2024-04-25T01:51:55.280 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T01:51:55.280 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_teuthology@teuthology --name teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi --archive /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672363 --verbose --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672363/orig.config.yaml 2024-04-25T01:51:55.334 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T01:51:55.424 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672363 branch: squid description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7672363' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 8528 sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 sleep_before_teardown: 0 subset: 122/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 targets: smithi077.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNiPBYem2L315tQD+IhE1fOSxEotITBoXUgKc1rgysRDbvkCxsMhj1zSuxQcFbVMI1ULi6K1eaQiYG2mxOFiyd8= smithi112.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOyb6/xA4fcJng6PBDhcYIPEWBfUWzN7SEeld1a6SkG9xPYbOJoVO/QWpe6kPHVkytVZqRRK4qgJ7qmgSXQTcEY= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-24_21:24:02 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-04-25T01:51:55.425 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa; will attempt to use it 2024-04-25T01:51:55.425 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa/tasks 2024-04-25T01:51:55.425 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T01:51:55.427 INFO:teuthology.task.internal:Checking packages... 2024-04-25T01:51:55.451 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd2c45d977142e024a59b68a8f1dce8f0b9840551' 2024-04-25T01:51:55.452 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T01:51:55.452 INFO:teuthology.packaging:ref: None 2024-04-25T01:51:55.452 INFO:teuthology.packaging:tag: None 2024-04-25T01:51:55.452 INFO:teuthology.packaging:branch: squid 2024-04-25T01:51:55.452 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:51:55.452 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-04-25T01:51:55.676 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2445.gd2c45d97 2024-04-25T01:51:55.677 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T01:51:55.686 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T01:51:55.687 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T01:51:55.700 INFO:teuthology.task.internal:Saving configuration 2024-04-25T01:51:55.720 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T01:51:55.731 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T01:51:55.755 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672363', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 01:46:49.343101', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNiPBYem2L315tQD+IhE1fOSxEotITBoXUgKc1rgysRDbvkCxsMhj1zSuxQcFbVMI1ULi6K1eaQiYG2mxOFiyd8='} 2024-04-25T01:51:55.775 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672363', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 01:46:49.344569', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOyb6/xA4fcJng6PBDhcYIPEWBfUWzN7SEeld1a6SkG9xPYbOJoVO/QWpe6kPHVkytVZqRRK4qgJ7qmgSXQTcEY='} 2024-04-25T01:51:55.775 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T01:51:55.787 INFO:teuthology.task.internal:roles: ubuntu@smithi077.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-04-25T01:51:55.787 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-04-25T01:51:55.787 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T01:51:55.867 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb6decb23a0>, signals=[15]) 2024-04-25T01:51:55.868 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T01:51:55.879 INFO:teuthology.task.internal:Opening connections... 2024-04-25T01:51:55.880 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T01:51:55.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T01:51:55.960 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi112.front.sepia.ceph.com 2024-04-25T01:51:55.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T01:51:56.039 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T01:51:56.050 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2024-04-25T01:51:56.069 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2024-04-25T01:51:56.069 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2024-04-25T01:51:56.126 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream" 2024-04-25T01:51:56.126 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="9" 2024-04-25T01:51:56.126 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos" 2024-04-25T01:51:56.126 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora" 2024-04-25T01:51:56.126 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="9" 2024-04-25T01:51:56.126 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el9" 2024-04-25T01:51:56.127 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T01:51:56.127 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2024-04-25T01:51:56.127 INFO:teuthology.orchestra.run.smithi077.stdout:LOGO="fedora-logo-icon" 2024-04-25T01:51:56.127 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T01:51:56.127 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/" 2024-04-25T01:51:56.127 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T01:51:56.127 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T01:51:56.127 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T01:51:56.128 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2024-04-25T01:51:56.153 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2024-04-25T01:51:56.170 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2024-04-25T01:51:56.170 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-04-25T01:51:56.227 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2024-04-25T01:51:56.227 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2024-04-25T01:51:56.227 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2024-04-25T01:51:56.227 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2024-04-25T01:51:56.227 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2024-04-25T01:51:56.228 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2024-04-25T01:51:56.228 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T01:51:56.228 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-04-25T01:51:56.228 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2024-04-25T01:51:56.228 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T01:51:56.228 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2024-04-25T01:51:56.228 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T01:51:56.228 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T01:51:56.228 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T01:51:56.228 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-04-25T01:51:56.251 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T01:51:56.265 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T01:51:56.330 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T01:51:56.330 DEBUG:teuthology.orchestra.run.smithi077:> test '!' -e /home/ubuntu/cephtest 2024-04-25T01:51:56.333 DEBUG:teuthology.orchestra.run.smithi112:> test '!' -e /home/ubuntu/cephtest 2024-04-25T01:51:56.350 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T01:51:56.356 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T01:51:56.356 DEBUG:teuthology.orchestra.run.smithi077:> test -z $(ls -A /var/lib/ceph) 2024-04-25T01:51:56.390 DEBUG:teuthology.orchestra.run.smithi112:> test -z $(ls -A /var/lib/ceph) 2024-04-25T01:51:56.513 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T01:51:56.710 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T01:51:56.824 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-25T01:51:56.824 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-25T01:51:56.825 DEBUG:teuthology.orchestra.run.smithi077:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T01:51:56.825 DEBUG:teuthology.orchestra.run.smithi112:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T01:51:56.841 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T01:51:56.842 DEBUG:teuthology.orchestra.run.smithi077:> uname -r 2024-04-25T01:51:56.842 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T01:51:56.843 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-04-25T01:51:56.899 INFO:teuthology.orchestra.run.smithi077.stdout:5.14.0-437.el9.x86_64 2024-04-25T01:51:56.899 INFO:teuthology.task.kernel:Running kernel on smithi077: 5.14.0-437.el9.x86_64 2024-04-25T01:51:56.899 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum install -y kernel 2024-04-25T01:51:56.901 INFO:teuthology.orchestra.run.smithi112.stdout:5.14.0-437.el9.x86_64 2024-04-25T01:51:56.901 INFO:teuthology.task.kernel:Running kernel on smithi112: 5.14.0-437.el9.x86_64 2024-04-25T01:51:56.901 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum install -y kernel 2024-04-25T01:51:59.059 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-04-25T01:51:59.873 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - BaseOS 6.1 MB/s | 8.0 MB 00:01 2024-04-25T01:52:02.138 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - AppStream 16 MB/s | 19 MB 00:01 2024-04-25T01:52:03.201 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - AppStream 6.2 MB/s | 19 MB 00:03 2024-04-25T01:52:06.241 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-04-25T01:52:07.744 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - CRB 7.1 MB/s | 6.2 MB 00:00 2024-04-25T01:52:07.842 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 16 kB 00:00 2024-04-25T01:52:09.635 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-04-25T01:52:09.653 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 16 kB 00:00 2024-04-25T01:52:11.073 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-25T01:52:14.635 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-04-25T01:52:16.179 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-25T01:52:16.517 INFO:teuthology.orchestra.run.smithi112.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T01:52:16.517 INFO:teuthology.orchestra.run.smithi112.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T01:52:16.604 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T01:52:16.605 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-04-25T01:52:16.606 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-25T01:52:16.723 DEBUG:teuthology.orchestra.run.smithi112:> echo no | sudo yum reinstall kernel || true 2024-04-25T01:52:17.223 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 01:52:14 AM UTC. 2024-04-25T01:52:17.352 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T01:52:17.364 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:52:17.364 INFO:teuthology.orchestra.run.smithi112.stdout: Package Architecture Version Repository Size 2024-04-25T01:52:17.364 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:52:17.364 INFO:teuthology.orchestra.run.smithi112.stdout:Reinstalling: 2024-04-25T01:52:17.364 INFO:teuthology.orchestra.run.smithi112.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T01:52:17.364 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:52:17.364 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-04-25T01:52:17.364 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:52:17.365 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:52:17.365 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 255 k 2024-04-25T01:52:17.365 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 0 2024-04-25T01:52:17.365 INFO:teuthology.orchestra.run.smithi112.stderr:Operation aborted. 2024-04-25T01:52:17.416 INFO:teuthology.orchestra.run.smithi112.stdout:Is this ok [y/N]: 2024-04-25T01:52:17.416 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum reinstall -y kernel || true 2024-04-25T01:52:17.911 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 01:52:14 AM UTC. 2024-04-25T01:52:18.002 INFO:teuthology.orchestra.run.smithi077.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T01:52:18.002 INFO:teuthology.orchestra.run.smithi077.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T01:52:18.029 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T01:52:18.030 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:52:18.030 INFO:teuthology.orchestra.run.smithi112.stdout: Package Architecture Version Repository Size 2024-04-25T01:52:18.030 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:52:18.030 INFO:teuthology.orchestra.run.smithi112.stdout:Reinstalling: 2024-04-25T01:52:18.030 INFO:teuthology.orchestra.run.smithi112.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T01:52:18.030 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:52:18.030 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-04-25T01:52:18.030 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:52:18.030 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:52:18.030 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 255 k 2024-04-25T01:52:18.030 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 0 2024-04-25T01:52:18.030 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-04-25T01:52:18.092 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:52:18.093 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-04-25T01:52:18.093 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:52:18.204 DEBUG:teuthology.orchestra.run.smithi077:> echo no | sudo yum reinstall kernel || true 2024-04-25T01:52:18.740 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:02 ago on Thu 25 Apr 2024 01:52:16 AM UTC. 2024-04-25T01:52:18.837 INFO:teuthology.orchestra.run.smithi112.stdout:kernel-5.14.0-437.el9.x86_64.rpm 342 kB/s | 255 kB 00:00 2024-04-25T01:52:18.837 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:52:18.838 INFO:teuthology.orchestra.run.smithi112.stdout:Total 316 kB/s | 255 kB 00:00 2024-04-25T01:52:18.854 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-04-25T01:52:18.857 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:52:18.871 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:52:18.871 INFO:teuthology.orchestra.run.smithi077.stdout: Package Architecture Version Repository Size 2024-04-25T01:52:18.871 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:52:18.871 INFO:teuthology.orchestra.run.smithi077.stdout:Reinstalling: 2024-04-25T01:52:18.871 INFO:teuthology.orchestra.run.smithi077.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T01:52:18.871 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:52:18.871 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-25T01:52:18.871 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:52:18.871 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:52:18.872 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 255 k 2024-04-25T01:52:18.872 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 0 2024-04-25T01:52:18.872 INFO:teuthology.orchestra.run.smithi077.stderr:Operation aborted. 2024-04-25T01:52:18.924 INFO:teuthology.orchestra.run.smithi077.stdout:Is this ok [y/N]: 2024-04-25T01:52:18.925 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum reinstall -y kernel || true 2024-04-25T01:52:19.045 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-04-25T01:52:19.045 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-04-25T01:52:19.050 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-04-25T01:52:19.051 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-04-25T01:52:19.188 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-04-25T01:52:19.264 INFO:teuthology.orchestra.run.smithi112.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T01:52:19.264 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T01:52:19.419 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 01:52:16 AM UTC. 2024-04-25T01:52:19.536 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:52:19.537 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:52:19.537 INFO:teuthology.orchestra.run.smithi077.stdout: Package Architecture Version Repository Size 2024-04-25T01:52:19.537 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:52:19.537 INFO:teuthology.orchestra.run.smithi077.stdout:Reinstalling: 2024-04-25T01:52:19.537 INFO:teuthology.orchestra.run.smithi077.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T01:52:19.537 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:52:19.537 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-25T01:52:19.537 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:52:19.538 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:52:19.538 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 255 k 2024-04-25T01:52:19.538 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 0 2024-04-25T01:52:19.538 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-25T01:52:19.915 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T01:52:19.915 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T01:52:20.199 INFO:teuthology.orchestra.run.smithi077.stdout:kernel-5.14.0-437.el9.x86_64.rpm 476 kB/s | 255 kB 00:00 2024-04-25T01:52:20.199 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:52:20.199 INFO:teuthology.orchestra.run.smithi077.stdout:Total 385 kB/s | 255 kB 00:00 2024-04-25T01:52:20.215 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-25T01:52:20.389 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-25T01:52:20.389 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-25T01:52:20.395 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-25T01:52:20.395 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-25T01:52:20.530 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-25T01:52:20.600 INFO:teuthology.orchestra.run.smithi077.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T01:52:20.600 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T01:52:20.614 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T01:52:20.615 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:52:20.615 INFO:teuthology.orchestra.run.smithi112.stdout:Reinstalled: 2024-04-25T01:52:20.615 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T01:52:20.615 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:52:20.615 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-25T01:52:20.808 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T01:52:20.854 INFO:teuthology.orchestra.run.smithi112.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T01:52:20.854 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T01:52:20.855 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T01:52:20.855 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-04-25T01:52:20.855 DEBUG:teuthology.orchestra.run.smithi112:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T01:52:20.889 INFO:teuthology.orchestra.run.smithi112.stdout:ttyS1 2024-04-25T01:52:20.912 DEBUG:teuthology.parallel:result is None 2024-04-25T01:52:21.339 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T01:52:21.339 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T01:52:22.066 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T01:52:22.067 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:52:22.067 INFO:teuthology.orchestra.run.smithi077.stdout:Reinstalled: 2024-04-25T01:52:22.067 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T01:52:22.067 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:52:22.067 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:52:22.226 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T01:52:22.313 INFO:teuthology.orchestra.run.smithi077.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T01:52:22.313 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T01:52:22.313 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T01:52:22.313 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-04-25T01:52:22.313 DEBUG:teuthology.orchestra.run.smithi077:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T01:52:22.350 INFO:teuthology.orchestra.run.smithi077.stdout:ttyS1 2024-04-25T01:52:22.370 DEBUG:teuthology.parallel:result is None 2024-04-25T01:52:22.370 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T01:52:22.378 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T01:52:22.378 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T01:52:22.413 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T01:52:22.431 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T01:52:22.441 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T01:52:22.449 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T01:52:22.450 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T01:52:22.468 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T01:52:22.503 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T01:52:22.511 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T01:52:22.511 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T01:52:22.529 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T01:52:22.557 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T01:52:22.566 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T01:52:22.627 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T01:52:22.642 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T01:52:22.642 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T01:52:22.651 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T01:52:22.651 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T01:52:22.653 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T01:52:22.684 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T01:52:22.697 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T01:52:22.698 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T01:52:22.718 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T01:52:22.740 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T01:52:22.810 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T01:52:22.861 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T01:52:22.943 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T01:52:22.981 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:52:22.981 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T01:52:23.044 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T01:52:23.087 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T01:52:23.140 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T01:52:23.223 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T01:52:23.265 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T01:52:23.266 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T01:52:23.332 DEBUG:teuthology.orchestra.run.smithi077:> sudo service rsyslog restart 2024-04-25T01:52:23.334 DEBUG:teuthology.orchestra.run.smithi112:> sudo service rsyslog restart 2024-04-25T01:52:23.368 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T01:52:23.421 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T01:52:23.810 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T01:52:23.821 INFO:teuthology.task.internal:Starting timer... 2024-04-25T01:52:23.821 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T01:52:23.835 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T01:52:23.877 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-25T01:52:23.878 DEBUG:teuthology.orchestra.run.smithi077:> sudo service auditd rotate 2024-04-25T01:52:23.927 INFO:teuthology.orchestra.run.smithi077.stdout:Rotating logs: 2024-04-25T01:52:23.928 DEBUG:teuthology.orchestra.run.smithi112:> sudo service auditd rotate 2024-04-25T01:52:23.978 INFO:teuthology.orchestra.run.smithi112.stdout:Rotating logs: 2024-04-25T01:52:23.981 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T01:52:23.982 DEBUG:teuthology.orchestra.run.smithi077:> /usr/sbin/getenforce 2024-04-25T01:52:24.001 INFO:teuthology.orchestra.run.smithi077.stdout:Permissive 2024-04-25T01:52:24.002 DEBUG:teuthology.orchestra.run.smithi112:> /usr/sbin/getenforce 2024-04-25T01:52:24.022 INFO:teuthology.orchestra.run.smithi112.stdout:Permissive 2024-04-25T01:52:24.022 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi077.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi112.front.sepia.ceph.com': 'permissive'} 2024-04-25T01:52:24.023 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T01:52:24.066 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T01:52:24.066 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T01:52:24.092 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T01:52:24.093 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T01:52:24.093 DEBUG:teuthology.orchestra.run.smithi077:> sudo /usr/sbin/setenforce permissive 2024-04-25T01:52:24.131 DEBUG:teuthology.orchestra.run.smithi112:> sudo /usr/sbin/setenforce permissive 2024-04-25T01:52:24.158 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T01:52:24.169 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-25T01:52:24.175 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-25T01:52:24.304 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T01:52:24.321 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T01:52:24.322 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi077.front.sepia.ceph.com,smithi112.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T01:55:50.869 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi077.front.sepia.ceph.com'), Remote(name='ubuntu@smithi112.front.sepia.ceph.com')] 2024-04-25T01:55:50.870 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-04-25T01:55:50.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T01:55:50.947 DEBUG:teuthology.orchestra.run.smithi077:> true 2024-04-25T01:55:51.033 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-04-25T01:55:51.034 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-25T01:55:51.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T01:55:51.123 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-04-25T01:55:51.201 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-25T01:55:51.201 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T01:55:51.211 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T01:55:51.212 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T01:55:51.212 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T01:55:51.215 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T01:55:51.215 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T01:55:51.240 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T01:55:51.254 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T01:55:51.269 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T01:55:51.277 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: ntpd: command not found 2024-04-25T01:55:51.283 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T01:55:51.287 INFO:teuthology.orchestra.run.smithi077.stdout:506 Cannot talk to daemon 2024-04-25T01:55:51.300 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T01:55:51.305 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: ntpd: command not found 2024-04-25T01:55:51.313 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T01:55:51.315 INFO:teuthology.orchestra.run.smithi112.stdout:506 Cannot talk to daemon 2024-04-25T01:55:51.328 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T01:55:51.340 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T01:55:51.366 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2024-04-25T01:55:51.370 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T01:55:51.370 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2024-04-25T01:55:51.370 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:55:51.370 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:55:51.370 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:55:51.370 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:55:51.394 INFO:teuthology.orchestra.run.smithi112.stderr:bash: line 1: ntpq: command not found 2024-04-25T01:55:51.398 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T01:55:51.398 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2024-04-25T01:55:51.398 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:55:51.398 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:55:51.398 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:55:51.398 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:55:51.399 INFO:teuthology.run_tasks:Running task install... 2024-04-25T01:55:51.407 DEBUG:teuthology.task.install:project ceph 2024-04-25T01:55:51.407 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}} 2024-04-25T01:55:51.407 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'} 2024-04-25T01:55:51.407 INFO:teuthology.task.install:Using flavor: default 2024-04-25T01:55:51.413 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T01:55:51.413 INFO:teuthology.task.install:extra packages: [] 2024-04-25T01:55:51.413 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'tag': None, 'wait_for_package': False} 2024-04-25T01:55:51.413 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T01:55:51.413 INFO:teuthology.packaging:ref: None 2024-04-25T01:55:51.414 INFO:teuthology.packaging:tag: None 2024-04-25T01:55:51.414 INFO:teuthology.packaging:branch: quincy 2024-04-25T01:55:51.414 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:55:51.414 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-04-25T01:55:51.416 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'tag': None, 'wait_for_package': False} 2024-04-25T01:55:51.416 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T01:55:51.416 INFO:teuthology.packaging:ref: None 2024-04-25T01:55:51.416 INFO:teuthology.packaging:tag: None 2024-04-25T01:55:51.416 INFO:teuthology.packaging:branch: quincy 2024-04-25T01:55:51.416 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:55:51.416 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-04-25T01:55:51.736 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/quincy/c61472c83ce76869b0fe076c19ed2f4bcc3fb4af/centos/9/flavors/default/ 2024-04-25T01:55:51.737 INFO:teuthology.task.install.rpm:Package version is 17.2.7-902.gc61472c8 2024-04-25T01:55:51.753 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/quincy/c61472c83ce76869b0fe076c19ed2f4bcc3fb4af/centos/9/flavors/default/ 2024-04-25T01:55:51.754 INFO:teuthology.task.install.rpm:Package version is 17.2.7-902.gc61472c8 2024-04-25T01:55:51.924 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/quincy/c61472c83ce76869b0fe076c19ed2f4bcc3fb4af/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/c61472c83ce76869b0fe076c19ed2f4bcc3fb4af/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/c61472c83ce76869b0fe076c19ed2f4bcc3fb4af/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T01:55:51.924 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T01:55:51.924 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T01:55:51.941 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/quincy/c61472c83ce76869b0fe076c19ed2f4bcc3fb4af/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/c61472c83ce76869b0fe076c19ed2f4bcc3fb4af/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/c61472c83ce76869b0fe076c19ed2f4bcc3fb4af/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T01:55:51.942 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:55:51.942 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T01:55:51.949 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-25T01:55:51.949 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T01:55:51.949 INFO:teuthology.packaging:ref: None 2024-04-25T01:55:51.949 INFO:teuthology.packaging:tag: None 2024-04-25T01:55:51.949 INFO:teuthology.packaging:branch: quincy 2024-04-25T01:55:51.949 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:55:51.949 DEBUG:teuthology.orchestra.run.smithi112:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T01:55:51.968 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-25T01:55:51.968 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T01:55:51.968 INFO:teuthology.packaging:ref: None 2024-04-25T01:55:51.968 INFO:teuthology.packaging:tag: None 2024-04-25T01:55:51.968 INFO:teuthology.packaging:branch: quincy 2024-04-25T01:55:51.968 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:55:51.968 DEBUG:teuthology.orchestra.run.smithi077:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T01:55:52.015 DEBUG:teuthology.orchestra.run.smithi112:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T01:55:52.034 DEBUG:teuthology.orchestra.run.smithi077:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T01:55:52.087 DEBUG:teuthology.orchestra.run.smithi112:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T01:55:52.108 DEBUG:teuthology.orchestra.run.smithi077:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T01:55:52.150 INFO:teuthology.orchestra.run.smithi112.stdout:check_obsoletes = 1 2024-04-25T01:55:52.153 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum clean all 2024-04-25T01:55:52.171 INFO:teuthology.orchestra.run.smithi077.stdout:check_obsoletes = 1 2024-04-25T01:55:52.173 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum clean all 2024-04-25T01:55:52.377 INFO:teuthology.orchestra.run.smithi112.stdout:48 files removed 2024-04-25T01:55:52.397 INFO:teuthology.orchestra.run.smithi077.stdout:48 files removed 2024-04-25T01:55:52.405 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-radosgw 2024-04-25T01:55:52.424 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-radosgw 2024-04-25T01:55:53.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph packages for x86_64 178 kB/s | 77 kB 00:00 2024-04-25T01:55:53.163 INFO:teuthology.orchestra.run.smithi112.stdout:ceph packages for x86_64 154 kB/s | 77 kB 00:00 2024-04-25T01:55:53.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph noarch packages 27 kB/s | 11 kB 00:00 2024-04-25T01:55:53.622 INFO:teuthology.orchestra.run.smithi112.stdout:ceph noarch packages 26 kB/s | 11 kB 00:00 2024-04-25T01:55:53.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph source packages 5.1 kB/s | 1.8 kB 00:00 2024-04-25T01:55:54.073 INFO:teuthology.orchestra.run.smithi112.stdout:ceph source packages 4.3 kB/s | 1.8 kB 00:00 2024-04-25T01:55:55.631 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.0 MB 00:01 2024-04-25T01:55:55.928 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.0 MB 00:01 2024-04-25T01:56:00.032 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - AppStream 5.7 MB/s | 19 MB 00:03 2024-04-25T01:56:06.299 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - CRB 2.3 MB/s | 6.2 MB 00:02 2024-04-25T01:56:07.975 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 16 kB 00:00 2024-04-25T01:56:10.120 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - AppStream 1.5 MB/s | 19 MB 00:13 2024-04-25T01:56:17.329 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - CRB 1.7 MB/s | 6.2 MB 00:03 2024-04-25T01:56:18.880 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 16 kB 00:00 2024-04-25T01:56:21.001 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:02 2024-04-25T01:56:26.382 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 8.3 kB/s | 1.7 kB 00:00 2024-04-25T01:56:28.535 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:56:28.537 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:56:28.537 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-04-25T01:56:28.537 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:56:28.537 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-25T01:56:28.537 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw x86_64 2:17.2.7-902.gc61472c8.el9 ceph 14 M 2024-04-25T01:56:28.537 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrading: 2024-04-25T01:56:28.537 INFO:teuthology.orchestra.run.smithi077.stdout: librados2 x86_64 2:17.2.7-902.gc61472c8.el9 ceph 3.1 M 2024-04-25T01:56:28.537 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1 x86_64 2:17.2.7-902.gc61472c8.el9 ceph 2.9 M 2024-04-25T01:56:28.537 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-04-25T01:56:28.538 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base x86_64 2:17.2.7-902.gc61472c8.el9 ceph 5.0 M 2024-04-25T01:56:28.538 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common x86_64 2:17.2.7-902.gc61472c8.el9 ceph 22 M 2024-04-25T01:56:28.538 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux x86_64 2:17.2.7-902.gc61472c8.el9 ceph 25 k 2024-04-25T01:56:28.538 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T01:56:28.538 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2 x86_64 2:17.2.7-902.gc61472c8.el9 ceph 637 k 2024-04-25T01:56:28.538 INFO:teuthology.orchestra.run.smithi077.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T01:56:28.538 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T01:56:28.538 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T01:56:28.538 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1 x86_64 2:17.2.7-902.gc61472c8.el9 ceph 457 k 2024-04-25T01:56:28.538 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T01:56:28.538 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2 x86_64 2:17.2.7-902.gc61472c8.el9 ceph 4.9 M 2024-04-25T01:56:28.538 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T01:56:28.539 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T01:56:28.539 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse x86_64 2:17.2.7-902.gc61472c8.el9 ceph 45 k 2024-04-25T01:56:28.539 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common x86_64 2:17.2.7-902.gc61472c8.el9 ceph 117 k 2024-04-25T01:56:28.539 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs x86_64 2:17.2.7-902.gc61472c8.el9 ceph 156 k 2024-04-25T01:56:28.539 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T01:56:28.539 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados x86_64 2:17.2.7-902.gc61472c8.el9 ceph 320 k 2024-04-25T01:56:28.539 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd x86_64 2:17.2.7-902.gc61472c8.el9 ceph 293 k 2024-04-25T01:56:28.539 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw x86_64 2:17.2.7-902.gc61472c8.el9 ceph 99 k 2024-04-25T01:56:28.539 INFO:teuthology.orchestra.run.smithi077.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T01:56:28.539 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:56:28.539 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-25T01:56:28.539 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:56:28.539 INFO:teuthology.orchestra.run.smithi077.stdout:Install 22 Packages 2024-04-25T01:56:28.539 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrade 2 Packages 2024-04-25T01:56:28.539 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:56:28.540 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 58 M 2024-04-25T01:56:28.540 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-25T01:56:28.845 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 1.0 MB/s | 21 MB 00:20 2024-04-25T01:56:29.258 INFO:teuthology.orchestra.run.smithi077.stdout:(1/24): ceph-base-17.2.7-902.gc61472c8.el9.x86_ 10 MB/s | 5.0 MB 00:00 2024-04-25T01:56:29.300 INFO:teuthology.orchestra.run.smithi077.stdout:(2/24): ceph-selinux-17.2.7-902.gc61472c8.el9.x 605 kB/s | 25 kB 00:00 2024-04-25T01:56:29.367 INFO:teuthology.orchestra.run.smithi077.stdout:(3/24): libcephfs2-17.2.7-902.gc61472c8.el9.x86 9.3 MB/s | 637 kB 00:00 2024-04-25T01:56:29.425 INFO:teuthology.orchestra.run.smithi077.stdout:(4/24): libradosstriper1-17.2.7-902.gc61472c8.e 7.7 MB/s | 457 kB 00:00 2024-04-25T01:56:29.709 INFO:teuthology.orchestra.run.smithi077.stdout:(5/24): librgw2-17.2.7-902.gc61472c8.el9.x86_64 17 MB/s | 4.9 MB 00:00 2024-04-25T01:56:29.759 INFO:teuthology.orchestra.run.smithi077.stdout:(6/24): python3-ceph-argparse-17.2.7-902.gc6147 903 kB/s | 45 kB 00:00 2024-04-25T01:56:29.843 INFO:teuthology.orchestra.run.smithi077.stdout:(7/24): python3-ceph-common-17.2.7-902.gc61472c 1.4 MB/s | 117 kB 00:00 2024-04-25T01:56:29.902 INFO:teuthology.orchestra.run.smithi077.stdout:(8/24): python3-cephfs-17.2.7-902.gc61472c8.el9 2.6 MB/s | 156 kB 00:00 2024-04-25T01:56:29.968 INFO:teuthology.orchestra.run.smithi077.stdout:(9/24): python3-rados-17.2.7-902.gc61472c8.el9. 4.7 MB/s | 320 kB 00:00 2024-04-25T01:56:30.036 INFO:teuthology.orchestra.run.smithi077.stdout:(10/24): python3-rbd-17.2.7-902.gc61472c8.el9.x 4.3 MB/s | 293 kB 00:00 2024-04-25T01:56:30.094 INFO:teuthology.orchestra.run.smithi077.stdout:(11/24): python3-rgw-17.2.7-902.gc61472c8.el9.x 1.7 MB/s | 99 kB 00:00 2024-04-25T01:56:30.286 INFO:teuthology.orchestra.run.smithi077.stdout:(12/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 836 kB/s | 160 kB 00:00 2024-04-25T01:56:30.336 INFO:teuthology.orchestra.run.smithi077.stdout:(13/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 906 kB/s | 45 kB 00:00 2024-04-25T01:56:30.536 INFO:teuthology.orchestra.run.smithi077.stdout:(14/24): librdkafka-1.6.1-102.el9.x86_64.rpm 3.2 MB/s | 662 kB 00:00 2024-04-25T01:56:30.645 INFO:teuthology.orchestra.run.smithi077.stdout:(15/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-04-25T01:56:30.712 INFO:teuthology.orchestra.run.smithi077.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 633 kB/s | 42 kB 00:00 2024-04-25T01:56:31.037 INFO:teuthology.orchestra.run.smithi077.stdout:(17/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 951 kB/s | 309 kB 00:00 2024-04-25T01:56:31.104 INFO:teuthology.orchestra.run.smithi077.stdout:(18/24): liboath-2.6.7-2.el9.x86_64.rpm 732 kB/s | 49 kB 00:00 2024-04-25T01:56:31.322 INFO:teuthology.orchestra.run.smithi077.stdout:(19/24): ceph-common-17.2.7-902.gc61472c8.el9.x 8.8 MB/s | 22 MB 00:02 2024-04-25T01:56:31.346 INFO:teuthology.orchestra.run.smithi077.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 278 kB/s | 67 kB 00:00 2024-04-25T01:56:31.597 INFO:teuthology.orchestra.run.smithi077.stdout:(21/24): librados2-17.2.7-902.gc61472c8.el9.x86 12 MB/s | 3.1 MB 00:00 2024-04-25T01:56:31.714 INFO:teuthology.orchestra.run.smithi077.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 4.0 MB/s | 1.6 MB 00:00 2024-04-25T01:56:31.781 INFO:teuthology.orchestra.run.smithi077.stdout:(23/24): librbd1-17.2.7-902.gc61472c8.el9.x86_6 16 MB/s | 2.9 MB 00:00 2024-04-25T01:56:32.073 INFO:teuthology.orchestra.run.smithi077.stdout:(24/24): ceph-radosgw-17.2.7-902.gc61472c8.el9. 4.3 MB/s | 14 MB 00:03 2024-04-25T01:56:32.075 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:56:32.076 INFO:teuthology.orchestra.run.smithi077.stdout:Total 16 MB/s | 58 MB 00:03 2024-04-25T01:56:32.133 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-25T01:56:32.164 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-25T01:56:32.164 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-25T01:56:32.596 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-25T01:56:32.597 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-25T01:56:33.842 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-04-25T01:56:33.887 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-25T01:56:34.276 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-04-25T01:56:34.333 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librados2-2:17.2.7-902.gc61472c8.el9.x86_64 2/26 2024-04-25T01:56:34.408 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:17.2.7-902.gc61472c8.el9.x86_64 2/26 2024-04-25T01:56:34.488 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rados-2:17.2.7-902.gc61472c8.el9.x86_64 3/26 2024-04-25T01:56:34.527 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs2-2:17.2.7-902.gc61472c8.el9.x86_64 4/26 2024-04-25T01:56:34.615 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephfs2-2:17.2.7-902.gc61472c8.el9.x86_64 4/26 2024-04-25T01:56:34.661 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-04-25T01:56:34.690 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-04-25T01:56:35.122 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-04-25T01:56:35.155 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librgw2-2:17.2.7-902.gc61472c8.el9.x86_64 8/26 2024-04-25T01:56:35.218 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librgw2-2:17.2.7-902.gc61472c8.el9.x86_64 8/26 2024-04-25T01:56:35.255 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-04-25T01:56:35.289 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-argparse-2:17.2.7-902.gc61472c8.el9.x 10/26 2024-04-25T01:56:35.326 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cephfs-2:17.2.7-902.gc61472c8.el9.x86_64 11/26 2024-04-25T01:56:35.397 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rgw-2:17.2.7-902.gc61472c8.el9.x86_64 12/26 2024-04-25T01:56:35.425 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libradosstriper1-2:17.2.7-902.gc61472c8.el9.x86_64 13/26 2024-04-25T01:56:35.473 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libradosstriper1-2:17.2.7-902.gc61472c8.el9.x86_64 13/26 2024-04-25T01:56:35.512 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-04-25T01:56:35.541 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-04-25T01:56:35.574 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-04-25T01:56:35.868 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-04-25T01:56:35.912 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librbd1-2:17.2.7-902.gc61472c8.el9.x86_64 18/26 2024-04-25T01:56:35.993 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:17.2.7-902.gc61472c8.el9.x86_64 18/26 2024-04-25T01:56:35.996 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T01:56:35.998 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:56:35.998 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-04-25T01:56:35.999 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:56:35.999 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-04-25T01:56:35.999 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw x86_64 2:17.2.7-902.gc61472c8.el9 ceph 14 M 2024-04-25T01:56:35.999 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrading: 2024-04-25T01:56:35.999 INFO:teuthology.orchestra.run.smithi112.stdout: librados2 x86_64 2:17.2.7-902.gc61472c8.el9 ceph 3.1 M 2024-04-25T01:56:35.999 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1 x86_64 2:17.2.7-902.gc61472c8.el9 ceph 2.9 M 2024-04-25T01:56:35.999 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-04-25T01:56:35.999 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base x86_64 2:17.2.7-902.gc61472c8.el9 ceph 5.0 M 2024-04-25T01:56:35.999 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common x86_64 2:17.2.7-902.gc61472c8.el9 ceph 22 M 2024-04-25T01:56:35.999 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux x86_64 2:17.2.7-902.gc61472c8.el9 ceph 25 k 2024-04-25T01:56:35.999 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T01:56:35.999 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2 x86_64 2:17.2.7-902.gc61472c8.el9 ceph 637 k 2024-04-25T01:56:35.999 INFO:teuthology.orchestra.run.smithi112.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T01:56:35.999 INFO:teuthology.orchestra.run.smithi112.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T01:56:35.999 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T01:56:36.000 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1 x86_64 2:17.2.7-902.gc61472c8.el9 ceph 457 k 2024-04-25T01:56:36.000 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T01:56:36.000 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2 x86_64 2:17.2.7-902.gc61472c8.el9 ceph 4.9 M 2024-04-25T01:56:36.000 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T01:56:36.000 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T01:56:36.000 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse x86_64 2:17.2.7-902.gc61472c8.el9 ceph 45 k 2024-04-25T01:56:36.000 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common x86_64 2:17.2.7-902.gc61472c8.el9 ceph 117 k 2024-04-25T01:56:36.000 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs x86_64 2:17.2.7-902.gc61472c8.el9 ceph 156 k 2024-04-25T01:56:36.000 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T01:56:36.000 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados x86_64 2:17.2.7-902.gc61472c8.el9 ceph 320 k 2024-04-25T01:56:36.000 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd x86_64 2:17.2.7-902.gc61472c8.el9 ceph 293 k 2024-04-25T01:56:36.000 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw x86_64 2:17.2.7-902.gc61472c8.el9 ceph 99 k 2024-04-25T01:56:36.000 INFO:teuthology.orchestra.run.smithi112.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T01:56:36.000 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:56:36.000 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-04-25T01:56:36.001 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:56:36.001 INFO:teuthology.orchestra.run.smithi112.stdout:Install 22 Packages 2024-04-25T01:56:36.001 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrade 2 Packages 2024-04-25T01:56:36.001 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:56:36.001 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 58 M 2024-04-25T01:56:36.001 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-04-25T01:56:36.067 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rbd-2:17.2.7-902.gc61472c8.el9.x86_64 19/26 2024-04-25T01:56:36.098 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-common-2:17.2.7-902.gc61472c8.el9.x86 20/26 2024-04-25T01:56:37.976 INFO:teuthology.orchestra.run.smithi112.stdout:(1/24): ceph-radosgw-17.2.7-902.gc61472c8.el9.x 9.3 MB/s | 14 MB 00:01 2024-04-25T01:56:38.017 INFO:teuthology.orchestra.run.smithi112.stdout:(2/24): ceph-selinux-17.2.7-902.gc61472c8.el9.x 609 kB/s | 25 kB 00:00 2024-04-25T01:56:38.176 INFO:teuthology.orchestra.run.smithi112.stdout:(3/24): libcephfs2-17.2.7-902.gc61472c8.el9.x86 3.9 MB/s | 637 kB 00:00 2024-04-25T01:56:38.402 INFO:teuthology.orchestra.run.smithi112.stdout:(4/24): ceph-common-17.2.7-902.gc61472c8.el9.x8 12 MB/s | 22 MB 00:01 2024-04-25T01:56:38.444 INFO:teuthology.orchestra.run.smithi112.stdout:(5/24): libradosstriper1-17.2.7-902.gc61472c8.e 1.7 MB/s | 457 kB 00:00 2024-04-25T01:56:38.542 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:17.2.7-902.gc61472c8.el9.x86_64 21/26 2024-04-25T01:56:38.560 INFO:teuthology.orchestra.run.smithi112.stdout:(6/24): ceph-base-17.2.7-902.gc61472c8.el9.x86_ 2.4 MB/s | 5.0 MB 00:02 2024-04-25T01:56:38.570 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-common-2:17.2.7-902.gc61472c8.el9.x86_64 21/26 2024-04-25T01:56:38.585 INFO:teuthology.orchestra.run.smithi112.stdout:(7/24): python3-ceph-argparse-17.2.7-902.gc6147 318 kB/s | 45 kB 00:00 2024-04-25T01:56:38.661 INFO:teuthology.orchestra.run.smithi112.stdout:(8/24): librgw2-17.2.7-902.gc61472c8.el9.x86_64 19 MB/s | 4.9 MB 00:00 2024-04-25T01:56:38.686 INFO:teuthology.orchestra.run.smithi112.stdout:(9/24): python3-ceph-common-17.2.7-902.gc61472c 937 kB/s | 117 kB 00:00 2024-04-25T01:56:38.711 INFO:teuthology.orchestra.run.smithi112.stdout:(10/24): python3-cephfs-17.2.7-902.gc61472c8.el 1.2 MB/s | 156 kB 00:00 2024-04-25T01:56:38.736 INFO:teuthology.orchestra.run.smithi112.stdout:(11/24): python3-rados-17.2.7-902.gc61472c8.el9 4.2 MB/s | 320 kB 00:00 2024-04-25T01:56:38.762 INFO:teuthology.orchestra.run.smithi112.stdout:(12/24): python3-rgw-17.2.7-902.gc61472c8.el9.x 1.9 MB/s | 99 kB 00:00 2024-04-25T01:56:38.795 INFO:teuthology.orchestra.run.smithi112.stdout:(13/24): python3-rbd-17.2.7-902.gc61472c8.el9.x 2.6 MB/s | 293 kB 00:00 2024-04-25T01:56:39.083 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:17.2.7-902.gc61472c8.el9.x86_64 21/26 2024-04-25T01:56:39.124 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-base-2:17.2.7-902.gc61472c8.el9.x86_64 22/26 2024-04-25T01:56:39.201 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-base-2:17.2.7-902.gc61472c8.el9.x86_64 22/26 2024-04-25T01:56:39.201 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T01:56:39.201 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T01:56:39.201 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:56:39.233 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-selinux-2:17.2.7-902.gc61472c8.el9.x86_64 23/26 2024-04-25T01:56:39.496 INFO:teuthology.orchestra.run.smithi112.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 62 kB/s | 45 kB 00:00 2024-04-25T01:56:39.813 INFO:teuthology.orchestra.run.smithi112.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 149 kB/s | 160 kB 00:01 2024-04-25T01:56:39.938 INFO:teuthology.orchestra.run.smithi112.stdout:(16/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 662 kB/s | 292 kB 00:00 2024-04-25T01:56:40.130 INFO:teuthology.orchestra.run.smithi112.stdout:(17/24): python3-prettytable-0.7.2-27.el9.noarc 133 kB/s | 42 kB 00:00 2024-04-25T01:56:40.297 INFO:teuthology.orchestra.run.smithi112.stdout:(18/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 862 kB/s | 309 kB 00:00 2024-04-25T01:56:40.322 INFO:teuthology.orchestra.run.smithi112.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 253 kB/s | 49 kB 00:00 2024-04-25T01:56:40.356 INFO:teuthology.orchestra.run.smithi112.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-04-25T01:56:40.431 INFO:teuthology.orchestra.run.smithi112.stdout:(21/24): librdkafka-1.6.1-102.el9.x86_64.rpm 405 kB/s | 662 kB 00:01 2024-04-25T01:56:40.581 INFO:teuthology.orchestra.run.smithi112.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 6.1 MB/s | 1.6 MB 00:00 2024-04-25T01:56:40.723 INFO:teuthology.orchestra.run.smithi112.stdout:(23/24): librbd1-17.2.7-902.gc61472c8.el9.x86_6 10 MB/s | 2.9 MB 00:00 2024-04-25T01:56:41.099 INFO:teuthology.orchestra.run.smithi112.stdout:(24/24): librados2-17.2.7-902.gc61472c8.el9.x86 4.1 MB/s | 3.1 MB 00:00 2024-04-25T01:56:41.101 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:56:41.102 INFO:teuthology.orchestra.run.smithi112.stdout:Total 11 MB/s | 58 MB 00:05 2024-04-25T01:56:41.163 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-04-25T01:56:41.196 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-04-25T01:56:41.196 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-04-25T01:56:41.634 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-04-25T01:56:41.635 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-04-25T01:56:42.890 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-04-25T01:56:43.265 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-04-25T01:56:43.318 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librados2-2:17.2.7-902.gc61472c8.el9.x86_64 2/26 2024-04-25T01:56:43.409 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:17.2.7-902.gc61472c8.el9.x86_64 2/26 2024-04-25T01:56:43.488 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rados-2:17.2.7-902.gc61472c8.el9.x86_64 3/26 2024-04-25T01:56:43.511 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs2-2:17.2.7-902.gc61472c8.el9.x86_64 4/26 2024-04-25T01:56:43.582 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephfs2-2:17.2.7-902.gc61472c8.el9.x86_64 4/26 2024-04-25T01:56:43.629 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-04-25T01:56:43.658 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-04-25T01:56:44.092 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-04-25T01:56:44.122 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librgw2-2:17.2.7-902.gc61472c8.el9.x86_64 8/26 2024-04-25T01:56:44.185 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librgw2-2:17.2.7-902.gc61472c8.el9.x86_64 8/26 2024-04-25T01:56:44.214 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-04-25T01:56:44.257 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-argparse-2:17.2.7-902.gc61472c8.el9.x 10/26 2024-04-25T01:56:44.294 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cephfs-2:17.2.7-902.gc61472c8.el9.x86_64 11/26 2024-04-25T01:56:44.356 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rgw-2:17.2.7-902.gc61472c8.el9.x86_64 12/26 2024-04-25T01:56:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libradosstriper1-2:17.2.7-902.gc61472c8.el9.x86_64 13/26 2024-04-25T01:56:44.449 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libradosstriper1-2:17.2.7-902.gc61472c8.el9.x86_64 13/26 2024-04-25T01:56:44.488 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-04-25T01:56:44.517 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-04-25T01:56:44.550 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-04-25T01:56:44.845 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-04-25T01:56:44.979 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librbd1-2:17.2.7-902.gc61472c8.el9.x86_64 18/26 2024-04-25T01:56:45.069 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:17.2.7-902.gc61472c8.el9.x86_64 18/26 2024-04-25T01:56:45.143 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rbd-2:17.2.7-902.gc61472c8.el9.x86_64 19/26 2024-04-25T01:56:45.174 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-common-2:17.2.7-902.gc61472c8.el9.x86 20/26 2024-04-25T01:56:47.571 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:17.2.7-902.gc61472c8.el9.x86_64 21/26 2024-04-25T01:56:47.603 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-common-2:17.2.7-902.gc61472c8.el9.x86_64 21/26 2024-04-25T01:56:48.112 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:17.2.7-902.gc61472c8.el9.x86_64 21/26 2024-04-25T01:56:48.167 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-base-2:17.2.7-902.gc61472c8.el9.x86_64 22/26 2024-04-25T01:56:48.265 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-base-2:17.2.7-902.gc61472c8.el9.x86_64 22/26 2024-04-25T01:56:48.266 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T01:56:48.266 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T01:56:48.266 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:56:48.293 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-selinux-2:17.2.7-902.gc61472c8.el9.x86_64 23/26 2024-04-25T01:56:48.370 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-selinux-2:17.2.7-902.gc61472c8.el9.x86_64 23/26 2024-04-25T01:56:48.370 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /sys 2024-04-25T01:56:48.370 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /proc 2024-04-25T01:56:48.370 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /mnt 2024-04-25T01:56:48.370 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /var/tmp 2024-04-25T01:56:48.370 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /home 2024-04-25T01:56:48.370 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /root 2024-04-25T01:56:48.370 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /tmp 2024-04-25T01:56:48.370 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:56:49.601 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-radosgw-2:17.2.7-902.gc61472c8.el9.x86_64 24/26 2024-04-25T01:56:49.679 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-902.gc61472c8.el9.x86_64 24/26 2024-04-25T01:56:49.679 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:49.679 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T01:56:49.679 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T01:56:49.679 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T01:56:49.679 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:56:49.680 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-25T01:56:49.771 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-25T01:56:49.771 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-25T01:56:51.016 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-25T01:56:51.016 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-base-2:17.2.7-902.gc61472c8.el9.x86_64 1/26 2024-04-25T01:56:51.016 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-common-2:17.2.7-902.gc61472c8.el9.x86_64 2/26 2024-04-25T01:56:51.016 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-radosgw-2:17.2.7-902.gc61472c8.el9.x86_64 3/26 2024-04-25T01:56:51.016 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-selinux-2:17.2.7-902.gc61472c8.el9.x86_64 4/26 2024-04-25T01:56:51.017 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs2-2:17.2.7-902.gc61472c8.el9.x86_64 5/26 2024-04-25T01:56:51.017 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libradosstriper1-2:17.2.7-902.gc61472c8.el9.x86_64 6/26 2024-04-25T01:56:51.017 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librgw2-2:17.2.7-902.gc61472c8.el9.x86_64 7/26 2024-04-25T01:56:51.017 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-argparse-2:17.2.7-902.gc61472c8.el9.x 8/26 2024-04-25T01:56:51.017 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-common-2:17.2.7-902.gc61472c8.el9.x86 9/26 2024-04-25T01:56:51.017 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cephfs-2:17.2.7-902.gc61472c8.el9.x86_64 10/26 2024-04-25T01:56:51.017 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rados-2:17.2.7-902.gc61472c8.el9.x86_64 11/26 2024-04-25T01:56:51.017 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rbd-2:17.2.7-902.gc61472c8.el9.x86_64 12/26 2024-04-25T01:56:51.017 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rgw-2:17.2.7-902.gc61472c8.el9.x86_64 13/26 2024-04-25T01:56:51.017 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-04-25T01:56:51.017 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-04-25T01:56:51.017 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-04-25T01:56:51.017 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-04-25T01:56:51.018 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-04-25T01:56:51.018 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-04-25T01:56:51.018 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-04-25T01:56:51.018 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-04-25T01:56:51.018 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-04-25T01:56:51.018 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:17.2.7-902.gc61472c8.el9.x86_64 23/26 2024-04-25T01:56:51.018 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-04-25T01:56:51.018 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:17.2.7-902.gc61472c8.el9.x86_64 25/26 2024-04-25T01:56:51.667 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-04-25T01:56:51.668 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:56:51.668 INFO:teuthology.orchestra.run.smithi077.stdout:Upgraded: 2024-04-25T01:56:51.668 INFO:teuthology.orchestra.run.smithi077.stdout: librados2-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:56:51.668 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:56:51.668 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-25T01:56:51.668 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:56:51.668 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:56:51.668 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:56:51.668 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:56:51.668 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T01:56:51.668 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:56:51.668 INFO:teuthology.orchestra.run.smithi077.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T01:56:51.668 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T01:56:51.668 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T01:56:51.669 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:56:51.669 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T01:56:51.669 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:56:51.669 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T01:56:51.669 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T01:56:51.669 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:56:51.669 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:56:51.669 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:56:51.669 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T01:56:51.669 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:56:51.669 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:56:51.669 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:56:51.669 INFO:teuthology.orchestra.run.smithi077.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T01:56:51.669 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:56:51.670 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:56:51.946 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-test 2024-04-25T01:56:52.513 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:26 ago on Thu 25 Apr 2024 01:56:26 AM UTC. 2024-04-25T01:56:52.634 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:56:52.635 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:56:52.635 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-04-25T01:56:52.635 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:56:52.635 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-25T01:56:52.635 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test x86_64 2:17.2.7-902.gc61472c8.el9 ceph 48 M 2024-04-25T01:56:52.635 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-04-25T01:56:52.635 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite x86_64 2:17.2.7-902.gc61472c8.el9 ceph 163 k 2024-04-25T01:56:52.635 INFO:teuthology.orchestra.run.smithi077.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T01:56:52.635 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T01:56:52.635 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:56:52.636 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-25T01:56:52.636 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:56:52.636 INFO:teuthology.orchestra.run.smithi077.stdout:Install 4 Packages 2024-04-25T01:56:52.636 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:56:52.636 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 48 M 2024-04-25T01:56:52.636 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 192 M 2024-04-25T01:56:52.636 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-25T01:56:53.164 INFO:teuthology.orchestra.run.smithi077.stdout:(1/4): libcephsqlite-17.2.7-902.gc61472c8.el9.x 421 kB/s | 163 kB 00:00 2024-04-25T01:56:53.366 INFO:teuthology.orchestra.run.smithi077.stdout:(2/4): socat-1.7.4.1-5.el9.x86_64.rpm 517 kB/s | 305 kB 00:00 2024-04-25T01:56:53.543 INFO:teuthology.orchestra.run.smithi077.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 168 kB/s | 64 kB 00:00 2024-04-25T01:56:55.268 INFO:teuthology.orchestra.run.smithi077.stdout:(4/4): ceph-test-17.2.7-902.gc61472c8.el9.x86_6 19 MB/s | 48 MB 00:02 2024-04-25T01:56:55.270 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:56:55.270 INFO:teuthology.orchestra.run.smithi077.stdout:Total 18 MB/s | 48 MB 00:02 2024-04-25T01:56:55.296 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-25T01:56:55.315 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-25T01:56:55.315 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-25T01:56:55.677 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-25T01:56:55.677 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-25T01:56:56.182 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-25T01:56:56.285 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-04-25T01:56:56.325 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-04-25T01:56:56.353 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephsqlite-2:17.2.7-902.gc61472c8.el9.x86_64 3/4 2024-04-25T01:56:57.570 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-selinux-2:17.2.7-902.gc61472c8.el9.x86_64 23/26 2024-04-25T01:56:57.570 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /sys 2024-04-25T01:56:57.570 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /proc 2024-04-25T01:56:57.570 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /mnt 2024-04-25T01:56:57.570 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /var/tmp 2024-04-25T01:56:57.570 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /home 2024-04-25T01:56:57.570 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /root 2024-04-25T01:56:57.570 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /tmp 2024-04-25T01:56:57.570 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:56:58.861 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-radosgw-2:17.2.7-902.gc61472c8.el9.x86_64 24/26 2024-04-25T01:56:58.938 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-902.gc61472c8.el9.x86_64 24/26 2024-04-25T01:56:58.938 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:58.938 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T01:56:58.938 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T01:56:58.939 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T01:56:58.939 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:56:58.940 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-25T01:56:59.031 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-25T01:56:59.031 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-25T01:57:00.278 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-25T01:57:00.278 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-base-2:17.2.7-902.gc61472c8.el9.x86_64 1/26 2024-04-25T01:57:00.278 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-common-2:17.2.7-902.gc61472c8.el9.x86_64 2/26 2024-04-25T01:57:00.278 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-radosgw-2:17.2.7-902.gc61472c8.el9.x86_64 3/26 2024-04-25T01:57:00.278 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-selinux-2:17.2.7-902.gc61472c8.el9.x86_64 4/26 2024-04-25T01:57:00.279 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs2-2:17.2.7-902.gc61472c8.el9.x86_64 5/26 2024-04-25T01:57:00.279 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libradosstriper1-2:17.2.7-902.gc61472c8.el9.x86_64 6/26 2024-04-25T01:57:00.279 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librgw2-2:17.2.7-902.gc61472c8.el9.x86_64 7/26 2024-04-25T01:57:00.279 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-argparse-2:17.2.7-902.gc61472c8.el9.x 8/26 2024-04-25T01:57:00.279 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-common-2:17.2.7-902.gc61472c8.el9.x86 9/26 2024-04-25T01:57:00.279 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cephfs-2:17.2.7-902.gc61472c8.el9.x86_64 10/26 2024-04-25T01:57:00.279 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rados-2:17.2.7-902.gc61472c8.el9.x86_64 11/26 2024-04-25T01:57:00.279 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rbd-2:17.2.7-902.gc61472c8.el9.x86_64 12/26 2024-04-25T01:57:00.279 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rgw-2:17.2.7-902.gc61472c8.el9.x86_64 13/26 2024-04-25T01:57:00.279 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-04-25T01:57:00.279 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-04-25T01:57:00.279 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-04-25T01:57:00.279 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-04-25T01:57:00.279 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-04-25T01:57:00.280 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-04-25T01:57:00.280 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-04-25T01:57:00.280 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-04-25T01:57:00.280 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-04-25T01:57:00.280 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:17.2.7-902.gc61472c8.el9.x86_64 23/26 2024-04-25T01:57:00.280 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-04-25T01:57:00.280 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:17.2.7-902.gc61472c8.el9.x86_64 25/26 2024-04-25T01:57:00.668 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephsqlite-2:17.2.7-902.gc61472c8.el9.x86_64 3/4 2024-04-25T01:57:00.741 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-test-2:17.2.7-902.gc61472c8.el9.x86_64 4/4 2024-04-25T01:57:00.920 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-04-25T01:57:00.920 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:00.920 INFO:teuthology.orchestra.run.smithi112.stdout:Upgraded: 2024-04-25T01:57:00.921 INFO:teuthology.orchestra.run.smithi112.stdout: librados2-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:00.921 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:00.921 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-04-25T01:57:00.921 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:00.921 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:00.921 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:00.921 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:00.921 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T01:57:00.921 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:00.921 INFO:teuthology.orchestra.run.smithi112.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T01:57:00.921 INFO:teuthology.orchestra.run.smithi112.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T01:57:00.921 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T01:57:00.921 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:00.921 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T01:57:00.922 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:00.922 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T01:57:00.922 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T01:57:00.922 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:00.922 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:00.922 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:00.922 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T01:57:00.922 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:00.922 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:00.922 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:00.922 INFO:teuthology.orchestra.run.smithi112.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T01:57:00.922 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:00.922 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-25T01:57:01.228 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-test 2024-04-25T01:57:01.762 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:28 ago on Thu 25 Apr 2024 01:56:33 AM UTC. 2024-04-25T01:57:01.883 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T01:57:01.884 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:57:01.884 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-04-25T01:57:01.884 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:57:01.884 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-04-25T01:57:01.884 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test x86_64 2:17.2.7-902.gc61472c8.el9 ceph 48 M 2024-04-25T01:57:01.884 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-04-25T01:57:01.884 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite x86_64 2:17.2.7-902.gc61472c8.el9 ceph 163 k 2024-04-25T01:57:01.884 INFO:teuthology.orchestra.run.smithi112.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T01:57:01.884 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T01:57:01.884 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:01.884 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-04-25T01:57:01.885 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:57:01.885 INFO:teuthology.orchestra.run.smithi112.stdout:Install 4 Packages 2024-04-25T01:57:01.885 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:01.885 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 48 M 2024-04-25T01:57:01.885 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 192 M 2024-04-25T01:57:01.885 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-04-25T01:57:02.389 INFO:teuthology.orchestra.run.smithi112.stdout:(1/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.3 MB/s | 305 kB 00:00 2024-04-25T01:57:02.440 INFO:teuthology.orchestra.run.smithi112.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-25T01:57:02.541 INFO:teuthology.orchestra.run.smithi112.stdout:(3/4): libcephsqlite-17.2.7-902.gc61472c8.el9.x 424 kB/s | 163 kB 00:00 2024-04-25T01:57:02.944 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-test-2:17.2.7-902.gc61472c8.el9.x86_64 4/4 2024-04-25T01:57:02.944 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-test-2:17.2.7-902.gc61472c8.el9.x86_64 1/4 2024-04-25T01:57:02.944 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephsqlite-2:17.2.7-902.gc61472c8.el9.x86_64 2/4 2024-04-25T01:57:02.944 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-04-25T01:57:03.225 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-04-25T01:57:03.225 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:03.225 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-25T01:57:03.225 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:03.225 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:03.225 INFO:teuthology.orchestra.run.smithi077.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T01:57:03.226 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T01:57:03.226 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:03.226 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:57:03.498 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph 2024-04-25T01:57:04.010 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:38 ago on Thu 25 Apr 2024 01:56:26 AM UTC. 2024-04-25T01:57:04.133 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:57:04.135 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:04.135 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-04-25T01:57:04.135 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:04.135 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-25T01:57:04.135 INFO:teuthology.orchestra.run.smithi077.stdout: ceph x86_64 2:17.2.7-902.gc61472c8.el9 ceph 6.5 k 2024-04-25T01:57:04.135 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-04-25T01:57:04.135 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds x86_64 2:17.2.7-902.gc61472c8.el9 ceph 2.1 M 2024-04-25T01:57:04.136 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr x86_64 2:17.2.7-902.gc61472c8.el9 ceph 1.4 M 2024-04-25T01:57:04.136 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 240 k 2024-04-25T01:57:04.136 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon x86_64 2:17.2.7-902.gc61472c8.el9 ceph 3.9 M 2024-04-25T01:57:04.136 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd x86_64 2:17.2.7-902.gc61472c8.el9 ceph 15 M 2024-04-25T01:57:04.136 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T01:57:04.136 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T01:57:04.136 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T01:57:04.136 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T01:57:04.136 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T01:57:04.136 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T01:57:04.136 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T01:57:04.136 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T01:57:04.136 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T01:57:04.136 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T01:57:04.136 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T01:57:04.137 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T01:57:04.137 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T01:57:04.137 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T01:57:04.137 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T01:57:04.137 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T01:57:04.137 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T01:57:04.137 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T01:57:04.137 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T01:57:04.137 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T01:57:04.137 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T01:57:04.137 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T01:57:04.137 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T01:57:04.137 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T01:57:04.137 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T01:57:04.138 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T01:57:04.138 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T01:57:04.138 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:04.138 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-25T01:57:04.138 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:04.138 INFO:teuthology.orchestra.run.smithi077.stdout:Install 33 Packages 2024-04-25T01:57:04.138 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:04.139 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 27 M 2024-04-25T01:57:04.139 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 96 M 2024-04-25T01:57:04.139 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-25T01:57:04.451 INFO:teuthology.orchestra.run.smithi112.stdout:(4/4): ceph-test-17.2.7-902.gc61472c8.el9.x86_6 21 MB/s | 48 MB 00:02 2024-04-25T01:57:04.453 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:57:04.454 INFO:teuthology.orchestra.run.smithi112.stdout:Total 19 MB/s | 48 MB 00:02 2024-04-25T01:57:04.480 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-04-25T01:57:04.500 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-04-25T01:57:04.500 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-04-25T01:57:04.865 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-04-25T01:57:04.865 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-04-25T01:57:05.145 INFO:teuthology.orchestra.run.smithi077.stdout:(1/33): ceph-17.2.7-902.gc61472c8.el9.x86_64.rp 27 kB/s | 6.5 kB 00:00 2024-04-25T01:57:05.345 INFO:teuthology.orchestra.run.smithi077.stdout:(2/33): ceph-mds-17.2.7-902.gc61472c8.el9.x86_6 4.7 MB/s | 2.1 MB 00:00 2024-04-25T01:57:05.403 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-04-25T01:57:05.485 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-04-25T01:57:05.534 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-04-25T01:57:05.561 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephsqlite-2:17.2.7-902.gc61472c8.el9.x86_64 3/4 2024-04-25T01:57:05.787 INFO:teuthology.orchestra.run.smithi077.stdout:(3/33): ceph-mgr-17.2.7-902.gc61472c8.el9.x86_6 1.6 MB/s | 1.4 MB 00:00 2024-04-25T01:57:05.979 INFO:teuthology.orchestra.run.smithi077.stdout:(4/33): ceph-mgr-modules-core-17.2.7-902.gc6147 1.2 MB/s | 240 kB 00:00 2024-04-25T01:57:06.138 INFO:teuthology.orchestra.run.smithi077.stdout:(5/33): ceph-osd-17.2.7-902.gc61472c8.el9.x86_6 19 MB/s | 15 MB 00:00 2024-04-25T01:57:06.646 INFO:teuthology.orchestra.run.smithi077.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 380 kB/s | 253 kB 00:00 2024-04-25T01:57:06.754 INFO:teuthology.orchestra.run.smithi077.stdout:(7/33): python3-ply-3.11-14.el9.noarch.rpm 984 kB/s | 106 kB 00:00 2024-04-25T01:57:06.888 INFO:teuthology.orchestra.run.smithi077.stdout:(8/33): ceph-mon-17.2.7-902.gc61472c8.el9.x86_6 2.2 MB/s | 3.9 MB 00:01 2024-04-25T01:57:06.914 INFO:teuthology.orchestra.run.smithi077.stdout:(9/33): python3-pycparser-2.20-6.el9.noarch.rpm 852 kB/s | 135 kB 00:00 2024-04-25T01:57:07.005 INFO:teuthology.orchestra.run.smithi077.stdout:(10/33): python3-cryptography-36.0.1-4.el9.x86_ 1.4 MB/s | 1.2 MB 00:00 2024-04-25T01:57:07.031 INFO:teuthology.orchestra.run.smithi077.stdout:(11/33): python3-urllib3-1.26.5-5.el9.noarch.rp 1.8 MB/s | 215 kB 00:00 2024-04-25T01:57:07.106 INFO:teuthology.orchestra.run.smithi077.stdout:(12/33): python3-markupsafe-1.1.1-12.el9.x86_64 465 kB/s | 35 kB 00:00 2024-04-25T01:57:07.139 INFO:teuthology.orchestra.run.smithi077.stdout:(13/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-04-25T01:57:07.156 INFO:teuthology.orchestra.run.smithi077.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-25T01:57:07.173 INFO:teuthology.orchestra.run.smithi077.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2024-04-25T01:57:07.290 INFO:teuthology.orchestra.run.smithi077.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 326 kB/s | 43 kB 00:00 2024-04-25T01:57:07.341 INFO:teuthology.orchestra.run.smithi077.stdout:(17/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.0 MB/s | 172 kB 00:00 2024-04-25T01:57:07.366 INFO:teuthology.orchestra.run.smithi077.stdout:(18/33): python3-requests-2.25.1-8.el9.noarch.r 261 kB/s | 125 kB 00:00 2024-04-25T01:57:07.383 INFO:teuthology.orchestra.run.smithi077.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 254 kB/s | 11 kB 00:00 2024-04-25T01:57:07.416 INFO:teuthology.orchestra.run.smithi077.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 352 kB/s | 18 kB 00:00 2024-04-25T01:57:07.450 INFO:teuthology.orchestra.run.smithi077.stdout:(21/33): python3-cherrypy-18.6.1-2.el9.noarch.r 2.2 MB/s | 358 kB 00:00 2024-04-25T01:57:07.475 INFO:teuthology.orchestra.run.smithi077.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 332 kB/s | 19 kB 00:00 2024-04-25T01:57:07.501 INFO:teuthology.orchestra.run.smithi077.stdout:(23/33): python3-jaraco-collections-3.0.0-8.el9 197 kB/s | 23 kB 00:00 2024-04-25T01:57:07.526 INFO:teuthology.orchestra.run.smithi077.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 260 kB/s | 20 kB 00:00 2024-04-25T01:57:07.551 INFO:teuthology.orchestra.run.smithi077.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 614 kB/s | 46 kB 00:00 2024-04-25T01:57:07.576 INFO:teuthology.orchestra.run.smithi077.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-04-25T01:57:07.602 INFO:teuthology.orchestra.run.smithi077.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 324 kB/s | 16 kB 00:00 2024-04-25T01:57:07.627 INFO:teuthology.orchestra.run.smithi077.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-04-25T01:57:07.652 INFO:teuthology.orchestra.run.smithi077.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 714 kB/s | 36 kB 00:00 2024-04-25T01:57:07.678 INFO:teuthology.orchestra.run.smithi077.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-04-25T01:57:07.703 INFO:teuthology.orchestra.run.smithi077.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-25T01:57:07.729 INFO:teuthology.orchestra.run.smithi077.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 400 kB/s | 20 kB 00:00 2024-04-25T01:57:07.754 INFO:teuthology.orchestra.run.smithi077.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.1 MB/s | 427 kB 00:00 2024-04-25T01:57:07.755 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:57:07.755 INFO:teuthology.orchestra.run.smithi077.stdout:Total 7.5 MB/s | 27 MB 00:03 2024-04-25T01:57:07.872 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-25T01:57:07.909 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-25T01:57:07.909 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-25T01:57:08.180 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-25T01:57:08.180 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-25T01:57:09.345 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-25T01:57:09.406 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-04-25T01:57:09.438 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-04-25T01:57:09.471 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-04-25T01:57:09.590 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-04-25T01:57:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-04-25T01:57:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-04-25T01:57:09.751 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-04-25T01:57:09.781 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-04-25T01:57:09.815 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-04-25T01:57:09.849 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-04-25T01:57:09.898 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-04-25T01:57:09.932 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-04-25T01:57:09.947 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephsqlite-2:17.2.7-902.gc61472c8.el9.x86_64 3/4 2024-04-25T01:57:09.967 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-04-25T01:57:10.005 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-04-25T01:57:10.024 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-test-2:17.2.7-902.gc61472c8.el9.x86_64 4/4 2024-04-25T01:57:10.079 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-04-25T01:57:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-04-25T01:57:10.313 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-04-25T01:57:10.366 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-04-25T01:57:10.405 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-04-25T01:57:10.462 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-04-25T01:57:10.518 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-04-25T01:57:10.706 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-04-25T01:57:10.760 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-04-25T01:57:10.829 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-04-25T01:57:10.917 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-04-25T01:57:10.958 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-04-25T01:57:11.074 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-04-25T01:57:11.221 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-902.gc61472c8.el9.n 28/33 2024-04-25T01:57:11.253 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-2:17.2.7-902.gc61472c8.el9.x86_64 29/33 2024-04-25T01:57:11.277 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-2:17.2.7-902.gc61472c8.el9.x86_64 29/33 2024-04-25T01:57:11.277 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:57:11.277 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T01:57:11.277 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T01:57:11.277 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T01:57:11.277 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:12.156 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-test-2:17.2.7-902.gc61472c8.el9.x86_64 4/4 2024-04-25T01:57:12.156 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-test-2:17.2.7-902.gc61472c8.el9.x86_64 1/4 2024-04-25T01:57:12.156 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephsqlite-2:17.2.7-902.gc61472c8.el9.x86_64 2/4 2024-04-25T01:57:12.156 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-04-25T01:57:12.432 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-04-25T01:57:12.432 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:12.432 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-04-25T01:57:12.432 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:12.432 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:12.432 INFO:teuthology.orchestra.run.smithi112.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T01:57:12.432 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T01:57:12.432 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:12.433 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-25T01:57:12.700 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph 2024-04-25T01:57:12.732 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-osd-2:17.2.7-902.gc61472c8.el9.x86_64 30/33 2024-04-25T01:57:12.759 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-osd-2:17.2.7-902.gc61472c8.el9.x86_64 30/33 2024-04-25T01:57:12.759 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:57:12.759 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T01:57:12.759 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T01:57:12.759 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T01:57:12.760 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:13.124 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mon-2:17.2.7-902.gc61472c8.el9.x86_64 31/33 2024-04-25T01:57:13.147 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mon-2:17.2.7-902.gc61472c8.el9.x86_64 31/33 2024-04-25T01:57:13.147 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:57:13.147 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T01:57:13.147 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T01:57:13.147 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T01:57:13.147 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:13.206 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:40 ago on Thu 25 Apr 2024 01:56:33 AM UTC. 2024-04-25T01:57:13.332 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T01:57:13.334 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:57:13.335 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-04-25T01:57:13.335 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:57:13.335 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-04-25T01:57:13.335 INFO:teuthology.orchestra.run.smithi112.stdout: ceph x86_64 2:17.2.7-902.gc61472c8.el9 ceph 6.5 k 2024-04-25T01:57:13.335 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-04-25T01:57:13.335 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds x86_64 2:17.2.7-902.gc61472c8.el9 ceph 2.1 M 2024-04-25T01:57:13.335 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr x86_64 2:17.2.7-902.gc61472c8.el9 ceph 1.4 M 2024-04-25T01:57:13.335 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 240 k 2024-04-25T01:57:13.335 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon x86_64 2:17.2.7-902.gc61472c8.el9 ceph 3.9 M 2024-04-25T01:57:13.335 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd x86_64 2:17.2.7-902.gc61472c8.el9 ceph 15 M 2024-04-25T01:57:13.335 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T01:57:13.335 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T01:57:13.335 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T01:57:13.336 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T01:57:13.336 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T01:57:13.336 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T01:57:13.336 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T01:57:13.336 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T01:57:13.336 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T01:57:13.336 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T01:57:13.336 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T01:57:13.336 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T01:57:13.336 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T01:57:13.336 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T01:57:13.336 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T01:57:13.336 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T01:57:13.336 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T01:57:13.337 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T01:57:13.337 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T01:57:13.337 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T01:57:13.337 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T01:57:13.337 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T01:57:13.337 INFO:teuthology.orchestra.run.smithi112.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T01:57:13.337 INFO:teuthology.orchestra.run.smithi112.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T01:57:13.337 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T01:57:13.337 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T01:57:13.337 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T01:57:13.337 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:13.337 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-04-25T01:57:13.337 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:57:13.337 INFO:teuthology.orchestra.run.smithi112.stdout:Install 33 Packages 2024-04-25T01:57:13.337 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:13.338 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 27 M 2024-04-25T01:57:13.338 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 96 M 2024-04-25T01:57:13.338 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-04-25T01:57:13.341 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mds-2:17.2.7-902.gc61472c8.el9.x86_64 32/33 2024-04-25T01:57:13.364 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mds-2:17.2.7-902.gc61472c8.el9.x86_64 32/33 2024-04-25T01:57:13.364 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:57:13.364 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T01:57:13.364 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T01:57:13.364 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T01:57:13.364 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:13.428 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-2:17.2.7-902.gc61472c8.el9.x86_64 33/33 2024-04-25T01:57:14.644 INFO:teuthology.orchestra.run.smithi112.stdout:(1/33): ceph-17.2.7-902.gc61472c8.el9.x86_64.rp 20 kB/s | 6.5 kB 00:00 2024-04-25T01:57:14.694 INFO:teuthology.orchestra.run.smithi112.stdout:(2/33): ceph-mds-17.2.7-902.gc61472c8.el9.x86_6 5.5 MB/s | 2.1 MB 00:00 2024-04-25T01:57:14.951 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-2:17.2.7-902.gc61472c8.el9.x86_64 33/33 2024-04-25T01:57:14.951 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-2:17.2.7-902.gc61472c8.el9.x86_64 1/33 2024-04-25T01:57:14.951 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mds-2:17.2.7-902.gc61472c8.el9.x86_64 2/33 2024-04-25T01:57:14.951 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-2:17.2.7-902.gc61472c8.el9.x86_64 3/33 2024-04-25T01:57:14.951 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mon-2:17.2.7-902.gc61472c8.el9.x86_64 4/33 2024-04-25T01:57:14.952 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-osd-2:17.2.7-902.gc61472c8.el9.x86_64 5/33 2024-04-25T01:57:14.952 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-902.gc61472c8.el9.n 6/33 2024-04-25T01:57:14.952 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-04-25T01:57:14.952 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-04-25T01:57:14.952 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-04-25T01:57:14.952 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-04-25T01:57:14.952 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-04-25T01:57:14.952 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-04-25T01:57:14.952 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-04-25T01:57:14.952 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-04-25T01:57:14.952 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-04-25T01:57:14.952 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-04-25T01:57:14.952 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-04-25T01:57:14.953 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-04-25T01:57:14.953 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-04-25T01:57:14.953 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-04-25T01:57:14.953 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-04-25T01:57:14.953 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-04-25T01:57:14.953 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-04-25T01:57:14.953 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-04-25T01:57:14.953 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-04-25T01:57:14.953 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-04-25T01:57:14.953 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-04-25T01:57:14.953 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-04-25T01:57:14.953 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-04-25T01:57:14.953 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-04-25T01:57:14.954 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-04-25T01:57:14.954 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-04-25T01:57:15.428 INFO:teuthology.orchestra.run.smithi112.stdout:(3/33): ceph-osd-17.2.7-902.gc61472c8.el9.x86_6 21 MB/s | 15 MB 00:00 2024-04-25T01:57:15.478 INFO:teuthology.orchestra.run.smithi112.stdout:(4/33): ceph-mgr-modules-core-17.2.7-902.gc6147 4.7 MB/s | 240 kB 00:00 2024-04-25T01:57:15.881 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-04-25T01:57:15.881 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:15.881 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-25T01:57:15.881 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:15.881 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:15.881 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:15.881 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T01:57:15.881 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:15.881 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:15.882 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T01:57:15.882 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T01:57:15.882 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T01:57:15.882 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T01:57:15.882 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T01:57:15.882 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T01:57:15.882 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T01:57:15.882 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T01:57:15.882 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T01:57:15.882 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T01:57:15.882 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T01:57:15.882 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T01:57:15.883 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T01:57:15.883 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T01:57:15.883 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T01:57:15.883 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T01:57:15.883 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T01:57:15.883 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T01:57:15.883 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T01:57:15.883 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T01:57:15.883 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T01:57:15.883 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T01:57:15.883 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T01:57:15.883 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T01:57:15.883 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T01:57:15.884 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T01:57:15.884 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T01:57:15.884 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:15.884 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:57:15.953 INFO:teuthology.orchestra.run.smithi112.stdout:(5/33): ceph-mgr-17.2.7-902.gc61472c8.el9.x86_6 884 kB/s | 1.4 MB 00:01 2024-04-25T01:57:16.137 INFO:teuthology.orchestra.run.smithi112.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 384 kB/s | 253 kB 00:00 2024-04-25T01:57:16.188 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-base 2024-04-25T01:57:16.379 INFO:teuthology.orchestra.run.smithi112.stdout:(7/33): python3-ply-3.11-14.el9.noarch.rpm 441 kB/s | 106 kB 00:00 2024-04-25T01:57:16.662 INFO:teuthology.orchestra.run.smithi112.stdout:(8/33): python3-pycparser-2.20-6.el9.noarch.rpm 477 kB/s | 135 kB 00:00 2024-04-25T01:57:16.698 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:50 ago on Thu 25 Apr 2024 01:56:26 AM UTC. 2024-04-25T01:57:16.777 INFO:teuthology.orchestra.run.smithi077.stdout:Package ceph-base-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T01:57:16.818 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:57:16.819 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-04-25T01:57:16.819 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:57:16.887 INFO:teuthology.orchestra.run.smithi112.stdout:(9/33): python3-cryptography-36.0.1-4.el9.x86_6 1.3 MB/s | 1.2 MB 00:00 2024-04-25T01:57:16.889 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install cephadm 2024-04-25T01:57:16.946 INFO:teuthology.orchestra.run.smithi112.stdout:(10/33): python3-requests-2.25.1-8.el9.noarch.r 440 kB/s | 125 kB 00:00 2024-04-25T01:57:17.230 INFO:teuthology.orchestra.run.smithi112.stdout:(11/33): python3-urllib3-1.26.5-5.el9.noarch.rp 627 kB/s | 215 kB 00:00 2024-04-25T01:57:17.272 INFO:teuthology.orchestra.run.smithi112.stdout:(12/33): python3-mako-1.1.4-6.el9.noarch.rpm 529 kB/s | 172 kB 00:00 2024-04-25T01:57:17.389 INFO:teuthology.orchestra.run.smithi112.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 219 kB/s | 35 kB 00:00 2024-04-25T01:57:17.393 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:51 ago on Thu 25 Apr 2024 01:56:26 AM UTC. 2024-04-25T01:57:17.464 INFO:teuthology.orchestra.run.smithi112.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 265 kB/s | 51 kB 00:00 2024-04-25T01:57:17.511 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:57:17.512 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:17.512 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-04-25T01:57:17.512 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:17.512 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-25T01:57:17.512 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 82 k 2024-04-25T01:57:17.512 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:17.513 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-25T01:57:17.513 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:17.513 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-04-25T01:57:17.513 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:17.513 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 82 k 2024-04-25T01:57:17.513 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 372 k 2024-04-25T01:57:17.513 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-25T01:57:17.589 INFO:teuthology.orchestra.run.smithi112.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 208 kB/s | 42 kB 00:00 2024-04-25T01:57:17.764 INFO:teuthology.orchestra.run.smithi112.stdout:(16/33): ceph-mon-17.2.7-902.gc61472c8.el9.x86_ 1.3 MB/s | 3.9 MB 00:03 2024-04-25T01:57:17.841 INFO:teuthology.orchestra.run.smithi077.stdout:cephadm-17.2.7-902.gc61472c8.el9.noarch.rpm 250 kB/s | 82 kB 00:00 2024-04-25T01:57:17.842 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:57:17.842 INFO:teuthology.orchestra.run.smithi077.stdout:Total 249 kB/s | 82 kB 00:00 2024-04-25T01:57:17.842 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-25T01:57:17.848 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-25T01:57:17.848 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-25T01:57:17.849 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-25T01:57:17.850 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-25T01:57:17.857 INFO:teuthology.orchestra.run.smithi112.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 111 kB/s | 43 kB 00:00 2024-04-25T01:57:17.924 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-25T01:57:17.965 INFO:teuthology.orchestra.run.smithi112.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 99 kB/s | 11 kB 00:00 2024-04-25T01:57:18.082 INFO:teuthology.orchestra.run.smithi112.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 151 kB/s | 18 kB 00:00 2024-04-25T01:57:18.191 INFO:teuthology.orchestra.run.smithi112.stdout:(20/33): python3-jaraco-collections-3.0.0-8.el9 213 kB/s | 23 kB 00:00 2024-04-25T01:57:18.308 INFO:teuthology.orchestra.run.smithi112.stdout:(21/33): python3-jaraco-functools-3.5.0-2.el9.n 166 kB/s | 19 kB 00:00 2024-04-25T01:57:18.330 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephadm-2:17.2.7-902.gc61472c8.el9.noarch 1/1 2024-04-25T01:57:18.341 INFO:teuthology.orchestra.run.smithi112.stdout:(22/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 228 kB/s | 172 kB 00:00 2024-04-25T01:57:18.416 INFO:teuthology.orchestra.run.smithi112.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 181 kB/s | 20 kB 00:00 2024-04-25T01:57:18.418 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephadm-2:17.2.7-902.gc61472c8.el9.noarch 1/1 2024-04-25T01:57:18.569 INFO:teuthology.orchestra.run.smithi112.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 204 kB/s | 46 kB 00:00 2024-04-25T01:57:18.717 INFO:teuthology.orchestra.run.smithi112.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 262 kB/s | 79 kB 00:00 2024-04-25T01:57:18.743 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephadm-2:17.2.7-902.gc61472c8.el9.noarch 1/1 2024-04-25T01:57:18.834 INFO:teuthology.orchestra.run.smithi112.stdout:(26/33): python3-portend-3.1.0-2.el9.noarch.rpm 141 kB/s | 16 kB 00:00 2024-04-25T01:57:18.893 INFO:teuthology.orchestra.run.smithi112.stdout:(27/33): python3-cherrypy-18.6.1-2.el9.noarch.r 318 kB/s | 358 kB 00:01 2024-04-25T01:57:18.959 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephadm-2:17.2.7-902.gc61472c8.el9.noarch 1/1 2024-04-25T01:57:18.959 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:18.959 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-25T01:57:18.960 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T01:57:18.960 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:18.960 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:57:19.018 INFO:teuthology.orchestra.run.smithi112.stdout:(28/33): python3-tempora-5.0.0-2.el9.noarch.rpm 286 kB/s | 36 kB 00:00 2024-04-25T01:57:19.135 INFO:teuthology.orchestra.run.smithi112.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 299 kB/s | 90 kB 00:00 2024-04-25T01:57:19.161 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-immutable-object-cache 2024-04-25T01:57:19.177 INFO:teuthology.orchestra.run.smithi112.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 448 kB/s | 272 kB 00:00 2024-04-25T01:57:19.310 INFO:teuthology.orchestra.run.smithi112.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 150 kB/s | 20 kB 00:00 2024-04-25T01:57:19.569 INFO:teuthology.orchestra.run.smithi112.stdout:(32/33): python3-webob-1.8.7-6.el9.noarch.rpm 417 kB/s | 230 kB 00:00 2024-04-25T01:57:19.673 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:53 ago on Thu 25 Apr 2024 01:56:26 AM UTC. 2024-04-25T01:57:19.794 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:57:19.795 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:19.795 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repo Size 2024-04-25T01:57:19.795 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:19.795 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-25T01:57:19.795 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-902.gc61472c8.el9 ceph 137 k 2024-04-25T01:57:19.795 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:19.795 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-25T01:57:19.795 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:19.795 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-04-25T01:57:19.796 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:19.796 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 137 k 2024-04-25T01:57:19.796 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 379 k 2024-04-25T01:57:19.796 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-25T01:57:20.094 INFO:teuthology.orchestra.run.smithi112.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 445 kB/s | 427 kB 00:00 2024-04-25T01:57:20.097 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:57:20.097 INFO:teuthology.orchestra.run.smithi112.stdout:Total 4.0 MB/s | 27 MB 00:06 2024-04-25T01:57:20.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-immutable-object-cache-17.2.7-902.gc61472c 399 kB/s | 137 kB 00:00 2024-04-25T01:57:20.141 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:57:20.141 INFO:teuthology.orchestra.run.smithi077.stdout:Total 397 kB/s | 137 kB 00:00 2024-04-25T01:57:20.141 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-25T01:57:20.149 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-25T01:57:20.149 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-25T01:57:20.204 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-25T01:57:20.205 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-25T01:57:20.214 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-04-25T01:57:20.251 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-04-25T01:57:20.251 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-04-25T01:57:20.343 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-25T01:57:20.416 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-902.gc61472c8.e 1/1 2024-04-25T01:57:20.440 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-902.gc61472c8.e 1/1 2024-04-25T01:57:20.440 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:57:20.440 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T01:57:20.440 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:20.518 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-04-25T01:57:20.519 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-04-25T01:57:21.259 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-902.gc61472c8.e 1/1 2024-04-25T01:57:21.260 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:21.260 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-25T01:57:21.260 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:21.260 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:21.260 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:57:21.441 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-mgr 2024-04-25T01:57:21.643 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-04-25T01:57:21.722 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-04-25T01:57:21.754 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-04-25T01:57:21.787 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-04-25T01:57:21.878 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-04-25T01:57:21.950 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:55 ago on Thu 25 Apr 2024 01:56:26 AM UTC. 2024-04-25T01:57:21.957 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-04-25T01:57:21.998 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-04-25T01:57:22.030 INFO:teuthology.orchestra.run.smithi077.stdout:Package ceph-mgr-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T01:57:22.033 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-04-25T01:57:22.063 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-04-25T01:57:22.073 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:57:22.074 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-04-25T01:57:22.074 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:57:22.098 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-04-25T01:57:22.131 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-04-25T01:57:22.156 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-mgr-dashboard 2024-04-25T01:57:22.171 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-04-25T01:57:22.206 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-04-25T01:57:22.249 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-04-25T01:57:22.287 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-04-25T01:57:22.361 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-04-25T01:57:22.519 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-04-25T01:57:22.595 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-04-25T01:57:22.649 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-04-25T01:57:22.664 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:56 ago on Thu 25 Apr 2024 01:56:26 AM UTC. 2024-04-25T01:57:22.687 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-04-25T01:57:22.744 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-04-25T01:57:22.798 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:57:22.799 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:22.799 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-04-25T01:57:22.799 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:22.799 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-25T01:57:22.799 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 3.4 M 2024-04-25T01:57:22.799 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-04-25T01:57:22.799 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 24 k 2024-04-25T01:57:22.799 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 15 k 2024-04-25T01:57:22.799 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-04-25T01:57:22.799 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T01:57:22.800 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T01:57:22.800 INFO:teuthology.orchestra.run.smithi077.stdout:Installing weak dependencies: 2024-04-25T01:57:22.800 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-04-25T01:57:22.800 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:22.800 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-25T01:57:22.800 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:22.800 INFO:teuthology.orchestra.run.smithi077.stdout:Install 7 Packages 2024-04-25T01:57:22.800 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:22.801 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-04-25T01:57:22.801 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 3.7 M 2024-04-25T01:57:22.801 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 80 M 2024-04-25T01:57:22.801 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-25T01:57:22.985 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-04-25T01:57:23.041 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-04-25T01:57:23.111 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-04-25T01:57:23.199 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-04-25T01:57:23.240 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-04-25T01:57:23.261 INFO:teuthology.orchestra.run.smithi077.stdout:(1/7): ceph-prometheus-alerts-17.2.7-902.gc6147 67 kB/s | 15 kB 00:00 2024-04-25T01:57:23.286 INFO:teuthology.orchestra.run.smithi077.stdout:(2/7): ceph-grafana-dashboards-17.2.7-902.gc614 100 kB/s | 24 kB 00:00 2024-04-25T01:57:23.355 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-04-25T01:57:23.404 INFO:teuthology.orchestra.run.smithi077.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 64 kB/s | 9.0 kB 00:00 2024-04-25T01:57:23.446 INFO:teuthology.orchestra.run.smithi077.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 258 kB/s | 41 kB 00:00 2024-04-25T01:57:23.488 INFO:teuthology.orchestra.run.smithi077.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 367 kB/s | 31 kB 00:00 2024-04-25T01:57:23.513 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-902.gc61472c8.el9.n 28/33 2024-04-25T01:57:23.543 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-2:17.2.7-902.gc61472c8.el9.x86_64 29/33 2024-04-25T01:57:23.568 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-2:17.2.7-902.gc61472c8.el9.x86_64 29/33 2024-04-25T01:57:23.568 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:57:23.568 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T01:57:23.568 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T01:57:23.568 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T01:57:23.568 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:23.754 INFO:teuthology.orchestra.run.smithi077.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 611 kB/s | 188 kB 00:00 2024-04-25T01:57:24.254 INFO:teuthology.orchestra.run.smithi077.stdout:(7/7): ceph-mgr-dashboard-17.2.7-902.gc61472c8. 2.8 MB/s | 3.4 MB 00:01 2024-04-25T01:57:24.256 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:57:24.257 INFO:teuthology.orchestra.run.smithi077.stdout:Total 2.5 MB/s | 3.7 MB 00:01 2024-04-25T01:57:24.257 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-25T01:57:24.265 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-25T01:57:24.265 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-25T01:57:24.326 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-25T01:57:24.329 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-25T01:57:24.630 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-25T01:57:24.689 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-04-25T01:57:24.723 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-04-25T01:57:24.770 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-04-25T01:57:24.802 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-04-25T01:57:24.831 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-902.gc61472c8.el9.no 5/7 2024-04-25T01:57:24.877 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-osd-2:17.2.7-902.gc61472c8.el9.x86_64 30/33 2024-04-25T01:57:24.903 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-osd-2:17.2.7-902.gc61472c8.el9.x86_64 30/33 2024-04-25T01:57:24.903 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:57:24.903 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T01:57:24.903 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T01:57:24.903 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T01:57:24.903 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:25.269 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mon-2:17.2.7-902.gc61472c8.el9.x86_64 31/33 2024-04-25T01:57:25.292 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mon-2:17.2.7-902.gc61472c8.el9.x86_64 31/33 2024-04-25T01:57:25.292 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:57:25.292 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T01:57:25.292 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T01:57:25.293 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T01:57:25.293 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mds-2:17.2.7-902.gc61472c8.el9.x86_64 32/33 2024-04-25T01:57:25.518 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mds-2:17.2.7-902.gc61472c8.el9.x86_64 32/33 2024-04-25T01:57:25.518 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:57:25.518 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T01:57:25.518 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T01:57:25.518 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T01:57:25.518 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:25.581 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-2:17.2.7-902.gc61472c8.el9.x86_64 33/33 2024-04-25T01:57:25.827 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-902.gc61472c8.el9.n 6/7 2024-04-25T01:57:25.868 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-902.gc61472c8.el9.noarch 7/7 2024-04-25T01:57:26.903 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-902.gc61472c8.el9.noarch 7/7 2024-04-25T01:57:26.903 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-902.gc61472c8.el9.n 1/7 2024-04-25T01:57:26.903 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-902.gc61472c8.el9.noarch 2/7 2024-04-25T01:57:26.904 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-902.gc61472c8.el9.no 3/7 2024-04-25T01:57:26.904 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-04-25T01:57:26.904 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-04-25T01:57:26.904 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-04-25T01:57:27.160 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-04-25T01:57:27.160 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:27.161 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-25T01:57:27.161 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T01:57:27.161 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T01:57:27.161 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T01:57:27.161 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-04-25T01:57:27.161 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-04-25T01:57:27.161 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T01:57:27.161 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T01:57:27.161 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:27.161 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:57:27.257 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-2:17.2.7-902.gc61472c8.el9.x86_64 33/33 2024-04-25T01:57:27.257 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-2:17.2.7-902.gc61472c8.el9.x86_64 1/33 2024-04-25T01:57:27.257 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mds-2:17.2.7-902.gc61472c8.el9.x86_64 2/33 2024-04-25T01:57:27.257 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-2:17.2.7-902.gc61472c8.el9.x86_64 3/33 2024-04-25T01:57:27.257 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mon-2:17.2.7-902.gc61472c8.el9.x86_64 4/33 2024-04-25T01:57:27.257 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-osd-2:17.2.7-902.gc61472c8.el9.x86_64 5/33 2024-04-25T01:57:27.257 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-902.gc61472c8.el9.n 6/33 2024-04-25T01:57:27.257 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-04-25T01:57:27.257 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-04-25T01:57:27.257 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-04-25T01:57:27.257 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-04-25T01:57:27.258 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-04-25T01:57:27.258 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-04-25T01:57:27.258 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-04-25T01:57:27.258 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-04-25T01:57:27.258 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-04-25T01:57:27.258 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-04-25T01:57:27.258 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-04-25T01:57:27.258 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-04-25T01:57:27.258 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-04-25T01:57:27.258 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-04-25T01:57:27.258 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-04-25T01:57:27.259 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-04-25T01:57:27.259 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-04-25T01:57:27.259 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-04-25T01:57:27.259 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-04-25T01:57:27.259 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-04-25T01:57:27.259 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-04-25T01:57:27.259 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-04-25T01:57:27.259 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-04-25T01:57:27.259 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-04-25T01:57:27.259 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-04-25T01:57:27.260 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-04-25T01:57:27.342 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-25T01:57:27.852 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:01 ago on Thu 25 Apr 2024 01:56:26 AM UTC. 2024-04-25T01:57:27.977 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:57:27.977 INFO:teuthology.orchestra.run.smithi077.stdout:====================================================================================== 2024-04-25T01:57:27.977 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-04-25T01:57:27.977 INFO:teuthology.orchestra.run.smithi077.stdout:====================================================================================== 2024-04-25T01:57:27.977 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-25T01:57:27.978 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 7.4 M 2024-04-25T01:57:27.978 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-04-25T01:57:27.978 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T01:57:27.978 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T01:57:27.978 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T01:57:27.978 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T01:57:27.978 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T01:57:27.978 INFO:teuthology.orchestra.run.smithi077.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T01:57:27.978 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T01:57:27.978 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T01:57:27.978 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T01:57:27.978 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T01:57:27.978 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T01:57:27.979 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:27.979 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-25T01:57:27.979 INFO:teuthology.orchestra.run.smithi077.stdout:====================================================================================== 2024-04-25T01:57:27.979 INFO:teuthology.orchestra.run.smithi077.stdout:Install 12 Packages 2024-04-25T01:57:27.979 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:27.979 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 38 M 2024-04-25T01:57:27.979 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 209 M 2024-04-25T01:57:27.980 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-25T01:57:28.066 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-04-25T01:57:28.066 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:28.066 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-04-25T01:57:28.066 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:28.066 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:28.066 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:28.066 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T01:57:28.066 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:28.066 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:28.067 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T01:57:28.067 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T01:57:28.067 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T01:57:28.067 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T01:57:28.067 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T01:57:28.067 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T01:57:28.067 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T01:57:28.068 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T01:57:28.068 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T01:57:28.068 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T01:57:28.068 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T01:57:28.068 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T01:57:28.068 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T01:57:28.068 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T01:57:28.068 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T01:57:28.068 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T01:57:28.068 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T01:57:28.068 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T01:57:28.068 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T01:57:28.068 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T01:57:28.068 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T01:57:28.069 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T01:57:28.069 INFO:teuthology.orchestra.run.smithi112.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T01:57:28.069 INFO:teuthology.orchestra.run.smithi112.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T01:57:28.069 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T01:57:28.069 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T01:57:28.069 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T01:57:28.069 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:28.069 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-25T01:57:28.398 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-base 2024-04-25T01:57:28.546 INFO:teuthology.orchestra.run.smithi077.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 580 kB/s | 195 kB 00:00 2024-04-25T01:57:28.638 INFO:teuthology.orchestra.run.smithi077.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 356 kB/s | 33 kB 00:00 2024-04-25T01:57:28.663 INFO:teuthology.orchestra.run.smithi077.stdout:(3/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.7 MB/s | 803 kB 00:00 2024-04-25T01:57:28.756 INFO:teuthology.orchestra.run.smithi077.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 198 kB/s | 18 kB 00:00 2024-04-25T01:57:28.847 INFO:teuthology.orchestra.run.smithi077.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 14 MB/s | 3.0 MB 00:00 2024-04-25T01:57:28.873 INFO:teuthology.orchestra.run.smithi077.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 301 kB/s | 35 kB 00:00 2024-04-25T01:57:28.907 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:55 ago on Thu 25 Apr 2024 01:56:33 AM UTC. 2024-04-25T01:57:28.981 INFO:teuthology.orchestra.run.smithi077.stdout:(7/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 35 MB/s | 4.7 MB 00:00 2024-04-25T01:57:28.985 INFO:teuthology.orchestra.run.smithi112.stdout:Package ceph-base-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T01:57:29.015 INFO:teuthology.orchestra.run.smithi077.stdout:(8/12): python3-devel-3.9.18-3.el9.x86_64.rpm 1.7 MB/s | 244 kB 00:00 2024-04-25T01:57:29.025 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T01:57:29.026 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-04-25T01:57:29.026 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-25T01:57:29.080 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install cephadm 2024-04-25T01:57:29.149 INFO:teuthology.orchestra.run.smithi077.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 31 MB/s | 5.1 MB 00:00 2024-04-25T01:57:29.174 INFO:teuthology.orchestra.run.smithi077.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.5 MB/s | 250 kB 00:00 2024-04-25T01:57:29.282 INFO:teuthology.orchestra.run.smithi077.stdout:(11/12): ceph-mgr-diskprediction-local-17.2.7-9 6.9 MB/s | 7.4 MB 00:01 2024-04-25T01:57:29.558 INFO:teuthology.orchestra.run.smithi077.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2024-04-25T01:57:29.558 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:57:29.559 INFO:teuthology.orchestra.run.smithi077.stdout:Total 24 MB/s | 38 MB 00:01 2024-04-25T01:57:29.585 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:56 ago on Thu 25 Apr 2024 01:56:33 AM UTC. 2024-04-25T01:57:29.706 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T01:57:29.707 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:57:29.707 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-04-25T01:57:29.707 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:57:29.707 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-04-25T01:57:29.707 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 82 k 2024-04-25T01:57:29.707 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:29.707 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-04-25T01:57:29.707 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:57:29.707 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2024-04-25T01:57:29.707 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:29.708 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 82 k 2024-04-25T01:57:29.708 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 372 k 2024-04-25T01:57:29.708 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-04-25T01:57:29.902 INFO:teuthology.orchestra.run.smithi112.stdout:cephadm-17.2.7-902.gc61472c8.el9.noarch.rpm 422 kB/s | 82 kB 00:00 2024-04-25T01:57:29.903 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:57:29.903 INFO:teuthology.orchestra.run.smithi112.stdout:Total 419 kB/s | 82 kB 00:00 2024-04-25T01:57:29.903 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-04-25T01:57:29.906 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-25T01:57:29.908 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-04-25T01:57:29.908 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-04-25T01:57:29.910 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-04-25T01:57:29.910 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-04-25T01:57:29.934 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-25T01:57:29.935 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-25T01:57:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-04-25T01:57:30.334 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-25T01:57:30.334 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-25T01:57:30.449 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephadm-2:17.2.7-902.gc61472c8.el9.noarch 1/1 2024-04-25T01:57:30.530 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephadm-2:17.2.7-902.gc61472c8.el9.noarch 1/1 2024-04-25T01:57:30.841 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephadm-2:17.2.7-902.gc61472c8.el9.noarch 1/1 2024-04-25T01:57:31.070 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephadm-2:17.2.7-902.gc61472c8.el9.noarch 1/1 2024-04-25T01:57:31.071 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:31.071 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-04-25T01:57:31.071 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T01:57:31.071 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:31.071 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-25T01:57:31.077 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-25T01:57:31.154 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-25T01:57:31.197 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-25T01:57:31.283 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-immutable-object-cache 2024-04-25T01:57:31.295 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-25T01:57:31.349 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-25T01:57:31.526 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-25T01:57:31.556 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-25T01:57:31.632 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-25T01:57:31.806 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:58 ago on Thu 25 Apr 2024 01:56:33 AM UTC. 2024-04-25T01:57:31.927 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T01:57:31.928 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:57:31.928 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repo Size 2024-04-25T01:57:31.928 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:57:31.928 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-04-25T01:57:31.928 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-902.gc61472c8.el9 ceph 137 k 2024-04-25T01:57:31.928 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:31.928 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-04-25T01:57:31.928 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:57:31.928 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2024-04-25T01:57:31.929 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:31.929 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 137 k 2024-04-25T01:57:31.929 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 379 k 2024-04-25T01:57:31.929 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-04-25T01:57:32.133 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-immutable-object-cache-17.2.7-902.gc61472c 672 kB/s | 137 kB 00:00 2024-04-25T01:57:32.134 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:57:32.134 INFO:teuthology.orchestra.run.smithi112.stdout:Total 666 kB/s | 137 kB 00:00 2024-04-25T01:57:32.135 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-04-25T01:57:32.142 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-04-25T01:57:32.142 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-04-25T01:57:32.199 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-04-25T01:57:32.199 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-04-25T01:57:32.267 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-25T01:57:32.362 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-04-25T01:57:32.385 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-25T01:57:32.451 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-902.gc61472c8.e 1/1 2024-04-25T01:57:32.476 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-902.gc61472c8.e 1/1 2024-04-25T01:57:32.476 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:57:32.476 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T01:57:32.476 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:33.293 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-902.gc61472c8.e 1/1 2024-04-25T01:57:33.294 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:33.294 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-04-25T01:57:33.294 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:33.294 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:33.294 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-25T01:57:33.492 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-mgr 2024-04-25T01:57:33.599 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-25T01:57:34.008 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:01 ago on Thu 25 Apr 2024 01:56:33 AM UTC. 2024-04-25T01:57:34.088 INFO:teuthology.orchestra.run.smithi112.stdout:Package ceph-mgr-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T01:57:34.130 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T01:57:34.131 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-04-25T01:57:34.131 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-25T01:57:34.200 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-mgr-dashboard 2024-04-25T01:57:34.614 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-25T01:57:34.640 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-902.gc61472 12/12 2024-04-25T01:57:34.715 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:01 ago on Thu 25 Apr 2024 01:56:33 AM UTC. 2024-04-25T01:57:34.836 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T01:57:34.837 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:57:34.837 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-04-25T01:57:34.837 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:57:34.837 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-04-25T01:57:34.837 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 3.4 M 2024-04-25T01:57:34.837 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-04-25T01:57:34.837 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 24 k 2024-04-25T01:57:34.837 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 15 k 2024-04-25T01:57:34.837 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-04-25T01:57:34.837 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T01:57:34.837 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T01:57:34.837 INFO:teuthology.orchestra.run.smithi112.stdout:Installing weak dependencies: 2024-04-25T01:57:34.837 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-04-25T01:57:34.837 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:34.838 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-04-25T01:57:34.838 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:57:34.838 INFO:teuthology.orchestra.run.smithi112.stdout:Install 7 Packages 2024-04-25T01:57:34.838 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:34.838 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 3.7 M 2024-04-25T01:57:34.838 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 80 M 2024-04-25T01:57:34.839 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-04-25T01:57:35.220 INFO:teuthology.orchestra.run.smithi112.stdout:(1/7): ceph-grafana-dashboards-17.2.7-902.gc614 132 kB/s | 24 kB 00:00 2024-04-25T01:57:35.271 INFO:teuthology.orchestra.run.smithi112.stdout:(2/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 179 kB/s | 9.0 kB 00:00 2024-04-25T01:57:35.313 INFO:teuthology.orchestra.run.smithi112.stdout:(3/7): python3-jwt-2.4.0-1.el9.noarch.rpm 982 kB/s | 41 kB 00:00 2024-04-25T01:57:35.338 INFO:teuthology.orchestra.run.smithi112.stdout:(4/7): ceph-prometheus-alerts-17.2.7-902.gc6147 48 kB/s | 15 kB 00:00 2024-04-25T01:57:35.380 INFO:teuthology.orchestra.run.smithi112.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 461 kB/s | 31 kB 00:00 2024-04-25T01:57:35.439 INFO:teuthology.orchestra.run.smithi112.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 1.8 MB/s | 188 kB 00:00 2024-04-25T01:57:35.681 INFO:teuthology.orchestra.run.smithi112.stdout:(7/7): ceph-mgr-dashboard-17.2.7-902.gc61472c8. 5.2 MB/s | 3.4 MB 00:00 2024-04-25T01:57:35.682 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:57:35.683 INFO:teuthology.orchestra.run.smithi112.stdout:Total 4.3 MB/s | 3.7 MB 00:00 2024-04-25T01:57:35.683 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-04-25T01:57:35.691 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-04-25T01:57:35.691 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-04-25T01:57:35.753 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-04-25T01:57:35.753 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-04-25T01:57:36.055 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-04-25T01:57:36.107 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-04-25T01:57:36.141 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-04-25T01:57:36.187 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-04-25T01:57:36.219 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-04-25T01:57:36.248 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-902.gc61472c8.el9.no 5/7 2024-04-25T01:57:36.986 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-902.gc61472 12/12 2024-04-25T01:57:36.986 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-902.gc61472 1/12 2024-04-25T01:57:36.986 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-25T01:57:36.986 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-25T01:57:36.986 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-25T01:57:36.986 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-25T01:57:36.986 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-25T01:57:36.986 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-25T01:57:36.986 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-25T01:57:36.986 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-25T01:57:36.986 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-25T01:57:36.987 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-25T01:57:37.244 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-902.gc61472c8.el9.n 6/7 2024-04-25T01:57:37.286 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-902.gc61472c8.el9.noarch 7/7 2024-04-25T01:57:37.354 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-25T01:57:37.354 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:37.354 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-25T01:57:37.354 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T01:57:37.355 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T01:57:37.355 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T01:57:37.355 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T01:57:37.355 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T01:57:37.355 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T01:57:37.355 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T01:57:37.355 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T01:57:37.356 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T01:57:37.356 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T01:57:37.356 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T01:57:37.356 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T01:57:37.356 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:37.356 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:57:37.725 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-mgr-rook 2024-04-25T01:57:38.242 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:12 ago on Thu 25 Apr 2024 01:56:26 AM UTC. 2024-04-25T01:57:38.358 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-902.gc61472c8.el9.noarch 7/7 2024-04-25T01:57:38.358 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-902.gc61472c8.el9.n 1/7 2024-04-25T01:57:38.358 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-902.gc61472c8.el9.noarch 2/7 2024-04-25T01:57:38.358 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-902.gc61472c8.el9.no 3/7 2024-04-25T01:57:38.358 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-04-25T01:57:38.358 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-04-25T01:57:38.358 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-04-25T01:57:38.362 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:57:38.364 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:38.364 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-04-25T01:57:38.364 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:38.364 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-25T01:57:38.364 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 47 k 2024-04-25T01:57:38.364 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-04-25T01:57:38.364 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T01:57:38.364 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T01:57:38.364 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T01:57:38.364 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T01:57:38.364 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T01:57:38.364 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T01:57:38.364 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T01:57:38.365 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T01:57:38.365 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T01:57:38.365 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T01:57:38.365 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T01:57:38.365 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T01:57:38.365 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:38.365 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-25T01:57:38.365 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:38.365 INFO:teuthology.orchestra.run.smithi077.stdout:Install 13 Packages 2024-04-25T01:57:38.365 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:38.366 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 2.2 M 2024-04-25T01:57:38.366 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 26 M 2024-04-25T01:57:38.366 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-25T01:57:38.603 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-04-25T01:57:38.603 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:38.604 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-04-25T01:57:38.604 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T01:57:38.604 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T01:57:38.604 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T01:57:38.604 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-04-25T01:57:38.604 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-04-25T01:57:38.605 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T01:57:38.605 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T01:57:38.605 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:38.605 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-25T01:57:38.811 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-25T01:57:38.891 INFO:teuthology.orchestra.run.smithi077.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 202 kB/s | 19 kB 00:00 2024-04-25T01:57:38.916 INFO:teuthology.orchestra.run.smithi077.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 213 kB/s | 26 kB 00:00 2024-04-25T01:57:38.983 INFO:teuthology.orchestra.run.smithi077.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.4 MB/s | 222 kB 00:00 2024-04-25T01:57:39.008 INFO:teuthology.orchestra.run.smithi077.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-04-25T01:57:39.050 INFO:teuthology.orchestra.run.smithi077.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 279 kB 00:00 2024-04-25T01:57:39.076 INFO:teuthology.orchestra.run.smithi077.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 801 kB/s | 54 kB 00:00 2024-04-25T01:57:39.093 INFO:teuthology.orchestra.run.smithi077.stdout:(7/13): ceph-mgr-rook-17.2.7-902.gc61472c8.el9. 160 kB/s | 47 kB 00:00 2024-04-25T01:57:39.293 INFO:teuthology.orchestra.run.smithi077.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 133 kB/s | 32 kB 00:00 2024-04-25T01:57:39.316 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:06 ago on Thu 25 Apr 2024 01:56:33 AM UTC. 2024-04-25T01:57:39.352 INFO:teuthology.orchestra.run.smithi077.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 54 kB/s | 15 kB 00:00 2024-04-25T01:57:39.410 INFO:teuthology.orchestra.run.smithi077.stdout:(10/13): python3-google-auth-2.29.0-1.el9.noarc 648 kB/s | 206 kB 00:00 2024-04-25T01:57:39.437 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T01:57:39.438 INFO:teuthology.orchestra.run.smithi112.stdout:====================================================================================== 2024-04-25T01:57:39.438 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-04-25T01:57:39.438 INFO:teuthology.orchestra.run.smithi112.stdout:====================================================================================== 2024-04-25T01:57:39.438 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-04-25T01:57:39.438 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 7.4 M 2024-04-25T01:57:39.439 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-04-25T01:57:39.439 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T01:57:39.439 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T01:57:39.439 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T01:57:39.439 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T01:57:39.439 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T01:57:39.439 INFO:teuthology.orchestra.run.smithi112.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T01:57:39.439 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T01:57:39.439 INFO:teuthology.orchestra.run.smithi112.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T01:57:39.439 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T01:57:39.439 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T01:57:39.439 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T01:57:39.439 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:39.440 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-04-25T01:57:39.440 INFO:teuthology.orchestra.run.smithi112.stdout:====================================================================================== 2024-04-25T01:57:39.440 INFO:teuthology.orchestra.run.smithi112.stdout:Install 12 Packages 2024-04-25T01:57:39.440 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:39.441 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 38 M 2024-04-25T01:57:39.441 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 209 M 2024-04-25T01:57:39.441 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-04-25T01:57:39.536 INFO:teuthology.orchestra.run.smithi077.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 321 kB/s | 59 kB 00:00 2024-04-25T01:57:39.561 INFO:teuthology.orchestra.run.smithi077.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 595 kB/s | 90 kB 00:00 2024-04-25T01:57:39.619 INFO:teuthology.orchestra.run.smithi077.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 3.1 MB/s | 1.0 MB 00:00 2024-04-25T01:57:39.621 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:57:39.621 INFO:teuthology.orchestra.run.smithi077.stdout:Total 1.8 MB/s | 2.2 MB 00:01 2024-04-25T01:57:39.683 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-25T01:57:39.698 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-25T01:57:39.698 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-25T01:57:39.779 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-25T01:57:39.780 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-25T01:57:40.047 INFO:teuthology.orchestra.run.smithi112.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 917 kB/s | 195 kB 00:00 2024-04-25T01:57:40.164 INFO:teuthology.orchestra.run.smithi112.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 2.4 MB/s | 803 kB 00:00 2024-04-25T01:57:40.206 INFO:teuthology.orchestra.run.smithi112.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 206 kB/s | 33 kB 00:00 2024-04-25T01:57:40.358 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-25T01:57:40.373 INFO:teuthology.orchestra.run.smithi112.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 109 kB/s | 18 kB 00:00 2024-04-25T01:57:40.527 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-25T01:57:40.532 INFO:teuthology.orchestra.run.smithi112.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 223 kB/s | 35 kB 00:00 2024-04-25T01:57:40.579 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-25T01:57:40.634 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-25T01:57:40.672 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-25T01:57:40.713 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-25T01:57:40.773 INFO:teuthology.orchestra.run.smithi112.stdout:(6/12): ceph-mgr-diskprediction-local-17.2.7-90 7.9 MB/s | 7.4 MB 00:00 2024-04-25T01:57:40.807 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-25T01:57:40.908 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-25T01:57:40.965 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-25T01:57:41.032 INFO:teuthology.orchestra.run.smithi112.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 946 kB/s | 244 kB 00:00 2024-04-25T01:57:41.516 INFO:teuthology.orchestra.run.smithi112.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.2 MB/s | 3.0 MB 00:01 2024-04-25T01:57:41.680 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-25T01:57:41.729 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-25T01:57:41.763 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-25T01:57:41.766 INFO:teuthology.orchestra.run.smithi112.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.0 MB/s | 250 kB 00:00 2024-04-25T01:57:41.809 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-25T01:57:41.833 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-rook-2:17.2.7-902.gc61472c8.el9.noarch 13/13 2024-04-25T01:57:41.833 INFO:teuthology.orchestra.run.smithi112.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 3.6 MB/s | 4.7 MB 00:01 2024-04-25T01:57:42.547 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-902.gc61472c8.el9.noarch 13/13 2024-04-25T01:57:42.547 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-rook-2:17.2.7-902.gc61472c8.el9.noarch 1/13 2024-04-25T01:57:42.547 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-25T01:57:42.547 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-25T01:57:42.547 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-25T01:57:42.547 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-25T01:57:42.547 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-25T01:57:42.547 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-25T01:57:42.547 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-25T01:57:42.547 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-25T01:57:42.547 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-25T01:57:42.547 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-25T01:57:42.548 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-25T01:57:42.583 INFO:teuthology.orchestra.run.smithi112.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.3 MB/s | 5.1 MB 00:01 2024-04-25T01:57:42.852 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-25T01:57:42.853 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:42.853 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-25T01:57:42.853 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T01:57:42.853 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T01:57:42.853 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T01:57:42.853 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T01:57:42.853 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T01:57:42.853 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T01:57:42.853 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T01:57:42.853 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T01:57:42.853 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T01:57:42.853 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T01:57:42.853 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T01:57:42.853 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T01:57:42.854 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T01:57:42.854 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:42.854 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:57:43.105 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-mgr-cephadm 2024-04-25T01:57:43.622 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:17 ago on Thu 25 Apr 2024 01:56:26 AM UTC. 2024-04-25T01:57:43.741 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:57:43.742 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:43.742 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-04-25T01:57:43.742 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:43.742 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-25T01:57:43.742 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 123 k 2024-04-25T01:57:43.742 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-04-25T01:57:43.742 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T01:57:43.742 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T01:57:43.743 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T01:57:43.743 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T01:57:43.743 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T01:57:43.743 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:43.743 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-25T01:57:43.743 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:43.743 INFO:teuthology.orchestra.run.smithi077.stdout:Install 6 Packages 2024-04-25T01:57:43.743 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:43.744 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 7.0 M 2024-04-25T01:57:43.744 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 33 M 2024-04-25T01:57:43.744 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-25T01:57:43.941 INFO:teuthology.orchestra.run.smithi112.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.5 MB/s | 16 MB 00:02 2024-04-25T01:57:43.942 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:57:43.942 INFO:teuthology.orchestra.run.smithi112.stdout:Total 8.4 MB/s | 38 MB 00:04 2024-04-25T01:57:44.139 INFO:teuthology.orchestra.run.smithi077.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.8 MB/s | 248 kB 00:00 2024-04-25T01:57:44.265 INFO:teuthology.orchestra.run.smithi077.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 6.0 MB 00:00 2024-04-25T01:57:44.290 INFO:teuthology.orchestra.run.smithi077.stdout:(3/6): ceph-mgr-cephadm-17.2.7-902.gc61472c8.el 431 kB/s | 123 kB 00:00 2024-04-25T01:57:44.291 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-04-25T01:57:44.318 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-04-25T01:57:44.318 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-04-25T01:57:44.665 INFO:teuthology.orchestra.run.smithi077.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 144 kB/s | 58 kB 00:00 2024-04-25T01:57:44.682 INFO:teuthology.orchestra.run.smithi077.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 130 kB/s | 51 kB 00:00 2024-04-25T01:57:44.723 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-04-25T01:57:44.723 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-04-25T01:57:44.941 INFO:teuthology.orchestra.run.smithi077.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 684 kB/s | 548 kB 00:00 2024-04-25T01:57:44.941 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:57:44.942 INFO:teuthology.orchestra.run.smithi077.stdout:Total 5.8 MB/s | 7.0 MB 00:01 2024-04-25T01:57:45.015 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-25T01:57:45.026 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-25T01:57:45.026 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-25T01:57:45.124 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-25T01:57:45.124 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-25T01:57:45.429 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-25T01:57:45.470 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-04-25T01:57:45.530 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-25T01:57:45.573 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-25T01:57:45.588 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-25T01:57:45.651 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-25T01:57:45.673 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-25T01:57:45.716 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-25T01:57:45.893 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-25T01:57:45.931 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-25T01:57:46.008 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-25T01:57:46.168 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-25T01:57:46.253 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-25T01:57:46.309 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-25T01:57:46.338 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-902.gc61472c8.el9.noarch 6/6 2024-04-25T01:57:46.654 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-25T01:57:46.778 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-25T01:57:47.122 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-902.gc61472c8.el9.noarch 6/6 2024-04-25T01:57:47.122 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-902.gc61472c8.el9.noarch 1/6 2024-04-25T01:57:47.122 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-25T01:57:47.122 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-25T01:57:47.122 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-25T01:57:47.122 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-25T01:57:47.390 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-25T01:57:47.390 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:47.390 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-25T01:57:47.390 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T01:57:47.390 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T01:57:47.390 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T01:57:47.390 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T01:57:47.391 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T01:57:47.391 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T01:57:47.391 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:47.391 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:57:47.622 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-fuse 2024-04-25T01:57:48.013 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-25T01:57:48.125 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:22 ago on Thu 25 Apr 2024 01:56:26 AM UTC. 2024-04-25T01:57:48.244 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:57:48.244 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:48.244 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-04-25T01:57:48.245 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:48.245 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-25T01:57:48.245 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse x86_64 2:17.2.7-902.gc61472c8.el9 ceph 814 k 2024-04-25T01:57:48.245 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-04-25T01:57:48.245 INFO:teuthology.orchestra.run.smithi077.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T01:57:48.245 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:48.245 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-25T01:57:48.245 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:48.245 INFO:teuthology.orchestra.run.smithi077.stdout:Install 2 Packages 2024-04-25T01:57:48.245 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:48.246 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 894 k 2024-04-25T01:57:48.246 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 2.6 M 2024-04-25T01:57:48.246 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-25T01:57:48.668 INFO:teuthology.orchestra.run.smithi077.stdout:(1/2): ceph-fuse-17.2.7-902.gc61472c8.el9.x86_6 2.8 MB/s | 814 kB 00:00 2024-04-25T01:57:48.810 INFO:teuthology.orchestra.run.smithi077.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 191 kB/s | 80 kB 00:00 2024-04-25T01:57:48.811 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:57:48.811 INFO:teuthology.orchestra.run.smithi077.stdout:Total 1.5 MB/s | 894 kB 00:00 2024-04-25T01:57:48.822 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-25T01:57:48.843 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-25T01:57:48.843 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-25T01:57:48.920 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-25T01:57:48.920 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-25T01:57:49.048 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-25T01:57:49.073 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-902.gc61472 12/12 2024-04-25T01:57:49.095 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-25T01:57:49.223 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-25T01:57:49.300 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 2/2 2024-04-25T01:57:49.933 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 2/2 2024-04-25T01:57:49.933 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 1/2 2024-04-25T01:57:50.200 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-25T01:57:50.200 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:50.201 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-25T01:57:50.201 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-25T01:57:50.201 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:50.201 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:57:50.439 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install librados-devel 2024-04-25T01:57:50.954 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:24 ago on Thu 25 Apr 2024 01:56:26 AM UTC. 2024-04-25T01:57:51.076 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:57:51.076 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:51.076 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repo Size 2024-04-25T01:57:51.077 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:51.077 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-25T01:57:51.077 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel x86_64 2:17.2.7-902.gc61472c8.el9 ceph 126 k 2024-04-25T01:57:51.077 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:51.077 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-25T01:57:51.077 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:51.077 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-04-25T01:57:51.077 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:51.078 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 126 k 2024-04-25T01:57:51.078 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 448 k 2024-04-25T01:57:51.078 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-25T01:57:51.291 INFO:teuthology.orchestra.run.smithi077.stdout:librados-devel-17.2.7-902.gc61472c8.el9.x86_64. 596 kB/s | 126 kB 00:00 2024-04-25T01:57:51.291 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:57:51.292 INFO:teuthology.orchestra.run.smithi077.stdout:Total 589 kB/s | 126 kB 00:00 2024-04-25T01:57:51.292 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-25T01:57:51.297 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-25T01:57:51.297 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-25T01:57:51.360 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-25T01:57:51.360 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-25T01:57:51.514 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-25T01:57:51.620 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librados-devel-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:57:51.674 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-902.gc61472 12/12 2024-04-25T01:57:51.674 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-902.gc61472 1/12 2024-04-25T01:57:51.674 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-25T01:57:51.675 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-25T01:57:51.675 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-25T01:57:51.675 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-25T01:57:51.675 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-25T01:57:51.675 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-25T01:57:51.675 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-25T01:57:51.675 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-25T01:57:51.675 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-25T01:57:51.675 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-25T01:57:51.997 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados-devel-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:57:52.079 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-25T01:57:52.079 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:52.079 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-04-25T01:57:52.080 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T01:57:52.080 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T01:57:52.080 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T01:57:52.080 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T01:57:52.080 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T01:57:52.080 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T01:57:52.080 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T01:57:52.080 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T01:57:52.081 INFO:teuthology.orchestra.run.smithi112.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T01:57:52.081 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T01:57:52.081 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T01:57:52.081 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T01:57:52.081 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:52.081 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-25T01:57:52.238 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados-devel-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:57:52.238 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:52.239 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-25T01:57:52.239 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:52.239 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:52.239 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:57:52.449 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install libcephfs2 2024-04-25T01:57:52.453 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-mgr-rook 2024-04-25T01:57:52.973 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:19 ago on Thu 25 Apr 2024 01:56:33 AM UTC. 2024-04-25T01:57:52.981 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:26 ago on Thu 25 Apr 2024 01:56:26 AM UTC. 2024-04-25T01:57:53.061 INFO:teuthology.orchestra.run.smithi077.stdout:Package libcephfs2-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T01:57:53.093 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T01:57:53.094 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:57:53.094 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-04-25T01:57:53.094 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:57:53.094 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-04-25T01:57:53.094 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 47 k 2024-04-25T01:57:53.094 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-04-25T01:57:53.095 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T01:57:53.095 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T01:57:53.095 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T01:57:53.095 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T01:57:53.095 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T01:57:53.095 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T01:57:53.095 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T01:57:53.095 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T01:57:53.095 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T01:57:53.095 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T01:57:53.095 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T01:57:53.095 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T01:57:53.095 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:53.095 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-04-25T01:57:53.096 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:57:53.096 INFO:teuthology.orchestra.run.smithi112.stdout:Install 13 Packages 2024-04-25T01:57:53.096 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:53.096 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 2.2 M 2024-04-25T01:57:53.096 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 26 M 2024-04-25T01:57:53.096 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-04-25T01:57:53.102 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:57:53.104 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-04-25T01:57:53.104 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:57:53.185 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install libcephfs-devel 2024-04-25T01:57:53.700 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:27 ago on Thu 25 Apr 2024 01:56:26 AM UTC. 2024-04-25T01:57:53.707 INFO:teuthology.orchestra.run.smithi112.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 133 kB/s | 19 kB 00:00 2024-04-25T01:57:53.733 INFO:teuthology.orchestra.run.smithi112.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 151 kB/s | 26 kB 00:00 2024-04-25T01:57:53.758 INFO:teuthology.orchestra.run.smithi112.stdout:(3/13): ceph-mgr-rook-17.2.7-902.gc61472c8.el9. 244 kB/s | 47 kB 00:00 2024-04-25T01:57:53.818 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:57:53.819 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:53.819 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repo Size 2024-04-25T01:57:53.819 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:53.819 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-25T01:57:53.819 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel x86_64 2:17.2.7-902.gc61472c8.el9 ceph 25 k 2024-04-25T01:57:53.819 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:53.819 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-25T01:57:53.820 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:53.820 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-04-25T01:57:53.820 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:53.820 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 25 k 2024-04-25T01:57:53.820 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 110 k 2024-04-25T01:57:53.820 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-25T01:57:53.858 INFO:teuthology.orchestra.run.smithi112.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-04-25T01:57:53.883 INFO:teuthology.orchestra.run.smithi112.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.2 MB/s | 222 kB 00:00 2024-04-25T01:57:53.909 INFO:teuthology.orchestra.run.smithi112.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-04-25T01:57:53.976 INFO:teuthology.orchestra.run.smithi112.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.3 MB/s | 279 kB 00:00 2024-04-25T01:57:53.980 INFO:teuthology.orchestra.run.smithi077.stdout:libcephfs-devel-17.2.7-902.gc61472c8.el9.x86_64 155 kB/s | 25 kB 00:00 2024-04-25T01:57:53.981 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:57:53.981 INFO:teuthology.orchestra.run.smithi077.stdout:Total 154 kB/s | 25 kB 00:00 2024-04-25T01:57:53.981 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-25T01:57:53.985 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-25T01:57:53.985 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-25T01:57:53.986 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-25T01:57:53.987 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-25T01:57:54.068 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-25T01:57:54.126 INFO:teuthology.orchestra.run.smithi112.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 133 kB/s | 32 kB 00:00 2024-04-25T01:57:54.151 INFO:teuthology.orchestra.run.smithi112.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 62 kB/s | 15 kB 00:00 2024-04-25T01:57:54.159 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs-devel-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:57:54.368 INFO:teuthology.orchestra.run.smithi112.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 273 kB/s | 59 kB 00:00 2024-04-25T01:57:54.393 INFO:teuthology.orchestra.run.smithi112.stdout:(11/13): python3-google-auth-2.29.0-1.el9.noarc 522 kB/s | 206 kB 00:00 2024-04-25T01:57:54.460 INFO:teuthology.orchestra.run.smithi112.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 3.1 MB/s | 1.0 MB 00:00 2024-04-25T01:57:54.477 INFO:teuthology.orchestra.run.smithi112.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 826 kB/s | 90 kB 00:00 2024-04-25T01:57:54.477 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:57:54.479 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:57:54.480 INFO:teuthology.orchestra.run.smithi112.stdout:Total 1.6 MB/s | 2.2 MB 00:01 2024-04-25T01:57:54.541 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-04-25T01:57:54.556 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-04-25T01:57:54.556 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-04-25T01:57:54.638 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-04-25T01:57:54.639 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-04-25T01:57:54.680 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs-devel-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:57:54.680 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:54.680 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-25T01:57:54.680 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:57:54.680 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:54.680 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:57:54.845 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install librados2 2024-04-25T01:57:55.204 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-04-25T01:57:55.350 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:29 ago on Thu 25 Apr 2024 01:56:26 AM UTC. 2024-04-25T01:57:55.383 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-25T01:57:55.428 INFO:teuthology.orchestra.run.smithi077.stdout:Package librados2-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T01:57:55.437 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-25T01:57:55.468 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:57:55.469 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-04-25T01:57:55.469 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:57:55.492 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-25T01:57:55.530 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-25T01:57:55.534 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install librbd1 2024-04-25T01:57:55.571 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-25T01:57:55.665 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-25T01:57:55.766 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-25T01:57:55.814 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-25T01:57:56.041 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:30 ago on Thu 25 Apr 2024 01:56:26 AM UTC. 2024-04-25T01:57:56.119 INFO:teuthology.orchestra.run.smithi077.stdout:Package librbd1-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T01:57:56.159 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:57:56.160 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-04-25T01:57:56.160 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:57:56.225 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install python3-rados 2024-04-25T01:57:56.538 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-25T01:57:56.596 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-25T01:57:56.629 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-25T01:57:56.674 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-25T01:57:56.699 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-rook-2:17.2.7-902.gc61472c8.el9.noarch 13/13 2024-04-25T01:57:56.729 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:30 ago on Thu 25 Apr 2024 01:56:26 AM UTC. 2024-04-25T01:57:56.808 INFO:teuthology.orchestra.run.smithi077.stdout:Package python3-rados-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T01:57:56.850 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:57:56.850 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-04-25T01:57:56.850 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:57:56.933 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install python3-rgw 2024-04-25T01:57:57.446 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-902.gc61472c8.el9.noarch 13/13 2024-04-25T01:57:57.446 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-rook-2:17.2.7-902.gc61472c8.el9.noarch 1/13 2024-04-25T01:57:57.446 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-25T01:57:57.446 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-25T01:57:57.446 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-25T01:57:57.446 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-25T01:57:57.446 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-25T01:57:57.446 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-25T01:57:57.446 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-25T01:57:57.446 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-25T01:57:57.447 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-25T01:57:57.447 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-25T01:57:57.447 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-25T01:57:57.447 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:31 ago on Thu 25 Apr 2024 01:56:26 AM UTC. 2024-04-25T01:57:57.526 INFO:teuthology.orchestra.run.smithi077.stdout:Package python3-rgw-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T01:57:57.567 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:57:57.568 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-04-25T01:57:57.568 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:57:57.631 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install python3-cephfs 2024-04-25T01:57:57.750 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-25T01:57:57.751 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:57.751 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-04-25T01:57:57.751 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T01:57:57.751 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T01:57:57.751 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T01:57:57.751 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T01:57:57.751 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T01:57:57.751 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T01:57:57.751 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T01:57:57.751 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T01:57:57.752 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T01:57:57.752 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T01:57:57.752 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T01:57:57.752 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T01:57:57.752 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T01:57:57.752 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:57.752 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-25T01:57:57.977 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-mgr-cephadm 2024-04-25T01:57:58.140 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:32 ago on Thu 25 Apr 2024 01:56:26 AM UTC. 2024-04-25T01:57:58.219 INFO:teuthology.orchestra.run.smithi077.stdout:Package python3-cephfs-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T01:57:58.259 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:57:58.261 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-04-25T01:57:58.261 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:57:58.328 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install python3-rbd 2024-04-25T01:57:58.488 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:25 ago on Thu 25 Apr 2024 01:56:33 AM UTC. 2024-04-25T01:57:58.608 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T01:57:58.608 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:57:58.608 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-04-25T01:57:58.608 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:57:58.609 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-04-25T01:57:58.609 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 123 k 2024-04-25T01:57:58.609 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-04-25T01:57:58.609 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T01:57:58.609 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T01:57:58.609 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T01:57:58.609 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T01:57:58.609 INFO:teuthology.orchestra.run.smithi112.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T01:57:58.609 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:58.609 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-04-25T01:57:58.609 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:57:58.609 INFO:teuthology.orchestra.run.smithi112.stdout:Install 6 Packages 2024-04-25T01:57:58.609 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:57:58.610 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 7.0 M 2024-04-25T01:57:58.610 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 33 M 2024-04-25T01:57:58.610 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-04-25T01:57:58.834 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:32 ago on Thu 25 Apr 2024 01:56:26 AM UTC. 2024-04-25T01:57:58.913 INFO:teuthology.orchestra.run.smithi077.stdout:Package python3-rbd-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T01:57:58.954 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:57:58.955 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-04-25T01:57:58.955 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:57:59.025 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install rbd-fuse 2024-04-25T01:57:59.155 INFO:teuthology.orchestra.run.smithi112.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.3 MB/s | 248 kB 00:00 2024-04-25T01:57:59.180 INFO:teuthology.orchestra.run.smithi112.stdout:(2/6): ceph-mgr-cephadm-17.2.7-902.gc61472c8.el 567 kB/s | 123 kB 00:00 2024-04-25T01:57:59.314 INFO:teuthology.orchestra.run.smithi112.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-04-25T01:57:59.529 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:33 ago on Thu 25 Apr 2024 01:56:26 AM UTC. 2024-04-25T01:57:59.581 INFO:teuthology.orchestra.run.smithi112.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 144 kB/s | 58 kB 00:00 2024-04-25T01:57:59.647 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:57:59.648 INFO:teuthology.orchestra.run.smithi112.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 178 kB/s | 51 kB 00:00 2024-04-25T01:57:59.649 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:59.649 INFO:teuthology.orchestra.run.smithi077.stdout: Package Architecture Version Repository Size 2024-04-25T01:57:59.649 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:59.649 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-25T01:57:59.649 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse x86_64 2:17.2.7-902.gc61472c8.el9 ceph 82 k 2024-04-25T01:57:59.649 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:59.650 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-25T01:57:59.650 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:57:59.650 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-04-25T01:57:59.650 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:57:59.650 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 82 k 2024-04-25T01:57:59.650 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 222 k 2024-04-25T01:57:59.651 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-25T01:57:59.748 INFO:teuthology.orchestra.run.smithi112.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 925 kB/s | 548 kB 00:00 2024-04-25T01:57:59.751 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:57:59.751 INFO:teuthology.orchestra.run.smithi112.stdout:Total 6.1 MB/s | 7.0 MB 00:01 2024-04-25T01:57:59.822 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-04-25T01:57:59.833 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-04-25T01:57:59.833 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-04-25T01:57:59.850 INFO:teuthology.orchestra.run.smithi077.stdout:rbd-fuse-17.2.7-902.gc61472c8.el9.x86_64.rpm 405 kB/s | 82 kB 00:00 2024-04-25T01:57:59.851 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:57:59.851 INFO:teuthology.orchestra.run.smithi077.stdout:Total 403 kB/s | 82 kB 00:00 2024-04-25T01:57:59.851 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-25T01:57:59.858 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-25T01:57:59.858 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-25T01:57:59.920 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-25T01:57:59.920 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-25T01:57:59.932 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-04-25T01:57:59.933 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-04-25T01:58:00.066 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-25T01:58:00.170 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:58:00.244 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-04-25T01:58:00.415 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-25T01:58:00.458 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-25T01:58:00.540 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: rbd-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:58:00.791 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:58:00.791 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:58:00.791 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-25T01:58:00.791 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:58:00.792 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:58:00.792 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:58:00.986 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-25T01:58:01.033 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install rbd-mirror 2024-04-25T01:58:01.060 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-25T01:58:01.116 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-25T01:58:01.145 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-902.gc61472c8.el9.noarch 6/6 2024-04-25T01:58:01.544 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:35 ago on Thu 25 Apr 2024 01:56:26 AM UTC. 2024-04-25T01:58:01.666 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:58:01.667 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:58:01.667 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repo Size 2024-04-25T01:58:01.667 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:58:01.667 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-25T01:58:01.667 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror x86_64 2:17.2.7-902.gc61472c8.el9 ceph 2.9 M 2024-04-25T01:58:01.667 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:58:01.667 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-25T01:58:01.667 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:58:01.668 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-04-25T01:58:01.668 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:58:01.668 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 2.9 M 2024-04-25T01:58:01.668 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 12 M 2024-04-25T01:58:01.668 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-25T01:58:01.850 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-902.gc61472c8.el9.noarch 6/6 2024-04-25T01:58:01.850 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-902.gc61472c8.el9.noarch 1/6 2024-04-25T01:58:01.850 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-25T01:58:01.850 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-25T01:58:01.850 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-25T01:58:01.850 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-25T01:58:02.092 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-25T01:58:02.092 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:58:02.092 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-04-25T01:58:02.092 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T01:58:02.093 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T01:58:02.093 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T01:58:02.093 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T01:58:02.093 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T01:58:02.093 INFO:teuthology.orchestra.run.smithi112.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T01:58:02.093 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:58:02.093 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-25T01:58:02.295 INFO:teuthology.orchestra.run.smithi077.stdout:rbd-mirror-17.2.7-902.gc61472c8.el9.x86_64.rpm 4.7 MB/s | 2.9 MB 00:00 2024-04-25T01:58:02.295 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:58:02.296 INFO:teuthology.orchestra.run.smithi077.stdout:Total 4.7 MB/s | 2.9 MB 00:00 2024-04-25T01:58:02.296 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-25T01:58:02.305 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-25T01:58:02.305 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-25T01:58:02.345 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-fuse 2024-04-25T01:58:02.383 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-25T01:58:02.383 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-25T01:58:02.799 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-25T01:58:02.854 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:29 ago on Thu 25 Apr 2024 01:56:33 AM UTC. 2024-04-25T01:58:02.954 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-mirror-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:58:02.973 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T01:58:02.974 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:58:02.974 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-04-25T01:58:02.974 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:58:02.974 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-04-25T01:58:02.974 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse x86_64 2:17.2.7-902.gc61472c8.el9 ceph 814 k 2024-04-25T01:58:02.974 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-04-25T01:58:02.974 INFO:teuthology.orchestra.run.smithi112.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T01:58:02.974 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:58:02.974 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-04-25T01:58:02.974 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:58:02.974 INFO:teuthology.orchestra.run.smithi112.stdout:Install 2 Packages 2024-04-25T01:58:02.975 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:58:02.975 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 894 k 2024-04-25T01:58:02.975 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 2.6 M 2024-04-25T01:58:02.975 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-04-25T01:58:02.979 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: rbd-mirror-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:58:02.980 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:58:02.980 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T01:58:02.980 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T01:58:02.980 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T01:58:02.980 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:58:03.467 INFO:teuthology.orchestra.run.smithi112.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 222 kB/s | 80 kB 00:00 2024-04-25T01:58:03.533 INFO:teuthology.orchestra.run.smithi112.stdout:(2/2): ceph-fuse-17.2.7-902.gc61472c8.el9.x86_6 1.9 MB/s | 814 kB 00:00 2024-04-25T01:58:03.534 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:58:03.534 INFO:teuthology.orchestra.run.smithi112.stdout:Total 1.6 MB/s | 894 kB 00:00 2024-04-25T01:58:03.545 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-04-25T01:58:03.567 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-04-25T01:58:03.567 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-04-25T01:58:03.643 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-04-25T01:58:03.643 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-04-25T01:58:03.818 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-04-25T01:58:03.830 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-mirror-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:58:03.830 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:58:03.830 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-25T01:58:03.830 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:58:03.830 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:58:03.830 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:58:03.954 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-25T01:58:04.021 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 2/2 2024-04-25T01:58:04.115 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install rbd-nbd 2024-04-25T01:58:04.633 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:38 ago on Thu 25 Apr 2024 01:56:26 AM UTC. 2024-04-25T01:58:04.665 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 2/2 2024-04-25T01:58:04.665 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 1/2 2024-04-25T01:58:04.759 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:58:04.760 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:58:04.760 INFO:teuthology.orchestra.run.smithi077.stdout: Package Architecture Version Repository Size 2024-04-25T01:58:04.760 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:58:04.760 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-25T01:58:04.761 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd x86_64 2:17.2.7-902.gc61472c8.el9 ceph 165 k 2024-04-25T01:58:04.761 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:58:04.761 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-25T01:58:04.761 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:58:04.761 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-04-25T01:58:04.761 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:58:04.761 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 165 k 2024-04-25T01:58:04.761 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 477 k 2024-04-25T01:58:04.762 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-25T01:58:04.901 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-25T01:58:04.901 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:58:04.901 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-04-25T01:58:04.901 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-25T01:58:04.901 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:58:04.901 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-25T01:58:05.001 INFO:teuthology.orchestra.run.smithi077.stdout:rbd-nbd-17.2.7-902.gc61472c8.el9.x86_64.rpm 688 kB/s | 165 kB 00:00 2024-04-25T01:58:05.002 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:58:05.002 INFO:teuthology.orchestra.run.smithi077.stdout:Total 683 kB/s | 165 kB 00:00 2024-04-25T01:58:05.002 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-25T01:58:05.009 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-25T01:58:05.010 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-25T01:58:05.073 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-25T01:58:05.073 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-25T01:58:05.152 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install librados-devel 2024-04-25T01:58:05.224 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-25T01:58:05.328 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-nbd-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:58:05.660 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:32 ago on Thu 25 Apr 2024 01:56:33 AM UTC. 2024-04-25T01:58:05.722 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: rbd-nbd-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:58:05.781 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T01:58:05.782 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:58:05.782 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repo Size 2024-04-25T01:58:05.782 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:58:05.782 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-04-25T01:58:05.782 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel x86_64 2:17.2.7-902.gc61472c8.el9 ceph 126 k 2024-04-25T01:58:05.782 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:58:05.782 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-04-25T01:58:05.782 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:58:05.782 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2024-04-25T01:58:05.783 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:58:05.783 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 126 k 2024-04-25T01:58:05.783 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 448 k 2024-04-25T01:58:05.783 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-04-25T01:58:05.945 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-nbd-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:58:05.945 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:58:05.945 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-25T01:58:05.946 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:58:05.946 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:58:05.946 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:58:06.122 INFO:teuthology.orchestra.run.smithi112.stdout:librados-devel-17.2.7-902.gc61472c8.el9.x86_64. 373 kB/s | 126 kB 00:00 2024-04-25T01:58:06.122 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:58:06.123 INFO:teuthology.orchestra.run.smithi112.stdout:Total 370 kB/s | 126 kB 00:00 2024-04-25T01:58:06.123 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-04-25T01:58:06.128 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-04-25T01:58:06.128 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-04-25T01:58:06.187 DEBUG:teuthology.parallel:result is None 2024-04-25T01:58:06.189 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-04-25T01:58:06.190 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-04-25T01:58:06.344 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-04-25T01:58:06.467 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librados-devel-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:58:06.871 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados-devel-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:58:07.115 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados-devel-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:58:07.117 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:58:07.117 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-04-25T01:58:07.117 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:58:07.117 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:58:07.117 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-25T01:58:07.347 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install libcephfs2 2024-04-25T01:58:07.856 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:34 ago on Thu 25 Apr 2024 01:56:33 AM UTC. 2024-04-25T01:58:07.935 INFO:teuthology.orchestra.run.smithi112.stdout:Package libcephfs2-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T01:58:07.976 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T01:58:07.978 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-04-25T01:58:07.978 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-25T01:58:08.056 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install libcephfs-devel 2024-04-25T01:58:08.567 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:35 ago on Thu 25 Apr 2024 01:56:33 AM UTC. 2024-04-25T01:58:08.686 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T01:58:08.686 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:58:08.686 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repo Size 2024-04-25T01:58:08.687 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:58:08.687 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-04-25T01:58:08.687 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel x86_64 2:17.2.7-902.gc61472c8.el9 ceph 25 k 2024-04-25T01:58:08.687 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:58:08.687 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-04-25T01:58:08.687 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:58:08.687 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2024-04-25T01:58:08.687 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:58:08.687 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 25 k 2024-04-25T01:58:08.687 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 110 k 2024-04-25T01:58:08.687 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-04-25T01:58:08.861 INFO:teuthology.orchestra.run.smithi112.stdout:libcephfs-devel-17.2.7-902.gc61472c8.el9.x86_64 144 kB/s | 25 kB 00:00 2024-04-25T01:58:08.862 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:58:08.862 INFO:teuthology.orchestra.run.smithi112.stdout:Total 143 kB/s | 25 kB 00:00 2024-04-25T01:58:08.862 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-04-25T01:58:08.865 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-04-25T01:58:08.865 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-04-25T01:58:08.867 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-04-25T01:58:08.867 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-04-25T01:58:08.950 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-04-25T01:58:09.056 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs-devel-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:58:09.398 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:58:09.597 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs-devel-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:58:09.598 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:58:09.598 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-04-25T01:58:09.598 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:58:09.598 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:58:09.598 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-25T01:58:09.782 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install librados2 2024-04-25T01:58:10.291 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:37 ago on Thu 25 Apr 2024 01:56:33 AM UTC. 2024-04-25T01:58:10.369 INFO:teuthology.orchestra.run.smithi112.stdout:Package librados2-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T01:58:10.409 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T01:58:10.410 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-04-25T01:58:10.410 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-25T01:58:10.475 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install librbd1 2024-04-25T01:58:10.980 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:37 ago on Thu 25 Apr 2024 01:56:33 AM UTC. 2024-04-25T01:58:11.059 INFO:teuthology.orchestra.run.smithi112.stdout:Package librbd1-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T01:58:11.100 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T01:58:11.101 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-04-25T01:58:11.101 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-25T01:58:11.161 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install python3-rados 2024-04-25T01:58:11.666 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:38 ago on Thu 25 Apr 2024 01:56:33 AM UTC. 2024-04-25T01:58:11.745 INFO:teuthology.orchestra.run.smithi112.stdout:Package python3-rados-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T01:58:11.786 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T01:58:11.787 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-04-25T01:58:11.788 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-25T01:58:11.840 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install python3-rgw 2024-04-25T01:58:12.342 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:39 ago on Thu 25 Apr 2024 01:56:33 AM UTC. 2024-04-25T01:58:12.420 INFO:teuthology.orchestra.run.smithi112.stdout:Package python3-rgw-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T01:58:12.461 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T01:58:12.462 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-04-25T01:58:12.462 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-25T01:58:12.515 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install python3-cephfs 2024-04-25T01:58:13.026 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:40 ago on Thu 25 Apr 2024 01:56:33 AM UTC. 2024-04-25T01:58:13.103 INFO:teuthology.orchestra.run.smithi112.stdout:Package python3-cephfs-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T01:58:13.143 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T01:58:13.144 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-04-25T01:58:13.144 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-25T01:58:13.199 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install python3-rbd 2024-04-25T01:58:13.709 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:40 ago on Thu 25 Apr 2024 01:56:33 AM UTC. 2024-04-25T01:58:13.790 INFO:teuthology.orchestra.run.smithi112.stdout:Package python3-rbd-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T01:58:13.831 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T01:58:13.832 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-04-25T01:58:13.832 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-25T01:58:13.889 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install rbd-fuse 2024-04-25T01:58:14.396 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:41 ago on Thu 25 Apr 2024 01:56:33 AM UTC. 2024-04-25T01:58:14.514 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T01:58:14.515 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:58:14.515 INFO:teuthology.orchestra.run.smithi112.stdout: Package Architecture Version Repository Size 2024-04-25T01:58:14.515 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:58:14.515 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-04-25T01:58:14.515 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse x86_64 2:17.2.7-902.gc61472c8.el9 ceph 82 k 2024-04-25T01:58:14.516 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:58:14.516 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-04-25T01:58:14.516 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:58:14.516 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2024-04-25T01:58:14.516 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:58:14.516 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 82 k 2024-04-25T01:58:14.516 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 222 k 2024-04-25T01:58:14.516 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-04-25T01:58:14.823 INFO:teuthology.orchestra.run.smithi112.stdout:rbd-fuse-17.2.7-902.gc61472c8.el9.x86_64.rpm 267 kB/s | 82 kB 00:00 2024-04-25T01:58:14.823 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:58:14.823 INFO:teuthology.orchestra.run.smithi112.stdout:Total 266 kB/s | 82 kB 00:00 2024-04-25T01:58:14.824 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-04-25T01:58:14.830 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-04-25T01:58:14.830 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-04-25T01:58:14.894 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-04-25T01:58:14.894 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-04-25T01:58:15.030 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-04-25T01:58:15.143 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:58:15.506 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:58:15.729 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:58:15.729 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:58:15.729 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-04-25T01:58:15.730 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:58:15.730 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:58:15.730 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-25T01:58:15.957 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install rbd-mirror 2024-04-25T01:58:16.477 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:43 ago on Thu 25 Apr 2024 01:56:33 AM UTC. 2024-04-25T01:58:16.602 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T01:58:16.602 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:58:16.603 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repo Size 2024-04-25T01:58:16.603 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:58:16.603 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-04-25T01:58:16.603 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror x86_64 2:17.2.7-902.gc61472c8.el9 ceph 2.9 M 2024-04-25T01:58:16.603 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:58:16.603 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-04-25T01:58:16.603 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:58:16.603 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2024-04-25T01:58:16.603 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:58:16.603 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 2.9 M 2024-04-25T01:58:16.603 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 12 M 2024-04-25T01:58:16.603 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-04-25T01:58:17.243 INFO:teuthology.orchestra.run.smithi112.stdout:rbd-mirror-17.2.7-902.gc61472c8.el9.x86_64.rpm 4.6 MB/s | 2.9 MB 00:00 2024-04-25T01:58:17.243 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:58:17.244 INFO:teuthology.orchestra.run.smithi112.stdout:Total 4.6 MB/s | 2.9 MB 00:00 2024-04-25T01:58:17.244 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-04-25T01:58:17.253 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-04-25T01:58:17.253 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-04-25T01:58:17.332 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-04-25T01:58:17.332 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-04-25T01:58:17.754 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-04-25T01:58:17.827 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-mirror-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:58:17.852 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-mirror-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:58:17.852 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:58:17.852 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T01:58:17.852 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T01:58:17.852 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T01:58:17.852 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:58:18.826 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-mirror-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:58:18.826 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:58:18.826 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-04-25T01:58:18.826 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:58:18.826 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:58:18.827 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-25T01:58:19.052 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install rbd-nbd 2024-04-25T01:58:19.590 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:46 ago on Thu 25 Apr 2024 01:56:33 AM UTC. 2024-04-25T01:58:19.712 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T01:58:19.713 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:58:19.713 INFO:teuthology.orchestra.run.smithi112.stdout: Package Architecture Version Repository Size 2024-04-25T01:58:19.713 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:58:19.713 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-04-25T01:58:19.714 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd x86_64 2:17.2.7-902.gc61472c8.el9 ceph 165 k 2024-04-25T01:58:19.714 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:58:19.714 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-04-25T01:58:19.714 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-25T01:58:19.714 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2024-04-25T01:58:19.714 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:58:19.714 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 165 k 2024-04-25T01:58:19.714 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 477 k 2024-04-25T01:58:19.714 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-04-25T01:58:19.913 INFO:teuthology.orchestra.run.smithi112.stdout:rbd-nbd-17.2.7-902.gc61472c8.el9.x86_64.rpm 832 kB/s | 165 kB 00:00 2024-04-25T01:58:19.914 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:58:19.914 INFO:teuthology.orchestra.run.smithi112.stdout:Total 824 kB/s | 165 kB 00:00 2024-04-25T01:58:19.914 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-04-25T01:58:19.921 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-04-25T01:58:19.922 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-04-25T01:58:19.984 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-04-25T01:58:19.984 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-04-25T01:58:20.131 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-04-25T01:58:20.234 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-nbd-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:58:20.679 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-nbd-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:58:20.932 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-nbd-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T01:58:20.932 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:58:20.932 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-04-25T01:58:20.932 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T01:58:20.932 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T01:58:20.932 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-25T01:58:21.171 DEBUG:teuthology.parallel:result is None 2024-04-25T01:58:21.172 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T01:58:21.172 INFO:teuthology.packaging:ref: None 2024-04-25T01:58:21.172 INFO:teuthology.packaging:tag: None 2024-04-25T01:58:21.172 INFO:teuthology.packaging:branch: quincy 2024-04-25T01:58:21.172 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:58:21.173 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-04-25T01:58:21.404 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T01:58:21.429 INFO:teuthology.orchestra.run.smithi077.stdout:17.2.7-902.gc61472c8.el9 2024-04-25T01:58:21.429 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-902.gc61472c8.el9 2024-04-25T01:58:21.429 INFO:teuthology.task.install:The correct ceph version 17.2.7-902.gc61472c8 is installed. 2024-04-25T01:58:21.431 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T01:58:21.431 INFO:teuthology.packaging:ref: None 2024-04-25T01:58:21.431 INFO:teuthology.packaging:tag: None 2024-04-25T01:58:21.431 INFO:teuthology.packaging:branch: quincy 2024-04-25T01:58:21.431 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:58:21.431 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-04-25T01:58:21.750 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T01:58:21.771 INFO:teuthology.orchestra.run.smithi112.stdout:17.2.7-902.gc61472c8.el9 2024-04-25T01:58:21.771 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-902.gc61472c8.el9 2024-04-25T01:58:21.771 INFO:teuthology.task.install:The correct ceph version 17.2.7-902.gc61472c8 is installed. 2024-04-25T01:58:21.773 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T01:58:21.773 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:58:21.773 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T01:58:21.803 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T01:58:21.803 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T01:58:21.836 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T01:58:21.836 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:58:21.836 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T01:58:21.870 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T01:58:21.936 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T01:58:21.936 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T01:58:21.959 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T01:58:22.022 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T01:58:22.022 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:58:22.022 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T01:58:22.048 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T01:58:22.115 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T01:58:22.115 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T01:58:22.139 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T01:58:22.203 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T01:58:22.203 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:58:22.203 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T01:58:22.227 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T01:58:22.291 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T01:58:22.291 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T01:58:22.314 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T01:58:22.378 INFO:teuthology.run_tasks:Running task print... 2024-04-25T01:58:22.389 INFO:teuthology.task.print:**** done install task... 2024-04-25T01:58:22.389 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-25T01:58:22.499 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'} 2024-04-25T01:58:22.499 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-04-25T01:58:22.500 INFO:tasks.cephadm:Cluster fsid is 4bb93d82-02a7-11ef-bc93-c7b262605968 2024-04-25T01:58:22.500 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-25T01:58:22.500 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-04-25T01:58:22.500 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi077': '172.21.15.77', 'mon.smithi112': '172.21.15.112'} 2024-04-25T01:58:22.500 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-25T01:58:22.500 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname $(hostname -s) 2024-04-25T01:58:22.524 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname $(hostname -s) 2024-04-25T01:58:22.547 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-04-25T01:58:22.548 DEBUG:teuthology.orchestra.run.smithi077:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-25T01:58:22.843 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r--. 1 ubuntu ubuntu 375153 Apr 25 01:58 /home/ubuntu/cephtest/cephadm 2024-04-25T01:58:22.844 DEBUG:teuthology.orchestra.run.smithi112:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-25T01:58:23.064 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r--. 1 ubuntu ubuntu 375153 Apr 25 01:58 /home/ubuntu/cephtest/cephadm 2024-04-25T01:58:23.064 DEBUG:teuthology.orchestra.run.smithi077:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-25T01:58:23.080 DEBUG:teuthology.orchestra.run.smithi112:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-25T01:58:23.104 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-04-25T01:58:23.104 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-04-25T01:58:23.121 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-04-25T01:58:24.751 INFO:teuthology.orchestra.run.smithi077.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-25T01:58:24.761 INFO:teuthology.orchestra.run.smithi112.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-25T01:59:07.336 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-25T01:59:07.336 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_version": "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)", 2024-04-25T01:59:07.336 INFO:teuthology.orchestra.run.smithi112.stdout: "image_id": "0de407c1b3afb7a571e0cc4b0c826a995ed358d49d5f013ca6bdfad025b55c43", 2024-04-25T01:59:07.336 INFO:teuthology.orchestra.run.smithi112.stdout: "repo_digests": [ 2024-04-25T01:59:07.336 INFO:teuthology.orchestra.run.smithi112.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17" 2024-04-25T01:59:07.336 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-25T01:59:07.336 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-25T01:59:13.308 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T01:59:13.308 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)", 2024-04-25T01:59:13.308 INFO:teuthology.orchestra.run.smithi077.stdout: "image_id": "0de407c1b3afb7a571e0cc4b0c826a995ed358d49d5f013ca6bdfad025b55c43", 2024-04-25T01:59:13.308 INFO:teuthology.orchestra.run.smithi077.stdout: "repo_digests": [ 2024-04-25T01:59:13.308 INFO:teuthology.orchestra.run.smithi077.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17" 2024-04-25T01:59:13.308 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-25T01:59:13.308 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T01:59:13.327 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /etc/ceph 2024-04-25T01:59:13.368 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph 2024-04-25T01:59:13.399 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 777 /etc/ceph 2024-04-25T01:59:13.431 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 777 /etc/ceph 2024-04-25T01:59:13.467 INFO:tasks.cephadm:Writing seed config... 2024-04-25T01:59:13.468 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-04-25T01:59:13.469 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-04-25T01:59:13.469 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-04-25T01:59:13.469 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-04-25T01:59:13.469 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-04-25T01:59:13.469 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-25T01:59:13.469 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-25T01:59:13.469 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-04-25T01:59:13.469 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-04-25T01:59:13.469 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-25T01:59:13.469 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-25T01:59:13.469 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-04-25T01:59:13.469 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-25T01:59:13.469 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-25T01:59:13.469 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-25T01:59:13.470 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-25T01:59:13.470 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-25T01:59:13.470 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-25T01:59:13.470 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-25T01:59:13.470 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-25T01:59:13.470 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-25T01:59:13.470 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-25T01:59:13.470 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-25T01:59:13.470 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-04-25T01:59:13.470 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-25T01:59:13.470 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-25T01:59:13.470 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-25T01:59:13.470 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-25T01:59:13.471 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-25T01:59:13.471 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-25T01:59:13.471 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-25T01:59:13.471 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-25T01:59:13.471 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-25T01:59:13.471 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-25T01:59:13.471 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-04-25T01:59:13.471 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-25T01:59:13.471 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-25T01:59:13.471 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-25T01:59:13.471 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-25T01:59:13.471 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-25T01:59:13.471 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-04-25T01:59:13.471 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-25T01:59:13.472 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:59:13.472 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-25T01:59:13.487 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 4bb93d82-02a7-11ef-bc93-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-25T01:59:13.487 DEBUG:teuthology.orchestra.run.smithi077:mon.smithi077> sudo journalctl -f -n 0 -u ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@mon.smithi077.service 2024-04-25T01:59:13.529 INFO:tasks.cephadm:Bootstrapping... 2024-04-25T01:59:13.529 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.77 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-25T01:59:13.728 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:59:13.728 INFO:teuthology.orchestra.run.smithi077.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '4bb93d82-02a7-11ef-bc93-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.77', '--skip-admin-label'] 2024-04-25T01:59:13.753 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-25T01:59:13.754 INFO:teuthology.orchestra.run.smithi077.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-25T01:59:13.754 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying podman|docker is present... 2024-04-25T01:59:13.777 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-25T01:59:13.777 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying lvm2 is present... 2024-04-25T01:59:13.777 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying time synchronization is in place... 2024-04-25T01:59:13.785 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-25T01:59:13.785 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-25T01:59:13.791 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-25T01:59:13.791 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout inactive 2024-04-25T01:59:13.798 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout enabled 2024-04-25T01:59:13.804 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout active 2024-04-25T01:59:13.804 INFO:teuthology.orchestra.run.smithi077.stdout:Unit chronyd.service is enabled and running 2024-04-25T01:59:13.804 INFO:teuthology.orchestra.run.smithi077.stdout:Repeating the final host check... 2024-04-25T01:59:13.827 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-25T01:59:13.827 INFO:teuthology.orchestra.run.smithi077.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-25T01:59:13.827 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl is present 2024-04-25T01:59:13.827 INFO:teuthology.orchestra.run.smithi077.stdout:lvcreate is present 2024-04-25T01:59:13.834 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-25T01:59:13.834 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-25T01:59:13.840 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-25T01:59:13.840 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout inactive 2024-04-25T01:59:13.846 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout enabled 2024-04-25T01:59:13.853 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout active 2024-04-25T01:59:13.853 INFO:teuthology.orchestra.run.smithi077.stdout:Unit chronyd.service is enabled and running 2024-04-25T01:59:13.853 INFO:teuthology.orchestra.run.smithi077.stdout:Host looks OK 2024-04-25T01:59:13.853 INFO:teuthology.orchestra.run.smithi077.stdout:Cluster fsid: 4bb93d82-02a7-11ef-bc93-c7b262605968 2024-04-25T01:59:13.853 INFO:teuthology.orchestra.run.smithi077.stdout:Acquiring lock 140408543691680 on /run/cephadm/4bb93d82-02a7-11ef-bc93-c7b262605968.lock 2024-04-25T01:59:13.853 INFO:teuthology.orchestra.run.smithi077.stdout:Lock 140408543691680 acquired on /run/cephadm/4bb93d82-02a7-11ef-bc93-c7b262605968.lock 2024-04-25T01:59:13.854 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying IP 172.21.15.77 port 3300 ... 2024-04-25T01:59:13.854 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying IP 172.21.15.77 port 6789 ... 2024-04-25T01:59:13.854 INFO:teuthology.orchestra.run.smithi077.stdout:Base mon IP(s) is [172.21.15.77:3300, 172.21.15.77:6789], mon addrv is [v2:172.21.15.77:3300,v1:172.21.15.77:6789] 2024-04-25T01:59:13.857 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.77 metric 100 2024-04-25T01:59:13.857 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.77 metric 100 2024-04-25T01:59:13.860 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-25T01:59:13.860 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-04-25T01:59:13.860 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-04-25T01:59:13.863 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-25T01:59:13.863 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-25T01:59:13.863 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-25T01:59:13.863 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-04-25T01:59:13.864 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout inet6 fe80::ebf8:3c3f:efd0:53e8/64 scope link noprefixroute 2024-04-25T01:59:13.864 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-25T01:59:13.864 INFO:teuthology.orchestra.run.smithi077.stdout:Mon IP `172.21.15.77` is in CIDR network `172.21.0.0/20` 2024-04-25T01:59:13.864 INFO:teuthology.orchestra.run.smithi077.stdout:Mon IP `172.21.15.77` is in CIDR network `172.21.0.0/20` 2024-04-25T01:59:13.864 INFO:teuthology.orchestra.run.smithi077.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-25T01:59:13.865 INFO:teuthology.orchestra.run.smithi077.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-25T01:59:13.865 INFO:teuthology.orchestra.run.smithi077.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-25T01:59:14.342 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stdout 0de407c1b3afb7a571e0cc4b0c826a995ed358d49d5f013ca6bdfad025b55c43 2024-04-25T01:59:14.342 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-25T01:59:14.342 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stderr Getting image source signatures 2024-04-25T01:59:14.342 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stderr Copying blob sha256:0e2af62137028b073c6ccdb8d4d7e0ccccc475ce5f6e225cb983e90813813045 2024-04-25T01:59:14.342 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stderr Copying blob sha256:3d665f4c032644be9cae748af04bee69f2bfe96cdc3616dabe0ab17899633ab5 2024-04-25T01:59:14.342 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stderr Copying config sha256:0de407c1b3afb7a571e0cc4b0c826a995ed358d49d5f013ca6bdfad025b55c43 2024-04-25T01:59:14.342 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-25T01:59:15.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph: stdout ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable) 2024-04-25T01:59:15.282 INFO:teuthology.orchestra.run.smithi077.stdout:Ceph version: ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable) 2024-04-25T01:59:15.282 INFO:teuthology.orchestra.run.smithi077.stdout:Extracting ceph user uid/gid from container image... 2024-04-25T01:59:16.246 INFO:teuthology.orchestra.run.smithi077.stdout:stat: stdout 167 167 2024-04-25T01:59:16.246 INFO:teuthology.orchestra.run.smithi077.stdout:Creating initial keys... 2024-04-25T01:59:17.176 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph-authtool: stdout AQD0uClmusvSIhAAjyTb91gaWBZoPXtKy8kAXA== 2024-04-25T01:59:18.151 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph-authtool: stdout AQD1uClmrD46HBAAws15lkevvYgnCOZcryIRPA== 2024-04-25T01:59:18.967 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph-authtool: stdout AQD2uClmklKCGRAALVkG1c4n7PZab3sDj+ja+g== 2024-04-25T01:59:18.968 INFO:teuthology.orchestra.run.smithi077.stdout:Creating initial monmap... 2024-04-25T01:59:19.935 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-25T01:59:19.935 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-04-25T01:59:19.935 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 4bb93d82-02a7-11ef-bc93-c7b262605968 2024-04-25T01:59:19.935 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-25T01:59:19.935 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool for smithi077 [v2:172.21.15.77:3300,v1:172.21.15.77:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-25T01:59:19.935 INFO:teuthology.orchestra.run.smithi077.stdout:setting min_mon_release = octopus 2024-04-25T01:59:19.936 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/monmaptool: set fsid to 4bb93d82-02a7-11ef-bc93-c7b262605968 2024-04-25T01:59:19.936 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-25T01:59:19.936 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:59:19.936 INFO:teuthology.orchestra.run.smithi077.stdout:Creating mon... 2024-04-25T01:59:20.981 INFO:teuthology.orchestra.run.smithi077.stdout:create mon.smithi077 on 2024-04-25T01:59:21.171 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-04-25T01:59:21.309 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-25T01:59:21.450 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-4bb93d82-02a7-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-4bb93d82-02a7-11ef-bc93-c7b262605968.target. 2024-04-25T01:59:21.451 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-4bb93d82-02a7-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-4bb93d82-02a7-11ef-bc93-c7b262605968.target. 2024-04-25T01:59:21.616 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@mon.smithi077 2024-04-25T01:59:21.616 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Failed to reset failed state of unit ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@mon.smithi077.service: Unit ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@mon.smithi077.service not loaded. 2024-04-25T01:59:21.771 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-4bb93d82-02a7-11ef-bc93-c7b262605968.target.wants/ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@mon.smithi077.service → /etc/systemd/system/ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@.service. 2024-04-25T01:59:22.291 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:22 smithi077 ceph-mon[25959]: mon.smithi077 is new leader, mons smithi077 in quorum (ranks 0) 2024-04-25T01:59:22.305 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-25T01:59:22.305 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout disabled 2024-04-25T01:59:22.313 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-25T01:59:22.313 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout inactive 2024-04-25T01:59:22.313 INFO:teuthology.orchestra.run.smithi077.stdout:firewalld.service is not enabled 2024-04-25T01:59:22.313 INFO:teuthology.orchestra.run.smithi077.stdout:Not possible to enable service . firewalld.service is not available 2024-04-25T01:59:22.314 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for mon to start... 2024-04-25T01:59:22.314 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for mon... 2024-04-25T01:59:22.543 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:22 smithi077 bash[25940]: 9c4fec5aa25d0de39974d16ea3d37636ece67913207a851b645199a178083582 2024-04-25T01:59:22.543 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:22 smithi077 systemd[1]: Started Ceph mon.smithi077 for 4bb93d82-02a7-11ef-bc93-c7b262605968. 2024-04-25T01:59:23.350 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout cluster: 2024-04-25T01:59:23.350 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout id: 4bb93d82-02a7-11ef-bc93-c7b262605968 2024-04-25T01:59:23.350 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-25T01:59:23.350 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-04-25T01:59:23.350 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout services: 2024-04-25T01:59:23.350 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi077 (age 0.576774s) 2024-04-25T01:59:23.350 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-25T01:59:23.351 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-25T01:59:23.351 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-04-25T01:59:23.351 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout data: 2024-04-25T01:59:23.351 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-25T01:59:23.351 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-25T01:59:23.351 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-25T01:59:23.351 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout pgs: 2024-04-25T01:59:23.351 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-04-25T01:59:23.351 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.734+0000 7f145eba7700 1 Processor -- start 2024-04-25T01:59:23.351 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.734+0000 7f145eba7700 1 -- start start 2024-04-25T01:59:23.351 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.734+0000 7f145eba7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1458078c30 0x7f1458077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:23.351 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.734+0000 7f145eba7700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1458079040 con 0x7f1458078c30 2024-04-25T01:59:23.351 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.735+0000 7f145c943700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1458078c30 0x7f1458077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:23.351 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.735+0000 7f145c943700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1458078c30 0x7f1458077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53144/0 (socket says 172.21.15.77:53144) 2024-04-25T01:59:23.352 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.735+0000 7f145c943700 1 -- 172.21.15.77:0/3220176513 learned_addr learned my addr 172.21.15.77:0/3220176513 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:59:23.352 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.735+0000 7f145c943700 1 -- 172.21.15.77:0/3220176513 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1458077770 con 0x7f1458078c30 2024-04-25T01:59:23.352 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.735+0000 7f145c943700 1 --2- 172.21.15.77:0/3220176513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1458078c30 0x7f1458077230 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f144c0098e0 tx=0x7f144c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d75249fe59aa0c6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:23.352 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.736+0000 7f14577fe700 1 -- 172.21.15.77:0/3220176513 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f144c00b860 con 0x7f1458078c30 2024-04-25T01:59:23.352 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.736+0000 7f14577fe700 1 -- 172.21.15.77:0/3220176513 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144c00b9c0 con 0x7f1458078c30 2024-04-25T01:59:23.352 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.736+0000 7f14577fe700 1 -- 172.21.15.77:0/3220176513 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f144c00bc90 con 0x7f1458078c30 2024-04-25T01:59:23.352 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.736+0000 7f145eba7700 1 -- 172.21.15.77:0/3220176513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1458078c30 msgr2=0x7f1458077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:23.352 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.736+0000 7f145eba7700 1 --2- 172.21.15.77:0/3220176513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1458078c30 0x7f1458077230 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f144c0098e0 tx=0x7f144c009250 comp rx=0 tx=0).stop 2024-04-25T01:59:23.352 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.736+0000 7f145eba7700 1 -- 172.21.15.77:0/3220176513 shutdown_connections 2024-04-25T01:59:23.352 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.736+0000 7f145eba7700 1 --2- 172.21.15.77:0/3220176513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1458078c30 0x7f1458077230 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:23.352 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.736+0000 7f145eba7700 1 -- 172.21.15.77:0/3220176513 >> 172.21.15.77:0/3220176513 conn(0x7f14580fe030 msgr2=0x7f1458100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:23.352 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.736+0000 7f145eba7700 1 -- 172.21.15.77:0/3220176513 shutdown_connections 2024-04-25T01:59:23.352 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.736+0000 7f145eba7700 1 -- 172.21.15.77:0/3220176513 wait complete. 2024-04-25T01:59:23.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.737+0000 7f145eba7700 1 Processor -- start 2024-04-25T01:59:23.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.737+0000 7f145eba7700 1 -- start start 2024-04-25T01:59:23.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.737+0000 7f145eba7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1458078c30 0x7f1458112fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:23.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.737+0000 7f145eba7700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1458113500 con 0x7f1458078c30 2024-04-25T01:59:23.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.737+0000 7f145c943700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1458078c30 0x7f1458112fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:23.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.737+0000 7f145c943700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1458078c30 0x7f1458112fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53158/0 (socket says 172.21.15.77:53158) 2024-04-25T01:59:23.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.737+0000 7f145c943700 1 -- 172.21.15.77:0/3356473442 learned_addr learned my addr 172.21.15.77:0/3356473442 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:59:23.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.738+0000 7f145c943700 1 -- 172.21.15.77:0/3356473442 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144c0094f0 con 0x7f1458078c30 2024-04-25T01:59:23.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.738+0000 7f145c943700 1 --2- 172.21.15.77:0/3356473442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1458078c30 0x7f1458112fc0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f144c009290 tx=0x7f144c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:23.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.738+0000 7f14557fa700 1 -- 172.21.15.77:0/3356473442 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f144c01c5c0 con 0x7f1458078c30 2024-04-25T01:59:23.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.738+0000 7f14557fa700 1 -- 172.21.15.77:0/3356473442 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144c01c740 con 0x7f1458078c30 2024-04-25T01:59:23.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.738+0000 7f145eba7700 1 -- 172.21.15.77:0/3356473442 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1458113700 con 0x7f1458078c30 2024-04-25T01:59:23.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.738+0000 7f145eba7700 1 -- 172.21.15.77:0/3356473442 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1458114270 con 0x7f1458078c30 2024-04-25T01:59:23.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.738+0000 7f14557fa700 1 -- 172.21.15.77:0/3356473442 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f144c01ca50 con 0x7f1458078c30 2024-04-25T01:59:23.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.738+0000 7f14557fa700 1 -- 172.21.15.77:0/3356473442 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f144c01cbf0 con 0x7f1458078c30 2024-04-25T01:59:23.354 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.738+0000 7f14557fa700 1 -- 172.21.15.77:0/3356473442 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f144c01ac50 con 0x7f1458078c30 2024-04-25T01:59:23.354 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.739+0000 7f145eba7700 1 -- 172.21.15.77:0/3356473442 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f143c0052e0 con 0x7f1458078c30 2024-04-25T01:59:23.354 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.741+0000 7f14557fa700 1 -- 172.21.15.77:0/3356473442 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f144c01ae10 con 0x7f1458078c30 2024-04-25T01:59:23.354 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.809+0000 7f145eba7700 1 -- 172.21.15.77:0/3356473442 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f143c005860 con 0x7f1458078c30 2024-04-25T01:59:23.354 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.810+0000 7f14557fa700 1 -- 172.21.15.77:0/3356473442 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f144c01a450 con 0x7f1458078c30 2024-04-25T01:59:23.354 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.810+0000 7f145eba7700 1 -- 172.21.15.77:0/3356473442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1458078c30 msgr2=0x7f1458112fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:23.354 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.810+0000 7f145eba7700 1 --2- 172.21.15.77:0/3356473442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1458078c30 0x7f1458112fc0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f144c009290 tx=0x7f144c016000 comp rx=0 tx=0).stop 2024-04-25T01:59:23.354 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.810+0000 7f145eba7700 1 -- 172.21.15.77:0/3356473442 shutdown_connections 2024-04-25T01:59:23.354 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.810+0000 7f145eba7700 1 --2- 172.21.15.77:0/3356473442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1458078c30 0x7f1458112fc0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:23.354 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.810+0000 7f145eba7700 1 -- 172.21.15.77:0/3356473442 >> 172.21.15.77:0/3356473442 conn(0x7f14580fe030 msgr2=0x7f1458109dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:23.354 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.810+0000 7f145eba7700 1 -- 172.21.15.77:0/3356473442 shutdown_connections 2024-04-25T01:59:23.354 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:22.810+0000 7f145eba7700 1 -- 172.21.15.77:0/3356473442 wait complete. 2024-04-25T01:59:23.354 INFO:teuthology.orchestra.run.smithi077.stdout:mon is available 2024-04-25T01:59:23.354 INFO:teuthology.orchestra.run.smithi077.stdout:Assimilating anything we can from ceph.conf... 2024-04-25T01:59:23.553 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:23 smithi077 ceph-mon[25959]: mon.smithi077 is new leader, mons smithi077 in quorum (ranks 0) 2024-04-25T01:59:23.554 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:23 smithi077 ceph-mon[25959]: monmap e1: 1 mons at {smithi077=[v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-25T01:59:23.554 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:23 smithi077 ceph-mon[25959]: fsmap 2024-04-25T01:59:23.554 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:23 smithi077 ceph-mon[25959]: osdmap e1: 0 total, 0 up, 0 in 2024-04-25T01:59:23.554 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:23 smithi077 ceph-mon[25959]: mgrmap e1: no daemons active 2024-04-25T01:59:23.554 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:23 smithi077 ceph-mon[25959]: from='client.? 172.21.15.77:0/3356473442' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-25T01:59:24.434 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-04-25T01:59:24.435 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout [global] 2024-04-25T01:59:24.435 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout fsid = 4bb93d82-02a7-11ef-bc93-c7b262605968 2024-04-25T01:59:24.435 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.77:3300,v1:172.21.15.77:6789] 2024-04-25T01:59:24.435 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-25T01:59:24.435 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-25T01:59:24.435 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-25T01:59:24.435 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-25T01:59:24.435 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-04-25T01:59:24.435 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-25T01:59:24.435 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-25T01:59:24.435 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-04-25T01:59:24.435 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout [osd] 2024-04-25T01:59:24.435 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-25T01:59:24.435 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-25T01:59:24.436 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-25T01:59:24.436 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-25T01:59:24.436 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-25T01:59:24.436 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.759+0000 7febaf7d6700 1 Processor -- start 2024-04-25T01:59:24.436 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.759+0000 7febaf7d6700 1 -- start start 2024-04-25T01:59:24.436 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.759+0000 7febaf7d6700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feba8071230 0x7feba81054f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:24.436 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.759+0000 7febaf7d6700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba8071640 con 0x7feba8071230 2024-04-25T01:59:24.436 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.760+0000 7febad572700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feba8071230 0x7feba81054f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:24.436 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.760+0000 7febad572700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feba8071230 0x7feba81054f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53162/0 (socket says 172.21.15.77:53162) 2024-04-25T01:59:24.436 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.760+0000 7febad572700 1 -- 172.21.15.77:0/3192762244 learned_addr learned my addr 172.21.15.77:0/3192762244 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:59:24.436 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.760+0000 7febad572700 1 -- 172.21.15.77:0/3192762244 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba8105a30 con 0x7feba8071230 2024-04-25T01:59:24.436 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.760+0000 7febad572700 1 --2- 172.21.15.77:0/3192762244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feba8071230 0x7feba81054f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7feba40098e0 tx=0x7feba4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98343adb3939bd9e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:24.436 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.760+0000 7feb9ffff700 1 -- 172.21.15.77:0/3192762244 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feba400b860 con 0x7feba8071230 2024-04-25T01:59:24.436 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.760+0000 7feb9ffff700 1 -- 172.21.15.77:0/3192762244 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba400b9c0 con 0x7feba8071230 2024-04-25T01:59:24.437 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.760+0000 7feb9ffff700 1 -- 172.21.15.77:0/3192762244 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feba400bc90 con 0x7feba8071230 2024-04-25T01:59:24.437 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.761+0000 7febaf7d6700 1 -- 172.21.15.77:0/3192762244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feba8071230 msgr2=0x7feba81054f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:24.437 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.761+0000 7febaf7d6700 1 --2- 172.21.15.77:0/3192762244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feba8071230 0x7feba81054f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7feba40098e0 tx=0x7feba4009250 comp rx=0 tx=0).stop 2024-04-25T01:59:24.437 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.761+0000 7febaf7d6700 1 -- 172.21.15.77:0/3192762244 shutdown_connections 2024-04-25T01:59:24.437 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.761+0000 7febaf7d6700 1 --2- 172.21.15.77:0/3192762244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feba8071230 0x7feba81054f0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:24.437 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.761+0000 7febaf7d6700 1 -- 172.21.15.77:0/3192762244 >> 172.21.15.77:0/3192762244 conn(0x7feba80fcec0 msgr2=0x7feba80ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:24.437 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.761+0000 7febaf7d6700 1 -- 172.21.15.77:0/3192762244 shutdown_connections 2024-04-25T01:59:24.437 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.761+0000 7febaf7d6700 1 -- 172.21.15.77:0/3192762244 wait complete. 2024-04-25T01:59:24.437 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.761+0000 7febaf7d6700 1 Processor -- start 2024-04-25T01:59:24.437 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.761+0000 7febaf7d6700 1 -- start start 2024-04-25T01:59:24.437 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.762+0000 7febaf7d6700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feba8102db0 0x7feba81013f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:24.437 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.762+0000 7febaf7d6700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba81031c0 con 0x7feba8102db0 2024-04-25T01:59:24.437 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.762+0000 7febad572700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feba8102db0 0x7feba81013f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:24.437 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.762+0000 7febad572700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feba8102db0 0x7feba81013f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53168/0 (socket says 172.21.15.77:53168) 2024-04-25T01:59:24.438 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.762+0000 7febad572700 1 -- 172.21.15.77:0/1628004678 learned_addr learned my addr 172.21.15.77:0/1628004678 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:59:24.438 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.762+0000 7febad572700 1 -- 172.21.15.77:0/1628004678 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba40094f0 con 0x7feba8102db0 2024-04-25T01:59:24.438 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.762+0000 7febad572700 1 --2- 172.21.15.77:0/1628004678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feba8102db0 0x7feba81013f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7feba4009290 tx=0x7feba4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:24.438 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.762+0000 7feb9dffb700 1 -- 172.21.15.77:0/1628004678 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feba400bc90 con 0x7feba8102db0 2024-04-25T01:59:24.438 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.762+0000 7feb9dffb700 1 -- 172.21.15.77:0/1628004678 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba4020070 con 0x7feba8102db0 2024-04-25T01:59:24.438 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.762+0000 7feb9dffb700 1 -- 172.21.15.77:0/1628004678 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feba401b5d0 con 0x7feba8102db0 2024-04-25T01:59:24.438 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.762+0000 7febaf7d6700 1 -- 172.21.15.77:0/1628004678 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba8101930 con 0x7feba8102db0 2024-04-25T01:59:24.438 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.763+0000 7febaf7d6700 1 -- 172.21.15.77:0/1628004678 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba8101dc0 con 0x7feba8102db0 2024-04-25T01:59:24.438 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.763+0000 7feb9dffb700 1 -- 172.21.15.77:0/1628004678 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7feba4022030 con 0x7feba8102db0 2024-04-25T01:59:24.438 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.763+0000 7feb9dffb700 1 -- 172.21.15.77:0/1628004678 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7feba401c7a0 con 0x7feba8102db0 2024-04-25T01:59:24.438 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.763+0000 7febaf7d6700 1 -- 172.21.15.77:0/1628004678 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba810ab70 con 0x7feba8102db0 2024-04-25T01:59:24.438 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.766+0000 7feb9dffb700 1 -- 172.21.15.77:0/1628004678 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7feba401b730 con 0x7feba8102db0 2024-04-25T01:59:24.438 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.832+0000 7febaf7d6700 1 -- 172.21.15.77:0/1628004678 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7feba804bed0 con 0x7feba8102db0 2024-04-25T01:59:24.438 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.836+0000 7feb9dffb700 1 -- 172.21.15.77:0/1628004678 <== mon.0 v2:172.21.15.77:3300/0 7 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7feba401bc80 con 0x7feba8102db0 2024-04-25T01:59:24.439 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.836+0000 7feb9dffb700 1 -- 172.21.15.77:0/1628004678 <== mon.0 v2:172.21.15.77:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7feba402ec30 con 0x7feba8102db0 2024-04-25T01:59:24.439 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.837+0000 7febaf7d6700 1 -- 172.21.15.77:0/1628004678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feba8102db0 msgr2=0x7feba81013f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:24.439 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.837+0000 7febaf7d6700 1 --2- 172.21.15.77:0/1628004678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feba8102db0 0x7feba81013f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7feba4009290 tx=0x7feba4016000 comp rx=0 tx=0).stop 2024-04-25T01:59:24.439 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.837+0000 7febaf7d6700 1 -- 172.21.15.77:0/1628004678 shutdown_connections 2024-04-25T01:59:24.439 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.837+0000 7febaf7d6700 1 --2- 172.21.15.77:0/1628004678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feba8102db0 0x7feba81013f0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:24.439 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.837+0000 7febaf7d6700 1 -- 172.21.15.77:0/1628004678 >> 172.21.15.77:0/1628004678 conn(0x7feba80fcec0 msgr2=0x7feba80fd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:24.439 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.837+0000 7febaf7d6700 1 -- 172.21.15.77:0/1628004678 shutdown_connections 2024-04-25T01:59:24.439 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.837+0000 7febaf7d6700 1 -- 172.21.15.77:0/1628004678 wait complete. 2024-04-25T01:59:24.439 INFO:teuthology.orchestra.run.smithi077.stdout:Generating new minimal ceph.conf... 2024-04-25T01:59:24.542 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:24 smithi077 ceph-mon[25959]: from='client.? 172.21.15.77:0/1628004678' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-25T01:59:24.542 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:24 smithi077 ceph-mon[25959]: from='client.? 172.21.15.77:0/1628004678' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-25T01:59:25.726 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:25 smithi077 ceph-mon[25959]: from='client.? 172.21.15.77:0/2443877412' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T01:59:28.286 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.826+0000 7f59267fd700 1 Processor -- start 2024-04-25T01:59:28.286 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.826+0000 7f59267fd700 1 -- start start 2024-04-25T01:59:28.286 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.826+0000 7f59267fd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5920103eb0 0x7f59201042c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:28.286 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.826+0000 7f59267fd700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5920063cc0 con 0x7f5920103eb0 2024-04-25T01:59:28.287 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.827+0000 7f591ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5920103eb0 0x7f59201042c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:28.287 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.827+0000 7f591ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5920103eb0 0x7f59201042c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53170/0 (socket says 172.21.15.77:53170) 2024-04-25T01:59:28.287 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.827+0000 7f591ffff700 1 -- 172.21.15.77:0/500638007 learned_addr learned my addr 172.21.15.77:0/500638007 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:59:28.287 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.827+0000 7f591ffff700 1 -- 172.21.15.77:0/500638007 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5920104800 con 0x7f5920103eb0 2024-04-25T01:59:28.287 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.827+0000 7f591ffff700 1 --2- 172.21.15.77:0/500638007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5920103eb0 0x7f59201042c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f59100098e0 tx=0x7f5910009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efbd5ae23241b360 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:28.287 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.827+0000 7f591effd700 1 -- 172.21.15.77:0/500638007 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f591000b860 con 0x7f5920103eb0 2024-04-25T01:59:28.287 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.827+0000 7f591effd700 1 -- 172.21.15.77:0/500638007 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f591000be50 con 0x7f5920103eb0 2024-04-25T01:59:28.287 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.827+0000 7f591effd700 1 -- 172.21.15.77:0/500638007 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5910010380 con 0x7f5920103eb0 2024-04-25T01:59:28.287 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.828+0000 7f59267fd700 1 -- 172.21.15.77:0/500638007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5920103eb0 msgr2=0x7f59201042c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:28.287 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.828+0000 7f59267fd700 1 --2- 172.21.15.77:0/500638007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5920103eb0 0x7f59201042c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f59100098e0 tx=0x7f5910009250 comp rx=0 tx=0).stop 2024-04-25T01:59:28.287 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.828+0000 7f59267fd700 1 -- 172.21.15.77:0/500638007 shutdown_connections 2024-04-25T01:59:28.287 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.828+0000 7f59267fd700 1 --2- 172.21.15.77:0/500638007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5920103eb0 0x7f59201042c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:28.287 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.828+0000 7f59267fd700 1 -- 172.21.15.77:0/500638007 >> 172.21.15.77:0/500638007 conn(0x7f59200fc6b0 msgr2=0x7f59200feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:28.288 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.828+0000 7f59267fd700 1 -- 172.21.15.77:0/500638007 shutdown_connections 2024-04-25T01:59:28.288 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.828+0000 7f59267fd700 1 -- 172.21.15.77:0/500638007 wait complete. 2024-04-25T01:59:28.288 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.828+0000 7f59267fd700 1 Processor -- start 2024-04-25T01:59:28.288 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.828+0000 7f59267fd700 1 -- start start 2024-04-25T01:59:28.288 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.829+0000 7f59267fd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5920103eb0 0x7f59201115b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:28.288 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.829+0000 7f59267fd700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5920111af0 con 0x7f5920103eb0 2024-04-25T01:59:28.288 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.829+0000 7f591ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5920103eb0 0x7f59201115b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:28.288 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.829+0000 7f591ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5920103eb0 0x7f59201115b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53174/0 (socket says 172.21.15.77:53174) 2024-04-25T01:59:28.288 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.829+0000 7f591ffff700 1 -- 172.21.15.77:0/2443877412 learned_addr learned my addr 172.21.15.77:0/2443877412 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:59:28.288 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.829+0000 7f591ffff700 1 -- 172.21.15.77:0/2443877412 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59100094f0 con 0x7f5920103eb0 2024-04-25T01:59:28.288 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.829+0000 7f591ffff700 1 --2- 172.21.15.77:0/2443877412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5920103eb0 0x7f59201115b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f591000b440 tx=0x7f5910009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:28.288 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.829+0000 7f591cff9700 1 -- 172.21.15.77:0/2443877412 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5910010760 con 0x7f5920103eb0 2024-04-25T01:59:28.288 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.829+0000 7f591cff9700 1 -- 172.21.15.77:0/2443877412 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f5910010d50 con 0x7f5920103eb0 2024-04-25T01:59:28.288 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.829+0000 7f591cff9700 1 -- 172.21.15.77:0/2443877412 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f591001ae20 con 0x7f5920103eb0 2024-04-25T01:59:28.289 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.829+0000 7f59267fd700 1 -- 172.21.15.77:0/2443877412 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5920111cf0 con 0x7f5920103eb0 2024-04-25T01:59:28.289 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.829+0000 7f59267fd700 1 -- 172.21.15.77:0/2443877412 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5920112860 con 0x7f5920103eb0 2024-04-25T01:59:28.289 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.830+0000 7f591cff9700 1 -- 172.21.15.77:0/2443877412 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f591002e440 con 0x7f5920103eb0 2024-04-25T01:59:28.289 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.830+0000 7f591cff9700 1 -- 172.21.15.77:0/2443877412 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f5910024740 con 0x7f5920103eb0 2024-04-25T01:59:28.289 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.830+0000 7f59267fd700 1 -- 172.21.15.77:0/2443877412 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f592005f5c0 con 0x7f5920103eb0 2024-04-25T01:59:28.289 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.832+0000 7f591cff9700 1 -- 172.21.15.77:0/2443877412 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f5910029070 con 0x7f5920103eb0 2024-04-25T01:59:28.289 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.898+0000 7f59267fd700 1 -- 172.21.15.77:0/2443877412 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f5920101320 con 0x7f5920103eb0 2024-04-25T01:59:28.289 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.898+0000 7f591cff9700 1 -- 172.21.15.77:0/2443877412 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f591001a6a0 con 0x7f5920103eb0 2024-04-25T01:59:28.289 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.899+0000 7f59267fd700 1 -- 172.21.15.77:0/2443877412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5920103eb0 msgr2=0x7f59201115b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:28.289 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.899+0000 7f59267fd700 1 --2- 172.21.15.77:0/2443877412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5920103eb0 0x7f59201115b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f591000b440 tx=0x7f5910009250 comp rx=0 tx=0).stop 2024-04-25T01:59:28.289 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.899+0000 7f59267fd700 1 -- 172.21.15.77:0/2443877412 shutdown_connections 2024-04-25T01:59:28.289 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.899+0000 7f59267fd700 1 --2- 172.21.15.77:0/2443877412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5920103eb0 0x7f59201115b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:28.290 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.899+0000 7f59267fd700 1 -- 172.21.15.77:0/2443877412 >> 172.21.15.77:0/2443877412 conn(0x7f59200fc6b0 msgr2=0x7f59200fd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:28.290 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.899+0000 7f59267fd700 1 -- 172.21.15.77:0/2443877412 shutdown_connections 2024-04-25T01:59:28.290 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:24.899+0000 7f59267fd700 1 -- 172.21.15.77:0/2443877412 wait complete. 2024-04-25T01:59:28.290 INFO:teuthology.orchestra.run.smithi077.stdout:Restarting the monitor... 2024-04-25T01:59:28.726 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:28 smithi077 systemd[1]: Stopping Ceph mon.smithi077 for 4bb93d82-02a7-11ef-bc93-c7b262605968... 2024-04-25T01:59:29.976 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:29 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi077[25955]: 2024-04-25T01:59:29.571+0000 7f530f7d1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi077 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T01:59:29.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:29 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi077[25955]: 2024-04-25T01:59:29.571+0000 7f530f7d1700 -1 mon.smithi077@0(leader) e1 *** Got Signal Terminated *** 2024-04-25T01:59:29.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:29 smithi077 podman[26205]: 2024-04-25 01:59:29.623383792 +0000 UTC m=+1.174039096 container died 9c4fec5aa25d0de39974d16ea3d37636ece67913207a851b645199a178083582 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi077, RELEASE=quincy-c61472c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T01:59:33.476 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:33 smithi077 podman[26205]: 2024-04-25 01:59:33.111643697 +0000 UTC m=+4.662298990 container cleanup 9c4fec5aa25d0de39974d16ea3d37636ece67913207a851b645199a178083582 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi077, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, RELEASE=quincy-c61472c, org.label-schema.build-date=20240424, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-04-25T01:59:33.476 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:33 smithi077 bash[26205]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi077 2024-04-25T01:59:35.468 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 podman[26219]: 2024-04-25 01:59:35.103399594 +0000 UTC m=+5.479934431 container remove 9c4fec5aa25d0de39974d16ea3d37636ece67913207a851b645199a178083582 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi077, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=quincy-c61472c, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T01:59:35.468 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 systemd[1]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@mon.smithi077.service: Deactivated successfully. 2024-04-25T01:59:35.468 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 systemd[1]: Stopped Ceph mon.smithi077 for 4bb93d82-02a7-11ef-bc93-c7b262605968. 2024-04-25T01:59:35.468 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 systemd[1]: Starting Ceph mon.smithi077 for 4bb93d82-02a7-11ef-bc93-c7b262605968... 2024-04-25T01:59:35.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 podman[26312]: 2024-04-25 01:59:35.465354359 +0000 UTC m=+0.114072907 container create adb57965a306d2c8d91a35d5e8d13e6576037a1dc774ee46816d4486f2155519 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi077, RELEASE=quincy-c61472c, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5) 2024-04-25T01:59:35.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 podman[26312]: 2024-04-25 01:59:35.369268342 +0000 UTC m=+0.017986830 image pull 0de407c1b3afb7a571e0cc4b0c826a995ed358d49d5f013ca6bdfad025b55c43 quay.ceph.io/ceph-ci/ceph:quincy 2024-04-25T01:59:35.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 podman[26312]: 2024-04-25 01:59:35.667266066 +0000 UTC m=+0.315984549 container init adb57965a306d2c8d91a35d5e8d13e6576037a1dc774ee46816d4486f2155519 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi077, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-c61472c, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-25T01:59:35.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 podman[26312]: 2024-04-25 01:59:35.67010635 +0000 UTC m=+0.318824835 container start adb57965a306d2c8d91a35d5e8d13e6576037a1dc774ee46816d4486f2155519 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi077, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=quincy-c61472c, org.label-schema.build-date=20240424) 2024-04-25T01:59:35.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: set uid:gid to 167:167 (ceph:ceph) 2024-04-25T01:59:35.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable), process ceph-mon, pid 2 2024-04-25T01:59:35.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: pidfile_write: ignore empty --pid-file 2024-04-25T01:59:35.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: load: jerasure load: lrc 2024-04-25T01:59:35.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: RocksDB version: 6.15.5 2024-04-25T01:59:35.732 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-04-25T01:59:35.732 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Compile date Apr 24 2024 2024-04-25T01:59:35.732 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: DB SUMMARY 2024-04-25T01:59:35.732 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: DB Session ID: GF2DY9A5HF59NX5W1NQT 2024-04-25T01:59:35.732 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: CURRENT file: CURRENT 2024-04-25T01:59:35.732 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: IDENTITY file: IDENTITY 2024-04-25T01:59:35.733 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-04-25T01:59:35.733 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi077/store.db dir, Total Num: 1, files: 000008.sst 2024-04-25T01:59:35.733 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi077/store.db: 000010.log size: 98164 ; 2024-04-25T01:59:35.733 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.error_if_exists: 0 2024-04-25T01:59:35.733 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.create_if_missing: 0 2024-04-25T01:59:35.733 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.paranoid_checks: 1 2024-04-25T01:59:35.733 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-25T01:59:35.734 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.env: 0x55976c647b00 2024-04-25T01:59:35.734 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.fs: Posix File System 2024-04-25T01:59:35.734 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.info_log: 0x55976eb05620 2024-04-25T01:59:35.734 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.max_file_opening_threads: 16 2024-04-25T01:59:35.734 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.statistics: (nil) 2024-04-25T01:59:35.734 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.use_fsync: 0 2024-04-25T01:59:35.735 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.max_log_file_size: 0 2024-04-25T01:59:35.735 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-25T01:59:35.735 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-25T01:59:35.735 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.keep_log_file_num: 1000 2024-04-25T01:59:35.735 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.recycle_log_file_num: 0 2024-04-25T01:59:35.735 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.allow_fallocate: 1 2024-04-25T01:59:35.736 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.allow_mmap_reads: 0 2024-04-25T01:59:35.736 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.allow_mmap_writes: 0 2024-04-25T01:59:35.736 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.use_direct_reads: 0 2024-04-25T01:59:35.736 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-25T01:59:35.736 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.create_missing_column_families: 0 2024-04-25T01:59:35.736 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.db_log_dir: 2024-04-25T01:59:35.736 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi077/store.db 2024-04-25T01:59:35.736 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-25T01:59:35.737 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-25T01:59:35.737 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-25T01:59:35.737 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-25T01:59:35.737 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-25T01:59:35.737 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-25T01:59:35.737 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.advise_random_on_open: 1 2024-04-25T01:59:35.738 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.db_write_buffer_size: 0 2024-04-25T01:59:35.738 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.write_buffer_manager: 0x55976f7f8a20 2024-04-25T01:59:35.738 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-25T01:59:35.738 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-04-25T01:59:35.738 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-25T01:59:35.738 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-25T01:59:35.738 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.rate_limiter: (nil) 2024-04-25T01:59:35.739 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-25T01:59:35.739 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.wal_recovery_mode: 2 2024-04-25T01:59:35.739 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.enable_thread_tracking: 0 2024-04-25T01:59:35.739 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.enable_pipelined_write: 0 2024-04-25T01:59:35.739 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.unordered_write: 0 2024-04-25T01:59:35.739 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-25T01:59:35.740 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-25T01:59:35.740 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-25T01:59:35.740 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-25T01:59:35.740 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.row_cache: None 2024-04-25T01:59:35.740 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.wal_filter: None 2024-04-25T01:59:35.740 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-25T01:59:35.740 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.allow_ingest_behind: 0 2024-04-25T01:59:35.740 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.preserve_deletes: 0 2024-04-25T01:59:35.741 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.two_write_queues: 0 2024-04-25T01:59:35.741 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.manual_wal_flush: 0 2024-04-25T01:59:35.741 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.atomic_flush: 0 2024-04-25T01:59:35.741 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-25T01:59:35.741 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-25T01:59:35.741 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-25T01:59:35.741 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.log_readahead_size: 0 2024-04-25T01:59:35.741 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-25T01:59:35.741 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.best_efforts_recovery: 0 2024-04-25T01:59:35.742 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-25T01:59:35.742 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-25T01:59:35.742 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.allow_data_in_errors: 0 2024-04-25T01:59:35.742 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.db_host_id: __hostname__ 2024-04-25T01:59:35.742 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.max_background_jobs: 2 2024-04-25T01:59:35.742 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.max_background_compactions: -1 2024-04-25T01:59:35.742 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.max_subcompactions: 1 2024-04-25T01:59:35.742 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-25T01:59:35.743 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-25T01:59:35.743 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-25T01:59:35.743 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.max_total_wal_size: 0 2024-04-25T01:59:35.743 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-25T01:59:35.743 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-25T01:59:35.743 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-25T01:59:35.743 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-25T01:59:35.743 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.max_open_files: -1 2024-04-25T01:59:35.744 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.bytes_per_sync: 0 2024-04-25T01:59:35.744 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-25T01:59:35.744 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-25T01:59:35.744 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.compaction_readahead_size: 0 2024-04-25T01:59:35.744 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.max_background_flushes: -1 2024-04-25T01:59:35.744 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Compression algorithms supported: 2024-04-25T01:59:35.744 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-25T01:59:35.744 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: kZSTD supported: 0 2024-04-25T01:59:35.745 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: kXpressCompression supported: 0 2024-04-25T01:59:35.745 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: kLZ4HCCompression supported: 1 2024-04-25T01:59:35.745 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: kZlibCompression supported: 1 2024-04-25T01:59:35.745 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: kSnappyCompression supported: 1 2024-04-25T01:59:35.745 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: kLZ4Compression supported: 1 2024-04-25T01:59:35.745 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: kBZip2Compression supported: 0 2024-04-25T01:59:35.745 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-25T01:59:35.745 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi077/store.db/MANIFEST-000009 2024-04-25T01:59:35.745 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-04-25T01:59:35.745 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-25T01:59:35.745 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.merge_operator: 2024-04-25T01:59:35.745 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.compaction_filter: None 2024-04-25T01:59:35.745 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.compaction_filter_factory: None 2024-04-25T01:59:35.745 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.sst_partitioner_factory: None 2024-04-25T01:59:35.745 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-25T01:59:35.746 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-25T01:59:35.746 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55976ead8f58) 2024-04-25T01:59:35.746 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: cache_index_and_filter_blocks: 1 2024-04-25T01:59:35.746 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-25T01:59:35.746 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-25T01:59:35.746 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: pin_top_level_index_and_filter: 1 2024-04-25T01:59:35.746 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: index_type: 0 2024-04-25T01:59:35.746 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: data_block_index_type: 0 2024-04-25T01:59:35.746 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: index_shortening: 1 2024-04-25T01:59:35.746 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-25T01:59:35.746 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: hash_index_allow_collision: 1 2024-04-25T01:59:35.746 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: checksum: 1 2024-04-25T01:59:35.746 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: no_block_cache: 0 2024-04-25T01:59:35.746 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_cache: 0x55976eb0b090 2024-04-25T01:59:35.747 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_cache_name: BinnedLRUCache 2024-04-25T01:59:35.747 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_cache_options: 2024-04-25T01:59:35.747 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: capacity : 536870912 2024-04-25T01:59:35.747 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: num_shard_bits : 4 2024-04-25T01:59:35.747 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: strict_capacity_limit : 0 2024-04-25T01:59:35.747 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: high_pri_pool_ratio: 0.000 2024-04-25T01:59:35.747 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_cache_compressed: (nil) 2024-04-25T01:59:35.747 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: persistent_cache: (nil) 2024-04-25T01:59:35.747 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_size: 4096 2024-04-25T01:59:35.747 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_size_deviation: 10 2024-04-25T01:59:35.747 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_restart_interval: 16 2024-04-25T01:59:35.747 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: index_block_restart_interval: 1 2024-04-25T01:59:35.747 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: metadata_block_size: 4096 2024-04-25T01:59:35.747 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: partition_filters: 0 2024-04-25T01:59:35.747 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: use_delta_encoding: 1 2024-04-25T01:59:35.748 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-04-25T01:59:35.748 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: whole_key_filtering: 1 2024-04-25T01:59:35.748 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: verify_compression: 0 2024-04-25T01:59:35.748 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: read_amp_bytes_per_bit: 0 2024-04-25T01:59:35.748 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: format_version: 4 2024-04-25T01:59:35.748 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: enable_index_compression: 1 2024-04-25T01:59:35.748 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_align: 0 2024-04-25T01:59:35.748 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.write_buffer_size: 33554432 2024-04-25T01:59:35.748 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.max_write_buffer_number: 2 2024-04-25T01:59:35.748 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.compression: NoCompression 2024-04-25T01:59:35.748 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.bottommost_compression: Disabled 2024-04-25T01:59:35.748 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.prefix_extractor: nullptr 2024-04-25T01:59:35.749 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-25T01:59:35.749 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.num_levels: 7 2024-04-25T01:59:35.749 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-25T01:59:35.749 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-25T01:59:35.749 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-25T01:59:35.749 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-25T01:59:35.749 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-25T01:59:35.749 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-25T01:59:35.749 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-25T01:59:35.750 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-25T01:59:35.750 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-25T01:59:35.750 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-25T01:59:35.750 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-25T01:59:35.750 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.compression_opts.level: 32767 2024-04-25T01:59:35.750 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.compression_opts.strategy: 0 2024-04-25T01:59:35.750 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-25T01:59:35.750 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-25T01:59:35.751 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-25T01:59:35.751 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.compression_opts.enabled: false 2024-04-25T01:59:35.751 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-25T01:59:35.751 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-25T01:59:35.751 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-25T01:59:35.751 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.target_file_size_base: 67108864 2024-04-25T01:59:35.751 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-25T01:59:35.751 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-25T01:59:35.751 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-25T01:59:35.752 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-25T01:59:35.752 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-25T01:59:35.752 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-25T01:59:35.752 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-25T01:59:35.752 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-25T01:59:35.752 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-25T01:59:35.752 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-25T01:59:35.752 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-25T01:59:35.753 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-25T01:59:35.753 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-25T01:59:35.753 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.arena_block_size: 4194304 2024-04-25T01:59:35.753 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-25T01:59:35.753 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-25T01:59:35.753 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-04-25T01:59:35.754 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.disable_auto_compactions: 0 2024-04-25T01:59:35.754 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-25T01:59:35.754 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-25T01:59:35.754 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-25T01:59:35.754 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-25T01:59:35.754 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-25T01:59:35.754 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-25T01:59:35.755 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-25T01:59:35.755 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-25T01:59:35.755 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-25T01:59:35.755 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-25T01:59:35.755 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.table_properties_collectors: 2024-04-25T01:59:35.755 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.inplace_update_support: 0 2024-04-25T01:59:35.755 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-25T01:59:35.755 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-25T01:59:35.756 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-25T01:59:35.756 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-25T01:59:35.756 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.bloom_locality: 0 2024-04-25T01:59:35.756 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.max_successive_merges: 0 2024-04-25T01:59:35.756 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-25T01:59:35.756 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.paranoid_file_checks: 0 2024-04-25T01:59:35.756 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.force_consistency_checks: 1 2024-04-25T01:59:35.756 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.report_bg_io_stats: 0 2024-04-25T01:59:35.756 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.ttl: 2592000 2024-04-25T01:59:35.757 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-25T01:59:35.757 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.enable_blob_files: false 2024-04-25T01:59:35.757 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.min_blob_size: 0 2024-04-25T01:59:35.757 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.blob_file_size: 268435456 2024-04-25T01:59:35.757 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-25T01:59:35.757 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-25T01:59:35.758 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-25T01:59:35.758 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi077/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-25T01:59:35.758 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-04-25T01:59:35.758 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-04-25T01:59:35.758 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714010375696403, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-04-25T01:59:35.758 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-04-25T01:59:35.758 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-04-25T01:59:35.759 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714010375697282, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 93370, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 91482, "index_size": 248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13576, "raw_average_key_size": 49, "raw_value_size": 84046, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1714010375, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "8dd475b3-51d4-4330-9ef2-27d90d7c1e8d", "db_session_id": "GF2DY9A5HF59NX5W1NQT"}} 2024-04-25T01:59:35.759 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-04-25T01:59:35.759 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714010375697643, "job": 1, "event": "recovery_finished"} 2024-04-25T01:59:35.759 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi077/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-25T01:59:35.759 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55976ea9f180 2024-04-25T01:59:35.759 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: DB pointer 0x55976eb74000 2024-04-25T01:59:35.759 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-04-25T01:59:35.759 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-04-25T01:59:35.760 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ** DB Stats ** 2024-04-25T01:59:35.760 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T01:59:35.760 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-25T01:59:35.760 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T01:59:35.760 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T01:59:35.760 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-25T01:59:35.760 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-04-25T01:59:35.760 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T01:59:35.760 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-04-25T01:59:35.760 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ** Compaction Stats [default] ** 2024-04-25T01:59:35.760 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-25T01:59:35.760 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T01:59:35.760 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: L0 2/0 92.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 146.7 0.00 0.00 1 0.001 0 0 2024-04-25T01:59:35.760 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Sum 2/0 92.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 146.7 0.00 0.00 1 0.001 0 0 2024-04-25T01:59:35.761 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 146.7 0.00 0.00 1 0.001 0 0 2024-04-25T01:59:35.761 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-04-25T01:59:35.761 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ** Compaction Stats [default] ** 2024-04-25T01:59:35.761 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-25T01:59:35.761 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T01:59:35.761 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 146.7 0.00 0.00 1 0.001 0 0 2024-04-25T01:59:35.761 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T01:59:35.761 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-25T01:59:35.761 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-25T01:59:35.761 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-25T01:59:35.761 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-25T01:59:35.761 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-25T01:59:35.761 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Cumulative compaction: 0.00 GB write, 28.92 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T01:59:35.761 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Interval compaction: 0.00 GB write, 28.92 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T01:59:35.761 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-25T01:59:35.762 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-04-25T01:59:35.762 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-25T01:59:35.762 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-04-25T01:59:35.762 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ** Compaction Stats [default] ** 2024-04-25T01:59:35.762 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-25T01:59:35.762 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T01:59:35.762 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: L0 2/0 92.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 146.7 0.00 0.00 1 0.001 0 0 2024-04-25T01:59:35.762 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Sum 2/0 92.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 146.7 0.00 0.00 1 0.001 0 0 2024-04-25T01:59:35.762 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-04-25T01:59:35.762 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-04-25T01:59:35.762 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ** Compaction Stats [default] ** 2024-04-25T01:59:35.762 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-25T01:59:35.762 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T01:59:35.762 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 146.7 0.00 0.00 1 0.001 0 0 2024-04-25T01:59:35.763 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T01:59:35.763 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-25T01:59:35.763 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-25T01:59:35.763 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-25T01:59:35.763 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-25T01:59:35.763 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-25T01:59:35.763 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Cumulative compaction: 0.00 GB write, 28.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T01:59:35.763 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T01:59:35.763 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-25T01:59:35.763 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-04-25T01:59:35.763 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-25T01:59:35.763 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: starting mon.smithi077 rank 0 at public addrs [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] at bind addrs [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi077 fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 2024-04-25T01:59:35.763 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: mon.smithi077@-1(???) e1 preinit fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 2024-04-25T01:59:35.764 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: mon.smithi077@-1(???).mds e1 new map 2024-04-25T01:59:35.764 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: mon.smithi077@-1(???).mds e1 print_map 2024-04-25T01:59:35.764 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: e1 2024-04-25T01:59:35.764 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T01:59:35.764 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T01:59:35.764 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: legacy client fscid: -1 2024-04-25T01:59:35.764 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-04-25T01:59:35.764 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: No filesystems configured 2024-04-25T01:59:35.764 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: mon.smithi077@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-25T01:59:35.764 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: mon.smithi077@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T01:59:35.764 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: mon.smithi077@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T01:59:35.764 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: mon.smithi077@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T01:59:35.765 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: mon.smithi077@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-25T01:59:35.765 INFO:teuthology.orchestra.run.smithi077.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-25T01:59:36.032 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 bash[26312]: adb57965a306d2c8d91a35d5e8d13e6576037a1dc774ee46816d4486f2155519 2024-04-25T01:59:36.032 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 systemd[1]: Started Ceph mon.smithi077 for 4bb93d82-02a7-11ef-bc93-c7b262605968. 2024-04-25T01:59:36.032 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: mon.smithi077 is new leader, mons smithi077 in quorum (ranks 0) 2024-04-25T01:59:36.032 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: monmap e1: 1 mons at {smithi077=[v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-25T01:59:36.032 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: fsmap 2024-04-25T01:59:36.032 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: osdmap e1: 0 total, 0 up, 0 in 2024-04-25T01:59:36.033 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:35 smithi077 ceph-mon[26330]: mgrmap e1: no daemons active 2024-04-25T01:59:36.717 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.125+0000 7f93e404a700 1 Processor -- start 2024-04-25T01:59:36.717 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.125+0000 7f93e404a700 1 -- start start 2024-04-25T01:59:36.717 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.125+0000 7f93e404a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93dc078ca0 0x7f93dc077250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:36.717 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.125+0000 7f93e404a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc0790b0 con 0x7f93dc078ca0 2024-04-25T01:59:36.717 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.125+0000 7f93e1de6700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93dc078ca0 0x7f93dc077250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:36.718 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.125+0000 7f93e1de6700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93dc078ca0 0x7f93dc077250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49860/0 (socket says 172.21.15.77:49860) 2024-04-25T01:59:36.718 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.125+0000 7f93e1de6700 1 -- 172.21.15.77:0/1947401277 learned_addr learned my addr 172.21.15.77:0/1947401277 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:59:36.718 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.126+0000 7f93e1de6700 1 -- 172.21.15.77:0/1947401277 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93dc077790 con 0x7f93dc078ca0 2024-04-25T01:59:36.718 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.126+0000 7f93e1de6700 1 --2- 172.21.15.77:0/1947401277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93dc078ca0 0x7f93dc077250 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f93d80098e0 tx=0x7f93d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d13e8ba97e2504 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:36.718 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.126+0000 7f93e0de4700 1 -- 172.21.15.77:0/1947401277 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f93d800b860 con 0x7f93dc078ca0 2024-04-25T01:59:36.718 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.126+0000 7f93e0de4700 1 -- 172.21.15.77:0/1947401277 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f93d800be50 con 0x7f93dc078ca0 2024-04-25T01:59:36.718 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.126+0000 7f93e0de4700 1 -- 172.21.15.77:0/1947401277 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f93d8010380 con 0x7f93dc078ca0 2024-04-25T01:59:36.718 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.127+0000 7f93e404a700 1 -- 172.21.15.77:0/1947401277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93dc078ca0 msgr2=0x7f93dc077250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:36.718 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.127+0000 7f93e404a700 1 --2- 172.21.15.77:0/1947401277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93dc078ca0 0x7f93dc077250 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f93d80098e0 tx=0x7f93d8009250 comp rx=0 tx=0).stop 2024-04-25T01:59:36.718 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.127+0000 7f93e404a700 1 -- 172.21.15.77:0/1947401277 shutdown_connections 2024-04-25T01:59:36.718 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.127+0000 7f93e404a700 1 --2- 172.21.15.77:0/1947401277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93dc078ca0 0x7f93dc077250 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:36.718 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.127+0000 7f93e404a700 1 -- 172.21.15.77:0/1947401277 >> 172.21.15.77:0/1947401277 conn(0x7f93dc0fe060 msgr2=0x7f93dc100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:36.718 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.127+0000 7f93e404a700 1 -- 172.21.15.77:0/1947401277 shutdown_connections 2024-04-25T01:59:36.719 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.127+0000 7f93e404a700 1 -- 172.21.15.77:0/1947401277 wait complete. 2024-04-25T01:59:36.719 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.127+0000 7f93e404a700 1 Processor -- start 2024-04-25T01:59:36.719 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.127+0000 7f93e404a700 1 -- start start 2024-04-25T01:59:36.719 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.128+0000 7f93e404a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93dc078ca0 0x7f93dc113860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:36.719 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.128+0000 7f93e404a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc113da0 con 0x7f93dc078ca0 2024-04-25T01:59:36.719 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.128+0000 7f93e1de6700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93dc078ca0 0x7f93dc113860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:36.719 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.128+0000 7f93e1de6700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93dc078ca0 0x7f93dc113860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49872/0 (socket says 172.21.15.77:49872) 2024-04-25T01:59:36.719 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.128+0000 7f93e1de6700 1 -- 172.21.15.77:0/609063071 learned_addr learned my addr 172.21.15.77:0/609063071 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:59:36.719 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.128+0000 7f93e1de6700 1 -- 172.21.15.77:0/609063071 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d80094f0 con 0x7f93dc078ca0 2024-04-25T01:59:36.719 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.128+0000 7f93e1de6700 1 --2- 172.21.15.77:0/609063071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93dc078ca0 0x7f93dc113860 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f93d8006fd0 tx=0x7f93d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:36.719 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.128+0000 7f93d27fc700 1 -- 172.21.15.77:0/609063071 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f93d80107c0 con 0x7f93dc078ca0 2024-04-25T01:59:36.719 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.128+0000 7f93d27fc700 1 -- 172.21.15.77:0/609063071 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f93d8010db0 con 0x7f93dc078ca0 2024-04-25T01:59:36.719 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.128+0000 7f93e404a700 1 -- 172.21.15.77:0/609063071 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93dc113fa0 con 0x7f93dc078ca0 2024-04-25T01:59:36.720 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.128+0000 7f93d27fc700 1 -- 172.21.15.77:0/609063071 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f93d801ada0 con 0x7f93dc078ca0 2024-04-25T01:59:36.720 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.128+0000 7f93e404a700 1 -- 172.21.15.77:0/609063071 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93dc114b10 con 0x7f93dc078ca0 2024-04-25T01:59:36.720 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.128+0000 7f93d27fc700 1 -- 172.21.15.77:0/609063071 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f93d8019410 con 0x7f93dc078ca0 2024-04-25T01:59:36.720 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.129+0000 7f93d27fc700 1 -- 172.21.15.77:0/609063071 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f93d8024750 con 0x7f93dc078ca0 2024-04-25T01:59:36.720 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.129+0000 7f93e404a700 1 -- 172.21.15.77:0/609063071 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93dc05f5c0 con 0x7f93dc078ca0 2024-04-25T01:59:36.720 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.131+0000 7f93d27fc700 1 -- 172.21.15.77:0/609063071 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f93d8029060 con 0x7f93dc078ca0 2024-04-25T01:59:36.720 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.197+0000 7f93e404a700 1 -- 172.21.15.77:0/609063071 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f93dc108ac0 con 0x7f93dc078ca0 2024-04-25T01:59:36.720 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.202+0000 7f93d27fc700 1 -- 172.21.15.77:0/609063071 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f93d8020070 con 0x7f93dc078ca0 2024-04-25T01:59:36.720 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.202+0000 7f93e404a700 1 -- 172.21.15.77:0/609063071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93dc078ca0 msgr2=0x7f93dc113860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:36.720 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.202+0000 7f93e404a700 1 --2- 172.21.15.77:0/609063071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93dc078ca0 0x7f93dc113860 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f93d8006fd0 tx=0x7f93d8009250 comp rx=0 tx=0).stop 2024-04-25T01:59:36.720 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.202+0000 7f93e404a700 1 -- 172.21.15.77:0/609063071 shutdown_connections 2024-04-25T01:59:36.720 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.202+0000 7f93e404a700 1 --2- 172.21.15.77:0/609063071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93dc078ca0 0x7f93dc113860 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:36.720 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.202+0000 7f93e404a700 1 -- 172.21.15.77:0/609063071 >> 172.21.15.77:0/609063071 conn(0x7f93dc0fe060 msgr2=0x7f93dc0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:36.720 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.202+0000 7f93e404a700 1 -- 172.21.15.77:0/609063071 shutdown_connections 2024-04-25T01:59:36.720 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.202+0000 7f93e404a700 1 -- 172.21.15.77:0/609063071 wait complete. 2024-04-25T01:59:36.721 INFO:teuthology.orchestra.run.smithi077.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-25T01:59:36.721 INFO:teuthology.orchestra.run.smithi077.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-25T01:59:36.721 INFO:teuthology.orchestra.run.smithi077.stdout:Creating mgr... 2024-04-25T01:59:36.721 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying port 9283 ... 2024-04-25T01:59:36.885 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@mgr.smithi077.zpflzp 2024-04-25T01:59:36.885 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Failed to reset failed state of unit ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@mgr.smithi077.zpflzp.service: Unit ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@mgr.smithi077.zpflzp.service not loaded. 2024-04-25T01:59:37.030 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-4bb93d82-02a7-11ef-bc93-c7b262605968.target.wants/ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@mgr.smithi077.zpflzp.service → /etc/systemd/system/ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@.service. 2024-04-25T01:59:37.365 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:37 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/609063071' entity='client.admin' 2024-04-25T01:59:37.545 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-25T01:59:37.545 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout disabled 2024-04-25T01:59:37.552 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-25T01:59:37.552 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout inactive 2024-04-25T01:59:37.553 INFO:teuthology.orchestra.run.smithi077.stdout:firewalld.service is not enabled 2024-04-25T01:59:37.553 INFO:teuthology.orchestra.run.smithi077.stdout:Not possible to enable service . firewalld.service is not available 2024-04-25T01:59:37.561 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-25T01:59:37.561 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout disabled 2024-04-25T01:59:37.568 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-25T01:59:37.569 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout inactive 2024-04-25T01:59:37.569 INFO:teuthology.orchestra.run.smithi077.stdout:firewalld.service is not enabled 2024-04-25T01:59:37.569 INFO:teuthology.orchestra.run.smithi077.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2024-04-25T01:59:37.569 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for mgr to start... 2024-04-25T01:59:37.569 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for mgr... 2024-04-25T01:59:38.271 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:38 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/3320340973' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-25T01:59:38.617 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-04-25T01:59:38.617 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout { 2024-04-25T01:59:38.617 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "fsid": "4bb93d82-02a7-11ef-bc93-c7b262605968", 2024-04-25T01:59:38.617 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "health": { 2024-04-25T01:59:38.617 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-25T01:59:38.617 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-25T01:59:38.617 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-25T01:59:38.617 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:59:38.617 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-25T01:59:38.617 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-25T01:59:38.617 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 0 2024-04-25T01:59:38.618 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-04-25T01:59:38.618 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-25T01:59:38.618 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "smithi077" 2024-04-25T01:59:38.618 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-04-25T01:59:38.618 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-04-25T01:59:38.618 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-25T01:59:38.618 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T01:59:38.618 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-25T01:59:38.618 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-25T01:59:38.618 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:59:38.618 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-25T01:59:38.618 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T01:59:38.618 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-25T01:59:38.618 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-25T01:59:38.619 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-25T01:59:38.627 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-25T01:59:38.627 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-25T01:59:38.627 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-25T01:59:38.627 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:59:38.627 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-25T01:59:38.627 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-25T01:59:38.627 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-25T01:59:38.627 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-25T01:59:38.627 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-25T01:59:38.627 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-25T01:59:38.627 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-25T01:59:38.627 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-25T01:59:38.627 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-25T01:59:38.628 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:59:38.628 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-25T01:59:38.628 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T01:59:38.628 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-25T01:59:38.628 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-25T01:59:38.628 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:59:38.628 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-25T01:59:38.628 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-25T01:59:38.628 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-25T01:59:38.628 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-25T01:59:38.628 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-25T01:59:38.628 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-25T01:59:38.628 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "restful" 2024-04-25T01:59:38.628 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-04-25T01:59:38.628 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T01:59:38.629 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:59:38.629 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-25T01:59:38.629 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T01:59:38.629 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "modified": "2024-04-25T01:59:22.235853+0000", 2024-04-25T01:59:38.629 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T01:59:38.629 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:59:38.629 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-25T01:59:38.629 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout } 2024-04-25T01:59:38.629 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.976+0000 7f94f2145700 1 Processor -- start 2024-04-25T01:59:38.629 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.976+0000 7f94f2145700 1 -- start start 2024-04-25T01:59:38.629 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.976+0000 7f94f2145700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94ec076c00 0x7f94ec105480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:38.629 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.976+0000 7f94f2145700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec1059c0 con 0x7f94ec076c00 2024-04-25T01:59:38.629 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.977+0000 7f94eb7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94ec076c00 0x7f94ec105480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:38.629 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.977+0000 7f94eb7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94ec076c00 0x7f94ec105480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33718/0 (socket says 172.21.15.77:33718) 2024-04-25T01:59:38.629 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.977+0000 7f94eb7fe700 1 -- 172.21.15.77:0/946785340 learned_addr learned my addr 172.21.15.77:0/946785340 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:59:38.630 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.977+0000 7f94eb7fe700 1 -- 172.21.15.77:0/946785340 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec105b00 con 0x7f94ec076c00 2024-04-25T01:59:38.630 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.977+0000 7f94eb7fe700 1 --2- 172.21.15.77:0/946785340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94ec076c00 0x7f94ec105480 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f94dc0098e0 tx=0x7f94dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=751d8d4379d62063 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:38.630 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.977+0000 7f94eaffd700 1 -- 172.21.15.77:0/946785340 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f94dc00b860 con 0x7f94ec076c00 2024-04-25T01:59:38.630 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.977+0000 7f94eaffd700 1 -- 172.21.15.77:0/946785340 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f94dc00be50 con 0x7f94ec076c00 2024-04-25T01:59:38.630 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.977+0000 7f94eaffd700 1 -- 172.21.15.77:0/946785340 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f94dc010380 con 0x7f94ec076c00 2024-04-25T01:59:38.630 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.978+0000 7f94f2145700 1 -- 172.21.15.77:0/946785340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94ec076c00 msgr2=0x7f94ec105480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:38.630 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.978+0000 7f94f2145700 1 --2- 172.21.15.77:0/946785340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94ec076c00 0x7f94ec105480 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f94dc0098e0 tx=0x7f94dc009250 comp rx=0 tx=0).stop 2024-04-25T01:59:38.630 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.978+0000 7f94f2145700 1 -- 172.21.15.77:0/946785340 shutdown_connections 2024-04-25T01:59:38.630 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.978+0000 7f94f2145700 1 --2- 172.21.15.77:0/946785340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94ec076c00 0x7f94ec105480 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:38.630 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.978+0000 7f94f2145700 1 -- 172.21.15.77:0/946785340 >> 172.21.15.77:0/946785340 conn(0x7f94ec0fcf50 msgr2=0x7f94ec0ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:38.630 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.978+0000 7f94f2145700 1 -- 172.21.15.77:0/946785340 shutdown_connections 2024-04-25T01:59:38.630 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.978+0000 7f94f2145700 1 -- 172.21.15.77:0/946785340 wait complete. 2024-04-25T01:59:38.630 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.979+0000 7f94f2145700 1 Processor -- start 2024-04-25T01:59:38.630 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.979+0000 7f94f2145700 1 -- start start 2024-04-25T01:59:38.631 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.979+0000 7f94f2145700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94ec076c00 0x7f94ec102dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:38.631 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.979+0000 7f94f2145700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec103310 con 0x7f94ec076c00 2024-04-25T01:59:38.631 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.979+0000 7f94eb7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94ec076c00 0x7f94ec102dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:38.631 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.979+0000 7f94eb7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94ec076c00 0x7f94ec102dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33728/0 (socket says 172.21.15.77:33728) 2024-04-25T01:59:38.631 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.979+0000 7f94eb7fe700 1 -- 172.21.15.77:0/3320340973 learned_addr learned my addr 172.21.15.77:0/3320340973 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:59:38.631 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.979+0000 7f94eb7fe700 1 -- 172.21.15.77:0/3320340973 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94dc0094f0 con 0x7f94ec076c00 2024-04-25T01:59:38.631 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.980+0000 7f94eb7fe700 1 --2- 172.21.15.77:0/3320340973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94ec076c00 0x7f94ec102dd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f94dc003080 tx=0x7f94dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:38.631 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.980+0000 7f94e8ff9700 1 -- 172.21.15.77:0/3320340973 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f94dc010760 con 0x7f94ec076c00 2024-04-25T01:59:38.631 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.980+0000 7f94e8ff9700 1 -- 172.21.15.77:0/3320340973 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f94dc010d50 con 0x7f94ec076c00 2024-04-25T01:59:38.631 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.980+0000 7f94e8ff9700 1 -- 172.21.15.77:0/3320340973 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f94dc01ace0 con 0x7f94ec076c00 2024-04-25T01:59:38.631 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.980+0000 7f94f2145700 1 -- 172.21.15.77:0/3320340973 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94ec101380 con 0x7f94ec076c00 2024-04-25T01:59:38.631 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.980+0000 7f94f2145700 1 -- 172.21.15.77:0/3320340973 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ec101870 con 0x7f94ec076c00 2024-04-25T01:59:38.631 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.981+0000 7f94e8ff9700 1 -- 172.21.15.77:0/3320340973 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f94dc0108c0 con 0x7f94ec076c00 2024-04-25T01:59:38.631 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.981+0000 7f94e8ff9700 1 -- 172.21.15.77:0/3320340973 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f94dc02ed10 con 0x7f94ec076c00 2024-04-25T01:59:38.631 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.981+0000 7f94f2145700 1 -- 172.21.15.77:0/3320340973 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94ec04bed0 con 0x7f94ec076c00 2024-04-25T01:59:38.632 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:37.983+0000 7f94e8ff9700 1 -- 172.21.15.77:0/3320340973 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f94dc029070 con 0x7f94ec076c00 2024-04-25T01:59:38.632 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:38.055+0000 7f94f2145700 1 -- 172.21.15.77:0/3320340973 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f94ec101ab0 con 0x7f94ec076c00 2024-04-25T01:59:38.632 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:38.055+0000 7f94e8ff9700 1 -- 172.21.15.77:0/3320340973 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f94dc02e440 con 0x7f94ec076c00 2024-04-25T01:59:38.632 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:38.056+0000 7f94f2145700 1 -- 172.21.15.77:0/3320340973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94ec076c00 msgr2=0x7f94ec102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:38.632 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:38.056+0000 7f94f2145700 1 --2- 172.21.15.77:0/3320340973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94ec076c00 0x7f94ec102dd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f94dc003080 tx=0x7f94dc009250 comp rx=0 tx=0).stop 2024-04-25T01:59:38.632 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:38.056+0000 7f94f2145700 1 -- 172.21.15.77:0/3320340973 shutdown_connections 2024-04-25T01:59:38.632 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:38.056+0000 7f94f2145700 1 --2- 172.21.15.77:0/3320340973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94ec076c00 0x7f94ec102dd0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:38.632 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:38.056+0000 7f94f2145700 1 -- 172.21.15.77:0/3320340973 >> 172.21.15.77:0/3320340973 conn(0x7f94ec0fcf50 msgr2=0x7f94ec0fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:38.632 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:38.056+0000 7f94f2145700 1 -- 172.21.15.77:0/3320340973 shutdown_connections 2024-04-25T01:59:38.632 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:38.056+0000 7f94f2145700 1 -- 172.21.15.77:0/3320340973 wait complete. 2024-04-25T01:59:38.632 INFO:teuthology.orchestra.run.smithi077.stdout:mgr not available, waiting (1/15)... 2024-04-25T01:59:42.262 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:42 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/3809754240' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-25T01:59:42.564 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-04-25T01:59:42.564 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout { 2024-04-25T01:59:42.564 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "fsid": "4bb93d82-02a7-11ef-bc93-c7b262605968", 2024-04-25T01:59:42.564 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "health": { 2024-04-25T01:59:42.564 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-25T01:59:42.564 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-25T01:59:42.565 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-25T01:59:42.565 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:59:42.565 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-25T01:59:42.565 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-25T01:59:42.565 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 0 2024-04-25T01:59:42.565 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-04-25T01:59:42.565 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-25T01:59:42.565 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "smithi077" 2024-04-25T01:59:42.565 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-04-25T01:59:42.565 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-04-25T01:59:42.565 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-25T01:59:42.565 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T01:59:42.565 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-25T01:59:42.566 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-25T01:59:42.566 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:59:42.566 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-25T01:59:42.566 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T01:59:42.566 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-25T01:59:42.566 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-25T01:59:42.566 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-25T01:59:42.574 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-25T01:59:42.574 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-25T01:59:42.575 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-25T01:59:42.575 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:59:42.575 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-25T01:59:42.575 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-25T01:59:42.575 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-25T01:59:42.575 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-25T01:59:42.575 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-25T01:59:42.575 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-25T01:59:42.575 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-25T01:59:42.575 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-25T01:59:42.575 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-25T01:59:42.575 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:59:42.576 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-25T01:59:42.576 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T01:59:42.576 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-25T01:59:42.576 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-25T01:59:42.576 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:59:42.576 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-25T01:59:42.576 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-25T01:59:42.576 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-25T01:59:42.576 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-25T01:59:42.576 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-25T01:59:42.577 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-25T01:59:42.577 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "restful" 2024-04-25T01:59:42.577 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-04-25T01:59:42.577 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T01:59:42.577 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:59:42.577 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-25T01:59:42.577 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T01:59:42.577 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "modified": "2024-04-25T01:59:22.235853+0000", 2024-04-25T01:59:42.577 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T01:59:42.577 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:59:42.577 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-25T01:59:42.577 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout } 2024-04-25T01:59:42.577 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.894+0000 7fa55bc5b700 1 Processor -- start 2024-04-25T01:59:42.577 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.894+0000 7fa55bc5b700 1 -- start start 2024-04-25T01:59:42.578 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.894+0000 7fa55bc5b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5541028c0 0x7fa554102cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:42.578 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.894+0000 7fa55bc5b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa554103210 con 0x7fa5541028c0 2024-04-25T01:59:42.578 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.895+0000 7fa5599f7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5541028c0 0x7fa554102cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:42.578 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.895+0000 7fa5599f7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5541028c0 0x7fa554102cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33730/0 (socket says 172.21.15.77:33730) 2024-04-25T01:59:42.578 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.895+0000 7fa5599f7700 1 -- 172.21.15.77:0/595595705 learned_addr learned my addr 172.21.15.77:0/595595705 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:59:42.578 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.895+0000 7fa5599f7700 1 -- 172.21.15.77:0/595595705 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa554103350 con 0x7fa5541028c0 2024-04-25T01:59:42.578 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.895+0000 7fa5599f7700 1 --2- 172.21.15.77:0/595595705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5541028c0 0x7fa554102cd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa5440098e0 tx=0x7fa544009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=604d81a57fc0d55e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:42.578 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.895+0000 7fa5589f5700 1 -- 172.21.15.77:0/595595705 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa54400b860 con 0x7fa5541028c0 2024-04-25T01:59:42.578 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.895+0000 7fa5589f5700 1 -- 172.21.15.77:0/595595705 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa54400be50 con 0x7fa5541028c0 2024-04-25T01:59:42.578 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.895+0000 7fa5589f5700 1 -- 172.21.15.77:0/595595705 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa544010380 con 0x7fa5541028c0 2024-04-25T01:59:42.578 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.896+0000 7fa55bc5b700 1 -- 172.21.15.77:0/595595705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5541028c0 msgr2=0x7fa554102cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:42.578 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.896+0000 7fa55bc5b700 1 --2- 172.21.15.77:0/595595705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5541028c0 0x7fa554102cd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa5440098e0 tx=0x7fa544009250 comp rx=0 tx=0).stop 2024-04-25T01:59:42.578 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.896+0000 7fa55bc5b700 1 -- 172.21.15.77:0/595595705 shutdown_connections 2024-04-25T01:59:42.579 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.896+0000 7fa55bc5b700 1 --2- 172.21.15.77:0/595595705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5541028c0 0x7fa554102cd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:42.579 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.896+0000 7fa55bc5b700 1 -- 172.21.15.77:0/595595705 >> 172.21.15.77:0/595595705 conn(0x7fa5540fe060 msgr2=0x7fa554100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:42.579 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.896+0000 7fa55bc5b700 1 -- 172.21.15.77:0/595595705 shutdown_connections 2024-04-25T01:59:42.579 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.896+0000 7fa55bc5b700 1 -- 172.21.15.77:0/595595705 wait complete. 2024-04-25T01:59:42.579 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.897+0000 7fa55bc5b700 1 Processor -- start 2024-04-25T01:59:42.579 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.897+0000 7fa55bc5b700 1 -- start start 2024-04-25T01:59:42.579 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.897+0000 7fa55bc5b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5541028c0 0x7fa554077b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:42.579 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.897+0000 7fa55bc5b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa554078050 con 0x7fa5541028c0 2024-04-25T01:59:42.579 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.897+0000 7fa5599f7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5541028c0 0x7fa554077b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:42.579 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.897+0000 7fa5599f7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5541028c0 0x7fa554077b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33734/0 (socket says 172.21.15.77:33734) 2024-04-25T01:59:42.579 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.897+0000 7fa5599f7700 1 -- 172.21.15.77:0/3809754240 learned_addr learned my addr 172.21.15.77:0/3809754240 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:59:42.579 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.897+0000 7fa5599f7700 1 -- 172.21.15.77:0/3809754240 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5440094f0 con 0x7fa5541028c0 2024-04-25T01:59:42.579 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.897+0000 7fa5599f7700 1 --2- 172.21.15.77:0/3809754240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5541028c0 0x7fa554077b10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa544006b00 tx=0x7fa544009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:42.579 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.897+0000 7fa54a7fc700 1 -- 172.21.15.77:0/3809754240 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa544010760 con 0x7fa5541028c0 2024-04-25T01:59:42.579 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.898+0000 7fa54a7fc700 1 -- 172.21.15.77:0/3809754240 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa544010d50 con 0x7fa5541028c0 2024-04-25T01:59:42.580 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.898+0000 7fa54a7fc700 1 -- 172.21.15.77:0/3809754240 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa54401ad40 con 0x7fa5541028c0 2024-04-25T01:59:42.580 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.898+0000 7fa55bc5b700 1 -- 172.21.15.77:0/3809754240 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5540760c0 con 0x7fa5541028c0 2024-04-25T01:59:42.580 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.898+0000 7fa55bc5b700 1 -- 172.21.15.77:0/3809754240 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5540765b0 con 0x7fa5541028c0 2024-04-25T01:59:42.580 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.898+0000 7fa54a7fc700 1 -- 172.21.15.77:0/3809754240 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fa54402e440 con 0x7fa5541028c0 2024-04-25T01:59:42.580 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.898+0000 7fa54a7fc700 1 -- 172.21.15.77:0/3809754240 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa544024740 con 0x7fa5541028c0 2024-04-25T01:59:42.580 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.898+0000 7fa55bc5b700 1 -- 172.21.15.77:0/3809754240 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa55404bed0 con 0x7fa5541028c0 2024-04-25T01:59:42.580 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.901+0000 7fa54a7fc700 1 -- 172.21.15.77:0/3809754240 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7fa544029070 con 0x7fa5541028c0 2024-04-25T01:59:42.580 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.972+0000 7fa55bc5b700 1 -- 172.21.15.77:0/3809754240 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fa5540767f0 con 0x7fa5541028c0 2024-04-25T01:59:42.580 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.972+0000 7fa54a7fc700 1 -- 172.21.15.77:0/3809754240 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fa544006d30 con 0x7fa5541028c0 2024-04-25T01:59:42.580 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.974+0000 7fa55bc5b700 1 -- 172.21.15.77:0/3809754240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5541028c0 msgr2=0x7fa554077b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:42.580 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.974+0000 7fa55bc5b700 1 --2- 172.21.15.77:0/3809754240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5541028c0 0x7fa554077b10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa544006b00 tx=0x7fa544009250 comp rx=0 tx=0).stop 2024-04-25T01:59:42.580 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.974+0000 7fa55bc5b700 1 -- 172.21.15.77:0/3809754240 shutdown_connections 2024-04-25T01:59:42.580 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.974+0000 7fa55bc5b700 1 --2- 172.21.15.77:0/3809754240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5541028c0 0x7fa554077b10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:42.581 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.974+0000 7fa55bc5b700 1 -- 172.21.15.77:0/3809754240 >> 172.21.15.77:0/3809754240 conn(0x7fa5540fe060 msgr2=0x7fa5540febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:42.581 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.974+0000 7fa55bc5b700 1 -- 172.21.15.77:0/3809754240 shutdown_connections 2024-04-25T01:59:42.581 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:41.974+0000 7fa55bc5b700 1 -- 172.21.15.77:0/3809754240 wait complete. 2024-04-25T01:59:42.581 INFO:teuthology.orchestra.run.smithi077.stdout:mgr not available, waiting (2/15)... 2024-04-25T01:59:44.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:43 smithi077 ceph-mon[26330]: Activating manager daemon smithi077.zpflzp 2024-04-25T01:59:44.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:43 smithi077 ceph-mon[26330]: mgrmap e2: smithi077.zpflzp(active, starting, since 0.00385007s) 2024-04-25T01:59:44.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:43 smithi077 ceph-mon[26330]: from='mgr.14100 172.21.15.77:0/1593047749' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T01:59:44.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:43 smithi077 ceph-mon[26330]: from='mgr.14100 172.21.15.77:0/1593047749' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T01:59:44.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:43 smithi077 ceph-mon[26330]: from='mgr.14100 172.21.15.77:0/1593047749' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T01:59:44.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:43 smithi077 ceph-mon[26330]: from='mgr.14100 172.21.15.77:0/1593047749' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-04-25T01:59:44.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:43 smithi077 ceph-mon[26330]: from='mgr.14100 172.21.15.77:0/1593047749' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr metadata", "who": "smithi077.zpflzp", "id": "smithi077.zpflzp"}]: dispatch 2024-04-25T01:59:44.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:43 smithi077 ceph-mon[26330]: Manager daemon smithi077.zpflzp is now available 2024-04-25T01:59:44.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:43 smithi077 ceph-mon[26330]: from='mgr.14100 172.21.15.77:0/1593047749' entity='mgr.smithi077.zpflzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.zpflzp/mirror_snapshot_schedule"}]: dispatch 2024-04-25T01:59:44.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:43 smithi077 ceph-mon[26330]: from='mgr.14100 172.21.15.77:0/1593047749' entity='mgr.smithi077.zpflzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.zpflzp/trash_purge_schedule"}]: dispatch 2024-04-25T01:59:44.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:43 smithi077 ceph-mon[26330]: from='mgr.14100 172.21.15.77:0/1593047749' entity='mgr.smithi077.zpflzp' 2024-04-25T01:59:44.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:43 smithi077 ceph-mon[26330]: from='mgr.14100 172.21.15.77:0/1593047749' entity='mgr.smithi077.zpflzp' 2024-04-25T01:59:44.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:43 smithi077 ceph-mon[26330]: from='mgr.14100 172.21.15.77:0/1593047749' entity='mgr.smithi077.zpflzp' 2024-04-25T01:59:45.819 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-04-25T01:59:45.819 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout { 2024-04-25T01:59:45.819 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "fsid": "4bb93d82-02a7-11ef-bc93-c7b262605968", 2024-04-25T01:59:45.820 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "health": { 2024-04-25T01:59:45.820 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-25T01:59:45.820 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-25T01:59:45.820 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-25T01:59:45.820 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:59:45.820 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-25T01:59:45.820 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-25T01:59:45.820 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 0 2024-04-25T01:59:45.820 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-04-25T01:59:45.820 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-25T01:59:45.820 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "smithi077" 2024-04-25T01:59:45.820 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-04-25T01:59:45.820 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-04-25T01:59:45.821 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-25T01:59:45.821 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T01:59:45.821 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-25T01:59:45.821 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-25T01:59:45.821 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:59:45.821 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-25T01:59:45.821 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T01:59:45.821 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-25T01:59:45.821 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-25T01:59:45.821 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-25T01:59:45.831 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-25T01:59:45.831 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-25T01:59:45.831 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-25T01:59:45.831 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:59:45.831 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-25T01:59:45.831 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-25T01:59:45.831 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-25T01:59:45.831 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-25T01:59:45.831 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-25T01:59:45.831 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-25T01:59:45.831 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-25T01:59:45.832 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-25T01:59:45.832 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-25T01:59:45.832 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:59:45.832 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-25T01:59:45.832 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T01:59:45.832 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-25T01:59:45.832 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-25T01:59:45.832 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:59:45.832 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-25T01:59:45.832 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-25T01:59:45.832 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-25T01:59:45.832 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-25T01:59:45.832 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-25T01:59:45.833 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-25T01:59:45.833 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "restful" 2024-04-25T01:59:45.833 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-04-25T01:59:45.833 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T01:59:45.833 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:59:45.833 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-25T01:59:45.833 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T01:59:45.833 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "modified": "2024-04-25T01:59:22.235853+0000", 2024-04-25T01:59:45.833 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T01:59:45.833 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:59:45.833 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-25T01:59:45.833 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout } 2024-04-25T01:59:45.833 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.018+0000 7fba2ffc3700 1 Processor -- start 2024-04-25T01:59:45.833 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.018+0000 7fba2ffc3700 1 -- start start 2024-04-25T01:59:45.834 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.018+0000 7fba2ffc3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba28102880 0x7fba28102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:45.834 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.018+0000 7fba2ffc3700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba281031d0 con 0x7fba28102880 2024-04-25T01:59:45.834 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.018+0000 7fba2dd5f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba28102880 0x7fba28102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:45.834 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.019+0000 7fba2dd5f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba28102880 0x7fba28102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33806/0 (socket says 172.21.15.77:33806) 2024-04-25T01:59:45.834 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.019+0000 7fba2dd5f700 1 -- 172.21.15.77:0/2058264484 learned_addr learned my addr 172.21.15.77:0/2058264484 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:59:45.834 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.019+0000 7fba2dd5f700 1 -- 172.21.15.77:0/2058264484 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba28103310 con 0x7fba28102880 2024-04-25T01:59:45.834 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.019+0000 7fba2dd5f700 1 --2- 172.21.15.77:0/2058264484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba28102880 0x7fba28102c90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fba240098e0 tx=0x7fba24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f1d76dbb27f212 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:45.834 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.019+0000 7fba2cd5d700 1 -- 172.21.15.77:0/2058264484 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba2400b860 con 0x7fba28102880 2024-04-25T01:59:45.834 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.019+0000 7fba2cd5d700 1 -- 172.21.15.77:0/2058264484 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fba2400be50 con 0x7fba28102880 2024-04-25T01:59:45.834 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.019+0000 7fba2cd5d700 1 -- 172.21.15.77:0/2058264484 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba24010380 con 0x7fba28102880 2024-04-25T01:59:45.834 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.020+0000 7fba2ffc3700 1 -- 172.21.15.77:0/2058264484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba28102880 msgr2=0x7fba28102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:45.834 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.020+0000 7fba2ffc3700 1 --2- 172.21.15.77:0/2058264484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba28102880 0x7fba28102c90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fba240098e0 tx=0x7fba24009250 comp rx=0 tx=0).stop 2024-04-25T01:59:45.835 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.020+0000 7fba2ffc3700 1 -- 172.21.15.77:0/2058264484 shutdown_connections 2024-04-25T01:59:45.835 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.020+0000 7fba2ffc3700 1 --2- 172.21.15.77:0/2058264484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba28102880 0x7fba28102c90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:45.835 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.020+0000 7fba2ffc3700 1 -- 172.21.15.77:0/2058264484 >> 172.21.15.77:0/2058264484 conn(0x7fba280fe060 msgr2=0x7fba28100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:45.835 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.020+0000 7fba2ffc3700 1 -- 172.21.15.77:0/2058264484 shutdown_connections 2024-04-25T01:59:45.835 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.020+0000 7fba2ffc3700 1 -- 172.21.15.77:0/2058264484 wait complete. 2024-04-25T01:59:45.835 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.020+0000 7fba2ffc3700 1 Processor -- start 2024-04-25T01:59:45.835 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.020+0000 7fba2ffc3700 1 -- start start 2024-04-25T01:59:45.835 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.020+0000 7fba2ffc3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba28102880 0x7fba281115f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:45.835 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.020+0000 7fba2ffc3700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba28111b30 con 0x7fba28102880 2024-04-25T01:59:45.835 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.021+0000 7fba2dd5f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba28102880 0x7fba281115f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:45.835 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.021+0000 7fba2dd5f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba28102880 0x7fba281115f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33816/0 (socket says 172.21.15.77:33816) 2024-04-25T01:59:45.835 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.021+0000 7fba2dd5f700 1 -- 172.21.15.77:0/2280159234 learned_addr learned my addr 172.21.15.77:0/2280159234 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:59:45.835 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.021+0000 7fba2dd5f700 1 -- 172.21.15.77:0/2280159234 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba240094f0 con 0x7fba28102880 2024-04-25T01:59:45.836 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.021+0000 7fba2dd5f700 1 --2- 172.21.15.77:0/2280159234 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba28102880 0x7fba281115f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fba2400b440 tx=0x7fba24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:45.836 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.021+0000 7fba1e7fc700 1 -- 172.21.15.77:0/2280159234 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba24010760 con 0x7fba28102880 2024-04-25T01:59:45.836 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.021+0000 7fba1e7fc700 1 -- 172.21.15.77:0/2280159234 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fba24010d50 con 0x7fba28102880 2024-04-25T01:59:45.836 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.021+0000 7fba2ffc3700 1 -- 172.21.15.77:0/2280159234 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba28111d30 con 0x7fba28102880 2024-04-25T01:59:45.836 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.021+0000 7fba1e7fc700 1 -- 172.21.15.77:0/2280159234 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba2401ae20 con 0x7fba28102880 2024-04-25T01:59:45.836 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.021+0000 7fba2ffc3700 1 -- 172.21.15.77:0/2280159234 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba281128a0 con 0x7fba28102880 2024-04-25T01:59:45.836 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.022+0000 7fba1e7fc700 1 -- 172.21.15.77:0/2280159234 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 3) v1 ==== 43259+0+0 (secure 0 0 0) 0x7fba2402e440 con 0x7fba28102880 2024-04-25T01:59:45.836 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.022+0000 7fba1e7fc700 1 --2- 172.21.15.77:0/2280159234 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7fba140366d0 0x7fba14038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:45.836 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.022+0000 7fba1e7fc700 1 -- 172.21.15.77:0/2280159234 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fba2404a6a0 con 0x7fba28102880 2024-04-25T01:59:45.836 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.022+0000 7fba2d55e700 1 --2- 172.21.15.77:0/2280159234 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7fba140366d0 0x7fba14038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:45.836 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.022+0000 7fba2ffc3700 1 -- 172.21.15.77:0/2280159234 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba2805f5c0 con 0x7fba28102880 2024-04-25T01:59:45.836 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.023+0000 7fba2d55e700 1 --2- 172.21.15.77:0/2280159234 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7fba140366d0 0x7fba14038b80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fba18009990 tx=0x7fba18006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:45.836 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.027+0000 7fba1e7fc700 1 -- 172.21.15.77:0/2280159234 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fba24018940 con 0x7fba28102880 2024-04-25T01:59:45.837 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.285+0000 7fba2ffc3700 1 -- 172.21.15.77:0/2280159234 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fba28112ae0 con 0x7fba28102880 2024-04-25T01:59:45.837 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.286+0000 7fba1e7fc700 1 -- 172.21.15.77:0/2280159234 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1247 (secure 0 0 0) 0x7fba24018350 con 0x7fba28102880 2024-04-25T01:59:45.837 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.288+0000 7fba2ffc3700 1 -- 172.21.15.77:0/2280159234 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7fba140366d0 msgr2=0x7fba14038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:45.837 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.288+0000 7fba2ffc3700 1 --2- 172.21.15.77:0/2280159234 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7fba140366d0 0x7fba14038b80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fba18009990 tx=0x7fba18006e40 comp rx=0 tx=0).stop 2024-04-25T01:59:45.837 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.288+0000 7fba2ffc3700 1 -- 172.21.15.77:0/2280159234 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba28102880 msgr2=0x7fba281115f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:45.837 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.288+0000 7fba2ffc3700 1 --2- 172.21.15.77:0/2280159234 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba28102880 0x7fba281115f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fba2400b440 tx=0x7fba24009250 comp rx=0 tx=0).stop 2024-04-25T01:59:45.837 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.289+0000 7fba2ffc3700 1 -- 172.21.15.77:0/2280159234 shutdown_connections 2024-04-25T01:59:45.837 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.289+0000 7fba2ffc3700 1 --2- 172.21.15.77:0/2280159234 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7fba140366d0 0x7fba14038b80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:45.837 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.289+0000 7fba2ffc3700 1 --2- 172.21.15.77:0/2280159234 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba28102880 0x7fba281115f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:45.837 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.289+0000 7fba2ffc3700 1 -- 172.21.15.77:0/2280159234 >> 172.21.15.77:0/2280159234 conn(0x7fba280fe060 msgr2=0x7fba280feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:45.837 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.289+0000 7fba2ffc3700 1 -- 172.21.15.77:0/2280159234 shutdown_connections 2024-04-25T01:59:45.837 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:45.289+0000 7fba2ffc3700 1 -- 172.21.15.77:0/2280159234 wait complete. 2024-04-25T01:59:45.837 INFO:teuthology.orchestra.run.smithi077.stdout:mgr is available 2024-04-25T01:59:46.134 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:45 smithi077 ceph-mon[26330]: mgrmap e3: smithi077.zpflzp(active, since 1.00592s) 2024-04-25T01:59:46.134 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:45 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/2280159234' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-25T01:59:47.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:46 smithi077 ceph-mon[26330]: mgrmap e4: smithi077.zpflzp(active, since 2s) 2024-04-25T01:59:47.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:46 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/1179333479' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-25T01:59:47.322 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-04-25T01:59:47.322 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout [global] 2024-04-25T01:59:47.323 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout fsid = 4bb93d82-02a7-11ef-bc93-c7b262605968 2024-04-25T01:59:47.323 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-25T01:59:47.323 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-25T01:59:47.323 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-25T01:59:47.323 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-25T01:59:47.323 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-04-25T01:59:47.323 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-25T01:59:47.323 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-25T01:59:47.323 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-04-25T01:59:47.323 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout [osd] 2024-04-25T01:59:47.323 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-25T01:59:47.323 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-25T01:59:47.323 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-25T01:59:47.323 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-25T01:59:47.324 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-25T01:59:47.324 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.224+0000 7f6c5416d700 1 Processor -- start 2024-04-25T01:59:47.324 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.224+0000 7f6c5416d700 1 -- start start 2024-04-25T01:59:47.324 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.225+0000 7f6c5416d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c102880 0x7f6c4c102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:47.324 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.225+0000 7f6c5416d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c1031d0 con 0x7f6c4c102880 2024-04-25T01:59:47.324 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.225+0000 7f6c51f09700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c102880 0x7f6c4c102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:47.324 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.225+0000 7f6c51f09700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c102880 0x7f6c4c102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33826/0 (socket says 172.21.15.77:33826) 2024-04-25T01:59:47.324 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.225+0000 7f6c51f09700 1 -- 172.21.15.77:0/4174518351 learned_addr learned my addr 172.21.15.77:0/4174518351 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:59:47.324 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.225+0000 7f6c51f09700 1 -- 172.21.15.77:0/4174518351 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c103310 con 0x7f6c4c102880 2024-04-25T01:59:47.324 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.225+0000 7f6c51f09700 1 --2- 172.21.15.77:0/4174518351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c102880 0x7f6c4c102c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0098e0 tx=0x7f6c3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d40dd8b061e7a6d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:47.324 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.225+0000 7f6c50f07700 1 -- 172.21.15.77:0/4174518351 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c3c00b860 con 0x7f6c4c102880 2024-04-25T01:59:47.324 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.225+0000 7f6c50f07700 1 -- 172.21.15.77:0/4174518351 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f6c3c00be50 con 0x7f6c4c102880 2024-04-25T01:59:47.324 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.225+0000 7f6c50f07700 1 -- 172.21.15.77:0/4174518351 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c3c010380 con 0x7f6c4c102880 2024-04-25T01:59:47.324 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.226+0000 7f6c5416d700 1 -- 172.21.15.77:0/4174518351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c102880 msgr2=0x7f6c4c102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:47.325 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.226+0000 7f6c5416d700 1 --2- 172.21.15.77:0/4174518351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c102880 0x7f6c4c102c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0098e0 tx=0x7f6c3c009250 comp rx=0 tx=0).stop 2024-04-25T01:59:47.325 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.226+0000 7f6c5416d700 1 -- 172.21.15.77:0/4174518351 shutdown_connections 2024-04-25T01:59:47.325 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.226+0000 7f6c5416d700 1 --2- 172.21.15.77:0/4174518351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c102880 0x7f6c4c102c90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:47.325 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.226+0000 7f6c5416d700 1 -- 172.21.15.77:0/4174518351 >> 172.21.15.77:0/4174518351 conn(0x7f6c4c0fe060 msgr2=0x7f6c4c100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:47.325 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.226+0000 7f6c5416d700 1 -- 172.21.15.77:0/4174518351 shutdown_connections 2024-04-25T01:59:47.325 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.226+0000 7f6c5416d700 1 -- 172.21.15.77:0/4174518351 wait complete. 2024-04-25T01:59:47.325 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.226+0000 7f6c5416d700 1 Processor -- start 2024-04-25T01:59:47.325 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.226+0000 7f6c5416d700 1 -- start start 2024-04-25T01:59:47.325 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.227+0000 7f6c5416d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c102880 0x7f6c4c1115f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:47.325 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.227+0000 7f6c5416d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c111b30 con 0x7f6c4c102880 2024-04-25T01:59:47.325 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.227+0000 7f6c51f09700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c102880 0x7f6c4c1115f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:47.325 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.227+0000 7f6c51f09700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c102880 0x7f6c4c1115f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33836/0 (socket says 172.21.15.77:33836) 2024-04-25T01:59:47.325 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.227+0000 7f6c51f09700 1 -- 172.21.15.77:0/1179333479 learned_addr learned my addr 172.21.15.77:0/1179333479 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:59:47.325 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.227+0000 7f6c51f09700 1 -- 172.21.15.77:0/1179333479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3c0094f0 con 0x7f6c4c102880 2024-04-25T01:59:47.325 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.227+0000 7f6c51f09700 1 --2- 172.21.15.77:0/1179333479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c102880 0x7f6c4c1115f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c000c00 tx=0x7f6c3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:47.326 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.227+0000 7f6c427fc700 1 -- 172.21.15.77:0/1179333479 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c3c0107c0 con 0x7f6c4c102880 2024-04-25T01:59:47.326 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.227+0000 7f6c427fc700 1 -- 172.21.15.77:0/1179333479 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f6c3c010db0 con 0x7f6c4c102880 2024-04-25T01:59:47.326 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.227+0000 7f6c5416d700 1 -- 172.21.15.77:0/1179333479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4c111d30 con 0x7f6c4c102880 2024-04-25T01:59:47.326 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.227+0000 7f6c427fc700 1 -- 172.21.15.77:0/1179333479 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c3c01ad00 con 0x7f6c4c102880 2024-04-25T01:59:47.326 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.227+0000 7f6c5416d700 1 -- 172.21.15.77:0/1179333479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c4c1128a0 con 0x7f6c4c102880 2024-04-25T01:59:47.326 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.228+0000 7f6c427fc700 1 -- 172.21.15.77:0/1179333479 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7f6c3c0193c0 con 0x7f6c4c102880 2024-04-25T01:59:47.326 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.228+0000 7f6c427fc700 1 --2- 172.21.15.77:0/1179333479 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7f6c38036850 0x7f6c38038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:47.326 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.228+0000 7f6c5416d700 1 -- 172.21.15.77:0/1179333479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c4c05f5c0 con 0x7f6c4c102880 2024-04-25T01:59:47.326 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.228+0000 7f6c427fc700 1 -- 172.21.15.77:0/1179333479 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f6c3c04a6e0 con 0x7f6c4c102880 2024-04-25T01:59:47.326 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.228+0000 7f6c51708700 1 --2- 172.21.15.77:0/1179333479 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7f6c38036850 0x7f6c38038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:47.326 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.229+0000 7f6c51708700 1 --2- 172.21.15.77:0/1179333479 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7f6c38036850 0x7f6c38038d00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6c48009990 tx=0x7f6c48006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:47.326 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.233+0000 7f6c427fc700 1 -- 172.21.15.77:0/1179333479 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6c3c019670 con 0x7f6c4c102880 2024-04-25T01:59:47.326 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.416+0000 7f6c5416d700 1 -- 172.21.15.77:0/1179333479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f6c4c04bed0 con 0x7f6c4c102880 2024-04-25T01:59:47.327 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.417+0000 7f6c427fc700 1 -- 172.21.15.77:0/1179333479 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f6c3c010920 con 0x7f6c4c102880 2024-04-25T01:59:47.327 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.419+0000 7f6c5416d700 1 -- 172.21.15.77:0/1179333479 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7f6c38036850 msgr2=0x7f6c38038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:47.327 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.419+0000 7f6c5416d700 1 --2- 172.21.15.77:0/1179333479 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7f6c38036850 0x7f6c38038d00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6c48009990 tx=0x7f6c48006e40 comp rx=0 tx=0).stop 2024-04-25T01:59:47.327 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.419+0000 7f6c5416d700 1 -- 172.21.15.77:0/1179333479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c102880 msgr2=0x7f6c4c1115f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:47.327 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.419+0000 7f6c5416d700 1 --2- 172.21.15.77:0/1179333479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c102880 0x7f6c4c1115f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c000c00 tx=0x7f6c3c009250 comp rx=0 tx=0).stop 2024-04-25T01:59:47.327 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.420+0000 7f6c5416d700 1 -- 172.21.15.77:0/1179333479 shutdown_connections 2024-04-25T01:59:47.327 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.420+0000 7f6c5416d700 1 --2- 172.21.15.77:0/1179333479 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7f6c38036850 0x7f6c38038d00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:47.327 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.420+0000 7f6c5416d700 1 --2- 172.21.15.77:0/1179333479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4c102880 0x7f6c4c1115f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:47.327 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.420+0000 7f6c5416d700 1 -- 172.21.15.77:0/1179333479 >> 172.21.15.77:0/1179333479 conn(0x7f6c4c0fe060 msgr2=0x7f6c4c0feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:47.327 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.420+0000 7f6c5416d700 1 -- 172.21.15.77:0/1179333479 shutdown_connections 2024-04-25T01:59:47.327 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:46.420+0000 7f6c5416d700 1 -- 172.21.15.77:0/1179333479 wait complete. 2024-04-25T01:59:47.327 INFO:teuthology.orchestra.run.smithi077.stdout:Enabling cephadm module... 2024-04-25T01:59:48.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:48 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/378340554' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-25T01:59:48.636 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.725+0000 7efe76897700 1 Processor -- start 2024-04-25T01:59:48.636 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.725+0000 7efe76897700 1 -- start start 2024-04-25T01:59:48.636 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.725+0000 7efe76897700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe70102880 0x7efe70102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:48.636 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.725+0000 7efe76897700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe701031d0 con 0x7efe70102880 2024-04-25T01:59:48.636 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.726+0000 7efe6ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe70102880 0x7efe70102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:48.636 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.726+0000 7efe6ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe70102880 0x7efe70102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49486/0 (socket says 172.21.15.77:49486) 2024-04-25T01:59:48.636 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.726+0000 7efe6ffff700 1 -- 172.21.15.77:0/534406167 learned_addr learned my addr 172.21.15.77:0/534406167 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:59:48.636 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.726+0000 7efe6ffff700 1 -- 172.21.15.77:0/534406167 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe70103310 con 0x7efe70102880 2024-04-25T01:59:48.636 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.726+0000 7efe6ffff700 1 --2- 172.21.15.77:0/534406167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe70102880 0x7efe70102c90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efe600098e0 tx=0x7efe60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c74db7d063b669 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:48.636 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.726+0000 7efe6effd700 1 -- 172.21.15.77:0/534406167 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe6000b860 con 0x7efe70102880 2024-04-25T01:59:48.636 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.726+0000 7efe6effd700 1 -- 172.21.15.77:0/534406167 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7efe6000be50 con 0x7efe70102880 2024-04-25T01:59:48.637 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.726+0000 7efe6effd700 1 -- 172.21.15.77:0/534406167 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe60010380 con 0x7efe70102880 2024-04-25T01:59:48.637 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.727+0000 7efe76897700 1 -- 172.21.15.77:0/534406167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe70102880 msgr2=0x7efe70102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:48.637 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.727+0000 7efe76897700 1 --2- 172.21.15.77:0/534406167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe70102880 0x7efe70102c90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efe600098e0 tx=0x7efe60009250 comp rx=0 tx=0).stop 2024-04-25T01:59:48.637 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.727+0000 7efe76897700 1 -- 172.21.15.77:0/534406167 shutdown_connections 2024-04-25T01:59:48.637 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.727+0000 7efe76897700 1 --2- 172.21.15.77:0/534406167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe70102880 0x7efe70102c90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:48.637 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.727+0000 7efe76897700 1 -- 172.21.15.77:0/534406167 >> 172.21.15.77:0/534406167 conn(0x7efe700fe060 msgr2=0x7efe70100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:48.637 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.727+0000 7efe76897700 1 -- 172.21.15.77:0/534406167 shutdown_connections 2024-04-25T01:59:48.637 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.727+0000 7efe76897700 1 -- 172.21.15.77:0/534406167 wait complete. 2024-04-25T01:59:48.637 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.727+0000 7efe76897700 1 Processor -- start 2024-04-25T01:59:48.637 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.728+0000 7efe76897700 1 -- start start 2024-04-25T01:59:48.637 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.728+0000 7efe76897700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe70102880 0x7efe701115f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:48.637 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.728+0000 7efe76897700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe70111b30 con 0x7efe70102880 2024-04-25T01:59:48.637 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.728+0000 7efe6ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe70102880 0x7efe701115f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:48.637 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.728+0000 7efe6ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe70102880 0x7efe701115f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49492/0 (socket says 172.21.15.77:49492) 2024-04-25T01:59:48.638 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.728+0000 7efe6ffff700 1 -- 172.21.15.77:0/378340554 learned_addr learned my addr 172.21.15.77:0/378340554 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:59:48.638 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.728+0000 7efe6ffff700 1 -- 172.21.15.77:0/378340554 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe600094f0 con 0x7efe70102880 2024-04-25T01:59:48.638 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.728+0000 7efe6ffff700 1 --2- 172.21.15.77:0/378340554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe70102880 0x7efe701115f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efe6000b440 tx=0x7efe60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:48.638 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.728+0000 7efe6cff9700 1 -- 172.21.15.77:0/378340554 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe60010760 con 0x7efe70102880 2024-04-25T01:59:48.638 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.729+0000 7efe6cff9700 1 -- 172.21.15.77:0/378340554 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7efe60010d50 con 0x7efe70102880 2024-04-25T01:59:48.638 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.729+0000 7efe76897700 1 -- 172.21.15.77:0/378340554 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe70111d30 con 0x7efe70102880 2024-04-25T01:59:48.638 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.729+0000 7efe6cff9700 1 -- 172.21.15.77:0/378340554 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe6001ae20 con 0x7efe70102880 2024-04-25T01:59:48.638 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.729+0000 7efe76897700 1 -- 172.21.15.77:0/378340554 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe701128a0 con 0x7efe70102880 2024-04-25T01:59:48.638 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.729+0000 7efe6cff9700 1 -- 172.21.15.77:0/378340554 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7efe600108c0 con 0x7efe70102880 2024-04-25T01:59:48.638 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.730+0000 7efe6cff9700 1 --2- 172.21.15.77:0/378340554 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7efe58036850 0x7efe58038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:48.638 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.730+0000 7efe6cff9700 1 -- 172.21.15.77:0/378340554 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7efe6004a510 con 0x7efe70102880 2024-04-25T01:59:48.638 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.730+0000 7efe76897700 1 -- 172.21.15.77:0/378340554 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe7005f5c0 con 0x7efe70102880 2024-04-25T01:59:48.638 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.730+0000 7efe6f7fe700 1 --2- 172.21.15.77:0/378340554 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7efe58036850 0x7efe58038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:48.638 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.730+0000 7efe6f7fe700 1 --2- 172.21.15.77:0/378340554 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7efe58036850 0x7efe58038d00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efe64009990 tx=0x7efe64006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:48.639 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.734+0000 7efe6cff9700 1 -- 172.21.15.77:0/378340554 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7efe6002e440 con 0x7efe70102880 2024-04-25T01:59:48.639 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:47.971+0000 7efe76897700 1 -- 172.21.15.77:0/378340554 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7efe70112b80 con 0x7efe70102880 2024-04-25T01:59:48.639 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:48.023+0000 7efe6cff9700 1 -- 172.21.15.77:0/378340554 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7efe6002e7c0 con 0x7efe70102880 2024-04-25T01:59:48.639 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:48.025+0000 7efe6cff9700 1 -- 172.21.15.77:0/378340554 <== mon.0 v2:172.21.15.77:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7efe60018530 con 0x7efe70102880 2024-04-25T01:59:48.639 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:48.027+0000 7efe76897700 1 -- 172.21.15.77:0/378340554 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7efe58036850 msgr2=0x7efe58038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:48.639 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:48.027+0000 7efe76897700 1 --2- 172.21.15.77:0/378340554 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7efe58036850 0x7efe58038d00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efe64009990 tx=0x7efe64006e40 comp rx=0 tx=0).stop 2024-04-25T01:59:48.639 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:48.027+0000 7efe76897700 1 -- 172.21.15.77:0/378340554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe70102880 msgr2=0x7efe701115f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:48.639 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:48.027+0000 7efe76897700 1 --2- 172.21.15.77:0/378340554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe70102880 0x7efe701115f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efe6000b440 tx=0x7efe60009250 comp rx=0 tx=0).stop 2024-04-25T01:59:48.639 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:48.027+0000 7efe76897700 1 -- 172.21.15.77:0/378340554 shutdown_connections 2024-04-25T01:59:48.639 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:48.027+0000 7efe76897700 1 --2- 172.21.15.77:0/378340554 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7efe58036850 0x7efe58038d00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:48.639 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:48.027+0000 7efe76897700 1 --2- 172.21.15.77:0/378340554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe70102880 0x7efe701115f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:48.639 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:48.027+0000 7efe76897700 1 -- 172.21.15.77:0/378340554 >> 172.21.15.77:0/378340554 conn(0x7efe700fe060 msgr2=0x7efe700feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:48.639 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:48.027+0000 7efe76897700 1 -- 172.21.15.77:0/378340554 shutdown_connections 2024-04-25T01:59:48.639 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:48.027+0000 7efe76897700 1 -- 172.21.15.77:0/378340554 wait complete. 2024-04-25T01:59:49.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:49 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/378340554' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-25T01:59:49.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:49 smithi077 ceph-mon[26330]: mgrmap e5: smithi077.zpflzp(active, since 4s) 2024-04-25T01:59:49.900 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout { 2024-04-25T01:59:49.900 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-25T01:59:49.900 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-25T01:59:49.901 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "active_name": "smithi077.zpflzp", 2024-04-25T01:59:49.901 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-25T01:59:49.901 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout } 2024-04-25T01:59:49.901 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.057+0000 7fbb41c9b700 1 Processor -- start 2024-04-25T01:59:49.901 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.057+0000 7fbb41c9b700 1 -- start start 2024-04-25T01:59:49.901 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.057+0000 7fbb41c9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb3c0712d0 0x7fbb3c105450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:49.901 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.057+0000 7fbb41c9b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c105990 con 0x7fbb3c0712d0 2024-04-25T01:59:49.901 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.058+0000 7fbb3b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb3c0712d0 0x7fbb3c105450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:49.901 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.058+0000 7fbb3b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb3c0712d0 0x7fbb3c105450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49524/0 (socket says 172.21.15.77:49524) 2024-04-25T01:59:49.901 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.058+0000 7fbb3b7fe700 1 -- 172.21.15.77:0/3485257566 learned_addr learned my addr 172.21.15.77:0/3485257566 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:59:49.901 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.058+0000 7fbb3b7fe700 1 -- 172.21.15.77:0/3485257566 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3c105ad0 con 0x7fbb3c0712d0 2024-04-25T01:59:49.901 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.058+0000 7fbb3b7fe700 1 --2- 172.21.15.77:0/3485257566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb3c0712d0 0x7fbb3c105450 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c0098e0 tx=0x7fbb2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e5a104d5c87fbf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:49.901 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.058+0000 7fbb3a7fc700 1 -- 172.21.15.77:0/3485257566 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb2c00b860 con 0x7fbb3c0712d0 2024-04-25T01:59:49.901 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.058+0000 7fbb3a7fc700 1 -- 172.21.15.77:0/3485257566 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fbb2c00be50 con 0x7fbb3c0712d0 2024-04-25T01:59:49.902 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.058+0000 7fbb3a7fc700 1 -- 172.21.15.77:0/3485257566 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb2c010380 con 0x7fbb3c0712d0 2024-04-25T01:59:49.902 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.059+0000 7fbb41c9b700 1 -- 172.21.15.77:0/3485257566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb3c0712d0 msgr2=0x7fbb3c105450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:49.902 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.059+0000 7fbb41c9b700 1 --2- 172.21.15.77:0/3485257566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb3c0712d0 0x7fbb3c105450 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c0098e0 tx=0x7fbb2c009250 comp rx=0 tx=0).stop 2024-04-25T01:59:49.902 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.059+0000 7fbb41c9b700 1 -- 172.21.15.77:0/3485257566 shutdown_connections 2024-04-25T01:59:49.902 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.059+0000 7fbb41c9b700 1 --2- 172.21.15.77:0/3485257566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb3c0712d0 0x7fbb3c105450 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:49.902 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.059+0000 7fbb41c9b700 1 -- 172.21.15.77:0/3485257566 >> 172.21.15.77:0/3485257566 conn(0x7fbb3c0fcec0 msgr2=0x7fbb3c0ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:49.902 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.059+0000 7fbb41c9b700 1 -- 172.21.15.77:0/3485257566 shutdown_connections 2024-04-25T01:59:49.902 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.059+0000 7fbb41c9b700 1 -- 172.21.15.77:0/3485257566 wait complete. 2024-04-25T01:59:49.902 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.060+0000 7fbb41c9b700 1 Processor -- start 2024-04-25T01:59:49.902 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.060+0000 7fbb41c9b700 1 -- start start 2024-04-25T01:59:49.902 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.060+0000 7fbb41c9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb3c0712d0 0x7fbb3c1115c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:49.902 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.060+0000 7fbb41c9b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c111b00 con 0x7fbb3c0712d0 2024-04-25T01:59:49.902 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.060+0000 7fbb3b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb3c0712d0 0x7fbb3c1115c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:49.902 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.060+0000 7fbb3b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb3c0712d0 0x7fbb3c1115c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49532/0 (socket says 172.21.15.77:49532) 2024-04-25T01:59:49.903 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.060+0000 7fbb3b7fe700 1 -- 172.21.15.77:0/2292838226 learned_addr learned my addr 172.21.15.77:0/2292838226 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:59:49.903 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.060+0000 7fbb3b7fe700 1 -- 172.21.15.77:0/2292838226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2c0094f0 con 0x7fbb3c0712d0 2024-04-25T01:59:49.903 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.061+0000 7fbb3b7fe700 1 --2- 172.21.15.77:0/2292838226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb3c0712d0 0x7fbb3c1115c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c003050 tx=0x7fbb2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:49.903 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.061+0000 7fbb23fff700 1 -- 172.21.15.77:0/2292838226 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb2c010760 con 0x7fbb3c0712d0 2024-04-25T01:59:49.903 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.061+0000 7fbb23fff700 1 -- 172.21.15.77:0/2292838226 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fbb2c010d50 con 0x7fbb3c0712d0 2024-04-25T01:59:49.903 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.061+0000 7fbb41c9b700 1 -- 172.21.15.77:0/2292838226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb3c111d00 con 0x7fbb3c0712d0 2024-04-25T01:59:49.903 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.061+0000 7fbb23fff700 1 -- 172.21.15.77:0/2292838226 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb2c01ae20 con 0x7fbb3c0712d0 2024-04-25T01:59:49.903 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.061+0000 7fbb41c9b700 1 -- 172.21.15.77:0/2292838226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb3c112870 con 0x7fbb3c0712d0 2024-04-25T01:59:49.903 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.062+0000 7fbb23fff700 1 -- 172.21.15.77:0/2292838226 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fbb2c02e440 con 0x7fbb3c0712d0 2024-04-25T01:59:49.903 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.062+0000 7fbb23fff700 1 --2- 172.21.15.77:0/2292838226 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7fbb24036830 0x7fbb24038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:49.903 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.062+0000 7fbb23fff700 1 -- 172.21.15.77:0/2292838226 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fbb2c04a4d0 con 0x7fbb3c0712d0 2024-04-25T01:59:49.903 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.062+0000 7fbb3affd700 1 -- 172.21.15.77:0/2292838226 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7fbb24036830 msgr2=0x7fbb24038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/839529497 2024-04-25T01:59:49.903 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.062+0000 7fbb3affd700 1 --2- 172.21.15.77:0/2292838226 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7fbb24036830 0x7fbb24038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T01:59:49.903 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.062+0000 7fbb41c9b700 1 -- 172.21.15.77:0/2292838226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb3c05f5c0 con 0x7fbb3c0712d0 2024-04-25T01:59:49.903 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.066+0000 7fbb23fff700 1 -- 172.21.15.77:0/2292838226 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fbb2c0243f0 con 0x7fbb3c0712d0 2024-04-25T01:59:49.904 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.263+0000 7fbb3affd700 1 -- 172.21.15.77:0/2292838226 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7fbb24036830 msgr2=0x7fbb24038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/839529497 2024-04-25T01:59:49.904 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.263+0000 7fbb3affd700 1 --2- 172.21.15.77:0/2292838226 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7fbb24036830 0x7fbb24038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T01:59:49.904 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.343+0000 7fbb41c9b700 1 -- 172.21.15.77:0/2292838226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fbb3c112ab0 con 0x7fbb3c0712d0 2024-04-25T01:59:49.904 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.343+0000 7fbb23fff700 1 -- 172.21.15.77:0/2292838226 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7fbb2c018350 con 0x7fbb3c0712d0 2024-04-25T01:59:49.904 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.345+0000 7fbb41c9b700 1 -- 172.21.15.77:0/2292838226 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7fbb24036830 msgr2=0x7fbb24038ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T01:59:49.904 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.345+0000 7fbb41c9b700 1 --2- 172.21.15.77:0/2292838226 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7fbb24036830 0x7fbb24038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:49.904 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.345+0000 7fbb41c9b700 1 -- 172.21.15.77:0/2292838226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb3c0712d0 msgr2=0x7fbb3c1115c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:49.904 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.345+0000 7fbb41c9b700 1 --2- 172.21.15.77:0/2292838226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb3c0712d0 0x7fbb3c1115c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c003050 tx=0x7fbb2c009250 comp rx=0 tx=0).stop 2024-04-25T01:59:49.904 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.345+0000 7fbb41c9b700 1 -- 172.21.15.77:0/2292838226 shutdown_connections 2024-04-25T01:59:49.904 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.345+0000 7fbb41c9b700 1 --2- 172.21.15.77:0/2292838226 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7fbb24036830 0x7fbb24038ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:49.904 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.345+0000 7fbb41c9b700 1 --2- 172.21.15.77:0/2292838226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb3c0712d0 0x7fbb3c1115c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:49.904 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.345+0000 7fbb41c9b700 1 -- 172.21.15.77:0/2292838226 >> 172.21.15.77:0/2292838226 conn(0x7fbb3c0fcec0 msgr2=0x7fbb3c0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:49.904 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.346+0000 7fbb41c9b700 1 -- 172.21.15.77:0/2292838226 shutdown_connections 2024-04-25T01:59:49.904 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:49.346+0000 7fbb41c9b700 1 -- 172.21.15.77:0/2292838226 wait complete. 2024-04-25T01:59:49.905 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for the mgr to restart... 2024-04-25T01:59:49.905 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for mgr epoch 5... 2024-04-25T01:59:50.143 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:50 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/2292838226' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-25T01:59:54.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:54 smithi077 ceph-mon[26330]: Active manager daemon smithi077.zpflzp restarted 2024-04-25T01:59:54.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:54 smithi077 ceph-mon[26330]: Activating manager daemon smithi077.zpflzp 2024-04-25T01:59:54.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:54 smithi077 ceph-mon[26330]: osdmap e2: 0 total, 0 up, 0 in 2024-04-25T01:59:54.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:54 smithi077 ceph-mon[26330]: mgrmap e6: smithi077.zpflzp(active, starting, since 0.00372199s) 2024-04-25T01:59:54.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:54 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-04-25T01:59:54.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:54 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr metadata", "who": "smithi077.zpflzp", "id": "smithi077.zpflzp"}]: dispatch 2024-04-25T01:59:54.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:54 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T01:59:54.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:54 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T01:59:54.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:54 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T01:59:54.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:54 smithi077 ceph-mon[26330]: Manager daemon smithi077.zpflzp is now available 2024-04-25T01:59:54.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:54 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' 2024-04-25T01:59:54.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:54 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' 2024-04-25T01:59:54.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:54 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T01:59:54.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:54 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T01:59:54.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:54 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T01:59:54.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:54 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.zpflzp/mirror_snapshot_schedule"}]: dispatch 2024-04-25T01:59:55.856 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:55 smithi077 ceph-mon[26330]: Found migration_current of "None". Setting to last migration. 2024-04-25T01:59:55.856 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:55 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.zpflzp/trash_purge_schedule"}]: dispatch 2024-04-25T01:59:55.856 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:55 smithi077 ceph-mon[26330]: [25/Apr/2024:01:59:54] ENGINE Bus STARTING 2024-04-25T01:59:55.857 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:55 smithi077 ceph-mon[26330]: [25/Apr/2024:01:59:54] ENGINE Serving on https://172.21.15.77:7150 2024-04-25T01:59:55.857 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:55 smithi077 ceph-mon[26330]: [25/Apr/2024:01:59:54] ENGINE Bus STARTED 2024-04-25T01:59:55.857 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:55 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' 2024-04-25T01:59:55.857 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:55 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T01:59:55.857 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:55 smithi077 ceph-mon[26330]: mgrmap e7: smithi077.zpflzp(active, since 1.0063s) 2024-04-25T01:59:56.077 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout { 2024-04-25T01:59:56.077 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-25T01:59:56.077 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-25T01:59:56.077 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout } 2024-04-25T01:59:56.077 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.340+0000 7f987eafb700 1 Processor -- start 2024-04-25T01:59:56.077 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.340+0000 7f987eafb700 1 -- start start 2024-04-25T01:59:56.078 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.340+0000 7f987eafb700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9878102810 0x7f9878102c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:56.078 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.340+0000 7f987eafb700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9878103160 con 0x7f9878102810 2024-04-25T01:59:56.078 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.340+0000 7f987c897700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9878102810 0x7f9878102c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:56.078 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.341+0000 7f987c897700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9878102810 0x7f9878102c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49546/0 (socket says 172.21.15.77:49546) 2024-04-25T01:59:56.078 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.341+0000 7f987c897700 1 -- 172.21.15.77:0/3253548256 learned_addr learned my addr 172.21.15.77:0/3253548256 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:59:56.078 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.341+0000 7f987c897700 1 -- 172.21.15.77:0/3253548256 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98781032a0 con 0x7f9878102810 2024-04-25T01:59:56.078 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.341+0000 7f987c897700 1 --2- 172.21.15.77:0/3253548256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9878102810 0x7f9878102c20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f986c0098e0 tx=0x7f986c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178eee45733eca68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:56.078 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.341+0000 7f98777fe700 1 -- 172.21.15.77:0/3253548256 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f986c00b860 con 0x7f9878102810 2024-04-25T01:59:56.078 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.341+0000 7f98777fe700 1 -- 172.21.15.77:0/3253548256 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f986c00be50 con 0x7f9878102810 2024-04-25T01:59:56.078 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.341+0000 7f98777fe700 1 -- 172.21.15.77:0/3253548256 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f986c010380 con 0x7f9878102810 2024-04-25T01:59:56.078 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.342+0000 7f987eafb700 1 -- 172.21.15.77:0/3253548256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9878102810 msgr2=0x7f9878102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:56.078 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.342+0000 7f987eafb700 1 --2- 172.21.15.77:0/3253548256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9878102810 0x7f9878102c20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f986c0098e0 tx=0x7f986c009250 comp rx=0 tx=0).stop 2024-04-25T01:59:56.079 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.342+0000 7f987eafb700 1 -- 172.21.15.77:0/3253548256 shutdown_connections 2024-04-25T01:59:56.079 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.342+0000 7f987eafb700 1 --2- 172.21.15.77:0/3253548256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9878102810 0x7f9878102c20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:56.079 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.342+0000 7f987eafb700 1 -- 172.21.15.77:0/3253548256 >> 172.21.15.77:0/3253548256 conn(0x7f98780fdfd0 msgr2=0x7f98781003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:56.079 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.342+0000 7f987eafb700 1 -- 172.21.15.77:0/3253548256 shutdown_connections 2024-04-25T01:59:56.079 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.342+0000 7f987eafb700 1 -- 172.21.15.77:0/3253548256 wait complete. 2024-04-25T01:59:56.079 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.342+0000 7f987eafb700 1 Processor -- start 2024-04-25T01:59:56.079 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.342+0000 7f987eafb700 1 -- start start 2024-04-25T01:59:56.079 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.343+0000 7f987eafb700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9878102810 0x7f98781116a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:56.079 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.343+0000 7f987eafb700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9878111be0 con 0x7f9878102810 2024-04-25T01:59:56.079 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.343+0000 7f987c897700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9878102810 0x7f98781116a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:56.079 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.343+0000 7f987c897700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9878102810 0x7f98781116a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49558/0 (socket says 172.21.15.77:49558) 2024-04-25T01:59:56.079 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.343+0000 7f987c897700 1 -- 172.21.15.77:0/715458698 learned_addr learned my addr 172.21.15.77:0/715458698 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:59:56.079 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.343+0000 7f987c897700 1 -- 172.21.15.77:0/715458698 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c0094f0 con 0x7f9878102810 2024-04-25T01:59:56.079 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.343+0000 7f987c897700 1 --2- 172.21.15.77:0/715458698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9878102810 0x7f98781116a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f986c006b00 tx=0x7f986c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:56.079 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.343+0000 7f98757fa700 1 -- 172.21.15.77:0/715458698 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f986c010760 con 0x7f9878102810 2024-04-25T01:59:56.080 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.343+0000 7f987eafb700 1 -- 172.21.15.77:0/715458698 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9878111de0 con 0x7f9878102810 2024-04-25T01:59:56.080 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.343+0000 7f98757fa700 1 -- 172.21.15.77:0/715458698 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f986c010d50 con 0x7f9878102810 2024-04-25T01:59:56.080 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.343+0000 7f98757fa700 1 -- 172.21.15.77:0/715458698 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f986c01ad40 con 0x7f9878102810 2024-04-25T01:59:56.080 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.344+0000 7f987eafb700 1 -- 172.21.15.77:0/715458698 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9878112950 con 0x7f9878102810 2024-04-25T01:59:56.080 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.344+0000 7f98757fa700 1 -- 172.21.15.77:0/715458698 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f986c02e440 con 0x7f9878102810 2024-04-25T01:59:56.080 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.345+0000 7f98757fa700 1 --2- 172.21.15.77:0/715458698 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7f9868036850 0x7f9868038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:56.080 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.345+0000 7f98757fa700 1 -- 172.21.15.77:0/715458698 --> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9868039410 con 0x7f9868036850 2024-04-25T01:59:56.080 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.345+0000 7f98757fa700 1 -- 172.21.15.77:0/715458698 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f986c04a5b0 con 0x7f9878102810 2024-04-25T01:59:56.080 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.345+0000 7f9877fff700 1 -- 172.21.15.77:0/715458698 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7f9868036850 msgr2=0x7f9868038d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/839529497 2024-04-25T01:59:56.080 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.345+0000 7f9877fff700 1 --2- 172.21.15.77:0/715458698 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7f9868036850 0x7f9868038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T01:59:56.080 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.546+0000 7f9877fff700 1 -- 172.21.15.77:0/715458698 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7f9868036850 msgr2=0x7f9868038d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/839529497 2024-04-25T01:59:56.081 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.546+0000 7f9877fff700 1 --2- 172.21.15.77:0/715458698 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7f9868036850 0x7f9868038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T01:59:56.081 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.947+0000 7f9877fff700 1 -- 172.21.15.77:0/715458698 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7f9868036850 msgr2=0x7f9868038d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/839529497 2024-04-25T01:59:56.081 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:50.947+0000 7f9877fff700 1 --2- 172.21.15.77:0/715458698 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7f9868036850 0x7f9868038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T01:59:56.081 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:51.748+0000 7f9877fff700 1 -- 172.21.15.77:0/715458698 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7f9868036850 msgr2=0x7f9868038d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/839529497 2024-04-25T01:59:56.081 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:51.748+0000 7f9877fff700 1 --2- 172.21.15.77:0/715458698 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7f9868036850 0x7f9868038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T01:59:56.081 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:53.349+0000 7f9877fff700 1 -- 172.21.15.77:0/715458698 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7f9868036850 msgr2=0x7f9868038d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/839529497 2024-04-25T01:59:56.081 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:53.349+0000 7f9877fff700 1 --2- 172.21.15.77:0/715458698 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7f9868036850 0x7f9868038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-25T01:59:56.081 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:54.493+0000 7f98757fa700 1 -- 172.21.15.77:0/715458698 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mgrmap(e 6) v1 ==== 43143+0+0 (secure 0 0 0) 0x7f986c021d60 con 0x7f9878102810 2024-04-25T01:59:56.081 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:54.493+0000 7f98757fa700 1 -- 172.21.15.77:0/715458698 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7f9868036850 msgr2=0x7f9868038d00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T01:59:56.081 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:54.493+0000 7f98757fa700 1 --2- 172.21.15.77:0/715458698 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7f9868036850 0x7f9868038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:56.081 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:55.495+0000 7f98757fa700 1 -- 172.21.15.77:0/715458698 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 7) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f986c023c00 con 0x7f9878102810 2024-04-25T01:59:56.081 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:55.495+0000 7f98757fa700 1 --2- 172.21.15.77:0/715458698 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f9868039ff0 0x7f986803c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:56.081 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:55.495+0000 7f98757fa700 1 -- 172.21.15.77:0/715458698 --> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9868039410 con 0x7f9868039ff0 2024-04-25T01:59:56.081 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:55.495+0000 7f9877fff700 1 --2- 172.21.15.77:0/715458698 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f9868039ff0 0x7f986803c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:56.082 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:55.496+0000 7f9877fff700 1 --2- 172.21.15.77:0/715458698 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f9868039ff0 0x7f986803c3d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f98640039d0 tx=0x7f9864009350 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:56.082 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:55.497+0000 7f98757fa700 1 -- 172.21.15.77:0/715458698 <== mgr.14118 v2:172.21.15.77:6800/859750200 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f9868039410 con 0x7f9868039ff0 2024-04-25T01:59:56.082 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:55.503+0000 7f987eafb700 1 -- 172.21.15.77:0/715458698 --> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f9878112270 con 0x7f9868039ff0 2024-04-25T01:59:56.082 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:55.503+0000 7f98757fa700 1 -- 172.21.15.77:0/715458698 <== mgr.14118 v2:172.21.15.77:6800/859750200 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f9878112270 con 0x7f9868039ff0 2024-04-25T01:59:56.082 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:55.504+0000 7f987eafb700 1 -- 172.21.15.77:0/715458698 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f9868039ff0 msgr2=0x7f986803c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:56.082 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:55.504+0000 7f987eafb700 1 --2- 172.21.15.77:0/715458698 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f9868039ff0 0x7f986803c3d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f98640039d0 tx=0x7f9864009350 comp rx=0 tx=0).stop 2024-04-25T01:59:56.082 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:55.504+0000 7f987eafb700 1 -- 172.21.15.77:0/715458698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9878102810 msgr2=0x7f98781116a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:56.082 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:55.504+0000 7f987eafb700 1 --2- 172.21.15.77:0/715458698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9878102810 0x7f98781116a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f986c006b00 tx=0x7f986c009250 comp rx=0 tx=0).stop 2024-04-25T01:59:56.082 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:55.504+0000 7f987eafb700 1 -- 172.21.15.77:0/715458698 shutdown_connections 2024-04-25T01:59:56.082 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:55.504+0000 7f987eafb700 1 --2- 172.21.15.77:0/715458698 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f9868039ff0 0x7f986803c3d0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:56.083 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:55.504+0000 7f987eafb700 1 --2- 172.21.15.77:0/715458698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9878102810 0x7f98781116a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:56.083 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:55.504+0000 7f987eafb700 1 --2- 172.21.15.77:0/715458698 >> [v2:172.21.15.77:6800/839529497,v1:172.21.15.77:6801/839529497] conn(0x7f9868036850 0x7f9868038d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:56.083 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:55.504+0000 7f987eafb700 1 -- 172.21.15.77:0/715458698 >> 172.21.15.77:0/715458698 conn(0x7f98780fdfd0 msgr2=0x7f98780feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:56.083 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:55.504+0000 7f987eafb700 1 -- 172.21.15.77:0/715458698 shutdown_connections 2024-04-25T01:59:56.083 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:55.504+0000 7f987eafb700 1 -- 172.21.15.77:0/715458698 wait complete. 2024-04-25T01:59:56.083 INFO:teuthology.orchestra.run.smithi077.stdout:mgr epoch 5 is available 2024-04-25T01:59:56.083 INFO:teuthology.orchestra.run.smithi077.stdout:Setting orchestrator backend to cephadm... 2024-04-25T01:59:56.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:56 smithi077 ceph-mon[26330]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-25T01:59:56.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:56 smithi077 ceph-mon[26330]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-25T01:59:57.254 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.467+0000 7f76dc897700 1 Processor -- start 2024-04-25T01:59:57.254 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.467+0000 7f76dc897700 1 -- start start 2024-04-25T01:59:57.254 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.468+0000 7f76dc897700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d8101730 0x7f76d8101b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:57.254 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.468+0000 7f76dc897700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d8102080 con 0x7f76d8101730 2024-04-25T01:59:57.254 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.468+0000 7f76d659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d8101730 0x7f76d8101b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:57.254 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.468+0000 7f76d659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d8101730 0x7f76d8101b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49650/0 (socket says 172.21.15.77:49650) 2024-04-25T01:59:57.254 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.468+0000 7f76d659c700 1 -- 172.21.15.77:0/3566738845 learned_addr learned my addr 172.21.15.77:0/3566738845 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:59:57.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.468+0000 7f76d659c700 1 -- 172.21.15.77:0/3566738845 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d81021c0 con 0x7f76d8101730 2024-04-25T01:59:57.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.468+0000 7f76d659c700 1 --2- 172.21.15.77:0/3566738845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d8101730 0x7f76d8101b40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f76cc00bb80 tx=0x7f76cc00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=420d810e80f3040b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:57.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.468+0000 7f76d559a700 1 -- 172.21.15.77:0/3566738845 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f76cc00dd00 con 0x7f76d8101730 2024-04-25T01:59:57.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.469+0000 7f76d559a700 1 -- 172.21.15.77:0/3566738845 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f76cc00de60 con 0x7f76d8101730 2024-04-25T01:59:57.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.469+0000 7f76d559a700 1 -- 172.21.15.77:0/3566738845 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f76cc0188a0 con 0x7f76d8101730 2024-04-25T01:59:57.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.469+0000 7f76dc897700 1 -- 172.21.15.77:0/3566738845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d8101730 msgr2=0x7f76d8101b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:57.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.469+0000 7f76dc897700 1 --2- 172.21.15.77:0/3566738845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d8101730 0x7f76d8101b40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f76cc00bb80 tx=0x7f76cc00b4f0 comp rx=0 tx=0).stop 2024-04-25T01:59:57.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.469+0000 7f76dc897700 1 -- 172.21.15.77:0/3566738845 shutdown_connections 2024-04-25T01:59:57.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.469+0000 7f76dc897700 1 --2- 172.21.15.77:0/3566738845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d8101730 0x7f76d8101b40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:57.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.469+0000 7f76dc897700 1 -- 172.21.15.77:0/3566738845 >> 172.21.15.77:0/3566738845 conn(0x7f76d80fcef0 msgr2=0x7f76d80ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:57.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.469+0000 7f76dc897700 1 -- 172.21.15.77:0/3566738845 shutdown_connections 2024-04-25T01:59:57.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.469+0000 7f76dc897700 1 -- 172.21.15.77:0/3566738845 wait complete. 2024-04-25T01:59:57.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.470+0000 7f76dc897700 1 Processor -- start 2024-04-25T01:59:57.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.470+0000 7f76dc897700 1 -- start start 2024-04-25T01:59:57.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.470+0000 7f76dc897700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d8101730 0x7f76d810f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:57.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.470+0000 7f76dc897700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d810f8d0 con 0x7f76d8101730 2024-04-25T01:59:57.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.470+0000 7f76d659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d8101730 0x7f76d810f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:57.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.470+0000 7f76d659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d8101730 0x7f76d810f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49660/0 (socket says 172.21.15.77:49660) 2024-04-25T01:59:57.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.470+0000 7f76d659c700 1 -- 172.21.15.77:0/2398574106 learned_addr learned my addr 172.21.15.77:0/2398574106 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:59:57.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.470+0000 7f76d659c700 1 -- 172.21.15.77:0/2398574106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc00b790 con 0x7f76d8101730 2024-04-25T01:59:57.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.470+0000 7f76d659c700 1 --2- 172.21.15.77:0/2398574106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d8101730 0x7f76d810f390 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f76cc018600 tx=0x7f76cc00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:57.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.470+0000 7f76c6ffd700 1 -- 172.21.15.77:0/2398574106 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f76cc010bd0 con 0x7f76d8101730 2024-04-25T01:59:57.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.470+0000 7f76dc897700 1 -- 172.21.15.77:0/2398574106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d810fad0 con 0x7f76d8101730 2024-04-25T01:59:57.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.470+0000 7f76c6ffd700 1 -- 172.21.15.77:0/2398574106 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f76cc01d050 con 0x7f76d8101730 2024-04-25T01:59:57.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.471+0000 7f76c6ffd700 1 -- 172.21.15.77:0/2398574106 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f76cc022590 con 0x7f76d8101730 2024-04-25T01:59:57.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.471+0000 7f76dc897700 1 -- 172.21.15.77:0/2398574106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d8110640 con 0x7f76d8101730 2024-04-25T01:59:57.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.471+0000 7f76c6ffd700 1 -- 172.21.15.77:0/2398574106 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 7) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f76cc022790 con 0x7f76d8101730 2024-04-25T01:59:57.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.471+0000 7f76dc897700 1 -- 172.21.15.77:0/2398574106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d805f5c0 con 0x7f76d8101730 2024-04-25T01:59:57.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.472+0000 7f76c6ffd700 1 --2- 172.21.15.77:0/2398574106 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f76c0036720 0x7f76c0038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:57.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.472+0000 7f76c6ffd700 1 -- 172.21.15.77:0/2398574106 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f76cc014070 con 0x7f76d8101730 2024-04-25T01:59:57.257 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.472+0000 7f76d5d9b700 1 --2- 172.21.15.77:0/2398574106 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f76c0036720 0x7f76c0038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:57.257 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.472+0000 7f76d5d9b700 1 --2- 172.21.15.77:0/2398574106 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f76c0036720 0x7f76c0038bd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f76c8009990 tx=0x7f76c8006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:57.257 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.476+0000 7f76c6ffd700 1 -- 172.21.15.77:0/2398574106 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f76cc021d70 con 0x7f76d8101730 2024-04-25T01:59:57.257 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.546+0000 7f76c6ffd700 1 -- 172.21.15.77:0/2398574106 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f76cc02d930 con 0x7f76d8101730 2024-04-25T01:59:57.257 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.677+0000 7f76dc897700 1 -- 172.21.15.77:0/2398574106 --> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f76d8110a50 con 0x7f76c0036720 2024-04-25T01:59:57.257 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.686+0000 7f76c6ffd700 1 -- 172.21.15.77:0/2398574106 <== mgr.14118 v2:172.21.15.77:6800/859750200 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f76d8110a50 con 0x7f76c0036720 2024-04-25T01:59:57.257 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.688+0000 7f76dc897700 1 -- 172.21.15.77:0/2398574106 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f76c0036720 msgr2=0x7f76c0038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:57.257 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.688+0000 7f76dc897700 1 --2- 172.21.15.77:0/2398574106 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f76c0036720 0x7f76c0038bd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f76c8009990 tx=0x7f76c8006e40 comp rx=0 tx=0).stop 2024-04-25T01:59:57.257 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.688+0000 7f76dc897700 1 -- 172.21.15.77:0/2398574106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d8101730 msgr2=0x7f76d810f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:57.257 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.688+0000 7f76dc897700 1 --2- 172.21.15.77:0/2398574106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d8101730 0x7f76d810f390 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f76cc018600 tx=0x7f76cc00b4f0 comp rx=0 tx=0).stop 2024-04-25T01:59:57.257 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.688+0000 7f76dc897700 1 -- 172.21.15.77:0/2398574106 shutdown_connections 2024-04-25T01:59:57.257 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.689+0000 7f76dc897700 1 --2- 172.21.15.77:0/2398574106 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f76c0036720 0x7f76c0038bd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:57.257 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.689+0000 7f76dc897700 1 --2- 172.21.15.77:0/2398574106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d8101730 0x7f76d810f390 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:57.257 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.689+0000 7f76dc897700 1 -- 172.21.15.77:0/2398574106 >> 172.21.15.77:0/2398574106 conn(0x7f76d80fcef0 msgr2=0x7f76d8105bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:57.258 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.689+0000 7f76dc897700 1 -- 172.21.15.77:0/2398574106 shutdown_connections 2024-04-25T01:59:57.258 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:56.689+0000 7f76dc897700 1 -- 172.21.15.77:0/2398574106 wait complete. 2024-04-25T01:59:57.834 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:57 smithi077 ceph-mon[26330]: mgrmap e8: smithi077.zpflzp(active, since 2s) 2024-04-25T01:59:57.834 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:57 smithi077 ceph-mon[26330]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T01:59:57.834 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:57 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' 2024-04-25T01:59:57.834 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:57 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T01:59:58.402 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-25T01:59:58.403 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.633+0000 7fb26e832700 1 Processor -- start 2024-04-25T01:59:58.403 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.633+0000 7fb26e832700 1 -- start start 2024-04-25T01:59:58.403 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.633+0000 7fb26e832700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb268078ce0 0x7fb2680771f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:58.403 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.633+0000 7fb26e832700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2680790f0 con 0x7fb268078ce0 2024-04-25T01:59:58.403 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.633+0000 7fb267fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb268078ce0 0x7fb2680771f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:58.403 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.633+0000 7fb267fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb268078ce0 0x7fb2680771f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52308/0 (socket says 172.21.15.77:52308) 2024-04-25T01:59:58.403 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.633+0000 7fb267fff700 1 -- 172.21.15.77:0/3301736324 learned_addr learned my addr 172.21.15.77:0/3301736324 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:59:58.403 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.634+0000 7fb267fff700 1 -- 172.21.15.77:0/3301736324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb268077730 con 0x7fb268078ce0 2024-04-25T01:59:58.403 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.634+0000 7fb267fff700 1 --2- 172.21.15.77:0/3301736324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb268078ce0 0x7fb2680771f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb2580098e0 tx=0x7fb258009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23cd86d2056716ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:58.403 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.634+0000 7fb266ffd700 1 -- 172.21.15.77:0/3301736324 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb25800b860 con 0x7fb268078ce0 2024-04-25T01:59:58.403 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.634+0000 7fb266ffd700 1 -- 172.21.15.77:0/3301736324 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fb25800be50 con 0x7fb268078ce0 2024-04-25T01:59:58.403 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.634+0000 7fb266ffd700 1 -- 172.21.15.77:0/3301736324 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb258010380 con 0x7fb268078ce0 2024-04-25T01:59:58.404 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.634+0000 7fb26e832700 1 -- 172.21.15.77:0/3301736324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb268078ce0 msgr2=0x7fb2680771f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:58.404 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.634+0000 7fb26e832700 1 --2- 172.21.15.77:0/3301736324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb268078ce0 0x7fb2680771f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb2580098e0 tx=0x7fb258009250 comp rx=0 tx=0).stop 2024-04-25T01:59:58.404 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.634+0000 7fb26e832700 1 -- 172.21.15.77:0/3301736324 shutdown_connections 2024-04-25T01:59:58.404 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.634+0000 7fb26e832700 1 --2- 172.21.15.77:0/3301736324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb268078ce0 0x7fb2680771f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:58.404 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.634+0000 7fb26e832700 1 -- 172.21.15.77:0/3301736324 >> 172.21.15.77:0/3301736324 conn(0x7fb2680fdfd0 msgr2=0x7fb2681003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:58.404 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.634+0000 7fb26e832700 1 -- 172.21.15.77:0/3301736324 shutdown_connections 2024-04-25T01:59:58.404 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.635+0000 7fb26e832700 1 -- 172.21.15.77:0/3301736324 wait complete. 2024-04-25T01:59:58.404 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.635+0000 7fb26e832700 1 Processor -- start 2024-04-25T01:59:58.404 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.635+0000 7fb26e832700 1 -- start start 2024-04-25T01:59:58.404 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.635+0000 7fb26e832700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb268078ce0 0x7fb268113870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:58.404 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.635+0000 7fb26e832700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb268113db0 con 0x7fb268078ce0 2024-04-25T01:59:58.405 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.636+0000 7fb267fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb268078ce0 0x7fb268113870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:58.405 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.636+0000 7fb267fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb268078ce0 0x7fb268113870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52316/0 (socket says 172.21.15.77:52316) 2024-04-25T01:59:58.405 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.636+0000 7fb267fff700 1 -- 172.21.15.77:0/1357743647 learned_addr learned my addr 172.21.15.77:0/1357743647 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:59:58.405 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.636+0000 7fb267fff700 1 -- 172.21.15.77:0/1357743647 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2580094f0 con 0x7fb268078ce0 2024-04-25T01:59:58.405 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.636+0000 7fb267fff700 1 --2- 172.21.15.77:0/1357743647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb268078ce0 0x7fb268113870 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb258011bd0 tx=0x7fb258009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:58.405 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.636+0000 7fb264ff9700 1 -- 172.21.15.77:0/1357743647 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2580107c0 con 0x7fb268078ce0 2024-04-25T01:59:58.405 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.636+0000 7fb264ff9700 1 -- 172.21.15.77:0/1357743647 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fb258010db0 con 0x7fb268078ce0 2024-04-25T01:59:58.405 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.636+0000 7fb26e832700 1 -- 172.21.15.77:0/1357743647 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb268113fb0 con 0x7fb268078ce0 2024-04-25T01:59:58.405 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.636+0000 7fb264ff9700 1 -- 172.21.15.77:0/1357743647 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb25801ad60 con 0x7fb268078ce0 2024-04-25T01:59:58.405 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.636+0000 7fb26e832700 1 -- 172.21.15.77:0/1357743647 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb268114b20 con 0x7fb268078ce0 2024-04-25T01:59:58.405 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.637+0000 7fb264ff9700 1 -- 172.21.15.77:0/1357743647 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fb25802e440 con 0x7fb268078ce0 2024-04-25T01:59:58.405 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.637+0000 7fb264ff9700 1 --2- 172.21.15.77:0/1357743647 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fb250036850 0x7fb250038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:58.405 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.637+0000 7fb264ff9700 1 -- 172.21.15.77:0/1357743647 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fb25804ab80 con 0x7fb268078ce0 2024-04-25T01:59:58.405 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.637+0000 7fb26e832700 1 -- 172.21.15.77:0/1357743647 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb26805f5c0 con 0x7fb268078ce0 2024-04-25T01:59:58.406 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.637+0000 7fb2677fe700 1 --2- 172.21.15.77:0/1357743647 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fb250036850 0x7fb250038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:58.406 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.638+0000 7fb2677fe700 1 --2- 172.21.15.77:0/1357743647 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fb250036850 0x7fb250038d00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb25c009990 tx=0x7fb25c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:58.406 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.642+0000 7fb264ff9700 1 -- 172.21.15.77:0/1357743647 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb2580243f0 con 0x7fb268078ce0 2024-04-25T01:59:58.406 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.830+0000 7fb26e832700 1 -- 172.21.15.77:0/1357743647 --> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2680ff230 con 0x7fb250036850 2024-04-25T01:59:58.406 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.830+0000 7fb264ff9700 1 -- 172.21.15.77:0/1357743647 <== mgr.14118 v2:172.21.15.77:6800/859750200 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fb2680ff230 con 0x7fb250036850 2024-04-25T01:59:58.406 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.833+0000 7fb26e832700 1 -- 172.21.15.77:0/1357743647 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fb250036850 msgr2=0x7fb250038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:58.406 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.833+0000 7fb26e832700 1 --2- 172.21.15.77:0/1357743647 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fb250036850 0x7fb250038d00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb25c009990 tx=0x7fb25c006e40 comp rx=0 tx=0).stop 2024-04-25T01:59:58.406 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.833+0000 7fb26e832700 1 -- 172.21.15.77:0/1357743647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb268078ce0 msgr2=0x7fb268113870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:58.406 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.833+0000 7fb26e832700 1 --2- 172.21.15.77:0/1357743647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb268078ce0 0x7fb268113870 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb258011bd0 tx=0x7fb258009250 comp rx=0 tx=0).stop 2024-04-25T01:59:58.406 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.833+0000 7fb26e832700 1 -- 172.21.15.77:0/1357743647 shutdown_connections 2024-04-25T01:59:58.406 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.833+0000 7fb26e832700 1 --2- 172.21.15.77:0/1357743647 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fb250036850 0x7fb250038d00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:58.406 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.833+0000 7fb26e832700 1 --2- 172.21.15.77:0/1357743647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb268078ce0 0x7fb268113870 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:58.406 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.833+0000 7fb26e832700 1 -- 172.21.15.77:0/1357743647 >> 172.21.15.77:0/1357743647 conn(0x7fb2680fdfd0 msgr2=0x7fb2680feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:58.406 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.833+0000 7fb26e832700 1 -- 172.21.15.77:0/1357743647 shutdown_connections 2024-04-25T01:59:58.407 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:57.833+0000 7fb26e832700 1 -- 172.21.15.77:0/1357743647 wait complete. 2024-04-25T01:59:58.407 INFO:teuthology.orchestra.run.smithi077.stdout:Generating ssh key... 2024-04-25T01:59:58.646 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:58 smithi077 ceph-mon[26330]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T01:59:59.726 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:59 smithi077 ceph-mon[26330]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T01:59:59.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:59 smithi077 ceph-mon[26330]: Generating ssh key... 2024-04-25T01:59:59.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:59 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' 2024-04-25T01:59:59.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 01:59:59 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' 2024-04-25T01:59:59.737 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.826+0000 7f935835e700 1 Processor -- start 2024-04-25T01:59:59.742 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.826+0000 7f935835e700 1 -- start start 2024-04-25T01:59:59.742 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.826+0000 7f935835e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9350102880 0x7f9350102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:59.742 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.826+0000 7f935835e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93501031d0 con 0x7f9350102880 2024-04-25T01:59:59.742 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.826+0000 7f93560fa700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9350102880 0x7f9350102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:59.743 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.826+0000 7f93560fa700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9350102880 0x7f9350102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52332/0 (socket says 172.21.15.77:52332) 2024-04-25T01:59:59.743 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.826+0000 7f93560fa700 1 -- 172.21.15.77:0/4099834877 learned_addr learned my addr 172.21.15.77:0/4099834877 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:59:59.743 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.826+0000 7f93560fa700 1 -- 172.21.15.77:0/4099834877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9350103310 con 0x7f9350102880 2024-04-25T01:59:59.743 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.826+0000 7f93560fa700 1 --2- 172.21.15.77:0/4099834877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9350102880 0x7f9350102c90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f934c0098e0 tx=0x7f934c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83dcb30e8d6e807e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:59.743 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.827+0000 7f93550f8700 1 -- 172.21.15.77:0/4099834877 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f934c00b860 con 0x7f9350102880 2024-04-25T01:59:59.743 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.827+0000 7f93550f8700 1 -- 172.21.15.77:0/4099834877 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f934c00be50 con 0x7f9350102880 2024-04-25T01:59:59.743 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.827+0000 7f93550f8700 1 -- 172.21.15.77:0/4099834877 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f934c010380 con 0x7f9350102880 2024-04-25T01:59:59.743 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.827+0000 7f935835e700 1 -- 172.21.15.77:0/4099834877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9350102880 msgr2=0x7f9350102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:59.743 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.827+0000 7f935835e700 1 --2- 172.21.15.77:0/4099834877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9350102880 0x7f9350102c90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f934c0098e0 tx=0x7f934c009250 comp rx=0 tx=0).stop 2024-04-25T01:59:59.743 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.827+0000 7f935835e700 1 -- 172.21.15.77:0/4099834877 shutdown_connections 2024-04-25T01:59:59.743 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.827+0000 7f935835e700 1 --2- 172.21.15.77:0/4099834877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9350102880 0x7f9350102c90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:59.743 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.827+0000 7f935835e700 1 -- 172.21.15.77:0/4099834877 >> 172.21.15.77:0/4099834877 conn(0x7f93500fe060 msgr2=0x7f9350100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:59.743 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.827+0000 7f935835e700 1 -- 172.21.15.77:0/4099834877 shutdown_connections 2024-04-25T01:59:59.743 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.827+0000 7f935835e700 1 -- 172.21.15.77:0/4099834877 wait complete. 2024-04-25T01:59:59.744 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.828+0000 7f935835e700 1 Processor -- start 2024-04-25T01:59:59.744 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.828+0000 7f935835e700 1 -- start start 2024-04-25T01:59:59.744 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.828+0000 7f935835e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9350102880 0x7f93501115f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:59.744 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.828+0000 7f935835e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9350111b30 con 0x7f9350102880 2024-04-25T01:59:59.744 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.828+0000 7f93560fa700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9350102880 0x7f93501115f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:59.744 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.828+0000 7f93560fa700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9350102880 0x7f93501115f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52338/0 (socket says 172.21.15.77:52338) 2024-04-25T01:59:59.744 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.828+0000 7f93560fa700 1 -- 172.21.15.77:0/6899225 learned_addr learned my addr 172.21.15.77:0/6899225 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:59:59.744 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.828+0000 7f93560fa700 1 -- 172.21.15.77:0/6899225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c0094f0 con 0x7f9350102880 2024-04-25T01:59:59.744 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.828+0000 7f93560fa700 1 --2- 172.21.15.77:0/6899225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9350102880 0x7f93501115f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f934c00b440 tx=0x7f934c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:59.744 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.829+0000 7f9346ffd700 1 -- 172.21.15.77:0/6899225 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f934c010760 con 0x7f9350102880 2024-04-25T01:59:59.744 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.829+0000 7f9346ffd700 1 -- 172.21.15.77:0/6899225 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f934c010d50 con 0x7f9350102880 2024-04-25T01:59:59.744 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.829+0000 7f935835e700 1 -- 172.21.15.77:0/6899225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9350111d30 con 0x7f9350102880 2024-04-25T01:59:59.744 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.829+0000 7f9346ffd700 1 -- 172.21.15.77:0/6899225 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f934c01ae20 con 0x7f9350102880 2024-04-25T01:59:59.744 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.829+0000 7f935835e700 1 -- 172.21.15.77:0/6899225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93501128a0 con 0x7f9350102880 2024-04-25T01:59:59.745 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.829+0000 7f9346ffd700 1 -- 172.21.15.77:0/6899225 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f934c02e440 con 0x7f9350102880 2024-04-25T01:59:59.745 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.830+0000 7f9346ffd700 1 --2- 172.21.15.77:0/6899225 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f933c0368a0 0x7f933c038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:59.745 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.829+0000 7f935835e700 1 -- 172.21.15.77:0/6899225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f935005f5c0 con 0x7f9350102880 2024-04-25T01:59:59.745 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.830+0000 7f9346ffd700 1 -- 172.21.15.77:0/6899225 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f934c04a6c0 con 0x7f9350102880 2024-04-25T01:59:59.745 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.830+0000 7f93558f9700 1 --2- 172.21.15.77:0/6899225 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f933c0368a0 0x7f933c038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:59.745 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.830+0000 7f93558f9700 1 --2- 172.21.15.77:0/6899225 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f933c0368a0 0x7f933c038d50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9340009990 tx=0x7f9340006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:59.745 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:58.834+0000 7f9346ffd700 1 -- 172.21.15.77:0/6899225 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f934c018350 con 0x7f9350102880 2024-04-25T01:59:59.745 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:59.023+0000 7f935835e700 1 -- 172.21.15.77:0/6899225 --> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f93500ff200 con 0x7f933c0368a0 2024-04-25T01:59:59.745 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:59.152+0000 7f9346ffd700 1 -- 172.21.15.77:0/6899225 <== mgr.14118 v2:172.21.15.77:6800/859750200 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f93500ff200 con 0x7f933c0368a0 2024-04-25T01:59:59.745 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:59.154+0000 7f935835e700 1 -- 172.21.15.77:0/6899225 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f933c0368a0 msgr2=0x7f933c038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:59.745 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:59.154+0000 7f935835e700 1 --2- 172.21.15.77:0/6899225 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f933c0368a0 0x7f933c038d50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9340009990 tx=0x7f9340006e40 comp rx=0 tx=0).stop 2024-04-25T01:59:59.745 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:59.154+0000 7f935835e700 1 -- 172.21.15.77:0/6899225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9350102880 msgr2=0x7f93501115f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:59.745 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:59.154+0000 7f935835e700 1 --2- 172.21.15.77:0/6899225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9350102880 0x7f93501115f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f934c00b440 tx=0x7f934c009250 comp rx=0 tx=0).stop 2024-04-25T01:59:59.745 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:59.154+0000 7f935835e700 1 -- 172.21.15.77:0/6899225 shutdown_connections 2024-04-25T01:59:59.745 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:59.154+0000 7f935835e700 1 --2- 172.21.15.77:0/6899225 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f933c0368a0 0x7f933c038d50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:59.746 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:59.154+0000 7f935835e700 1 --2- 172.21.15.77:0/6899225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9350102880 0x7f93501115f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:59.746 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:59.154+0000 7f935835e700 1 -- 172.21.15.77:0/6899225 >> 172.21.15.77:0/6899225 conn(0x7f93500fe060 msgr2=0x7f93500feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:59.746 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:59.155+0000 7f935835e700 1 -- 172.21.15.77:0/6899225 shutdown_connections 2024-04-25T01:59:59.746 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:59.155+0000 7f935835e700 1 -- 172.21.15.77:0/6899225 wait complete. 2024-04-25T02:00:01.067 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxdH7nyo6VX9eDOT3wQZqrCa1FUHos0uAXwuaAbNFIO4cO5TJO8s7fqmDbcFY5vJvf8/tv5abdeo0FerLuUd0s44JXrF+FzQl6VVsZsWnCIm/ggo4vwQzRosV+dnE9Z+JeXtVODFse/taC4hP0dOTdpB9MxW9zsLwUtAXascXXhmC/2jTwuA/pwglkAHZLNYHSnD6euQdlzaSjDO3QA3XILtKn4ok5JUrQOC1wwBe675O2J2Losdz0c1bim8gS1ADIVc58qN7kWJfinGY2ySus0L3geldxXzrFiaUdC5nIpLDNElAPMVnIS1iOXQ/JmZILOxSLYgZxG7EebwM927TizrasfXE9BtgFDOoDO90izdGGblRmqX7k8xna9OO+sZudhvGsb7TazVSfQ8vOy2T1V38hNSJWFp6oAzuHHTs7zuAxdVbsoWD0HpM/yhI6bHNDEw38fK0uFGjFkJm+CDDsXRN7otoEr9WN/XHnJVRz0bhCfqq6sIYD37l6jlYcbsU= ceph-4bb93d82-02a7-11ef-bc93-c7b262605968 2024-04-25T02:00:01.067 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.141+0000 7f3b9c777700 1 Processor -- start 2024-04-25T02:00:01.067 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.141+0000 7f3b9c777700 1 -- start start 2024-04-25T02:00:01.067 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.141+0000 7f3b9c777700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b94102880 0x7f3b94102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:01.067 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.141+0000 7f3b9c777700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b941031d0 con 0x7f3b94102880 2024-04-25T02:00:01.067 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.141+0000 7f3b9a513700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b94102880 0x7f3b94102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:01.067 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.141+0000 7f3b9a513700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b94102880 0x7f3b94102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52354/0 (socket says 172.21.15.77:52354) 2024-04-25T02:00:01.067 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.141+0000 7f3b9a513700 1 -- 172.21.15.77:0/3811397263 learned_addr learned my addr 172.21.15.77:0/3811397263 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:01.067 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.141+0000 7f3b9a513700 1 -- 172.21.15.77:0/3811397263 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b94103310 con 0x7f3b94102880 2024-04-25T02:00:01.068 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.142+0000 7f3b9a513700 1 --2- 172.21.15.77:0/3811397263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b94102880 0x7f3b94102c90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3b900098e0 tx=0x7f3b90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a26cf356b47d0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:01.068 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.142+0000 7f3b99511700 1 -- 172.21.15.77:0/3811397263 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3b9000b860 con 0x7f3b94102880 2024-04-25T02:00:01.068 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.142+0000 7f3b99511700 1 -- 172.21.15.77:0/3811397263 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f3b9000be50 con 0x7f3b94102880 2024-04-25T02:00:01.068 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.142+0000 7f3b99511700 1 -- 172.21.15.77:0/3811397263 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3b90010380 con 0x7f3b94102880 2024-04-25T02:00:01.068 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.142+0000 7f3b9c777700 1 -- 172.21.15.77:0/3811397263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b94102880 msgr2=0x7f3b94102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:01.068 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.142+0000 7f3b9c777700 1 --2- 172.21.15.77:0/3811397263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b94102880 0x7f3b94102c90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3b900098e0 tx=0x7f3b90009250 comp rx=0 tx=0).stop 2024-04-25T02:00:01.068 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.142+0000 7f3b9c777700 1 -- 172.21.15.77:0/3811397263 shutdown_connections 2024-04-25T02:00:01.068 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.142+0000 7f3b9c777700 1 --2- 172.21.15.77:0/3811397263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b94102880 0x7f3b94102c90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:01.068 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.142+0000 7f3b9c777700 1 -- 172.21.15.77:0/3811397263 >> 172.21.15.77:0/3811397263 conn(0x7f3b940fe060 msgr2=0x7f3b94100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:01.068 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.143+0000 7f3b9c777700 1 -- 172.21.15.77:0/3811397263 shutdown_connections 2024-04-25T02:00:01.068 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.143+0000 7f3b9c777700 1 -- 172.21.15.77:0/3811397263 wait complete. 2024-04-25T02:00:01.068 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.143+0000 7f3b9c777700 1 Processor -- start 2024-04-25T02:00:01.068 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.143+0000 7f3b9c777700 1 -- start start 2024-04-25T02:00:01.068 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.143+0000 7f3b9c777700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b94102880 0x7f3b941115f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:01.069 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.143+0000 7f3b9c777700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b94111b30 con 0x7f3b94102880 2024-04-25T02:00:01.069 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.143+0000 7f3b9a513700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b94102880 0x7f3b941115f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:01.069 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.143+0000 7f3b9a513700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b94102880 0x7f3b941115f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52364/0 (socket says 172.21.15.77:52364) 2024-04-25T02:00:01.069 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.143+0000 7f3b9a513700 1 -- 172.21.15.77:0/4218811461 learned_addr learned my addr 172.21.15.77:0/4218811461 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:01.069 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.144+0000 7f3b9a513700 1 -- 172.21.15.77:0/4218811461 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b900094f0 con 0x7f3b94102880 2024-04-25T02:00:01.069 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.144+0000 7f3b9a513700 1 --2- 172.21.15.77:0/4218811461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b94102880 0x7f3b941115f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3b90000c00 tx=0x7f3b90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:01.069 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.144+0000 7f3b8affd700 1 -- 172.21.15.77:0/4218811461 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3b900107c0 con 0x7f3b94102880 2024-04-25T02:00:01.069 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.144+0000 7f3b8affd700 1 -- 172.21.15.77:0/4218811461 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f3b90010db0 con 0x7f3b94102880 2024-04-25T02:00:01.069 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.144+0000 7f3b9c777700 1 -- 172.21.15.77:0/4218811461 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b94111d30 con 0x7f3b94102880 2024-04-25T02:00:01.069 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.144+0000 7f3b8affd700 1 -- 172.21.15.77:0/4218811461 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3b9001ad00 con 0x7f3b94102880 2024-04-25T02:00:01.069 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.144+0000 7f3b9c777700 1 -- 172.21.15.77:0/4218811461 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b941128a0 con 0x7f3b94102880 2024-04-25T02:00:01.069 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.145+0000 7f3b8affd700 1 -- 172.21.15.77:0/4218811461 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f3b90010920 con 0x7f3b94102880 2024-04-25T02:00:01.069 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.145+0000 7f3b9c777700 1 -- 172.21.15.77:0/4218811461 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b9405f5c0 con 0x7f3b94102880 2024-04-25T02:00:01.069 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.145+0000 7f3b8affd700 1 --2- 172.21.15.77:0/4218811461 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f3b80036850 0x7f3b80038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:01.070 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.145+0000 7f3b8affd700 1 -- 172.21.15.77:0/4218811461 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f3b9004a600 con 0x7f3b94102880 2024-04-25T02:00:01.070 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.145+0000 7f3b99d12700 1 --2- 172.21.15.77:0/4218811461 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f3b80036850 0x7f3b80038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:01.070 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.145+0000 7f3b99d12700 1 --2- 172.21.15.77:0/4218811461 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f3b80036850 0x7f3b80038d00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3b84009990 tx=0x7f3b84006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:01.070 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.149+0000 7f3b8affd700 1 -- 172.21.15.77:0/4218811461 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3b9001a530 con 0x7f3b94102880 2024-04-25T02:00:01.070 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.336+0000 7f3b9c777700 1 -- 172.21.15.77:0/4218811461 --> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b940ff200 con 0x7f3b80036850 2024-04-25T02:00:01.070 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.337+0000 7f3b8affd700 1 -- 172.21.15.77:0/4218811461 <== mgr.14118 v2:172.21.15.77:6800/859750200 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f3b940ff200 con 0x7f3b80036850 2024-04-25T02:00:01.070 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.339+0000 7f3b9c777700 1 -- 172.21.15.77:0/4218811461 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f3b80036850 msgr2=0x7f3b80038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:01.070 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.339+0000 7f3b9c777700 1 --2- 172.21.15.77:0/4218811461 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f3b80036850 0x7f3b80038d00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3b84009990 tx=0x7f3b84006e40 comp rx=0 tx=0).stop 2024-04-25T02:00:01.070 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.339+0000 7f3b9c777700 1 -- 172.21.15.77:0/4218811461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b94102880 msgr2=0x7f3b941115f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:01.070 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.339+0000 7f3b9c777700 1 --2- 172.21.15.77:0/4218811461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b94102880 0x7f3b941115f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3b90000c00 tx=0x7f3b90009250 comp rx=0 tx=0).stop 2024-04-25T02:00:01.070 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.339+0000 7f3b9c777700 1 -- 172.21.15.77:0/4218811461 shutdown_connections 2024-04-25T02:00:01.070 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.339+0000 7f3b9c777700 1 --2- 172.21.15.77:0/4218811461 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f3b80036850 0x7f3b80038d00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:01.070 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.339+0000 7f3b9c777700 1 --2- 172.21.15.77:0/4218811461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b94102880 0x7f3b941115f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:01.070 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.339+0000 7f3b9c777700 1 -- 172.21.15.77:0/4218811461 >> 172.21.15.77:0/4218811461 conn(0x7f3b940fe060 msgr2=0x7f3b940feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:01.071 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.339+0000 7f3b9c777700 1 -- 172.21.15.77:0/4218811461 shutdown_connections 2024-04-25T02:00:01.071 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:00.339+0000 7f3b9c777700 1 -- 172.21.15.77:0/4218811461 wait complete. 2024-04-25T02:00:01.071 INFO:teuthology.orchestra.run.smithi077.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-25T02:00:01.071 INFO:teuthology.orchestra.run.smithi077.stdout:Adding key to root@localhost authorized_keys... 2024-04-25T02:00:01.071 INFO:teuthology.orchestra.run.smithi077.stdout:Adding host smithi077... 2024-04-25T02:00:01.427 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:01 smithi077 ceph-mon[26330]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:00:02.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:02 smithi077 ceph-mon[26330]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi077", "addr": "172.21.15.77", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:00:03.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:03 smithi077 ceph-mon[26330]: Deploying cephadm binary to smithi077 2024-04-25T02:00:03.998 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout Added host 'smithi077' with addr '172.21.15.77' 2024-04-25T02:00:03.998 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.453+0000 7f84a9a58700 1 Processor -- start 2024-04-25T02:00:03.998 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.453+0000 7f84a9a58700 1 -- start start 2024-04-25T02:00:03.998 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.453+0000 7f84a9a58700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84a4102880 0x7f84a4102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:03.998 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.453+0000 7f84a9a58700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a41031d0 con 0x7f84a4102880 2024-04-25T02:00:03.998 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.453+0000 7f84a2ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84a4102880 0x7f84a4102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:03.998 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.453+0000 7f84a2ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84a4102880 0x7f84a4102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52376/0 (socket says 172.21.15.77:52376) 2024-04-25T02:00:03.999 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.453+0000 7f84a2ffd700 1 -- 172.21.15.77:0/2230111930 learned_addr learned my addr 172.21.15.77:0/2230111930 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:03.999 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.453+0000 7f84a2ffd700 1 -- 172.21.15.77:0/2230111930 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a4103310 con 0x7f84a4102880 2024-04-25T02:00:03.999 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.453+0000 7f84a2ffd700 1 --2- 172.21.15.77:0/2230111930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84a4102880 0x7f84a4102c90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f84940098e0 tx=0x7f8494009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b9c2b30a548cca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:03.999 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.454+0000 7f84a1ffb700 1 -- 172.21.15.77:0/2230111930 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f849400b860 con 0x7f84a4102880 2024-04-25T02:00:03.999 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.454+0000 7f84a1ffb700 1 -- 172.21.15.77:0/2230111930 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f849400be50 con 0x7f84a4102880 2024-04-25T02:00:03.999 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.454+0000 7f84a1ffb700 1 -- 172.21.15.77:0/2230111930 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8494010380 con 0x7f84a4102880 2024-04-25T02:00:03.999 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.454+0000 7f84a9a58700 1 -- 172.21.15.77:0/2230111930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84a4102880 msgr2=0x7f84a4102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:03.999 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.454+0000 7f84a9a58700 1 --2- 172.21.15.77:0/2230111930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84a4102880 0x7f84a4102c90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f84940098e0 tx=0x7f8494009250 comp rx=0 tx=0).stop 2024-04-25T02:00:03.999 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.454+0000 7f84a9a58700 1 -- 172.21.15.77:0/2230111930 shutdown_connections 2024-04-25T02:00:03.999 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.454+0000 7f84a9a58700 1 --2- 172.21.15.77:0/2230111930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84a4102880 0x7f84a4102c90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:03.999 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.454+0000 7f84a9a58700 1 -- 172.21.15.77:0/2230111930 >> 172.21.15.77:0/2230111930 conn(0x7f84a40fe060 msgr2=0x7f84a4100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:03.999 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.454+0000 7f84a9a58700 1 -- 172.21.15.77:0/2230111930 shutdown_connections 2024-04-25T02:00:03.999 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.454+0000 7f84a9a58700 1 -- 172.21.15.77:0/2230111930 wait complete. 2024-04-25T02:00:03.999 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.455+0000 7f84a9a58700 1 Processor -- start 2024-04-25T02:00:04.000 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.455+0000 7f84a9a58700 1 -- start start 2024-04-25T02:00:04.000 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.455+0000 7f84a9a58700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84a4102880 0x7f84a41115f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:04.000 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.455+0000 7f84a9a58700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a4111b30 con 0x7f84a4102880 2024-04-25T02:00:04.000 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.455+0000 7f84a2ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84a4102880 0x7f84a41115f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:04.000 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.455+0000 7f84a2ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84a4102880 0x7f84a41115f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52382/0 (socket says 172.21.15.77:52382) 2024-04-25T02:00:04.000 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.455+0000 7f84a2ffd700 1 -- 172.21.15.77:0/186785648 learned_addr learned my addr 172.21.15.77:0/186785648 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:04.000 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.456+0000 7f84a2ffd700 1 -- 172.21.15.77:0/186785648 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84940094f0 con 0x7f84a4102880 2024-04-25T02:00:04.000 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.456+0000 7f84a2ffd700 1 --2- 172.21.15.77:0/186785648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84a4102880 0x7f84a41115f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f849400b440 tx=0x7f8494009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:04.000 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.456+0000 7f848b7fe700 1 -- 172.21.15.77:0/186785648 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8494010760 con 0x7f84a4102880 2024-04-25T02:00:04.000 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.456+0000 7f848b7fe700 1 -- 172.21.15.77:0/186785648 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f8494010d50 con 0x7f84a4102880 2024-04-25T02:00:04.000 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.456+0000 7f848b7fe700 1 -- 172.21.15.77:0/186785648 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f849401ae20 con 0x7f84a4102880 2024-04-25T02:00:04.000 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.456+0000 7f84a9a58700 1 -- 172.21.15.77:0/186785648 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a4111d30 con 0x7f84a4102880 2024-04-25T02:00:04.000 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.456+0000 7f84a9a58700 1 -- 172.21.15.77:0/186785648 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a41128a0 con 0x7f84a4102880 2024-04-25T02:00:04.001 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.457+0000 7f848b7fe700 1 -- 172.21.15.77:0/186785648 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f849402e440 con 0x7f84a4102880 2024-04-25T02:00:04.001 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.457+0000 7f848b7fe700 1 --2- 172.21.15.77:0/186785648 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f848c036830 0x7f848c038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:04.001 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.457+0000 7f848b7fe700 1 -- 172.21.15.77:0/186785648 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f849404a7c0 con 0x7f84a4102880 2024-04-25T02:00:04.001 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.457+0000 7f84a9a58700 1 -- 172.21.15.77:0/186785648 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a405f5c0 con 0x7f84a4102880 2024-04-25T02:00:04.001 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.457+0000 7f84a27fc700 1 --2- 172.21.15.77:0/186785648 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f848c036830 0x7f848c038ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:04.001 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.457+0000 7f84a27fc700 1 --2- 172.21.15.77:0/186785648 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f848c036830 0x7f848c038ce0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8498009990 tx=0x7f8498006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:04.001 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.462+0000 7f848b7fe700 1 -- 172.21.15.77:0/186785648 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8494018940 con 0x7f84a4102880 2024-04-25T02:00:04.001 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:01.651+0000 7f84a9a58700 1 -- 172.21.15.77:0/186785648 --> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi077", "addr": "172.21.15.77", "target": ["mon-mgr", ""]}) v1 -- 0x7f84a40ff200 con 0x7f848c036830 2024-04-25T02:00:04.001 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:03.441+0000 7f848b7fe700 1 -- 172.21.15.77:0/186785648 <== mgr.14118 v2:172.21.15.77:6800/859750200 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f84a40ff200 con 0x7f848c036830 2024-04-25T02:00:04.001 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:03.443+0000 7f84a9a58700 1 -- 172.21.15.77:0/186785648 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f848c036830 msgr2=0x7f848c038ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:04.001 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:03.443+0000 7f84a9a58700 1 --2- 172.21.15.77:0/186785648 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f848c036830 0x7f848c038ce0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8498009990 tx=0x7f8498006e40 comp rx=0 tx=0).stop 2024-04-25T02:00:04.001 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:03.444+0000 7f84a9a58700 1 -- 172.21.15.77:0/186785648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84a4102880 msgr2=0x7f84a41115f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:04.001 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:03.444+0000 7f84a9a58700 1 --2- 172.21.15.77:0/186785648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84a4102880 0x7f84a41115f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f849400b440 tx=0x7f8494009250 comp rx=0 tx=0).stop 2024-04-25T02:00:04.001 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:03.444+0000 7f84a9a58700 1 -- 172.21.15.77:0/186785648 shutdown_connections 2024-04-25T02:00:04.002 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:03.444+0000 7f84a9a58700 1 --2- 172.21.15.77:0/186785648 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f848c036830 0x7f848c038ce0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:04.002 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:03.444+0000 7f84a9a58700 1 --2- 172.21.15.77:0/186785648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84a4102880 0x7f84a41115f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:04.002 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:03.444+0000 7f84a9a58700 1 -- 172.21.15.77:0/186785648 >> 172.21.15.77:0/186785648 conn(0x7f84a40fe060 msgr2=0x7f84a40feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:04.002 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:03.444+0000 7f84a9a58700 1 -- 172.21.15.77:0/186785648 shutdown_connections 2024-04-25T02:00:04.002 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:03.444+0000 7f84a9a58700 1 -- 172.21.15.77:0/186785648 wait complete. 2024-04-25T02:00:04.002 INFO:teuthology.orchestra.run.smithi077.stdout:Deploying mon service with default placement... 2024-04-25T02:00:04.726 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:04 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:04.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:04 smithi077 ceph-mon[26330]: Added host smithi077 2024-04-25T02:00:04.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:04 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:00:05.233 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-25T02:00:05.233 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.386+0000 7f6a50971700 1 Processor -- start 2024-04-25T02:00:05.234 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.386+0000 7f6a50971700 1 -- start start 2024-04-25T02:00:05.234 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.386+0000 7f6a50971700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a4c076c50 0x7f6a4c105420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:05.234 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.386+0000 7f6a50971700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c105960 con 0x7f6a4c076c50 2024-04-25T02:00:05.234 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.386+0000 7f6a4a59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a4c076c50 0x7f6a4c105420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:05.234 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.386+0000 7f6a4a59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a4c076c50 0x7f6a4c105420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52384/0 (socket says 172.21.15.77:52384) 2024-04-25T02:00:05.234 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.386+0000 7f6a4a59c700 1 -- 172.21.15.77:0/402193685 learned_addr learned my addr 172.21.15.77:0/402193685 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:05.234 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.387+0000 7f6a4a59c700 1 -- 172.21.15.77:0/402193685 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c105aa0 con 0x7f6a4c076c50 2024-04-25T02:00:05.234 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.387+0000 7f6a4a59c700 1 --2- 172.21.15.77:0/402193685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a4c076c50 0x7f6a4c105420 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c0098e0 tx=0x7f6a3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d2f7fb0de143468 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:05.234 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.387+0000 7f6a4959a700 1 -- 172.21.15.77:0/402193685 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a3c00b860 con 0x7f6a4c076c50 2024-04-25T02:00:05.234 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.387+0000 7f6a4959a700 1 -- 172.21.15.77:0/402193685 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f6a3c00be50 con 0x7f6a4c076c50 2024-04-25T02:00:05.234 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.387+0000 7f6a4959a700 1 -- 172.21.15.77:0/402193685 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a3c010380 con 0x7f6a4c076c50 2024-04-25T02:00:05.235 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.388+0000 7f6a50971700 1 -- 172.21.15.77:0/402193685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a4c076c50 msgr2=0x7f6a4c105420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:05.235 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.388+0000 7f6a50971700 1 --2- 172.21.15.77:0/402193685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a4c076c50 0x7f6a4c105420 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c0098e0 tx=0x7f6a3c009250 comp rx=0 tx=0).stop 2024-04-25T02:00:05.235 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.388+0000 7f6a50971700 1 -- 172.21.15.77:0/402193685 shutdown_connections 2024-04-25T02:00:05.235 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.388+0000 7f6a50971700 1 --2- 172.21.15.77:0/402193685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a4c076c50 0x7f6a4c105420 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:05.235 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.388+0000 7f6a50971700 1 -- 172.21.15.77:0/402193685 >> 172.21.15.77:0/402193685 conn(0x7f6a4c0fcef0 msgr2=0x7f6a4c0ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:05.235 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.388+0000 7f6a50971700 1 -- 172.21.15.77:0/402193685 shutdown_connections 2024-04-25T02:00:05.235 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.388+0000 7f6a50971700 1 -- 172.21.15.77:0/402193685 wait complete. 2024-04-25T02:00:05.235 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.388+0000 7f6a50971700 1 Processor -- start 2024-04-25T02:00:05.235 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.388+0000 7f6a50971700 1 -- start start 2024-04-25T02:00:05.235 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.388+0000 7f6a50971700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a4c076c50 0x7f6a4c111600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:05.235 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.388+0000 7f6a50971700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c111b40 con 0x7f6a4c076c50 2024-04-25T02:00:05.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.389+0000 7f6a4a59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a4c076c50 0x7f6a4c111600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:05.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.389+0000 7f6a4a59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a4c076c50 0x7f6a4c111600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52396/0 (socket says 172.21.15.77:52396) 2024-04-25T02:00:05.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.389+0000 7f6a4a59c700 1 -- 172.21.15.77:0/394336799 learned_addr learned my addr 172.21.15.77:0/394336799 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:05.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.389+0000 7f6a4a59c700 1 -- 172.21.15.77:0/394336799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c0094f0 con 0x7f6a4c076c50 2024-04-25T02:00:05.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.389+0000 7f6a4a59c700 1 --2- 172.21.15.77:0/394336799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a4c076c50 0x7f6a4c111600 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c006b00 tx=0x7f6a3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:05.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.389+0000 7f6a3affd700 1 -- 172.21.15.77:0/394336799 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a3c0107c0 con 0x7f6a4c076c50 2024-04-25T02:00:05.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.389+0000 7f6a50971700 1 -- 172.21.15.77:0/394336799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a4c111d40 con 0x7f6a4c076c50 2024-04-25T02:00:05.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.389+0000 7f6a3affd700 1 -- 172.21.15.77:0/394336799 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f6a3c010db0 con 0x7f6a4c076c50 2024-04-25T02:00:05.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.389+0000 7f6a3affd700 1 -- 172.21.15.77:0/394336799 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a3c01acf0 con 0x7f6a4c076c50 2024-04-25T02:00:05.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.389+0000 7f6a50971700 1 -- 172.21.15.77:0/394336799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a4c1128b0 con 0x7f6a4c076c50 2024-04-25T02:00:05.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.390+0000 7f6a3affd700 1 -- 172.21.15.77:0/394336799 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f6a3c010920 con 0x7f6a4c076c50 2024-04-25T02:00:05.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.390+0000 7f6a3affd700 1 --2- 172.21.15.77:0/394336799 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f6a34036850 0x7f6a34038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:05.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.390+0000 7f6a50971700 1 -- 172.21.15.77:0/394336799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a4c05f5c0 con 0x7f6a4c076c50 2024-04-25T02:00:05.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.390+0000 7f6a3affd700 1 -- 172.21.15.77:0/394336799 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f6a3c04a6e0 con 0x7f6a4c076c50 2024-04-25T02:00:05.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.390+0000 7f6a49d9b700 1 --2- 172.21.15.77:0/394336799 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f6a34036850 0x7f6a34038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:05.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.390+0000 7f6a49d9b700 1 --2- 172.21.15.77:0/394336799 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f6a34036850 0x7f6a34038d00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009990 tx=0x7f6a40006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:05.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.395+0000 7f6a3affd700 1 -- 172.21.15.77:0/394336799 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6a3c01a530 con 0x7f6a4c076c50 2024-04-25T02:00:05.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.601+0000 7f6a50971700 1 -- 172.21.15.77:0/394336799 --> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a4c0fe100 con 0x7f6a34036850 2024-04-25T02:00:05.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.608+0000 7f6a3affd700 1 -- 172.21.15.77:0/394336799 <== mgr.14118 v2:172.21.15.77:6800/859750200 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f6a4c0fe100 con 0x7f6a34036850 2024-04-25T02:00:05.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.610+0000 7f6a50971700 1 -- 172.21.15.77:0/394336799 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f6a34036850 msgr2=0x7f6a34038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:05.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.610+0000 7f6a50971700 1 --2- 172.21.15.77:0/394336799 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f6a34036850 0x7f6a34038d00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009990 tx=0x7f6a40006e40 comp rx=0 tx=0).stop 2024-04-25T02:00:05.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.610+0000 7f6a50971700 1 -- 172.21.15.77:0/394336799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a4c076c50 msgr2=0x7f6a4c111600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:05.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.610+0000 7f6a50971700 1 --2- 172.21.15.77:0/394336799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a4c076c50 0x7f6a4c111600 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c006b00 tx=0x7f6a3c009250 comp rx=0 tx=0).stop 2024-04-25T02:00:05.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.610+0000 7f6a50971700 1 -- 172.21.15.77:0/394336799 shutdown_connections 2024-04-25T02:00:05.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.610+0000 7f6a50971700 1 --2- 172.21.15.77:0/394336799 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f6a34036850 0x7f6a34038d00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:05.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.610+0000 7f6a50971700 1 --2- 172.21.15.77:0/394336799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a4c076c50 0x7f6a4c111600 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:05.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.610+0000 7f6a50971700 1 -- 172.21.15.77:0/394336799 >> 172.21.15.77:0/394336799 conn(0x7f6a4c0fcef0 msgr2=0x7f6a4c0fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:05.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.610+0000 7f6a50971700 1 -- 172.21.15.77:0/394336799 shutdown_connections 2024-04-25T02:00:05.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:04.610+0000 7f6a50971700 1 -- 172.21.15.77:0/394336799 wait complete. 2024-04-25T02:00:05.238 INFO:teuthology.orchestra.run.smithi077.stdout:Deploying mgr service with default placement... 2024-04-25T02:00:05.822 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:05 smithi077 ceph-mon[26330]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:00:05.822 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:05 smithi077 ceph-mon[26330]: Saving service mon spec with placement count:5 2024-04-25T02:00:05.822 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:05 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:07.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:07 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:07.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:07 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:07.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:07 smithi077 ceph-mon[26330]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:00:07.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:07 smithi077 ceph-mon[26330]: Saving service mgr spec with placement count:2 2024-04-25T02:00:07.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:07 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:07.502 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-25T02:00:07.502 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.678+0000 7f0d3c3a7700 1 Processor -- start 2024-04-25T02:00:07.502 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.678+0000 7f0d3c3a7700 1 -- start start 2024-04-25T02:00:07.502 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.679+0000 7f0d3c3a7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d34078d60 0x7f0d34077270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:07.502 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.679+0000 7f0d3c3a7700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d34079170 con 0x7f0d34078d60 2024-04-25T02:00:07.502 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.679+0000 7f0d3a143700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d34078d60 0x7f0d34077270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:07.502 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.679+0000 7f0d3a143700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d34078d60 0x7f0d34077270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52410/0 (socket says 172.21.15.77:52410) 2024-04-25T02:00:07.503 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.679+0000 7f0d3a143700 1 -- 172.21.15.77:0/2176761129 learned_addr learned my addr 172.21.15.77:0/2176761129 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:07.503 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.679+0000 7f0d3a143700 1 -- 172.21.15.77:0/2176761129 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d340777b0 con 0x7f0d34078d60 2024-04-25T02:00:07.503 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.679+0000 7f0d3a143700 1 --2- 172.21.15.77:0/2176761129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d34078d60 0x7f0d34077270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0d300098e0 tx=0x7f0d30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7265aa8c17aaae0e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:07.503 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.680+0000 7f0d39141700 1 -- 172.21.15.77:0/2176761129 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d3000b860 con 0x7f0d34078d60 2024-04-25T02:00:07.503 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.680+0000 7f0d39141700 1 -- 172.21.15.77:0/2176761129 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0d3000be90 con 0x7f0d34078d60 2024-04-25T02:00:07.503 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.680+0000 7f0d39141700 1 -- 172.21.15.77:0/2176761129 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d300103c0 con 0x7f0d34078d60 2024-04-25T02:00:07.503 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.680+0000 7f0d3c3a7700 1 -- 172.21.15.77:0/2176761129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d34078d60 msgr2=0x7f0d34077270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:07.503 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.680+0000 7f0d3c3a7700 1 --2- 172.21.15.77:0/2176761129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d34078d60 0x7f0d34077270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0d300098e0 tx=0x7f0d30009250 comp rx=0 tx=0).stop 2024-04-25T02:00:07.503 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.680+0000 7f0d3c3a7700 1 -- 172.21.15.77:0/2176761129 shutdown_connections 2024-04-25T02:00:07.503 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.680+0000 7f0d3c3a7700 1 --2- 172.21.15.77:0/2176761129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d34078d60 0x7f0d34077270 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:07.503 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.680+0000 7f0d3c3a7700 1 -- 172.21.15.77:0/2176761129 >> 172.21.15.77:0/2176761129 conn(0x7f0d340fdfd0 msgr2=0x7f0d341003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:07.503 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.680+0000 7f0d3c3a7700 1 -- 172.21.15.77:0/2176761129 shutdown_connections 2024-04-25T02:00:07.503 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.681+0000 7f0d3c3a7700 1 -- 172.21.15.77:0/2176761129 wait complete. 2024-04-25T02:00:07.503 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.681+0000 7f0d3c3a7700 1 Processor -- start 2024-04-25T02:00:07.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.681+0000 7f0d3c3a7700 1 -- start start 2024-04-25T02:00:07.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.681+0000 7f0d3c3a7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d34078d60 0x7f0d34117d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:07.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.681+0000 7f0d3c3a7700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d34118270 con 0x7f0d34078d60 2024-04-25T02:00:07.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.681+0000 7f0d3a143700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d34078d60 0x7f0d34117d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:07.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.681+0000 7f0d3a143700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d34078d60 0x7f0d34117d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52424/0 (socket says 172.21.15.77:52424) 2024-04-25T02:00:07.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.681+0000 7f0d3a143700 1 -- 172.21.15.77:0/3620737651 learned_addr learned my addr 172.21.15.77:0/3620737651 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:07.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.682+0000 7f0d3a143700 1 -- 172.21.15.77:0/3620737651 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d300094f0 con 0x7f0d34078d60 2024-04-25T02:00:07.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.682+0000 7f0d3a143700 1 --2- 172.21.15.77:0/3620737651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d34078d60 0x7f0d34117d30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0d30011c10 tx=0x7f0d30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:07.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.682+0000 7f0d2affd700 1 -- 172.21.15.77:0/3620737651 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d30010630 con 0x7f0d34078d60 2024-04-25T02:00:07.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.682+0000 7f0d2affd700 1 -- 172.21.15.77:0/3620737651 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0d30010c60 con 0x7f0d34078d60 2024-04-25T02:00:07.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.682+0000 7f0d3c3a7700 1 -- 172.21.15.77:0/3620737651 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d34118470 con 0x7f0d34078d60 2024-04-25T02:00:07.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.682+0000 7f0d2affd700 1 -- 172.21.15.77:0/3620737651 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d3001ad10 con 0x7f0d34078d60 2024-04-25T02:00:07.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.682+0000 7f0d3c3a7700 1 -- 172.21.15.77:0/3620737651 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d34118fe0 con 0x7f0d34078d60 2024-04-25T02:00:07.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.683+0000 7f0d2affd700 1 -- 172.21.15.77:0/3620737651 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f0d300193c0 con 0x7f0d34078d60 2024-04-25T02:00:07.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.683+0000 7f0d3c3a7700 1 -- 172.21.15.77:0/3620737651 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d3405f5c0 con 0x7f0d34078d60 2024-04-25T02:00:07.505 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.683+0000 7f0d2affd700 1 --2- 172.21.15.77:0/3620737651 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f0d20036850 0x7f0d20038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:07.505 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.683+0000 7f0d2affd700 1 -- 172.21.15.77:0/3620737651 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f0d3004a060 con 0x7f0d34078d60 2024-04-25T02:00:07.505 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.683+0000 7f0d39942700 1 --2- 172.21.15.77:0/3620737651 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f0d20036850 0x7f0d20038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:07.505 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.684+0000 7f0d39942700 1 --2- 172.21.15.77:0/3620737651 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f0d20036850 0x7f0d20038d00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0d24009990 tx=0x7f0d24006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:07.505 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.688+0000 7f0d2affd700 1 -- 172.21.15.77:0/3620737651 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0d30024d30 con 0x7f0d34078d60 2024-04-25T02:00:07.505 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.905+0000 7f0d3c3a7700 1 -- 172.21.15.77:0/3620737651 --> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d34119b60 con 0x7f0d20036850 2024-04-25T02:00:07.505 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.912+0000 7f0d2affd700 1 -- 172.21.15.77:0/3620737651 <== mgr.14118 v2:172.21.15.77:6800/859750200 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f0d34119b60 con 0x7f0d20036850 2024-04-25T02:00:07.505 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.915+0000 7f0d3c3a7700 1 -- 172.21.15.77:0/3620737651 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f0d20036850 msgr2=0x7f0d20038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:07.505 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.915+0000 7f0d3c3a7700 1 --2- 172.21.15.77:0/3620737651 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f0d20036850 0x7f0d20038d00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0d24009990 tx=0x7f0d24006e40 comp rx=0 tx=0).stop 2024-04-25T02:00:07.505 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.915+0000 7f0d3c3a7700 1 -- 172.21.15.77:0/3620737651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d34078d60 msgr2=0x7f0d34117d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:07.505 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.915+0000 7f0d3c3a7700 1 --2- 172.21.15.77:0/3620737651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d34078d60 0x7f0d34117d30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0d30011c10 tx=0x7f0d30009250 comp rx=0 tx=0).stop 2024-04-25T02:00:07.505 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.915+0000 7f0d3c3a7700 1 -- 172.21.15.77:0/3620737651 shutdown_connections 2024-04-25T02:00:07.506 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.915+0000 7f0d3c3a7700 1 --2- 172.21.15.77:0/3620737651 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f0d20036850 0x7f0d20038d00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:07.506 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.915+0000 7f0d3c3a7700 1 --2- 172.21.15.77:0/3620737651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d34078d60 0x7f0d34117d30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:07.506 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.915+0000 7f0d3c3a7700 1 -- 172.21.15.77:0/3620737651 >> 172.21.15.77:0/3620737651 conn(0x7f0d340fdfd0 msgr2=0x7f0d3410ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:07.506 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.916+0000 7f0d3c3a7700 1 -- 172.21.15.77:0/3620737651 shutdown_connections 2024-04-25T02:00:07.506 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:06.916+0000 7f0d3c3a7700 1 -- 172.21.15.77:0/3620737651 wait complete. 2024-04-25T02:00:07.506 INFO:teuthology.orchestra.run.smithi077.stdout:Deploying crash service with default placement... 2024-04-25T02:00:09.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:09 smithi077 ceph-mon[26330]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:00:09.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:09 smithi077 ceph-mon[26330]: Saving service crash spec with placement * 2024-04-25T02:00:09.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:09 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:09.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:09 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:09.245 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-04-25T02:00:09.245 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.872+0000 7fba92005700 1 Processor -- start 2024-04-25T02:00:09.245 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.872+0000 7fba92005700 1 -- start start 2024-04-25T02:00:09.245 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.872+0000 7fba92005700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba8c102810 0x7fba8c102c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:09.245 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.872+0000 7fba92005700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c103160 con 0x7fba8c102810 2024-04-25T02:00:09.245 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.872+0000 7fba8b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba8c102810 0x7fba8c102c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:09.245 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.872+0000 7fba8b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba8c102810 0x7fba8c102c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53146/0 (socket says 172.21.15.77:53146) 2024-04-25T02:00:09.245 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.872+0000 7fba8b7fe700 1 -- 172.21.15.77:0/4097130529 learned_addr learned my addr 172.21.15.77:0/4097130529 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:09.245 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.872+0000 7fba8b7fe700 1 -- 172.21.15.77:0/4097130529 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8c1032a0 con 0x7fba8c102810 2024-04-25T02:00:09.245 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.872+0000 7fba8b7fe700 1 --2- 172.21.15.77:0/4097130529 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba8c102810 0x7fba8c102c20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0098e0 tx=0x7fba7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2913d6480663763f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:09.246 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.873+0000 7fba8a7fc700 1 -- 172.21.15.77:0/4097130529 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba7c00b860 con 0x7fba8c102810 2024-04-25T02:00:09.246 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.873+0000 7fba8a7fc700 1 -- 172.21.15.77:0/4097130529 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba7c00be90 con 0x7fba8c102810 2024-04-25T02:00:09.246 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.873+0000 7fba8a7fc700 1 -- 172.21.15.77:0/4097130529 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba7c0103c0 con 0x7fba8c102810 2024-04-25T02:00:09.246 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.873+0000 7fba92005700 1 -- 172.21.15.77:0/4097130529 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba8c102810 msgr2=0x7fba8c102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:09.246 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.873+0000 7fba92005700 1 --2- 172.21.15.77:0/4097130529 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba8c102810 0x7fba8c102c20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0098e0 tx=0x7fba7c009250 comp rx=0 tx=0).stop 2024-04-25T02:00:09.246 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.873+0000 7fba92005700 1 -- 172.21.15.77:0/4097130529 shutdown_connections 2024-04-25T02:00:09.246 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.873+0000 7fba92005700 1 --2- 172.21.15.77:0/4097130529 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba8c102810 0x7fba8c102c20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:09.246 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.873+0000 7fba92005700 1 -- 172.21.15.77:0/4097130529 >> 172.21.15.77:0/4097130529 conn(0x7fba8c0fdfd0 msgr2=0x7fba8c1003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:09.246 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.873+0000 7fba92005700 1 -- 172.21.15.77:0/4097130529 shutdown_connections 2024-04-25T02:00:09.246 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.873+0000 7fba92005700 1 -- 172.21.15.77:0/4097130529 wait complete. 2024-04-25T02:00:09.246 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.874+0000 7fba92005700 1 Processor -- start 2024-04-25T02:00:09.246 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.874+0000 7fba92005700 1 -- start start 2024-04-25T02:00:09.246 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.874+0000 7fba92005700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba8c102810 0x7fba8c1116c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:09.247 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.874+0000 7fba92005700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c111c00 con 0x7fba8c102810 2024-04-25T02:00:09.247 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.874+0000 7fba8b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba8c102810 0x7fba8c1116c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:09.247 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.874+0000 7fba8b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba8c102810 0x7fba8c1116c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53160/0 (socket says 172.21.15.77:53160) 2024-04-25T02:00:09.247 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.874+0000 7fba8b7fe700 1 -- 172.21.15.77:0/2996404017 learned_addr learned my addr 172.21.15.77:0/2996404017 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:09.247 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.874+0000 7fba8b7fe700 1 -- 172.21.15.77:0/2996404017 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c0094f0 con 0x7fba8c102810 2024-04-25T02:00:09.247 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.875+0000 7fba8b7fe700 1 --2- 172.21.15.77:0/2996404017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba8c102810 0x7fba8c1116c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fba7c011c10 tx=0x7fba7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:09.247 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.875+0000 7fba73fff700 1 -- 172.21.15.77:0/2996404017 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba7c010890 con 0x7fba8c102810 2024-04-25T02:00:09.247 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.875+0000 7fba92005700 1 -- 172.21.15.77:0/2996404017 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8c111e00 con 0x7fba8c102810 2024-04-25T02:00:09.247 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.875+0000 7fba73fff700 1 -- 172.21.15.77:0/2996404017 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba7c010ec0 con 0x7fba8c102810 2024-04-25T02:00:09.247 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.875+0000 7fba73fff700 1 -- 172.21.15.77:0/2996404017 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba7c0243f0 con 0x7fba8c102810 2024-04-25T02:00:09.247 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.875+0000 7fba92005700 1 -- 172.21.15.77:0/2996404017 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba8c112970 con 0x7fba8c102810 2024-04-25T02:00:09.247 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.876+0000 7fba92005700 1 -- 172.21.15.77:0/2996404017 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba8c05f5c0 con 0x7fba8c102810 2024-04-25T02:00:09.247 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.876+0000 7fba73fff700 1 -- 172.21.15.77:0/2996404017 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fba7c01a430 con 0x7fba8c102810 2024-04-25T02:00:09.247 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.876+0000 7fba73fff700 1 --2- 172.21.15.77:0/2996404017 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fba74036850 0x7fba74038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:09.247 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.876+0000 7fba73fff700 1 -- 172.21.15.77:0/2996404017 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fba7c04a210 con 0x7fba8c102810 2024-04-25T02:00:09.248 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.876+0000 7fba8affd700 1 --2- 172.21.15.77:0/2996404017 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fba74036850 0x7fba74038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:09.248 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.877+0000 7fba8affd700 1 --2- 172.21.15.77:0/2996404017 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fba74036850 0x7fba74038d00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fba80009990 tx=0x7fba80006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:09.248 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:07.881+0000 7fba73fff700 1 -- 172.21.15.77:0/2996404017 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fba7c02b8e0 con 0x7fba8c102810 2024-04-25T02:00:09.248 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:08.089+0000 7fba92005700 1 -- 172.21.15.77:0/2996404017 --> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7fba8c0ff230 con 0x7fba74036850 2024-04-25T02:00:09.248 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:08.094+0000 7fba73fff700 1 -- 172.21.15.77:0/2996404017 <== mgr.14118 v2:172.21.15.77:6800/859750200 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fba8c0ff230 con 0x7fba74036850 2024-04-25T02:00:09.248 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:08.096+0000 7fba92005700 1 -- 172.21.15.77:0/2996404017 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fba74036850 msgr2=0x7fba74038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:09.248 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:08.096+0000 7fba92005700 1 --2- 172.21.15.77:0/2996404017 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fba74036850 0x7fba74038d00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fba80009990 tx=0x7fba80006e40 comp rx=0 tx=0).stop 2024-04-25T02:00:09.248 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:08.096+0000 7fba92005700 1 -- 172.21.15.77:0/2996404017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba8c102810 msgr2=0x7fba8c1116c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:09.248 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:08.096+0000 7fba92005700 1 --2- 172.21.15.77:0/2996404017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba8c102810 0x7fba8c1116c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fba7c011c10 tx=0x7fba7c009250 comp rx=0 tx=0).stop 2024-04-25T02:00:09.248 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:08.096+0000 7fba92005700 1 -- 172.21.15.77:0/2996404017 shutdown_connections 2024-04-25T02:00:09.248 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:08.096+0000 7fba92005700 1 --2- 172.21.15.77:0/2996404017 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fba74036850 0x7fba74038d00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:09.248 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:08.096+0000 7fba92005700 1 --2- 172.21.15.77:0/2996404017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba8c102810 0x7fba8c1116c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:09.248 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:08.096+0000 7fba92005700 1 -- 172.21.15.77:0/2996404017 >> 172.21.15.77:0/2996404017 conn(0x7fba8c0fdfd0 msgr2=0x7fba8c0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:09.248 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:08.096+0000 7fba92005700 1 -- 172.21.15.77:0/2996404017 shutdown_connections 2024-04-25T02:00:09.249 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:08.096+0000 7fba92005700 1 -- 172.21.15.77:0/2996404017 wait complete. 2024-04-25T02:00:09.249 INFO:teuthology.orchestra.run.smithi077.stdout:Deploying prometheus service with default placement... 2024-04-25T02:00:10.493 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-04-25T02:00:10.493 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.679+0000 7f50c352b700 1 Processor -- start 2024-04-25T02:00:10.494 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.679+0000 7f50c352b700 1 -- start start 2024-04-25T02:00:10.494 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.679+0000 7f50c352b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50bc101750 0x7f50bc101b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:10.494 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.679+0000 7f50c352b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc1020a0 con 0x7f50bc101750 2024-04-25T02:00:10.494 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.679+0000 7f50c12c7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50bc101750 0x7f50bc101b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:10.494 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.679+0000 7f50c12c7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50bc101750 0x7f50bc101b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53172/0 (socket says 172.21.15.77:53172) 2024-04-25T02:00:10.494 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.680+0000 7f50c12c7700 1 -- 172.21.15.77:0/3974697147 learned_addr learned my addr 172.21.15.77:0/3974697147 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:10.494 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.680+0000 7f50c12c7700 1 -- 172.21.15.77:0/3974697147 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50bc1021e0 con 0x7f50bc101750 2024-04-25T02:00:10.494 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.680+0000 7f50c12c7700 1 --2- 172.21.15.77:0/3974697147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50bc101750 0x7f50bc101b60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f50b800bb80 tx=0x7f50b800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e135ad91915959b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:10.494 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.680+0000 7f50b3fff700 1 -- 172.21.15.77:0/3974697147 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50b800dd00 con 0x7f50bc101750 2024-04-25T02:00:10.494 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.680+0000 7f50b3fff700 1 -- 172.21.15.77:0/3974697147 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f50b800de60 con 0x7f50bc101750 2024-04-25T02:00:10.494 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.680+0000 7f50b3fff700 1 -- 172.21.15.77:0/3974697147 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50b8018920 con 0x7f50bc101750 2024-04-25T02:00:10.494 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.681+0000 7f50c352b700 1 -- 172.21.15.77:0/3974697147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50bc101750 msgr2=0x7f50bc101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:10.494 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.681+0000 7f50c352b700 1 --2- 172.21.15.77:0/3974697147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50bc101750 0x7f50bc101b60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f50b800bb80 tx=0x7f50b800b4f0 comp rx=0 tx=0).stop 2024-04-25T02:00:10.494 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.681+0000 7f50c352b700 1 -- 172.21.15.77:0/3974697147 shutdown_connections 2024-04-25T02:00:10.495 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.681+0000 7f50c352b700 1 --2- 172.21.15.77:0/3974697147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50bc101750 0x7f50bc101b60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:10.495 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.681+0000 7f50c352b700 1 -- 172.21.15.77:0/3974697147 >> 172.21.15.77:0/3974697147 conn(0x7f50bc0fcef0 msgr2=0x7f50bc0ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:10.495 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.681+0000 7f50c352b700 1 -- 172.21.15.77:0/3974697147 shutdown_connections 2024-04-25T02:00:10.495 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.681+0000 7f50c352b700 1 -- 172.21.15.77:0/3974697147 wait complete. 2024-04-25T02:00:10.495 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.681+0000 7f50c352b700 1 Processor -- start 2024-04-25T02:00:10.495 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.681+0000 7f50c352b700 1 -- start start 2024-04-25T02:00:10.495 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.682+0000 7f50c352b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50bc101750 0x7f50bc1137c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:10.495 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.682+0000 7f50c352b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc113d00 con 0x7f50bc101750 2024-04-25T02:00:10.495 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.682+0000 7f50c12c7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50bc101750 0x7f50bc1137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:10.495 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.682+0000 7f50c12c7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50bc101750 0x7f50bc1137c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53180/0 (socket says 172.21.15.77:53180) 2024-04-25T02:00:10.495 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.682+0000 7f50c12c7700 1 -- 172.21.15.77:0/112817008 learned_addr learned my addr 172.21.15.77:0/112817008 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:10.495 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.682+0000 7f50c12c7700 1 -- 172.21.15.77:0/112817008 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b800b790 con 0x7f50bc101750 2024-04-25T02:00:10.495 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.682+0000 7f50c12c7700 1 --2- 172.21.15.77:0/112817008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50bc101750 0x7f50bc1137c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f50b80106a0 tx=0x7f50b800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:10.495 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.682+0000 7f50b1ffb700 1 -- 172.21.15.77:0/112817008 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50b8018e90 con 0x7f50bc101750 2024-04-25T02:00:10.496 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.682+0000 7f50c352b700 1 -- 172.21.15.77:0/112817008 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50bc113f00 con 0x7f50bc101750 2024-04-25T02:00:10.496 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.682+0000 7f50b1ffb700 1 -- 172.21.15.77:0/112817008 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f50b8010c30 con 0x7f50bc101750 2024-04-25T02:00:10.496 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.682+0000 7f50b1ffb700 1 -- 172.21.15.77:0/112817008 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50b8021530 con 0x7f50bc101750 2024-04-25T02:00:10.496 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.683+0000 7f50c352b700 1 -- 172.21.15.77:0/112817008 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50bc114a70 con 0x7f50bc101750 2024-04-25T02:00:10.496 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.683+0000 7f50b1ffb700 1 -- 172.21.15.77:0/112817008 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f50b8021720 con 0x7f50bc101750 2024-04-25T02:00:10.496 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.683+0000 7f50c352b700 1 -- 172.21.15.77:0/112817008 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50bc05f5c0 con 0x7f50bc101750 2024-04-25T02:00:10.496 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.684+0000 7f50b1ffb700 1 --2- 172.21.15.77:0/112817008 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f50a8036850 0x7f50a8038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:10.496 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.684+0000 7f50b1ffb700 1 -- 172.21.15.77:0/112817008 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f50b8014070 con 0x7f50bc101750 2024-04-25T02:00:10.496 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.684+0000 7f50c0ac6700 1 --2- 172.21.15.77:0/112817008 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f50a8036850 0x7f50a8038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:10.496 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.684+0000 7f50c0ac6700 1 --2- 172.21.15.77:0/112817008 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f50a8036850 0x7f50a8038d00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f50ac009990 tx=0x7f50ac006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:10.496 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.689+0000 7f50b1ffb700 1 -- 172.21.15.77:0/112817008 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f50b8022a50 con 0x7f50bc101750 2024-04-25T02:00:10.496 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.899+0000 7f50c352b700 1 -- 172.21.15.77:0/112817008 --> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f50bc114e20 con 0x7f50a8036850 2024-04-25T02:00:10.496 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.904+0000 7f50b1ffb700 1 -- 172.21.15.77:0/112817008 <== mgr.14118 v2:172.21.15.77:6800/859750200 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f50bc114e20 con 0x7f50a8036850 2024-04-25T02:00:10.496 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.906+0000 7f50c352b700 1 -- 172.21.15.77:0/112817008 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f50a8036850 msgr2=0x7f50a8038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:10.497 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.906+0000 7f50c352b700 1 --2- 172.21.15.77:0/112817008 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f50a8036850 0x7f50a8038d00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f50ac009990 tx=0x7f50ac006e40 comp rx=0 tx=0).stop 2024-04-25T02:00:10.497 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.906+0000 7f50c352b700 1 -- 172.21.15.77:0/112817008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50bc101750 msgr2=0x7f50bc1137c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:10.497 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.906+0000 7f50c352b700 1 --2- 172.21.15.77:0/112817008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50bc101750 0x7f50bc1137c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f50b80106a0 tx=0x7f50b800b4f0 comp rx=0 tx=0).stop 2024-04-25T02:00:10.497 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.906+0000 7f50c352b700 1 -- 172.21.15.77:0/112817008 shutdown_connections 2024-04-25T02:00:10.497 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.906+0000 7f50c352b700 1 --2- 172.21.15.77:0/112817008 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f50a8036850 0x7f50a8038d00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:10.497 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.906+0000 7f50c352b700 1 --2- 172.21.15.77:0/112817008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50bc101750 0x7f50bc1137c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:10.497 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.906+0000 7f50c352b700 1 -- 172.21.15.77:0/112817008 >> 172.21.15.77:0/112817008 conn(0x7f50bc0fcef0 msgr2=0x7f50bc105be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:10.497 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.906+0000 7f50c352b700 1 -- 172.21.15.77:0/112817008 shutdown_connections 2024-04-25T02:00:10.497 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:09.906+0000 7f50c352b700 1 -- 172.21.15.77:0/112817008 wait complete. 2024-04-25T02:00:10.497 INFO:teuthology.orchestra.run.smithi077.stdout:Deploying grafana service with default placement... 2024-04-25T02:00:10.913 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:10 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:10.913 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:10 smithi077 ceph-mon[26330]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:00:10.913 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:10 smithi077 ceph-mon[26330]: Saving service prometheus spec with placement count:1 2024-04-25T02:00:10.913 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:10 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:11.735 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-04-25T02:00:11.735 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.929+0000 7f1cc1fcd700 1 Processor -- start 2024-04-25T02:00:11.736 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.929+0000 7f1cc1fcd700 1 -- start start 2024-04-25T02:00:11.736 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.929+0000 7f1cc1fcd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cbc078d60 0x7f1cbc077270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:11.736 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.929+0000 7f1cc1fcd700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc079170 con 0x7f1cbc078d60 2024-04-25T02:00:11.736 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.929+0000 7f1cbb7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cbc078d60 0x7f1cbc077270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:11.736 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.929+0000 7f1cbb7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cbc078d60 0x7f1cbc077270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53194/0 (socket says 172.21.15.77:53194) 2024-04-25T02:00:11.736 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.929+0000 7f1cbb7fe700 1 -- 172.21.15.77:0/600657869 learned_addr learned my addr 172.21.15.77:0/600657869 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:11.736 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.929+0000 7f1cbb7fe700 1 -- 172.21.15.77:0/600657869 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cbc0777b0 con 0x7f1cbc078d60 2024-04-25T02:00:11.736 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.930+0000 7f1cbb7fe700 1 --2- 172.21.15.77:0/600657869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cbc078d60 0x7f1cbc077270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1cac0098e0 tx=0x7f1cac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63173ed209df4c97 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:11.736 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.930+0000 7f1cba7fc700 1 -- 172.21.15.77:0/600657869 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1cac00b860 con 0x7f1cbc078d60 2024-04-25T02:00:11.736 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.930+0000 7f1cba7fc700 1 -- 172.21.15.77:0/600657869 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1cac00be90 con 0x7f1cbc078d60 2024-04-25T02:00:11.736 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.930+0000 7f1cba7fc700 1 -- 172.21.15.77:0/600657869 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1cac0103c0 con 0x7f1cbc078d60 2024-04-25T02:00:11.736 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.930+0000 7f1cc1fcd700 1 -- 172.21.15.77:0/600657869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cbc078d60 msgr2=0x7f1cbc077270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:11.736 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.930+0000 7f1cc1fcd700 1 --2- 172.21.15.77:0/600657869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cbc078d60 0x7f1cbc077270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1cac0098e0 tx=0x7f1cac009250 comp rx=0 tx=0).stop 2024-04-25T02:00:11.736 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.930+0000 7f1cc1fcd700 1 -- 172.21.15.77:0/600657869 shutdown_connections 2024-04-25T02:00:11.736 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.930+0000 7f1cc1fcd700 1 --2- 172.21.15.77:0/600657869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cbc078d60 0x7f1cbc077270 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:11.737 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.930+0000 7f1cc1fcd700 1 -- 172.21.15.77:0/600657869 >> 172.21.15.77:0/600657869 conn(0x7f1cbc0fdfd0 msgr2=0x7f1cbc1003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:11.737 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.930+0000 7f1cc1fcd700 1 -- 172.21.15.77:0/600657869 shutdown_connections 2024-04-25T02:00:11.737 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.930+0000 7f1cc1fcd700 1 -- 172.21.15.77:0/600657869 wait complete. 2024-04-25T02:00:11.737 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.931+0000 7f1cc1fcd700 1 Processor -- start 2024-04-25T02:00:11.737 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.931+0000 7f1cc1fcd700 1 -- start start 2024-04-25T02:00:11.737 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.931+0000 7f1cc1fcd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cbc078d60 0x7f1cbc1138c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:11.737 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.931+0000 7f1cc1fcd700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc113e00 con 0x7f1cbc078d60 2024-04-25T02:00:11.737 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.931+0000 7f1cbb7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cbc078d60 0x7f1cbc1138c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:11.737 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.931+0000 7f1cbb7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cbc078d60 0x7f1cbc1138c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53196/0 (socket says 172.21.15.77:53196) 2024-04-25T02:00:11.737 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.931+0000 7f1cbb7fe700 1 -- 172.21.15.77:0/1839750220 learned_addr learned my addr 172.21.15.77:0/1839750220 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:11.737 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.932+0000 7f1cbb7fe700 1 -- 172.21.15.77:0/1839750220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cac0094f0 con 0x7f1cbc078d60 2024-04-25T02:00:11.737 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.932+0000 7f1cbb7fe700 1 --2- 172.21.15.77:0/1839750220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cbc078d60 0x7f1cbc1138c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1cac0105b0 tx=0x7f1cac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:11.737 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.932+0000 7f1ca3fff700 1 -- 172.21.15.77:0/1839750220 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1cac010840 con 0x7f1cbc078d60 2024-04-25T02:00:11.737 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.932+0000 7f1cc1fcd700 1 -- 172.21.15.77:0/1839750220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cbc114000 con 0x7f1cbc078d60 2024-04-25T02:00:11.738 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.932+0000 7f1ca3fff700 1 -- 172.21.15.77:0/1839750220 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1cac010e70 con 0x7f1cbc078d60 2024-04-25T02:00:11.738 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.932+0000 7f1ca3fff700 1 -- 172.21.15.77:0/1839750220 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1cac01ae30 con 0x7f1cbc078d60 2024-04-25T02:00:11.738 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.932+0000 7f1cc1fcd700 1 -- 172.21.15.77:0/1839750220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cbc114b70 con 0x7f1cbc078d60 2024-04-25T02:00:11.738 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.933+0000 7f1ca3fff700 1 -- 172.21.15.77:0/1839750220 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f1cac02d3f0 con 0x7f1cbc078d60 2024-04-25T02:00:11.738 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.933+0000 7f1cc1fcd700 1 -- 172.21.15.77:0/1839750220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cbc05f5c0 con 0x7f1cbc078d60 2024-04-25T02:00:11.738 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.933+0000 7f1ca3fff700 1 --2- 172.21.15.77:0/1839750220 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f1ca4036850 0x7f1ca4038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:11.738 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.933+0000 7f1ca3fff700 1 -- 172.21.15.77:0/1839750220 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f1cac04a1c0 con 0x7f1cbc078d60 2024-04-25T02:00:11.738 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.933+0000 7f1cbaffd700 1 --2- 172.21.15.77:0/1839750220 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f1ca4036850 0x7f1ca4038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:11.738 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.933+0000 7f1cbaffd700 1 --2- 172.21.15.77:0/1839750220 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f1ca4036850 0x7f1ca4038d00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0009990 tx=0x7f1cb0006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:11.738 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:10.938+0000 7f1ca3fff700 1 -- 172.21.15.77:0/1839750220 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1cac02b8e0 con 0x7f1cbc078d60 2024-04-25T02:00:11.738 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:11.142+0000 7f1cc1fcd700 1 -- 172.21.15.77:0/1839750220 --> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f1cbc0ff230 con 0x7f1ca4036850 2024-04-25T02:00:11.738 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:11.146+0000 7f1ca3fff700 1 -- 172.21.15.77:0/1839750220 <== mgr.14118 v2:172.21.15.77:6800/859750200 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f1cbc0ff230 con 0x7f1ca4036850 2024-04-25T02:00:11.738 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:11.148+0000 7f1cc1fcd700 1 -- 172.21.15.77:0/1839750220 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f1ca4036850 msgr2=0x7f1ca4038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:11.739 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:11.148+0000 7f1cc1fcd700 1 --2- 172.21.15.77:0/1839750220 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f1ca4036850 0x7f1ca4038d00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0009990 tx=0x7f1cb0006e40 comp rx=0 tx=0).stop 2024-04-25T02:00:11.739 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:11.148+0000 7f1cc1fcd700 1 -- 172.21.15.77:0/1839750220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cbc078d60 msgr2=0x7f1cbc1138c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:11.739 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:11.148+0000 7f1cc1fcd700 1 --2- 172.21.15.77:0/1839750220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cbc078d60 0x7f1cbc1138c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1cac0105b0 tx=0x7f1cac009250 comp rx=0 tx=0).stop 2024-04-25T02:00:11.739 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:11.148+0000 7f1cc1fcd700 1 -- 172.21.15.77:0/1839750220 shutdown_connections 2024-04-25T02:00:11.739 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:11.148+0000 7f1cc1fcd700 1 --2- 172.21.15.77:0/1839750220 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f1ca4036850 0x7f1ca4038d00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:11.739 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:11.148+0000 7f1cc1fcd700 1 --2- 172.21.15.77:0/1839750220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cbc078d60 0x7f1cbc1138c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:11.739 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:11.148+0000 7f1cc1fcd700 1 -- 172.21.15.77:0/1839750220 >> 172.21.15.77:0/1839750220 conn(0x7f1cbc0fdfd0 msgr2=0x7f1cbc0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:11.739 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:11.148+0000 7f1cc1fcd700 1 -- 172.21.15.77:0/1839750220 shutdown_connections 2024-04-25T02:00:11.739 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:11.148+0000 7f1cc1fcd700 1 -- 172.21.15.77:0/1839750220 wait complete. 2024-04-25T02:00:11.739 INFO:teuthology.orchestra.run.smithi077.stdout:Deploying node-exporter service with default placement... 2024-04-25T02:00:12.476 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:12 smithi077 ceph-mon[26330]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:00:12.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:12 smithi077 ceph-mon[26330]: Saving service grafana spec with placement count:1 2024-04-25T02:00:12.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:12 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:13.490 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-04-25T02:00:13.495 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.147+0000 7fe8662ba700 1 Processor -- start 2024-04-25T02:00:13.496 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.147+0000 7fe8662ba700 1 -- start start 2024-04-25T02:00:13.496 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.147+0000 7fe8662ba700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe860101760 0x7fe860101b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:13.496 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.147+0000 7fe8662ba700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8601020b0 con 0x7fe860101760 2024-04-25T02:00:13.496 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.147+0000 7fe85ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe860101760 0x7fe860101b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:13.496 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.147+0000 7fe85ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe860101760 0x7fe860101b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53202/0 (socket says 172.21.15.77:53202) 2024-04-25T02:00:13.496 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.147+0000 7fe85ffff700 1 -- 172.21.15.77:0/48269131 learned_addr learned my addr 172.21.15.77:0/48269131 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:13.496 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.148+0000 7fe85ffff700 1 -- 172.21.15.77:0/48269131 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8601021f0 con 0x7fe860101760 2024-04-25T02:00:13.496 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.148+0000 7fe85ffff700 1 --2- 172.21.15.77:0/48269131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe860101760 0x7fe860101b70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe85000bb80 tx=0x7fe85000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f82067fa4e970e90 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:13.496 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.148+0000 7fe85effd700 1 -- 172.21.15.77:0/48269131 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe85000dd00 con 0x7fe860101760 2024-04-25T02:00:13.496 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.148+0000 7fe85effd700 1 -- 172.21.15.77:0/48269131 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe85000de60 con 0x7fe860101760 2024-04-25T02:00:13.496 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.148+0000 7fe85effd700 1 -- 172.21.15.77:0/48269131 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe850018920 con 0x7fe860101760 2024-04-25T02:00:13.496 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.148+0000 7fe8662ba700 1 -- 172.21.15.77:0/48269131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe860101760 msgr2=0x7fe860101b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:13.496 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.148+0000 7fe8662ba700 1 --2- 172.21.15.77:0/48269131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe860101760 0x7fe860101b70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe85000bb80 tx=0x7fe85000b4f0 comp rx=0 tx=0).stop 2024-04-25T02:00:13.497 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.149+0000 7fe8662ba700 1 -- 172.21.15.77:0/48269131 shutdown_connections 2024-04-25T02:00:13.497 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.149+0000 7fe8662ba700 1 --2- 172.21.15.77:0/48269131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe860101760 0x7fe860101b70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:13.497 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.149+0000 7fe8662ba700 1 -- 172.21.15.77:0/48269131 >> 172.21.15.77:0/48269131 conn(0x7fe8600fcea0 msgr2=0x7fe8600ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:13.497 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.149+0000 7fe8662ba700 1 -- 172.21.15.77:0/48269131 shutdown_connections 2024-04-25T02:00:13.497 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.149+0000 7fe8662ba700 1 -- 172.21.15.77:0/48269131 wait complete. 2024-04-25T02:00:13.497 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.149+0000 7fe8662ba700 1 Processor -- start 2024-04-25T02:00:13.497 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.149+0000 7fe8662ba700 1 -- start start 2024-04-25T02:00:13.497 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.150+0000 7fe8662ba700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe860101760 0x7fe860113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:13.497 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.150+0000 7fe8662ba700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe860113cc0 con 0x7fe860101760 2024-04-25T02:00:13.497 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.150+0000 7fe85ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe860101760 0x7fe860113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:13.497 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.150+0000 7fe85ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe860101760 0x7fe860113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53206/0 (socket says 172.21.15.77:53206) 2024-04-25T02:00:13.497 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.150+0000 7fe85ffff700 1 -- 172.21.15.77:0/3132019181 learned_addr learned my addr 172.21.15.77:0/3132019181 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:13.497 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.150+0000 7fe85ffff700 1 -- 172.21.15.77:0/3132019181 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85000b790 con 0x7fe860101760 2024-04-25T02:00:13.497 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.150+0000 7fe85ffff700 1 --2- 172.21.15.77:0/3132019181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe860101760 0x7fe860113780 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe8500106a0 tx=0x7fe85000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:13.498 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.150+0000 7fe85cff9700 1 -- 172.21.15.77:0/3132019181 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe850018e90 con 0x7fe860101760 2024-04-25T02:00:13.498 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.150+0000 7fe85cff9700 1 -- 172.21.15.77:0/3132019181 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe850010c30 con 0x7fe860101760 2024-04-25T02:00:13.498 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.150+0000 7fe8662ba700 1 -- 172.21.15.77:0/3132019181 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe860113ec0 con 0x7fe860101760 2024-04-25T02:00:13.498 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.150+0000 7fe85cff9700 1 -- 172.21.15.77:0/3132019181 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8500215e0 con 0x7fe860101760 2024-04-25T02:00:13.498 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.150+0000 7fe8662ba700 1 -- 172.21.15.77:0/3132019181 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe860114a30 con 0x7fe860101760 2024-04-25T02:00:13.498 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.151+0000 7fe85cff9700 1 -- 172.21.15.77:0/3132019181 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fe850021740 con 0x7fe860101760 2024-04-25T02:00:13.498 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.151+0000 7fe85cff9700 1 --2- 172.21.15.77:0/3132019181 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fe848036850 0x7fe848038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:13.498 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.151+0000 7fe85cff9700 1 -- 172.21.15.77:0/3132019181 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe850014070 con 0x7fe860101760 2024-04-25T02:00:13.498 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.151+0000 7fe85f7fe700 1 --2- 172.21.15.77:0/3132019181 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fe848036850 0x7fe848038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:13.498 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.151+0000 7fe8662ba700 1 -- 172.21.15.77:0/3132019181 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe86005f5c0 con 0x7fe860101760 2024-04-25T02:00:13.499 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.152+0000 7fe85f7fe700 1 --2- 172.21.15.77:0/3132019181 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fe848036850 0x7fe848038d00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe854009990 tx=0x7fe854006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:13.499 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.156+0000 7fe85cff9700 1 -- 172.21.15.77:0/3132019181 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe85000e950 con 0x7fe860101760 2024-04-25T02:00:13.499 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.356+0000 7fe8662ba700 1 -- 172.21.15.77:0/3132019181 --> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fe860114ce0 con 0x7fe848036850 2024-04-25T02:00:13.499 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.361+0000 7fe85cff9700 1 -- 172.21.15.77:0/3132019181 <== mgr.14118 v2:172.21.15.77:6800/859750200 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fe860114ce0 con 0x7fe848036850 2024-04-25T02:00:13.499 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.363+0000 7fe8662ba700 1 -- 172.21.15.77:0/3132019181 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fe848036850 msgr2=0x7fe848038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:13.499 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.363+0000 7fe8662ba700 1 --2- 172.21.15.77:0/3132019181 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fe848036850 0x7fe848038d00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe854009990 tx=0x7fe854006e40 comp rx=0 tx=0).stop 2024-04-25T02:00:13.499 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.363+0000 7fe8662ba700 1 -- 172.21.15.77:0/3132019181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe860101760 msgr2=0x7fe860113780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:13.499 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.363+0000 7fe8662ba700 1 --2- 172.21.15.77:0/3132019181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe860101760 0x7fe860113780 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe8500106a0 tx=0x7fe85000b4f0 comp rx=0 tx=0).stop 2024-04-25T02:00:13.499 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.363+0000 7fe8662ba700 1 -- 172.21.15.77:0/3132019181 shutdown_connections 2024-04-25T02:00:13.499 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.363+0000 7fe8662ba700 1 --2- 172.21.15.77:0/3132019181 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fe848036850 0x7fe848038d00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:13.499 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.363+0000 7fe8662ba700 1 --2- 172.21.15.77:0/3132019181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe860101760 0x7fe860113780 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:13.499 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.363+0000 7fe8662ba700 1 -- 172.21.15.77:0/3132019181 >> 172.21.15.77:0/3132019181 conn(0x7fe8600fcea0 msgr2=0x7fe860105ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:13.499 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.363+0000 7fe8662ba700 1 -- 172.21.15.77:0/3132019181 shutdown_connections 2024-04-25T02:00:13.499 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:12.363+0000 7fe8662ba700 1 -- 172.21.15.77:0/3132019181 wait complete. 2024-04-25T02:00:13.500 INFO:teuthology.orchestra.run.smithi077.stdout:Deploying alertmanager service with default placement... 2024-04-25T02:00:13.624 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:13 smithi077 ceph-mon[26330]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:00:13.625 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:13 smithi077 ceph-mon[26330]: Saving service node-exporter spec with placement * 2024-04-25T02:00:13.625 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:13 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:14.727 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-04-25T02:00:14.727 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.951+0000 7feeac710700 1 Processor -- start 2024-04-25T02:00:14.727 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.951+0000 7feeac710700 1 -- start start 2024-04-25T02:00:14.727 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.951+0000 7feeac710700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feea4076b20 0x7feea4105520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:14.727 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.951+0000 7feeac710700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea4076f30 con 0x7feea4076b20 2024-04-25T02:00:14.727 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.951+0000 7feeaa4ac700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feea4076b20 0x7feea4105520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:14.727 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.951+0000 7feeaa4ac700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feea4076b20 0x7feea4105520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53214/0 (socket says 172.21.15.77:53214) 2024-04-25T02:00:14.727 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.951+0000 7feeaa4ac700 1 -- 172.21.15.77:0/110178772 learned_addr learned my addr 172.21.15.77:0/110178772 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:14.727 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.951+0000 7feeaa4ac700 1 -- 172.21.15.77:0/110178772 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea4105a60 con 0x7feea4076b20 2024-04-25T02:00:14.727 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.952+0000 7feeaa4ac700 1 --2- 172.21.15.77:0/110178772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feea4076b20 0x7feea4105520 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feea00098e0 tx=0x7feea0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c3d291d35f647c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:14.727 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.952+0000 7feea94aa700 1 -- 172.21.15.77:0/110178772 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feea000b860 con 0x7feea4076b20 2024-04-25T02:00:14.728 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.952+0000 7feea94aa700 1 -- 172.21.15.77:0/110178772 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feea000be90 con 0x7feea4076b20 2024-04-25T02:00:14.728 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.952+0000 7feea94aa700 1 -- 172.21.15.77:0/110178772 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feea00103c0 con 0x7feea4076b20 2024-04-25T02:00:14.728 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.953+0000 7feeac710700 1 -- 172.21.15.77:0/110178772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feea4076b20 msgr2=0x7feea4105520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:14.728 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.953+0000 7feeac710700 1 --2- 172.21.15.77:0/110178772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feea4076b20 0x7feea4105520 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feea00098e0 tx=0x7feea0009250 comp rx=0 tx=0).stop 2024-04-25T02:00:14.728 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.953+0000 7feeac710700 1 -- 172.21.15.77:0/110178772 shutdown_connections 2024-04-25T02:00:14.728 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.953+0000 7feeac710700 1 --2- 172.21.15.77:0/110178772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feea4076b20 0x7feea4105520 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:14.728 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.953+0000 7feeac710700 1 -- 172.21.15.77:0/110178772 >> 172.21.15.77:0/110178772 conn(0x7feea40fcef0 msgr2=0x7feea40ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:14.728 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.953+0000 7feeac710700 1 -- 172.21.15.77:0/110178772 shutdown_connections 2024-04-25T02:00:14.728 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.953+0000 7feeac710700 1 -- 172.21.15.77:0/110178772 wait complete. 2024-04-25T02:00:14.728 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.953+0000 7feeac710700 1 Processor -- start 2024-04-25T02:00:14.728 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.953+0000 7feeac710700 1 -- start start 2024-04-25T02:00:14.728 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.953+0000 7feeac710700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feea4076b20 0x7feea4111610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:14.728 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.953+0000 7feeac710700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea4111b50 con 0x7feea4076b20 2024-04-25T02:00:14.729 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.954+0000 7feeaa4ac700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feea4076b20 0x7feea4111610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:14.729 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.954+0000 7feeaa4ac700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feea4076b20 0x7feea4111610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53216/0 (socket says 172.21.15.77:53216) 2024-04-25T02:00:14.729 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.954+0000 7feeaa4ac700 1 -- 172.21.15.77:0/2013563551 learned_addr learned my addr 172.21.15.77:0/2013563551 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:14.729 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.954+0000 7feeaa4ac700 1 -- 172.21.15.77:0/2013563551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea00094f0 con 0x7feea4076b20 2024-04-25T02:00:14.729 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.954+0000 7feeaa4ac700 1 --2- 172.21.15.77:0/2013563551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feea4076b20 0x7feea4111610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feea0006d40 tx=0x7feea0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:14.729 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.954+0000 7fee9affd700 1 -- 172.21.15.77:0/2013563551 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feea0010840 con 0x7feea4076b20 2024-04-25T02:00:14.729 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.954+0000 7fee9affd700 1 -- 172.21.15.77:0/2013563551 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feea0010e70 con 0x7feea4076b20 2024-04-25T02:00:14.729 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.954+0000 7feeac710700 1 -- 172.21.15.77:0/2013563551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea4111d50 con 0x7feea4076b20 2024-04-25T02:00:14.729 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.954+0000 7fee9affd700 1 -- 172.21.15.77:0/2013563551 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feea0024ea0 con 0x7feea4076b20 2024-04-25T02:00:14.729 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.954+0000 7feeac710700 1 -- 172.21.15.77:0/2013563551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea41128c0 con 0x7feea4076b20 2024-04-25T02:00:14.729 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.955+0000 7fee9affd700 1 -- 172.21.15.77:0/2013563551 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7feea00109a0 con 0x7feea4076b20 2024-04-25T02:00:14.729 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.955+0000 7feeac710700 1 -- 172.21.15.77:0/2013563551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea405f5c0 con 0x7feea4076b20 2024-04-25T02:00:14.729 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.955+0000 7fee9affd700 1 --2- 172.21.15.77:0/2013563551 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fee90036800 0x7fee90038cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:14.729 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.955+0000 7fee9affd700 1 -- 172.21.15.77:0/2013563551 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7feea004a6b0 con 0x7feea4076b20 2024-04-25T02:00:14.730 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.956+0000 7feea9cab700 1 --2- 172.21.15.77:0/2013563551 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fee90036800 0x7fee90038cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:14.730 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.956+0000 7feea9cab700 1 --2- 172.21.15.77:0/2013563551 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fee90036800 0x7fee90038cb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fee94009990 tx=0x7fee94006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:14.730 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:13.960+0000 7fee9affd700 1 -- 172.21.15.77:0/2013563551 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7feea002c910 con 0x7feea4076b20 2024-04-25T02:00:14.730 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:14.165+0000 7feeac710700 1 -- 172.21.15.77:0/2013563551 --> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7feea40fe0b0 con 0x7fee90036800 2024-04-25T02:00:14.730 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:14.169+0000 7fee9affd700 1 -- 172.21.15.77:0/2013563551 <== mgr.14118 v2:172.21.15.77:6800/859750200 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7feea40fe0b0 con 0x7fee90036800 2024-04-25T02:00:14.730 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:14.171+0000 7feeac710700 1 -- 172.21.15.77:0/2013563551 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fee90036800 msgr2=0x7fee90038cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:14.730 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:14.171+0000 7feeac710700 1 --2- 172.21.15.77:0/2013563551 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fee90036800 0x7fee90038cb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fee94009990 tx=0x7fee94006e40 comp rx=0 tx=0).stop 2024-04-25T02:00:14.730 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:14.171+0000 7feeac710700 1 -- 172.21.15.77:0/2013563551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feea4076b20 msgr2=0x7feea4111610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:14.730 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:14.171+0000 7feeac710700 1 --2- 172.21.15.77:0/2013563551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feea4076b20 0x7feea4111610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feea0006d40 tx=0x7feea0009250 comp rx=0 tx=0).stop 2024-04-25T02:00:14.730 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:14.171+0000 7feeac710700 1 -- 172.21.15.77:0/2013563551 shutdown_connections 2024-04-25T02:00:14.730 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:14.171+0000 7feeac710700 1 --2- 172.21.15.77:0/2013563551 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fee90036800 0x7fee90038cb0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:14.730 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:14.171+0000 7feeac710700 1 --2- 172.21.15.77:0/2013563551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feea4076b20 0x7feea4111610 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:14.730 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:14.171+0000 7feeac710700 1 -- 172.21.15.77:0/2013563551 >> 172.21.15.77:0/2013563551 conn(0x7feea40fcef0 msgr2=0x7feea40fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:14.730 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:14.171+0000 7feeac710700 1 -- 172.21.15.77:0/2013563551 shutdown_connections 2024-04-25T02:00:14.731 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:14.171+0000 7feeac710700 1 -- 172.21.15.77:0/2013563551 wait complete. 2024-04-25T02:00:15.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:15 smithi077 ceph-mon[26330]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:00:15.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:15 smithi077 ceph-mon[26330]: Saving service alertmanager spec with placement count:1 2024-04-25T02:00:15.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:15 smithi077 ceph-mon[26330]: from='mgr.14118 172.21.15.77:0/133294390' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:15.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:15 smithi077 ceph-mon[26330]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:15.959 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.149+0000 7f139563d700 1 Processor -- start 2024-04-25T02:00:15.959 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.149+0000 7f139563d700 1 -- start start 2024-04-25T02:00:15.959 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.149+0000 7f139563d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1390102880 0x7f1390102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:15.959 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.149+0000 7f139563d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13901031d0 con 0x7f1390102880 2024-04-25T02:00:15.959 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.149+0000 7f138effd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1390102880 0x7f1390102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:15.959 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.149+0000 7f138effd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1390102880 0x7f1390102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53220/0 (socket says 172.21.15.77:53220) 2024-04-25T02:00:15.959 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.149+0000 7f138effd700 1 -- 172.21.15.77:0/39030987 learned_addr learned my addr 172.21.15.77:0/39030987 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:15.959 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.150+0000 7f138effd700 1 -- 172.21.15.77:0/39030987 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1390103310 con 0x7f1390102880 2024-04-25T02:00:15.959 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.150+0000 7f138effd700 1 --2- 172.21.15.77:0/39030987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1390102880 0x7f1390102c90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f13800098e0 tx=0x7f1380009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1861419550acd060 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:15.959 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.150+0000 7f138e7fc700 1 -- 172.21.15.77:0/39030987 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f138000b860 con 0x7f1390102880 2024-04-25T02:00:15.960 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.150+0000 7f138e7fc700 1 -- 172.21.15.77:0/39030987 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f138000be90 con 0x7f1390102880 2024-04-25T02:00:15.960 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.150+0000 7f138e7fc700 1 -- 172.21.15.77:0/39030987 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f13800103c0 con 0x7f1390102880 2024-04-25T02:00:15.960 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.150+0000 7f139563d700 1 -- 172.21.15.77:0/39030987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1390102880 msgr2=0x7f1390102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:15.960 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.150+0000 7f139563d700 1 --2- 172.21.15.77:0/39030987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1390102880 0x7f1390102c90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f13800098e0 tx=0x7f1380009250 comp rx=0 tx=0).stop 2024-04-25T02:00:15.960 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.151+0000 7f139563d700 1 -- 172.21.15.77:0/39030987 shutdown_connections 2024-04-25T02:00:15.960 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.151+0000 7f139563d700 1 --2- 172.21.15.77:0/39030987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1390102880 0x7f1390102c90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:15.960 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.151+0000 7f139563d700 1 -- 172.21.15.77:0/39030987 >> 172.21.15.77:0/39030987 conn(0x7f13900fe060 msgr2=0x7f1390100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:15.960 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.151+0000 7f139563d700 1 -- 172.21.15.77:0/39030987 shutdown_connections 2024-04-25T02:00:15.960 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.151+0000 7f139563d700 1 -- 172.21.15.77:0/39030987 wait complete. 2024-04-25T02:00:15.960 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.151+0000 7f139563d700 1 Processor -- start 2024-04-25T02:00:15.960 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.151+0000 7f139563d700 1 -- start start 2024-04-25T02:00:15.960 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.152+0000 7f139563d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1390102880 0x7f13901115c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:15.960 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.152+0000 7f139563d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1390111b00 con 0x7f1390102880 2024-04-25T02:00:15.960 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.152+0000 7f138effd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1390102880 0x7f13901115c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:15.960 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.152+0000 7f138effd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1390102880 0x7f13901115c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53228/0 (socket says 172.21.15.77:53228) 2024-04-25T02:00:15.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.152+0000 7f138effd700 1 -- 172.21.15.77:0/2043699917 learned_addr learned my addr 172.21.15.77:0/2043699917 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:15.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.152+0000 7f138effd700 1 -- 172.21.15.77:0/2043699917 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13800094f0 con 0x7f1390102880 2024-04-25T02:00:15.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.152+0000 7f138effd700 1 --2- 172.21.15.77:0/2043699917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1390102880 0x7f13901115c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f13800090b0 tx=0x7f1380009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:15.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.152+0000 7f1387fff700 1 -- 172.21.15.77:0/2043699917 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1380010840 con 0x7f1390102880 2024-04-25T02:00:15.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.152+0000 7f139563d700 1 -- 172.21.15.77:0/2043699917 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1390111d00 con 0x7f1390102880 2024-04-25T02:00:15.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.152+0000 7f1387fff700 1 -- 172.21.15.77:0/2043699917 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1380010e70 con 0x7f1390102880 2024-04-25T02:00:15.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.152+0000 7f1387fff700 1 -- 172.21.15.77:0/2043699917 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1380024e40 con 0x7f1390102880 2024-04-25T02:00:15.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.152+0000 7f139563d700 1 -- 172.21.15.77:0/2043699917 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1390112870 con 0x7f1390102880 2024-04-25T02:00:15.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.153+0000 7f1387fff700 1 -- 172.21.15.77:0/2043699917 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f138001a510 con 0x7f1390102880 2024-04-25T02:00:15.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.153+0000 7f1387fff700 1 --2- 172.21.15.77:0/2043699917 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f137c036800 0x7f137c038cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:15.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.153+0000 7f139563d700 1 -- 172.21.15.77:0/2043699917 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f139005f5c0 con 0x7f1390102880 2024-04-25T02:00:15.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.153+0000 7f1387fff700 1 -- 172.21.15.77:0/2043699917 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f138004a860 con 0x7f1390102880 2024-04-25T02:00:15.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.153+0000 7f13867fc700 1 --2- 172.21.15.77:0/2043699917 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f137c036800 0x7f137c038cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:15.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.154+0000 7f13867fc700 1 --2- 172.21.15.77:0/2043699917 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f137c036800 0x7f137c038cb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1378009990 tx=0x7f1378006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:15.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.158+0000 7f1387fff700 1 -- 172.21.15.77:0/2043699917 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1380018710 con 0x7f1390102880 2024-04-25T02:00:15.962 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.342+0000 7f139563d700 1 -- 172.21.15.77:0/2043699917 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f139004bed0 con 0x7f1390102880 2024-04-25T02:00:15.962 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.348+0000 7f1387fff700 1 -- 172.21.15.77:0/2043699917 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f1380018350 con 0x7f1390102880 2024-04-25T02:00:15.962 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.350+0000 7f139563d700 1 -- 172.21.15.77:0/2043699917 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f137c036800 msgr2=0x7f137c038cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:15.962 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.350+0000 7f139563d700 1 --2- 172.21.15.77:0/2043699917 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f137c036800 0x7f137c038cb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1378009990 tx=0x7f1378006e40 comp rx=0 tx=0).stop 2024-04-25T02:00:15.962 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.350+0000 7f139563d700 1 -- 172.21.15.77:0/2043699917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1390102880 msgr2=0x7f13901115c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:15.962 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.350+0000 7f139563d700 1 --2- 172.21.15.77:0/2043699917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1390102880 0x7f13901115c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f13800090b0 tx=0x7f1380009250 comp rx=0 tx=0).stop 2024-04-25T02:00:15.962 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.350+0000 7f139563d700 1 -- 172.21.15.77:0/2043699917 shutdown_connections 2024-04-25T02:00:15.962 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.350+0000 7f139563d700 1 --2- 172.21.15.77:0/2043699917 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f137c036800 0x7f137c038cb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:15.962 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.350+0000 7f139563d700 1 --2- 172.21.15.77:0/2043699917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1390102880 0x7f13901115c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:15.963 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.350+0000 7f139563d700 1 -- 172.21.15.77:0/2043699917 >> 172.21.15.77:0/2043699917 conn(0x7f13900fe060 msgr2=0x7f13900feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:15.963 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.350+0000 7f139563d700 1 -- 172.21.15.77:0/2043699917 shutdown_connections 2024-04-25T02:00:15.963 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:15.351+0000 7f139563d700 1 -- 172.21.15.77:0/2043699917 wait complete. 2024-04-25T02:00:16.592 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:16 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/2043699917' entity='client.admin' 2024-04-25T02:00:17.181 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.392+0000 7fc2ae076700 1 Processor -- start 2024-04-25T02:00:17.181 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.392+0000 7fc2ae076700 1 -- start start 2024-04-25T02:00:17.181 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.392+0000 7fc2ae076700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2a8078c30 0x7fc2a8077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:17.181 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.393+0000 7fc2ae076700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a8079040 con 0x7fc2a8078c30 2024-04-25T02:00:17.181 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.393+0000 7fc2a77fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2a8078c30 0x7fc2a8077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:17.181 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.393+0000 7fc2a77fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2a8078c30 0x7fc2a8077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53232/0 (socket says 172.21.15.77:53232) 2024-04-25T02:00:17.181 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.393+0000 7fc2a77fe700 1 -- 172.21.15.77:0/3157788117 learned_addr learned my addr 172.21.15.77:0/3157788117 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:17.181 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.393+0000 7fc2a77fe700 1 -- 172.21.15.77:0/3157788117 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a8077770 con 0x7fc2a8078c30 2024-04-25T02:00:17.181 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.393+0000 7fc2a77fe700 1 --2- 172.21.15.77:0/3157788117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2a8078c30 0x7fc2a8077230 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc2980098e0 tx=0x7fc298009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c36e4e8df3c8ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:17.182 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.393+0000 7fc2a67fc700 1 -- 172.21.15.77:0/3157788117 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc29800b860 con 0x7fc2a8078c30 2024-04-25T02:00:17.182 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.393+0000 7fc2a67fc700 1 -- 172.21.15.77:0/3157788117 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc29800be90 con 0x7fc2a8078c30 2024-04-25T02:00:17.182 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.393+0000 7fc2a67fc700 1 -- 172.21.15.77:0/3157788117 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc2980103c0 con 0x7fc2a8078c30 2024-04-25T02:00:17.182 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.394+0000 7fc2ae076700 1 -- 172.21.15.77:0/3157788117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2a8078c30 msgr2=0x7fc2a8077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:17.182 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.394+0000 7fc2ae076700 1 --2- 172.21.15.77:0/3157788117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2a8078c30 0x7fc2a8077230 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc2980098e0 tx=0x7fc298009250 comp rx=0 tx=0).stop 2024-04-25T02:00:17.182 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.394+0000 7fc2ae076700 1 -- 172.21.15.77:0/3157788117 shutdown_connections 2024-04-25T02:00:17.182 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.394+0000 7fc2ae076700 1 --2- 172.21.15.77:0/3157788117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2a8078c30 0x7fc2a8077230 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:17.182 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.394+0000 7fc2ae076700 1 -- 172.21.15.77:0/3157788117 >> 172.21.15.77:0/3157788117 conn(0x7fc2a80fe030 msgr2=0x7fc2a8100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:17.182 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.394+0000 7fc2ae076700 1 -- 172.21.15.77:0/3157788117 shutdown_connections 2024-04-25T02:00:17.182 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.394+0000 7fc2ae076700 1 -- 172.21.15.77:0/3157788117 wait complete. 2024-04-25T02:00:17.182 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.395+0000 7fc2ae076700 1 Processor -- start 2024-04-25T02:00:17.182 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.395+0000 7fc2ae076700 1 -- start start 2024-04-25T02:00:17.182 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.395+0000 7fc2ae076700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2a8078c30 0x7fc2a8113800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:17.182 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.395+0000 7fc2ae076700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a8113d40 con 0x7fc2a8078c30 2024-04-25T02:00:17.183 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.395+0000 7fc2a77fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2a8078c30 0x7fc2a8113800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:17.183 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.395+0000 7fc2a77fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2a8078c30 0x7fc2a8113800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53236/0 (socket says 172.21.15.77:53236) 2024-04-25T02:00:17.183 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.395+0000 7fc2a77fe700 1 -- 172.21.15.77:0/601714243 learned_addr learned my addr 172.21.15.77:0/601714243 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:17.183 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.395+0000 7fc2a77fe700 1 -- 172.21.15.77:0/601714243 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2980094f0 con 0x7fc2a8078c30 2024-04-25T02:00:17.183 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.395+0000 7fc2a77fe700 1 --2- 172.21.15.77:0/601714243 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2a8078c30 0x7fc2a8113800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc298006d40 tx=0x7fc298009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:17.183 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.395+0000 7fc29ffff700 1 -- 172.21.15.77:0/601714243 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc298010840 con 0x7fc2a8078c30 2024-04-25T02:00:17.183 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.396+0000 7fc2ae076700 1 -- 172.21.15.77:0/601714243 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a8113f40 con 0x7fc2a8078c30 2024-04-25T02:00:17.183 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.396+0000 7fc29ffff700 1 -- 172.21.15.77:0/601714243 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc298010e70 con 0x7fc2a8078c30 2024-04-25T02:00:17.183 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.396+0000 7fc29ffff700 1 -- 172.21.15.77:0/601714243 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc298024ea0 con 0x7fc2a8078c30 2024-04-25T02:00:17.183 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.396+0000 7fc2ae076700 1 -- 172.21.15.77:0/601714243 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a8114ab0 con 0x7fc2a8078c30 2024-04-25T02:00:17.183 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.396+0000 7fc29ffff700 1 -- 172.21.15.77:0/601714243 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fc29801a510 con 0x7fc2a8078c30 2024-04-25T02:00:17.184 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.396+0000 7fc2ae076700 1 -- 172.21.15.77:0/601714243 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a805f5c0 con 0x7fc2a8078c30 2024-04-25T02:00:17.184 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.397+0000 7fc29ffff700 1 --2- 172.21.15.77:0/601714243 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fc294036800 0x7fc294038cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:17.184 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.397+0000 7fc29ffff700 1 -- 172.21.15.77:0/601714243 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc29804a710 con 0x7fc2a8078c30 2024-04-25T02:00:17.184 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.397+0000 7fc2a6ffd700 1 --2- 172.21.15.77:0/601714243 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fc294036800 0x7fc294038cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:17.184 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.397+0000 7fc2a6ffd700 1 --2- 172.21.15.77:0/601714243 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fc294036800 0x7fc294038cb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc290009990 tx=0x7fc290006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:17.184 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.401+0000 7fc29ffff700 1 -- 172.21.15.77:0/601714243 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc298018940 con 0x7fc2a8078c30 2024-04-25T02:00:17.184 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.588+0000 7fc2ae076700 1 -- 172.21.15.77:0/601714243 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fc2a804bed0 con 0x7fc2a8078c30 2024-04-25T02:00:17.184 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.593+0000 7fc29ffff700 1 -- 172.21.15.77:0/601714243 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fc29804a0d0 con 0x7fc2a8078c30 2024-04-25T02:00:17.184 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.596+0000 7fc2ae076700 1 -- 172.21.15.77:0/601714243 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fc294036800 msgr2=0x7fc294038cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:17.184 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.596+0000 7fc2ae076700 1 --2- 172.21.15.77:0/601714243 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fc294036800 0x7fc294038cb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc290009990 tx=0x7fc290006e40 comp rx=0 tx=0).stop 2024-04-25T02:00:17.184 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.596+0000 7fc2ae076700 1 -- 172.21.15.77:0/601714243 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2a8078c30 msgr2=0x7fc2a8113800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:17.185 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.596+0000 7fc2ae076700 1 --2- 172.21.15.77:0/601714243 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2a8078c30 0x7fc2a8113800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc298006d40 tx=0x7fc298009250 comp rx=0 tx=0).stop 2024-04-25T02:00:17.185 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.596+0000 7fc2ae076700 1 -- 172.21.15.77:0/601714243 shutdown_connections 2024-04-25T02:00:17.185 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.596+0000 7fc2ae076700 1 --2- 172.21.15.77:0/601714243 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fc294036800 0x7fc294038cb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:17.185 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.596+0000 7fc2ae076700 1 --2- 172.21.15.77:0/601714243 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2a8078c30 0x7fc2a8113800 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:17.185 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.596+0000 7fc2ae076700 1 -- 172.21.15.77:0/601714243 >> 172.21.15.77:0/601714243 conn(0x7fc2a80fe030 msgr2=0x7fc2a80feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:17.185 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.596+0000 7fc2ae076700 1 -- 172.21.15.77:0/601714243 shutdown_connections 2024-04-25T02:00:17.185 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:16.596+0000 7fc2ae076700 1 -- 172.21.15.77:0/601714243 wait complete. 2024-04-25T02:00:17.185 INFO:teuthology.orchestra.run.smithi077.stdout:Enabling the dashboard module... 2024-04-25T02:00:17.840 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:17 smithi077 ceph-mon[26330]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:17.840 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:17 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/601714243' entity='client.admin' 2024-04-25T02:00:18.920 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:18 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/2730915715' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-25T02:00:19.218 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.590+0000 7f48627d7700 1 Processor -- start 2024-04-25T02:00:19.218 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.590+0000 7f48627d7700 1 -- start start 2024-04-25T02:00:19.219 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.590+0000 7f48627d7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f485c076c10 0x7f485c105440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:19.219 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.590+0000 7f48627d7700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c105980 con 0x7f485c076c10 2024-04-25T02:00:19.219 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.590+0000 7f485bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f485c076c10 0x7f485c105440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:19.219 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.590+0000 7f485bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f485c076c10 0x7f485c105440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48134/0 (socket says 172.21.15.77:48134) 2024-04-25T02:00:19.219 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.590+0000 7f485bfff700 1 -- 172.21.15.77:0/1434044651 learned_addr learned my addr 172.21.15.77:0/1434044651 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:19.219 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.590+0000 7f485bfff700 1 -- 172.21.15.77:0/1434044651 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485c105ac0 con 0x7f485c076c10 2024-04-25T02:00:19.220 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.590+0000 7f485bfff700 1 --2- 172.21.15.77:0/1434044651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f485c076c10 0x7f485c105440 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f484c0098e0 tx=0x7f484c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dde722f56bffc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:19.220 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.591+0000 7f485affd700 1 -- 172.21.15.77:0/1434044651 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f484c00b860 con 0x7f485c076c10 2024-04-25T02:00:19.220 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.591+0000 7f485affd700 1 -- 172.21.15.77:0/1434044651 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f484c00be90 con 0x7f485c076c10 2024-04-25T02:00:19.220 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.591+0000 7f485affd700 1 -- 172.21.15.77:0/1434044651 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f484c0103c0 con 0x7f485c076c10 2024-04-25T02:00:19.220 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.591+0000 7f48627d7700 1 -- 172.21.15.77:0/1434044651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f485c076c10 msgr2=0x7f485c105440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:19.221 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.591+0000 7f48627d7700 1 --2- 172.21.15.77:0/1434044651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f485c076c10 0x7f485c105440 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f484c0098e0 tx=0x7f484c009250 comp rx=0 tx=0).stop 2024-04-25T02:00:19.221 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.591+0000 7f48627d7700 1 -- 172.21.15.77:0/1434044651 shutdown_connections 2024-04-25T02:00:19.221 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.591+0000 7f48627d7700 1 --2- 172.21.15.77:0/1434044651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f485c076c10 0x7f485c105440 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:19.221 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.591+0000 7f48627d7700 1 -- 172.21.15.77:0/1434044651 >> 172.21.15.77:0/1434044651 conn(0x7f485c0fcef0 msgr2=0x7f485c0ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:19.221 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.591+0000 7f48627d7700 1 -- 172.21.15.77:0/1434044651 shutdown_connections 2024-04-25T02:00:19.221 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.591+0000 7f48627d7700 1 -- 172.21.15.77:0/1434044651 wait complete. 2024-04-25T02:00:19.222 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.592+0000 7f48627d7700 1 Processor -- start 2024-04-25T02:00:19.222 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.592+0000 7f48627d7700 1 -- start start 2024-04-25T02:00:19.222 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.592+0000 7f48627d7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f485c076c10 0x7f485c1115d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:19.222 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.592+0000 7f48627d7700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c111b10 con 0x7f485c076c10 2024-04-25T02:00:19.222 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.592+0000 7f485bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f485c076c10 0x7f485c1115d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:19.223 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.592+0000 7f485bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f485c076c10 0x7f485c1115d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48136/0 (socket says 172.21.15.77:48136) 2024-04-25T02:00:19.223 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.592+0000 7f485bfff700 1 -- 172.21.15.77:0/2730915715 learned_addr learned my addr 172.21.15.77:0/2730915715 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:19.223 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.592+0000 7f485bfff700 1 -- 172.21.15.77:0/2730915715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484c0094f0 con 0x7f485c076c10 2024-04-25T02:00:19.223 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.593+0000 7f485bfff700 1 --2- 172.21.15.77:0/2730915715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f485c076c10 0x7f485c1115d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f484c0094c0 tx=0x7f484c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:19.223 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.593+0000 7f4858ff9700 1 -- 172.21.15.77:0/2730915715 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f484c010890 con 0x7f485c076c10 2024-04-25T02:00:19.223 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.593+0000 7f4858ff9700 1 -- 172.21.15.77:0/2730915715 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f484c010ec0 con 0x7f485c076c10 2024-04-25T02:00:19.224 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.593+0000 7f4858ff9700 1 -- 172.21.15.77:0/2730915715 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f484c01aea0 con 0x7f485c076c10 2024-04-25T02:00:19.224 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.593+0000 7f48627d7700 1 -- 172.21.15.77:0/2730915715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f485c111d70 con 0x7f485c076c10 2024-04-25T02:00:19.224 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.593+0000 7f48627d7700 1 -- 172.21.15.77:0/2730915715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f485c112880 con 0x7f485c076c10 2024-04-25T02:00:19.224 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.594+0000 7f4858ff9700 1 -- 172.21.15.77:0/2730915715 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f484c02d3f0 con 0x7f485c076c10 2024-04-25T02:00:19.224 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.594+0000 7f48627d7700 1 -- 172.21.15.77:0/2730915715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f485c05f5c0 con 0x7f485c076c10 2024-04-25T02:00:19.224 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.594+0000 7f4858ff9700 1 --2- 172.21.15.77:0/2730915715 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f48440368a0 0x7f4844038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:19.225 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.594+0000 7f4858ff9700 1 -- 172.21.15.77:0/2730915715 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f484c04a1d0 con 0x7f485c076c10 2024-04-25T02:00:19.225 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.594+0000 7f485b7fe700 1 --2- 172.21.15.77:0/2730915715 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f48440368a0 0x7f4844038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:19.225 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.594+0000 7f485b7fe700 1 --2- 172.21.15.77:0/2730915715 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f48440368a0 0x7f4844038d50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4850009990 tx=0x7f4850006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:19.225 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.598+0000 7f4858ff9700 1 -- 172.21.15.77:0/2730915715 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f484c02b8e0 con 0x7f485c076c10 2024-04-25T02:00:19.225 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:17.835+0000 7f48627d7700 1 -- 172.21.15.77:0/2730915715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f485c04bed0 con 0x7f485c076c10 2024-04-25T02:00:19.225 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:18.606+0000 7f4858ff9700 1 -- 172.21.15.77:0/2730915715 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f484c01a430 con 0x7f485c076c10 2024-04-25T02:00:19.226 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:18.608+0000 7f4858ff9700 1 -- 172.21.15.77:0/2730915715 <== mon.0 v2:172.21.15.77:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f484c018a60 con 0x7f485c076c10 2024-04-25T02:00:19.226 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:18.611+0000 7f48627d7700 1 -- 172.21.15.77:0/2730915715 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f48440368a0 msgr2=0x7f4844038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:19.226 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:18.611+0000 7f48627d7700 1 --2- 172.21.15.77:0/2730915715 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f48440368a0 0x7f4844038d50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4850009990 tx=0x7f4850006e40 comp rx=0 tx=0).stop 2024-04-25T02:00:19.226 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:18.611+0000 7f48627d7700 1 -- 172.21.15.77:0/2730915715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f485c076c10 msgr2=0x7f485c1115d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:19.226 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:18.611+0000 7f48627d7700 1 --2- 172.21.15.77:0/2730915715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f485c076c10 0x7f485c1115d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f484c0094c0 tx=0x7f484c009250 comp rx=0 tx=0).stop 2024-04-25T02:00:19.227 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:18.611+0000 7f48627d7700 1 -- 172.21.15.77:0/2730915715 shutdown_connections 2024-04-25T02:00:19.227 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:18.611+0000 7f48627d7700 1 --2- 172.21.15.77:0/2730915715 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f48440368a0 0x7f4844038d50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:19.227 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:18.611+0000 7f48627d7700 1 --2- 172.21.15.77:0/2730915715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f485c076c10 0x7f485c1115d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:19.227 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:18.611+0000 7f48627d7700 1 -- 172.21.15.77:0/2730915715 >> 172.21.15.77:0/2730915715 conn(0x7f485c0fcef0 msgr2=0x7f485c0fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:19.227 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:18.611+0000 7f48627d7700 1 -- 172.21.15.77:0/2730915715 shutdown_connections 2024-04-25T02:00:19.227 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:18.611+0000 7f48627d7700 1 -- 172.21.15.77:0/2730915715 wait complete. 2024-04-25T02:00:19.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:19 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/2730915715' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-25T02:00:19.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:19 smithi077 ceph-mon[26330]: mgrmap e9: smithi077.zpflzp(active, since 24s) 2024-04-25T02:00:20.511 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout { 2024-04-25T02:00:20.511 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-25T02:00:20.511 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-25T02:00:20.511 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "active_name": "smithi077.zpflzp", 2024-04-25T02:00:20.511 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-25T02:00:20.511 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout } 2024-04-25T02:00:20.511 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.643+0000 7fdeb5e10700 1 Processor -- start 2024-04-25T02:00:20.511 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.643+0000 7fdeb5e10700 1 -- start start 2024-04-25T02:00:20.511 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.643+0000 7fdeb5e10700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdeb0078cc0 0x7fdeb0077270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:20.512 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.643+0000 7fdeb5e10700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb00790d0 con 0x7fdeb0078cc0 2024-04-25T02:00:20.512 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.643+0000 7fdeaf7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdeb0078cc0 0x7fdeb0077270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:20.512 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.643+0000 7fdeaf7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdeb0078cc0 0x7fdeb0077270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48156/0 (socket says 172.21.15.77:48156) 2024-04-25T02:00:20.512 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.643+0000 7fdeaf7fe700 1 -- 172.21.15.77:0/368840833 learned_addr learned my addr 172.21.15.77:0/368840833 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:20.512 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.643+0000 7fdeaf7fe700 1 -- 172.21.15.77:0/368840833 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb00777b0 con 0x7fdeb0078cc0 2024-04-25T02:00:20.512 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.644+0000 7fdeaf7fe700 1 --2- 172.21.15.77:0/368840833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdeb0078cc0 0x7fdeb0077270 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdea00098e0 tx=0x7fdea0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608854fc2ae7301b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:20.512 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.644+0000 7fdeae7fc700 1 -- 172.21.15.77:0/368840833 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdea000b860 con 0x7fdeb0078cc0 2024-04-25T02:00:20.512 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.644+0000 7fdeae7fc700 1 -- 172.21.15.77:0/368840833 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdea000be90 con 0x7fdeb0078cc0 2024-04-25T02:00:20.512 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.644+0000 7fdeae7fc700 1 -- 172.21.15.77:0/368840833 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdea00103c0 con 0x7fdeb0078cc0 2024-04-25T02:00:20.513 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.644+0000 7fdeb5e10700 1 -- 172.21.15.77:0/368840833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdeb0078cc0 msgr2=0x7fdeb0077270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:20.513 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.644+0000 7fdeb5e10700 1 --2- 172.21.15.77:0/368840833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdeb0078cc0 0x7fdeb0077270 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdea00098e0 tx=0x7fdea0009250 comp rx=0 tx=0).stop 2024-04-25T02:00:20.513 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.644+0000 7fdeb5e10700 1 -- 172.21.15.77:0/368840833 shutdown_connections 2024-04-25T02:00:20.513 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.644+0000 7fdeb5e10700 1 --2- 172.21.15.77:0/368840833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdeb0078cc0 0x7fdeb0077270 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:20.513 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.644+0000 7fdeb5e10700 1 -- 172.21.15.77:0/368840833 >> 172.21.15.77:0/368840833 conn(0x7fdeb00fe030 msgr2=0x7fdeb0100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:20.513 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.644+0000 7fdeb5e10700 1 -- 172.21.15.77:0/368840833 shutdown_connections 2024-04-25T02:00:20.513 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.645+0000 7fdeb5e10700 1 -- 172.21.15.77:0/368840833 wait complete. 2024-04-25T02:00:20.513 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.645+0000 7fdeb5e10700 1 Processor -- start 2024-04-25T02:00:20.513 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.645+0000 7fdeb5e10700 1 -- start start 2024-04-25T02:00:20.513 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.645+0000 7fdeb5e10700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdeb0078cc0 0x7fdeb01137f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:20.513 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.645+0000 7fdeb5e10700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb0113d30 con 0x7fdeb0078cc0 2024-04-25T02:00:20.513 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.645+0000 7fdeaf7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdeb0078cc0 0x7fdeb01137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:20.513 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.646+0000 7fdeaf7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdeb0078cc0 0x7fdeb01137f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48164/0 (socket says 172.21.15.77:48164) 2024-04-25T02:00:20.513 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.646+0000 7fdeaf7fe700 1 -- 172.21.15.77:0/1363180224 learned_addr learned my addr 172.21.15.77:0/1363180224 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:20.513 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.646+0000 7fdeaf7fe700 1 -- 172.21.15.77:0/1363180224 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea00094f0 con 0x7fdeb0078cc0 2024-04-25T02:00:20.514 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.646+0000 7fdeaf7fe700 1 --2- 172.21.15.77:0/1363180224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdeb0078cc0 0x7fdeb01137f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdea00094c0 tx=0x7fdea0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:20.514 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.646+0000 7fde97fff700 1 -- 172.21.15.77:0/1363180224 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdea0010890 con 0x7fdeb0078cc0 2024-04-25T02:00:20.514 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.646+0000 7fde97fff700 1 -- 172.21.15.77:0/1363180224 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdea0010ec0 con 0x7fdeb0078cc0 2024-04-25T02:00:20.514 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.646+0000 7fdeb5e10700 1 -- 172.21.15.77:0/1363180224 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb0113f30 con 0x7fdeb0078cc0 2024-04-25T02:00:20.514 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.646+0000 7fde97fff700 1 -- 172.21.15.77:0/1363180224 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdea00243f0 con 0x7fdeb0078cc0 2024-04-25T02:00:20.514 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.646+0000 7fdeb5e10700 1 -- 172.21.15.77:0/1363180224 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb0114aa0 con 0x7fdeb0078cc0 2024-04-25T02:00:20.514 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.647+0000 7fdeb5e10700 1 -- 172.21.15.77:0/1363180224 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb005f5c0 con 0x7fdeb0078cc0 2024-04-25T02:00:20.514 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.647+0000 7fde97fff700 1 -- 172.21.15.77:0/1363180224 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7fdea002d3f0 con 0x7fdeb0078cc0 2024-04-25T02:00:20.514 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.647+0000 7fde97fff700 1 --2- 172.21.15.77:0/1363180224 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fde980368a0 0x7fde98038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:20.514 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.647+0000 7fde97fff700 1 -- 172.21.15.77:0/1363180224 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fdea004a2d0 con 0x7fdeb0078cc0 2024-04-25T02:00:20.514 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.647+0000 7fdeaeffd700 1 -- 172.21.15.77:0/1363180224 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fde980368a0 msgr2=0x7fde98038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/859750200 2024-04-25T02:00:20.514 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.647+0000 7fdeaeffd700 1 --2- 172.21.15.77:0/1363180224 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fde980368a0 0x7fde98038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:00:20.514 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.652+0000 7fde97fff700 1 -- 172.21.15.77:0/1363180224 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fdea002b8e0 con 0x7fdeb0078cc0 2024-04-25T02:00:20.515 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.848+0000 7fdeaeffd700 1 -- 172.21.15.77:0/1363180224 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fde980368a0 msgr2=0x7fde98038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/859750200 2024-04-25T02:00:20.515 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.848+0000 7fdeaeffd700 1 --2- 172.21.15.77:0/1363180224 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fde980368a0 0x7fde98038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T02:00:20.515 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.931+0000 7fdeb5e10700 1 -- 172.21.15.77:0/1363180224 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fdeb0114e40 con 0x7fdeb0078cc0 2024-04-25T02:00:20.515 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.932+0000 7fde97fff700 1 -- 172.21.15.77:0/1363180224 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7fdea002b2f0 con 0x7fdeb0078cc0 2024-04-25T02:00:20.515 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.934+0000 7fdeb5e10700 1 -- 172.21.15.77:0/1363180224 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fde980368a0 msgr2=0x7fde98038d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:00:20.515 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.934+0000 7fdeb5e10700 1 --2- 172.21.15.77:0/1363180224 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fde980368a0 0x7fde98038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:20.515 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.934+0000 7fdeb5e10700 1 -- 172.21.15.77:0/1363180224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdeb0078cc0 msgr2=0x7fdeb01137f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:20.515 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.934+0000 7fdeb5e10700 1 --2- 172.21.15.77:0/1363180224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdeb0078cc0 0x7fdeb01137f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdea00094c0 tx=0x7fdea0009250 comp rx=0 tx=0).stop 2024-04-25T02:00:20.515 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.934+0000 7fdeb5e10700 1 -- 172.21.15.77:0/1363180224 shutdown_connections 2024-04-25T02:00:20.515 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.934+0000 7fdeb5e10700 1 --2- 172.21.15.77:0/1363180224 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7fde980368a0 0x7fde98038d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:20.515 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.934+0000 7fdeb5e10700 1 --2- 172.21.15.77:0/1363180224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdeb0078cc0 0x7fdeb01137f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:20.515 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.934+0000 7fdeb5e10700 1 -- 172.21.15.77:0/1363180224 >> 172.21.15.77:0/1363180224 conn(0x7fdeb00fe030 msgr2=0x7fdeb00feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:20.515 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.934+0000 7fdeb5e10700 1 -- 172.21.15.77:0/1363180224 shutdown_connections 2024-04-25T02:00:20.515 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:19.935+0000 7fdeb5e10700 1 -- 172.21.15.77:0/1363180224 wait complete. 2024-04-25T02:00:20.516 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for the mgr to restart... 2024-04-25T02:00:20.516 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for mgr epoch 9... 2024-04-25T02:00:20.761 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:20 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/1363180224' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-25T02:00:25.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:25 smithi077 ceph-mon[26330]: Active manager daemon smithi077.zpflzp restarted 2024-04-25T02:00:25.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:25 smithi077 ceph-mon[26330]: Activating manager daemon smithi077.zpflzp 2024-04-25T02:00:25.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:25 smithi077 ceph-mon[26330]: osdmap e3: 0 total, 0 up, 0 in 2024-04-25T02:00:25.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:25 smithi077 ceph-mon[26330]: mgrmap e10: smithi077.zpflzp(active, starting, since 0.0032288s) 2024-04-25T02:00:25.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:25 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-04-25T02:00:25.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:25 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr metadata", "who": "smithi077.zpflzp", "id": "smithi077.zpflzp"}]: dispatch 2024-04-25T02:00:25.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:25 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T02:00:25.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:25 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T02:00:25.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:25 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T02:00:25.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:25 smithi077 ceph-mon[26330]: Manager daemon smithi077.zpflzp is now available 2024-04-25T02:00:25.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:25 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:00:25.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:25 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:00:25.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:25 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.zpflzp/mirror_snapshot_schedule"}]: dispatch 2024-04-25T02:00:25.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:25 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.zpflzp/trash_purge_schedule"}]: dispatch 2024-04-25T02:00:26.670 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:26 smithi077 ceph-mon[26330]: [25/Apr/2024:02:00:25] ENGINE Bus STARTING 2024-04-25T02:00:26.670 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:26 smithi077 ceph-mon[26330]: [25/Apr/2024:02:00:25] ENGINE Serving on https://172.21.15.77:7150 2024-04-25T02:00:26.670 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:26 smithi077 ceph-mon[26330]: [25/Apr/2024:02:00:25] ENGINE Bus STARTED 2024-04-25T02:00:26.670 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:26 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:26.670 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:26 smithi077 ceph-mon[26330]: mgrmap e11: smithi077.zpflzp(active, since 1.0059s) 2024-04-25T02:00:26.680 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout { 2024-04-25T02:00:26.680 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-25T02:00:26.680 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-25T02:00:26.680 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout } 2024-04-25T02:00:26.680 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.951+0000 7f226af3c700 1 Processor -- start 2024-04-25T02:00:26.680 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.951+0000 7f226af3c700 1 -- start start 2024-04-25T02:00:26.680 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.951+0000 7f226af3c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2264076c10 0x7f2264105440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:26.680 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.951+0000 7f226af3c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2264105980 con 0x7f2264076c10 2024-04-25T02:00:26.680 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.951+0000 7f2268cd8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2264076c10 0x7f2264105440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:26.680 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.951+0000 7f2268cd8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2264076c10 0x7f2264105440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48178/0 (socket says 172.21.15.77:48178) 2024-04-25T02:00:26.681 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.951+0000 7f2268cd8700 1 -- 172.21.15.77:0/2865354238 learned_addr learned my addr 172.21.15.77:0/2865354238 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:26.681 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.951+0000 7f2268cd8700 1 -- 172.21.15.77:0/2865354238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2264105ac0 con 0x7f2264076c10 2024-04-25T02:00:26.681 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.952+0000 7f2268cd8700 1 --2- 172.21.15.77:0/2865354238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2264076c10 0x7f2264105440 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f22580098e0 tx=0x7f2258009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15623d46f3c1631c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:26.681 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.952+0000 7f22637fe700 1 -- 172.21.15.77:0/2865354238 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f225800b860 con 0x7f2264076c10 2024-04-25T02:00:26.681 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.952+0000 7f22637fe700 1 -- 172.21.15.77:0/2865354238 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f225800be90 con 0x7f2264076c10 2024-04-25T02:00:26.681 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.952+0000 7f22637fe700 1 -- 172.21.15.77:0/2865354238 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22580103c0 con 0x7f2264076c10 2024-04-25T02:00:26.681 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.953+0000 7f226af3c700 1 -- 172.21.15.77:0/2865354238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2264076c10 msgr2=0x7f2264105440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:26.681 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.953+0000 7f226af3c700 1 --2- 172.21.15.77:0/2865354238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2264076c10 0x7f2264105440 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f22580098e0 tx=0x7f2258009250 comp rx=0 tx=0).stop 2024-04-25T02:00:26.681 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.953+0000 7f226af3c700 1 -- 172.21.15.77:0/2865354238 shutdown_connections 2024-04-25T02:00:26.681 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.953+0000 7f226af3c700 1 --2- 172.21.15.77:0/2865354238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2264076c10 0x7f2264105440 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:26.681 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.953+0000 7f226af3c700 1 -- 172.21.15.77:0/2865354238 >> 172.21.15.77:0/2865354238 conn(0x7f22640fced0 msgr2=0x7f22640ff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:26.681 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.953+0000 7f226af3c700 1 -- 172.21.15.77:0/2865354238 shutdown_connections 2024-04-25T02:00:26.681 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.953+0000 7f226af3c700 1 -- 172.21.15.77:0/2865354238 wait complete. 2024-04-25T02:00:26.681 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.953+0000 7f226af3c700 1 Processor -- start 2024-04-25T02:00:26.682 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.953+0000 7f226af3c700 1 -- start start 2024-04-25T02:00:26.682 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.954+0000 7f226af3c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2264076c10 0x7f22641115b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:26.682 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.954+0000 7f226af3c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2264111af0 con 0x7f2264076c10 2024-04-25T02:00:26.682 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.954+0000 7f2268cd8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2264076c10 0x7f22641115b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:26.682 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.954+0000 7f2268cd8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2264076c10 0x7f22641115b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48184/0 (socket says 172.21.15.77:48184) 2024-04-25T02:00:26.682 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.954+0000 7f2268cd8700 1 -- 172.21.15.77:0/1970652695 learned_addr learned my addr 172.21.15.77:0/1970652695 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:26.682 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.954+0000 7f2268cd8700 1 -- 172.21.15.77:0/1970652695 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22580094f0 con 0x7f2264076c10 2024-04-25T02:00:26.682 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.954+0000 7f2268cd8700 1 --2- 172.21.15.77:0/1970652695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2264076c10 0x7f22641115b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f22580094c0 tx=0x7f2258009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:26.682 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.954+0000 7f22617fa700 1 -- 172.21.15.77:0/1970652695 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2258010890 con 0x7f2264076c10 2024-04-25T02:00:26.682 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.954+0000 7f226af3c700 1 -- 172.21.15.77:0/1970652695 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2264111d50 con 0x7f2264076c10 2024-04-25T02:00:26.682 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.954+0000 7f22617fa700 1 -- 172.21.15.77:0/1970652695 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2258010ec0 con 0x7f2264076c10 2024-04-25T02:00:26.682 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.954+0000 7f22617fa700 1 -- 172.21.15.77:0/1970652695 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f225801aea0 con 0x7f2264076c10 2024-04-25T02:00:26.682 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.954+0000 7f226af3c700 1 -- 172.21.15.77:0/1970652695 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2264112860 con 0x7f2264076c10 2024-04-25T02:00:26.683 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.955+0000 7f22617fa700 1 -- 172.21.15.77:0/1970652695 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f225802d3f0 con 0x7f2264076c10 2024-04-25T02:00:26.683 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.955+0000 7f22617fa700 1 --2- 172.21.15.77:0/1970652695 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f2254036870 0x7f2254038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:26.683 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.955+0000 7f22617fa700 1 -- 172.21.15.77:0/1970652695 --> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2254039430 con 0x7f2254036870 2024-04-25T02:00:26.683 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.955+0000 7f22617fa700 1 -- 172.21.15.77:0/1970652695 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f225804a230 con 0x7f2264076c10 2024-04-25T02:00:26.683 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.955+0000 7f2263fff700 1 -- 172.21.15.77:0/1970652695 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f2254036870 msgr2=0x7f2254038d20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/859750200 2024-04-25T02:00:26.683 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:20.955+0000 7f2263fff700 1 --2- 172.21.15.77:0/1970652695 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f2254036870 0x7f2254038d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:00:26.683 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:21.156+0000 7f2263fff700 1 -- 172.21.15.77:0/1970652695 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f2254036870 msgr2=0x7f2254038d20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/859750200 2024-04-25T02:00:26.683 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:21.156+0000 7f2263fff700 1 --2- 172.21.15.77:0/1970652695 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f2254036870 0x7f2254038d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T02:00:26.683 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:21.557+0000 7f2263fff700 1 -- 172.21.15.77:0/1970652695 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f2254036870 msgr2=0x7f2254038d20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/859750200 2024-04-25T02:00:26.683 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:21.557+0000 7f2263fff700 1 --2- 172.21.15.77:0/1970652695 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f2254036870 0x7f2254038d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T02:00:26.683 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:22.358+0000 7f2263fff700 1 -- 172.21.15.77:0/1970652695 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f2254036870 msgr2=0x7f2254038d20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/859750200 2024-04-25T02:00:26.683 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:22.358+0000 7f2263fff700 1 --2- 172.21.15.77:0/1970652695 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f2254036870 0x7f2254038d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T02:00:26.683 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:23.959+0000 7f2263fff700 1 -- 172.21.15.77:0/1970652695 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f2254036870 msgr2=0x7f2254038d20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/859750200 2024-04-25T02:00:26.683 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:23.959+0000 7f2263fff700 1 --2- 172.21.15.77:0/1970652695 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f2254036870 0x7f2254038d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-25T02:00:26.684 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:25.058+0000 7f22617fa700 1 -- 172.21.15.77:0/1970652695 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mgrmap(e 10) v1 ==== 43156+0+0 (secure 0 0 0) 0x7f225801a430 con 0x7f2264076c10 2024-04-25T02:00:26.684 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:25.058+0000 7f22617fa700 1 -- 172.21.15.77:0/1970652695 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f2254036870 msgr2=0x7f2254038d20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:00:26.684 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:25.058+0000 7f22617fa700 1 --2- 172.21.15.77:0/1970652695 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f2254036870 0x7f2254038d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:26.684 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:26.060+0000 7f22617fa700 1 -- 172.21.15.77:0/1970652695 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 11) v1 ==== 43283+0+0 (secure 0 0 0) 0x7f225802d6a0 con 0x7f2264076c10 2024-04-25T02:00:26.684 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:26.060+0000 7f22617fa700 1 --2- 172.21.15.77:0/1970652695 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f225403a210 0x7f225403c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:26.684 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:26.060+0000 7f22617fa700 1 -- 172.21.15.77:0/1970652695 --> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2254039430 con 0x7f225403a210 2024-04-25T02:00:26.684 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:26.060+0000 7f2263fff700 1 --2- 172.21.15.77:0/1970652695 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f225403a210 0x7f225403c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:26.684 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:26.061+0000 7f2263fff700 1 --2- 172.21.15.77:0/1970652695 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f225403a210 0x7f225403c5f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f22500039d0 tx=0x7f22500092f0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:26.684 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:26.061+0000 7f22617fa700 1 -- 172.21.15.77:0/1970652695 <== mgr.14160 v2:172.21.15.77:6800/2375514340 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f2254039430 con 0x7f225403a210 2024-04-25T02:00:26.684 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:26.067+0000 7f226af3c700 1 -- 172.21.15.77:0/1970652695 --> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f226405f5c0 con 0x7f225403a210 2024-04-25T02:00:26.684 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:26.068+0000 7f22617fa700 1 -- 172.21.15.77:0/1970652695 <== mgr.14160 v2:172.21.15.77:6800/2375514340 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f226405f5c0 con 0x7f225403a210 2024-04-25T02:00:26.684 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:26.068+0000 7f226af3c700 1 -- 172.21.15.77:0/1970652695 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f225403a210 msgr2=0x7f225403c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:26.684 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:26.068+0000 7f226af3c700 1 --2- 172.21.15.77:0/1970652695 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f225403a210 0x7f225403c5f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f22500039d0 tx=0x7f22500092f0 comp rx=0 tx=0).stop 2024-04-25T02:00:26.684 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:26.068+0000 7f226af3c700 1 -- 172.21.15.77:0/1970652695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2264076c10 msgr2=0x7f22641115b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:26.685 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:26.068+0000 7f226af3c700 1 --2- 172.21.15.77:0/1970652695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2264076c10 0x7f22641115b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f22580094c0 tx=0x7f2258009250 comp rx=0 tx=0).stop 2024-04-25T02:00:26.685 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:26.068+0000 7f226af3c700 1 -- 172.21.15.77:0/1970652695 shutdown_connections 2024-04-25T02:00:26.685 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:26.068+0000 7f226af3c700 1 --2- 172.21.15.77:0/1970652695 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f225403a210 0x7f225403c5f0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:26.685 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:26.068+0000 7f226af3c700 1 --2- 172.21.15.77:0/1970652695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2264076c10 0x7f22641115b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:26.685 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:26.068+0000 7f226af3c700 1 --2- 172.21.15.77:0/1970652695 >> [v2:172.21.15.77:6800/859750200,v1:172.21.15.77:6801/859750200] conn(0x7f2254036870 0x7f2254038d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:26.685 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:26.068+0000 7f226af3c700 1 -- 172.21.15.77:0/1970652695 >> 172.21.15.77:0/1970652695 conn(0x7f22640fced0 msgr2=0x7f22640fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:26.685 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:26.068+0000 7f226af3c700 1 -- 172.21.15.77:0/1970652695 shutdown_connections 2024-04-25T02:00:26.685 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:26.068+0000 7f226af3c700 1 -- 172.21.15.77:0/1970652695 wait complete. 2024-04-25T02:00:26.685 INFO:teuthology.orchestra.run.smithi077.stdout:mgr epoch 9 is available 2024-04-25T02:00:26.685 INFO:teuthology.orchestra.run.smithi077.stdout:Generating a dashboard self-signed certificate... 2024-04-25T02:00:27.951 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:27 smithi077 ceph-mon[26330]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-25T02:00:27.952 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:27 smithi077 ceph-mon[26330]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-25T02:00:27.952 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:27 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:27.952 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:27 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:27.952 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:27 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:27.959 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-25T02:00:27.960 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.074+0000 7fb3dbd97700 1 Processor -- start 2024-04-25T02:00:27.960 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.074+0000 7fb3dbd97700 1 -- start start 2024-04-25T02:00:27.960 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.074+0000 7fb3dbd97700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3d4100c00 0x7fb3d4101010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:27.960 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.074+0000 7fb3dbd97700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d4101550 con 0x7fb3d4100c00 2024-04-25T02:00:27.960 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.074+0000 7fb3d9b33700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3d4100c00 0x7fb3d4101010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:27.960 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.074+0000 7fb3d9b33700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3d4100c00 0x7fb3d4101010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48254/0 (socket says 172.21.15.77:48254) 2024-04-25T02:00:27.960 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.074+0000 7fb3d9b33700 1 -- 172.21.15.77:0/2848264889 learned_addr learned my addr 172.21.15.77:0/2848264889 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:27.960 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.074+0000 7fb3d9b33700 1 -- 172.21.15.77:0/2848264889 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d4101690 con 0x7fb3d4100c00 2024-04-25T02:00:27.960 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.075+0000 7fb3d9b33700 1 --2- 172.21.15.77:0/2848264889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3d4100c00 0x7fb3d4101010 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb3c40098e0 tx=0x7fb3c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824ae34afbf765df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:27.960 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.075+0000 7fb3d8b31700 1 -- 172.21.15.77:0/2848264889 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb3c400b860 con 0x7fb3d4100c00 2024-04-25T02:00:27.960 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.075+0000 7fb3d8b31700 1 -- 172.21.15.77:0/2848264889 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb3c400be90 con 0x7fb3d4100c00 2024-04-25T02:00:27.960 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.075+0000 7fb3d8b31700 1 -- 172.21.15.77:0/2848264889 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb3c40103c0 con 0x7fb3d4100c00 2024-04-25T02:00:27.960 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.075+0000 7fb3dbd97700 1 -- 172.21.15.77:0/2848264889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3d4100c00 msgr2=0x7fb3d4101010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:27.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.075+0000 7fb3dbd97700 1 --2- 172.21.15.77:0/2848264889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3d4100c00 0x7fb3d4101010 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb3c40098e0 tx=0x7fb3c4009250 comp rx=0 tx=0).stop 2024-04-25T02:00:27.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.075+0000 7fb3dbd97700 1 -- 172.21.15.77:0/2848264889 shutdown_connections 2024-04-25T02:00:27.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.075+0000 7fb3dbd97700 1 --2- 172.21.15.77:0/2848264889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3d4100c00 0x7fb3d4101010 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:27.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.075+0000 7fb3dbd97700 1 -- 172.21.15.77:0/2848264889 >> 172.21.15.77:0/2848264889 conn(0x7fb3d40fc6f0 msgr2=0x7fb3d40feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:27.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.075+0000 7fb3dbd97700 1 -- 172.21.15.77:0/2848264889 shutdown_connections 2024-04-25T02:00:27.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.075+0000 7fb3dbd97700 1 -- 172.21.15.77:0/2848264889 wait complete. 2024-04-25T02:00:27.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.076+0000 7fb3dbd97700 1 Processor -- start 2024-04-25T02:00:27.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.076+0000 7fb3dbd97700 1 -- start start 2024-04-25T02:00:27.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.076+0000 7fb3dbd97700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3d4100c00 0x7fb3d41115d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:27.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.076+0000 7fb3dbd97700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d4111b10 con 0x7fb3d4100c00 2024-04-25T02:00:27.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.076+0000 7fb3d9b33700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3d4100c00 0x7fb3d41115d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:27.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.076+0000 7fb3d9b33700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3d4100c00 0x7fb3d41115d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48266/0 (socket says 172.21.15.77:48266) 2024-04-25T02:00:27.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.076+0000 7fb3d9b33700 1 -- 172.21.15.77:0/6305955 learned_addr learned my addr 172.21.15.77:0/6305955 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:27.961 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.076+0000 7fb3d9b33700 1 -- 172.21.15.77:0/6305955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c40094f0 con 0x7fb3d4100c00 2024-04-25T02:00:27.962 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.077+0000 7fb3d9b33700 1 --2- 172.21.15.77:0/6305955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3d4100c00 0x7fb3d41115d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb3c40090b0 tx=0x7fb3c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:27.962 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.077+0000 7fb3ca7fc700 1 -- 172.21.15.77:0/6305955 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb3c4010840 con 0x7fb3d4100c00 2024-04-25T02:00:27.962 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.077+0000 7fb3ca7fc700 1 -- 172.21.15.77:0/6305955 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb3c4010e70 con 0x7fb3d4100c00 2024-04-25T02:00:27.962 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.077+0000 7fb3dbd97700 1 -- 172.21.15.77:0/6305955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d4111d10 con 0x7fb3d4100c00 2024-04-25T02:00:27.962 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.077+0000 7fb3ca7fc700 1 -- 172.21.15.77:0/6305955 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb3c4024e40 con 0x7fb3d4100c00 2024-04-25T02:00:27.962 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.077+0000 7fb3dbd97700 1 -- 172.21.15.77:0/6305955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d4112880 con 0x7fb3d4100c00 2024-04-25T02:00:27.962 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.077+0000 7fb3ca7fc700 1 -- 172.21.15.77:0/6305955 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 43283+0+0 (secure 0 0 0) 0x7fb3c401a4e0 con 0x7fb3d4100c00 2024-04-25T02:00:27.962 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.078+0000 7fb3ca7fc700 1 --2- 172.21.15.77:0/6305955 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fb3c0036770 0x7fb3c0038c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:27.962 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.078+0000 7fb3dbd97700 1 -- 172.21.15.77:0/6305955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d405f5c0 con 0x7fb3d4100c00 2024-04-25T02:00:27.962 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.078+0000 7fb3ca7fc700 1 -- 172.21.15.77:0/6305955 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb3c404a6f0 con 0x7fb3d4100c00 2024-04-25T02:00:27.962 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.078+0000 7fb3d9332700 1 --2- 172.21.15.77:0/6305955 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fb3c0036770 0x7fb3c0038c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:27.962 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.078+0000 7fb3d9332700 1 --2- 172.21.15.77:0/6305955 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fb3c0036770 0x7fb3c0038c20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0009990 tx=0x7fb3d0006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:27.962 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.082+0000 7fb3ca7fc700 1 -- 172.21.15.77:0/6305955 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb3c402c930 con 0x7fb3d4100c00 2024-04-25T02:00:27.962 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.281+0000 7fb3dbd97700 1 -- 172.21.15.77:0/6305955 --> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3d40fd890 con 0x7fb3c0036770 2024-04-25T02:00:27.963 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.380+0000 7fb3ca7fc700 1 -- 172.21.15.77:0/6305955 <== mgr.14160 v2:172.21.15.77:6800/2375514340 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fb3d40fd890 con 0x7fb3c0036770 2024-04-25T02:00:27.963 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.382+0000 7fb3dbd97700 1 -- 172.21.15.77:0/6305955 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fb3c0036770 msgr2=0x7fb3c0038c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:27.963 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.382+0000 7fb3dbd97700 1 --2- 172.21.15.77:0/6305955 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fb3c0036770 0x7fb3c0038c20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0009990 tx=0x7fb3d0006e40 comp rx=0 tx=0).stop 2024-04-25T02:00:27.963 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.382+0000 7fb3dbd97700 1 -- 172.21.15.77:0/6305955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3d4100c00 msgr2=0x7fb3d41115d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:27.963 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.382+0000 7fb3dbd97700 1 --2- 172.21.15.77:0/6305955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3d4100c00 0x7fb3d41115d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb3c40090b0 tx=0x7fb3c4009250 comp rx=0 tx=0).stop 2024-04-25T02:00:27.963 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.382+0000 7fb3dbd97700 1 -- 172.21.15.77:0/6305955 shutdown_connections 2024-04-25T02:00:27.963 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.382+0000 7fb3dbd97700 1 --2- 172.21.15.77:0/6305955 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fb3c0036770 0x7fb3c0038c20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:27.963 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.382+0000 7fb3dbd97700 1 --2- 172.21.15.77:0/6305955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3d4100c00 0x7fb3d41115d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:27.963 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.382+0000 7fb3dbd97700 1 -- 172.21.15.77:0/6305955 >> 172.21.15.77:0/6305955 conn(0x7fb3d40fc6f0 msgr2=0x7fb3d40fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:27.963 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.382+0000 7fb3dbd97700 1 -- 172.21.15.77:0/6305955 shutdown_connections 2024-04-25T02:00:27.963 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:27.382+0000 7fb3dbd97700 1 -- 172.21.15.77:0/6305955 wait complete. 2024-04-25T02:00:27.963 INFO:teuthology.orchestra.run.smithi077.stdout:Creating initial admin user... 2024-04-25T02:00:28.817 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:28 smithi077 ceph-mon[26330]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:00:28.818 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:28 smithi077 ceph-mon[26330]: mgrmap e12: smithi077.zpflzp(active, since 2s) 2024-04-25T02:00:28.818 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:28 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:29.630 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:29 smithi077 ceph-mon[26330]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:00:29.630 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:29 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:30.083 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$yf01GMeqD3J8UVGSFmY6p.47okAGStFjCsKQcN3ITGCqh2SeOala2", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1714010428, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-25T02:00:30.083 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.382+0000 7f9612ba4700 1 Processor -- start 2024-04-25T02:00:30.084 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.382+0000 7f9612ba4700 1 -- start start 2024-04-25T02:00:30.084 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.382+0000 7f9612ba4700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f960c102880 0x7f960c102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:30.084 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.382+0000 7f9612ba4700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c1031d0 con 0x7f960c102880 2024-04-25T02:00:30.084 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.382+0000 7f9610940700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f960c102880 0x7f960c102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:30.084 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.382+0000 7f9610940700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f960c102880 0x7f960c102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54432/0 (socket says 172.21.15.77:54432) 2024-04-25T02:00:30.084 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.382+0000 7f9610940700 1 -- 172.21.15.77:0/2809288405 learned_addr learned my addr 172.21.15.77:0/2809288405 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:30.085 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.382+0000 7f9610940700 1 -- 172.21.15.77:0/2809288405 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960c103310 con 0x7f960c102880 2024-04-25T02:00:30.085 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.382+0000 7f9610940700 1 --2- 172.21.15.77:0/2809288405 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f960c102880 0x7f960c102c90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f96000098e0 tx=0x7f9600009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3f1a862ad2e92b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:30.085 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.383+0000 7f960b7fe700 1 -- 172.21.15.77:0/2809288405 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f960000b860 con 0x7f960c102880 2024-04-25T02:00:30.085 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.383+0000 7f960b7fe700 1 -- 172.21.15.77:0/2809288405 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f960000be90 con 0x7f960c102880 2024-04-25T02:00:30.085 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.383+0000 7f960b7fe700 1 -- 172.21.15.77:0/2809288405 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f96000103c0 con 0x7f960c102880 2024-04-25T02:00:30.085 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.383+0000 7f9612ba4700 1 -- 172.21.15.77:0/2809288405 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f960c102880 msgr2=0x7f960c102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:30.085 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.383+0000 7f9612ba4700 1 --2- 172.21.15.77:0/2809288405 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f960c102880 0x7f960c102c90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f96000098e0 tx=0x7f9600009250 comp rx=0 tx=0).stop 2024-04-25T02:00:30.085 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.383+0000 7f9612ba4700 1 -- 172.21.15.77:0/2809288405 shutdown_connections 2024-04-25T02:00:30.085 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.383+0000 7f9612ba4700 1 --2- 172.21.15.77:0/2809288405 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f960c102880 0x7f960c102c90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:30.085 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.383+0000 7f9612ba4700 1 -- 172.21.15.77:0/2809288405 >> 172.21.15.77:0/2809288405 conn(0x7f960c0fe060 msgr2=0x7f960c100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:30.085 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.383+0000 7f9612ba4700 1 -- 172.21.15.77:0/2809288405 shutdown_connections 2024-04-25T02:00:30.085 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.383+0000 7f9612ba4700 1 -- 172.21.15.77:0/2809288405 wait complete. 2024-04-25T02:00:30.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.384+0000 7f9612ba4700 1 Processor -- start 2024-04-25T02:00:30.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.384+0000 7f9612ba4700 1 -- start start 2024-04-25T02:00:30.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.384+0000 7f9612ba4700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f960c102880 0x7f960c1115c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:30.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.384+0000 7f9612ba4700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c111b00 con 0x7f960c102880 2024-04-25T02:00:30.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.384+0000 7f9610940700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f960c102880 0x7f960c1115c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:30.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.384+0000 7f9610940700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f960c102880 0x7f960c1115c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54440/0 (socket says 172.21.15.77:54440) 2024-04-25T02:00:30.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.384+0000 7f9610940700 1 -- 172.21.15.77:0/283424955 learned_addr learned my addr 172.21.15.77:0/283424955 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:30.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.384+0000 7f9610940700 1 -- 172.21.15.77:0/283424955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96000094f0 con 0x7f960c102880 2024-04-25T02:00:30.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.385+0000 7f9610940700 1 --2- 172.21.15.77:0/283424955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f960c102880 0x7f960c1115c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9600011680 tx=0x7f9600009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:30.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.385+0000 7f96097fa700 1 -- 172.21.15.77:0/283424955 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9600010890 con 0x7f960c102880 2024-04-25T02:00:30.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.385+0000 7f9612ba4700 1 -- 172.21.15.77:0/283424955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960c111d00 con 0x7f960c102880 2024-04-25T02:00:30.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.385+0000 7f96097fa700 1 -- 172.21.15.77:0/283424955 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9600010ec0 con 0x7f960c102880 2024-04-25T02:00:30.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.385+0000 7f96097fa700 1 -- 172.21.15.77:0/283424955 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f96000243f0 con 0x7f960c102880 2024-04-25T02:00:30.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.385+0000 7f9612ba4700 1 -- 172.21.15.77:0/283424955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960c112870 con 0x7f960c102880 2024-04-25T02:00:30.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.386+0000 7f96097fa700 1 -- 172.21.15.77:0/283424955 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 12) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f960002d3f0 con 0x7f960c102880 2024-04-25T02:00:30.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.386+0000 7f9612ba4700 1 -- 172.21.15.77:0/283424955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f960c05f5c0 con 0x7f960c102880 2024-04-25T02:00:30.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.386+0000 7f96097fa700 1 --2- 172.21.15.77:0/283424955 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f95fc0368a0 0x7f95fc038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:30.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.386+0000 7f96097fa700 1 -- 172.21.15.77:0/283424955 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f960004a3b0 con 0x7f960c102880 2024-04-25T02:00:30.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.386+0000 7f960bfff700 1 --2- 172.21.15.77:0/283424955 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f95fc0368a0 0x7f95fc038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:30.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.386+0000 7f960bfff700 1 --2- 172.21.15.77:0/283424955 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f95fc0368a0 0x7f95fc038d50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009990 tx=0x7f95f8006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:30.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.391+0000 7f96097fa700 1 -- 172.21.15.77:0/283424955 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f960002b6b0 con 0x7f960c102880 2024-04-25T02:00:30.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.611+0000 7f9612ba4700 1 -- 172.21.15.77:0/283424955 --> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f960c05f3b0 con 0x7f95fc0368a0 2024-04-25T02:00:30.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.835+0000 7f96097fa700 1 -- 172.21.15.77:0/283424955 <== mgr.14160 v2:172.21.15.77:6800/2375514340 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f960c05f3b0 con 0x7f95fc0368a0 2024-04-25T02:00:30.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.837+0000 7f9612ba4700 1 -- 172.21.15.77:0/283424955 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f95fc0368a0 msgr2=0x7f95fc038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:30.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.837+0000 7f9612ba4700 1 --2- 172.21.15.77:0/283424955 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f95fc0368a0 0x7f95fc038d50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009990 tx=0x7f95f8006e40 comp rx=0 tx=0).stop 2024-04-25T02:00:30.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.837+0000 7f9612ba4700 1 -- 172.21.15.77:0/283424955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f960c102880 msgr2=0x7f960c1115c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:30.088 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.837+0000 7f9612ba4700 1 --2- 172.21.15.77:0/283424955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f960c102880 0x7f960c1115c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9600011680 tx=0x7f9600009250 comp rx=0 tx=0).stop 2024-04-25T02:00:30.088 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.837+0000 7f9612ba4700 1 -- 172.21.15.77:0/283424955 shutdown_connections 2024-04-25T02:00:30.088 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.837+0000 7f9612ba4700 1 --2- 172.21.15.77:0/283424955 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f95fc0368a0 0x7f95fc038d50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:30.088 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.837+0000 7f9612ba4700 1 --2- 172.21.15.77:0/283424955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f960c102880 0x7f960c1115c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:30.088 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.837+0000 7f9612ba4700 1 -- 172.21.15.77:0/283424955 >> 172.21.15.77:0/283424955 conn(0x7f960c0fe060 msgr2=0x7f960c0feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:30.088 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.837+0000 7f9612ba4700 1 -- 172.21.15.77:0/283424955 shutdown_connections 2024-04-25T02:00:30.088 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:28.837+0000 7f9612ba4700 1 -- 172.21.15.77:0/283424955 wait complete. 2024-04-25T02:00:30.088 INFO:teuthology.orchestra.run.smithi077.stdout:Fetching dashboard port number... 2024-04-25T02:00:31.088 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:30 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/1923290236' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-25T02:00:31.330 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 8443 2024-04-25T02:00:31.330 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.552+0000 7efdd906e700 1 Processor -- start 2024-04-25T02:00:31.330 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.552+0000 7efdd906e700 1 -- start start 2024-04-25T02:00:31.331 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.552+0000 7efdd906e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdd4102880 0x7efdd4102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:31.331 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.552+0000 7efdd906e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd41031d0 con 0x7efdd4102880 2024-04-25T02:00:31.331 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.552+0000 7efdd2d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdd4102880 0x7efdd4102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:31.331 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.552+0000 7efdd2d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdd4102880 0x7efdd4102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54448/0 (socket says 172.21.15.77:54448) 2024-04-25T02:00:31.331 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.552+0000 7efdd2d9d700 1 -- 172.21.15.77:0/1013822533 learned_addr learned my addr 172.21.15.77:0/1013822533 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:31.331 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.552+0000 7efdd2d9d700 1 -- 172.21.15.77:0/1013822533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd4103310 con 0x7efdd4102880 2024-04-25T02:00:31.331 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.552+0000 7efdd2d9d700 1 --2- 172.21.15.77:0/1013822533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdd4102880 0x7efdd4102c90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efdc40098e0 tx=0x7efdc4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c86027fd2059e81 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:31.331 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.553+0000 7efdd1d9b700 1 -- 172.21.15.77:0/1013822533 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efdc400b860 con 0x7efdd4102880 2024-04-25T02:00:31.331 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.553+0000 7efdd1d9b700 1 -- 172.21.15.77:0/1013822533 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efdc400be90 con 0x7efdd4102880 2024-04-25T02:00:31.331 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.553+0000 7efdd1d9b700 1 -- 172.21.15.77:0/1013822533 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efdc40103c0 con 0x7efdd4102880 2024-04-25T02:00:31.331 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.553+0000 7efdd906e700 1 -- 172.21.15.77:0/1013822533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdd4102880 msgr2=0x7efdd4102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:31.331 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.553+0000 7efdd906e700 1 --2- 172.21.15.77:0/1013822533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdd4102880 0x7efdd4102c90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efdc40098e0 tx=0x7efdc4009250 comp rx=0 tx=0).stop 2024-04-25T02:00:31.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.553+0000 7efdd906e700 1 -- 172.21.15.77:0/1013822533 shutdown_connections 2024-04-25T02:00:31.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.553+0000 7efdd906e700 1 --2- 172.21.15.77:0/1013822533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdd4102880 0x7efdd4102c90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:31.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.553+0000 7efdd906e700 1 -- 172.21.15.77:0/1013822533 >> 172.21.15.77:0/1013822533 conn(0x7efdd40fe060 msgr2=0x7efdd4100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:31.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.553+0000 7efdd906e700 1 -- 172.21.15.77:0/1013822533 shutdown_connections 2024-04-25T02:00:31.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.553+0000 7efdd906e700 1 -- 172.21.15.77:0/1013822533 wait complete. 2024-04-25T02:00:31.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.554+0000 7efdd906e700 1 Processor -- start 2024-04-25T02:00:31.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.554+0000 7efdd906e700 1 -- start start 2024-04-25T02:00:31.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.554+0000 7efdd906e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdd4102880 0x7efdd4111620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:31.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.554+0000 7efdd906e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd4111b60 con 0x7efdd4102880 2024-04-25T02:00:31.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.554+0000 7efdd2d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdd4102880 0x7efdd4111620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:31.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.554+0000 7efdd2d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdd4102880 0x7efdd4111620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54452/0 (socket says 172.21.15.77:54452) 2024-04-25T02:00:31.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.554+0000 7efdd2d9d700 1 -- 172.21.15.77:0/1923290236 learned_addr learned my addr 172.21.15.77:0/1923290236 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:31.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.554+0000 7efdd2d9d700 1 -- 172.21.15.77:0/1923290236 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc40094f0 con 0x7efdd4102880 2024-04-25T02:00:31.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.555+0000 7efdd2d9d700 1 --2- 172.21.15.77:0/1923290236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdd4102880 0x7efdd4111620 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efdc40090b0 tx=0x7efdc4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:31.333 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.555+0000 7efdbb7fe700 1 -- 172.21.15.77:0/1923290236 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efdc4010840 con 0x7efdd4102880 2024-04-25T02:00:31.333 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.555+0000 7efdbb7fe700 1 -- 172.21.15.77:0/1923290236 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efdc4010e70 con 0x7efdd4102880 2024-04-25T02:00:31.333 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.555+0000 7efdd906e700 1 -- 172.21.15.77:0/1923290236 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd4111d60 con 0x7efdd4102880 2024-04-25T02:00:31.333 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.555+0000 7efdbb7fe700 1 -- 172.21.15.77:0/1923290236 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efdc4024e40 con 0x7efdd4102880 2024-04-25T02:00:31.333 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.555+0000 7efdd906e700 1 -- 172.21.15.77:0/1923290236 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd41128d0 con 0x7efdd4102880 2024-04-25T02:00:31.333 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.556+0000 7efdbb7fe700 1 -- 172.21.15.77:0/1923290236 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 12) v1 ==== 43389+0+0 (secure 0 0 0) 0x7efdc401a510 con 0x7efdd4102880 2024-04-25T02:00:31.333 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.556+0000 7efdd906e700 1 -- 172.21.15.77:0/1923290236 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd405f5c0 con 0x7efdd4102880 2024-04-25T02:00:31.333 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.556+0000 7efdbb7fe700 1 --2- 172.21.15.77:0/1923290236 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7efdbc036850 0x7efdbc038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:31.333 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.556+0000 7efdbb7fe700 1 -- 172.21.15.77:0/1923290236 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7efdc404a900 con 0x7efdd4102880 2024-04-25T02:00:31.333 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.556+0000 7efdd259c700 1 --2- 172.21.15.77:0/1923290236 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7efdbc036850 0x7efdbc038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:31.334 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.556+0000 7efdd259c700 1 --2- 172.21.15.77:0/1923290236 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7efdbc036850 0x7efdbc038d00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009990 tx=0x7efdc8006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:31.334 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.560+0000 7efdbb7fe700 1 -- 172.21.15.77:0/1923290236 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7efdc4018940 con 0x7efdd4102880 2024-04-25T02:00:31.334 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.748+0000 7efdd906e700 1 -- 172.21.15.77:0/1923290236 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7efdd404bed0 con 0x7efdd4102880 2024-04-25T02:00:31.334 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.749+0000 7efdbb7fe700 1 -- 172.21.15.77:0/1923290236 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7efdc4018350 con 0x7efdd4102880 2024-04-25T02:00:31.334 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.751+0000 7efdd906e700 1 -- 172.21.15.77:0/1923290236 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7efdbc036850 msgr2=0x7efdbc038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:31.334 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.751+0000 7efdd906e700 1 --2- 172.21.15.77:0/1923290236 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7efdbc036850 0x7efdbc038d00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009990 tx=0x7efdc8006e40 comp rx=0 tx=0).stop 2024-04-25T02:00:31.334 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.751+0000 7efdd906e700 1 -- 172.21.15.77:0/1923290236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdd4102880 msgr2=0x7efdd4111620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:31.334 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.751+0000 7efdd906e700 1 --2- 172.21.15.77:0/1923290236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdd4102880 0x7efdd4111620 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efdc40090b0 tx=0x7efdc4009250 comp rx=0 tx=0).stop 2024-04-25T02:00:31.334 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.751+0000 7efdd906e700 1 -- 172.21.15.77:0/1923290236 shutdown_connections 2024-04-25T02:00:31.334 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.751+0000 7efdd906e700 1 --2- 172.21.15.77:0/1923290236 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7efdbc036850 0x7efdbc038d00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:31.334 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.751+0000 7efdd906e700 1 --2- 172.21.15.77:0/1923290236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdd4102880 0x7efdd4111620 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:31.334 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.751+0000 7efdd906e700 1 -- 172.21.15.77:0/1923290236 >> 172.21.15.77:0/1923290236 conn(0x7efdd40fe060 msgr2=0x7efdd40feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:31.334 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.751+0000 7efdd906e700 1 -- 172.21.15.77:0/1923290236 shutdown_connections 2024-04-25T02:00:31.335 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:30.751+0000 7efdd906e700 1 -- 172.21.15.77:0/1923290236 wait complete. 2024-04-25T02:00:31.336 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-25T02:00:31.336 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout disabled 2024-04-25T02:00:31.343 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-25T02:00:31.343 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout inactive 2024-04-25T02:00:31.343 INFO:teuthology.orchestra.run.smithi077.stdout:firewalld.service is not enabled 2024-04-25T02:00:31.343 INFO:teuthology.orchestra.run.smithi077.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-25T02:00:31.345 INFO:teuthology.orchestra.run.smithi077.stdout:Ceph Dashboard is now available at: 2024-04-25T02:00:31.345 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:00:31.345 INFO:teuthology.orchestra.run.smithi077.stdout: URL: https://smithi077:8443/ 2024-04-25T02:00:31.345 INFO:teuthology.orchestra.run.smithi077.stdout: User: admin 2024-04-25T02:00:31.345 INFO:teuthology.orchestra.run.smithi077.stdout: Password: hg7vp1z6gk 2024-04-25T02:00:31.345 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:00:31.346 INFO:teuthology.orchestra.run.smithi077.stdout:Saving cluster configuration to /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config directory 2024-04-25T02:00:31.346 INFO:teuthology.orchestra.run.smithi077.stdout:Enabling autotune for osd_memory_target 2024-04-25T02:00:32.503 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.718+0000 7fad2b3c9700 1 Processor -- start 2024-04-25T02:00:32.503 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.718+0000 7fad2b3c9700 1 -- start start 2024-04-25T02:00:32.503 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.718+0000 7fad2b3c9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad24102c70 0x7fad24103080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:32.503 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.718+0000 7fad2b3c9700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad24103650 con 0x7fad24102c70 2024-04-25T02:00:32.503 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.719+0000 7fad29165700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad24102c70 0x7fad24103080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:32.503 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.719+0000 7fad29165700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad24102c70 0x7fad24103080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54458/0 (socket says 172.21.15.77:54458) 2024-04-25T02:00:32.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.719+0000 7fad29165700 1 -- 172.21.15.77:0/210929058 learned_addr learned my addr 172.21.15.77:0/210929058 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:32.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.719+0000 7fad29165700 1 -- 172.21.15.77:0/210929058 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad24103790 con 0x7fad24102c70 2024-04-25T02:00:32.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.719+0000 7fad29165700 1 --2- 172.21.15.77:0/210929058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad24102c70 0x7fad24103080 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fad20009e50 tx=0x7fad20009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372dfdff7c45e641 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:32.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.719+0000 7fad1bfff700 1 -- 172.21.15.77:0/210929058 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad200092e0 con 0x7fad24102c70 2024-04-25T02:00:32.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.719+0000 7fad1bfff700 1 -- 172.21.15.77:0/210929058 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad20012430 con 0x7fad24102c70 2024-04-25T02:00:32.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.719+0000 7fad1bfff700 1 -- 172.21.15.77:0/210929058 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad200075a0 con 0x7fad24102c70 2024-04-25T02:00:32.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.720+0000 7fad2b3c9700 1 -- 172.21.15.77:0/210929058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad24102c70 msgr2=0x7fad24103080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:32.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.720+0000 7fad2b3c9700 1 --2- 172.21.15.77:0/210929058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad24102c70 0x7fad24103080 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fad20009e50 tx=0x7fad20009840 comp rx=0 tx=0).stop 2024-04-25T02:00:32.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.720+0000 7fad2b3c9700 1 -- 172.21.15.77:0/210929058 shutdown_connections 2024-04-25T02:00:32.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.720+0000 7fad2b3c9700 1 --2- 172.21.15.77:0/210929058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad24102c70 0x7fad24103080 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:32.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.720+0000 7fad2b3c9700 1 -- 172.21.15.77:0/210929058 >> 172.21.15.77:0/210929058 conn(0x7fad240fc6b0 msgr2=0x7fad240feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:32.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.720+0000 7fad2b3c9700 1 -- 172.21.15.77:0/210929058 shutdown_connections 2024-04-25T02:00:32.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.720+0000 7fad2b3c9700 1 -- 172.21.15.77:0/210929058 wait complete. 2024-04-25T02:00:32.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.721+0000 7fad2b3c9700 1 Processor -- start 2024-04-25T02:00:32.504 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.721+0000 7fad2b3c9700 1 -- start start 2024-04-25T02:00:32.505 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.721+0000 7fad2b3c9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad24102c70 0x7fad24113840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:32.505 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.721+0000 7fad2b3c9700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad24113d80 con 0x7fad24102c70 2024-04-25T02:00:32.505 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.721+0000 7fad29165700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad24102c70 0x7fad24113840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:32.505 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.721+0000 7fad29165700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad24102c70 0x7fad24113840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54464/0 (socket says 172.21.15.77:54464) 2024-04-25T02:00:32.505 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.721+0000 7fad29165700 1 -- 172.21.15.77:0/160587817 learned_addr learned my addr 172.21.15.77:0/160587817 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:32.505 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.721+0000 7fad29165700 1 -- 172.21.15.77:0/160587817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad20009ae0 con 0x7fad24102c70 2024-04-25T02:00:32.505 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.721+0000 7fad29165700 1 --2- 172.21.15.77:0/160587817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad24102c70 0x7fad24113840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fad20012f20 tx=0x7fad20009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:32.505 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.721+0000 7fad19ffb700 1 -- 172.21.15.77:0/160587817 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad200092e0 con 0x7fad24102c70 2024-04-25T02:00:32.505 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.721+0000 7fad2b3c9700 1 -- 172.21.15.77:0/160587817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad24113f80 con 0x7fad24102c70 2024-04-25T02:00:32.505 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.721+0000 7fad19ffb700 1 -- 172.21.15.77:0/160587817 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad20007d30 con 0x7fad24102c70 2024-04-25T02:00:32.505 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.721+0000 7fad19ffb700 1 -- 172.21.15.77:0/160587817 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad20025a00 con 0x7fad24102c70 2024-04-25T02:00:32.505 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.722+0000 7fad2b3c9700 1 -- 172.21.15.77:0/160587817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad24114af0 con 0x7fad24102c70 2024-04-25T02:00:32.505 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.722+0000 7fad19ffb700 1 -- 172.21.15.77:0/160587817 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 12) v1 ==== 43389+0+0 (secure 0 0 0) 0x7fad20019050 con 0x7fad24102c70 2024-04-25T02:00:32.506 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.723+0000 7fad2b3c9700 1 -- 172.21.15.77:0/160587817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad2405f5c0 con 0x7fad24102c70 2024-04-25T02:00:32.506 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.723+0000 7fad19ffb700 1 --2- 172.21.15.77:0/160587817 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fad100368f0 0x7fad10038da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:32.506 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.723+0000 7fad19ffb700 1 -- 172.21.15.77:0/160587817 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fad2004a070 con 0x7fad24102c70 2024-04-25T02:00:32.506 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.723+0000 7fad28964700 1 --2- 172.21.15.77:0/160587817 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fad100368f0 0x7fad10038da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:32.506 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.723+0000 7fad28964700 1 --2- 172.21.15.77:0/160587817 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fad100368f0 0x7fad10038da0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fad14009990 tx=0x7fad14006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:32.506 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.728+0000 7fad19ffb700 1 -- 172.21.15.77:0/160587817 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fad2002d9a0 con 0x7fad24102c70 2024-04-25T02:00:32.506 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.802+0000 7fad19ffb700 1 -- 172.21.15.77:0/160587817 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fad2001c5a0 con 0x7fad24102c70 2024-04-25T02:00:32.506 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.916+0000 7fad2b3c9700 1 -- 172.21.15.77:0/160587817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fad2404bed0 con 0x7fad24102c70 2024-04-25T02:00:32.506 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.916+0000 7fad19ffb700 1 -- 172.21.15.77:0/160587817 <== mon.0 v2:172.21.15.77:3300/0 8 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fad20025410 con 0x7fad24102c70 2024-04-25T02:00:32.506 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.918+0000 7fad2b3c9700 1 -- 172.21.15.77:0/160587817 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fad100368f0 msgr2=0x7fad10038da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:32.506 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.918+0000 7fad2b3c9700 1 --2- 172.21.15.77:0/160587817 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fad100368f0 0x7fad10038da0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fad14009990 tx=0x7fad14006e40 comp rx=0 tx=0).stop 2024-04-25T02:00:32.506 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.918+0000 7fad2b3c9700 1 -- 172.21.15.77:0/160587817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad24102c70 msgr2=0x7fad24113840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:32.507 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.918+0000 7fad2b3c9700 1 --2- 172.21.15.77:0/160587817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad24102c70 0x7fad24113840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fad20012f20 tx=0x7fad20009840 comp rx=0 tx=0).stop 2024-04-25T02:00:32.507 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.918+0000 7fad2b3c9700 1 -- 172.21.15.77:0/160587817 shutdown_connections 2024-04-25T02:00:32.507 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.918+0000 7fad2b3c9700 1 --2- 172.21.15.77:0/160587817 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fad100368f0 0x7fad10038da0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:32.507 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.918+0000 7fad2b3c9700 1 --2- 172.21.15.77:0/160587817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad24102c70 0x7fad24113840 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:32.507 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.918+0000 7fad2b3c9700 1 -- 172.21.15.77:0/160587817 >> 172.21.15.77:0/160587817 conn(0x7fad240fc6b0 msgr2=0x7fad240fd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:32.507 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.918+0000 7fad2b3c9700 1 -- 172.21.15.77:0/160587817 shutdown_connections 2024-04-25T02:00:32.507 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:31.918+0000 7fad2b3c9700 1 -- 172.21.15.77:0/160587817 wait complete. 2024-04-25T02:00:32.893 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:32 smithi077 ceph-mon[26330]: mgrmap e13: smithi077.zpflzp(active, since 6s) 2024-04-25T02:00:33.772 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.889+0000 7fddf70ae700 1 Processor -- start 2024-04-25T02:00:33.772 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.889+0000 7fddf70ae700 1 -- start start 2024-04-25T02:00:33.772 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.889+0000 7fddf70ae700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddf0076b90 0x7fddf01054c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:33.772 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.889+0000 7fddf70ae700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf0105a00 con 0x7fddf0076b90 2024-04-25T02:00:33.772 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.889+0000 7fddf4e4a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddf0076b90 0x7fddf01054c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:33.772 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.889+0000 7fddf4e4a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddf0076b90 0x7fddf01054c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54480/0 (socket says 172.21.15.77:54480) 2024-04-25T02:00:33.772 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.889+0000 7fddf4e4a700 1 -- 172.21.15.77:0/435273353 learned_addr learned my addr 172.21.15.77:0/435273353 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:33.772 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.889+0000 7fddf4e4a700 1 -- 172.21.15.77:0/435273353 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf0105b40 con 0x7fddf0076b90 2024-04-25T02:00:33.772 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.890+0000 7fddf4e4a700 1 --2- 172.21.15.77:0/435273353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddf0076b90 0x7fddf01054c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdde40098e0 tx=0x7fdde4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd105c5b461747a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:33.772 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.890+0000 7fddef7fe700 1 -- 172.21.15.77:0/435273353 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdde400b860 con 0x7fddf0076b90 2024-04-25T02:00:33.772 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.890+0000 7fddef7fe700 1 -- 172.21.15.77:0/435273353 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdde400be90 con 0x7fddf0076b90 2024-04-25T02:00:33.773 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.890+0000 7fddef7fe700 1 -- 172.21.15.77:0/435273353 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdde40103c0 con 0x7fddf0076b90 2024-04-25T02:00:33.773 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.890+0000 7fddf70ae700 1 -- 172.21.15.77:0/435273353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddf0076b90 msgr2=0x7fddf01054c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:33.773 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.890+0000 7fddf70ae700 1 --2- 172.21.15.77:0/435273353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddf0076b90 0x7fddf01054c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdde40098e0 tx=0x7fdde4009250 comp rx=0 tx=0).stop 2024-04-25T02:00:33.773 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.890+0000 7fddf70ae700 1 -- 172.21.15.77:0/435273353 shutdown_connections 2024-04-25T02:00:33.773 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.890+0000 7fddf70ae700 1 --2- 172.21.15.77:0/435273353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddf0076b90 0x7fddf01054c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:33.773 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.891+0000 7fddf70ae700 1 -- 172.21.15.77:0/435273353 >> 172.21.15.77:0/435273353 conn(0x7fddf00fcef0 msgr2=0x7fddf00ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:33.773 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.891+0000 7fddf70ae700 1 -- 172.21.15.77:0/435273353 shutdown_connections 2024-04-25T02:00:33.773 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.891+0000 7fddf70ae700 1 -- 172.21.15.77:0/435273353 wait complete. 2024-04-25T02:00:33.773 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.891+0000 7fddf70ae700 1 Processor -- start 2024-04-25T02:00:33.773 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.891+0000 7fddf70ae700 1 -- start start 2024-04-25T02:00:33.773 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.891+0000 7fddf70ae700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddf0076b90 0x7fddf0111620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:33.773 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.891+0000 7fddf70ae700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf0111b60 con 0x7fddf0076b90 2024-04-25T02:00:33.773 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.891+0000 7fddf4e4a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddf0076b90 0x7fddf0111620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:33.773 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.892+0000 7fddf4e4a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddf0076b90 0x7fddf0111620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54488/0 (socket says 172.21.15.77:54488) 2024-04-25T02:00:33.773 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.892+0000 7fddf4e4a700 1 -- 172.21.15.77:0/1198302157 learned_addr learned my addr 172.21.15.77:0/1198302157 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:33.774 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.892+0000 7fddf4e4a700 1 -- 172.21.15.77:0/1198302157 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde40094f0 con 0x7fddf0076b90 2024-04-25T02:00:33.774 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.892+0000 7fddf4e4a700 1 --2- 172.21.15.77:0/1198302157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddf0076b90 0x7fddf0111620 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdde40094c0 tx=0x7fdde4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:33.774 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.892+0000 7fdded7fa700 1 -- 172.21.15.77:0/1198302157 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdde4010890 con 0x7fddf0076b90 2024-04-25T02:00:33.774 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.892+0000 7fdded7fa700 1 -- 172.21.15.77:0/1198302157 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdde4010ec0 con 0x7fddf0076b90 2024-04-25T02:00:33.774 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.892+0000 7fddf70ae700 1 -- 172.21.15.77:0/1198302157 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf0111d60 con 0x7fddf0076b90 2024-04-25T02:00:33.774 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.892+0000 7fdded7fa700 1 -- 172.21.15.77:0/1198302157 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdde40243f0 con 0x7fddf0076b90 2024-04-25T02:00:33.774 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.892+0000 7fddf70ae700 1 -- 172.21.15.77:0/1198302157 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf01128d0 con 0x7fddf0076b90 2024-04-25T02:00:33.774 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.893+0000 7fdded7fa700 1 -- 172.21.15.77:0/1198302157 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fdde402d3f0 con 0x7fddf0076b90 2024-04-25T02:00:33.774 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.893+0000 7fdded7fa700 1 --2- 172.21.15.77:0/1198302157 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fdde0036940 0x7fdde0038df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:33.774 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.893+0000 7fddf70ae700 1 -- 172.21.15.77:0/1198302157 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf005f5c0 con 0x7fddf0076b90 2024-04-25T02:00:33.774 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.893+0000 7fdded7fa700 1 -- 172.21.15.77:0/1198302157 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fdde404a4c0 con 0x7fddf0076b90 2024-04-25T02:00:33.774 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.893+0000 7fddeffff700 1 --2- 172.21.15.77:0/1198302157 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fdde0036940 0x7fdde0038df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:33.774 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.893+0000 7fddeffff700 1 --2- 172.21.15.77:0/1198302157 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fdde0036940 0x7fdde0038df0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdddc009990 tx=0x7fdddc006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:33.775 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:32.898+0000 7fdded7fa700 1 -- 172.21.15.77:0/1198302157 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fdde4079250 con 0x7fddf0076b90 2024-04-25T02:00:33.775 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:33.186+0000 7fddf70ae700 1 -- 172.21.15.77:0/1198302157 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fddf004bed0 con 0x7fddf0076b90 2024-04-25T02:00:33.775 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:33.191+0000 7fdded7fa700 1 -- 172.21.15.77:0/1198302157 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7fdde402b8e0 con 0x7fddf0076b90 2024-04-25T02:00:33.775 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:33.193+0000 7fddf70ae700 1 -- 172.21.15.77:0/1198302157 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fdde0036940 msgr2=0x7fdde0038df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:33.775 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:33.193+0000 7fddf70ae700 1 --2- 172.21.15.77:0/1198302157 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fdde0036940 0x7fdde0038df0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdddc009990 tx=0x7fdddc006e40 comp rx=0 tx=0).stop 2024-04-25T02:00:33.775 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:33.193+0000 7fddf70ae700 1 -- 172.21.15.77:0/1198302157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddf0076b90 msgr2=0x7fddf0111620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:33.775 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:33.193+0000 7fddf70ae700 1 --2- 172.21.15.77:0/1198302157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddf0076b90 0x7fddf0111620 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdde40094c0 tx=0x7fdde4009250 comp rx=0 tx=0).stop 2024-04-25T02:00:33.775 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:33.194+0000 7fddf70ae700 1 -- 172.21.15.77:0/1198302157 shutdown_connections 2024-04-25T02:00:33.775 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:33.194+0000 7fddf70ae700 1 --2- 172.21.15.77:0/1198302157 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fdde0036940 0x7fdde0038df0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:33.775 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:33.194+0000 7fddf70ae700 1 --2- 172.21.15.77:0/1198302157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddf0076b90 0x7fddf0111620 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:33.775 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:33.194+0000 7fddf70ae700 1 -- 172.21.15.77:0/1198302157 >> 172.21.15.77:0/1198302157 conn(0x7fddf00fcef0 msgr2=0x7fddf00fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:33.775 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:33.194+0000 7fddf70ae700 1 -- 172.21.15.77:0/1198302157 shutdown_connections 2024-04-25T02:00:33.775 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-04-25T02:00:33.194+0000 7fddf70ae700 1 -- 172.21.15.77:0/1198302157 wait complete. 2024-04-25T02:00:33.775 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-25T02:00:33.775 INFO:teuthology.orchestra.run.smithi077.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-25T02:00:33.776 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:00:33.776 INFO:teuthology.orchestra.run.smithi077.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-25T02:00:33.776 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:00:33.776 INFO:teuthology.orchestra.run.smithi077.stdout:Or, if you are only running a single cluster on this host: 2024-04-25T02:00:33.776 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:00:33.776 INFO:teuthology.orchestra.run.smithi077.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-25T02:00:33.776 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:00:33.776 INFO:teuthology.orchestra.run.smithi077.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-25T02:00:33.776 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:00:33.776 INFO:teuthology.orchestra.run.smithi077.stdout: ceph telemetry on 2024-04-25T02:00:33.776 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:00:33.776 INFO:teuthology.orchestra.run.smithi077.stdout:For more information see: 2024-04-25T02:00:33.776 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:00:33.776 INFO:teuthology.orchestra.run.smithi077.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-04-25T02:00:33.777 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:00:33.777 INFO:teuthology.orchestra.run.smithi077.stdout:Bootstrap complete. 2024-04-25T02:00:33.799 INFO:tasks.cephadm:Fetching config... 2024-04-25T02:00:33.799 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T02:00:33.799 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-25T02:00:33.814 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-25T02:00:33.814 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T02:00:33.814 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-25T02:00:33.871 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-25T02:00:33.871 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T02:00:33.871 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/keyring of=/dev/stdout 2024-04-25T02:00:33.936 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-25T02:00:33.936 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T02:00:33.936 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-25T02:00:33.992 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-25T02:00:33.992 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxdH7nyo6VX9eDOT3wQZqrCa1FUHos0uAXwuaAbNFIO4cO5TJO8s7fqmDbcFY5vJvf8/tv5abdeo0FerLuUd0s44JXrF+FzQl6VVsZsWnCIm/ggo4vwQzRosV+dnE9Z+JeXtVODFse/taC4hP0dOTdpB9MxW9zsLwUtAXascXXhmC/2jTwuA/pwglkAHZLNYHSnD6euQdlzaSjDO3QA3XILtKn4ok5JUrQOC1wwBe675O2J2Losdz0c1bim8gS1ADIVc58qN7kWJfinGY2ySus0L3geldxXzrFiaUdC5nIpLDNElAPMVnIS1iOXQ/JmZILOxSLYgZxG7EebwM927TizrasfXE9BtgFDOoDO90izdGGblRmqX7k8xna9OO+sZudhvGsb7TazVSfQ8vOy2T1V38hNSJWFp6oAzuHHTs7zuAxdVbsoWD0HpM/yhI6bHNDEw38fK0uFGjFkJm+CDDsXRN7otoEr9WN/XHnJVRz0bhCfqq6sIYD37l6jlYcbsU= ceph-4bb93d82-02a7-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-25T02:00:34.070 INFO:teuthology.orchestra.run.smithi077.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxdH7nyo6VX9eDOT3wQZqrCa1FUHos0uAXwuaAbNFIO4cO5TJO8s7fqmDbcFY5vJvf8/tv5abdeo0FerLuUd0s44JXrF+FzQl6VVsZsWnCIm/ggo4vwQzRosV+dnE9Z+JeXtVODFse/taC4hP0dOTdpB9MxW9zsLwUtAXascXXhmC/2jTwuA/pwglkAHZLNYHSnD6euQdlzaSjDO3QA3XILtKn4ok5JUrQOC1wwBe675O2J2Losdz0c1bim8gS1ADIVc58qN7kWJfinGY2ySus0L3geldxXzrFiaUdC5nIpLDNElAPMVnIS1iOXQ/JmZILOxSLYgZxG7EebwM927TizrasfXE9BtgFDOoDO90izdGGblRmqX7k8xna9OO+sZudhvGsb7TazVSfQ8vOy2T1V38hNSJWFp6oAzuHHTs7zuAxdVbsoWD0HpM/yhI6bHNDEw38fK0uFGjFkJm+CDDsXRN7otoEr9WN/XHnJVRz0bhCfqq6sIYD37l6jlYcbsU= ceph-4bb93d82-02a7-11ef-bc93-c7b262605968 2024-04-25T02:00:34.082 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxdH7nyo6VX9eDOT3wQZqrCa1FUHos0uAXwuaAbNFIO4cO5TJO8s7fqmDbcFY5vJvf8/tv5abdeo0FerLuUd0s44JXrF+FzQl6VVsZsWnCIm/ggo4vwQzRosV+dnE9Z+JeXtVODFse/taC4hP0dOTdpB9MxW9zsLwUtAXascXXhmC/2jTwuA/pwglkAHZLNYHSnD6euQdlzaSjDO3QA3XILtKn4ok5JUrQOC1wwBe675O2J2Losdz0c1bim8gS1ADIVc58qN7kWJfinGY2ySus0L3geldxXzrFiaUdC5nIpLDNElAPMVnIS1iOXQ/JmZILOxSLYgZxG7EebwM927TizrasfXE9BtgFDOoDO90izdGGblRmqX7k8xna9OO+sZudhvGsb7TazVSfQ8vOy2T1V38hNSJWFp6oAzuHHTs7zuAxdVbsoWD0HpM/yhI6bHNDEw38fK0uFGjFkJm+CDDsXRN7otoEr9WN/XHnJVRz0bhCfqq6sIYD37l6jlYcbsU= ceph-4bb93d82-02a7-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-25T02:00:34.122 INFO:teuthology.orchestra.run.smithi112.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxdH7nyo6VX9eDOT3wQZqrCa1FUHos0uAXwuaAbNFIO4cO5TJO8s7fqmDbcFY5vJvf8/tv5abdeo0FerLuUd0s44JXrF+FzQl6VVsZsWnCIm/ggo4vwQzRosV+dnE9Z+JeXtVODFse/taC4hP0dOTdpB9MxW9zsLwUtAXascXXhmC/2jTwuA/pwglkAHZLNYHSnD6euQdlzaSjDO3QA3XILtKn4ok5JUrQOC1wwBe675O2J2Losdz0c1bim8gS1ADIVc58qN7kWJfinGY2ySus0L3geldxXzrFiaUdC5nIpLDNElAPMVnIS1iOXQ/JmZILOxSLYgZxG7EebwM927TizrasfXE9BtgFDOoDO90izdGGblRmqX7k8xna9OO+sZudhvGsb7TazVSfQ8vOy2T1V38hNSJWFp6oAzuHHTs7zuAxdVbsoWD0HpM/yhI6bHNDEw38fK0uFGjFkJm+CDDsXRN7otoEr9WN/XHnJVRz0bhCfqq6sIYD37l6jlYcbsU= ceph-4bb93d82-02a7-11ef-bc93-c7b262605968 2024-04-25T02:00:34.134 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-25T02:00:34.380 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:00:34.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:34 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/1198302157' entity='client.admin' 2024-04-25T02:00:36.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.291+0000 7f615adb0700 1 -- 172.21.15.77:0/3749663408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61540fca40 msgr2=0x7f61540fce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:36.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.291+0000 7f615adb0700 1 --2- 172.21.15.77:0/3749663408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61540fca40 0x7f61540fce50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f61480048c0 tx=0x7f6148009e30 comp rx=0 tx=0).stop 2024-04-25T02:00:36.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.291+0000 7f615adb0700 1 -- 172.21.15.77:0/3749663408 shutdown_connections 2024-04-25T02:00:36.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.291+0000 7f615adb0700 1 --2- 172.21.15.77:0/3749663408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61540fca40 0x7f61540fce50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:36.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.291+0000 7f615adb0700 1 -- 172.21.15.77:0/3749663408 >> 172.21.15.77:0/3749663408 conn(0x7f61540f81a0 msgr2=0x7f61540fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:36.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.291+0000 7f615adb0700 1 -- 172.21.15.77:0/3749663408 shutdown_connections 2024-04-25T02:00:36.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.291+0000 7f615adb0700 1 -- 172.21.15.77:0/3749663408 wait complete. 2024-04-25T02:00:36.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.292+0000 7f615adb0700 1 Processor -- start 2024-04-25T02:00:36.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.292+0000 7f615adb0700 1 -- start start 2024-04-25T02:00:36.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.292+0000 7f615adb0700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61540fca40 0x7f615410d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:36.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.292+0000 7f615adb0700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615410d5d0 con 0x7f61540fca40 2024-04-25T02:00:36.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.292+0000 7f6158b4c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61540fca40 0x7f615410d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:36.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.292+0000 7f6158b4c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61540fca40 0x7f615410d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54504/0 (socket says 172.21.15.77:54504) 2024-04-25T02:00:36.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.292+0000 7f6158b4c700 1 -- 172.21.15.77:0/2605129143 learned_addr learned my addr 172.21.15.77:0/2605129143 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:36.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.292+0000 7f6158b4c700 1 -- 172.21.15.77:0/2605129143 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6148005040 con 0x7f61540fca40 2024-04-25T02:00:36.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.293+0000 7f6158b4c700 1 --2- 172.21.15.77:0/2605129143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61540fca40 0x7f615410d090 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f61480096b0 tx=0x7f6148009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:36.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.293+0000 7f61517fa700 1 -- 172.21.15.77:0/2605129143 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f614800bed0 con 0x7f61540fca40 2024-04-25T02:00:36.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.293+0000 7f61517fa700 1 -- 172.21.15.77:0/2605129143 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f614800b5c0 con 0x7f61540fca40 2024-04-25T02:00:36.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.293+0000 7f615adb0700 1 -- 172.21.15.77:0/2605129143 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615410d7d0 con 0x7f61540fca40 2024-04-25T02:00:36.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.294+0000 7f61517fa700 1 -- 172.21.15.77:0/2605129143 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f614801c5b0 con 0x7f61540fca40 2024-04-25T02:00:36.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.294+0000 7f615adb0700 1 -- 172.21.15.77:0/2605129143 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615410e340 con 0x7f61540fca40 2024-04-25T02:00:36.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.294+0000 7f61517fa700 1 -- 172.21.15.77:0/2605129143 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f614801c820 con 0x7f61540fca40 2024-04-25T02:00:36.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.295+0000 7f61517fa700 1 --2- 172.21.15.77:0/2605129143 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f6144036880 0x7f6144038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:36.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.295+0000 7f61517fa700 1 -- 172.21.15.77:0/2605129143 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6148049a90 con 0x7f61540fca40 2024-04-25T02:00:36.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.295+0000 7f6153fff700 1 --2- 172.21.15.77:0/2605129143 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f6144036880 0x7f6144038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:36.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.295+0000 7f615adb0700 1 -- 172.21.15.77:0/2605129143 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6154102f50 con 0x7f61540fca40 2024-04-25T02:00:36.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.295+0000 7f6153fff700 1 --2- 172.21.15.77:0/2605129143 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f6144036880 0x7f6144038d30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6140009990 tx=0x7f6140006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:36.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.300+0000 7f61517fa700 1 -- 172.21.15.77:0/2605129143 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6148023300 con 0x7f61540fca40 2024-04-25T02:00:36.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.498+0000 7f615adb0700 1 -- 172.21.15.77:0/2605129143 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f615405f5c0 con 0x7f61540fca40 2024-04-25T02:00:36.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.501+0000 7f61517fa700 1 -- 172.21.15.77:0/2605129143 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f6148011b60 con 0x7f61540fca40 2024-04-25T02:00:36.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.503+0000 7f615adb0700 1 -- 172.21.15.77:0/2605129143 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f6144036880 msgr2=0x7f6144038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:36.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.503+0000 7f615adb0700 1 --2- 172.21.15.77:0/2605129143 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f6144036880 0x7f6144038d30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6140009990 tx=0x7f6140006e40 comp rx=0 tx=0).stop 2024-04-25T02:00:36.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.503+0000 7f615adb0700 1 -- 172.21.15.77:0/2605129143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61540fca40 msgr2=0x7f615410d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:36.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.503+0000 7f615adb0700 1 --2- 172.21.15.77:0/2605129143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61540fca40 0x7f615410d090 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f61480096b0 tx=0x7f6148009e30 comp rx=0 tx=0).stop 2024-04-25T02:00:36.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.503+0000 7f615adb0700 1 -- 172.21.15.77:0/2605129143 shutdown_connections 2024-04-25T02:00:36.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.503+0000 7f615adb0700 1 --2- 172.21.15.77:0/2605129143 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f6144036880 0x7f6144038d30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:36.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.503+0000 7f615adb0700 1 --2- 172.21.15.77:0/2605129143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61540fca40 0x7f615410d090 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:36.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.503+0000 7f615adb0700 1 -- 172.21.15.77:0/2605129143 >> 172.21.15.77:0/2605129143 conn(0x7f61540f81a0 msgr2=0x7f6154103b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:36.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.503+0000 7f615adb0700 1 -- 172.21.15.77:0/2605129143 shutdown_connections 2024-04-25T02:00:36.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:36.503+0000 7f615adb0700 1 -- 172.21.15.77:0/2605129143 wait complete. 2024-04-25T02:00:37.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:37 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/2605129143' entity='client.admin' 2024-04-25T02:00:37.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:37 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:37.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:37 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:37.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:37 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi077", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:00:37.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:37 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:37.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:37 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi077", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T02:00:37.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:37 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi077", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-25T02:00:37.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:37 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:37.795 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-25T02:00:37.795 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-25T02:00:38.520 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:38 smithi077 ceph-mon[26330]: Deploying daemon crash.smithi077 on smithi077 2024-04-25T02:00:38.613 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:00:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.168+0000 7f8acdc5f700 1 -- 172.21.15.77:0/2347527237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac80fca30 msgr2=0x7f8ac80fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:41.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.168+0000 7f8acdc5f700 1 --2- 172.21.15.77:0/2347527237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac80fca30 0x7f8ac80fce40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80048c0 tx=0x7f8ab8009e30 comp rx=0 tx=0).stop 2024-04-25T02:00:41.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.168+0000 7f8acdc5f700 1 -- 172.21.15.77:0/2347527237 shutdown_connections 2024-04-25T02:00:41.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.168+0000 7f8acdc5f700 1 --2- 172.21.15.77:0/2347527237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac80fca30 0x7f8ac80fce40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:41.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.168+0000 7f8acdc5f700 1 -- 172.21.15.77:0/2347527237 >> 172.21.15.77:0/2347527237 conn(0x7f8ac80f8170 msgr2=0x7f8ac80fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:41.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.168+0000 7f8acdc5f700 1 -- 172.21.15.77:0/2347527237 shutdown_connections 2024-04-25T02:00:41.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.168+0000 7f8acdc5f700 1 -- 172.21.15.77:0/2347527237 wait complete. 2024-04-25T02:00:41.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.169+0000 7f8acdc5f700 1 Processor -- start 2024-04-25T02:00:41.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.169+0000 7f8acdc5f700 1 -- start start 2024-04-25T02:00:41.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.169+0000 7f8acdc5f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac80fca30 0x7f8ac810d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:41.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.169+0000 7f8acdc5f700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac810d5d0 con 0x7f8ac80fca30 2024-04-25T02:00:41.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.169+0000 7f8ac77fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac80fca30 0x7f8ac810d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:41.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.169+0000 7f8ac77fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac80fca30 0x7f8ac810d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35162/0 (socket says 172.21.15.77:35162) 2024-04-25T02:00:41.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.169+0000 7f8ac77fe700 1 -- 172.21.15.77:0/1749778442 learned_addr learned my addr 172.21.15.77:0/1749778442 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:41.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.169+0000 7f8ac77fe700 1 -- 172.21.15.77:0/1749778442 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab8005040 con 0x7f8ac80fca30 2024-04-25T02:00:41.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.170+0000 7f8ac77fe700 1 --2- 172.21.15.77:0/1749778442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac80fca30 0x7f8ac810d090 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800b3a0 tx=0x7f8ab8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:41.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.170+0000 7f8ac4ff9700 1 -- 172.21.15.77:0/1749778442 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ab8009890 con 0x7f8ac80fca30 2024-04-25T02:00:41.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.170+0000 7f8ac4ff9700 1 -- 172.21.15.77:0/1749778442 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ab801cac0 con 0x7f8ac80fca30 2024-04-25T02:00:41.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.170+0000 7f8acdc5f700 1 -- 172.21.15.77:0/1749778442 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac810d7d0 con 0x7f8ac80fca30 2024-04-25T02:00:41.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.170+0000 7f8ac4ff9700 1 -- 172.21.15.77:0/1749778442 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ab80139a0 con 0x7f8ac80fca30 2024-04-25T02:00:41.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.170+0000 7f8acdc5f700 1 -- 172.21.15.77:0/1749778442 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac810e340 con 0x7f8ac80fca30 2024-04-25T02:00:41.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.171+0000 7f8ac4ff9700 1 -- 172.21.15.77:0/1749778442 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f8ab8022020 con 0x7f8ac80fca30 2024-04-25T02:00:41.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.171+0000 7f8ac4ff9700 1 --2- 172.21.15.77:0/1749778442 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f8ab4036880 0x7f8ab4038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:41.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.171+0000 7f8ac4ff9700 1 -- 172.21.15.77:0/1749778442 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8ab804d810 con 0x7f8ac80fca30 2024-04-25T02:00:41.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.171+0000 7f8abeffd700 1 --2- 172.21.15.77:0/1749778442 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f8ab4036880 0x7f8ab4038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:41.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.171+0000 7f8acdc5f700 1 -- 172.21.15.77:0/1749778442 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac8102f40 con 0x7f8ac80fca30 2024-04-25T02:00:41.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.171+0000 7f8abeffd700 1 --2- 172.21.15.77:0/1749778442 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f8ab4036880 0x7f8ab4038d30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0009990 tx=0x7f8ab0006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:41.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.176+0000 7f8ac4ff9700 1 -- 172.21.15.77:0/1749778442 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8ab8018040 con 0x7f8ac80fca30 2024-04-25T02:00:41.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.380+0000 7f8acdc5f700 1 -- 172.21.15.77:0/1749778442 --> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ac8102920 con 0x7f8ab4036880 2024-04-25T02:00:41.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.383+0000 7f8ac4ff9700 1 -- 172.21.15.77:0/1749778442 <== mgr.14160 v2:172.21.15.77:6800/2375514340 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8ab0009590 con 0x7f8ab4036880 2024-04-25T02:00:41.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.385+0000 7f8acdc5f700 1 -- 172.21.15.77:0/1749778442 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f8ab4036880 msgr2=0x7f8ab4038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:41.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.385+0000 7f8acdc5f700 1 --2- 172.21.15.77:0/1749778442 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f8ab4036880 0x7f8ab4038d30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0009990 tx=0x7f8ab0006e40 comp rx=0 tx=0).stop 2024-04-25T02:00:41.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.385+0000 7f8acdc5f700 1 -- 172.21.15.77:0/1749778442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac80fca30 msgr2=0x7f8ac810d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:41.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.385+0000 7f8acdc5f700 1 --2- 172.21.15.77:0/1749778442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac80fca30 0x7f8ac810d090 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800b3a0 tx=0x7f8ab8009e30 comp rx=0 tx=0).stop 2024-04-25T02:00:41.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.385+0000 7f8acdc5f700 1 -- 172.21.15.77:0/1749778442 shutdown_connections 2024-04-25T02:00:41.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.385+0000 7f8acdc5f700 1 --2- 172.21.15.77:0/1749778442 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f8ab4036880 0x7f8ab4038d30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:41.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.385+0000 7f8acdc5f700 1 --2- 172.21.15.77:0/1749778442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac80fca30 0x7f8ac810d090 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:41.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.385+0000 7f8acdc5f700 1 -- 172.21.15.77:0/1749778442 >> 172.21.15.77:0/1749778442 conn(0x7f8ac80f8170 msgr2=0x7f8ac8103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:41.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.385+0000 7f8acdc5f700 1 -- 172.21.15.77:0/1749778442 shutdown_connections 2024-04-25T02:00:41.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:41.385+0000 7f8acdc5f700 1 -- 172.21.15.77:0/1749778442 wait complete. 2024-04-25T02:00:42.227 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi112 2024-04-25T02:00:42.227 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T02:00:42.227 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/etc/ceph/ceph.conf 2024-04-25T02:00:42.245 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T02:00:42.245 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:00:42.302 INFO:tasks.cephadm:Adding host smithi112 to orchestrator... 2024-04-25T02:00:42.302 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph orch host add smithi112 2024-04-25T02:00:42.469 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:42 smithi077 ceph-mon[26330]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:00:42.469 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:42 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:42.469 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:42 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:42.469 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:42 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:42.469 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:42 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:42.469 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:42 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:42.674 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:00:43.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:43 smithi077 ceph-mon[26330]: Deploying daemon node-exporter.smithi077 on smithi077 2024-04-25T02:00:44.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.308+0000 7fa300694700 1 -- 172.21.15.77:0/931198735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2f80fca40 msgr2=0x7fa2f80fce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:44.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.308+0000 7fa300694700 1 --2- 172.21.15.77:0/931198735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2f80fca40 0x7fa2f80fce50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40048c0 tx=0x7fa2f4009e30 comp rx=0 tx=0).stop 2024-04-25T02:00:44.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.308+0000 7fa300694700 1 -- 172.21.15.77:0/931198735 shutdown_connections 2024-04-25T02:00:44.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.308+0000 7fa300694700 1 --2- 172.21.15.77:0/931198735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2f80fca40 0x7fa2f80fce50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:44.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.308+0000 7fa300694700 1 -- 172.21.15.77:0/931198735 >> 172.21.15.77:0/931198735 conn(0x7fa2f80f81a0 msgr2=0x7fa2f80fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:44.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.308+0000 7fa300694700 1 -- 172.21.15.77:0/931198735 shutdown_connections 2024-04-25T02:00:44.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.308+0000 7fa300694700 1 -- 172.21.15.77:0/931198735 wait complete. 2024-04-25T02:00:44.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.308+0000 7fa300694700 1 Processor -- start 2024-04-25T02:00:44.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.309+0000 7fa300694700 1 -- start start 2024-04-25T02:00:44.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.309+0000 7fa300694700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2f80fca40 0x7fa2f810d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:44.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.309+0000 7fa300694700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f810d5d0 con 0x7fa2f80fca40 2024-04-25T02:00:44.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.309+0000 7fa2fe430700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2f80fca40 0x7fa2f810d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:44.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.309+0000 7fa2fe430700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2f80fca40 0x7fa2f810d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35194/0 (socket says 172.21.15.77:35194) 2024-04-25T02:00:44.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.309+0000 7fa2fe430700 1 -- 172.21.15.77:0/3551187270 learned_addr learned my addr 172.21.15.77:0/3551187270 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:44.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.309+0000 7fa2fe430700 1 -- 172.21.15.77:0/3551187270 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f4005040 con 0x7fa2f80fca40 2024-04-25T02:00:44.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.309+0000 7fa2fe430700 1 --2- 172.21.15.77:0/3551187270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2f80fca40 0x7fa2f810d090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4009680 tx=0x7fa2f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:44.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.309+0000 7fa2eeffd700 1 -- 172.21.15.77:0/3551187270 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa2f400b5c0 con 0x7fa2f80fca40 2024-04-25T02:00:44.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.309+0000 7fa2eeffd700 1 -- 172.21.15.77:0/3551187270 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa2f400be70 con 0x7fa2f80fca40 2024-04-25T02:00:44.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.309+0000 7fa300694700 1 -- 172.21.15.77:0/3551187270 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f810d7d0 con 0x7fa2f80fca40 2024-04-25T02:00:44.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.309+0000 7fa2eeffd700 1 -- 172.21.15.77:0/3551187270 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa2f40135a0 con 0x7fa2f80fca40 2024-04-25T02:00:44.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.309+0000 7fa300694700 1 -- 172.21.15.77:0/3551187270 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f810e340 con 0x7fa2f80fca40 2024-04-25T02:00:44.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.310+0000 7fa2eeffd700 1 -- 172.21.15.77:0/3551187270 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fa2f4013860 con 0x7fa2f80fca40 2024-04-25T02:00:44.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.310+0000 7fa300694700 1 -- 172.21.15.77:0/3551187270 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f8102f50 con 0x7fa2f80fca40 2024-04-25T02:00:44.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.310+0000 7fa2eeffd700 1 --2- 172.21.15.77:0/3551187270 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fa2e4036880 0x7fa2e4038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:44.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.310+0000 7fa2eeffd700 1 -- 172.21.15.77:0/3551187270 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa2f40493b0 con 0x7fa2f80fca40 2024-04-25T02:00:44.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.310+0000 7fa2fdc2f700 1 --2- 172.21.15.77:0/3551187270 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fa2e4036880 0x7fa2e4038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:44.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.311+0000 7fa2fdc2f700 1 --2- 172.21.15.77:0/3551187270 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fa2e4036880 0x7fa2e4038d30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8009990 tx=0x7fa2e8006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:44.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.315+0000 7fa2eeffd700 1 -- 172.21.15.77:0/3551187270 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa2f4011960 con 0x7fa2f80fca40 2024-04-25T02:00:44.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:44.535+0000 7fa300694700 1 -- 172.21.15.77:0/3551187270 --> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi112", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2f810e580 con 0x7fa2e4036880 2024-04-25T02:00:44.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:44 smithi077 ceph-mon[26330]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi112", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:00:46.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:46.372+0000 7fa2eeffd700 1 -- 172.21.15.77:0/3551187270 <== mgr.14160 v2:172.21.15.77:6800/2375514340 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fa2f810e580 con 0x7fa2e4036880 2024-04-25T02:00:46.376 INFO:teuthology.orchestra.run.smithi077.stdout:Added host 'smithi112' with addr '172.21.15.112' 2024-04-25T02:00:46.377 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:46 smithi077 ceph-mon[26330]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:46.377 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:46 smithi077 ceph-mon[26330]: Deploying cephadm binary to smithi112 2024-04-25T02:00:46.377 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:46 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:46.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:46.374+0000 7fa300694700 1 -- 172.21.15.77:0/3551187270 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fa2e4036880 msgr2=0x7fa2e4038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:46.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:46.374+0000 7fa300694700 1 --2- 172.21.15.77:0/3551187270 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fa2e4036880 0x7fa2e4038d30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8009990 tx=0x7fa2e8006e40 comp rx=0 tx=0).stop 2024-04-25T02:00:46.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:46.374+0000 7fa300694700 1 -- 172.21.15.77:0/3551187270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2f80fca40 msgr2=0x7fa2f810d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:46.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:46.374+0000 7fa300694700 1 --2- 172.21.15.77:0/3551187270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2f80fca40 0x7fa2f810d090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4009680 tx=0x7fa2f4009e30 comp rx=0 tx=0).stop 2024-04-25T02:00:46.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:46.374+0000 7fa300694700 1 -- 172.21.15.77:0/3551187270 shutdown_connections 2024-04-25T02:00:46.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:46.374+0000 7fa300694700 1 --2- 172.21.15.77:0/3551187270 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fa2e4036880 0x7fa2e4038d30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:46.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:46.374+0000 7fa300694700 1 --2- 172.21.15.77:0/3551187270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2f80fca40 0x7fa2f810d090 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:46.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:46.374+0000 7fa300694700 1 -- 172.21.15.77:0/3551187270 >> 172.21.15.77:0/3551187270 conn(0x7fa2f80f81a0 msgr2=0x7fa2f8103b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:46.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:46.374+0000 7fa300694700 1 -- 172.21.15.77:0/3551187270 shutdown_connections 2024-04-25T02:00:46.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:46.374+0000 7fa300694700 1 -- 172.21.15.77:0/3551187270 wait complete. 2024-04-25T02:00:46.992 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-25T02:00:47.247 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:00:47.274 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:47 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:47.588 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:47 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:47.588 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:47 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:47.588 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:47 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:47.588 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:47 smithi077 ceph-mon[26330]: Deploying daemon alertmanager.smithi077 on smithi077 2024-04-25T02:00:47.588 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:47 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:47.588 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:47 smithi077 ceph-mon[26330]: Added host smithi112 2024-04-25T02:00:48.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:48 smithi077 ceph-mon[26330]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:49.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.408+0000 7f8560fd7700 1 -- 172.21.15.77:0/1296263895 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f855c0fb960 msgr2=0x7f855c0fbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:49.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.408+0000 7f8560fd7700 1 --2- 172.21.15.77:0/1296263895 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f855c0fb960 0x7f855c0fbd70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f854c0048c0 tx=0x7f854c009e30 comp rx=0 tx=0).stop 2024-04-25T02:00:49.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.409+0000 7f8560fd7700 1 -- 172.21.15.77:0/1296263895 shutdown_connections 2024-04-25T02:00:49.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.409+0000 7f8560fd7700 1 --2- 172.21.15.77:0/1296263895 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f855c0fb960 0x7f855c0fbd70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:49.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.409+0000 7f8560fd7700 1 -- 172.21.15.77:0/1296263895 >> 172.21.15.77:0/1296263895 conn(0x7f855c0f70c0 msgr2=0x7f855c0f94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:49.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.409+0000 7f8560fd7700 1 -- 172.21.15.77:0/1296263895 shutdown_connections 2024-04-25T02:00:49.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.409+0000 7f8560fd7700 1 -- 172.21.15.77:0/1296263895 wait complete. 2024-04-25T02:00:49.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.409+0000 7f8560fd7700 1 Processor -- start 2024-04-25T02:00:49.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.409+0000 7f8560fd7700 1 -- start start 2024-04-25T02:00:49.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.409+0000 7f8560fd7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f855c0fb960 0x7f855c066820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:49.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.409+0000 7f8560fd7700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c10fd90 con 0x7f855c0fb960 2024-04-25T02:00:49.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.410+0000 7f855a59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f855c0fb960 0x7f855c066820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:49.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.410+0000 7f855a59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f855c0fb960 0x7f855c066820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38102/0 (socket says 172.21.15.77:38102) 2024-04-25T02:00:49.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.410+0000 7f855a59c700 1 -- 172.21.15.77:0/3119841075 learned_addr learned my addr 172.21.15.77:0/3119841075 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:49.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.410+0000 7f855a59c700 1 -- 172.21.15.77:0/3119841075 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c005040 con 0x7f855c0fb960 2024-04-25T02:00:49.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.410+0000 7f855a59c700 1 --2- 172.21.15.77:0/3119841075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f855c0fb960 0x7f855c066820 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f854c0096b0 tx=0x7f854c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:49.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.410+0000 7f854affd700 1 -- 172.21.15.77:0/3119841075 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f854c00bed0 con 0x7f855c0fb960 2024-04-25T02:00:49.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.410+0000 7f854affd700 1 -- 172.21.15.77:0/3119841075 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f854c00b5c0 con 0x7f855c0fb960 2024-04-25T02:00:49.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.410+0000 7f8560fd7700 1 -- 172.21.15.77:0/3119841075 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855c10fed0 con 0x7f855c0fb960 2024-04-25T02:00:49.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.410+0000 7f854affd700 1 -- 172.21.15.77:0/3119841075 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f854c01c5b0 con 0x7f855c0fb960 2024-04-25T02:00:49.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.410+0000 7f8560fd7700 1 -- 172.21.15.77:0/3119841075 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855c1103c0 con 0x7f855c0fb960 2024-04-25T02:00:49.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.411+0000 7f854affd700 1 -- 172.21.15.77:0/3119841075 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f854c01c820 con 0x7f855c0fb960 2024-04-25T02:00:49.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.411+0000 7f854affd700 1 --2- 172.21.15.77:0/3119841075 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f8544036880 0x7f8544038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:49.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.411+0000 7f854affd700 1 -- 172.21.15.77:0/3119841075 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f854c049b50 con 0x7f855c0fb960 2024-04-25T02:00:49.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.411+0000 7f8560fd7700 1 -- 172.21.15.77:0/3119841075 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855c105920 con 0x7f855c0fb960 2024-04-25T02:00:49.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.411+0000 7f8559d9b700 1 --2- 172.21.15.77:0/3119841075 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f8544036880 0x7f8544038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:49.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.412+0000 7f8559d9b700 1 --2- 172.21.15.77:0/3119841075 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f8544036880 0x7f8544038d30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8550009990 tx=0x7f8550006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:49.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.416+0000 7f854affd700 1 -- 172.21.15.77:0/3119841075 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f854c013420 con 0x7f855c0fb960 2024-04-25T02:00:49.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.636+0000 7f8560fd7700 1 -- 172.21.15.77:0/3119841075 --> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f855c101810 con 0x7f8544036880 2024-04-25T02:00:49.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.637+0000 7f854affd700 1 -- 172.21.15.77:0/3119841075 <== mgr.14160 v2:172.21.15.77:6800/2375514340 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f855c101810 con 0x7f8544036880 2024-04-25T02:00:49.641 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:00:49.641 INFO:teuthology.orchestra.run.smithi077.stdout:[{"addr": "172.21.15.77", "hostname": "smithi077", "labels": [], "status": ""}, {"addr": "172.21.15.112", "hostname": "smithi112", "labels": [], "status": ""}] 2024-04-25T02:00:49.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.640+0000 7f8560fd7700 1 -- 172.21.15.77:0/3119841075 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f8544036880 msgr2=0x7f8544038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:49.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.640+0000 7f8560fd7700 1 --2- 172.21.15.77:0/3119841075 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f8544036880 0x7f8544038d30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8550009990 tx=0x7f8550006e40 comp rx=0 tx=0).stop 2024-04-25T02:00:49.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.640+0000 7f8560fd7700 1 -- 172.21.15.77:0/3119841075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f855c0fb960 msgr2=0x7f855c066820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:49.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.640+0000 7f8560fd7700 1 --2- 172.21.15.77:0/3119841075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f855c0fb960 0x7f855c066820 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f854c0096b0 tx=0x7f854c009e30 comp rx=0 tx=0).stop 2024-04-25T02:00:49.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.640+0000 7f8560fd7700 1 -- 172.21.15.77:0/3119841075 shutdown_connections 2024-04-25T02:00:49.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.640+0000 7f8560fd7700 1 --2- 172.21.15.77:0/3119841075 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f8544036880 0x7f8544038d30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:49.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.640+0000 7f8560fd7700 1 --2- 172.21.15.77:0/3119841075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f855c0fb960 0x7f855c066820 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:49.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.640+0000 7f8560fd7700 1 -- 172.21.15.77:0/3119841075 >> 172.21.15.77:0/3119841075 conn(0x7f855c0f70c0 msgr2=0x7f855c102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:49.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.640+0000 7f8560fd7700 1 -- 172.21.15.77:0/3119841075 shutdown_connections 2024-04-25T02:00:49.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:49.640+0000 7f8560fd7700 1 -- 172.21.15.77:0/3119841075 wait complete. 2024-04-25T02:00:50.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:50 smithi077 ceph-mon[26330]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:50.778 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:50 smithi077 ceph-mon[26330]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:00:50.778 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:50 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:51.098 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-25T02:00:51.098 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph osd crush tunables default 2024-04-25T02:00:51.411 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:00:52.686 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:52 smithi077 ceph-mon[26330]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:54.474 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:54 smithi077 ceph-mon[26330]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:55.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.677+0000 7ff5f116a700 1 -- 172.21.15.77:0/1132214586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5ec0fca30 msgr2=0x7ff5ec0fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:55.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.677+0000 7ff5f116a700 1 --2- 172.21.15.77:0/1132214586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5ec0fca30 0x7ff5ec0fce40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc0048c0 tx=0x7ff5dc009e30 comp rx=0 tx=0).stop 2024-04-25T02:00:55.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.677+0000 7ff5f116a700 1 -- 172.21.15.77:0/1132214586 shutdown_connections 2024-04-25T02:00:55.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.677+0000 7ff5f116a700 1 --2- 172.21.15.77:0/1132214586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5ec0fca30 0x7ff5ec0fce40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:55.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.677+0000 7ff5f116a700 1 -- 172.21.15.77:0/1132214586 >> 172.21.15.77:0/1132214586 conn(0x7ff5ec0f8190 msgr2=0x7ff5ec0fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:55.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.677+0000 7ff5f116a700 1 -- 172.21.15.77:0/1132214586 shutdown_connections 2024-04-25T02:00:55.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.677+0000 7ff5f116a700 1 -- 172.21.15.77:0/1132214586 wait complete. 2024-04-25T02:00:55.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.677+0000 7ff5f116a700 1 Processor -- start 2024-04-25T02:00:55.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.678+0000 7ff5f116a700 1 -- start start 2024-04-25T02:00:55.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.678+0000 7ff5f116a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5ec0fca30 0x7ff5ec10d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:55.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.678+0000 7ff5f116a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec10d5c0 con 0x7ff5ec0fca30 2024-04-25T02:00:55.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.678+0000 7ff5ead9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5ec0fca30 0x7ff5ec10d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:55.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.678+0000 7ff5ead9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5ec0fca30 0x7ff5ec10d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38120/0 (socket says 172.21.15.77:38120) 2024-04-25T02:00:55.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.678+0000 7ff5ead9d700 1 -- 172.21.15.77:0/3826021701 learned_addr learned my addr 172.21.15.77:0/3826021701 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:00:55.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.678+0000 7ff5ead9d700 1 -- 172.21.15.77:0/3826021701 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5dc005040 con 0x7ff5ec0fca30 2024-04-25T02:00:55.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.678+0000 7ff5ead9d700 1 --2- 172.21.15.77:0/3826021701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5ec0fca30 0x7ff5ec10d080 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc0096b0 tx=0x7ff5dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:55.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.678+0000 7ff5d37fe700 1 -- 172.21.15.77:0/3826021701 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff5dc00bed0 con 0x7ff5ec0fca30 2024-04-25T02:00:55.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.678+0000 7ff5d37fe700 1 -- 172.21.15.77:0/3826021701 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff5dc00b5c0 con 0x7ff5ec0fca30 2024-04-25T02:00:55.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.678+0000 7ff5f116a700 1 -- 172.21.15.77:0/3826021701 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ec10d7c0 con 0x7ff5ec0fca30 2024-04-25T02:00:55.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.678+0000 7ff5d37fe700 1 -- 172.21.15.77:0/3826021701 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff5dc01c5b0 con 0x7ff5ec0fca30 2024-04-25T02:00:55.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.679+0000 7ff5f116a700 1 -- 172.21.15.77:0/3826021701 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ec10e330 con 0x7ff5ec0fca30 2024-04-25T02:00:55.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.679+0000 7ff5d37fe700 1 -- 172.21.15.77:0/3826021701 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7ff5dc01c820 con 0x7ff5ec0fca30 2024-04-25T02:00:55.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.679+0000 7ff5d37fe700 1 --2- 172.21.15.77:0/3826021701 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7ff5d4036880 0x7ff5d4038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:55.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.679+0000 7ff5d37fe700 1 -- 172.21.15.77:0/3826021701 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff5dc013a80 con 0x7ff5ec0fca30 2024-04-25T02:00:55.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.680+0000 7ff5ea59c700 1 --2- 172.21.15.77:0/3826021701 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7ff5d4036880 0x7ff5d4038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:55.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.680+0000 7ff5f116a700 1 -- 172.21.15.77:0/3826021701 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5ec102f40 con 0x7ff5ec0fca30 2024-04-25T02:00:55.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.680+0000 7ff5ea59c700 1 --2- 172.21.15.77:0/3826021701 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7ff5d4036880 0x7ff5d4038d30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0009990 tx=0x7ff5e0006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:55.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.684+0000 7ff5d37fe700 1 -- 172.21.15.77:0/3826021701 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff5dc023300 con 0x7ff5ec0fca30 2024-04-25T02:00:55.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:55.889+0000 7ff5f116a700 1 -- 172.21.15.77:0/3826021701 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff5ec04bed0 con 0x7ff5ec0fca30 2024-04-25T02:00:56.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:56.383+0000 7ff5d37fe700 1 -- 172.21.15.77:0/3826021701 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff5dc011b60 con 0x7ff5ec0fca30 2024-04-25T02:00:56.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:56.385+0000 7ff5f116a700 1 -- 172.21.15.77:0/3826021701 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7ff5d4036880 msgr2=0x7ff5d4038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:56.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:56.385+0000 7ff5f116a700 1 --2- 172.21.15.77:0/3826021701 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7ff5d4036880 0x7ff5d4038d30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0009990 tx=0x7ff5e0006e40 comp rx=0 tx=0).stop 2024-04-25T02:00:56.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:56.385+0000 7ff5f116a700 1 -- 172.21.15.77:0/3826021701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5ec0fca30 msgr2=0x7ff5ec10d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:56.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:56.385+0000 7ff5f116a700 1 --2- 172.21.15.77:0/3826021701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5ec0fca30 0x7ff5ec10d080 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc0096b0 tx=0x7ff5dc009e30 comp rx=0 tx=0).stop 2024-04-25T02:00:56.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:56.385+0000 7ff5f116a700 1 -- 172.21.15.77:0/3826021701 shutdown_connections 2024-04-25T02:00:56.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:56.385+0000 7ff5f116a700 1 --2- 172.21.15.77:0/3826021701 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7ff5d4036880 0x7ff5d4038d30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:56.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:56.385+0000 7ff5f116a700 1 --2- 172.21.15.77:0/3826021701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5ec0fca30 0x7ff5ec10d080 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:56.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:56.385+0000 7ff5f116a700 1 -- 172.21.15.77:0/3826021701 >> 172.21.15.77:0/3826021701 conn(0x7ff5ec0f8190 msgr2=0x7ff5ec103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:56.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:56.385+0000 7ff5f116a700 1 -- 172.21.15.77:0/3826021701 shutdown_connections 2024-04-25T02:00:56.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:00:56.385+0000 7ff5f116a700 1 -- 172.21.15.77:0/3826021701 wait complete. 2024-04-25T02:00:56.391 INFO:teuthology.orchestra.run.smithi077.stderr:adjusted tunables profile to default 2024-04-25T02:00:56.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:56 smithi077 ceph-mon[26330]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:56.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:56 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/3826021701' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-25T02:00:57.139 INFO:tasks.cephadm:Adding mon.smithi077 on smithi077 2024-04-25T02:00:57.139 INFO:tasks.cephadm:Adding mon.smithi112 on smithi112 2024-04-25T02:00:57.139 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph orch apply mon '2;smithi077:172.21.15.77=smithi077;smithi112:172.21.15.112=smithi112' 2024-04-25T02:00:57.430 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T02:00:57.477 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T02:00:57.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:57 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/3826021701' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-25T02:00:57.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:57 smithi077 ceph-mon[26330]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T02:00:57.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:57 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:57.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:57 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:57.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:57 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:57.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:57 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:57.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:57 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:57.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:57 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:57.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:57 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-25T02:00:57.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:57 smithi077 ceph-mon[26330]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-25T02:00:57.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:57 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:00:57.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:57 smithi077 ceph-mon[26330]: Deploying daemon grafana.smithi077 on smithi077 2024-04-25T02:00:58.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:00:58 smithi077 ceph-mon[26330]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:58.888 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:58.883+0000 7f870a1ec700 1 -- 172.21.15.112:0/2158765191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87040fca30 msgr2=0x7f87040fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:58.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:58.883+0000 7f870a1ec700 1 --2- 172.21.15.112:0/2158765191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87040fca30 0x7f87040fce40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f86f40048c0 tx=0x7f86f4009e30 comp rx=0 tx=0).stop 2024-04-25T02:00:58.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:58.884+0000 7f870a1ec700 1 -- 172.21.15.112:0/2158765191 shutdown_connections 2024-04-25T02:00:58.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:58.884+0000 7f870a1ec700 1 --2- 172.21.15.112:0/2158765191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87040fca30 0x7f87040fce40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:58.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:58.884+0000 7f870a1ec700 1 -- 172.21.15.112:0/2158765191 >> 172.21.15.112:0/2158765191 conn(0x7f87040f8170 msgr2=0x7f87040fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:58.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:58.884+0000 7f870a1ec700 1 -- 172.21.15.112:0/2158765191 shutdown_connections 2024-04-25T02:00:58.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:58.884+0000 7f870a1ec700 1 -- 172.21.15.112:0/2158765191 wait complete. 2024-04-25T02:00:58.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:58.884+0000 7f870a1ec700 1 Processor -- start 2024-04-25T02:00:58.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:58.884+0000 7f870a1ec700 1 -- start start 2024-04-25T02:00:58.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:58.884+0000 7f870a1ec700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87040fca30 0x7f870410d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:58.889 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:58.884+0000 7f870a1ec700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870410d5f0 con 0x7f87040fca30 2024-04-25T02:00:58.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:58.885+0000 7f87037fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87040fca30 0x7f870410d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:58.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:58.885+0000 7f87037fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87040fca30 0x7f870410d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.112:47366/0 (socket says 172.21.15.112:47366) 2024-04-25T02:00:58.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:58.885+0000 7f87037fe700 1 -- 172.21.15.112:0/2384786892 learned_addr learned my addr 172.21.15.112:0/2384786892 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T02:00:58.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:58.885+0000 7f87037fe700 1 -- 172.21.15.112:0/2384786892 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f4005040 con 0x7f87040fca30 2024-04-25T02:00:58.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:58.885+0000 7f87037fe700 1 --2- 172.21.15.112:0/2384786892 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87040fca30 0x7f870410d0b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f86f40096b0 tx=0x7f86f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:58.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:58.885+0000 7f86ebfff700 1 -- 172.21.15.112:0/2384786892 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86f400bed0 con 0x7f87040fca30 2024-04-25T02:00:58.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:58.885+0000 7f870a1ec700 1 -- 172.21.15.112:0/2384786892 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f870410d7f0 con 0x7f87040fca30 2024-04-25T02:00:58.891 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:58.885+0000 7f86ebfff700 1 -- 172.21.15.112:0/2384786892 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f86f400b5c0 con 0x7f87040fca30 2024-04-25T02:00:58.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:58.885+0000 7f86ebfff700 1 -- 172.21.15.112:0/2384786892 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86f401c5b0 con 0x7f87040fca30 2024-04-25T02:00:58.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:58.885+0000 7f870a1ec700 1 -- 172.21.15.112:0/2384786892 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f870410e360 con 0x7f87040fca30 2024-04-25T02:00:58.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:58.886+0000 7f86ebfff700 1 -- 172.21.15.112:0/2384786892 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f86f401c820 con 0x7f87040fca30 2024-04-25T02:00:58.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:58.886+0000 7f86ebfff700 1 --2- 172.21.15.112:0/2384786892 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f86ec036880 0x7f86ec038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:58.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:58.886+0000 7f86ebfff700 1 -- 172.21.15.112:0/2384786892 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f86f4049b00 con 0x7f87040fca30 2024-04-25T02:00:58.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:58.886+0000 7f870a1ec700 1 -- 172.21.15.112:0/2384786892 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8704102f40 con 0x7f87040fca30 2024-04-25T02:00:58.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:58.887+0000 7f8702ffd700 1 --2- 172.21.15.112:0/2384786892 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f86ec036880 0x7f86ec038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:58.892 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:58.887+0000 7f8702ffd700 1 --2- 172.21.15.112:0/2384786892 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f86ec036880 0x7f86ec038d30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f86f8009990 tx=0x7f86f8006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:58.896 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:58.892+0000 7f86ebfff700 1 -- 172.21.15.112:0/2384786892 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f86f4023300 con 0x7f87040fca30 2024-04-25T02:00:59.092 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:59.087+0000 7f870a1ec700 1 -- 172.21.15.112:0/2384786892 --> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi077:172.21.15.77=smithi077;smithi112:172.21.15.112=smithi112", "target": ["mon-mgr", ""]}) v1 -- 0x7f870410e5a0 con 0x7f86ec036880 2024-04-25T02:00:59.097 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:59.093+0000 7f86ebfff700 1 -- 172.21.15.112:0/2384786892 <== mgr.14160 v2:172.21.15.77:6800/2375514340 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f870410e5a0 con 0x7f86ec036880 2024-04-25T02:00:59.097 INFO:teuthology.orchestra.run.smithi112.stdout:Scheduled mon update... 2024-04-25T02:00:59.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:59.094+0000 7f870a1ec700 1 -- 172.21.15.112:0/2384786892 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f86ec036880 msgr2=0x7f86ec038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:59.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:59.094+0000 7f870a1ec700 1 --2- 172.21.15.112:0/2384786892 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f86ec036880 0x7f86ec038d30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f86f8009990 tx=0x7f86f8006e40 comp rx=0 tx=0).stop 2024-04-25T02:00:59.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:59.094+0000 7f870a1ec700 1 -- 172.21.15.112:0/2384786892 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87040fca30 msgr2=0x7f870410d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:59.099 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:59.094+0000 7f870a1ec700 1 --2- 172.21.15.112:0/2384786892 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87040fca30 0x7f870410d0b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f86f40096b0 tx=0x7f86f4009e30 comp rx=0 tx=0).stop 2024-04-25T02:00:59.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:59.094+0000 7f870a1ec700 1 -- 172.21.15.112:0/2384786892 shutdown_connections 2024-04-25T02:00:59.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:59.094+0000 7f870a1ec700 1 --2- 172.21.15.112:0/2384786892 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f86ec036880 0x7f86ec038d30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:59.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:59.094+0000 7f870a1ec700 1 --2- 172.21.15.112:0/2384786892 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87040fca30 0x7f870410d0b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:59.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:59.095+0000 7f870a1ec700 1 -- 172.21.15.112:0/2384786892 >> 172.21.15.112:0/2384786892 conn(0x7f87040f8170 msgr2=0x7f8704103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:59.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:59.095+0000 7f870a1ec700 1 -- 172.21.15.112:0/2384786892 shutdown_connections 2024-04-25T02:00:59.100 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:00:59.095+0000 7f870a1ec700 1 -- 172.21.15.112:0/2384786892 wait complete. 2024-04-25T02:00:59.641 DEBUG:teuthology.orchestra.run.smithi112:mon.smithi112> sudo journalctl -f -n 0 -u ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@mon.smithi112.service 2024-04-25T02:00:59.643 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T02:00:59.643 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T02:00:59.917 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T02:00:59.965 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T02:01:00.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:00 smithi077 ceph-mon[26330]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:00.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:00 smithi077 ceph-mon[26330]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi077:172.21.15.77=smithi077;smithi112:172.21.15.112=smithi112", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:01:00.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:00 smithi077 ceph-mon[26330]: Saving service mon spec with placement smithi077:172.21.15.77=smithi077;smithi112:172.21.15.112=smithi112;count:2 2024-04-25T02:01:00.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:00 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:01.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.444+0000 7f58963d2700 1 -- 172.21.15.112:0/2169003908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58900fb940 msgr2=0x7f58900fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:01.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.444+0000 7f58963d2700 1 --2- 172.21.15.112:0/2169003908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58900fb940 0x7f58900fbd50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f58800048c0 tx=0x7f5880009e30 comp rx=0 tx=0).stop 2024-04-25T02:01:01.450 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.444+0000 7f58963d2700 1 -- 172.21.15.112:0/2169003908 shutdown_connections 2024-04-25T02:01:01.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.444+0000 7f58963d2700 1 --2- 172.21.15.112:0/2169003908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58900fb940 0x7f58900fbd50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:01.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.444+0000 7f58963d2700 1 -- 172.21.15.112:0/2169003908 >> 172.21.15.112:0/2169003908 conn(0x7f58900f70a0 msgr2=0x7f58900f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:01.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.444+0000 7f58963d2700 1 -- 172.21.15.112:0/2169003908 shutdown_connections 2024-04-25T02:01:01.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.444+0000 7f58963d2700 1 -- 172.21.15.112:0/2169003908 wait complete. 2024-04-25T02:01:01.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.444+0000 7f58963d2700 1 Processor -- start 2024-04-25T02:01:01.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.445+0000 7f58963d2700 1 -- start start 2024-04-25T02:01:01.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.445+0000 7f58963d2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58900fb940 0x7f5890065c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:01.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.445+0000 7f58963d2700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589010fd50 con 0x7f58900fb940 2024-04-25T02:01:01.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.445+0000 7f588ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58900fb940 0x7f5890065c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:01.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.445+0000 7f588ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58900fb940 0x7f5890065c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.112:47380/0 (socket says 172.21.15.112:47380) 2024-04-25T02:01:01.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.445+0000 7f588ffff700 1 -- 172.21.15.112:0/457401735 learned_addr learned my addr 172.21.15.112:0/457401735 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T02:01:01.451 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.445+0000 7f588ffff700 1 -- 172.21.15.112:0/457401735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5880005040 con 0x7f58900fb940 2024-04-25T02:01:01.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.445+0000 7f588ffff700 1 --2- 172.21.15.112:0/457401735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58900fb940 0x7f5890065c10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5880009680 tx=0x7f5880009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:01.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.446+0000 7f588cff9700 1 -- 172.21.15.112:0/457401735 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f588000b5c0 con 0x7f58900fb940 2024-04-25T02:01:01.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.446+0000 7f588cff9700 1 -- 172.21.15.112:0/457401735 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f588000be70 con 0x7f58900fb940 2024-04-25T02:01:01.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.446+0000 7f58963d2700 1 -- 172.21.15.112:0/457401735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f589010fef0 con 0x7f58900fb940 2024-04-25T02:01:01.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.446+0000 7f588cff9700 1 -- 172.21.15.112:0/457401735 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58800135a0 con 0x7f58900fb940 2024-04-25T02:01:01.452 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.446+0000 7f58963d2700 1 -- 172.21.15.112:0/457401735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5890110380 con 0x7f58900fb940 2024-04-25T02:01:01.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.446+0000 7f588cff9700 1 -- 172.21.15.112:0/457401735 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f5880013860 con 0x7f58900fb940 2024-04-25T02:01:01.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.446+0000 7f58963d2700 1 -- 172.21.15.112:0/457401735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5890105900 con 0x7f58900fb940 2024-04-25T02:01:01.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.447+0000 7f588cff9700 1 --2- 172.21.15.112:0/457401735 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f5878036880 0x7f5878038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:01.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.447+0000 7f588cff9700 1 -- 172.21.15.112:0/457401735 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f58800493e0 con 0x7f58900fb940 2024-04-25T02:01:01.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.447+0000 7f588f7fe700 1 --2- 172.21.15.112:0/457401735 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f5878036880 0x7f5878038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:01.453 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.447+0000 7f588f7fe700 1 --2- 172.21.15.112:0/457401735 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f5878036880 0x7f5878038d30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5884009990 tx=0x7f5884006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:01.456 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.451+0000 7f588cff9700 1 -- 172.21.15.112:0/457401735 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5880011bf0 con 0x7f58900fb940 2024-04-25T02:01:01.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:01 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:01.722 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.718+0000 7f58963d2700 1 -- 172.21.15.112:0/457401735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f589005f5c0 con 0x7f58900fb940 2024-04-25T02:01:01.723 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.718+0000 7f588cff9700 1 -- 172.21.15.112:0/457401735 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f5880021070 con 0x7f58900fb940 2024-04-25T02:01:01.723 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T02:01:01.723 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"4bb93d82-02a7-11ef-bc93-c7b262605968","modified":"2024-04-25T01:59:19.321779Z","created":"2024-04-25T01:59:19.321779Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi077","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T02:01:01.724 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.720+0000 7f58963d2700 1 -- 172.21.15.112:0/457401735 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f5878036880 msgr2=0x7f5878038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:01.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.720+0000 7f58963d2700 1 --2- 172.21.15.112:0/457401735 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f5878036880 0x7f5878038d30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5884009990 tx=0x7f5884006e40 comp rx=0 tx=0).stop 2024-04-25T02:01:01.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.720+0000 7f58963d2700 1 -- 172.21.15.112:0/457401735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58900fb940 msgr2=0x7f5890065c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:01.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.720+0000 7f58963d2700 1 --2- 172.21.15.112:0/457401735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58900fb940 0x7f5890065c10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5880009680 tx=0x7f5880009e30 comp rx=0 tx=0).stop 2024-04-25T02:01:01.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.720+0000 7f58963d2700 1 -- 172.21.15.112:0/457401735 shutdown_connections 2024-04-25T02:01:01.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.720+0000 7f58963d2700 1 --2- 172.21.15.112:0/457401735 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f5878036880 0x7f5878038d30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:01.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.720+0000 7f58963d2700 1 --2- 172.21.15.112:0/457401735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58900fb940 0x7f5890065c10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:01.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.720+0000 7f58963d2700 1 -- 172.21.15.112:0/457401735 >> 172.21.15.112:0/457401735 conn(0x7f58900f70a0 msgr2=0x7f5890102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:01.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.720+0000 7f58963d2700 1 -- 172.21.15.112:0/457401735 shutdown_connections 2024-04-25T02:01:01.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:01.720+0000 7f58963d2700 1 -- 172.21.15.112:0/457401735 wait complete. 2024-04-25T02:01:01.725 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-04-25T02:01:02.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:02 smithi077 ceph-mon[26330]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:02.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:02 smithi077 ceph-mon[26330]: from='client.? 172.21.15.112:0/457401735' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:01:03.313 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T02:01:03.313 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T02:01:03.561 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T02:01:03.608 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T02:01:04.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:04 smithi077 ceph-mon[26330]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:04.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:04.963+0000 7f9126d0b700 1 -- 172.21.15.112:0/2753015475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91200fca30 msgr2=0x7f91200fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:04.969 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:04.963+0000 7f9126d0b700 1 --2- 172.21.15.112:0/2753015475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91200fca30 0x7f91200fce40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9118009c60 tx=0x7f9118004d10 comp rx=0 tx=0).stop 2024-04-25T02:01:04.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:04.963+0000 7f9126d0b700 1 -- 172.21.15.112:0/2753015475 shutdown_connections 2024-04-25T02:01:04.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:04.963+0000 7f9126d0b700 1 --2- 172.21.15.112:0/2753015475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91200fca30 0x7f91200fce40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:04.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:04.963+0000 7f9126d0b700 1 -- 172.21.15.112:0/2753015475 >> 172.21.15.112:0/2753015475 conn(0x7f91200f8170 msgr2=0x7f91200fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:04.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:04.963+0000 7f9126d0b700 1 -- 172.21.15.112:0/2753015475 shutdown_connections 2024-04-25T02:01:04.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:04.963+0000 7f9126d0b700 1 -- 172.21.15.112:0/2753015475 wait complete. 2024-04-25T02:01:04.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:04.964+0000 7f9126d0b700 1 Processor -- start 2024-04-25T02:01:04.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:04.964+0000 7f9126d0b700 1 -- start start 2024-04-25T02:01:04.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:04.964+0000 7f9126d0b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91200fca30 0x7f912010d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:04.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:04.964+0000 7f9126d0b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912010d5f0 con 0x7f91200fca30 2024-04-25T02:01:04.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:04.964+0000 7f9124aa7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91200fca30 0x7f912010d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:04.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:04.964+0000 7f9124aa7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91200fca30 0x7f912010d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.112:42344/0 (socket says 172.21.15.112:42344) 2024-04-25T02:01:04.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:04.964+0000 7f9124aa7700 1 -- 172.21.15.112:0/1468081891 learned_addr learned my addr 172.21.15.112:0/1468081891 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T02:01:04.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:04.965+0000 7f9124aa7700 1 -- 172.21.15.112:0/1468081891 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9118009940 con 0x7f91200fca30 2024-04-25T02:01:04.970 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:04.965+0000 7f9124aa7700 1 --2- 172.21.15.112:0/1468081891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91200fca30 0x7f912010d0b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9118009500 tx=0x7f9118004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:04.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:04.965+0000 7f911d7fa700 1 -- 172.21.15.112:0/1468081891 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9118007c80 con 0x7f91200fca30 2024-04-25T02:01:04.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:04.965+0000 7f9126d0b700 1 -- 172.21.15.112:0/1468081891 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f912010d7f0 con 0x7f91200fca30 2024-04-25T02:01:04.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:04.965+0000 7f911d7fa700 1 -- 172.21.15.112:0/1468081891 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f911801d910 con 0x7f91200fca30 2024-04-25T02:01:04.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:04.965+0000 7f911d7fa700 1 -- 172.21.15.112:0/1468081891 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f91180129c0 con 0x7f91200fca30 2024-04-25T02:01:04.971 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:04.965+0000 7f9126d0b700 1 -- 172.21.15.112:0/1468081891 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f912010e360 con 0x7f91200fca30 2024-04-25T02:01:04.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:04.966+0000 7f911d7fa700 1 -- 172.21.15.112:0/1468081891 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f9118019040 con 0x7f91200fca30 2024-04-25T02:01:04.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:04.966+0000 7f9126d0b700 1 -- 172.21.15.112:0/1468081891 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9120102f40 con 0x7f91200fca30 2024-04-25T02:01:04.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:04.966+0000 7f911d7fa700 1 --2- 172.21.15.112:0/1468081891 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f9108036880 0x7f9108038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:04.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:04.966+0000 7f911d7fa700 1 -- 172.21.15.112:0/1468081891 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f911804a370 con 0x7f91200fca30 2024-04-25T02:01:04.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:04.966+0000 7f911ffff700 1 --2- 172.21.15.112:0/1468081891 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f9108036880 0x7f9108038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:04.972 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:04.967+0000 7f911ffff700 1 --2- 172.21.15.112:0/1468081891 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f9108036880 0x7f9108038d30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9114009990 tx=0x7f9114006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:04.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:04.975+0000 7f911d7fa700 1 -- 172.21.15.112:0/1468081891 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f911802eca0 con 0x7f91200fca30 2024-04-25T02:01:05.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:05.230+0000 7f9126d0b700 1 -- 172.21.15.112:0/1468081891 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f912010ecc0 con 0x7f91200fca30 2024-04-25T02:01:05.235 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:05.230+0000 7f911d7fa700 1 -- 172.21.15.112:0/1468081891 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f9118017020 con 0x7f91200fca30 2024-04-25T02:01:05.235 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T02:01:05.235 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"4bb93d82-02a7-11ef-bc93-c7b262605968","modified":"2024-04-25T01:59:19.321779Z","created":"2024-04-25T01:59:19.321779Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi077","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T02:01:05.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:05.232+0000 7f9126d0b700 1 -- 172.21.15.112:0/1468081891 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f9108036880 msgr2=0x7f9108038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:05.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:05.232+0000 7f9126d0b700 1 --2- 172.21.15.112:0/1468081891 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f9108036880 0x7f9108038d30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9114009990 tx=0x7f9114006e40 comp rx=0 tx=0).stop 2024-04-25T02:01:05.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:05.232+0000 7f9126d0b700 1 -- 172.21.15.112:0/1468081891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91200fca30 msgr2=0x7f912010d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:05.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:05.232+0000 7f9126d0b700 1 --2- 172.21.15.112:0/1468081891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91200fca30 0x7f912010d0b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9118009500 tx=0x7f9118004d10 comp rx=0 tx=0).stop 2024-04-25T02:01:05.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:05.232+0000 7f9126d0b700 1 -- 172.21.15.112:0/1468081891 shutdown_connections 2024-04-25T02:01:05.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:05.232+0000 7f9126d0b700 1 --2- 172.21.15.112:0/1468081891 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f9108036880 0x7f9108038d30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:05.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:05.232+0000 7f9126d0b700 1 --2- 172.21.15.112:0/1468081891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91200fca30 0x7f912010d0b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:05.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:05.232+0000 7f9126d0b700 1 -- 172.21.15.112:0/1468081891 >> 172.21.15.112:0/1468081891 conn(0x7f91200f8170 msgr2=0x7f9120103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:05.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:05.232+0000 7f9126d0b700 1 -- 172.21.15.112:0/1468081891 shutdown_connections 2024-04-25T02:01:05.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:05.232+0000 7f9126d0b700 1 -- 172.21.15.112:0/1468081891 wait complete. 2024-04-25T02:01:05.238 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-04-25T02:01:06.389 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:06 smithi077 ceph-mon[26330]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:06.389 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:06 smithi077 ceph-mon[26330]: from='client.? 172.21.15.112:0/1468081891' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:01:06.809 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T02:01:06.810 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T02:01:07.055 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T02:01:07.102 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T02:01:08.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:08 smithi077 ceph-mon[26330]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:08.593 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.589+0000 7fafeaa65700 1 -- 172.21.15.112:0/2042644495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafe40fca30 msgr2=0x7fafe40fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:08.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.589+0000 7fafeaa65700 1 --2- 172.21.15.112:0/2042644495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafe40fca30 0x7fafe40fce40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fafdc009c60 tx=0x7fafdc004d10 comp rx=0 tx=0).stop 2024-04-25T02:01:08.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.589+0000 7fafeaa65700 1 -- 172.21.15.112:0/2042644495 shutdown_connections 2024-04-25T02:01:08.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.589+0000 7fafeaa65700 1 --2- 172.21.15.112:0/2042644495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafe40fca30 0x7fafe40fce40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:08.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.589+0000 7fafeaa65700 1 -- 172.21.15.112:0/2042644495 >> 172.21.15.112:0/2042644495 conn(0x7fafe40f8170 msgr2=0x7fafe40fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:08.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.589+0000 7fafeaa65700 1 -- 172.21.15.112:0/2042644495 shutdown_connections 2024-04-25T02:01:08.595 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.589+0000 7fafeaa65700 1 -- 172.21.15.112:0/2042644495 wait complete. 2024-04-25T02:01:08.597 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.589+0000 7fafeaa65700 1 Processor -- start 2024-04-25T02:01:08.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.589+0000 7fafeaa65700 1 -- start start 2024-04-25T02:01:08.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.589+0000 7fafeaa65700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafe40fca30 0x7fafe4071d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:08.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.589+0000 7fafeaa65700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe4072240 con 0x7fafe40fca30 2024-04-25T02:01:08.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.590+0000 7fafe8801700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafe40fca30 0x7fafe4071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:08.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.590+0000 7fafe8801700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafe40fca30 0x7fafe4071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.112:42356/0 (socket says 172.21.15.112:42356) 2024-04-25T02:01:08.598 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.590+0000 7fafe8801700 1 -- 172.21.15.112:0/1623252596 learned_addr learned my addr 172.21.15.112:0/1623252596 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T02:01:08.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.590+0000 7fafe8801700 1 -- 172.21.15.112:0/1623252596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafdc009940 con 0x7fafe40fca30 2024-04-25T02:01:08.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.590+0000 7fafe8801700 1 --2- 172.21.15.112:0/1623252596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafe40fca30 0x7fafe4071d00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fafdc009500 tx=0x7fafdc004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:08.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.590+0000 7fafe17fa700 1 -- 172.21.15.112:0/1623252596 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fafdc007c80 con 0x7fafe40fca30 2024-04-25T02:01:08.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.590+0000 7fafe17fa700 1 -- 172.21.15.112:0/1623252596 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fafdc01d910 con 0x7fafe40fca30 2024-04-25T02:01:08.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.590+0000 7fafe17fa700 1 -- 172.21.15.112:0/1623252596 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fafdc0129d0 con 0x7fafe40fca30 2024-04-25T02:01:08.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.590+0000 7fafeaa65700 1 -- 172.21.15.112:0/1623252596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe4070310 con 0x7fafe40fca30 2024-04-25T02:01:08.599 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.590+0000 7fafeaa65700 1 -- 172.21.15.112:0/1623252596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe4070800 con 0x7fafe40fca30 2024-04-25T02:01:08.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.591+0000 7fafe17fa700 1 -- 172.21.15.112:0/1623252596 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fafdc019040 con 0x7fafe40fca30 2024-04-25T02:01:08.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.591+0000 7fafeaa65700 1 -- 172.21.15.112:0/1623252596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe405f5c0 con 0x7fafe40fca30 2024-04-25T02:01:08.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.591+0000 7fafe17fa700 1 --2- 172.21.15.112:0/1623252596 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fafcc036880 0x7fafcc038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:08.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.591+0000 7fafe17fa700 1 -- 172.21.15.112:0/1623252596 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fafdc04a450 con 0x7fafe40fca30 2024-04-25T02:01:08.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.592+0000 7fafe3fff700 1 --2- 172.21.15.112:0/1623252596 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fafcc036880 0x7fafcc038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:08.600 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.592+0000 7fafe3fff700 1 --2- 172.21.15.112:0/1623252596 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fafcc036880 0x7fafcc038d30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fafd8009990 tx=0x7fafd8006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:08.601 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.597+0000 7fafe17fa700 1 -- 172.21.15.112:0/1623252596 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fafdc02eb40 con 0x7fafe40fca30 2024-04-25T02:01:08.861 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.857+0000 7fafeaa65700 1 -- 172.21.15.112:0/1623252596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fafe404bed0 con 0x7fafe40fca30 2024-04-25T02:01:08.862 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.858+0000 7fafe17fa700 1 -- 172.21.15.112:0/1623252596 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fafdc017020 con 0x7fafe40fca30 2024-04-25T02:01:08.862 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T02:01:08.862 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"4bb93d82-02a7-11ef-bc93-c7b262605968","modified":"2024-04-25T01:59:19.321779Z","created":"2024-04-25T01:59:19.321779Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi077","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T02:01:08.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.860+0000 7fafeaa65700 1 -- 172.21.15.112:0/1623252596 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fafcc036880 msgr2=0x7fafcc038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:08.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.860+0000 7fafeaa65700 1 --2- 172.21.15.112:0/1623252596 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fafcc036880 0x7fafcc038d30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fafd8009990 tx=0x7fafd8006e40 comp rx=0 tx=0).stop 2024-04-25T02:01:08.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.860+0000 7fafeaa65700 1 -- 172.21.15.112:0/1623252596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafe40fca30 msgr2=0x7fafe4071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:08.864 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.860+0000 7fafeaa65700 1 --2- 172.21.15.112:0/1623252596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafe40fca30 0x7fafe4071d00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fafdc009500 tx=0x7fafdc004d10 comp rx=0 tx=0).stop 2024-04-25T02:01:08.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.860+0000 7fafeaa65700 1 -- 172.21.15.112:0/1623252596 shutdown_connections 2024-04-25T02:01:08.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.860+0000 7fafeaa65700 1 --2- 172.21.15.112:0/1623252596 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7fafcc036880 0x7fafcc038d30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:08.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.860+0000 7fafeaa65700 1 --2- 172.21.15.112:0/1623252596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafe40fca30 0x7fafe4071d00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:08.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.860+0000 7fafeaa65700 1 -- 172.21.15.112:0/1623252596 >> 172.21.15.112:0/1623252596 conn(0x7fafe40f8170 msgr2=0x7fafe4103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:08.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.860+0000 7fafeaa65700 1 -- 172.21.15.112:0/1623252596 shutdown_connections 2024-04-25T02:01:08.865 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:08.860+0000 7fafeaa65700 1 -- 172.21.15.112:0/1623252596 wait complete. 2024-04-25T02:01:08.865 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-04-25T02:01:09.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:09 smithi077 ceph-mon[26330]: from='client.? 172.21.15.112:0/1623252596' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:01:10.389 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T02:01:10.390 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T02:01:10.471 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:10 smithi077 ceph-mon[26330]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:10.638 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T02:01:10.699 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T02:01:12.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.165+0000 7f626ab8f700 1 -- 172.21.15.112:0/3628645710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62640fb930 msgr2=0x7f62640fbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:12.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.165+0000 7f626ab8f700 1 --2- 172.21.15.112:0/3628645710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62640fb930 0x7f62640fbd40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f62580048c0 tx=0x7f6258009e30 comp rx=0 tx=0).stop 2024-04-25T02:01:12.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.165+0000 7f626ab8f700 1 -- 172.21.15.112:0/3628645710 shutdown_connections 2024-04-25T02:01:12.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.165+0000 7f626ab8f700 1 --2- 172.21.15.112:0/3628645710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62640fb930 0x7f62640fbd40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:12.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.165+0000 7f626ab8f700 1 -- 172.21.15.112:0/3628645710 >> 172.21.15.112:0/3628645710 conn(0x7f62640f7070 msgr2=0x7f62640f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:12.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.165+0000 7f626ab8f700 1 -- 172.21.15.112:0/3628645710 shutdown_connections 2024-04-25T02:01:12.170 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.165+0000 7f626ab8f700 1 -- 172.21.15.112:0/3628645710 wait complete. 2024-04-25T02:01:12.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.166+0000 7f626ab8f700 1 Processor -- start 2024-04-25T02:01:12.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.166+0000 7f626ab8f700 1 -- start start 2024-04-25T02:01:12.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.166+0000 7f626ab8f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62640fb930 0x7f6264066840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:12.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.166+0000 7f626ab8f700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626410fdb0 con 0x7f62640fb930 2024-04-25T02:01:12.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.167+0000 7f626892b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62640fb930 0x7f6264066840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:12.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.167+0000 7f626892b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62640fb930 0x7f6264066840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.112:42366/0 (socket says 172.21.15.112:42366) 2024-04-25T02:01:12.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.167+0000 7f626892b700 1 -- 172.21.15.112:0/1603074967 learned_addr learned my addr 172.21.15.112:0/1603074967 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T02:01:12.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.167+0000 7f626892b700 1 -- 172.21.15.112:0/1603074967 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6258005040 con 0x7f62640fb930 2024-04-25T02:01:12.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.167+0000 7f626892b700 1 --2- 172.21.15.112:0/1603074967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62640fb930 0x7f6264066840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f62580096b0 tx=0x7f6258009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:12.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.167+0000 7f62617fa700 1 -- 172.21.15.112:0/1603074967 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f625800bed0 con 0x7f62640fb930 2024-04-25T02:01:12.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.167+0000 7f62617fa700 1 -- 172.21.15.112:0/1603074967 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f625800b5c0 con 0x7f62640fb930 2024-04-25T02:01:12.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.167+0000 7f626ab8f700 1 -- 172.21.15.112:0/1603074967 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626410fef0 con 0x7f62640fb930 2024-04-25T02:01:12.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.167+0000 7f62617fa700 1 -- 172.21.15.112:0/1603074967 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f625801c5b0 con 0x7f62640fb930 2024-04-25T02:01:12.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.167+0000 7f626ab8f700 1 -- 172.21.15.112:0/1603074967 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62641103e0 con 0x7f62640fb930 2024-04-25T02:01:12.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.168+0000 7f62617fa700 1 -- 172.21.15.112:0/1603074967 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f625801c820 con 0x7f62640fb930 2024-04-25T02:01:12.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.168+0000 7f62617fa700 1 --2- 172.21.15.112:0/1603074967 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f6254036880 0x7f6254038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:12.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.168+0000 7f62617fa700 1 -- 172.21.15.112:0/1603074967 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6258013a80 con 0x7f62640fb930 2024-04-25T02:01:12.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.168+0000 7f626ab8f700 1 -- 172.21.15.112:0/1603074967 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62641058f0 con 0x7f62640fb930 2024-04-25T02:01:12.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.168+0000 7f6263fff700 1 --2- 172.21.15.112:0/1603074967 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f6254036880 0x7f6254038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:12.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.169+0000 7f6263fff700 1 --2- 172.21.15.112:0/1603074967 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f6254036880 0x7f6254038d30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6250009990 tx=0x7f6250006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:12.177 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.174+0000 7f62617fa700 1 -- 172.21.15.112:0/1603074967 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6258023300 con 0x7f62640fb930 2024-04-25T02:01:12.348 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:12 smithi077 ceph-mon[26330]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:12.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.433+0000 7f626ab8f700 1 -- 172.21.15.112:0/1603074967 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6264101770 con 0x7f62640fb930 2024-04-25T02:01:12.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.434+0000 7f62617fa700 1 -- 172.21.15.112:0/1603074967 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f6258011b60 con 0x7f62640fb930 2024-04-25T02:01:12.439 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T02:01:12.439 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"4bb93d82-02a7-11ef-bc93-c7b262605968","modified":"2024-04-25T01:59:19.321779Z","created":"2024-04-25T01:59:19.321779Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi077","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T02:01:12.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.436+0000 7f626ab8f700 1 -- 172.21.15.112:0/1603074967 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f6254036880 msgr2=0x7f6254038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:12.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.436+0000 7f626ab8f700 1 --2- 172.21.15.112:0/1603074967 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f6254036880 0x7f6254038d30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6250009990 tx=0x7f6250006e40 comp rx=0 tx=0).stop 2024-04-25T02:01:12.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.436+0000 7f626ab8f700 1 -- 172.21.15.112:0/1603074967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62640fb930 msgr2=0x7f6264066840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:12.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.436+0000 7f626ab8f700 1 --2- 172.21.15.112:0/1603074967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62640fb930 0x7f6264066840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f62580096b0 tx=0x7f6258009e30 comp rx=0 tx=0).stop 2024-04-25T02:01:12.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.436+0000 7f626ab8f700 1 -- 172.21.15.112:0/1603074967 shutdown_connections 2024-04-25T02:01:12.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.436+0000 7f626ab8f700 1 --2- 172.21.15.112:0/1603074967 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f6254036880 0x7f6254038d30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:12.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.436+0000 7f626ab8f700 1 --2- 172.21.15.112:0/1603074967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62640fb930 0x7f6264066840 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:12.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.436+0000 7f626ab8f700 1 -- 172.21.15.112:0/1603074967 >> 172.21.15.112:0/1603074967 conn(0x7f62640f7070 msgr2=0x7f6264102a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:12.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.436+0000 7f626ab8f700 1 -- 172.21.15.112:0/1603074967 shutdown_connections 2024-04-25T02:01:12.441 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:12.436+0000 7f626ab8f700 1 -- 172.21.15.112:0/1603074967 wait complete. 2024-04-25T02:01:12.441 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-04-25T02:01:13.425 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:13 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:13.425 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:13 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:13.425 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:13 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:13.425 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:13 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:13.425 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:13 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:13.425 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:13 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:13.426 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:13 smithi077 ceph-mon[26330]: Deploying daemon prometheus.smithi077 on smithi077 2024-04-25T02:01:13.426 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:13 smithi077 ceph-mon[26330]: from='client.? 172.21.15.112:0/1603074967' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:01:14.018 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T02:01:14.018 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T02:01:14.267 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T02:01:14.316 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T02:01:14.700 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:14 smithi077 ceph-mon[26330]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:15.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.718+0000 7f7ecffce700 1 -- 172.21.15.112:0/3915839067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ec8065cb0 msgr2=0x7f7ec80ff6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:15.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.718+0000 7f7ecffce700 1 --2- 172.21.15.112:0/3915839067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ec8065cb0 0x7f7ec80ff6b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009c60 tx=0x7f7ec0004d10 comp rx=0 tx=0).stop 2024-04-25T02:01:15.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.718+0000 7f7ecffce700 1 -- 172.21.15.112:0/3915839067 shutdown_connections 2024-04-25T02:01:15.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.718+0000 7f7ecffce700 1 --2- 172.21.15.112:0/3915839067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ec8065cb0 0x7f7ec80ff6b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:15.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.718+0000 7f7ecffce700 1 -- 172.21.15.112:0/3915839067 >> 172.21.15.112:0/3915839067 conn(0x7f7ec80f70a0 msgr2=0x7f7ec80f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:15.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.719+0000 7f7ecffce700 1 -- 172.21.15.112:0/3915839067 shutdown_connections 2024-04-25T02:01:15.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.719+0000 7f7ecffce700 1 -- 172.21.15.112:0/3915839067 wait complete. 2024-04-25T02:01:15.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.719+0000 7f7ecffce700 1 Processor -- start 2024-04-25T02:01:15.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.719+0000 7f7ecffce700 1 -- start start 2024-04-25T02:01:15.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.719+0000 7f7ecffce700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ec8065cb0 0x7f7ec810d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:15.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.719+0000 7f7ecffce700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec810d5c0 con 0x7f7ec8065cb0 2024-04-25T02:01:15.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.720+0000 7f7ecdd6a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ec8065cb0 0x7f7ec810d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:15.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.720+0000 7f7ecdd6a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ec8065cb0 0x7f7ec810d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.112:50798/0 (socket says 172.21.15.112:50798) 2024-04-25T02:01:15.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.720+0000 7f7ecdd6a700 1 -- 172.21.15.112:0/1754858016 learned_addr learned my addr 172.21.15.112:0/1754858016 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T02:01:15.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.720+0000 7f7ecdd6a700 1 -- 172.21.15.112:0/1754858016 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec0009940 con 0x7f7ec8065cb0 2024-04-25T02:01:15.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.720+0000 7f7ecdd6a700 1 --2- 172.21.15.112:0/1754858016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ec8065cb0 0x7f7ec810d080 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7ec00097b0 tx=0x7f7ec0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:15.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.720+0000 7f7ebe7fc700 1 -- 172.21.15.112:0/1754858016 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ec0012410 con 0x7f7ec8065cb0 2024-04-25T02:01:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.720+0000 7f7ecffce700 1 -- 172.21.15.112:0/1754858016 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec810d7c0 con 0x7f7ec8065cb0 2024-04-25T02:01:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.720+0000 7f7ebe7fc700 1 -- 172.21.15.112:0/1754858016 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ec0012a40 con 0x7f7ec8065cb0 2024-04-25T02:01:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.720+0000 7f7ecffce700 1 -- 172.21.15.112:0/1754858016 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec810e330 con 0x7f7ec8065cb0 2024-04-25T02:01:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.720+0000 7f7ebe7fc700 1 -- 172.21.15.112:0/1754858016 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ec001b970 con 0x7f7ec8065cb0 2024-04-25T02:01:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.721+0000 7f7ebe7fc700 1 -- 172.21.15.112:0/1754858016 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f7ec0019040 con 0x7f7ec8065cb0 2024-04-25T02:01:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.721+0000 7f7ecffce700 1 -- 172.21.15.112:0/1754858016 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec8102f40 con 0x7f7ec8065cb0 2024-04-25T02:01:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.721+0000 7f7ebe7fc700 1 --2- 172.21.15.112:0/1754858016 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f7eb4036880 0x7f7eb4038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.721+0000 7f7ebe7fc700 1 -- 172.21.15.112:0/1754858016 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7ec004a000 con 0x7f7ec8065cb0 2024-04-25T02:01:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.721+0000 7f7ecd569700 1 --2- 172.21.15.112:0/1754858016 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f7eb4036880 0x7f7eb4038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.722+0000 7f7ecd569700 1 --2- 172.21.15.112:0/1754858016 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f7eb4036880 0x7f7eb4038d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009990 tx=0x7f7eb8006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:15.803 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.727+0000 7f7ebe7fc700 1 -- 172.21.15.112:0/1754858016 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7ec00237c0 con 0x7f7ec8065cb0 2024-04-25T02:01:15.993 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.989+0000 7f7ecffce700 1 -- 172.21.15.112:0/1754858016 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7ec810ed40 con 0x7f7ec8065cb0 2024-04-25T02:01:15.994 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.989+0000 7f7ebe7fc700 1 -- 172.21.15.112:0/1754858016 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f7ec0017070 con 0x7f7ec8065cb0 2024-04-25T02:01:15.994 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T02:01:15.994 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"4bb93d82-02a7-11ef-bc93-c7b262605968","modified":"2024-04-25T01:59:19.321779Z","created":"2024-04-25T01:59:19.321779Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi077","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T02:01:15.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.991+0000 7f7ecffce700 1 -- 172.21.15.112:0/1754858016 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f7eb4036880 msgr2=0x7f7eb4038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:15.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.991+0000 7f7ecffce700 1 --2- 172.21.15.112:0/1754858016 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f7eb4036880 0x7f7eb4038d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009990 tx=0x7f7eb8006e40 comp rx=0 tx=0).stop 2024-04-25T02:01:15.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.991+0000 7f7ecffce700 1 -- 172.21.15.112:0/1754858016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ec8065cb0 msgr2=0x7f7ec810d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:15.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.991+0000 7f7ecffce700 1 --2- 172.21.15.112:0/1754858016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ec8065cb0 0x7f7ec810d080 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7ec00097b0 tx=0x7f7ec0004d10 comp rx=0 tx=0).stop 2024-04-25T02:01:15.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.991+0000 7f7ecffce700 1 -- 172.21.15.112:0/1754858016 shutdown_connections 2024-04-25T02:01:15.996 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.991+0000 7f7ecffce700 1 --2- 172.21.15.112:0/1754858016 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f7eb4036880 0x7f7eb4038d30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:15.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.991+0000 7f7ecffce700 1 --2- 172.21.15.112:0/1754858016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ec8065cb0 0x7f7ec810d080 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:15.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.991+0000 7f7ecffce700 1 -- 172.21.15.112:0/1754858016 >> 172.21.15.112:0/1754858016 conn(0x7f7ec80f70a0 msgr2=0x7f7ec8103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:15.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.991+0000 7f7ecffce700 1 -- 172.21.15.112:0/1754858016 shutdown_connections 2024-04-25T02:01:15.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:15.991+0000 7f7ecffce700 1 -- 172.21.15.112:0/1754858016 wait complete. 2024-04-25T02:01:15.997 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-04-25T02:01:16.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:16 smithi077 ceph-mon[26330]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:16.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:16 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:16.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:16 smithi077 ceph-mon[26330]: from='client.? 172.21.15.112:0/1754858016' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:01:17.513 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T02:01:17.513 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T02:01:17.761 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T02:01:17.808 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T02:01:18.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:18 smithi077 ceph-mon[26330]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:19.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.246+0000 7f208e0cc700 1 -- 172.21.15.112:0/1774298764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20880fca40 msgr2=0x7f20880fce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:19.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.246+0000 7f208e0cc700 1 --2- 172.21.15.112:0/1774298764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20880fca40 0x7f20880fce50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f20780048c0 tx=0x7f2078009e30 comp rx=0 tx=0).stop 2024-04-25T02:01:19.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.246+0000 7f208e0cc700 1 -- 172.21.15.112:0/1774298764 shutdown_connections 2024-04-25T02:01:19.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.246+0000 7f208e0cc700 1 --2- 172.21.15.112:0/1774298764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20880fca40 0x7f20880fce50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:19.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.246+0000 7f208e0cc700 1 -- 172.21.15.112:0/1774298764 >> 172.21.15.112:0/1774298764 conn(0x7f20880f81c0 msgr2=0x7f20880fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:19.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.246+0000 7f208e0cc700 1 -- 172.21.15.112:0/1774298764 shutdown_connections 2024-04-25T02:01:19.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.246+0000 7f208e0cc700 1 -- 172.21.15.112:0/1774298764 wait complete. 2024-04-25T02:01:19.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.247+0000 7f208e0cc700 1 Processor -- start 2024-04-25T02:01:19.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.247+0000 7f208e0cc700 1 -- start start 2024-04-25T02:01:19.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.247+0000 7f208e0cc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20880fca40 0x7f2088071d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:19.253 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.247+0000 7f208e0cc700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2088072240 con 0x7f20880fca40 2024-04-25T02:01:19.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.247+0000 7f20877fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20880fca40 0x7f2088071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:19.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.247+0000 7f20877fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20880fca40 0x7f2088071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.112:50816/0 (socket says 172.21.15.112:50816) 2024-04-25T02:01:19.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.247+0000 7f20877fe700 1 -- 172.21.15.112:0/1522216495 learned_addr learned my addr 172.21.15.112:0/1522216495 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T02:01:19.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.248+0000 7f20877fe700 1 -- 172.21.15.112:0/1522216495 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2078005040 con 0x7f20880fca40 2024-04-25T02:01:19.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.248+0000 7f20877fe700 1 --2- 172.21.15.112:0/1522216495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20880fca40 0x7f2088071d00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2078009680 tx=0x7f2078009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:19.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.248+0000 7f2084ff9700 1 -- 172.21.15.112:0/1522216495 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f207800b5c0 con 0x7f20880fca40 2024-04-25T02:01:19.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.248+0000 7f2084ff9700 1 -- 172.21.15.112:0/1522216495 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f207800be70 con 0x7f20880fca40 2024-04-25T02:01:19.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.248+0000 7f208e0cc700 1 -- 172.21.15.112:0/1522216495 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2088070310 con 0x7f20880fca40 2024-04-25T02:01:19.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.248+0000 7f2084ff9700 1 -- 172.21.15.112:0/1522216495 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20780135a0 con 0x7f20880fca40 2024-04-25T02:01:19.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.248+0000 7f208e0cc700 1 -- 172.21.15.112:0/1522216495 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2088070800 con 0x7f20880fca40 2024-04-25T02:01:19.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.249+0000 7f2084ff9700 1 -- 172.21.15.112:0/1522216495 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f2078004d30 con 0x7f20880fca40 2024-04-25T02:01:19.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.249+0000 7f208e0cc700 1 -- 172.21.15.112:0/1522216495 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f208805f5c0 con 0x7f20880fca40 2024-04-25T02:01:19.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.249+0000 7f2084ff9700 1 --2- 172.21.15.112:0/1522216495 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f2074036880 0x7f2074038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:19.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.249+0000 7f2084ff9700 1 -- 172.21.15.112:0/1522216495 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f20780493a0 con 0x7f20880fca40 2024-04-25T02:01:19.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.249+0000 7f207ffff700 1 --2- 172.21.15.112:0/1522216495 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f2074036880 0x7f2074038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:19.256 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.250+0000 7f207ffff700 1 --2- 172.21.15.112:0/1522216495 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f2074036880 0x7f2074038d30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2070009990 tx=0x7f2070006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:19.258 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.254+0000 7f2084ff9700 1 -- 172.21.15.112:0/1522216495 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2078011960 con 0x7f20880fca40 2024-04-25T02:01:19.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.515+0000 7f208e0cc700 1 -- 172.21.15.112:0/1522216495 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2088106420 con 0x7f20880fca40 2024-04-25T02:01:19.520 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.516+0000 7f2084ff9700 1 -- 172.21.15.112:0/1522216495 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f2078021070 con 0x7f20880fca40 2024-04-25T02:01:19.521 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T02:01:19.521 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"4bb93d82-02a7-11ef-bc93-c7b262605968","modified":"2024-04-25T01:59:19.321779Z","created":"2024-04-25T01:59:19.321779Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi077","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T02:01:19.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.518+0000 7f208e0cc700 1 -- 172.21.15.112:0/1522216495 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f2074036880 msgr2=0x7f2074038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:19.522 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.518+0000 7f208e0cc700 1 --2- 172.21.15.112:0/1522216495 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f2074036880 0x7f2074038d30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2070009990 tx=0x7f2070006e40 comp rx=0 tx=0).stop 2024-04-25T02:01:19.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.518+0000 7f208e0cc700 1 -- 172.21.15.112:0/1522216495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20880fca40 msgr2=0x7f2088071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:19.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.518+0000 7f208e0cc700 1 --2- 172.21.15.112:0/1522216495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20880fca40 0x7f2088071d00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2078009680 tx=0x7f2078009e30 comp rx=0 tx=0).stop 2024-04-25T02:01:19.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.518+0000 7f208e0cc700 1 -- 172.21.15.112:0/1522216495 shutdown_connections 2024-04-25T02:01:19.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.518+0000 7f208e0cc700 1 --2- 172.21.15.112:0/1522216495 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f2074036880 0x7f2074038d30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:19.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.518+0000 7f208e0cc700 1 --2- 172.21.15.112:0/1522216495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20880fca40 0x7f2088071d00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:19.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.518+0000 7f208e0cc700 1 -- 172.21.15.112:0/1522216495 >> 172.21.15.112:0/1522216495 conn(0x7f20880f81c0 msgr2=0x7f2088103b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:19.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.518+0000 7f208e0cc700 1 -- 172.21.15.112:0/1522216495 shutdown_connections 2024-04-25T02:01:19.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:19.518+0000 7f208e0cc700 1 -- 172.21.15.112:0/1522216495 wait complete. 2024-04-25T02:01:19.523 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-04-25T02:01:20.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:20 smithi077 ceph-mon[26330]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:20.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:20 smithi077 ceph-mon[26330]: from='client.? 172.21.15.112:0/1522216495' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:01:21.074 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T02:01:21.075 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T02:01:21.320 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T02:01:21.366 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T02:01:22.175 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:22 smithi077 ceph-mon[26330]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:22.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:22.810+0000 7f1469833700 1 -- 172.21.15.112:0/2800571700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1464066620 msgr2=0x7f14640ff6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:22.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:22.810+0000 7f1469833700 1 --2- 172.21.15.112:0/2800571700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1464066620 0x7f14640ff6d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f14540048c0 tx=0x7f1454009e30 comp rx=0 tx=0).stop 2024-04-25T02:01:22.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:22.810+0000 7f1469833700 1 -- 172.21.15.112:0/2800571700 shutdown_connections 2024-04-25T02:01:22.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:22.810+0000 7f1469833700 1 --2- 172.21.15.112:0/2800571700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1464066620 0x7f14640ff6d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:22.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:22.810+0000 7f1469833700 1 -- 172.21.15.112:0/2800571700 >> 172.21.15.112:0/2800571700 conn(0x7f14640f70a0 msgr2=0x7f14640f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:22.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:22.810+0000 7f1469833700 1 -- 172.21.15.112:0/2800571700 shutdown_connections 2024-04-25T02:01:22.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:22.810+0000 7f1469833700 1 -- 172.21.15.112:0/2800571700 wait complete. 2024-04-25T02:01:22.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:22.811+0000 7f1469833700 1 Processor -- start 2024-04-25T02:01:22.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:22.811+0000 7f1469833700 1 -- start start 2024-04-25T02:01:22.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:22.811+0000 7f1469833700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1464066620 0x7f14640fd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:22.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:22.811+0000 7f1469833700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14640fd560 con 0x7f1464066620 2024-04-25T02:01:22.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:22.811+0000 7f1462ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1464066620 0x7f14640fd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:22.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:22.811+0000 7f1462ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1464066620 0x7f14640fd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.112:50840/0 (socket says 172.21.15.112:50840) 2024-04-25T02:01:22.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:22.811+0000 7f1462ffd700 1 -- 172.21.15.112:0/804688125 learned_addr learned my addr 172.21.15.112:0/804688125 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T02:01:22.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:22.812+0000 7f1462ffd700 1 -- 172.21.15.112:0/804688125 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1454005040 con 0x7f1464066620 2024-04-25T02:01:22.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:22.812+0000 7f1462ffd700 1 --2- 172.21.15.112:0/804688125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1464066620 0x7f14640fd020 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1454009680 tx=0x7f1454009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:22.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:22.812+0000 7f145b7fe700 1 -- 172.21.15.112:0/804688125 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f145400bed0 con 0x7f1464066620 2024-04-25T02:01:22.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:22.812+0000 7f145b7fe700 1 -- 172.21.15.112:0/804688125 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f145400b5c0 con 0x7f1464066620 2024-04-25T02:01:22.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:22.812+0000 7f1469833700 1 -- 172.21.15.112:0/804688125 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14640fb630 con 0x7f1464066620 2024-04-25T02:01:22.819 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:22.812+0000 7f145b7fe700 1 -- 172.21.15.112:0/804688125 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f145401c5b0 con 0x7f1464066620 2024-04-25T02:01:22.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:22.812+0000 7f1469833700 1 -- 172.21.15.112:0/804688125 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14640fbb20 con 0x7f1464066620 2024-04-25T02:01:22.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:22.813+0000 7f145b7fe700 1 -- 172.21.15.112:0/804688125 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f145401c710 con 0x7f1464066620 2024-04-25T02:01:22.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:22.813+0000 7f145b7fe700 1 --2- 172.21.15.112:0/804688125 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f1450036880 0x7f1450038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:22.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:22.813+0000 7f145b7fe700 1 -- 172.21.15.112:0/804688125 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f1454049b00 con 0x7f1464066620 2024-04-25T02:01:22.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:22.813+0000 7f1469833700 1 -- 172.21.15.112:0/804688125 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1464102f30 con 0x7f1464066620 2024-04-25T02:01:22.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:22.813+0000 7f14627fc700 1 --2- 172.21.15.112:0/804688125 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f1450036880 0x7f1450038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:22.820 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:22.813+0000 7f14627fc700 1 --2- 172.21.15.112:0/804688125 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f1450036880 0x7f1450038d30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f144c009990 tx=0x7f144c006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:22.822 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:22.818+0000 7f145b7fe700 1 -- 172.21.15.112:0/804688125 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1454025400 con 0x7f1464066620 2024-04-25T02:01:23.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:23.075+0000 7f1469833700 1 -- 172.21.15.112:0/804688125 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1464102870 con 0x7f1464066620 2024-04-25T02:01:23.080 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:23.075+0000 7f145b7fe700 1 -- 172.21.15.112:0/804688125 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f1454011b60 con 0x7f1464066620 2024-04-25T02:01:23.080 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T02:01:23.080 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"4bb93d82-02a7-11ef-bc93-c7b262605968","modified":"2024-04-25T01:59:19.321779Z","created":"2024-04-25T01:59:19.321779Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi077","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T02:01:23.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:23.077+0000 7f1469833700 1 -- 172.21.15.112:0/804688125 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f1450036880 msgr2=0x7f1450038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:23.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:23.077+0000 7f1469833700 1 --2- 172.21.15.112:0/804688125 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f1450036880 0x7f1450038d30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f144c009990 tx=0x7f144c006e40 comp rx=0 tx=0).stop 2024-04-25T02:01:23.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:23.077+0000 7f1469833700 1 -- 172.21.15.112:0/804688125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1464066620 msgr2=0x7f14640fd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:23.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:23.077+0000 7f1469833700 1 --2- 172.21.15.112:0/804688125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1464066620 0x7f14640fd020 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1454009680 tx=0x7f1454009e30 comp rx=0 tx=0).stop 2024-04-25T02:01:23.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:23.077+0000 7f1469833700 1 -- 172.21.15.112:0/804688125 shutdown_connections 2024-04-25T02:01:23.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:23.077+0000 7f1469833700 1 --2- 172.21.15.112:0/804688125 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f1450036880 0x7f1450038d30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:23.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:23.077+0000 7f1469833700 1 --2- 172.21.15.112:0/804688125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1464066620 0x7f14640fd020 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:23.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:23.077+0000 7f1469833700 1 -- 172.21.15.112:0/804688125 >> 172.21.15.112:0/804688125 conn(0x7f14640f70a0 msgr2=0x7f1464103b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:23.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:23.077+0000 7f1469833700 1 -- 172.21.15.112:0/804688125 shutdown_connections 2024-04-25T02:01:23.082 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:23.077+0000 7f1469833700 1 -- 172.21.15.112:0/804688125 wait complete. 2024-04-25T02:01:23.083 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-04-25T02:01:24.144 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:23 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:24.144 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:23 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:24.144 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:23 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:24.144 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:23 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-04-25T02:01:24.144 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:23 smithi077 ceph-mon[26330]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:24.144 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:23 smithi077 ceph-mon[26330]: from='client.? 172.21.15.112:0/804688125' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:01:24.684 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T02:01:24.685 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T02:01:24.933 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T02:01:24.981 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T02:01:25.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:24 smithi077 ceph-mon[26330]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-04-25T02:01:25.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:24 smithi077 ceph-mon[26330]: mgrmap e14: smithi077.zpflzp(active, since 58s) 2024-04-25T02:01:26.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.510+0000 7f72c8361700 1 -- 172.21.15.112:0/2729148848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72c00fca30 msgr2=0x7f72c00fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:26.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.510+0000 7f72c8361700 1 --2- 172.21.15.112:0/2729148848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72c00fca30 0x7f72c00fce40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f72b00048c0 tx=0x7f72b0009e30 comp rx=0 tx=0).stop 2024-04-25T02:01:26.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.510+0000 7f72c8361700 1 -- 172.21.15.112:0/2729148848 shutdown_connections 2024-04-25T02:01:26.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.510+0000 7f72c8361700 1 --2- 172.21.15.112:0/2729148848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72c00fca30 0x7f72c00fce40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:26.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.510+0000 7f72c8361700 1 -- 172.21.15.112:0/2729148848 >> 172.21.15.112:0/2729148848 conn(0x7f72c00f8170 msgr2=0x7f72c00fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:26.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.510+0000 7f72c8361700 1 -- 172.21.15.112:0/2729148848 shutdown_connections 2024-04-25T02:01:26.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.510+0000 7f72c8361700 1 -- 172.21.15.112:0/2729148848 wait complete. 2024-04-25T02:01:26.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.510+0000 7f72c8361700 1 Processor -- start 2024-04-25T02:01:26.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.510+0000 7f72c8361700 1 -- start start 2024-04-25T02:01:26.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.510+0000 7f72c8361700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72c00fca30 0x7f72c0071d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:26.516 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.510+0000 7f72c8361700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c0072240 con 0x7f72c00fca30 2024-04-25T02:01:26.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.511+0000 7f72c60fd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72c00fca30 0x7f72c0071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:26.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.511+0000 7f72c60fd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72c00fca30 0x7f72c0071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.112:60356/0 (socket says 172.21.15.112:60356) 2024-04-25T02:01:26.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.511+0000 7f72c60fd700 1 -- 172.21.15.112:0/2887136724 learned_addr learned my addr 172.21.15.112:0/2887136724 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T02:01:26.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.511+0000 7f72c60fd700 1 -- 172.21.15.112:0/2887136724 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b0005040 con 0x7f72c00fca30 2024-04-25T02:01:26.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.511+0000 7f72c60fd700 1 --2- 172.21.15.112:0/2887136724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72c00fca30 0x7f72c0071d00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009680 tx=0x7f72b0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:26.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.511+0000 7f72b6ffd700 1 -- 172.21.15.112:0/2887136724 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72b000b5c0 con 0x7f72c00fca30 2024-04-25T02:01:26.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.511+0000 7f72b6ffd700 1 -- 172.21.15.112:0/2887136724 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f72b000be70 con 0x7f72c00fca30 2024-04-25T02:01:26.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.511+0000 7f72c8361700 1 -- 172.21.15.112:0/2887136724 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c0070310 con 0x7f72c00fca30 2024-04-25T02:01:26.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.511+0000 7f72b6ffd700 1 -- 172.21.15.112:0/2887136724 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72b00135a0 con 0x7f72c00fca30 2024-04-25T02:01:26.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.511+0000 7f72c8361700 1 -- 172.21.15.112:0/2887136724 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c0070800 con 0x7f72c00fca30 2024-04-25T02:01:26.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.512+0000 7f72b6ffd700 1 -- 172.21.15.112:0/2887136724 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 43446+0+0 (secure 0 0 0) 0x7f72b001c430 con 0x7f72c00fca30 2024-04-25T02:01:26.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.512+0000 7f72c8361700 1 -- 172.21.15.112:0/2887136724 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c005f5c0 con 0x7f72c00fca30 2024-04-25T02:01:26.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.512+0000 7f72b6ffd700 1 --2- 172.21.15.112:0/2887136724 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f72ac0368d0 0x7f72ac038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:26.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.512+0000 7f72b6ffd700 1 -- 172.21.15.112:0/2887136724 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f72b0049400 con 0x7f72c00fca30 2024-04-25T02:01:26.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.512+0000 7f72c58fc700 1 -- 172.21.15.112:0/2887136724 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f72ac0368d0 msgr2=0x7f72ac038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/2375514340 2024-04-25T02:01:26.518 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.512+0000 7f72c58fc700 1 --2- 172.21.15.112:0/2887136724 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f72ac0368d0 0x7f72ac038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:01:26.521 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.517+0000 7f72b6ffd700 1 -- 172.21.15.112:0/2887136724 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f72b00117e0 con 0x7f72c00fca30 2024-04-25T02:01:26.717 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.713+0000 7f72c58fc700 1 -- 172.21.15.112:0/2887136724 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f72ac0368d0 msgr2=0x7f72ac038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/2375514340 2024-04-25T02:01:26.718 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.713+0000 7f72c58fc700 1 --2- 172.21.15.112:0/2887136724 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f72ac0368d0 0x7f72ac038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T02:01:26.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.777+0000 7f72c8361700 1 -- 172.21.15.112:0/2887136724 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f72c0106410 con 0x7f72c00fca30 2024-04-25T02:01:26.782 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.777+0000 7f72b6ffd700 1 -- 172.21.15.112:0/2887136724 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f72b0021070 con 0x7f72c00fca30 2024-04-25T02:01:26.782 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T02:01:26.782 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"4bb93d82-02a7-11ef-bc93-c7b262605968","modified":"2024-04-25T01:59:19.321779Z","created":"2024-04-25T01:59:19.321779Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi077","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T02:01:26.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.779+0000 7f72c8361700 1 -- 172.21.15.112:0/2887136724 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f72ac0368d0 msgr2=0x7f72ac038d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:01:26.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.779+0000 7f72c8361700 1 --2- 172.21.15.112:0/2887136724 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f72ac0368d0 0x7f72ac038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:26.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.779+0000 7f72c8361700 1 -- 172.21.15.112:0/2887136724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72c00fca30 msgr2=0x7f72c0071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:26.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.779+0000 7f72c8361700 1 --2- 172.21.15.112:0/2887136724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72c00fca30 0x7f72c0071d00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009680 tx=0x7f72b0009e30 comp rx=0 tx=0).stop 2024-04-25T02:01:26.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.779+0000 7f72c8361700 1 -- 172.21.15.112:0/2887136724 shutdown_connections 2024-04-25T02:01:26.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.779+0000 7f72c8361700 1 --2- 172.21.15.112:0/2887136724 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f72ac0368d0 0x7f72ac038d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:26.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.779+0000 7f72c8361700 1 --2- 172.21.15.112:0/2887136724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72c00fca30 0x7f72c0071d00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:26.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.779+0000 7f72c8361700 1 -- 172.21.15.112:0/2887136724 >> 172.21.15.112:0/2887136724 conn(0x7f72c00f8170 msgr2=0x7f72c0103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:26.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.779+0000 7f72c8361700 1 -- 172.21.15.112:0/2887136724 shutdown_connections 2024-04-25T02:01:26.784 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:26.779+0000 7f72c8361700 1 -- 172.21.15.112:0/2887136724 wait complete. 2024-04-25T02:01:26.785 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-04-25T02:01:27.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:26 smithi077 ceph-mon[26330]: from='client.? 172.21.15.112:0/2887136724' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:01:28.332 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T02:01:28.332 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T02:01:28.581 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T02:01:28.629 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T02:01:29.977 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:29.971+0000 7f1d76e14700 1 -- 172.21.15.112:0/3163227977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d700fb940 msgr2=0x7f1d700fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:29.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:29.971+0000 7f1d76e14700 1 --2- 172.21.15.112:0/3163227977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d700fb940 0x7f1d700fbd50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1d640048c0 tx=0x7f1d64009e30 comp rx=0 tx=0).stop 2024-04-25T02:01:29.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:29.971+0000 7f1d76e14700 1 -- 172.21.15.112:0/3163227977 shutdown_connections 2024-04-25T02:01:29.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:29.971+0000 7f1d76e14700 1 --2- 172.21.15.112:0/3163227977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d700fb940 0x7f1d700fbd50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:29.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:29.971+0000 7f1d76e14700 1 -- 172.21.15.112:0/3163227977 >> 172.21.15.112:0/3163227977 conn(0x7f1d700f70a0 msgr2=0x7f1d700f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:29.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:29.971+0000 7f1d76e14700 1 -- 172.21.15.112:0/3163227977 shutdown_connections 2024-04-25T02:01:29.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:29.971+0000 7f1d76e14700 1 -- 172.21.15.112:0/3163227977 wait complete. 2024-04-25T02:01:29.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:29.972+0000 7f1d76e14700 1 Processor -- start 2024-04-25T02:01:29.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:29.972+0000 7f1d76e14700 1 -- start start 2024-04-25T02:01:29.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:29.972+0000 7f1d76e14700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d700fb940 0x7f1d70066840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:29.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:29.972+0000 7f1d76e14700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7010fde0 con 0x7f1d700fb940 2024-04-25T02:01:29.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:29.972+0000 7f1d74bb0700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d700fb940 0x7f1d70066840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:29.978 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:29.972+0000 7f1d74bb0700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d700fb940 0x7f1d70066840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.112:60374/0 (socket says 172.21.15.112:60374) 2024-04-25T02:01:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:29.972+0000 7f1d74bb0700 1 -- 172.21.15.112:0/3158115632 learned_addr learned my addr 172.21.15.112:0/3158115632 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T02:01:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:29.973+0000 7f1d74bb0700 1 -- 172.21.15.112:0/3158115632 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d64005040 con 0x7f1d700fb940 2024-04-25T02:01:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:29.973+0000 7f1d74bb0700 1 --2- 172.21.15.112:0/3158115632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d700fb940 0x7f1d70066840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1d640096b0 tx=0x7f1d64009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:29.973+0000 7f1d6d7fa700 1 -- 172.21.15.112:0/3158115632 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d6400bed0 con 0x7f1d700fb940 2024-04-25T02:01:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:29.973+0000 7f1d6d7fa700 1 -- 172.21.15.112:0/3158115632 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1d6400b5c0 con 0x7f1d700fb940 2024-04-25T02:01:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:29.973+0000 7f1d6d7fa700 1 -- 172.21.15.112:0/3158115632 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d6401c5b0 con 0x7f1d700fb940 2024-04-25T02:01:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:29.973+0000 7f1d76e14700 1 -- 172.21.15.112:0/3158115632 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d7010ff20 con 0x7f1d700fb940 2024-04-25T02:01:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:29.973+0000 7f1d76e14700 1 -- 172.21.15.112:0/3158115632 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d70110410 con 0x7f1d700fb940 2024-04-25T02:01:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:29.974+0000 7f1d6d7fa700 1 -- 172.21.15.112:0/3158115632 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 43446+0+0 (secure 0 0 0) 0x7f1d64013420 con 0x7f1d700fb940 2024-04-25T02:01:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:29.974+0000 7f1d76e14700 1 -- 172.21.15.112:0/3158115632 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d70105900 con 0x7f1d700fb940 2024-04-25T02:01:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:29.974+0000 7f1d6d7fa700 1 --2- 172.21.15.112:0/3158115632 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f1d600368d0 0x7f1d60038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:29.974+0000 7f1d6d7fa700 1 -- 172.21.15.112:0/3158115632 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f1d64049b20 con 0x7f1d700fb940 2024-04-25T02:01:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:29.974+0000 7f1d6ffff700 1 -- 172.21.15.112:0/3158115632 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f1d600368d0 msgr2=0x7f1d60038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/2375514340 2024-04-25T02:01:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:29.974+0000 7f1d6ffff700 1 --2- 172.21.15.112:0/3158115632 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f1d600368d0 0x7f1d60038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:01:29.986 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:29.979+0000 7f1d6d7fa700 1 -- 172.21.15.112:0/3158115632 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1d64013a80 con 0x7f1d700fb940 2024-04-25T02:01:30.179 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:30.175+0000 7f1d6ffff700 1 -- 172.21.15.112:0/3158115632 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f1d600368d0 msgr2=0x7f1d60038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/2375514340 2024-04-25T02:01:30.180 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:30.175+0000 7f1d6ffff700 1 --2- 172.21.15.112:0/3158115632 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f1d600368d0 0x7f1d60038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T02:01:30.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:30.245+0000 7f1d76e14700 1 -- 172.21.15.112:0/3158115632 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1d7005f5c0 con 0x7f1d700fb940 2024-04-25T02:01:30.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:30.245+0000 7f1d6d7fa700 1 -- 172.21.15.112:0/3158115632 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f1d64011370 con 0x7f1d700fb940 2024-04-25T02:01:30.250 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T02:01:30.250 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"4bb93d82-02a7-11ef-bc93-c7b262605968","modified":"2024-04-25T01:59:19.321779Z","created":"2024-04-25T01:59:19.321779Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi077","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T02:01:30.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:30.247+0000 7f1d76e14700 1 -- 172.21.15.112:0/3158115632 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f1d600368d0 msgr2=0x7f1d60038d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:01:30.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:30.247+0000 7f1d76e14700 1 --2- 172.21.15.112:0/3158115632 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f1d600368d0 0x7f1d60038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:30.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:30.247+0000 7f1d76e14700 1 -- 172.21.15.112:0/3158115632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d700fb940 msgr2=0x7f1d70066840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:30.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:30.247+0000 7f1d76e14700 1 --2- 172.21.15.112:0/3158115632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d700fb940 0x7f1d70066840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1d640096b0 tx=0x7f1d64009e30 comp rx=0 tx=0).stop 2024-04-25T02:01:30.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:30.247+0000 7f1d76e14700 1 -- 172.21.15.112:0/3158115632 shutdown_connections 2024-04-25T02:01:30.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:30.247+0000 7f1d76e14700 1 --2- 172.21.15.112:0/3158115632 >> [v2:172.21.15.77:6800/2375514340,v1:172.21.15.77:6801/2375514340] conn(0x7f1d600368d0 0x7f1d60038d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:30.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:30.247+0000 7f1d76e14700 1 --2- 172.21.15.112:0/3158115632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d700fb940 0x7f1d70066840 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:30.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:30.247+0000 7f1d76e14700 1 -- 172.21.15.112:0/3158115632 >> 172.21.15.112:0/3158115632 conn(0x7f1d700f70a0 msgr2=0x7f1d70102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:30.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:30.247+0000 7f1d76e14700 1 -- 172.21.15.112:0/3158115632 shutdown_connections 2024-04-25T02:01:30.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:30.247+0000 7f1d76e14700 1 -- 172.21.15.112:0/3158115632 wait complete. 2024-04-25T02:01:30.253 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-04-25T02:01:30.465 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:30 smithi077 ceph-mon[26330]: from='client.? 172.21.15.112:0/3158115632' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:01:31.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:31 smithi077 ceph-mon[26330]: Active manager daemon smithi077.zpflzp restarted 2024-04-25T02:01:31.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:31 smithi077 ceph-mon[26330]: Activating manager daemon smithi077.zpflzp 2024-04-25T02:01:31.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:31 smithi077 ceph-mon[26330]: osdmap e5: 0 total, 0 up, 0 in 2024-04-25T02:01:31.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:31 smithi077 ceph-mon[26330]: mgrmap e15: smithi077.zpflzp(active, starting, since 0.00576337s) 2024-04-25T02:01:31.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-04-25T02:01:31.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr metadata", "who": "smithi077.zpflzp", "id": "smithi077.zpflzp"}]: dispatch 2024-04-25T02:01:31.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T02:01:31.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T02:01:31.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T02:01:31.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:31 smithi077 ceph-mon[26330]: Manager daemon smithi077.zpflzp is now available 2024-04-25T02:01:31.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:01:31.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:01:31.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:31.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:01:31.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.zpflzp/mirror_snapshot_schedule"}]: dispatch 2024-04-25T02:01:31.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.zpflzp/trash_purge_schedule"}]: dispatch 2024-04-25T02:01:31.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:31.896 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T02:01:31.896 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T02:01:32.142 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T02:01:32.198 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T02:01:32.642 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:32 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:32.643 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:32 smithi077 ceph-mon[26330]: [25/Apr/2024:02:01:31] ENGINE Bus STARTING 2024-04-25T02:01:32.643 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:32 smithi077 ceph-mon[26330]: mgrmap e16: smithi077.zpflzp(active, since 1.00772s) 2024-04-25T02:01:32.643 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:32 smithi077 ceph-mon[26330]: [25/Apr/2024:02:01:31] ENGINE Serving on https://172.21.15.77:7150 2024-04-25T02:01:32.643 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:32 smithi077 ceph-mon[26330]: [25/Apr/2024:02:01:31] ENGINE Bus STARTED 2024-04-25T02:01:32.643 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:32 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:32.643 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:32 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:34.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.247+0000 7f765209f700 1 -- 172.21.15.112:0/2409185568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f764c0fca30 msgr2=0x7f764c0fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:34.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.247+0000 7f765209f700 1 --2- 172.21.15.112:0/2409185568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f764c0fca30 0x7f764c0fce40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f763c0048c0 tx=0x7f763c009e30 comp rx=0 tx=0).stop 2024-04-25T02:01:34.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.247+0000 7f765209f700 1 -- 172.21.15.112:0/2409185568 shutdown_connections 2024-04-25T02:01:34.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.247+0000 7f765209f700 1 --2- 172.21.15.112:0/2409185568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f764c0fca30 0x7f764c0fce40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:34.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.247+0000 7f765209f700 1 -- 172.21.15.112:0/2409185568 >> 172.21.15.112:0/2409185568 conn(0x7f764c0f8170 msgr2=0x7f764c0fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:34.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.247+0000 7f765209f700 1 -- 172.21.15.112:0/2409185568 shutdown_connections 2024-04-25T02:01:34.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.247+0000 7f765209f700 1 -- 172.21.15.112:0/2409185568 wait complete. 2024-04-25T02:01:34.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.247+0000 7f765209f700 1 Processor -- start 2024-04-25T02:01:34.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.248+0000 7f765209f700 1 -- start start 2024-04-25T02:01:34.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.248+0000 7f765209f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f764c0fca30 0x7f764c10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:34.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.248+0000 7f765209f700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764c10d5f0 con 0x7f764c0fca30 2024-04-25T02:01:34.254 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.248+0000 7f764b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f764c0fca30 0x7f764c10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:34.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.248+0000 7f764b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f764c0fca30 0x7f764c10d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.112:60390/0 (socket says 172.21.15.112:60390) 2024-04-25T02:01:34.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.248+0000 7f764b7fe700 1 -- 172.21.15.112:0/2152174396 learned_addr learned my addr 172.21.15.112:0/2152174396 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T02:01:34.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.248+0000 7f764b7fe700 1 -- 172.21.15.112:0/2152174396 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c005040 con 0x7f764c0fca30 2024-04-25T02:01:34.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.248+0000 7f764b7fe700 1 --2- 172.21.15.112:0/2152174396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f764c0fca30 0x7f764c10d0b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f763c0096b0 tx=0x7f763c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:34.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.248+0000 7f7633fff700 1 -- 172.21.15.112:0/2152174396 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f763c00bed0 con 0x7f764c0fca30 2024-04-25T02:01:34.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.249+0000 7f765209f700 1 -- 172.21.15.112:0/2152174396 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f764c10d7f0 con 0x7f764c0fca30 2024-04-25T02:01:34.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.249+0000 7f7633fff700 1 -- 172.21.15.112:0/2152174396 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f763c00b5c0 con 0x7f764c0fca30 2024-04-25T02:01:34.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.249+0000 7f7633fff700 1 -- 172.21.15.112:0/2152174396 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f763c01c5b0 con 0x7f764c0fca30 2024-04-25T02:01:34.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.249+0000 7f765209f700 1 -- 172.21.15.112:0/2152174396 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f764c10e360 con 0x7f764c0fca30 2024-04-25T02:01:34.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.249+0000 7f7633fff700 1 -- 172.21.15.112:0/2152174396 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f763c01c820 con 0x7f764c0fca30 2024-04-25T02:01:34.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.249+0000 7f7633fff700 1 --2- 172.21.15.112:0/2152174396 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f7634036970 0x7f7634038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:34.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.250+0000 7f7633fff700 1 -- 172.21.15.112:0/2152174396 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f763c049d00 con 0x7f764c0fca30 2024-04-25T02:01:34.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.250+0000 7f765209f700 1 -- 172.21.15.112:0/2152174396 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f764c102f40 con 0x7f764c0fca30 2024-04-25T02:01:34.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.250+0000 7f764affd700 1 --2- 172.21.15.112:0/2152174396 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f7634036970 0x7f7634038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:34.255 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.250+0000 7f764affd700 1 --2- 172.21.15.112:0/2152174396 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f7634036970 0x7f7634038e20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7640009990 tx=0x7f7640006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:34.259 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.255+0000 7f7633fff700 1 -- 172.21.15.112:0/2152174396 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f763c023300 con 0x7f764c0fca30 2024-04-25T02:01:34.523 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.518+0000 7f765209f700 1 -- 172.21.15.112:0/2152174396 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f764c05f5c0 con 0x7f764c0fca30 2024-04-25T02:01:34.524 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.519+0000 7f7633fff700 1 -- 172.21.15.112:0/2152174396 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f763c034090 con 0x7f764c0fca30 2024-04-25T02:01:34.524 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T02:01:34.524 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"4bb93d82-02a7-11ef-bc93-c7b262605968","modified":"2024-04-25T01:59:19.321779Z","created":"2024-04-25T01:59:19.321779Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi077","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T02:01:34.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.521+0000 7f765209f700 1 -- 172.21.15.112:0/2152174396 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f7634036970 msgr2=0x7f7634038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:34.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.521+0000 7f765209f700 1 --2- 172.21.15.112:0/2152174396 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f7634036970 0x7f7634038e20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7640009990 tx=0x7f7640006e40 comp rx=0 tx=0).stop 2024-04-25T02:01:34.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.521+0000 7f765209f700 1 -- 172.21.15.112:0/2152174396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f764c0fca30 msgr2=0x7f764c10d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:34.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.521+0000 7f765209f700 1 --2- 172.21.15.112:0/2152174396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f764c0fca30 0x7f764c10d0b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f763c0096b0 tx=0x7f763c009e30 comp rx=0 tx=0).stop 2024-04-25T02:01:34.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.521+0000 7f765209f700 1 -- 172.21.15.112:0/2152174396 shutdown_connections 2024-04-25T02:01:34.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.521+0000 7f765209f700 1 --2- 172.21.15.112:0/2152174396 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f7634036970 0x7f7634038e20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:34.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.521+0000 7f765209f700 1 --2- 172.21.15.112:0/2152174396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f764c0fca30 0x7f764c10d0b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:34.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.521+0000 7f765209f700 1 -- 172.21.15.112:0/2152174396 >> 172.21.15.112:0/2152174396 conn(0x7f764c0f8170 msgr2=0x7f764c103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:34.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.521+0000 7f765209f700 1 -- 172.21.15.112:0/2152174396 shutdown_connections 2024-04-25T02:01:34.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:34.521+0000 7f765209f700 1 -- 172.21.15.112:0/2152174396 wait complete. 2024-04-25T02:01:34.527 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-04-25T02:01:34.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:34 smithi077 ceph-mon[26330]: mgrmap e17: smithi077.zpflzp(active, since 2s) 2024-04-25T02:01:35.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:35 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:35.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:35 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:35.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:35 smithi077 ceph-mon[26330]: from='client.? 172.21.15.112:0/2152174396' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:01:35.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:35 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:35.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:35 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:35.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:35 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi077", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:01:36.772 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T02:01:36.773 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T02:01:37.032 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:01:37.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:37 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:37.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:37 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:37.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:37 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:37.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:37 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:37.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:37 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:01:37.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:37 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:37.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:37 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:01:37.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:37 smithi077 ceph-mon[26330]: Updating smithi077:/etc/ceph/ceph.conf 2024-04-25T02:01:37.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:37 smithi077 ceph-mon[26330]: Updating smithi112:/etc/ceph/ceph.conf 2024-04-25T02:01:37.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:37 smithi077 ceph-mon[26330]: Updating smithi077:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:01:37.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:37 smithi077 ceph-mon[26330]: Updating smithi112:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:01:37.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:37 smithi077 ceph-mon[26330]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:01:37.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:37 smithi077 ceph-mon[26330]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:01:37.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:37 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:37.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:37 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:37.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:37 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:37.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:37 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:37.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:37 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:37.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:37 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T02:01:37.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:37 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-25T02:01:37.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:37 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:38.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:38 smithi077 ceph-mon[26330]: Updating smithi077:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:01:38.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:38 smithi077 ceph-mon[26330]: Updating smithi112:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:01:38.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:38 smithi077 ceph-mon[26330]: Deploying daemon crash.smithi112 on smithi112 2024-04-25T02:01:39.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.189+0000 7f16d94d1700 1 -- 172.21.15.112:0/4183136677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16d4101990 msgr2=0x7f16d4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:39.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.189+0000 7f16d94d1700 1 --2- 172.21.15.112:0/4183136677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16d4101990 0x7f16d4101d60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f16c40048c0 tx=0x7f16c4009e30 comp rx=0 tx=0).stop 2024-04-25T02:01:39.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.189+0000 7f16d94d1700 1 -- 172.21.15.112:0/4183136677 shutdown_connections 2024-04-25T02:01:39.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.189+0000 7f16d94d1700 1 --2- 172.21.15.112:0/4183136677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16d4101990 0x7f16d4101d60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:39.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.189+0000 7f16d94d1700 1 -- 172.21.15.112:0/4183136677 >> 172.21.15.112:0/4183136677 conn(0x7f16d40f74f0 msgr2=0x7f16d40f9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:39.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.189+0000 7f16d94d1700 1 -- 172.21.15.112:0/4183136677 shutdown_connections 2024-04-25T02:01:39.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.189+0000 7f16d94d1700 1 -- 172.21.15.112:0/4183136677 wait complete. 2024-04-25T02:01:39.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.190+0000 7f16d94d1700 1 Processor -- start 2024-04-25T02:01:39.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.190+0000 7f16d94d1700 1 -- start start 2024-04-25T02:01:39.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.190+0000 7f16d94d1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16d4101990 0x7f16d410e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:39.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.190+0000 7f16d94d1700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d4066c20 con 0x7f16d4101990 2024-04-25T02:01:39.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.190+0000 7f16d2ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16d4101990 0x7f16d410e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:39.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.190+0000 7f16d2ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16d4101990 0x7f16d410e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.112:45966/0 (socket says 172.21.15.112:45966) 2024-04-25T02:01:39.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.190+0000 7f16d2ffd700 1 -- 172.21.15.112:0/3265808279 learned_addr learned my addr 172.21.15.112:0/3265808279 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T02:01:39.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.191+0000 7f16d2ffd700 1 -- 172.21.15.112:0/3265808279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c4005040 con 0x7f16d4101990 2024-04-25T02:01:39.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.191+0000 7f16d2ffd700 1 --2- 172.21.15.112:0/3265808279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16d4101990 0x7f16d410e2a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f16c400b7f0 tx=0x7f16c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:39.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.191+0000 7f16cbfff700 1 -- 172.21.15.112:0/3265808279 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f16c4009370 con 0x7f16d4101990 2024-04-25T02:01:39.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.191+0000 7f16d94d1700 1 -- 172.21.15.112:0/3265808279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d410e7e0 con 0x7f16d4101990 2024-04-25T02:01:39.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.191+0000 7f16cbfff700 1 -- 172.21.15.112:0/3265808279 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f16c4013420 con 0x7f16d4101990 2024-04-25T02:01:39.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.191+0000 7f16cbfff700 1 -- 172.21.15.112:0/3265808279 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f16c401c590 con 0x7f16d4101990 2024-04-25T02:01:39.197 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.191+0000 7f16d94d1700 1 -- 172.21.15.112:0/3265808279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d410ec50 con 0x7f16d4101990 2024-04-25T02:01:39.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.192+0000 7f16cbfff700 1 -- 172.21.15.112:0/3265808279 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f16c4013a70 con 0x7f16d4101990 2024-04-25T02:01:39.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.192+0000 7f16d94d1700 1 -- 172.21.15.112:0/3265808279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d410eef0 con 0x7f16d4101990 2024-04-25T02:01:39.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.192+0000 7f16cbfff700 1 --2- 172.21.15.112:0/3265808279 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f16c0036970 0x7f16c0038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:39.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.192+0000 7f16cbfff700 1 -- 172.21.15.112:0/3265808279 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f16c4049400 con 0x7f16d4101990 2024-04-25T02:01:39.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.192+0000 7f16ca7fc700 1 --2- 172.21.15.112:0/3265808279 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f16c0036970 0x7f16c0038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:39.198 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.193+0000 7f16ca7fc700 1 --2- 172.21.15.112:0/3265808279 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f16c0036970 0x7f16c0038e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009990 tx=0x7f16bc006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:39.202 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.197+0000 7f16cbfff700 1 -- 172.21.15.112:0/3265808279 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f16c4024d30 con 0x7f16d4101990 2024-04-25T02:01:39.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.465+0000 7f16d94d1700 1 -- 172.21.15.112:0/3265808279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f16d404bed0 con 0x7f16d4101990 2024-04-25T02:01:39.470 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.466+0000 7f16cbfff700 1 -- 172.21.15.112:0/3265808279 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f16c4021030 con 0x7f16d4101990 2024-04-25T02:01:39.470 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T02:01:39.470 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"4bb93d82-02a7-11ef-bc93-c7b262605968","modified":"2024-04-25T01:59:19.321779Z","created":"2024-04-25T01:59:19.321779Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi077","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T02:01:39.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.468+0000 7f16d94d1700 1 -- 172.21.15.112:0/3265808279 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f16c0036970 msgr2=0x7f16c0038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:39.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.468+0000 7f16d94d1700 1 --2- 172.21.15.112:0/3265808279 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f16c0036970 0x7f16c0038e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009990 tx=0x7f16bc006e40 comp rx=0 tx=0).stop 2024-04-25T02:01:39.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.468+0000 7f16d94d1700 1 -- 172.21.15.112:0/3265808279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16d4101990 msgr2=0x7f16d410e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:39.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.468+0000 7f16d94d1700 1 --2- 172.21.15.112:0/3265808279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16d4101990 0x7f16d410e2a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f16c400b7f0 tx=0x7f16c4009e30 comp rx=0 tx=0).stop 2024-04-25T02:01:39.472 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.468+0000 7f16d94d1700 1 -- 172.21.15.112:0/3265808279 shutdown_connections 2024-04-25T02:01:39.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.468+0000 7f16d94d1700 1 --2- 172.21.15.112:0/3265808279 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f16c0036970 0x7f16c0038e20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:39.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.468+0000 7f16d94d1700 1 --2- 172.21.15.112:0/3265808279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16d4101990 0x7f16d410e2a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:39.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.468+0000 7f16d94d1700 1 -- 172.21.15.112:0/3265808279 >> 172.21.15.112:0/3265808279 conn(0x7f16d40f74f0 msgr2=0x7f16d40f8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:39.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.468+0000 7f16d94d1700 1 -- 172.21.15.112:0/3265808279 shutdown_connections 2024-04-25T02:01:39.473 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:39.468+0000 7f16d94d1700 1 -- 172.21.15.112:0/3265808279 wait complete. 2024-04-25T02:01:39.473 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-04-25T02:01:39.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:39 smithi077 ceph-mon[26330]: from='client.? 172.21.15.112:0/3265808279' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:01:41.329 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T02:01:41.330 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T02:01:41.593 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:01:42.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:42 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:42.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:42 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:42.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:42 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:42.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:42 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:42.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:42 smithi077 ceph-mon[26330]: Deploying daemon node-exporter.smithi112 on smithi112 2024-04-25T02:01:43.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.057+0000 7f71278c0700 1 -- 172.21.15.112:0/1966533112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7120101990 msgr2=0x7f7120101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:43.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.057+0000 7f71278c0700 1 --2- 172.21.15.112:0/1966533112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7120101990 0x7f7120101d60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f711c0048c0 tx=0x7f711c009e30 comp rx=0 tx=0).stop 2024-04-25T02:01:43.063 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.057+0000 7f71278c0700 1 -- 172.21.15.112:0/1966533112 shutdown_connections 2024-04-25T02:01:43.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.057+0000 7f71278c0700 1 --2- 172.21.15.112:0/1966533112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7120101990 0x7f7120101d60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:43.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.057+0000 7f71278c0700 1 -- 172.21.15.112:0/1966533112 >> 172.21.15.112:0/1966533112 conn(0x7f71200f74f0 msgr2=0x7f71200f9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:43.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.057+0000 7f71278c0700 1 -- 172.21.15.112:0/1966533112 shutdown_connections 2024-04-25T02:01:43.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.057+0000 7f71278c0700 1 -- 172.21.15.112:0/1966533112 wait complete. 2024-04-25T02:01:43.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.057+0000 7f71278c0700 1 Processor -- start 2024-04-25T02:01:43.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.057+0000 7f71278c0700 1 -- start start 2024-04-25T02:01:43.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.058+0000 7f71278c0700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7120101990 0x7f712010e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:43.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.058+0000 7f71278c0700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7120066c20 con 0x7f7120101990 2024-04-25T02:01:43.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.058+0000 7f712565c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7120101990 0x7f712010e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:43.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.058+0000 7f712565c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7120101990 0x7f712010e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.112:45984/0 (socket says 172.21.15.112:45984) 2024-04-25T02:01:43.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.058+0000 7f712565c700 1 -- 172.21.15.112:0/785724604 learned_addr learned my addr 172.21.15.112:0/785724604 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T02:01:43.064 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.058+0000 7f712565c700 1 -- 172.21.15.112:0/785724604 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711c005040 con 0x7f7120101990 2024-04-25T02:01:43.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.058+0000 7f712565c700 1 --2- 172.21.15.112:0/785724604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7120101990 0x7f712010e2a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f711c00b820 tx=0x7f711c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:43.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.058+0000 7f7115ffb700 1 -- 172.21.15.112:0/785724604 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f711c0093c0 con 0x7f7120101990 2024-04-25T02:01:43.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.058+0000 7f71278c0700 1 -- 172.21.15.112:0/785724604 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f712010e7e0 con 0x7f7120101990 2024-04-25T02:01:43.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.058+0000 7f7115ffb700 1 -- 172.21.15.112:0/785724604 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f711c013420 con 0x7f7120101990 2024-04-25T02:01:43.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.058+0000 7f7115ffb700 1 -- 172.21.15.112:0/785724604 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f711c01c5b0 con 0x7f7120101990 2024-04-25T02:01:43.065 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.059+0000 7f71278c0700 1 -- 172.21.15.112:0/785724604 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f712010ec50 con 0x7f7120101990 2024-04-25T02:01:43.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.059+0000 7f71278c0700 1 -- 172.21.15.112:0/785724604 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712010ef50 con 0x7f7120101990 2024-04-25T02:01:43.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.059+0000 7f7115ffb700 1 -- 172.21.15.112:0/785724604 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f711c009520 con 0x7f7120101990 2024-04-25T02:01:43.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.060+0000 7f7115ffb700 1 --2- 172.21.15.112:0/785724604 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f710c036970 0x7f710c038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:43.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.060+0000 7f7115ffb700 1 -- 172.21.15.112:0/785724604 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f711c049b60 con 0x7f7120101990 2024-04-25T02:01:43.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.060+0000 7f7124e5b700 1 --2- 172.21.15.112:0/785724604 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f710c036970 0x7f710c038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:43.066 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.060+0000 7f7124e5b700 1 --2- 172.21.15.112:0/785724604 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f710c036970 0x7f710c038e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7110009990 tx=0x7f7110006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:43.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.064+0000 7f7115ffb700 1 -- 172.21.15.112:0/785724604 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f712010ef50 con 0x7f7120101990 2024-04-25T02:01:43.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.346+0000 7f71278c0700 1 -- 172.21.15.112:0/785724604 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f712010ef50 con 0x7f7120101990 2024-04-25T02:01:43.351 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.346+0000 7f7115ffb700 1 -- 172.21.15.112:0/785724604 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f712010ef50 con 0x7f7120101990 2024-04-25T02:01:43.351 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T02:01:43.351 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"4bb93d82-02a7-11ef-bc93-c7b262605968","modified":"2024-04-25T01:59:19.321779Z","created":"2024-04-25T01:59:19.321779Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi077","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T02:01:43.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.348+0000 7f71278c0700 1 -- 172.21.15.112:0/785724604 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f710c036970 msgr2=0x7f710c038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:43.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.348+0000 7f71278c0700 1 --2- 172.21.15.112:0/785724604 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f710c036970 0x7f710c038e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7110009990 tx=0x7f7110006e40 comp rx=0 tx=0).stop 2024-04-25T02:01:43.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.348+0000 7f71278c0700 1 -- 172.21.15.112:0/785724604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7120101990 msgr2=0x7f712010e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:43.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.348+0000 7f71278c0700 1 --2- 172.21.15.112:0/785724604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7120101990 0x7f712010e2a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f711c00b820 tx=0x7f711c009e30 comp rx=0 tx=0).stop 2024-04-25T02:01:43.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.348+0000 7f71278c0700 1 -- 172.21.15.112:0/785724604 shutdown_connections 2024-04-25T02:01:43.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.348+0000 7f71278c0700 1 --2- 172.21.15.112:0/785724604 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f710c036970 0x7f710c038e20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:43.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.348+0000 7f71278c0700 1 --2- 172.21.15.112:0/785724604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7120101990 0x7f712010e2a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:43.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.349+0000 7f71278c0700 1 -- 172.21.15.112:0/785724604 >> 172.21.15.112:0/785724604 conn(0x7f71200f74f0 msgr2=0x7f71200f8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:43.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.349+0000 7f71278c0700 1 -- 172.21.15.112:0/785724604 shutdown_connections 2024-04-25T02:01:43.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:43.349+0000 7f71278c0700 1 -- 172.21.15.112:0/785724604 wait complete. 2024-04-25T02:01:43.354 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-04-25T02:01:43.667 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:43 smithi077 ceph-mon[26330]: from='client.? 172.21.15.112:0/785724604' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:01:45.027 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T02:01:45.027 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T02:01:45.404 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:01:46.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:46 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:46.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:46 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:01:47.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:47.786+0000 7f7018212700 1 -- 172.21.15.112:0/3730380609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70100fda70 msgr2=0x7f70100fde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:47.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:47.786+0000 7f7018212700 1 --2- 172.21.15.112:0/3730380609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70100fda70 0x7f70100fde40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f70000048c0 tx=0x7f7000009e30 comp rx=0 tx=0).stop 2024-04-25T02:01:47.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:47.786+0000 7f7018212700 1 -- 172.21.15.112:0/3730380609 shutdown_connections 2024-04-25T02:01:47.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:47.786+0000 7f7018212700 1 --2- 172.21.15.112:0/3730380609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70100fda70 0x7f70100fde40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:47.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:47.786+0000 7f7018212700 1 -- 172.21.15.112:0/3730380609 >> 172.21.15.112:0/3730380609 conn(0x7f70100f74f0 msgr2=0x7f70100f9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:47.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:47.787+0000 7f7018212700 1 -- 172.21.15.112:0/3730380609 shutdown_connections 2024-04-25T02:01:47.792 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:47.787+0000 7f7018212700 1 -- 172.21.15.112:0/3730380609 wait complete. 2024-04-25T02:01:47.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:47.787+0000 7f7018212700 1 Processor -- start 2024-04-25T02:01:47.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:47.787+0000 7f7018212700 1 -- start start 2024-04-25T02:01:47.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:47.787+0000 7f7018212700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70100fda70 0x7f7010113160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:47.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:47.787+0000 7f7018212700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70101136a0 con 0x7f70100fda70 2024-04-25T02:01:47.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:47.788+0000 7f7015fae700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70100fda70 0x7f7010113160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:47.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:47.788+0000 7f7015fae700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70100fda70 0x7f7010113160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.112:56404/0 (socket says 172.21.15.112:56404) 2024-04-25T02:01:47.793 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:47.788+0000 7f7015fae700 1 -- 172.21.15.112:0/1421399504 learned_addr learned my addr 172.21.15.112:0/1421399504 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T02:01:47.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:47.788+0000 7f7015fae700 1 -- 172.21.15.112:0/1421399504 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7000005040 con 0x7f70100fda70 2024-04-25T02:01:47.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:47.788+0000 7f7015fae700 1 --2- 172.21.15.112:0/1421399504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70100fda70 0x7f7010113160 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f700000b820 tx=0x7f7000009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:47.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:47.788+0000 7f70067fc700 1 -- 172.21.15.112:0/1421399504 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f70000093c0 con 0x7f70100fda70 2024-04-25T02:01:47.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:47.788+0000 7f70067fc700 1 -- 172.21.15.112:0/1421399504 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7000013420 con 0x7f70100fda70 2024-04-25T02:01:47.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:47.788+0000 7f7018212700 1 -- 172.21.15.112:0/1421399504 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70101138a0 con 0x7f70100fda70 2024-04-25T02:01:47.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:47.788+0000 7f70067fc700 1 -- 172.21.15.112:0/1421399504 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f700001c5b0 con 0x7f70100fda70 2024-04-25T02:01:47.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:47.788+0000 7f7018212700 1 -- 172.21.15.112:0/1421399504 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7010113d10 con 0x7f70100fda70 2024-04-25T02:01:47.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:47.789+0000 7f7018212700 1 -- 172.21.15.112:0/1421399504 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7010066500 con 0x7f70100fda70 2024-04-25T02:01:47.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:47.789+0000 7f70067fc700 1 -- 172.21.15.112:0/1421399504 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f7000013a90 con 0x7f70100fda70 2024-04-25T02:01:47.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:47.789+0000 7f70067fc700 1 --2- 172.21.15.112:0/1421399504 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f6ffc036970 0x7f6ffc038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:47.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:47.789+0000 7f70067fc700 1 -- 172.21.15.112:0/1421399504 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f7000049a70 con 0x7f70100fda70 2024-04-25T02:01:47.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:47.790+0000 7f70157ad700 1 --2- 172.21.15.112:0/1421399504 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f6ffc036970 0x7f6ffc038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:47.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:47.790+0000 7f70157ad700 1 --2- 172.21.15.112:0/1421399504 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f6ffc036970 0x7f6ffc038e20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f700c009990 tx=0x7f700c006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:47.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:47.794+0000 7f70067fc700 1 -- 172.21.15.112:0/1421399504 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f70000098a0 con 0x7f70100fda70 2024-04-25T02:01:48.068 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:48.064+0000 7f7018212700 1 -- 172.21.15.112:0/1421399504 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f701005f5c0 con 0x7f70100fda70 2024-04-25T02:01:48.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:48.064+0000 7f70067fc700 1 -- 172.21.15.112:0/1421399504 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f7000011370 con 0x7f70100fda70 2024-04-25T02:01:48.069 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T02:01:48.069 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"4bb93d82-02a7-11ef-bc93-c7b262605968","modified":"2024-04-25T01:59:19.321779Z","created":"2024-04-25T01:59:19.321779Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi077","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T02:01:48.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:48.066+0000 7f7018212700 1 -- 172.21.15.112:0/1421399504 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f6ffc036970 msgr2=0x7f6ffc038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:48.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:48.066+0000 7f7018212700 1 --2- 172.21.15.112:0/1421399504 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f6ffc036970 0x7f6ffc038e20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f700c009990 tx=0x7f700c006e40 comp rx=0 tx=0).stop 2024-04-25T02:01:48.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:48.066+0000 7f7018212700 1 -- 172.21.15.112:0/1421399504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70100fda70 msgr2=0x7f7010113160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:48.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:48.066+0000 7f7018212700 1 --2- 172.21.15.112:0/1421399504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70100fda70 0x7f7010113160 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f700000b820 tx=0x7f7000009e30 comp rx=0 tx=0).stop 2024-04-25T02:01:48.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:48.066+0000 7f7018212700 1 -- 172.21.15.112:0/1421399504 shutdown_connections 2024-04-25T02:01:48.071 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:48.066+0000 7f7018212700 1 --2- 172.21.15.112:0/1421399504 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f6ffc036970 0x7f6ffc038e20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:48.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:48.066+0000 7f7018212700 1 --2- 172.21.15.112:0/1421399504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70100fda70 0x7f7010113160 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:48.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:48.067+0000 7f7018212700 1 -- 172.21.15.112:0/1421399504 >> 172.21.15.112:0/1421399504 conn(0x7f70100f74f0 msgr2=0x7f7010103760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:48.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:48.067+0000 7f7018212700 1 -- 172.21.15.112:0/1421399504 shutdown_connections 2024-04-25T02:01:48.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:48.067+0000 7f7018212700 1 -- 172.21.15.112:0/1421399504 wait complete. 2024-04-25T02:01:48.072 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-04-25T02:01:48.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:47 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:48.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:47 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:48.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:47 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:48.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:47 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:48.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:47 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.cswrxs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T02:01:48.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:47 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.cswrxs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-25T02:01:48.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:47 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T02:01:48.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:47 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:48.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:47 smithi077 ceph-mon[26330]: Deploying daemon mgr.smithi112.cswrxs on smithi112 2024-04-25T02:01:49.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:48 smithi077 ceph-mon[26330]: from='client.? 172.21.15.112:0/1421399504' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:01:50.780 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T02:01:50.781 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T02:01:51.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:51 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:51.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:51 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:51.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:51 smithi077 ceph-mon[26330]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:51.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:51 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:51.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:51 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:51.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:51 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:51.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:51 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:01:51.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:51 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:51.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:51 smithi077 ceph-mon[26330]: Deploying daemon mon.smithi112 on smithi112 2024-04-25T02:01:52.957 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi112/config 2024-04-25T02:01:53.335 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:53 smithi112 systemd[1]: Starting Ceph mon.smithi112 for 4bb93d82-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:01:53.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:01:53 smithi077 ceph-mon[26330]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:54.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.658+0000 7f1373dc7700 1 -- 172.21.15.112:0/2823675365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f136c102b60 msgr2=0x7f136c102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:54.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.658+0000 7f1373dc7700 1 --2- 172.21.15.112:0/2823675365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f136c102b60 0x7f136c102f30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f13680048c0 tx=0x7f1368009e30 comp rx=0 tx=0).stop 2024-04-25T02:01:54.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.659+0000 7f1373dc7700 1 -- 172.21.15.112:0/2823675365 shutdown_connections 2024-04-25T02:01:54.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.659+0000 7f1373dc7700 1 --2- 172.21.15.112:0/2823675365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f136c102b60 0x7f136c102f30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:54.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.659+0000 7f1373dc7700 1 -- 172.21.15.112:0/2823675365 >> 172.21.15.112:0/2823675365 conn(0x7f136c0f86f0 msgr2=0x7f136c0fab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:54.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.659+0000 7f1373dc7700 1 -- 172.21.15.112:0/2823675365 shutdown_connections 2024-04-25T02:01:54.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.659+0000 7f1373dc7700 1 -- 172.21.15.112:0/2823675365 wait complete. 2024-04-25T02:01:54.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.659+0000 7f1373dc7700 1 Processor -- start 2024-04-25T02:01:54.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.660+0000 7f1373dc7700 1 -- start start 2024-04-25T02:01:54.666 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.660+0000 7f1373dc7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f136c102b60 0x7f136c1131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:54.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.660+0000 7f1373dc7700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c113730 con 0x7f136c102b60 2024-04-25T02:01:54.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.660+0000 7f1371b63700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f136c102b60 0x7f136c1131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:54.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.660+0000 7f1371b63700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f136c102b60 0x7f136c1131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.112:53756/0 (socket says 172.21.15.112:53756) 2024-04-25T02:01:54.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.660+0000 7f1371b63700 1 -- 172.21.15.112:0/787114056 learned_addr learned my addr 172.21.15.112:0/787114056 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T02:01:54.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.660+0000 7f1371b63700 1 -- 172.21.15.112:0/787114056 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1368005040 con 0x7f136c102b60 2024-04-25T02:01:54.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.661+0000 7f1371b63700 1 --2- 172.21.15.112:0/787114056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f136c102b60 0x7f136c1131f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f136800b820 tx=0x7f1368009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:54.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.661+0000 7f13627fc700 1 -- 172.21.15.112:0/787114056 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f13680093c0 con 0x7f136c102b60 2024-04-25T02:01:54.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.661+0000 7f1373dc7700 1 -- 172.21.15.112:0/787114056 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136c113930 con 0x7f136c102b60 2024-04-25T02:01:54.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.661+0000 7f13627fc700 1 -- 172.21.15.112:0/787114056 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1368013420 con 0x7f136c102b60 2024-04-25T02:01:54.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.661+0000 7f13627fc700 1 -- 172.21.15.112:0/787114056 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f136801c5b0 con 0x7f136c102b60 2024-04-25T02:01:54.667 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.661+0000 7f1373dc7700 1 -- 172.21.15.112:0/787114056 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136c113e20 con 0x7f136c102b60 2024-04-25T02:01:54.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.662+0000 7f13627fc700 1 -- 172.21.15.112:0/787114056 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f136801c7a0 con 0x7f136c102b60 2024-04-25T02:01:54.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.662+0000 7f1373dc7700 1 -- 172.21.15.112:0/787114056 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f136c0fe2b0 con 0x7f136c102b60 2024-04-25T02:01:54.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.662+0000 7f13627fc700 1 --2- 172.21.15.112:0/787114056 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f13580369c0 0x7f1358038e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:54.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.662+0000 7f13627fc700 1 -- 172.21.15.112:0/787114056 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f1368049b30 con 0x7f136c102b60 2024-04-25T02:01:54.668 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.662+0000 7f1371362700 1 --2- 172.21.15.112:0/787114056 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f13580369c0 0x7f1358038e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:54.669 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.663+0000 7f1371362700 1 --2- 172.21.15.112:0/787114056 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f13580369c0 0x7f1358038e70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f135c009990 tx=0x7f135c006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:54.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.667+0000 7f13627fc700 1 -- 172.21.15.112:0/787114056 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1368023300 con 0x7f136c102b60 2024-04-25T02:01:54.959 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.954+0000 7f1373dc7700 1 -- 172.21.15.112:0/787114056 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f136c05f5c0 con 0x7f136c102b60 2024-04-25T02:01:54.959 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:54 smithi112 podman[33253]: 2024-04-25 02:01:54.67834061 +0000 UTC m=+0.204192546 image pull 0de407c1b3afb7a571e0cc4b0c826a995ed358d49d5f013ca6bdfad025b55c43 quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17 2024-04-25T02:01:54.959 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:54 smithi112 podman[33253]: 2024-04-25 02:01:54.777998092 +0000 UTC m=+0.303850016 container create db2fb9b097899b1beeded6fdda300057100e9f712d58f0a2ac03a0ffd98f7fbb (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi112, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, RELEASE=quincy-c61472c, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, ceph=True) 2024-04-25T02:01:54.960 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.955+0000 7f13627fc700 1 -- 172.21.15.112:0/787114056 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f1368011b60 con 0x7f136c102b60 2024-04-25T02:01:54.960 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T02:01:54.960 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"4bb93d82-02a7-11ef-bc93-c7b262605968","modified":"2024-04-25T01:59:19.321779Z","created":"2024-04-25T01:59:19.321779Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi077","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T02:01:54.961 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.957+0000 7f1373dc7700 1 -- 172.21.15.112:0/787114056 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f13580369c0 msgr2=0x7f1358038e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:54.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.957+0000 7f1373dc7700 1 --2- 172.21.15.112:0/787114056 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f13580369c0 0x7f1358038e70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f135c009990 tx=0x7f135c006e40 comp rx=0 tx=0).stop 2024-04-25T02:01:54.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.957+0000 7f1373dc7700 1 -- 172.21.15.112:0/787114056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f136c102b60 msgr2=0x7f136c1131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:54.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.957+0000 7f1373dc7700 1 --2- 172.21.15.112:0/787114056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f136c102b60 0x7f136c1131f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f136800b820 tx=0x7f1368009e30 comp rx=0 tx=0).stop 2024-04-25T02:01:54.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.957+0000 7f1373dc7700 1 -- 172.21.15.112:0/787114056 shutdown_connections 2024-04-25T02:01:54.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.957+0000 7f1373dc7700 1 --2- 172.21.15.112:0/787114056 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f13580369c0 0x7f1358038e70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:54.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.957+0000 7f1373dc7700 1 --2- 172.21.15.112:0/787114056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f136c102b60 0x7f136c1131f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:54.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.957+0000 7f1373dc7700 1 -- 172.21.15.112:0/787114056 >> 172.21.15.112:0/787114056 conn(0x7f136c0f86f0 msgr2=0x7f136c0f9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:54.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.957+0000 7f1373dc7700 1 -- 172.21.15.112:0/787114056 shutdown_connections 2024-04-25T02:01:54.962 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:01:54.957+0000 7f1373dc7700 1 -- 172.21.15.112:0/787114056 wait complete. 2024-04-25T02:01:54.962 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-04-25T02:01:55.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:54 smithi112 podman[33253]: 2024-04-25 02:01:54.998041975 +0000 UTC m=+0.523893908 container init db2fb9b097899b1beeded6fdda300057100e9f712d58f0a2ac03a0ffd98f7fbb (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi112, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, RELEASE=quincy-c61472c, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-25T02:01:55.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 podman[33253]: 2024-04-25 02:01:55.001316274 +0000 UTC m=+0.527168198 container start db2fb9b097899b1beeded6fdda300057100e9f712d58f0a2ac03a0ffd98f7fbb (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi112, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-c61472c, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.build-date=20240424) 2024-04-25T02:01:55.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: set uid:gid to 167:167 (ceph:ceph) 2024-04-25T02:01:55.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable), process ceph-mon, pid 2 2024-04-25T02:01:55.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: pidfile_write: ignore empty --pid-file 2024-04-25T02:01:55.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: load: jerasure load: lrc 2024-04-25T02:01:55.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: RocksDB version: 6.15.5 2024-04-25T02:01:55.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-04-25T02:01:55.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Compile date Apr 24 2024 2024-04-25T02:01:55.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: DB SUMMARY 2024-04-25T02:01:55.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: DB Session ID: UQFIODXVPUEVDW1KAR6K 2024-04-25T02:01:55.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: CURRENT file: CURRENT 2024-04-25T02:01:55.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: IDENTITY file: IDENTITY 2024-04-25T02:01:55.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2024-04-25T02:01:55.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi112/store.db dir, Total Num: 0, files: 2024-04-25T02:01:55.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi112/store.db: 000004.log size: 511 ; 2024-04-25T02:01:55.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.error_if_exists: 0 2024-04-25T02:01:55.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.create_if_missing: 0 2024-04-25T02:01:55.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.paranoid_checks: 1 2024-04-25T02:01:55.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-25T02:01:55.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.env: 0x560d983f3b00 2024-04-25T02:01:55.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.fs: Posix File System 2024-04-25T02:01:55.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.info_log: 0x560d99f81620 2024-04-25T02:01:55.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.max_file_opening_threads: 16 2024-04-25T02:01:55.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.statistics: (nil) 2024-04-25T02:01:55.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.use_fsync: 0 2024-04-25T02:01:55.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.max_log_file_size: 0 2024-04-25T02:01:55.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-25T02:01:55.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-25T02:01:55.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.keep_log_file_num: 1000 2024-04-25T02:01:55.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.recycle_log_file_num: 0 2024-04-25T02:01:55.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.allow_fallocate: 1 2024-04-25T02:01:55.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.allow_mmap_reads: 0 2024-04-25T02:01:55.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.allow_mmap_writes: 0 2024-04-25T02:01:55.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.use_direct_reads: 0 2024-04-25T02:01:55.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-25T02:01:55.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.create_missing_column_families: 0 2024-04-25T02:01:55.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.db_log_dir: 2024-04-25T02:01:55.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi112/store.db 2024-04-25T02:01:55.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-25T02:01:55.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-25T02:01:55.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-25T02:01:55.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-25T02:01:55.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-25T02:01:55.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-25T02:01:55.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.advise_random_on_open: 1 2024-04-25T02:01:55.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.db_write_buffer_size: 0 2024-04-25T02:01:55.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.write_buffer_manager: 0x560d9ac74a20 2024-04-25T02:01:55.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-25T02:01:55.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-04-25T02:01:55.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-25T02:01:55.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-25T02:01:55.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.rate_limiter: (nil) 2024-04-25T02:01:55.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-25T02:01:55.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.wal_recovery_mode: 2 2024-04-25T02:01:55.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.enable_thread_tracking: 0 2024-04-25T02:01:55.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.enable_pipelined_write: 0 2024-04-25T02:01:55.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.unordered_write: 0 2024-04-25T02:01:55.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-25T02:01:55.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-25T02:01:55.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-25T02:01:55.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-25T02:01:55.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.row_cache: None 2024-04-25T02:01:55.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.wal_filter: None 2024-04-25T02:01:55.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-25T02:01:55.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.allow_ingest_behind: 0 2024-04-25T02:01:55.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.preserve_deletes: 0 2024-04-25T02:01:55.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.two_write_queues: 0 2024-04-25T02:01:55.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.manual_wal_flush: 0 2024-04-25T02:01:55.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.atomic_flush: 0 2024-04-25T02:01:55.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-25T02:01:55.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-25T02:01:55.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-25T02:01:55.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.log_readahead_size: 0 2024-04-25T02:01:55.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-25T02:01:55.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.best_efforts_recovery: 0 2024-04-25T02:01:55.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-25T02:01:55.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-25T02:01:55.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.allow_data_in_errors: 0 2024-04-25T02:01:55.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.db_host_id: __hostname__ 2024-04-25T02:01:55.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.max_background_jobs: 2 2024-04-25T02:01:55.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.max_background_compactions: -1 2024-04-25T02:01:55.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.max_subcompactions: 1 2024-04-25T02:01:55.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-25T02:01:55.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-25T02:01:55.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-25T02:01:55.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.max_total_wal_size: 0 2024-04-25T02:01:55.286 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-25T02:01:55.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-25T02:01:55.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-25T02:01:55.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-25T02:01:55.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.max_open_files: -1 2024-04-25T02:01:55.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.bytes_per_sync: 0 2024-04-25T02:01:55.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-25T02:01:55.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-25T02:01:55.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.compaction_readahead_size: 0 2024-04-25T02:01:55.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.max_background_flushes: -1 2024-04-25T02:01:55.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Compression algorithms supported: 2024-04-25T02:01:55.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-25T02:01:55.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: kZSTD supported: 0 2024-04-25T02:01:55.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: kXpressCompression supported: 0 2024-04-25T02:01:55.287 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: kLZ4HCCompression supported: 1 2024-04-25T02:01:55.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: kZlibCompression supported: 1 2024-04-25T02:01:55.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: kSnappyCompression supported: 1 2024-04-25T02:01:55.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: kLZ4Compression supported: 1 2024-04-25T02:01:55.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: kBZip2Compression supported: 0 2024-04-25T02:01:55.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-25T02:01:55.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi112/store.db/MANIFEST-000003 2024-04-25T02:01:55.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-04-25T02:01:55.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-25T02:01:55.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.merge_operator: 2024-04-25T02:01:55.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.compaction_filter: None 2024-04-25T02:01:55.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.compaction_filter_factory: None 2024-04-25T02:01:55.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.sst_partitioner_factory: None 2024-04-25T02:01:55.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-25T02:01:55.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-25T02:01:55.288 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560d99f54f58) 2024-04-25T02:01:55.289 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: cache_index_and_filter_blocks: 1 2024-04-25T02:01:55.289 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-25T02:01:55.289 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-25T02:01:55.289 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: pin_top_level_index_and_filter: 1 2024-04-25T02:01:55.289 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: index_type: 0 2024-04-25T02:01:55.289 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: data_block_index_type: 0 2024-04-25T02:01:55.289 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: index_shortening: 1 2024-04-25T02:01:55.289 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-25T02:01:55.289 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: hash_index_allow_collision: 1 2024-04-25T02:01:55.289 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: checksum: 1 2024-04-25T02:01:55.289 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: no_block_cache: 0 2024-04-25T02:01:55.289 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache: 0x560d99f87090 2024-04-25T02:01:55.289 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache_name: BinnedLRUCache 2024-04-25T02:01:55.289 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache_options: 2024-04-25T02:01:55.290 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: capacity : 536870912 2024-04-25T02:01:55.290 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: num_shard_bits : 4 2024-04-25T02:01:55.290 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: strict_capacity_limit : 0 2024-04-25T02:01:55.290 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: high_pri_pool_ratio: 0.000 2024-04-25T02:01:55.290 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache_compressed: (nil) 2024-04-25T02:01:55.290 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: persistent_cache: (nil) 2024-04-25T02:01:55.290 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_size: 4096 2024-04-25T02:01:55.290 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_size_deviation: 10 2024-04-25T02:01:55.290 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_restart_interval: 16 2024-04-25T02:01:55.290 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: index_block_restart_interval: 1 2024-04-25T02:01:55.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: metadata_block_size: 4096 2024-04-25T02:01:55.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: partition_filters: 0 2024-04-25T02:01:55.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: use_delta_encoding: 1 2024-04-25T02:01:55.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-04-25T02:01:55.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: whole_key_filtering: 1 2024-04-25T02:01:55.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: verify_compression: 0 2024-04-25T02:01:55.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: read_amp_bytes_per_bit: 0 2024-04-25T02:01:55.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: format_version: 4 2024-04-25T02:01:55.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: enable_index_compression: 1 2024-04-25T02:01:55.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_align: 0 2024-04-25T02:01:55.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.write_buffer_size: 33554432 2024-04-25T02:01:55.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.max_write_buffer_number: 2 2024-04-25T02:01:55.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.compression: NoCompression 2024-04-25T02:01:55.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.bottommost_compression: Disabled 2024-04-25T02:01:55.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.prefix_extractor: nullptr 2024-04-25T02:01:55.292 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-25T02:01:55.292 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.num_levels: 7 2024-04-25T02:01:55.292 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-25T02:01:55.292 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-25T02:01:55.292 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-25T02:01:55.292 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-25T02:01:55.292 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-25T02:01:55.292 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-25T02:01:55.292 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-25T02:01:55.292 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-25T02:01:55.292 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-25T02:01:55.292 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-25T02:01:55.292 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-25T02:01:55.292 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.compression_opts.level: 32767 2024-04-25T02:01:55.292 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.compression_opts.strategy: 0 2024-04-25T02:01:55.293 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-25T02:01:55.293 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-25T02:01:55.293 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-25T02:01:55.293 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.compression_opts.enabled: false 2024-04-25T02:01:55.293 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-25T02:01:55.293 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-25T02:01:55.293 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-25T02:01:55.293 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.target_file_size_base: 67108864 2024-04-25T02:01:55.293 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-25T02:01:55.293 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-25T02:01:55.293 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-25T02:01:55.293 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-25T02:01:55.293 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-25T02:01:55.293 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-25T02:01:55.293 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-25T02:01:55.294 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-25T02:01:55.294 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-25T02:01:55.294 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-25T02:01:55.294 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-25T02:01:55.294 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-25T02:01:55.294 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-25T02:01:55.294 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.arena_block_size: 4194304 2024-04-25T02:01:55.294 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-25T02:01:55.294 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-25T02:01:55.294 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-04-25T02:01:55.294 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.disable_auto_compactions: 0 2024-04-25T02:01:55.294 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-25T02:01:55.294 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-25T02:01:55.294 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-25T02:01:55.295 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-25T02:01:55.295 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-25T02:01:55.295 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-25T02:01:55.295 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-25T02:01:55.295 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-25T02:01:55.295 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-25T02:01:55.295 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-25T02:01:55.295 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.table_properties_collectors: 2024-04-25T02:01:55.295 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.inplace_update_support: 0 2024-04-25T02:01:55.295 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-25T02:01:55.295 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-25T02:01:55.295 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-25T02:01:55.295 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-25T02:01:55.295 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.bloom_locality: 0 2024-04-25T02:01:55.295 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.max_successive_merges: 0 2024-04-25T02:01:55.296 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-25T02:01:55.296 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.paranoid_file_checks: 0 2024-04-25T02:01:55.296 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.force_consistency_checks: 1 2024-04-25T02:01:55.296 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.report_bg_io_stats: 0 2024-04-25T02:01:55.296 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.ttl: 2592000 2024-04-25T02:01:55.296 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-25T02:01:55.296 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.enable_blob_files: false 2024-04-25T02:01:55.296 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.min_blob_size: 0 2024-04-25T02:01:55.296 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.blob_file_size: 268435456 2024-04-25T02:01:55.296 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-25T02:01:55.296 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-25T02:01:55.296 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-25T02:01:55.296 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi112/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-25T02:01:55.296 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2024-04-25T02:01:55.296 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2024-04-25T02:01:55.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714010515028585, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-25T02:01:55.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2024-04-25T02:01:55.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-04-25T02:01:55.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714010515028890, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1714010515, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "4704c66f-d3e9-44c7-acab-36912c372c6e", "db_session_id": "UQFIODXVPUEVDW1KAR6K"}} 2024-04-25T02:01:55.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2024-04-25T02:01:55.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714010515029206, "job": 1, "event": "recovery_finished"} 2024-04-25T02:01:55.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi112/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-25T02:01:55.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x560d99f1b180 2024-04-25T02:01:55.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: DB pointer 0x560d99ff0000 2024-04-25T02:01:55.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-04-25T02:01:55.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-04-25T02:01:55.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** DB Stats ** 2024-04-25T02:01:55.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T02:01:55.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-25T02:01:55.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T02:01:55.298 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T02:01:55.298 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-25T02:01:55.298 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-04-25T02:01:55.298 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T02:01:55.298 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-04-25T02:01:55.298 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** Compaction Stats [default] ** 2024-04-25T02:01:55.298 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-25T02:01:55.298 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T02:01:55.298 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.0 0.00 0.00 1 0.000 0 0 2024-04-25T02:01:55.298 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.0 0.00 0.00 1 0.000 0 0 2024-04-25T02:01:55.298 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.0 0.00 0.00 1 0.000 0 0 2024-04-25T02:01:55.298 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-04-25T02:01:55.298 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** Compaction Stats [default] ** 2024-04-25T02:01:55.298 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-25T02:01:55.299 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T02:01:55.299 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.0 0.00 0.00 1 0.000 0 0 2024-04-25T02:01:55.299 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T02:01:55.299 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-25T02:01:55.299 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-25T02:01:55.299 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-25T02:01:55.299 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-25T02:01:55.299 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-25T02:01:55.299 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative compaction: 0.00 GB write, 0.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T02:01:55.299 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval compaction: 0.00 GB write, 0.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T02:01:55.299 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-25T02:01:55.299 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-04-25T02:01:55.299 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-25T02:01:55.299 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-04-25T02:01:55.299 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** Compaction Stats [default] ** 2024-04-25T02:01:55.300 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-25T02:01:55.300 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T02:01:55.300 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.0 0.00 0.00 1 0.000 0 0 2024-04-25T02:01:55.300 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.0 0.00 0.00 1 0.000 0 0 2024-04-25T02:01:55.300 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-04-25T02:01:55.300 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-04-25T02:01:55.300 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** Compaction Stats [default] ** 2024-04-25T02:01:55.300 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-25T02:01:55.300 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T02:01:55.300 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.0 0.00 0.00 1 0.000 0 0 2024-04-25T02:01:55.300 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T02:01:55.300 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-25T02:01:55.300 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-25T02:01:55.300 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-25T02:01:55.300 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-25T02:01:55.301 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-25T02:01:55.301 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative compaction: 0.00 GB write, 0.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T02:01:55.301 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T02:01:55.301 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-25T02:01:55.301 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-04-25T02:01:55.301 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-25T02:01:55.301 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: mon.smithi112 does not exist in monmap, will attempt to join an existing cluster 2024-04-25T02:01:55.301 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: using public_addr v2:172.21.15.112:0/0 -> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] 2024-04-25T02:01:55.301 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: starting mon.smithi112 rank -1 at public addrs [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] at bind addrs [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi112 fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 2024-04-25T02:01:55.301 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: mon.smithi112@-1(???) e0 preinit fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 2024-04-25T02:01:55.301 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: mon.smithi112@-1(synchronizing).mds e1 new map 2024-04-25T02:01:55.301 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: mon.smithi112@-1(synchronizing).mds e1 print_map 2024-04-25T02:01:55.301 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: e1 2024-04-25T02:01:55.301 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T02:01:55.301 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:01:55.302 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: legacy client fscid: -1 2024-04-25T02:01:55.302 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-04-25T02:01:55.302 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: No filesystems configured 2024-04-25T02:01:55.302 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: mon.smithi112@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-25T02:01:55.302 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: mon.smithi112@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-25T02:01:55.302 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: mon.smithi112@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-25T02:01:55.302 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: mon.smithi112@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-25T02:01:55.302 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: mon.smithi112@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-25T02:01:55.302 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: mon.smithi112@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-25T02:01:55.302 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: mon.smithi112@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-04-25T02:01:55.302 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: mon.smithi112@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-25T02:01:55.302 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: mon.smithi112@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T02:01:55.302 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: mon.smithi112@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T02:01:55.303 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: mon.smithi112@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T02:01:55.303 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.303 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.303 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.303 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.303 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: Deploying daemon alertmanager.smithi077 on smithi077 2024-04-25T02:01:55.303 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.303 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: Added host smithi112 2024-04-25T02:01:55.303 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:55.303 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:55.303 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:01:55.303 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.303 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:55.303 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:55.303 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:55.304 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/3826021701' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-25T02:01:55.304 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/3826021701' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-25T02:01:55.304 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T02:01:55.304 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.304 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.304 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.304 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.304 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.304 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.304 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-25T02:01:55.304 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-25T02:01:55.304 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.304 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: Deploying daemon grafana.smithi077 on smithi077 2024-04-25T02:01:55.304 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:55.304 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:55.304 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi077:172.21.15.77=smithi077;smithi112:172.21.15.112=smithi112", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:01:55.305 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: Saving service mon spec with placement smithi077:172.21.15.77=smithi077;smithi112:172.21.15.112=smithi112;count:2 2024-04-25T02:01:55.305 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.305 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.305 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:55.305 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='client.? 172.21.15.112:0/457401735' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:01:55.305 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:55.305 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:55.305 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='client.? 172.21.15.112:0/1468081891' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:01:55.305 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:55.305 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='client.? 172.21.15.112:0/1623252596' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:01:55.305 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:55.305 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:55.305 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.305 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.306 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.306 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.306 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.306 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.306 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: Deploying daemon prometheus.smithi077 on smithi077 2024-04-25T02:01:55.306 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='client.? 172.21.15.112:0/1603074967' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:01:55.306 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:55.306 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:55.306 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.306 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='client.? 172.21.15.112:0/1754858016' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:01:55.306 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:55.306 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:55.306 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='client.? 172.21.15.112:0/1522216495' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:01:55.306 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:55.306 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.307 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.307 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.307 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-04-25T02:01:55.307 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:55.307 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='client.? 172.21.15.112:0/804688125' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:01:55.307 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14160 172.21.15.77:0/3867600355' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-04-25T02:01:55.307 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: mgrmap e14: smithi077.zpflzp(active, since 58s) 2024-04-25T02:01:55.307 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='client.? 172.21.15.112:0/2887136724' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:01:55.307 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='client.? 172.21.15.112:0/3158115632' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:01:55.307 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: Active manager daemon smithi077.zpflzp restarted 2024-04-25T02:01:55.307 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: Activating manager daemon smithi077.zpflzp 2024-04-25T02:01:55.307 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: osdmap e5: 0 total, 0 up, 0 in 2024-04-25T02:01:55.307 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: mgrmap e15: smithi077.zpflzp(active, starting, since 0.00576337s) 2024-04-25T02:01:55.307 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-04-25T02:01:55.307 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr metadata", "who": "smithi077.zpflzp", "id": "smithi077.zpflzp"}]: dispatch 2024-04-25T02:01:55.308 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T02:01:55.308 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T02:01:55.308 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T02:01:55.308 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: Manager daemon smithi077.zpflzp is now available 2024-04-25T02:01:55.308 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:01:55.308 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:01:55.308 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.308 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:01:55.308 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.zpflzp/mirror_snapshot_schedule"}]: dispatch 2024-04-25T02:01:55.308 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.zpflzp/trash_purge_schedule"}]: dispatch 2024-04-25T02:01:55.308 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.308 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.308 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: [25/Apr/2024:02:01:31] ENGINE Bus STARTING 2024-04-25T02:01:55.308 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: mgrmap e16: smithi077.zpflzp(active, since 1.00772s) 2024-04-25T02:01:55.308 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: [25/Apr/2024:02:01:31] ENGINE Serving on https://172.21.15.77:7150 2024-04-25T02:01:55.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: [25/Apr/2024:02:01:31] ENGINE Bus STARTED 2024-04-25T02:01:55.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: mgrmap e17: smithi077.zpflzp(active, since 2s) 2024-04-25T02:01:55.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='client.? 172.21.15.112:0/2152174396' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:01:55.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi077", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:01:55.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.309 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:01:55.310 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:55.310 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:01:55.310 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: Updating smithi077:/etc/ceph/ceph.conf 2024-04-25T02:01:55.310 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: Updating smithi112:/etc/ceph/ceph.conf 2024-04-25T02:01:55.310 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: Updating smithi077:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:01:55.310 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: Updating smithi112:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:01:55.310 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:01:55.310 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:01:55.310 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.310 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.310 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.310 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.310 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.310 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T02:01:55.310 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-25T02:01:55.311 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:55.311 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: Updating smithi077:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:01:55.311 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: Updating smithi112:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:01:55.311 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: Deploying daemon crash.smithi112 on smithi112 2024-04-25T02:01:55.311 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='client.? 172.21.15.112:0/3265808279' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:01:55.311 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.311 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.311 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.311 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.311 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: Deploying daemon node-exporter.smithi112 on smithi112 2024-04-25T02:01:55.311 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='client.? 172.21.15.112:0/785724604' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:01:55.311 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.311 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:01:55.311 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.312 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.312 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.312 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.312 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.cswrxs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T02:01:55.312 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.cswrxs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-25T02:01:55.312 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T02:01:55.312 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:55.312 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: Deploying daemon mgr.smithi112.cswrxs on smithi112 2024-04-25T02:01:55.312 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='client.? 172.21.15.112:0/1421399504' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:01:55.312 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.312 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.312 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:55.312 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.312 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.312 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:01:55.312 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:01:55.313 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:55.313 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: Deploying daemon mon.smithi112 on smithi112 2024-04-25T02:01:55.313 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:55.313 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 ceph-mon[33313]: mon.smithi112@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2024-04-25T02:01:55.313 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 bash[33253]: db2fb9b097899b1beeded6fdda300057100e9f712d58f0a2ac03a0ffd98f7fbb 2024-04-25T02:01:55.313 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:01:55 smithi112 systemd[1]: Started Ceph mon.smithi112 for 4bb93d82-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:01:56.870 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T02:01:56.871 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T02:01:57.115 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi112/config 2024-04-25T02:02:00.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:00 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-04-25T02:02:00.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:00 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-04-25T02:02:00.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:00 smithi077 ceph-mon[26330]: mon.smithi077 calling monitor election 2024-04-25T02:02:00.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:00 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-04-25T02:02:00.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:00 smithi077 ceph-mon[26330]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:00.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:00 smithi077 ceph-mon[26330]: from='mgr.? 172.21.15.112:0/375681288' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.cswrxs/crt"}]: dispatch 2024-04-25T02:02:00.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:00 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-04-25T02:02:00.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:00 smithi077 ceph-mon[26330]: mon.smithi112 calling monitor election 2024-04-25T02:02:00.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:00 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-04-25T02:02:00.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:00 smithi077 ceph-mon[26330]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:00.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:00 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-04-25T02:02:00.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:00 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-04-25T02:02:00.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:00 smithi077 ceph-mon[26330]: mon.smithi077 is new leader, mons smithi077,smithi112 in quorum (ranks 0,1) 2024-04-25T02:02:00.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:00 smithi077 ceph-mon[26330]: monmap e2: 2 mons at {smithi077=[v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0],smithi112=[v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-25T02:02:00.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:00 smithi077 ceph-mon[26330]: fsmap 2024-04-25T02:02:00.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:00 smithi077 ceph-mon[26330]: osdmap e5: 0 total, 0 up, 0 in 2024-04-25T02:02:00.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:00 smithi077 ceph-mon[26330]: mgrmap e17: smithi077.zpflzp(active, since 29s) 2024-04-25T02:02:00.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:00 smithi077 ceph-mon[26330]: overall HEALTH_OK 2024-04-25T02:02:00.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:00 smithi077 ceph-mon[26330]: Standby manager daemon smithi112.cswrxs started 2024-04-25T02:02:00.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:00 smithi077 ceph-mon[26330]: from='mgr.? 172.21.15.112:0/375681288' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T02:02:00.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:00 smithi077 ceph-mon[26330]: from='mgr.? 172.21.15.112:0/375681288' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.cswrxs/key"}]: dispatch 2024-04-25T02:02:00.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:00 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:00.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:00 smithi077 ceph-mon[26330]: from='mgr.? 172.21.15.112:0/375681288' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T02:02:00.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:00 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:00.528 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:00 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-04-25T02:02:00.528 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:00 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-04-25T02:02:00.528 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:00 smithi112 ceph-mon[33313]: mon.smithi077 calling monitor election 2024-04-25T02:02:00.528 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:00 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-04-25T02:02:00.528 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:00 smithi112 ceph-mon[33313]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:00.528 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:00 smithi112 ceph-mon[33313]: from='mgr.? 172.21.15.112:0/375681288' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.cswrxs/crt"}]: dispatch 2024-04-25T02:02:00.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:00 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-04-25T02:02:00.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:00 smithi112 ceph-mon[33313]: mon.smithi112 calling monitor election 2024-04-25T02:02:00.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:00 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-04-25T02:02:00.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:00 smithi112 ceph-mon[33313]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:00.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:00 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-04-25T02:02:00.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:00 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-04-25T02:02:00.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:00 smithi112 ceph-mon[33313]: mon.smithi077 is new leader, mons smithi077,smithi112 in quorum (ranks 0,1) 2024-04-25T02:02:00.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:00 smithi112 ceph-mon[33313]: monmap e2: 2 mons at {smithi077=[v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0],smithi112=[v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-25T02:02:00.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:00 smithi112 ceph-mon[33313]: fsmap 2024-04-25T02:02:00.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:00 smithi112 ceph-mon[33313]: osdmap e5: 0 total, 0 up, 0 in 2024-04-25T02:02:00.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:00 smithi112 ceph-mon[33313]: mgrmap e17: smithi077.zpflzp(active, since 29s) 2024-04-25T02:02:00.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:00 smithi112 ceph-mon[33313]: overall HEALTH_OK 2024-04-25T02:02:00.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:00 smithi112 ceph-mon[33313]: Standby manager daemon smithi112.cswrxs started 2024-04-25T02:02:00.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:00 smithi112 ceph-mon[33313]: from='mgr.? 172.21.15.112:0/375681288' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T02:02:00.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:00 smithi112 ceph-mon[33313]: from='mgr.? 172.21.15.112:0/375681288' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.cswrxs/key"}]: dispatch 2024-04-25T02:02:00.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:00 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:00.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:00 smithi112 ceph-mon[33313]: from='mgr.? 172.21.15.112:0/375681288' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T02:02:00.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:00 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:01.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:01 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:01.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:01 smithi077 ceph-mon[26330]: mgrmap e18: smithi077.zpflzp(active, since 29s), standbys: smithi112.cswrxs 2024-04-25T02:02:01.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:01 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr metadata", "who": "smithi112.cswrxs", "id": "smithi112.cswrxs"}]: dispatch 2024-04-25T02:02:01.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:01 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:01.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:01 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:01.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:01 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:02:01.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:01 smithi077 ceph-mon[26330]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:01.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:01 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:02:01.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:01 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:01.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:01 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-04-25T02:02:01.496 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:01 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:01.496 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:01 smithi112 ceph-mon[33313]: mgrmap e18: smithi077.zpflzp(active, since 29s), standbys: smithi112.cswrxs 2024-04-25T02:02:01.496 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:01 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr metadata", "who": "smithi112.cswrxs", "id": "smithi112.cswrxs"}]: dispatch 2024-04-25T02:02:01.496 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:01 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:01.497 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:01 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:01.497 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:01 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:02:01.497 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:01 smithi112 ceph-mon[33313]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:01.497 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:01 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:02:01.497 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:01 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:01.497 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:01 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-04-25T02:02:01.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.641+0000 7f02218a4700 1 -- 172.21.15.112:0/327881223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0208003580 msgr2=0x7f0208005a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:02:01.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.641+0000 7f02218a4700 1 --2- 172.21.15.112:0/327881223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0208003580 0x7f0208005a00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f021c0fb9f0 tx=0x7f020c00b040 comp rx=0 tx=0).stop 2024-04-25T02:02:01.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.642+0000 7f02218a4700 1 -- 172.21.15.112:0/327881223 shutdown_connections 2024-04-25T02:02:01.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.642+0000 7f02218a4700 1 --2- 172.21.15.112:0/327881223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0208003580 0x7f0208005a00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:01.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.642+0000 7f02218a4700 1 -- 172.21.15.112:0/327881223 >> 172.21.15.112:0/327881223 conn(0x7f021c0f7620 msgr2=0x7f021c0f9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:02:01.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.642+0000 7f02218a4700 1 -- 172.21.15.112:0/327881223 shutdown_connections 2024-04-25T02:02:01.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.642+0000 7f02218a4700 1 -- 172.21.15.112:0/327881223 wait complete. 2024-04-25T02:02:01.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.642+0000 7f02218a4700 1 Processor -- start 2024-04-25T02:02:01.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.642+0000 7f02218a4700 1 -- start start 2024-04-25T02:02:01.649 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.642+0000 7f02218a4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0208003580 0x7f021c1120b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:02:01.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.642+0000 7f02218a4700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f021c1125f0 0x7f021c10c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:02:01.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.642+0000 7f02218a4700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c112c00 con 0x7f021c1125f0 2024-04-25T02:02:01.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.642+0000 7f02218a4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c112d70 con 0x7f0208003580 2024-04-25T02:02:01.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.643+0000 7f021affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0208003580 0x7f021c1120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:02:01.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.643+0000 7f021affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0208003580 0x7f021c1120b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60278/0 (socket says 172.21.15.112:60278) 2024-04-25T02:02:01.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.643+0000 7f021affd700 1 -- 172.21.15.112:0/2534954073 learned_addr learned my addr 172.21.15.112:0/2534954073 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T02:02:01.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.643+0000 7f021affd700 1 -- 172.21.15.112:0/2534954073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0208003580 msgr2=0x7f021c1120b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-25T02:02:01.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.643+0000 7f021affd700 1 -- 172.21.15.112:0/2534954073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0208003580 msgr2=0x7f021c1120b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T02:02:01.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.643+0000 7f021affd700 1 --2- 172.21.15.112:0/2534954073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0208003580 0x7f021c1120b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:02:01.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.643+0000 7f021affd700 1 --2- 172.21.15.112:0/2534954073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0208003580 0x7f021c1120b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:02:01.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.643+0000 7f0213fff700 1 --2- 172.21.15.112:0/2534954073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f021c1125f0 0x7f021c10c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:02:01.650 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.643+0000 7f0213fff700 1 -- 172.21.15.112:0/2534954073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0208003580 msgr2=0x7f021c1120b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:02:01.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.643+0000 7f0213fff700 1 --2- 172.21.15.112:0/2534954073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0208003580 0x7f021c1120b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:01.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.643+0000 7f0213fff700 1 -- 172.21.15.112:0/2534954073 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c005040 con 0x7f021c1125f0 2024-04-25T02:02:01.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.643+0000 7f0213fff700 1 --2- 172.21.15.112:0/2534954073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f021c1125f0 0x7f021c10c110 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f020400b790 tx=0x7f02040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:02:01.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.643+0000 7f02137fe700 1 -- 172.21.15.112:0/2534954073 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0204011810 con 0x7f021c1125f0 2024-04-25T02:02:01.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.644+0000 7f02218a4700 1 -- 172.21.15.112:0/2534954073 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021c10c770 con 0x7f021c1125f0 2024-04-25T02:02:01.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.644+0000 7f02137fe700 1 -- 172.21.15.112:0/2534954073 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0204011e40 con 0x7f021c1125f0 2024-04-25T02:02:01.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.644+0000 7f02137fe700 1 -- 172.21.15.112:0/2534954073 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f020400f2e0 con 0x7f021c1125f0 2024-04-25T02:02:01.651 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.644+0000 7f02218a4700 1 -- 172.21.15.112:0/2534954073 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021c10ccb0 con 0x7f021c1125f0 2024-04-25T02:02:01.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.644+0000 7f02218a4700 1 -- 172.21.15.112:0/2534954073 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021c10cf30 con 0x7f021c1125f0 2024-04-25T02:02:01.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.645+0000 7f02137fe700 1 -- 172.21.15.112:0/2534954073 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f0204010380 con 0x7f021c1125f0 2024-04-25T02:02:01.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.645+0000 7f02137fe700 1 --2- 172.21.15.112:0/2534954073 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f01fc069360 0x7f01fc06b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:02:01.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.646+0000 7f02137fe700 1 -- 172.21.15.112:0/2534954073 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f0204086360 con 0x7f021c1125f0 2024-04-25T02:02:01.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.646+0000 7f021affd700 1 --2- 172.21.15.112:0/2534954073 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f01fc069360 0x7f01fc06b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:02:01.652 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.646+0000 7f021affd700 1 --2- 172.21.15.112:0/2534954073 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f01fc069360 0x7f01fc06b810 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f020c007f50 tx=0x7f020c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:02:01.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.650+0000 7f02137fe700 1 -- 172.21.15.112:0/2534954073 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f02040536f0 con 0x7f021c1125f0 2024-04-25T02:02:01.924 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.919+0000 7f02218a4700 1 -- 172.21.15.112:0/2534954073 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f021c10d840 con 0x7f021c1125f0 2024-04-25T02:02:01.925 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.920+0000 7f02137fe700 1 -- 172.21.15.112:0/2534954073 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1017 (secure 0 0 0) 0x7f0204015090 con 0x7f021c1125f0 2024-04-25T02:02:01.925 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T02:02:01.925 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":2,"fsid":"4bb93d82-02a7-11ef-bc93-c7b262605968","modified":"2024-04-25T02:01:55.055250Z","created":"2024-04-25T01:59:19.321779Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi077","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-25T02:02:01.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.922+0000 7f02218a4700 1 -- 172.21.15.112:0/2534954073 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f01fc069360 msgr2=0x7f01fc06b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:02:01.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.922+0000 7f02218a4700 1 --2- 172.21.15.112:0/2534954073 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f01fc069360 0x7f01fc06b810 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f020c007f50 tx=0x7f020c00b040 comp rx=0 tx=0).stop 2024-04-25T02:02:01.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.922+0000 7f02218a4700 1 -- 172.21.15.112:0/2534954073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f021c1125f0 msgr2=0x7f021c10c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:02:01.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.922+0000 7f02218a4700 1 --2- 172.21.15.112:0/2534954073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f021c1125f0 0x7f021c10c110 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f020400b790 tx=0x7f02040091a0 comp rx=0 tx=0).stop 2024-04-25T02:02:01.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.922+0000 7f02218a4700 1 -- 172.21.15.112:0/2534954073 shutdown_connections 2024-04-25T02:02:01.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.922+0000 7f02218a4700 1 --2- 172.21.15.112:0/2534954073 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f01fc069360 0x7f01fc06b810 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:01.927 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.922+0000 7f02218a4700 1 --2- 172.21.15.112:0/2534954073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0208003580 0x7f021c1120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:01.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.922+0000 7f02218a4700 1 --2- 172.21.15.112:0/2534954073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f021c1125f0 0x7f021c10c110 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:01.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.922+0000 7f02218a4700 1 -- 172.21.15.112:0/2534954073 >> 172.21.15.112:0/2534954073 conn(0x7f021c0f7620 msgr2=0x7f021c0f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:02:01.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.922+0000 7f02218a4700 1 -- 172.21.15.112:0/2534954073 shutdown_connections 2024-04-25T02:02:01.928 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:02:01.922+0000 7f02218a4700 1 -- 172.21.15.112:0/2534954073 wait complete. 2024-04-25T02:02:01.928 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 2 2024-04-25T02:02:02.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:02 smithi112 ceph-mon[33313]: from='client.? 172.21.15.112:0/2534954073' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:02:02.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:02 smithi077 ceph-mon[26330]: from='client.? 172.21.15.112:0/2534954073' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:02:02.582 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-25T02:02:02.582 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph config generate-minimal-conf 2024-04-25T02:02:02.871 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:02:03.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:03 smithi077 ceph-mon[26330]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:03.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:03 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:03.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:03 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:03.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:03 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:03.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:03 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:02:03.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:03 smithi077 ceph-mon[26330]: Updating smithi077:/etc/ceph/ceph.conf 2024-04-25T02:02:03.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:03 smithi077 ceph-mon[26330]: Updating smithi112:/etc/ceph/ceph.conf 2024-04-25T02:02:03.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:03 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:03.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:03 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:03.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:03 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:03.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:03 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:03.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:03 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:03.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:03 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:02:03.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:03 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T02:02:03.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:03 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:04.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:03 smithi112 ceph-mon[33313]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:04.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:03 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:04.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:03 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:04.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:03 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:04.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:03 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:02:04.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:03 smithi112 ceph-mon[33313]: Updating smithi077:/etc/ceph/ceph.conf 2024-04-25T02:02:04.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:03 smithi112 ceph-mon[33313]: Updating smithi112:/etc/ceph/ceph.conf 2024-04-25T02:02:04.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:03 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:04.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:03 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:04.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:03 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:04.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:03 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:04.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:03 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:04.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:03 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:02:04.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:03 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T02:02:04.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:03 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:04.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:04 smithi077 ceph-mon[26330]: Updating smithi077:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:02:04.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:04 smithi077 ceph-mon[26330]: Updating smithi112:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:02:04.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:04 smithi077 ceph-mon[26330]: Reconfiguring mon.smithi077 (unknown last config time)... 2024-04-25T02:02:04.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:04 smithi077 ceph-mon[26330]: Reconfiguring daemon mon.smithi077 on smithi077 2024-04-25T02:02:04.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.984+0000 7f985d90f700 1 -- 172.21.15.77:0/3357331946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98581019d0 msgr2=0x7f9858101da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:02:04.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.984+0000 7f985d90f700 1 --2- 172.21.15.77:0/3357331946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98581019d0 0x7f9858101da0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f98480048c0 tx=0x7f9848009e30 comp rx=0 tx=0).stop 2024-04-25T02:02:04.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.984+0000 7f985d90f700 1 -- 172.21.15.77:0/3357331946 shutdown_connections 2024-04-25T02:02:04.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.984+0000 7f985d90f700 1 --2- 172.21.15.77:0/3357331946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98581019d0 0x7f9858101da0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:04.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.984+0000 7f985d90f700 1 -- 172.21.15.77:0/3357331946 >> 172.21.15.77:0/3357331946 conn(0x7f9858071800 msgr2=0x7f9858071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:02:04.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.984+0000 7f985d90f700 1 -- 172.21.15.77:0/3357331946 shutdown_connections 2024-04-25T02:02:04.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.984+0000 7f985d90f700 1 -- 172.21.15.77:0/3357331946 wait complete. 2024-04-25T02:02:04.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.984+0000 7f985d90f700 1 Processor -- start 2024-04-25T02:02:04.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.985+0000 7f985d90f700 1 -- start start 2024-04-25T02:02:04.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.985+0000 7f985d90f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98581019d0 0x7f9858112170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:02:04.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.985+0000 7f985d90f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98581126b0 0x7f985810c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:02:04.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.985+0000 7f985d90f700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9858112cc0 con 0x7f98581019d0 2024-04-25T02:02:04.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.985+0000 7f985d90f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985810c660 con 0x7f98581126b0 2024-04-25T02:02:04.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.985+0000 7f9856ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98581019d0 0x7f9858112170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:02:04.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.985+0000 7f9856ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98581019d0 0x7f9858112170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41194/0 (socket says 172.21.15.77:41194) 2024-04-25T02:02:04.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.985+0000 7f9856ffd700 1 -- 172.21.15.77:0/2472805949 learned_addr learned my addr 172.21.15.77:0/2472805949 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:02:04.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.985+0000 7f9856ffd700 1 -- 172.21.15.77:0/2472805949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98581126b0 msgr2=0x7f985810c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:02:04.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.985+0000 7f9856ffd700 1 --2- 172.21.15.77:0/2472805949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98581126b0 0x7f985810c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:04.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.985+0000 7f9856ffd700 1 -- 172.21.15.77:0/2472805949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9848005040 con 0x7f98581019d0 2024-04-25T02:02:04.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.985+0000 7f9856ffd700 1 --2- 172.21.15.77:0/2472805949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98581019d0 0x7f9858112170 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f984800b5c0 tx=0x7f9848009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:02:04.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.985+0000 7f984ffff700 1 -- 172.21.15.77:0/2472805949 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f984800e040 con 0x7f98581019d0 2024-04-25T02:02:04.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.986+0000 7f985d90f700 1 -- 172.21.15.77:0/2472805949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f985810c8e0 con 0x7f98581019d0 2024-04-25T02:02:04.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.986+0000 7f984ffff700 1 -- 172.21.15.77:0/2472805949 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9848009950 con 0x7f98581019d0 2024-04-25T02:02:04.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.986+0000 7f984ffff700 1 -- 172.21.15.77:0/2472805949 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f984801c3f0 con 0x7f98581019d0 2024-04-25T02:02:04.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.986+0000 7f985d90f700 1 -- 172.21.15.77:0/2472805949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f985810cea0 con 0x7f98581019d0 2024-04-25T02:02:04.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.986+0000 7f985d90f700 1 -- 172.21.15.77:0/2472805949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9858100c40 con 0x7f98581019d0 2024-04-25T02:02:04.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.987+0000 7f984ffff700 1 -- 172.21.15.77:0/2472805949 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f98480137d0 con 0x7f98581019d0 2024-04-25T02:02:04.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.987+0000 7f984ffff700 1 --2- 172.21.15.77:0/2472805949 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f9844069360 0x7f984406b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:02:04.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.987+0000 7f984ffff700 1 -- 172.21.15.77:0/2472805949 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f9848087460 con 0x7f98581019d0 2024-04-25T02:02:04.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.987+0000 7f984e7fc700 1 --2- 172.21.15.77:0/2472805949 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f9844069360 0x7f984406b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:02:04.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.988+0000 7f984e7fc700 1 --2- 172.21.15.77:0/2472805949 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f9844069360 0x7f984406b810 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9840006fd0 tx=0x7f9840006dd0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:02:04.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:04.992+0000 7f984ffff700 1 -- 172.21.15.77:0/2472805949 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9848058300 con 0x7f98581019d0 2024-04-25T02:02:05.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:04 smithi112 ceph-mon[33313]: Updating smithi077:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:02:05.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:04 smithi112 ceph-mon[33313]: Updating smithi112:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:02:05.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:04 smithi112 ceph-mon[33313]: Reconfiguring mon.smithi077 (unknown last config time)... 2024-04-25T02:02:05.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:04 smithi112 ceph-mon[33313]: Reconfiguring daemon mon.smithi077 on smithi077 2024-04-25T02:02:05.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:05.183+0000 7f985d90f700 1 -- 172.21.15.77:0/2472805949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f9858105cc0 con 0x7f98581019d0 2024-04-25T02:02:05.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:05.183+0000 7f984ffff700 1 -- 172.21.15.77:0/2472805949 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7f9848086c10 con 0x7f98581019d0 2024-04-25T02:02:05.189 INFO:teuthology.orchestra.run.smithi077.stdout:# minimal ceph.conf for 4bb93d82-02a7-11ef-bc93-c7b262605968 2024-04-25T02:02:05.189 INFO:teuthology.orchestra.run.smithi077.stdout:[global] 2024-04-25T02:02:05.189 INFO:teuthology.orchestra.run.smithi077.stdout: fsid = 4bb93d82-02a7-11ef-bc93-c7b262605968 2024-04-25T02:02:05.189 INFO:teuthology.orchestra.run.smithi077.stdout: mon_host = [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] 2024-04-25T02:02:05.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:05.186+0000 7f985d90f700 1 -- 172.21.15.77:0/2472805949 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f9844069360 msgr2=0x7f984406b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:02:05.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:05.186+0000 7f985d90f700 1 --2- 172.21.15.77:0/2472805949 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f9844069360 0x7f984406b810 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9840006fd0 tx=0x7f9840006dd0 comp rx=0 tx=0).stop 2024-04-25T02:02:05.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:05.186+0000 7f985d90f700 1 -- 172.21.15.77:0/2472805949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98581019d0 msgr2=0x7f9858112170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:02:05.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:05.186+0000 7f985d90f700 1 --2- 172.21.15.77:0/2472805949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98581019d0 0x7f9858112170 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f984800b5c0 tx=0x7f9848009e30 comp rx=0 tx=0).stop 2024-04-25T02:02:05.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:05.186+0000 7f985d90f700 1 -- 172.21.15.77:0/2472805949 shutdown_connections 2024-04-25T02:02:05.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:05.186+0000 7f985d90f700 1 --2- 172.21.15.77:0/2472805949 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f9844069360 0x7f984406b810 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:05.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:05.186+0000 7f985d90f700 1 --2- 172.21.15.77:0/2472805949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98581019d0 0x7f9858112170 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:05.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:05.186+0000 7f985d90f700 1 --2- 172.21.15.77:0/2472805949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98581126b0 0x7f985810c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:05.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:05.186+0000 7f985d90f700 1 -- 172.21.15.77:0/2472805949 >> 172.21.15.77:0/2472805949 conn(0x7f9858071800 msgr2=0x7f98580f9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:02:05.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:05.186+0000 7f985d90f700 1 -- 172.21.15.77:0/2472805949 shutdown_connections 2024-04-25T02:02:05.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:05.186+0000 7f985d90f700 1 -- 172.21.15.77:0/2472805949 wait complete. 2024-04-25T02:02:05.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:05 smithi077 ceph-mon[26330]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:05.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:05 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/2472805949' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:05.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:05 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:05.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:05 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:05.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:05 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi077.zpflzp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T02:02:05.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:05 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T02:02:05.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:05 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:06.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:05 smithi112 ceph-mon[33313]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:06.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:05 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/2472805949' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:06.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:05 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:06.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:05 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:06.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:05 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi077.zpflzp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T02:02:06.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:05 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T02:02:06.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:05 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:06.200 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-25T02:02:06.200 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T02:02:06.200 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.conf 2024-04-25T02:02:06.227 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T02:02:06.227 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:02:06.290 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T02:02:06.291 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.conf 2024-04-25T02:02:06.321 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T02:02:06.321 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:02:06.388 INFO:tasks.cephadm:Deploying OSDs... 2024-04-25T02:02:06.389 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T02:02:06.389 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T02:02:06.404 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T02:02:06.404 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_1 2024-04-25T02:02:06.459 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T02:02:06.459 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:02:06.459 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-25T02:02:06.459 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:02:06.459 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:02:06.459 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-04-25 02:01:22.282510057 +0000 2024-04-25T02:02:06.459 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-04-25 01:55:32.332361996 +0000 2024-04-25T02:02:06.459 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-04-25 01:55:32.332361996 +0000 2024-04-25T02:02:06.460 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-04-25 01:55:32.332361996 +0000 2024-04-25T02:02:06.460 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T02:02:06.521 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-04-25T02:02:06.521 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-04-25T02:02:06.522 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000250936 s, 2.0 MB/s 2024-04-25T02:02:06.523 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T02:02:06.580 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_2 2024-04-25T02:02:06.636 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T02:02:06.636 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:02:06.637 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-25T02:02:06.637 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:02:06.637 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:02:06.637 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-04-25 02:01:22.283510036 +0000 2024-04-25T02:02:06.637 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-04-25 01:55:32.686354686 +0000 2024-04-25T02:02:06.637 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-04-25 01:55:32.686354686 +0000 2024-04-25T02:02:06.637 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-04-25 01:55:32.686354686 +0000 2024-04-25T02:02:06.637 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T02:02:06.700 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-04-25T02:02:06.700 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-04-25T02:02:06.700 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000257289 s, 2.0 MB/s 2024-04-25T02:02:06.701 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T02:02:06.756 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_3 2024-04-25T02:02:06.812 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T02:02:06.812 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:02:06.812 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-25T02:02:06.812 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:02:06.813 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:02:06.813 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-04-25 02:01:22.283510036 +0000 2024-04-25T02:02:06.813 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-04-25 01:55:33.021347767 +0000 2024-04-25T02:02:06.813 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-04-25 01:55:33.021347767 +0000 2024-04-25T02:02:06.813 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-04-25 01:55:33.021347767 +0000 2024-04-25T02:02:06.813 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T02:02:06.872 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:06 smithi077 ceph-mon[26330]: Reconfiguring mgr.smithi077.zpflzp (unknown last config time)... 2024-04-25T02:02:06.872 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:06 smithi077 ceph-mon[26330]: Reconfiguring daemon mgr.smithi077.zpflzp on smithi077 2024-04-25T02:02:06.875 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-04-25T02:02:06.875 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-04-25T02:02:06.875 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000190152 s, 2.7 MB/s 2024-04-25T02:02:06.876 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T02:02:06.932 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_4 2024-04-25T02:02:06.987 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T02:02:06.988 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:02:06.988 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-25T02:02:06.988 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:02:06.988 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:02:06.988 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-04-25 02:01:22.283510036 +0000 2024-04-25T02:02:06.988 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-04-25 01:55:33.360340767 +0000 2024-04-25T02:02:06.988 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-04-25 01:55:33.360340767 +0000 2024-04-25T02:02:06.988 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-04-25 01:55:33.360340767 +0000 2024-04-25T02:02:06.988 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T02:02:07.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:06 smithi112 ceph-mon[33313]: Reconfiguring mgr.smithi077.zpflzp (unknown last config time)... 2024-04-25T02:02:07.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:06 smithi112 ceph-mon[33313]: Reconfiguring daemon mgr.smithi077.zpflzp on smithi077 2024-04-25T02:02:07.050 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-04-25T02:02:07.050 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-04-25T02:02:07.050 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.00019593 s, 2.6 MB/s 2024-04-25T02:02:07.051 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T02:02:07.107 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T02:02:07.107 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T02:02:07.126 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T02:02:07.126 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_1 2024-04-25T02:02:07.183 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T02:02:07.184 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:02:07.184 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-25T02:02:07.184 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:02:07.184 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:02:07.184 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-04-25 02:01:53.254925825 +0000 2024-04-25T02:02:07.184 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-04-25 01:55:32.372384137 +0000 2024-04-25T02:02:07.184 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-04-25 01:55:32.372384137 +0000 2024-04-25T02:02:07.184 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-04-25 01:55:32.372384137 +0000 2024-04-25T02:02:07.184 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T02:02:07.249 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-04-25T02:02:07.249 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-04-25T02:02:07.249 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000267146 s, 1.9 MB/s 2024-04-25T02:02:07.251 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T02:02:07.307 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_2 2024-04-25T02:02:07.364 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T02:02:07.364 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:02:07.364 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-25T02:02:07.364 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:02:07.364 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:02:07.365 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-04-25 02:01:53.255925798 +0000 2024-04-25T02:02:07.365 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-04-25 01:55:32.709374828 +0000 2024-04-25T02:02:07.365 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-04-25 01:55:32.709374828 +0000 2024-04-25T02:02:07.365 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-04-25 01:55:32.709374828 +0000 2024-04-25T02:02:07.365 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T02:02:07.429 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-04-25T02:02:07.429 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-04-25T02:02:07.429 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000223544 s, 2.3 MB/s 2024-04-25T02:02:07.430 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T02:02:07.488 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_3 2024-04-25T02:02:07.543 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T02:02:07.543 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:02:07.543 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-25T02:02:07.543 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:02:07.543 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:02:07.543 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-04-25 02:01:53.255925798 +0000 2024-04-25T02:02:07.543 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-04-25 01:55:33.045365547 +0000 2024-04-25T02:02:07.543 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-04-25 01:55:33.045365547 +0000 2024-04-25T02:02:07.543 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-04-25 01:55:33.045365547 +0000 2024-04-25T02:02:07.544 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T02:02:07.606 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-04-25T02:02:07.606 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-04-25T02:02:07.607 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000206873 s, 2.5 MB/s 2024-04-25T02:02:07.608 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T02:02:07.665 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_4 2024-04-25T02:02:07.719 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T02:02:07.720 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:02:07.720 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-25T02:02:07.720 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:02:07.720 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:02:07.720 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-04-25 02:01:53.255925798 +0000 2024-04-25T02:02:07.720 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-04-25 01:55:33.384356183 +0000 2024-04-25T02:02:07.720 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-04-25 01:55:33.384356183 +0000 2024-04-25T02:02:07.720 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-04-25 01:55:33.384356183 +0000 2024-04-25T02:02:07.720 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T02:02:07.782 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-04-25T02:02:07.782 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-04-25T02:02:07.782 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000210816 s, 2.4 MB/s 2024-04-25T02:02:07.783 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T02:02:07.839 INFO:tasks.cephadm:Deploying osd.0 on smithi077 with /dev/vg_nvme/lv_4... 2024-04-25T02:02:07.840 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-25T02:02:07.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:07 smithi077 ceph-mon[26330]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:07.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:07 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:07.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:07 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:07.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:07 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi077", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T02:02:07.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:07 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:08.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:07 smithi112 ceph-mon[33313]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:08.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:07 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:08.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:07 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:08.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:07 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi077", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T02:02:08.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:07 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:08.767 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:02:08.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:08 smithi077 ceph-mon[26330]: Reconfiguring crash.smithi077 (monmap changed)... 2024-04-25T02:02:08.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:08 smithi077 ceph-mon[26330]: Reconfiguring daemon crash.smithi077 on smithi077 2024-04-25T02:02:09.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:08 smithi112 ceph-mon[33313]: Reconfiguring crash.smithi077 (monmap changed)... 2024-04-25T02:02:09.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:08 smithi112 ceph-mon[33313]: Reconfiguring daemon crash.smithi077 on smithi077 2024-04-25T02:02:09.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:09 smithi077 ceph-mon[26330]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:09.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:09 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:09.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:09 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:09.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:09 smithi077 ceph-mon[26330]: Reconfiguring alertmanager.smithi077 (dependencies changed)... 2024-04-25T02:02:09.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:09 smithi077 ceph-mon[26330]: Reconfiguring daemon alertmanager.smithi077 on smithi077 2024-04-25T02:02:10.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:09 smithi112 ceph-mon[33313]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:10.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:09 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:10.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:09 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:10.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:09 smithi112 ceph-mon[33313]: Reconfiguring alertmanager.smithi077 (dependencies changed)... 2024-04-25T02:02:10.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:09 smithi112 ceph-mon[33313]: Reconfiguring daemon alertmanager.smithi077 on smithi077 2024-04-25T02:02:11.739 INFO:teuthology.orchestra.run.smithi077.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-25T02:02:11.739 INFO:teuthology.orchestra.run.smithi077.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-25T02:02:11.739 INFO:teuthology.orchestra.run.smithi077.stderr: stderr: 10+0 records in 2024-04-25T02:02:11.740 INFO:teuthology.orchestra.run.smithi077.stderr:10+0 records out 2024-04-25T02:02:11.740 INFO:teuthology.orchestra.run.smithi077.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.014434 s, 726 MB/s 2024-04-25T02:02:11.740 INFO:teuthology.orchestra.run.smithi077.stderr: stderr: 2024-04-25T02:02:11.740 INFO:teuthology.orchestra.run.smithi077.stderr:--> Zapping successful for: 2024-04-25T02:02:11.740 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:11 smithi077 ceph-mon[26330]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:12.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:11 smithi112 ceph-mon[33313]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:12.312 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi077:vg_nvme/lv_4 2024-04-25T02:02:13.169 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:02:14.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:13 smithi112 ceph-mon[33313]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:14.094 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:13 smithi077 ceph-mon[26330]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:15.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.449+0000 7f2678859700 1 -- 172.21.15.77:0/3547523720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26740fc290 msgr2=0x7f26740fc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:02:15.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.449+0000 7f2678859700 1 --2- 172.21.15.77:0/3547523720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26740fc290 0x7f26740fc6a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2664004940 tx=0x7f2664009e30 comp rx=0 tx=0).stop 2024-04-25T02:02:15.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.450+0000 7f2678859700 1 -- 172.21.15.77:0/3547523720 shutdown_connections 2024-04-25T02:02:15.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.450+0000 7f2678859700 1 --2- 172.21.15.77:0/3547523720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26740fcbe0 0x7f26740fd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:15.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.450+0000 7f2678859700 1 --2- 172.21.15.77:0/3547523720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26740fc290 0x7f26740fc6a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:15.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.450+0000 7f2678859700 1 -- 172.21.15.77:0/3547523720 >> 172.21.15.77:0/3547523720 conn(0x7f26740f6b80 msgr2=0x7f26740f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:02:15.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.450+0000 7f2678859700 1 -- 172.21.15.77:0/3547523720 shutdown_connections 2024-04-25T02:02:15.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.450+0000 7f2678859700 1 -- 172.21.15.77:0/3547523720 wait complete. 2024-04-25T02:02:15.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.450+0000 7f2678859700 1 Processor -- start 2024-04-25T02:02:15.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.450+0000 7f2678859700 1 -- start start 2024-04-25T02:02:15.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.450+0000 7f2678859700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26740fc290 0x7f267410c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:02:15.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.450+0000 7f2678859700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26740fcbe0 0x7f267410ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:02:15.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.450+0000 7f2678859700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267410d480 con 0x7f26740fc290 2024-04-25T02:02:15.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.450+0000 7f2678859700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267410dcd0 con 0x7f26740fcbe0 2024-04-25T02:02:15.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.451+0000 7f267259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26740fc290 0x7f267410c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:02:15.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.451+0000 7f267259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26740fc290 0x7f267410c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51900/0 (socket says 172.21.15.77:51900) 2024-04-25T02:02:15.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.451+0000 7f267259c700 1 -- 172.21.15.77:0/238463046 learned_addr learned my addr 172.21.15.77:0/238463046 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:02:15.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.451+0000 7f2671d9b700 1 --2- 172.21.15.77:0/238463046 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26740fcbe0 0x7f267410ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:02:15.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.451+0000 7f267259c700 1 -- 172.21.15.77:0/238463046 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26740fcbe0 msgr2=0x7f267410ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:02:15.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.451+0000 7f267259c700 1 --2- 172.21.15.77:0/238463046 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26740fcbe0 0x7f267410ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:15.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.451+0000 7f267259c700 1 -- 172.21.15.77:0/238463046 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2664005040 con 0x7f26740fc290 2024-04-25T02:02:15.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.451+0000 7f267259c700 1 --2- 172.21.15.77:0/238463046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26740fc290 0x7f267410c940 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f266400b3b0 tx=0x7f2664009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:02:15.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.451+0000 7f2662ffd700 1 -- 172.21.15.77:0/238463046 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f266400e040 con 0x7f26740fc290 2024-04-25T02:02:15.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.451+0000 7f2678859700 1 -- 172.21.15.77:0/238463046 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f267410df50 con 0x7f26740fc290 2024-04-25T02:02:15.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.451+0000 7f2662ffd700 1 -- 172.21.15.77:0/238463046 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f266400bbf0 con 0x7f26740fc290 2024-04-25T02:02:15.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.451+0000 7f2662ffd700 1 -- 172.21.15.77:0/238463046 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f266401c630 con 0x7f26740fc290 2024-04-25T02:02:15.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.451+0000 7f2678859700 1 -- 172.21.15.77:0/238463046 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f267410e490 con 0x7f26740fc290 2024-04-25T02:02:15.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.452+0000 7f2678859700 1 -- 172.21.15.77:0/238463046 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f267405f5c0 con 0x7f26740fc290 2024-04-25T02:02:15.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.453+0000 7f2662ffd700 1 -- 172.21.15.77:0/238463046 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f266400bd60 con 0x7f26740fc290 2024-04-25T02:02:15.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.454+0000 7f2662ffd700 1 --2- 172.21.15.77:0/238463046 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f265c069210 0x7f265c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:02:15.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.454+0000 7f2662ffd700 1 -- 172.21.15.77:0/238463046 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f2664086d20 con 0x7f26740fc290 2024-04-25T02:02:15.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.454+0000 7f2671d9b700 1 --2- 172.21.15.77:0/238463046 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f265c069210 0x7f265c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:02:15.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.454+0000 7f2671d9b700 1 --2- 172.21.15.77:0/238463046 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f265c069210 0x7f265c06b6c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2668004f40 tx=0x7f266800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:02:15.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.458+0000 7f2662ffd700 1 -- 172.21.15.77:0/238463046 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2664057bc0 con 0x7f26740fc290 2024-04-25T02:02:15.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:15.688+0000 7f2678859700 1 -- 172.21.15.77:0/238463046 --> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f267410e860 con 0x7f265c069210 2024-04-25T02:02:15.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:15 smithi077 ceph-mon[26330]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:15.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:15 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:02:15.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:15 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:02:15.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:15 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:02:15.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:15 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:16.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:15 smithi112 ceph-mon[33313]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:16.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:15 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:02:16.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:15 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:02:16.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:15 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:02:16.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:15 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:16.810 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:16 smithi077 ceph-mon[26330]: from='client.14242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:02:16.810 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:16 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:16.810 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:16 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:17.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:16 smithi112 ceph-mon[33313]: from='client.14242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:02:17.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:16 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:17.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:16 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:17.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:17 smithi077 ceph-mon[26330]: Reconfiguring grafana.smithi077 (dependencies changed)... 2024-04-25T02:02:17.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:17 smithi077 ceph-mon[26330]: Reconfiguring daemon grafana.smithi077 on smithi077 2024-04-25T02:02:17.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:17 smithi077 ceph-mon[26330]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:18.015 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:17 smithi112 ceph-mon[33313]: Reconfiguring grafana.smithi077 (dependencies changed)... 2024-04-25T02:02:18.016 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:17 smithi112 ceph-mon[33313]: Reconfiguring daemon grafana.smithi077 on smithi077 2024-04-25T02:02:18.016 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:17 smithi112 ceph-mon[33313]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:20.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:19 smithi112 ceph-mon[33313]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:20.028 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:19 smithi077 ceph-mon[26330]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:21.997 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:21 smithi077 ceph-mon[26330]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:21.997 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:21 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:21.998 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:21 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:22.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:21 smithi112 ceph-mon[33313]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:22.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:21 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:22.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:21 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:22.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:22 smithi077 ceph-mon[26330]: Reconfiguring prometheus.smithi077 (dependencies changed)... 2024-04-25T02:02:22.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:22 smithi077 ceph-mon[26330]: Reconfiguring daemon prometheus.smithi077 on smithi077 2024-04-25T02:02:22.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:22 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/2800117193' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1533372f-b1a5-4ec0-9524-9940f870d874"}]: dispatch 2024-04-25T02:02:22.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:22 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/2800117193' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1533372f-b1a5-4ec0-9524-9940f870d874"}]': finished 2024-04-25T02:02:22.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:22 smithi077 ceph-mon[26330]: osdmap e6: 1 total, 0 up, 1 in 2024-04-25T02:02:22.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:22 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:02:23.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:22 smithi112 ceph-mon[33313]: Reconfiguring prometheus.smithi077 (dependencies changed)... 2024-04-25T02:02:23.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:22 smithi112 ceph-mon[33313]: Reconfiguring daemon prometheus.smithi077 on smithi077 2024-04-25T02:02:23.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:22 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/2800117193' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1533372f-b1a5-4ec0-9524-9940f870d874"}]: dispatch 2024-04-25T02:02:23.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:22 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/2800117193' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1533372f-b1a5-4ec0-9524-9940f870d874"}]': finished 2024-04-25T02:02:23.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:22 smithi112 ceph-mon[33313]: osdmap e6: 1 total, 0 up, 1 in 2024-04-25T02:02:23.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:22 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:02:24.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:23 smithi112 ceph-mon[33313]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:24.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:23 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/3897069063' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:02:24.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:23 smithi077 ceph-mon[26330]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:24.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:23 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/3897069063' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:02:26.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:25 smithi112 ceph-mon[33313]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:26.045 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:25 smithi077 ceph-mon[26330]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:27.777 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:27 smithi112 ceph-mon[33313]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:28.007 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:27 smithi077 ceph-mon[26330]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:30.005 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:29 smithi077 ceph-mon[26330]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:30.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:29 smithi112 ceph-mon[33313]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:30.881 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:30 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:02:31.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:30 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:02:31.887 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:31 smithi112 ceph-mon[33313]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:31.887 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:31 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:31.887 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:31 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:31.887 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:31 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T02:02:31.887 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:31 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:31.918 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:31 smithi077 ceph-mon[26330]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:31.918 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:31.918 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:31.918 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T02:02:31.918 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:33.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:32 smithi112 ceph-mon[33313]: Reconfiguring crash.smithi112 (monmap changed)... 2024-04-25T02:02:33.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:32 smithi112 ceph-mon[33313]: Reconfiguring daemon crash.smithi112 on smithi112 2024-04-25T02:02:33.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:32 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-25T02:02:33.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:32 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:33.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:32 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:33.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:32 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:33.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:32 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.cswrxs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T02:02:33.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:32 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T02:02:33.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:32 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:33.062 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:32 smithi077 ceph-mon[26330]: Reconfiguring crash.smithi112 (monmap changed)... 2024-04-25T02:02:33.062 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:32 smithi077 ceph-mon[26330]: Reconfiguring daemon crash.smithi112 on smithi112 2024-04-25T02:02:33.062 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:32 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-25T02:02:33.062 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:32 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:33.062 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:32 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:33.062 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:32 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:33.062 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:32 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.cswrxs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T02:02:33.062 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:32 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T02:02:33.062 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:32 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:34.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:33 smithi112 ceph-mon[33313]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:34.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:33 smithi112 ceph-mon[33313]: Deploying daemon osd.0 on smithi077 2024-04-25T02:02:34.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:33 smithi112 ceph-mon[33313]: Reconfiguring mgr.smithi112.cswrxs (monmap changed)... 2024-04-25T02:02:34.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:33 smithi112 ceph-mon[33313]: Reconfiguring daemon mgr.smithi112.cswrxs on smithi112 2024-04-25T02:02:34.047 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:33 smithi077 ceph-mon[26330]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:34.047 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:33 smithi077 ceph-mon[26330]: Deploying daemon osd.0 on smithi077 2024-04-25T02:02:34.047 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:33 smithi077 ceph-mon[26330]: Reconfiguring mgr.smithi112.cswrxs (monmap changed)... 2024-04-25T02:02:34.047 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:33 smithi077 ceph-mon[26330]: Reconfiguring daemon mgr.smithi112.cswrxs on smithi112 2024-04-25T02:02:35.082 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:34 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:35.082 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:34 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:35.082 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:34 smithi077 ceph-mon[26330]: Reconfiguring mon.smithi112 (monmap changed)... 2024-04-25T02:02:35.083 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:34 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:02:35.083 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:34 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T02:02:35.083 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:34 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:35.083 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:34 smithi077 ceph-mon[26330]: Reconfiguring daemon mon.smithi112 on smithi112 2024-04-25T02:02:35.083 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:34 smithi077 ceph-mon[26330]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:35.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:34 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:35.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:34 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:35.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:34 smithi112 ceph-mon[33313]: Reconfiguring mon.smithi112 (monmap changed)... 2024-04-25T02:02:35.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:34 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:02:35.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:34 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T02:02:35.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:34 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:35.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:34 smithi112 ceph-mon[33313]: Reconfiguring daemon mon.smithi112 on smithi112 2024-04-25T02:02:35.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:34 smithi112 ceph-mon[33313]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:36.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:36 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:36.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:36 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:36.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:36 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-25T02:02:36.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:36 smithi077 ceph-mon[26330]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-25T02:02:36.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:36 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi077:9093"}]: dispatch 2024-04-25T02:02:36.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:36 smithi077 ceph-mon[26330]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi077:9093"}]: dispatch 2024-04-25T02:02:36.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:36 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:36.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:36 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-25T02:02:36.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:36 smithi077 ceph-mon[26330]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-25T02:02:36.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:36 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi077:3000"}]: dispatch 2024-04-25T02:02:36.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:36 smithi077 ceph-mon[26330]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi077:3000"}]: dispatch 2024-04-25T02:02:36.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:36 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:36.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:36 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T02:02:36.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:36 smithi077 ceph-mon[26330]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T02:02:36.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:36 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi077:9095"}]: dispatch 2024-04-25T02:02:36.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:36 smithi077 ceph-mon[26330]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi077:9095"}]: dispatch 2024-04-25T02:02:36.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:36 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:36.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:36 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:02:36.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:36 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:36.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:36 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:36.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:36 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-25T02:02:36.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:36 smithi112 ceph-mon[33313]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-25T02:02:36.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:36 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi077:9093"}]: dispatch 2024-04-25T02:02:36.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:36 smithi112 ceph-mon[33313]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi077:9093"}]: dispatch 2024-04-25T02:02:36.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:36 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:36.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:36 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-25T02:02:36.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:36 smithi112 ceph-mon[33313]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-25T02:02:36.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:36 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi077:3000"}]: dispatch 2024-04-25T02:02:36.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:36 smithi112 ceph-mon[33313]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi077:3000"}]: dispatch 2024-04-25T02:02:36.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:36 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:36.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:36 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T02:02:36.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:36 smithi112 ceph-mon[33313]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T02:02:36.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:36 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi077:9095"}]: dispatch 2024-04-25T02:02:36.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:36 smithi112 ceph-mon[33313]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi077:9095"}]: dispatch 2024-04-25T02:02:36.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:36 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:36.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:36 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:02:37.585 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:37 smithi077 ceph-mon[26330]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:37.777 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:37 smithi112 ceph-mon[33313]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:38.496 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:38 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:38.496 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:38 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:38.496 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:38 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:38.496 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:38 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:38.777 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:38 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:38.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:38 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:38.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:38 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:38.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:38 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:40.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:39 smithi077 ceph-mon[26330]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:40.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:39 smithi112 ceph-mon[33313]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:41.949 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:41 smithi077 ceph-mon[26330]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:41.949 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:41 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:41.949 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:41 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:41.950 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:41 smithi077 ceph-mon[26330]: from='osd.0 [v2:172.21.15.77:6802/3624813295,v1:172.21.15.77:6803/3624813295]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-25T02:02:42.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:41 smithi112 ceph-mon[33313]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:42.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:41 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:42.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:41 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:42.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:41 smithi112 ceph-mon[33313]: from='osd.0 [v2:172.21.15.77:6802/3624813295,v1:172.21.15.77:6803/3624813295]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-25T02:02:42.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:42.315+0000 7f2662ffd700 1 -- 172.21.15.77:0/238463046 <== mgr.14208 v2:172.21.15.77:6800/310739264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f267410e860 con 0x7f265c069210 2024-04-25T02:02:42.321 INFO:teuthology.orchestra.run.smithi077.stdout:Created osd(s) 0 on host 'smithi077' 2024-04-25T02:02:42.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:42.318+0000 7f2678859700 1 -- 172.21.15.77:0/238463046 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f265c069210 msgr2=0x7f265c06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:02:42.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:42.318+0000 7f2678859700 1 --2- 172.21.15.77:0/238463046 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f265c069210 0x7f265c06b6c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2668004f40 tx=0x7f266800b040 comp rx=0 tx=0).stop 2024-04-25T02:02:42.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:42.318+0000 7f2678859700 1 -- 172.21.15.77:0/238463046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26740fc290 msgr2=0x7f267410c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:02:42.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:42.318+0000 7f2678859700 1 --2- 172.21.15.77:0/238463046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26740fc290 0x7f267410c940 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f266400b3b0 tx=0x7f2664009e30 comp rx=0 tx=0).stop 2024-04-25T02:02:42.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:42.318+0000 7f2678859700 1 -- 172.21.15.77:0/238463046 shutdown_connections 2024-04-25T02:02:42.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:42.318+0000 7f2678859700 1 --2- 172.21.15.77:0/238463046 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f265c069210 0x7f265c06b6c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:42.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:42.318+0000 7f2678859700 1 --2- 172.21.15.77:0/238463046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26740fc290 0x7f267410c940 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:42.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:42.318+0000 7f2678859700 1 --2- 172.21.15.77:0/238463046 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26740fcbe0 0x7f267410ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:42.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:42.318+0000 7f2678859700 1 -- 172.21.15.77:0/238463046 >> 172.21.15.77:0/238463046 conn(0x7f26740f6b80 msgr2=0x7f26740f82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:02:42.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:42.318+0000 7f2678859700 1 -- 172.21.15.77:0/238463046 shutdown_connections 2024-04-25T02:02:42.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:42.318+0000 7f2678859700 1 -- 172.21.15.77:0/238463046 wait complete. 2024-04-25T02:02:42.860 DEBUG:teuthology.orchestra.run.smithi077:osd.0> sudo journalctl -f -n 0 -u ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.0.service 2024-04-25T02:02:42.862 INFO:tasks.cephadm:Deploying osd.1 on smithi077 with /dev/vg_nvme/lv_3... 2024-04-25T02:02:42.863 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-25T02:02:42.881 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:42 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:42.881 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:42 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:02:42.881 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:42 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:42.881 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:42 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:02:42.881 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:42 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:42.881 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:42 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:42.882 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:42 smithi077 ceph-mon[26330]: from='osd.0 [v2:172.21.15.77:6802/3624813295,v1:172.21.15.77:6803/3624813295]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-25T02:02:42.882 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:42 smithi077 ceph-mon[26330]: osdmap e7: 1 total, 0 up, 1 in 2024-04-25T02:02:42.882 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:42 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:02:42.882 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:42 smithi077 ceph-mon[26330]: from='osd.0 [v2:172.21.15.77:6802/3624813295,v1:172.21.15.77:6803/3624813295]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-04-25T02:02:43.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:42 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:43.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:42 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:02:43.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:42 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:43.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:42 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:02:43.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:42 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:43.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:42 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:43.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:42 smithi112 ceph-mon[33313]: from='osd.0 [v2:172.21.15.77:6802/3624813295,v1:172.21.15.77:6803/3624813295]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-25T02:02:43.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:42 smithi112 ceph-mon[33313]: osdmap e7: 1 total, 0 up, 1 in 2024-04-25T02:02:43.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:42 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:02:43.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:42 smithi112 ceph-mon[33313]: from='osd.0 [v2:172.21.15.77:6802/3624813295,v1:172.21.15.77:6803/3624813295]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-04-25T02:02:43.715 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:02:43.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:43 smithi077 ceph-mon[26330]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:43.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:43 smithi077 ceph-mon[26330]: from='osd.0 [v2:172.21.15.77:6802/3624813295,v1:172.21.15.77:6803/3624813295]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-04-25T02:02:43.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:43 smithi077 ceph-mon[26330]: osdmap e8: 1 total, 0 up, 1 in 2024-04-25T02:02:43.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:43 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:02:43.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:43 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:02:43.978 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:02:43 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0[44888]: 2024-04-25T02:02:43.627+0000 7fe763dbc700 -1 osd.0 0 waiting for initial osdmap 2024-04-25T02:02:43.978 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:02:43 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0[44888]: 2024-04-25T02:02:43.631+0000 7fe75ebb7700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:02:44.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:43 smithi112 ceph-mon[33313]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:44.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:43 smithi112 ceph-mon[33313]: from='osd.0 [v2:172.21.15.77:6802/3624813295,v1:172.21.15.77:6803/3624813295]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-04-25T02:02:44.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:43 smithi112 ceph-mon[33313]: osdmap e8: 1 total, 0 up, 1 in 2024-04-25T02:02:44.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:43 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:02:44.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:43 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:02:45.179 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:44 smithi112 ceph-mon[33313]: purged_snaps scrub starts 2024-04-25T02:02:45.179 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:44 smithi112 ceph-mon[33313]: purged_snaps scrub ok 2024-04-25T02:02:45.179 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:44 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:45.180 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:44 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:45.180 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:44 smithi112 ceph-mon[33313]: osd.0 [v2:172.21.15.77:6802/3624813295,v1:172.21.15.77:6803/3624813295] boot 2024-04-25T02:02:45.180 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:44 smithi112 ceph-mon[33313]: osdmap e9: 1 total, 1 up, 1 in 2024-04-25T02:02:45.180 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:44 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:02:45.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:44 smithi077 ceph-mon[26330]: purged_snaps scrub starts 2024-04-25T02:02:45.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:44 smithi077 ceph-mon[26330]: purged_snaps scrub ok 2024-04-25T02:02:45.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:44 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:45.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:44 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:45.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:44 smithi077 ceph-mon[26330]: osd.0 [v2:172.21.15.77:6802/3624813295,v1:172.21.15.77:6803/3624813295] boot 2024-04-25T02:02:45.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:44 smithi077 ceph-mon[26330]: osdmap e9: 1 total, 1 up, 1 in 2024-04-25T02:02:45.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:44 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:02:46.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:45 smithi077 ceph-mon[26330]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:46.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:45 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:02:46.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:45 smithi077 ceph-mon[26330]: osdmap e10: 1 total, 1 up, 1 in 2024-04-25T02:02:46.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:45 smithi112 ceph-mon[33313]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:02:46.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:45 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:02:46.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:45 smithi112 ceph-mon[33313]: osdmap e10: 1 total, 1 up, 1 in 2024-04-25T02:02:46.299 INFO:teuthology.orchestra.run.smithi077.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-25T02:02:46.299 INFO:teuthology.orchestra.run.smithi077.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-25T02:02:46.300 INFO:teuthology.orchestra.run.smithi077.stderr: stderr: 10+0 records in 2024-04-25T02:02:46.300 INFO:teuthology.orchestra.run.smithi077.stderr:10+0 records out 2024-04-25T02:02:46.300 INFO:teuthology.orchestra.run.smithi077.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0146698 s, 715 MB/s 2024-04-25T02:02:46.300 INFO:teuthology.orchestra.run.smithi077.stderr:--> Zapping successful for: 2024-04-25T02:02:47.329 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi077:vg_nvme/lv_3 2024-04-25T02:02:47.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:47 smithi077 ceph-mon[26330]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:02:48.046 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:02:48.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:47 smithi112 ceph-mon[33313]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:02:49.161 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:49 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:49.162 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:49 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:49.162 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:49 smithi077 ceph-mon[26330]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:02:49.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:49 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:49.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:49 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:49.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:49 smithi112 ceph-mon[33313]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:02:49.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.490+0000 7f80e3a71700 1 -- 172.21.15.77:0/2363665038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80dc0fce60 msgr2=0x7f80dc0fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:02:49.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.490+0000 7f80e3a71700 1 --2- 172.21.15.77:0/2363665038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80dc0fce60 0x7f80dc0fd270 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f80cc004940 tx=0x7f80cc009e30 comp rx=0 tx=0).stop 2024-04-25T02:02:49.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.490+0000 7f80e3a71700 1 -- 172.21.15.77:0/2363665038 shutdown_connections 2024-04-25T02:02:49.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.490+0000 7f80e3a71700 1 --2- 172.21.15.77:0/2363665038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80dc0fdfd0 0x7f80dc0fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:49.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.490+0000 7f80e3a71700 1 --2- 172.21.15.77:0/2363665038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80dc0fce60 0x7f80dc0fd270 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:49.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.490+0000 7f80e3a71700 1 -- 172.21.15.77:0/2363665038 >> 172.21.15.77:0/2363665038 conn(0x7f80dc0f8540 msgr2=0x7f80dc0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:02:49.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.490+0000 7f80e3a71700 1 -- 172.21.15.77:0/2363665038 shutdown_connections 2024-04-25T02:02:49.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.490+0000 7f80e3a71700 1 -- 172.21.15.77:0/2363665038 wait complete. 2024-04-25T02:02:49.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.490+0000 7f80e3a71700 1 Processor -- start 2024-04-25T02:02:49.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.490+0000 7f80e3a71700 1 -- start start 2024-04-25T02:02:49.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.490+0000 7f80e3a71700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80dc0fce60 0x7f80dc10d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:02:49.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.490+0000 7f80e3a71700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80dc0fdfd0 0x7f80dc10ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:02:49.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.490+0000 7f80e3a71700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc10e3f0 con 0x7f80dc0fdfd0 2024-04-25T02:02:49.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.490+0000 7f80e3a71700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc10e560 con 0x7f80dc0fce60 2024-04-25T02:02:49.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.491+0000 7f80e100c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80dc0fdfd0 0x7f80dc10ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:02:49.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.491+0000 7f80e100c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80dc0fdfd0 0x7f80dc10ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47456/0 (socket says 172.21.15.77:47456) 2024-04-25T02:02:49.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.491+0000 7f80e100c700 1 -- 172.21.15.77:0/3001012854 learned_addr learned my addr 172.21.15.77:0/3001012854 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:02:49.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.491+0000 7f80e180d700 1 --2- 172.21.15.77:0/3001012854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80dc0fce60 0x7f80dc10d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:02:49.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.491+0000 7f80e100c700 1 -- 172.21.15.77:0/3001012854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80dc0fce60 msgr2=0x7f80dc10d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:02:49.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.491+0000 7f80e100c700 1 --2- 172.21.15.77:0/3001012854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80dc0fce60 0x7f80dc10d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:49.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.491+0000 7f80e100c700 1 -- 172.21.15.77:0/3001012854 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc005040 con 0x7f80dc0fdfd0 2024-04-25T02:02:49.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.491+0000 7f80e100c700 1 --2- 172.21.15.77:0/3001012854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80dc0fdfd0 0x7f80dc10ddf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f80d8002a80 tx=0x7f80d80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:02:49.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.491+0000 7f80d27fc700 1 -- 172.21.15.77:0/3001012854 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80d8007cc0 con 0x7f80dc0fdfd0 2024-04-25T02:02:49.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.491+0000 7f80e3a71700 1 -- 172.21.15.77:0/3001012854 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80dc112fc0 con 0x7f80dc0fdfd0 2024-04-25T02:02:49.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.491+0000 7f80d27fc700 1 -- 172.21.15.77:0/3001012854 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f80d800f040 con 0x7f80dc0fdfd0 2024-04-25T02:02:49.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.491+0000 7f80d27fc700 1 -- 172.21.15.77:0/3001012854 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80d80096f0 con 0x7f80dc0fdfd0 2024-04-25T02:02:49.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.491+0000 7f80e3a71700 1 -- 172.21.15.77:0/3001012854 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80dc113550 con 0x7f80dc0fdfd0 2024-04-25T02:02:49.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.492+0000 7f80e3a71700 1 -- 172.21.15.77:0/3001012854 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80dc04c710 con 0x7f80dc0fdfd0 2024-04-25T02:02:49.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.493+0000 7f80d27fc700 1 -- 172.21.15.77:0/3001012854 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f80d800d690 con 0x7f80dc0fdfd0 2024-04-25T02:02:49.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.493+0000 7f80d27fc700 1 --2- 172.21.15.77:0/3001012854 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f80c8069210 0x7f80c806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:02:49.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.493+0000 7f80d27fc700 1 -- 172.21.15.77:0/3001012854 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7f80d8085ac0 con 0x7f80dc0fdfd0 2024-04-25T02:02:49.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.493+0000 7f80e180d700 1 --2- 172.21.15.77:0/3001012854 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f80c8069210 0x7f80c806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:02:49.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.494+0000 7f80e180d700 1 --2- 172.21.15.77:0/3001012854 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f80c8069210 0x7f80c806b6c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f80cc000c00 tx=0x7f80cc009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:02:49.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.497+0000 7f80d27fc700 1 -- 172.21.15.77:0/3001012854 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f80d804d250 con 0x7f80dc0fdfd0 2024-04-25T02:02:49.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:02:49.697+0000 7f80e3a71700 1 -- 172.21.15.77:0/3001012854 --> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f80dc1022b0 con 0x7f80c8069210 2024-04-25T02:02:50.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:50 smithi077 ceph-mon[26330]: from='client.14260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:02:50.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:50 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:02:50.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:50 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:02:50.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:50 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:50.528 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:50 smithi112 ceph-mon[33313]: from='client.14260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:02:50.528 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:50 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:02:50.528 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:50 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:02:50.528 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:50 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:51.333 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:51 smithi077 ceph-mon[26330]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:02:51.528 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:51 smithi112 ceph-mon[33313]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:02:53.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:53 smithi077 ceph-mon[26330]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:02:53.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:53 smithi077 ceph-mon[26330]: Detected new or changed devices on smithi077 2024-04-25T02:02:53.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:53 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:53.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:53 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:53.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:53 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:02:53.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:53 smithi077 ceph-mon[26330]: Adjusting osd_memory_target on smithi077 to 12864M 2024-04-25T02:02:53.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:53 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:53.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:53 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:53.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:53 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:02:53.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:53 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:53.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:53 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:02:54.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:53 smithi112 ceph-mon[33313]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:02:54.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:53 smithi112 ceph-mon[33313]: Detected new or changed devices on smithi077 2024-04-25T02:02:54.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:53 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:54.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:53 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:54.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:53 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:02:54.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:53 smithi112 ceph-mon[33313]: Adjusting osd_memory_target on smithi077 to 12864M 2024-04-25T02:02:54.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:53 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:54.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:53 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:54.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:53 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:02:54.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:53 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:54.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:53 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:02:54.941 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:54 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/627897727' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb083b21-fd25-4ac4-bbde-6387c3253d27"}]: dispatch 2024-04-25T02:02:54.941 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:54 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/627897727' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cb083b21-fd25-4ac4-bbde-6387c3253d27"}]': finished 2024-04-25T02:02:54.941 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:54 smithi077 ceph-mon[26330]: osdmap e11: 2 total, 1 up, 2 in 2024-04-25T02:02:54.941 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:54 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:02:54.941 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:54 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/3542789751' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:02:55.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:54 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/627897727' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb083b21-fd25-4ac4-bbde-6387c3253d27"}]: dispatch 2024-04-25T02:02:55.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:54 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/627897727' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cb083b21-fd25-4ac4-bbde-6387c3253d27"}]': finished 2024-04-25T02:02:55.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:54 smithi112 ceph-mon[33313]: osdmap e11: 2 total, 1 up, 2 in 2024-04-25T02:02:55.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:54 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:02:55.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:54 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/3542789751' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:02:56.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:55 smithi112 ceph-mon[33313]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:02:56.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:56.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:56.054 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:55 smithi077 ceph-mon[26330]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:02:56.054 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:55 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:56.054 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:55 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:57.777 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:57 smithi112 ceph-mon[33313]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:02:57.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:57 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:57.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:57 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:57.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:57 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:57.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:57 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:02:57.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:57 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:57.942 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:57 smithi077 ceph-mon[26330]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:02:57.942 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:57 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:57.942 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:57 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:57.942 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:57 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:57.942 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:57 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:02:57.942 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:57 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:02:59.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:02:59 smithi077 ceph-mon[26330]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:02:59.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:02:59 smithi112 ceph-mon[33313]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:03:00.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:00 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:03:00.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:00 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:03:01.777 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:01 smithi112 ceph-mon[33313]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:03:01.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:01 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-25T02:03:01.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:01 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:01.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:01 smithi112 ceph-mon[33313]: Deploying daemon osd.1 on smithi077 2024-04-25T02:03:01.811 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:01 smithi077 ceph-mon[26330]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:03:01.811 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:01 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-25T02:03:01.811 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:01 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:01.811 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:01 smithi077 ceph-mon[26330]: Deploying daemon osd.1 on smithi077 2024-04-25T02:03:03.678 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:03 smithi077 ceph-mon[26330]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:03:03.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:03 smithi112 ceph-mon[33313]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:03:05.754 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:05 smithi077 ceph-mon[26330]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:03:05.754 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:05 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:05.754 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:05 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:05.754 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:05 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:03:05.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:05 smithi112 ceph-mon[33313]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:03:05.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:05 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:05.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:05 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:05.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:05 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:03:07.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:07 smithi112 ceph-mon[33313]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:03:07.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:07 smithi077 ceph-mon[26330]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:03:08.322 INFO:teuthology.orchestra.run.smithi077.stdout:Created osd(s) 1 on host 'smithi077' 2024-04-25T02:03:08.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:08.317+0000 7f80d27fc700 1 -- 172.21.15.77:0/3001012854 <== mgr.14208 v2:172.21.15.77:6800/310739264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f80dc1022b0 con 0x7f80c8069210 2024-04-25T02:03:08.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:08.320+0000 7f80e3a71700 1 -- 172.21.15.77:0/3001012854 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f80c8069210 msgr2=0x7f80c806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:03:08.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:08.320+0000 7f80e3a71700 1 --2- 172.21.15.77:0/3001012854 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f80c8069210 0x7f80c806b6c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f80cc000c00 tx=0x7f80cc009e30 comp rx=0 tx=0).stop 2024-04-25T02:03:08.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:08.320+0000 7f80e3a71700 1 -- 172.21.15.77:0/3001012854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80dc0fdfd0 msgr2=0x7f80dc10ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:03:08.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:08.320+0000 7f80e3a71700 1 --2- 172.21.15.77:0/3001012854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80dc0fdfd0 0x7f80dc10ddf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f80d8002a80 tx=0x7f80d80046b0 comp rx=0 tx=0).stop 2024-04-25T02:03:08.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:08.320+0000 7f80e3a71700 1 -- 172.21.15.77:0/3001012854 shutdown_connections 2024-04-25T02:03:08.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:08.320+0000 7f80e3a71700 1 --2- 172.21.15.77:0/3001012854 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f80c8069210 0x7f80c806b6c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:08.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:08.320+0000 7f80e3a71700 1 --2- 172.21.15.77:0/3001012854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80dc0fce60 0x7f80dc10d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:08.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:08.320+0000 7f80e3a71700 1 --2- 172.21.15.77:0/3001012854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80dc0fdfd0 0x7f80dc10ddf0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:08.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:08.320+0000 7f80e3a71700 1 -- 172.21.15.77:0/3001012854 >> 172.21.15.77:0/3001012854 conn(0x7f80dc0f8540 msgr2=0x7f80dc0f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:03:08.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:08.320+0000 7f80e3a71700 1 -- 172.21.15.77:0/3001012854 shutdown_connections 2024-04-25T02:03:08.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:08.320+0000 7f80e3a71700 1 -- 172.21.15.77:0/3001012854 wait complete. 2024-04-25T02:03:09.107 DEBUG:teuthology.orchestra.run.smithi077:osd.1> sudo journalctl -f -n 0 -u ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.1.service 2024-04-25T02:03:09.109 INFO:tasks.cephadm:Deploying osd.2 on smithi077 with /dev/vg_nvme/lv_2... 2024-04-25T02:03:09.109 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-25T02:03:09.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:09 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:09.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:09 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:09.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:09 smithi077 ceph-mon[26330]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:03:09.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:09 smithi077 ceph-mon[26330]: from='osd.1 [v2:172.21.15.77:6810/3061147623,v1:172.21.15.77:6811/3061147623]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T02:03:09.478 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:03:09 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1[53044]: 2024-04-25T02:03:09.226+0000 7fdb02b2f540 -1 osd.1 0 log_to_monitors true 2024-04-25T02:03:09.490 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:03:09.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:09 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:09.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:09 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:09.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:09 smithi112 ceph-mon[33313]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:03:09.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:09 smithi112 ceph-mon[33313]: from='osd.1 [v2:172.21.15.77:6810/3061147623,v1:172.21.15.77:6811/3061147623]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T02:03:10.490 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:03:10 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1[53044]: 2024-04-25T02:03:10.296+0000 7fdaf9301700 -1 osd.1 0 waiting for initial osdmap 2024-04-25T02:03:10.490 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:03:10 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1[53044]: 2024-04-25T02:03:10.303+0000 7fdaf58ff700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:03:10.491 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:10 smithi077 ceph-mon[26330]: from='osd.1 [v2:172.21.15.77:6810/3061147623,v1:172.21.15.77:6811/3061147623]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-25T02:03:10.491 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:10 smithi077 ceph-mon[26330]: osdmap e12: 2 total, 1 up, 2 in 2024-04-25T02:03:10.491 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:10 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:03:10.491 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:10 smithi077 ceph-mon[26330]: from='osd.1 [v2:172.21.15.77:6810/3061147623,v1:172.21.15.77:6811/3061147623]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-04-25T02:03:10.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:10 smithi112 ceph-mon[33313]: from='osd.1 [v2:172.21.15.77:6810/3061147623,v1:172.21.15.77:6811/3061147623]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-25T02:03:10.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:10 smithi112 ceph-mon[33313]: osdmap e12: 2 total, 1 up, 2 in 2024-04-25T02:03:10.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:10 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:03:10.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:10 smithi112 ceph-mon[33313]: from='osd.1 [v2:172.21.15.77:6810/3061147623,v1:172.21.15.77:6811/3061147623]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-04-25T02:03:11.584 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:11 smithi077 ceph-mon[26330]: from='osd.1 [v2:172.21.15.77:6810/3061147623,v1:172.21.15.77:6811/3061147623]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-04-25T02:03:11.584 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:11 smithi077 ceph-mon[26330]: osdmap e13: 2 total, 1 up, 2 in 2024-04-25T02:03:11.584 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:11 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:03:11.584 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:11 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:03:11.584 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:11 smithi077 ceph-mon[26330]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:03:11.584 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:11 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:03:11.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:11 smithi112 ceph-mon[33313]: from='osd.1 [v2:172.21.15.77:6810/3061147623,v1:172.21.15.77:6811/3061147623]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-04-25T02:03:11.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:11 smithi112 ceph-mon[33313]: osdmap e13: 2 total, 1 up, 2 in 2024-04-25T02:03:11.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:11 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:03:11.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:11 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:03:11.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:11 smithi112 ceph-mon[33313]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:03:11.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:11 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:03:12.387 INFO:teuthology.orchestra.run.smithi077.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-25T02:03:12.388 INFO:teuthology.orchestra.run.smithi077.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-25T02:03:12.388 INFO:teuthology.orchestra.run.smithi077.stderr: stderr: 10+0 records in 2024-04-25T02:03:12.388 INFO:teuthology.orchestra.run.smithi077.stderr:10+0 records out 2024-04-25T02:03:12.388 INFO:teuthology.orchestra.run.smithi077.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0123711 s, 848 MB/s 2024-04-25T02:03:12.388 INFO:teuthology.orchestra.run.smithi077.stderr:--> Zapping successful for: 2024-04-25T02:03:12.668 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:12 smithi077 ceph-mon[26330]: purged_snaps scrub starts 2024-04-25T02:03:12.668 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:12 smithi077 ceph-mon[26330]: purged_snaps scrub ok 2024-04-25T02:03:12.668 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:12 smithi077 ceph-mon[26330]: osd.1 [v2:172.21.15.77:6810/3061147623,v1:172.21.15.77:6811/3061147623] boot 2024-04-25T02:03:12.668 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:12 smithi077 ceph-mon[26330]: osdmap e14: 2 total, 2 up, 2 in 2024-04-25T02:03:12.668 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:12 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:03:12.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:12 smithi112 ceph-mon[33313]: purged_snaps scrub starts 2024-04-25T02:03:12.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:12 smithi112 ceph-mon[33313]: purged_snaps scrub ok 2024-04-25T02:03:12.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:12 smithi112 ceph-mon[33313]: osd.1 [v2:172.21.15.77:6810/3061147623,v1:172.21.15.77:6811/3061147623] boot 2024-04-25T02:03:12.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:12 smithi112 ceph-mon[33313]: osdmap e14: 2 total, 2 up, 2 in 2024-04-25T02:03:12.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:12 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:03:13.339 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:13 smithi077 ceph-mon[26330]: osdmap e15: 2 total, 2 up, 2 in 2024-04-25T02:03:13.339 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:13 smithi077 ceph-mon[26330]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T02:03:13.339 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:13 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:13.339 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:13 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:13.340 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi077:vg_nvme/lv_2 2024-04-25T02:03:13.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:13 smithi112 ceph-mon[33313]: osdmap e15: 2 total, 2 up, 2 in 2024-04-25T02:03:13.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:13 smithi112 ceph-mon[33313]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T02:03:13.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:13 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:13.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:13 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:14.777 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:03:15.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:15 smithi077 ceph-mon[26330]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T02:03:15.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:15 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:03:15.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:15 smithi112 ceph-mon[33313]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T02:03:15.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:15 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:03:16.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.305+0000 7f625c3fe700 1 -- 172.21.15.77:0/3378177653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62540fce60 msgr2=0x7f62540fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:03:16.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.305+0000 7f625c3fe700 1 --2- 172.21.15.77:0/3378177653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62540fce60 0x7f62540fd270 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6244004940 tx=0x7f6244009e30 comp rx=0 tx=0).stop 2024-04-25T02:03:16.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.305+0000 7f625c3fe700 1 -- 172.21.15.77:0/3378177653 shutdown_connections 2024-04-25T02:03:16.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.305+0000 7f625c3fe700 1 --2- 172.21.15.77:0/3378177653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62540fdfd0 0x7f62540fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:16.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.305+0000 7f625c3fe700 1 --2- 172.21.15.77:0/3378177653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62540fce60 0x7f62540fd270 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:16.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.305+0000 7f625c3fe700 1 -- 172.21.15.77:0/3378177653 >> 172.21.15.77:0/3378177653 conn(0x7f62540f8540 msgr2=0x7f62540fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:03:16.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.305+0000 7f625c3fe700 1 -- 172.21.15.77:0/3378177653 shutdown_connections 2024-04-25T02:03:16.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.305+0000 7f625c3fe700 1 -- 172.21.15.77:0/3378177653 wait complete. 2024-04-25T02:03:16.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.306+0000 7f625c3fe700 1 Processor -- start 2024-04-25T02:03:16.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.306+0000 7f625c3fe700 1 -- start start 2024-04-25T02:03:16.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.306+0000 7f625c3fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62540fce60 0x7f625410d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:03:16.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.306+0000 7f625c3fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62540fdfd0 0x7f625410de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:03:16.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.306+0000 7f625c3fe700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625410e450 con 0x7f62540fdfd0 2024-04-25T02:03:16.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.306+0000 7f625c3fe700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625410e5c0 con 0x7f62540fce60 2024-04-25T02:03:16.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.306+0000 7f6259999700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62540fdfd0 0x7f625410de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:03:16.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.306+0000 7f6259999700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62540fdfd0 0x7f625410de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44990/0 (socket says 172.21.15.77:44990) 2024-04-25T02:03:16.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.306+0000 7f6259999700 1 -- 172.21.15.77:0/2315060180 learned_addr learned my addr 172.21.15.77:0/2315060180 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:03:16.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.306+0000 7f625a19a700 1 --2- 172.21.15.77:0/2315060180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62540fce60 0x7f625410d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:03:16.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.306+0000 7f6259999700 1 -- 172.21.15.77:0/2315060180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62540fce60 msgr2=0x7f625410d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:03:16.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.306+0000 7f6259999700 1 --2- 172.21.15.77:0/2315060180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62540fce60 0x7f625410d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:16.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.306+0000 7f6259999700 1 -- 172.21.15.77:0/2315060180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6244005040 con 0x7f62540fdfd0 2024-04-25T02:03:16.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.307+0000 7f6259999700 1 --2- 172.21.15.77:0/2315060180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62540fdfd0 0x7f625410de50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f625000c830 tx=0x7f6250004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:03:16.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.307+0000 7f624affd700 1 -- 172.21.15.77:0/2315060180 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62500106f0 con 0x7f62540fdfd0 2024-04-25T02:03:16.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.307+0000 7f624affd700 1 -- 172.21.15.77:0/2315060180 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6250010d20 con 0x7f62540fdfd0 2024-04-25T02:03:16.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.307+0000 7f625c3fe700 1 -- 172.21.15.77:0/2315060180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6254113020 con 0x7f62540fdfd0 2024-04-25T02:03:16.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.307+0000 7f624affd700 1 -- 172.21.15.77:0/2315060180 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62500113a0 con 0x7f62540fdfd0 2024-04-25T02:03:16.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.307+0000 7f625c3fe700 1 -- 172.21.15.77:0/2315060180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62541135b0 con 0x7f62540fdfd0 2024-04-25T02:03:16.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.308+0000 7f625c3fe700 1 -- 172.21.15.77:0/2315060180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f625404c710 con 0x7f62540fdfd0 2024-04-25T02:03:16.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.308+0000 7f624affd700 1 -- 172.21.15.77:0/2315060180 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f6250012400 con 0x7f62540fdfd0 2024-04-25T02:03:16.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.309+0000 7f624affd700 1 --2- 172.21.15.77:0/2315060180 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f6240069210 0x7f624006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:03:16.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.309+0000 7f624affd700 1 -- 172.21.15.77:0/2315060180 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f6250086450 con 0x7f62540fdfd0 2024-04-25T02:03:16.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.309+0000 7f625a19a700 1 --2- 172.21.15.77:0/2315060180 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f6240069210 0x7f624006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:03:16.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.309+0000 7f625a19a700 1 --2- 172.21.15.77:0/2315060180 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f6240069210 0x7f624006b6c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f624400b970 tx=0x7f6244009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:03:16.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.313+0000 7f624affd700 1 -- 172.21.15.77:0/2315060180 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6250056ee0 con 0x7f62540fdfd0 2024-04-25T02:03:16.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:16.511+0000 7f625c3fe700 1 -- 172.21.15.77:0/2315060180 --> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6254102360 con 0x7f6240069210 2024-04-25T02:03:17.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:17 smithi077 ceph-mon[26330]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T02:03:17.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:17 smithi077 ceph-mon[26330]: from='client.14278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:03:17.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:17 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:03:17.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:17 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:03:17.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:17 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:17.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:17 smithi077 ceph-mon[26330]: Detected new or changed devices on smithi077 2024-04-25T02:03:17.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:17 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:17.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:17 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:17.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:17 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:03:17.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:17 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:03:17.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:17 smithi077 ceph-mon[26330]: Adjusting osd_memory_target on smithi077 to 6432M 2024-04-25T02:03:17.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:17 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:17.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:17 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:17.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:17 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:03:17.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:17 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:17.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:17 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:03:17.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:17 smithi112 ceph-mon[33313]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T02:03:17.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:17 smithi112 ceph-mon[33313]: from='client.14278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:03:17.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:17 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:03:17.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:17 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:03:17.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:17 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:17.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:17 smithi112 ceph-mon[33313]: Detected new or changed devices on smithi077 2024-04-25T02:03:17.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:17 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:17.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:17 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:17.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:17 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:03:17.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:17 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:03:17.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:17 smithi112 ceph-mon[33313]: Adjusting osd_memory_target on smithi077 to 6432M 2024-04-25T02:03:17.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:17 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:17.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:17 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:17.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:17 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:03:17.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:17 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:17.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:17 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:03:19.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:19 smithi077 ceph-mon[26330]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T02:03:19.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:19 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/1796814042' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39b4553c-c1ed-489b-aead-210f38ac86b8"}]: dispatch 2024-04-25T02:03:19.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:19 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/1796814042' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39b4553c-c1ed-489b-aead-210f38ac86b8"}]': finished 2024-04-25T02:03:19.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:19 smithi077 ceph-mon[26330]: osdmap e16: 3 total, 2 up, 3 in 2024-04-25T02:03:19.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:19 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:03:19.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:19 smithi112 ceph-mon[33313]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T02:03:19.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:19 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/1796814042' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39b4553c-c1ed-489b-aead-210f38ac86b8"}]: dispatch 2024-04-25T02:03:19.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:19 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/1796814042' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39b4553c-c1ed-489b-aead-210f38ac86b8"}]': finished 2024-04-25T02:03:19.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:19 smithi112 ceph-mon[33313]: osdmap e16: 3 total, 2 up, 3 in 2024-04-25T02:03:19.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:19 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:03:20.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:20 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/2836802122' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:03:20.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:20 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/2836802122' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:03:21.497 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:21 smithi077 ceph-mon[26330]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T02:03:21.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:21 smithi112 ceph-mon[33313]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T02:03:23.060 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:22 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:23.060 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:22 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:23.060 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:22 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:23.060 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:22 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:03:23.061 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:22 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:23.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:22 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:23.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:22 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:23.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:22 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:23.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:22 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:03:23.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:22 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:23.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:23 smithi077 ceph-mon[26330]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T02:03:24.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:23 smithi112 ceph-mon[33313]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T02:03:25.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:25 smithi077 ceph-mon[26330]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T02:03:26.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:25 smithi112 ceph-mon[33313]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T02:03:26.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:26 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-25T02:03:26.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:26 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:27.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:26 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-25T02:03:27.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:26 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:28.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:27 smithi077 ceph-mon[26330]: Deploying daemon osd.2 on smithi077 2024-04-25T02:03:28.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:27 smithi077 ceph-mon[26330]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T02:03:28.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:27 smithi112 ceph-mon[33313]: Deploying daemon osd.2 on smithi077 2024-04-25T02:03:28.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:27 smithi112 ceph-mon[33313]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T02:03:29.976 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:29 smithi077 ceph-mon[26330]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T02:03:30.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:29 smithi112 ceph-mon[33313]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T02:03:30.872 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:30 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:03:31.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:30 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:03:32.137 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:31 smithi077 ceph-mon[26330]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T02:03:32.138 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:03:32.138 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:32.138 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:32.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:31 smithi112 ceph-mon[33313]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T02:03:32.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:31 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:03:32.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:31 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:32.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:31 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:34.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:34.111+0000 7f624affd700 1 -- 172.21.15.77:0/2315060180 <== mgr.14208 v2:172.21.15.77:6800/310739264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6254102360 con 0x7f6240069210 2024-04-25T02:03:34.117 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:33 smithi077 ceph-mon[26330]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T02:03:34.117 INFO:teuthology.orchestra.run.smithi077.stdout:Created osd(s) 2 on host 'smithi077' 2024-04-25T02:03:34.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:34.113+0000 7f625c3fe700 1 -- 172.21.15.77:0/2315060180 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f6240069210 msgr2=0x7f624006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:03:34.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:34.113+0000 7f625c3fe700 1 --2- 172.21.15.77:0/2315060180 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f6240069210 0x7f624006b6c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f624400b970 tx=0x7f6244009e30 comp rx=0 tx=0).stop 2024-04-25T02:03:34.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:34.113+0000 7f625c3fe700 1 -- 172.21.15.77:0/2315060180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62540fdfd0 msgr2=0x7f625410de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:03:34.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:34.113+0000 7f625c3fe700 1 --2- 172.21.15.77:0/2315060180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62540fdfd0 0x7f625410de50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f625000c830 tx=0x7f6250004470 comp rx=0 tx=0).stop 2024-04-25T02:03:34.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:34.113+0000 7f625c3fe700 1 -- 172.21.15.77:0/2315060180 shutdown_connections 2024-04-25T02:03:34.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:34.113+0000 7f625c3fe700 1 --2- 172.21.15.77:0/2315060180 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f6240069210 0x7f624006b6c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:34.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:34.113+0000 7f625c3fe700 1 --2- 172.21.15.77:0/2315060180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62540fce60 0x7f625410d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:34.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:34.113+0000 7f625c3fe700 1 --2- 172.21.15.77:0/2315060180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62540fdfd0 0x7f625410de50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:34.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:34.113+0000 7f625c3fe700 1 -- 172.21.15.77:0/2315060180 >> 172.21.15.77:0/2315060180 conn(0x7f62540f8540 msgr2=0x7f62540f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:03:34.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:34.114+0000 7f625c3fe700 1 -- 172.21.15.77:0/2315060180 shutdown_connections 2024-04-25T02:03:34.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:03:34.114+0000 7f625c3fe700 1 -- 172.21.15.77:0/2315060180 wait complete. 2024-04-25T02:03:34.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:33 smithi112 ceph-mon[33313]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T02:03:34.963 DEBUG:teuthology.orchestra.run.smithi077:osd.2> sudo journalctl -f -n 0 -u ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.2.service 2024-04-25T02:03:34.965 INFO:tasks.cephadm:Deploying osd.3 on smithi112 with /dev/vg_nvme/lv_4... 2024-04-25T02:03:34.965 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-25T02:03:35.225 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi112/config 2024-04-25T02:03:35.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:35 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:35.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:35 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:35.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:35 smithi077 ceph-mon[26330]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T02:03:35.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:35 smithi077 ceph-mon[26330]: from='osd.2 [v2:172.21.15.77:6818/625070655,v1:172.21.15.77:6819/625070655]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T02:03:35.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:35 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:35.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:35 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:35.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:35 smithi112 ceph-mon[33313]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T02:03:35.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:35 smithi112 ceph-mon[33313]: from='osd.2 [v2:172.21.15.77:6818/625070655,v1:172.21.15.77:6819/625070655]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T02:03:36.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:36 smithi077 ceph-mon[26330]: from='osd.2 [v2:172.21.15.77:6818/625070655,v1:172.21.15.77:6819/625070655]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-25T02:03:36.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:36 smithi077 ceph-mon[26330]: osdmap e17: 3 total, 2 up, 3 in 2024-04-25T02:03:36.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:36 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:03:36.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:36 smithi077 ceph-mon[26330]: from='osd.2 [v2:172.21.15.77:6818/625070655,v1:172.21.15.77:6819/625070655]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-04-25T02:03:36.229 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:03:36 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2[60507]: 2024-04-25T02:03:36.102+0000 7f462afa4700 -1 osd.2 0 waiting for initial osdmap 2024-04-25T02:03:36.229 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:03:36 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2[60507]: 2024-04-25T02:03:36.107+0000 7f462459c700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:03:36.300 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:36 smithi112 ceph-mon[33313]: from='osd.2 [v2:172.21.15.77:6818/625070655,v1:172.21.15.77:6819/625070655]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-25T02:03:36.300 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:36 smithi112 ceph-mon[33313]: osdmap e17: 3 total, 2 up, 3 in 2024-04-25T02:03:36.300 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:36 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:03:36.300 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:36 smithi112 ceph-mon[33313]: from='osd.2 [v2:172.21.15.77:6818/625070655,v1:172.21.15.77:6819/625070655]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-04-25T02:03:37.179 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-25T02:03:37.179 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-25T02:03:37.179 INFO:teuthology.orchestra.run.smithi112.stderr: stderr: 10+0 records in 2024-04-25T02:03:37.179 INFO:teuthology.orchestra.run.smithi112.stderr:10+0 records out 2024-04-25T02:03:37.179 INFO:teuthology.orchestra.run.smithi112.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0115231 s, 910 MB/s 2024-04-25T02:03:37.179 INFO:teuthology.orchestra.run.smithi112.stderr: stderr: 2024-04-25T02:03:37.179 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping successful for: 2024-04-25T02:03:37.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:37 smithi112 ceph-mon[33313]: from='osd.2 [v2:172.21.15.77:6818/625070655,v1:172.21.15.77:6819/625070655]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-04-25T02:03:37.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:37 smithi112 ceph-mon[33313]: osdmap e18: 3 total, 2 up, 3 in 2024-04-25T02:03:37.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:37 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:03:37.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:37 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:03:37.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:37 smithi112 ceph-mon[33313]: pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T02:03:37.298 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:37 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:37.298 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:37 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:37.298 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:37 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:03:37.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:37 smithi077 ceph-mon[26330]: from='osd.2 [v2:172.21.15.77:6818/625070655,v1:172.21.15.77:6819/625070655]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-04-25T02:03:37.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:37 smithi077 ceph-mon[26330]: osdmap e18: 3 total, 2 up, 3 in 2024-04-25T02:03:37.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:37 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:03:37.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:37 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:03:37.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:37 smithi077 ceph-mon[26330]: pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T02:03:37.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:37 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:37.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:37 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:37.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:37 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:03:37.856 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi112:vg_nvme/lv_4 2024-04-25T02:03:38.108 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi112/config 2024-04-25T02:03:38.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:38 smithi112 ceph-mon[33313]: purged_snaps scrub starts 2024-04-25T02:03:38.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:38 smithi112 ceph-mon[33313]: purged_snaps scrub ok 2024-04-25T02:03:38.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:38 smithi112 ceph-mon[33313]: osd.2 [v2:172.21.15.77:6818/625070655,v1:172.21.15.77:6819/625070655] boot 2024-04-25T02:03:38.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:38 smithi112 ceph-mon[33313]: osdmap e19: 3 total, 3 up, 3 in 2024-04-25T02:03:38.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:38 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:03:38.476 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:38 smithi077 ceph-mon[26330]: purged_snaps scrub starts 2024-04-25T02:03:38.476 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:38 smithi077 ceph-mon[26330]: purged_snaps scrub ok 2024-04-25T02:03:38.476 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:38 smithi077 ceph-mon[26330]: osd.2 [v2:172.21.15.77:6818/625070655,v1:172.21.15.77:6819/625070655] boot 2024-04-25T02:03:38.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:38 smithi077 ceph-mon[26330]: osdmap e19: 3 total, 3 up, 3 in 2024-04-25T02:03:38.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:38 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:03:39.386 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:39 smithi077 ceph-mon[26330]: osdmap e20: 3 total, 3 up, 3 in 2024-04-25T02:03:39.387 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:39 smithi077 ceph-mon[26330]: pgmap v72: 0 pgs: ; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-25T02:03:39.387 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:39 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-04-25T02:03:39.466 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:39 smithi112 ceph-mon[33313]: osdmap e20: 3 total, 3 up, 3 in 2024-04-25T02:03:39.466 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:39 smithi112 ceph-mon[33313]: pgmap v72: 0 pgs: ; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-25T02:03:39.466 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:39 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-04-25T02:03:39.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.560+0000 7fa3207ab700 1 -- 172.21.15.112:0/4042353635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa318102360 msgr2=0x7fa318104740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:03:39.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.560+0000 7fa3207ab700 1 --2- 172.21.15.112:0/4042353635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa318102360 0x7fa318104740 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fa308004970 tx=0x7fa308009e30 comp rx=0 tx=0).stop 2024-04-25T02:03:39.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.560+0000 7fa3207ab700 1 -- 172.21.15.112:0/4042353635 shutdown_connections 2024-04-25T02:03:39.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.560+0000 7fa3207ab700 1 --2- 172.21.15.112:0/4042353635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa318102360 0x7fa318104740 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:39.567 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.560+0000 7fa3207ab700 1 --2- 172.21.15.112:0/4042353635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa318066240 0x7fa318101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:39.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.560+0000 7fa3207ab700 1 -- 172.21.15.112:0/4042353635 >> 172.21.15.112:0/4042353635 conn(0x7fa3180f7430 msgr2=0x7fa3180f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:03:39.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.560+0000 7fa3207ab700 1 -- 172.21.15.112:0/4042353635 shutdown_connections 2024-04-25T02:03:39.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.560+0000 7fa3207ab700 1 -- 172.21.15.112:0/4042353635 wait complete. 2024-04-25T02:03:39.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.561+0000 7fa3207ab700 1 Processor -- start 2024-04-25T02:03:39.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.561+0000 7fa3207ab700 1 -- start start 2024-04-25T02:03:39.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.561+0000 7fa3207ab700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa318066240 0x7fa31810fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:03:39.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.561+0000 7fa3207ab700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa318102360 0x7fa3181100f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:03:39.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.561+0000 7fa3207ab700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3181106f0 con 0x7fa318066240 2024-04-25T02:03:39.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.561+0000 7fa3207ab700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa318110f40 con 0x7fa318102360 2024-04-25T02:03:39.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.561+0000 7fa31dd46700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa318102360 0x7fa3181100f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:03:39.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.561+0000 7fa31dd46700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa318102360 0x7fa3181100f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35560/0 (socket says 172.21.15.112:35560) 2024-04-25T02:03:39.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.561+0000 7fa31dd46700 1 -- 172.21.15.112:0/1574481072 learned_addr learned my addr 172.21.15.112:0/1574481072 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T02:03:39.568 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.561+0000 7fa31e547700 1 --2- 172.21.15.112:0/1574481072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa318066240 0x7fa31810fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:03:39.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.561+0000 7fa31dd46700 1 -- 172.21.15.112:0/1574481072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa318066240 msgr2=0x7fa31810fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:03:39.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.561+0000 7fa31dd46700 1 --2- 172.21.15.112:0/1574481072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa318066240 0x7fa31810fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:39.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.561+0000 7fa31dd46700 1 -- 172.21.15.112:0/1574481072 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa308005040 con 0x7fa318102360 2024-04-25T02:03:39.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.561+0000 7fa31dd46700 1 --2- 172.21.15.112:0/1574481072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa318102360 0x7fa3181100f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa308005010 tx=0x7fa308009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:03:39.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.561+0000 7fa30effd700 1 -- 172.21.15.112:0/1574481072 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa30800e040 con 0x7fa318102360 2024-04-25T02:03:39.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.561+0000 7fa30effd700 1 -- 172.21.15.112:0/1574481072 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa30800be70 con 0x7fa318102360 2024-04-25T02:03:39.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.562+0000 7fa3207ab700 1 -- 172.21.15.112:0/1574481072 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3181111c0 con 0x7fa318102360 2024-04-25T02:03:39.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.562+0000 7fa30effd700 1 -- 172.21.15.112:0/1574481072 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa30801c630 con 0x7fa318102360 2024-04-25T02:03:39.569 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.562+0000 7fa3207ab700 1 -- 172.21.15.112:0/1574481072 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa318111700 con 0x7fa318102360 2024-04-25T02:03:39.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.563+0000 7fa3207ab700 1 -- 172.21.15.112:0/1574481072 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa31805f5c0 con 0x7fa318102360 2024-04-25T02:03:39.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.563+0000 7fa30effd700 1 -- 172.21.15.112:0/1574481072 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7fa308013420 con 0x7fa318102360 2024-04-25T02:03:39.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.563+0000 7fa30effd700 1 --2- 172.21.15.112:0/1574481072 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fa304069210 0x7fa30406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:03:39.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.563+0000 7fa30effd700 1 -- 172.21.15.112:0/1574481072 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3217+0+0 (secure 0 0 0) 0x7fa308087a80 con 0x7fa318102360 2024-04-25T02:03:39.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.563+0000 7fa31e547700 1 --2- 172.21.15.112:0/1574481072 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fa304069210 0x7fa30406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:03:39.570 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.564+0000 7fa31e547700 1 --2- 172.21.15.112:0/1574481072 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fa304069210 0x7fa30406b6c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa314009b80 tx=0x7fa31400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:03:39.573 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.568+0000 7fa30effd700 1 -- 172.21.15.112:0/1574481072 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa308058280 con 0x7fa318102360 2024-04-25T02:03:39.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:39.761+0000 7fa3207ab700 1 -- 172.21.15.112:0/1574481072 --> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fa318111a80 con 0x7fa304069210 2024-04-25T02:03:40.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:40 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-04-25T02:03:40.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:40 smithi077 ceph-mon[26330]: osdmap e21: 3 total, 3 up, 3 in 2024-04-25T02:03:40.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:40 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T02:03:40.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:40 smithi077 ceph-mon[26330]: from='client.24127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:03:40.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:40 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:03:40.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:40 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:03:40.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:40 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:40.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:40 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:40.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:40 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:40.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:40 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:03:40.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:40 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:03:40.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:40 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:03:40.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:40 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:40.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:40 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:40.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:40 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:03:40.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:40 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:40.411 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:40 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-04-25T02:03:40.411 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:40 smithi112 ceph-mon[33313]: osdmap e21: 3 total, 3 up, 3 in 2024-04-25T02:03:40.411 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:40 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T02:03:40.411 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:40 smithi112 ceph-mon[33313]: from='client.24127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:03:40.411 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:40 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:03:40.411 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:40 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:03:40.411 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:40 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:40.411 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:40 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:40.411 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:40 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:40.411 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:40 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:03:40.412 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:40 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:03:40.412 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:40 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:03:40.412 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:40 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:40.412 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:40 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:40.412 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:40 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:03:40.412 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:40 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:41.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:41 smithi112 ceph-mon[33313]: Detected new or changed devices on smithi077 2024-04-25T02:03:41.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:41 smithi112 ceph-mon[33313]: Adjusting osd_memory_target on smithi077 to 4288M 2024-04-25T02:03:41.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:41 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-25T02:03:41.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:41 smithi112 ceph-mon[33313]: osdmap e22: 3 total, 3 up, 3 in 2024-04-25T02:03:41.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:41 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:03:41.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:41 smithi112 ceph-mon[33313]: pgmap v75: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-25T02:03:41.355 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:03:41 smithi077 sudo[64687]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T02:03:41.355 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:03:41 smithi077 sudo[64687]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T02:03:41.355 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:03:41 smithi077 sudo[64687]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T02:03:41.355 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:03:41 smithi077 sudo[64687]: pam_unix(sudo:session): session closed for user root 2024-04-25T02:03:41.355 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:41 smithi077 ceph-mon[26330]: Detected new or changed devices on smithi077 2024-04-25T02:03:41.355 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:41 smithi077 ceph-mon[26330]: Adjusting osd_memory_target on smithi077 to 4288M 2024-04-25T02:03:41.355 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:41 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-25T02:03:41.355 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:41 smithi077 ceph-mon[26330]: osdmap e22: 3 total, 3 up, 3 in 2024-04-25T02:03:41.355 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:41 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:03:41.356 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:41 smithi077 ceph-mon[26330]: pgmap v75: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-25T02:03:41.619 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:03:41 smithi077 sudo[64722]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T02:03:41.619 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:03:41 smithi077 sudo[64722]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T02:03:41.619 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:03:41 smithi077 sudo[64722]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T02:03:41.619 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:03:41 smithi077 sudo[64722]: pam_unix(sudo:session): session closed for user root 2024-04-25T02:03:41.874 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:03:41 smithi077 sudo[64725]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T02:03:41.874 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:03:41 smithi077 sudo[64725]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T02:03:41.874 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:03:41 smithi077 sudo[64725]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T02:03:41.875 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:03:41 smithi077 sudo[64725]: pam_unix(sudo:session): session closed for user root 2024-04-25T02:03:42.135 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:03:41 smithi077 sudo[64728]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T02:03:42.135 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:03:41 smithi077 sudo[64728]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T02:03:42.135 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:03:41 smithi077 sudo[64728]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T02:03:42.135 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:03:41 smithi077 sudo[64728]: pam_unix(sudo:session): session closed for user root 2024-04-25T02:03:42.136 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:03:42 smithi077 sudo[64731]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T02:03:42.136 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:03:42 smithi077 sudo[64731]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T02:03:42.136 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:03:42 smithi077 sudo[64731]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T02:03:42.136 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:03:42 smithi077 sudo[64731]: pam_unix(sudo:session): session closed for user root 2024-04-25T02:03:42.386 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:03:42 smithi077 sudo[64734]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T02:03:42.386 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:03:42 smithi077 sudo[64734]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T02:03:42.386 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:03:42 smithi077 sudo[64734]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T02:03:42.386 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:03:42 smithi077 sudo[64734]: pam_unix(sudo:session): session closed for user root 2024-04-25T02:03:42.386 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:42 smithi077 ceph-mon[26330]: osdmap e23: 3 total, 3 up, 3 in 2024-04-25T02:03:42.387 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:42 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:42.387 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:42 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:03:42.387 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:42 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:42.387 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:42 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:42.387 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:42 smithi077 ceph-mon[26330]: from='client.? 172.21.15.112:0/2627051466' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "addec0fa-80ee-465d-9d3e-c801d7bd9f4b"}]: dispatch 2024-04-25T02:03:42.387 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:42 smithi077 ceph-mon[26330]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "addec0fa-80ee-465d-9d3e-c801d7bd9f4b"}]: dispatch 2024-04-25T02:03:42.387 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:42 smithi077 ceph-mon[26330]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "addec0fa-80ee-465d-9d3e-c801d7bd9f4b"}]': finished 2024-04-25T02:03:42.387 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:42 smithi077 ceph-mon[26330]: osdmap e24: 4 total, 3 up, 4 in 2024-04-25T02:03:42.387 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:42 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:03:42.528 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:42 smithi112 ceph-mon[33313]: osdmap e23: 3 total, 3 up, 3 in 2024-04-25T02:03:42.528 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:42 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:42.528 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:42 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:03:42.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:42 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:42.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:42 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:42.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:42 smithi112 ceph-mon[33313]: from='client.? 172.21.15.112:0/2627051466' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "addec0fa-80ee-465d-9d3e-c801d7bd9f4b"}]: dispatch 2024-04-25T02:03:42.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:42 smithi112 ceph-mon[33313]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "addec0fa-80ee-465d-9d3e-c801d7bd9f4b"}]: dispatch 2024-04-25T02:03:42.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:42 smithi112 ceph-mon[33313]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "addec0fa-80ee-465d-9d3e-c801d7bd9f4b"}]': finished 2024-04-25T02:03:42.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:42 smithi112 ceph-mon[33313]: osdmap e24: 4 total, 3 up, 4 in 2024-04-25T02:03:42.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:42 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:03:42.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:42 smithi077 sudo[64737]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T02:03:42.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:42 smithi077 sudo[64737]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T02:03:42.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:42 smithi077 sudo[64737]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T02:03:42.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:42 smithi077 sudo[64737]: pam_unix(sudo:session): session closed for user root 2024-04-25T02:03:43.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:42 smithi077 sudo[64740]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T02:03:43.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:42 smithi077 sudo[64740]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T02:03:43.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:42 smithi077 sudo[64740]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T02:03:43.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:42 smithi077 sudo[64740]: pam_unix(sudo:session): session closed for user root 2024-04-25T02:03:43.378 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:43 smithi112 sudo[36921]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T02:03:43.378 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:43 smithi112 sudo[36921]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T02:03:43.378 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:43 smithi112 sudo[36921]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T02:03:43.378 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:43 smithi112 sudo[36921]: pam_unix(sudo:session): session closed for user root 2024-04-25T02:03:43.387 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:43.381+0000 7fa30effd700 1 -- 172.21.15.112:0/1574481072 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fa308054bc0 con 0x7fa318102360 2024-04-25T02:03:43.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:43 smithi077 ceph-mon[26330]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T02:03:43.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:43 smithi077 ceph-mon[26330]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-04-25T02:03:43.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:43 smithi077 ceph-mon[26330]: from='client.? 172.21.15.112:0/384353774' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:03:43.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:43 smithi077 ceph-mon[26330]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T02:03:43.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:43 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-04-25T02:03:43.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:43 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-04-25T02:03:43.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:43 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-04-25T02:03:43.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:43 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-04-25T02:03:43.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:43 smithi112 sudo[36926]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T02:03:43.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:43 smithi112 sudo[36926]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T02:03:43.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:43 smithi112 sudo[36926]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T02:03:43.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:43 smithi112 sudo[36926]: pam_unix(sudo:session): session closed for user root 2024-04-25T02:03:43.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:43 smithi112 ceph-mon[33313]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T02:03:43.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:43 smithi112 ceph-mon[33313]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-04-25T02:03:43.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:43 smithi112 ceph-mon[33313]: from='client.? 172.21.15.112:0/384353774' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:03:43.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:43 smithi112 ceph-mon[33313]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T02:03:43.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:43 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-04-25T02:03:43.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:43 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-04-25T02:03:43.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:43 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-04-25T02:03:43.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:43 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-04-25T02:03:44.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:44 smithi077 ceph-mon[26330]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T02:03:44.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:44 smithi077 ceph-mon[26330]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T02:03:44.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:44 smithi077 ceph-mon[26330]: mgrmap e19: smithi077.zpflzp(active, since 2m), standbys: smithi112.cswrxs 2024-04-25T02:03:44.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:44 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:44.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:44 smithi112 ceph-mon[33313]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T02:03:44.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:44 smithi112 ceph-mon[33313]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T02:03:44.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:44 smithi112 ceph-mon[33313]: mgrmap e19: smithi077.zpflzp(active, since 2m), standbys: smithi112.cswrxs 2024-04-25T02:03:44.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:44 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:45.679 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:45 smithi112 ceph-mon[33313]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-25T02:03:45.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:45 smithi077 ceph-mon[26330]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-25T02:03:46.514 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:46 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:03:46.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:46 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:03:47.528 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:47 smithi112 ceph-mon[33313]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-25T02:03:47.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:47 smithi077 ceph-mon[26330]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-25T02:03:49.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:49 smithi077 ceph-mon[26330]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-04-25T02:03:49.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:49 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-25T02:03:49.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:49 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:49.736 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:49 smithi112 ceph-mon[33313]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-04-25T02:03:49.736 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:49 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-25T02:03:49.736 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:49 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:50.642 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:50 smithi112 ceph-mon[33313]: Deploying daemon osd.3 on smithi112 2024-04-25T02:03:50.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:50 smithi077 ceph-mon[26330]: Deploying daemon osd.3 on smithi112 2024-04-25T02:03:51.616 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:51 smithi112 ceph-mon[33313]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-04-25T02:03:51.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:51 smithi077 ceph-mon[26330]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-04-25T02:03:53.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:53 smithi077 ceph-mon[26330]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-25T02:03:53.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:53 smithi112 ceph-mon[33313]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-25T02:03:55.720 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:55.720 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:55.720 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:03:55.720 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:55 smithi112 ceph-mon[33313]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-25T02:03:55.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:55 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:55.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:55 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:55.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:55 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:03:55.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:55 smithi077 ceph-mon[26330]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-25T02:03:57.033 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:57.027+0000 7fa30effd700 1 -- 172.21.15.112:0/1574481072 <== mgr.14208 v2:172.21.15.77:6800/310739264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa318111a80 con 0x7fa304069210 2024-04-25T02:03:57.033 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 3 on host 'smithi112' 2024-04-25T02:03:57.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:57.029+0000 7fa3207ab700 1 -- 172.21.15.112:0/1574481072 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fa304069210 msgr2=0x7fa30406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:03:57.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:57.029+0000 7fa3207ab700 1 --2- 172.21.15.112:0/1574481072 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fa304069210 0x7fa30406b6c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa314009b80 tx=0x7fa31400b040 comp rx=0 tx=0).stop 2024-04-25T02:03:57.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:57.030+0000 7fa3207ab700 1 -- 172.21.15.112:0/1574481072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa318102360 msgr2=0x7fa3181100f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:03:57.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:57.030+0000 7fa3207ab700 1 --2- 172.21.15.112:0/1574481072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa318102360 0x7fa3181100f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa308005010 tx=0x7fa308009e30 comp rx=0 tx=0).stop 2024-04-25T02:03:57.035 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:57.030+0000 7fa3207ab700 1 -- 172.21.15.112:0/1574481072 shutdown_connections 2024-04-25T02:03:57.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:57.030+0000 7fa3207ab700 1 --2- 172.21.15.112:0/1574481072 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fa304069210 0x7fa30406b6c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:57.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:57.030+0000 7fa3207ab700 1 --2- 172.21.15.112:0/1574481072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa318066240 0x7fa31810fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:57.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:57.030+0000 7fa3207ab700 1 --2- 172.21.15.112:0/1574481072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa318102360 0x7fa3181100f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:57.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:57.030+0000 7fa3207ab700 1 -- 172.21.15.112:0/1574481072 >> 172.21.15.112:0/1574481072 conn(0x7fa3180f7430 msgr2=0x7fa3180f9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:03:57.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:57.030+0000 7fa3207ab700 1 -- 172.21.15.112:0/1574481072 shutdown_connections 2024-04-25T02:03:57.036 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:03:57.030+0000 7fa3207ab700 1 -- 172.21.15.112:0/1574481072 wait complete. 2024-04-25T02:03:57.722 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:57 smithi112 ceph-mon[33313]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-25T02:03:57.723 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:57 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:57.723 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:57 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:57.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:57 smithi077 ceph-mon[26330]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-25T02:03:57.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:57 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:57.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:57 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:03:58.014 DEBUG:teuthology.orchestra.run.smithi112:osd.3> sudo journalctl -f -n 0 -u ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.3.service 2024-04-25T02:03:58.016 INFO:tasks.cephadm:Deploying osd.4 on smithi112 with /dev/vg_nvme/lv_3... 2024-04-25T02:03:58.016 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-25T02:03:58.528 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:58 smithi112 ceph-mon[33313]: from='osd.3 [v2:172.21.15.112:6800/36251324,v1:172.21.15.112:6801/36251324]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T02:03:58.528 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:58 smithi112 ceph-mon[33313]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T02:03:58.529 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:03:58 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3[38886]: 2024-04-25T02:03:58.236+0000 7f60f4fe2540 -1 osd.3 0 log_to_monitors true 2024-04-25T02:03:58.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:58 smithi077 ceph-mon[26330]: from='osd.3 [v2:172.21.15.112:6800/36251324,v1:172.21.15.112:6801/36251324]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T02:03:58.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:58 smithi077 ceph-mon[26330]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T02:03:58.846 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi112/config 2024-04-25T02:03:59.641 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:03:59 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3[38886]: 2024-04-25T02:03:59.478+0000 7f60ecfb7700 -1 osd.3 0 waiting for initial osdmap 2024-04-25T02:03:59.641 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:03:59 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3[38886]: 2024-04-25T02:03:59.483+0000 7f60e4dac700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:03:59.641 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:59 smithi112 ceph-mon[33313]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-25T02:03:59.641 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:59 smithi112 ceph-mon[33313]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-25T02:03:59.641 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:59 smithi112 ceph-mon[33313]: osdmap e25: 4 total, 3 up, 4 in 2024-04-25T02:03:59.642 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:59 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:03:59.642 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:59 smithi112 ceph-mon[33313]: from='osd.3 [v2:172.21.15.112:6800/36251324,v1:172.21.15.112:6801/36251324]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T02:03:59.642 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:03:59 smithi112 ceph-mon[33313]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T02:03:59.891 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:59 smithi077 ceph-mon[26330]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-25T02:03:59.891 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:59 smithi077 ceph-mon[26330]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-25T02:03:59.891 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:59 smithi077 ceph-mon[26330]: osdmap e25: 4 total, 3 up, 4 in 2024-04-25T02:03:59.891 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:59 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:03:59.892 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:59 smithi077 ceph-mon[26330]: from='osd.3 [v2:172.21.15.112:6800/36251324,v1:172.21.15.112:6801/36251324]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T02:03:59.892 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:03:59 smithi077 ceph-mon[26330]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T02:04:00.481 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:00 smithi112 ceph-mon[33313]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-04-25T02:04:00.481 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:00 smithi112 ceph-mon[33313]: osdmap e26: 4 total, 3 up, 4 in 2024-04-25T02:04:00.481 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:00 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:04:00.481 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:00 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:04:00.481 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:00 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:00.481 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:00 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:00.481 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:00 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:04:00.481 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:00 smithi112 ceph-mon[33313]: osd.3 [v2:172.21.15.112:6800/36251324,v1:172.21.15.112:6801/36251324] boot 2024-04-25T02:04:00.481 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:00 smithi112 ceph-mon[33313]: osdmap e27: 4 total, 4 up, 4 in 2024-04-25T02:04:00.481 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:00 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:04:00.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:00 smithi077 ceph-mon[26330]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-04-25T02:04:00.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:00 smithi077 ceph-mon[26330]: osdmap e26: 4 total, 3 up, 4 in 2024-04-25T02:04:00.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:00 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:04:00.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:00 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:04:00.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:00 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:00.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:00 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:00.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:00 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:04:00.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:00 smithi077 ceph-mon[26330]: osd.3 [v2:172.21.15.112:6800/36251324,v1:172.21.15.112:6801/36251324] boot 2024-04-25T02:04:00.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:00 smithi077 ceph-mon[26330]: osdmap e27: 4 total, 4 up, 4 in 2024-04-25T02:04:00.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:00 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:04:00.763 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-25T02:04:00.764 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-25T02:04:00.764 INFO:teuthology.orchestra.run.smithi112.stderr: stderr: 10+0 records in 2024-04-25T02:04:00.764 INFO:teuthology.orchestra.run.smithi112.stderr:10+0 records out 2024-04-25T02:04:00.764 INFO:teuthology.orchestra.run.smithi112.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0134846 s, 778 MB/s 2024-04-25T02:04:00.764 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping successful for: 2024-04-25T02:04:01.888 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:01 smithi112 ceph-mon[33313]: purged_snaps scrub starts 2024-04-25T02:04:01.889 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:01 smithi112 ceph-mon[33313]: purged_snaps scrub ok 2024-04-25T02:04:01.889 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:01 smithi112 ceph-mon[33313]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-25T02:04:01.889 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:01 smithi112 ceph-mon[33313]: osdmap e28: 4 total, 4 up, 4 in 2024-04-25T02:04:02.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:01 smithi077 ceph-mon[26330]: purged_snaps scrub starts 2024-04-25T02:04:02.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:01 smithi077 ceph-mon[26330]: purged_snaps scrub ok 2024-04-25T02:04:02.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:01 smithi077 ceph-mon[26330]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-25T02:04:02.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:01 smithi077 ceph-mon[26330]: osdmap e28: 4 total, 4 up, 4 in 2024-04-25T02:04:02.235 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi112:vg_nvme/lv_3 2024-04-25T02:04:02.728 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi112/config 2024-04-25T02:04:03.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:02 smithi112 ceph-mon[33313]: osdmap e29: 4 total, 4 up, 4 in 2024-04-25T02:04:03.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:02 smithi077 ceph-mon[26330]: osdmap e29: 4 total, 4 up, 4 in 2024-04-25T02:04:04.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:03 smithi112 ceph-mon[33313]: pgmap v93: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-04-25T02:04:04.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:03 smithi112 ceph-mon[33313]: osdmap e30: 4 total, 4 up, 4 in 2024-04-25T02:04:04.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:03 smithi077 ceph-mon[26330]: pgmap v93: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-04-25T02:04:04.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:03 smithi077 ceph-mon[26330]: osdmap e30: 4 total, 4 up, 4 in 2024-04-25T02:04:05.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.000+0000 7f1671101700 1 -- 172.21.15.112:0/2974349130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f166c0fdfd0 msgr2=0x7f166c0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:05.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.000+0000 7f1671101700 1 --2- 172.21.15.112:0/2974349130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f166c0fdfd0 0x7f166c0fe440 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f165c004940 tx=0x7f165c009e30 comp rx=0 tx=0).stop 2024-04-25T02:04:05.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.000+0000 7f1671101700 1 -- 172.21.15.112:0/2974349130 shutdown_connections 2024-04-25T02:04:05.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.000+0000 7f1671101700 1 --2- 172.21.15.112:0/2974349130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f166c0fdfd0 0x7f166c0fe440 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:05.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.000+0000 7f1671101700 1 --2- 172.21.15.112:0/2974349130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f166c0fce60 0x7f166c0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:05.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.000+0000 7f1671101700 1 -- 172.21.15.112:0/2974349130 >> 172.21.15.112:0/2974349130 conn(0x7f166c0f8540 msgr2=0x7f166c0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:04:05.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.000+0000 7f1671101700 1 -- 172.21.15.112:0/2974349130 shutdown_connections 2024-04-25T02:04:05.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.000+0000 7f1671101700 1 -- 172.21.15.112:0/2974349130 wait complete. 2024-04-25T02:04:05.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.001+0000 7f1671101700 1 Processor -- start 2024-04-25T02:04:05.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.001+0000 7f1671101700 1 -- start start 2024-04-25T02:04:05.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.001+0000 7f1671101700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f166c0fce60 0x7f166c10d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:04:05.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.001+0000 7f1671101700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f166c0fdfd0 0x7f166c10de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:04:05.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.001+0000 7f1671101700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166c10e500 con 0x7f166c0fdfd0 2024-04-25T02:04:05.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.001+0000 7f1671101700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166c112ea0 con 0x7f166c0fce60 2024-04-25T02:04:05.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.001+0000 7f166ad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f166c0fce60 0x7f166c10d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:04:05.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.001+0000 7f166ad9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f166c0fce60 0x7f166c10d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:48646/0 (socket says 172.21.15.112:48646) 2024-04-25T02:04:05.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.001+0000 7f166ad9d700 1 -- 172.21.15.112:0/821430173 learned_addr learned my addr 172.21.15.112:0/821430173 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T02:04:05.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.001+0000 7f166a59c700 1 --2- 172.21.15.112:0/821430173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f166c0fdfd0 0x7f166c10de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:04:05.008 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.001+0000 7f166ad9d700 1 -- 172.21.15.112:0/821430173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f166c0fdfd0 msgr2=0x7f166c10de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:05.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.001+0000 7f166ad9d700 1 --2- 172.21.15.112:0/821430173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f166c0fdfd0 0x7f166c10de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:05.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.001+0000 7f166ad9d700 1 -- 172.21.15.112:0/821430173 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165c005040 con 0x7f166c0fce60 2024-04-25T02:04:05.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.001+0000 7f166ad9d700 1 --2- 172.21.15.112:0/821430173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f166c0fce60 0x7f166c10d930 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f166000b790 tx=0x7f1660009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:04:05.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.002+0000 7f16537fe700 1 -- 172.21.15.112:0/821430173 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f166000f770 con 0x7f166c0fce60 2024-04-25T02:04:05.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.002+0000 7f16537fe700 1 -- 172.21.15.112:0/821430173 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f166000fda0 con 0x7f166c0fce60 2024-04-25T02:04:05.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.002+0000 7f1671101700 1 -- 172.21.15.112:0/821430173 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f166c113100 con 0x7f166c0fce60 2024-04-25T02:04:05.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.002+0000 7f16537fe700 1 -- 172.21.15.112:0/821430173 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f166000d310 con 0x7f166c0fce60 2024-04-25T02:04:05.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.002+0000 7f1671101700 1 -- 172.21.15.112:0/821430173 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f166c113670 con 0x7f166c0fce60 2024-04-25T02:04:05.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.003+0000 7f1671101700 1 -- 172.21.15.112:0/821430173 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f166c04c710 con 0x7f166c0fce60 2024-04-25T02:04:05.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.003+0000 7f16537fe700 1 -- 172.21.15.112:0/821430173 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f1660010420 con 0x7f166c0fce60 2024-04-25T02:04:05.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.003+0000 7f16537fe700 1 --2- 172.21.15.112:0/821430173 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f16540692a0 0x7f165406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:04:05.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.004+0000 7f16537fe700 1 -- 172.21.15.112:0/821430173 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3770+0+0 (secure 0 0 0) 0x7f1660086b20 con 0x7f166c0fce60 2024-04-25T02:04:05.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.004+0000 7f166a59c700 1 --2- 172.21.15.112:0/821430173 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f16540692a0 0x7f165406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:04:05.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.004+0000 7f166a59c700 1 --2- 172.21.15.112:0/821430173 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f16540692a0 0x7f165406b750 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f165c000c00 tx=0x7f165c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:04:05.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.008+0000 7f16537fe700 1 -- 172.21.15.112:0/821430173 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1660056f80 con 0x7f166c0fce60 2024-04-25T02:04:05.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:04 smithi112 ceph-mon[33313]: osdmap e31: 4 total, 4 up, 4 in 2024-04-25T02:04:05.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:04 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:05.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:04 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:05.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:04 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:05.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:04 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:05.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:04 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:05.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:04 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:05.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:04 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:05.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:04 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:04:05.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:04 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:05.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:04 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:05.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:04 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:05.206 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:05.201+0000 7f1671101700 1 -- 172.21.15.112:0/821430173 --> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f166c1138f0 con 0x7f16540692a0 2024-04-25T02:04:05.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:04 smithi077 ceph-mon[26330]: osdmap e31: 4 total, 4 up, 4 in 2024-04-25T02:04:05.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:04 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:05.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:04 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:05.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:04 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:05.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:04 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:05.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:04 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:05.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:04 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:05.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:04 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:05.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:04 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:04:05.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:04 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:05.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:04 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:05.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:04 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:05.893 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:05 smithi112 ceph-mon[33313]: pgmap v96: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-04-25T02:04:05.894 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:05 smithi112 ceph-mon[33313]: Detected new or changed devices on smithi112 2024-04-25T02:04:05.894 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:05 smithi112 ceph-mon[33313]: Adjusting osd_memory_target on smithi112 to 15936M 2024-04-25T02:04:05.894 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:05 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:04:05.894 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:05 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:04:05.894 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:05 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:06.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:05 smithi077 ceph-mon[26330]: pgmap v96: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-04-25T02:04:06.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:05 smithi077 ceph-mon[26330]: Detected new or changed devices on smithi112 2024-04-25T02:04:06.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:05 smithi077 ceph-mon[26330]: Adjusting osd_memory_target on smithi112 to 15936M 2024-04-25T02:04:06.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:05 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:04:06.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:05 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:04:06.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:05 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:06.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:06 smithi112 ceph-mon[33313]: from='client.24147 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:04:07.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:06 smithi077 ceph-mon[26330]: from='client.24147 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:04:08.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:07 smithi077 ceph-mon[26330]: pgmap v97: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-04-25T02:04:08.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:07 smithi077 ceph-mon[26330]: from='client.? 172.21.15.112:0/2110036555' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93465def-0617-4ba8-915a-b3ea85c8f6d1"}]: dispatch 2024-04-25T02:04:08.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:07 smithi077 ceph-mon[26330]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93465def-0617-4ba8-915a-b3ea85c8f6d1"}]: dispatch 2024-04-25T02:04:08.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:07 smithi077 ceph-mon[26330]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "93465def-0617-4ba8-915a-b3ea85c8f6d1"}]': finished 2024-04-25T02:04:08.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:07 smithi077 ceph-mon[26330]: osdmap e32: 5 total, 4 up, 5 in 2024-04-25T02:04:08.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:07 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:04:08.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:07 smithi112 ceph-mon[33313]: pgmap v97: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-04-25T02:04:08.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:07 smithi112 ceph-mon[33313]: from='client.? 172.21.15.112:0/2110036555' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93465def-0617-4ba8-915a-b3ea85c8f6d1"}]: dispatch 2024-04-25T02:04:08.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:07 smithi112 ceph-mon[33313]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93465def-0617-4ba8-915a-b3ea85c8f6d1"}]: dispatch 2024-04-25T02:04:08.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:07 smithi112 ceph-mon[33313]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "93465def-0617-4ba8-915a-b3ea85c8f6d1"}]': finished 2024-04-25T02:04:08.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:07 smithi112 ceph-mon[33313]: osdmap e32: 5 total, 4 up, 5 in 2024-04-25T02:04:08.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:07 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:04:09.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:08 smithi112 ceph-mon[33313]: from='client.? 172.21.15.112:0/1656016133' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:04:09.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:08 smithi077 ceph-mon[26330]: from='client.? 172.21.15.112:0/1656016133' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:04:10.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:09 smithi077 ceph-mon[26330]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T02:04:10.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:09 smithi112 ceph-mon[33313]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T02:04:11.972 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:11 smithi112 ceph-mon[33313]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T02:04:12.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:11 smithi077 ceph-mon[26330]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T02:04:13.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:13 smithi112 ceph-mon[33313]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T02:04:14.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:13 smithi077 ceph-mon[26330]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T02:04:16.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:15 smithi077 ceph-mon[26330]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T02:04:16.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:15 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-25T02:04:16.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:15 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:16.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:15 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:04:16.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:15 smithi112 ceph-mon[33313]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T02:04:16.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:15 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-25T02:04:16.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:15 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:16.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:15 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:04:17.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:16 smithi112 ceph-mon[33313]: Deploying daemon osd.4 on smithi112 2024-04-25T02:04:17.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:16 smithi077 ceph-mon[26330]: Deploying daemon osd.4 on smithi112 2024-04-25T02:04:18.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:17 smithi112 ceph-mon[33313]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T02:04:18.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:17 smithi077 ceph-mon[26330]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T02:04:20.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:19 smithi112 ceph-mon[33313]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T02:04:20.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:19 smithi077 ceph-mon[26330]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T02:04:21.666 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:21 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:21.667 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:21 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:04:21.667 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:21 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:21.667 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:21 smithi112 ceph-mon[33313]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T02:04:21.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:21 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:21.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:21 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:04:21.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:21 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:21.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:21 smithi077 ceph-mon[26330]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T02:04:23.171 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:23.165+0000 7f16537fe700 1 -- 172.21.15.112:0/821430173 <== mgr.14208 v2:172.21.15.77:6800/310739264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f166c1138f0 con 0x7f16540692a0 2024-04-25T02:04:23.171 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 4 on host 'smithi112' 2024-04-25T02:04:23.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:23.167+0000 7f1671101700 1 -- 172.21.15.112:0/821430173 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f16540692a0 msgr2=0x7f165406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:23.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:23.167+0000 7f1671101700 1 --2- 172.21.15.112:0/821430173 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f16540692a0 0x7f165406b750 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f165c000c00 tx=0x7f165c009e30 comp rx=0 tx=0).stop 2024-04-25T02:04:23.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:23.167+0000 7f1671101700 1 -- 172.21.15.112:0/821430173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f166c0fce60 msgr2=0x7f166c10d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:23.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:23.167+0000 7f1671101700 1 --2- 172.21.15.112:0/821430173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f166c0fce60 0x7f166c10d930 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f166000b790 tx=0x7f1660009250 comp rx=0 tx=0).stop 2024-04-25T02:04:23.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:23.167+0000 7f1671101700 1 -- 172.21.15.112:0/821430173 shutdown_connections 2024-04-25T02:04:23.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:23.167+0000 7f1671101700 1 --2- 172.21.15.112:0/821430173 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f16540692a0 0x7f165406b750 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:23.173 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:23.167+0000 7f1671101700 1 --2- 172.21.15.112:0/821430173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f166c0fce60 0x7f166c10d930 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:23.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:23.167+0000 7f1671101700 1 --2- 172.21.15.112:0/821430173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f166c0fdfd0 0x7f166c10de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:23.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:23.167+0000 7f1671101700 1 -- 172.21.15.112:0/821430173 >> 172.21.15.112:0/821430173 conn(0x7f166c0f8540 msgr2=0x7f166c0f9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:04:23.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:23.167+0000 7f1671101700 1 -- 172.21.15.112:0/821430173 shutdown_connections 2024-04-25T02:04:23.174 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:23.167+0000 7f1671101700 1 -- 172.21.15.112:0/821430173 wait complete. 2024-04-25T02:04:23.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:23 smithi077 ceph-mon[26330]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T02:04:23.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:23 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:23.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:23 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:23.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:23 smithi112 ceph-mon[33313]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T02:04:23.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:23 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:23.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:23 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:24.237 DEBUG:teuthology.orchestra.run.smithi112:osd.4> sudo journalctl -f -n 0 -u ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.4.service 2024-04-25T02:04:24.240 INFO:tasks.cephadm:Deploying osd.5 on smithi112 with /dev/vg_nvme/lv_2... 2024-04-25T02:04:24.240 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-25T02:04:24.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:24 smithi112 ceph-mon[33313]: from='osd.4 [v2:172.21.15.112:6808/581823847,v1:172.21.15.112:6809/581823847]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T02:04:24.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:24 smithi112 ceph-mon[33313]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T02:04:24.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:24 smithi077 ceph-mon[26330]: from='osd.4 [v2:172.21.15.112:6808/581823847,v1:172.21.15.112:6809/581823847]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T02:04:24.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:24 smithi077 ceph-mon[26330]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T02:04:25.039 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi112/config 2024-04-25T02:04:25.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:25 smithi112 ceph-mon[33313]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T02:04:25.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:25 smithi112 ceph-mon[33313]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-25T02:04:25.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:25 smithi112 ceph-mon[33313]: osdmap e33: 5 total, 4 up, 5 in 2024-04-25T02:04:25.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:25 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:04:25.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:25 smithi112 ceph-mon[33313]: from='osd.4 [v2:172.21.15.112:6808/581823847,v1:172.21.15.112:6809/581823847]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T02:04:25.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:25 smithi112 ceph-mon[33313]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T02:04:25.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:25 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:25.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:25 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:25.779 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:04:25 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4[45300]: 2024-04-25T02:04:25.488+0000 7ff2e1f9d700 -1 osd.4 0 waiting for initial osdmap 2024-04-25T02:04:25.779 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:04:25 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4[45300]: 2024-04-25T02:04:25.494+0000 7ff2d9591700 -1 osd.4 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:04:25.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:25 smithi077 ceph-mon[26330]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T02:04:25.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:25 smithi077 ceph-mon[26330]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-25T02:04:25.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:25 smithi077 ceph-mon[26330]: osdmap e33: 5 total, 4 up, 5 in 2024-04-25T02:04:25.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:25 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:04:25.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:25 smithi077 ceph-mon[26330]: from='osd.4 [v2:172.21.15.112:6808/581823847,v1:172.21.15.112:6809/581823847]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T02:04:25.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:25 smithi077 ceph-mon[26330]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T02:04:25.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:25 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:25.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:25 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:26.743 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:26 smithi112 ceph-mon[33313]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-04-25T02:04:26.744 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:26 smithi112 ceph-mon[33313]: osdmap e34: 5 total, 4 up, 5 in 2024-04-25T02:04:26.744 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:26 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:04:26.744 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:26 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:04:26.744 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:26 smithi112 ceph-mon[33313]: osd.4 [v2:172.21.15.112:6808/581823847,v1:172.21.15.112:6809/581823847] boot 2024-04-25T02:04:26.744 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:26 smithi112 ceph-mon[33313]: osdmap e35: 5 total, 5 up, 5 in 2024-04-25T02:04:26.744 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:26 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:04:26.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:26 smithi077 ceph-mon[26330]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-04-25T02:04:26.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:26 smithi077 ceph-mon[26330]: osdmap e34: 5 total, 4 up, 5 in 2024-04-25T02:04:26.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:26 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:04:26.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:26 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:04:26.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:26 smithi077 ceph-mon[26330]: osd.4 [v2:172.21.15.112:6808/581823847,v1:172.21.15.112:6809/581823847] boot 2024-04-25T02:04:26.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:26 smithi077 ceph-mon[26330]: osdmap e35: 5 total, 5 up, 5 in 2024-04-25T02:04:26.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:26 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:04:27.277 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-25T02:04:27.277 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-25T02:04:27.278 INFO:teuthology.orchestra.run.smithi112.stderr: stderr: 10+0 records in 2024-04-25T02:04:27.278 INFO:teuthology.orchestra.run.smithi112.stderr:10+0 records out 2024-04-25T02:04:27.278 INFO:teuthology.orchestra.run.smithi112.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0133268 s, 787 MB/s 2024-04-25T02:04:27.278 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping successful for: 2024-04-25T02:04:27.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:27 smithi112 ceph-mon[33313]: purged_snaps scrub starts 2024-04-25T02:04:27.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:27 smithi112 ceph-mon[33313]: purged_snaps scrub ok 2024-04-25T02:04:27.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:27 smithi112 ceph-mon[33313]: pgmap v110: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T02:04:27.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:27 smithi077 ceph-mon[26330]: purged_snaps scrub starts 2024-04-25T02:04:27.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:27 smithi077 ceph-mon[26330]: purged_snaps scrub ok 2024-04-25T02:04:27.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:27 smithi077 ceph-mon[26330]: pgmap v110: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T02:04:28.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:28 smithi112 ceph-mon[33313]: osdmap e36: 5 total, 5 up, 5 in 2024-04-25T02:04:28.937 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi112:vg_nvme/lv_2 2024-04-25T02:04:28.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:28 smithi077 ceph-mon[26330]: osdmap e36: 5 total, 5 up, 5 in 2024-04-25T02:04:29.599 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:29 smithi112 ceph-mon[33313]: pgmap v113: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T02:04:29.704 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi112/config 2024-04-25T02:04:29.891 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:29 smithi077 ceph-mon[26330]: pgmap v113: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T02:04:30.764 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:30 smithi112 ceph-mon[33313]: Detected new or changed devices on smithi112 2024-04-25T02:04:30.765 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:30 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:30.765 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:30 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:30.765 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:30 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:30.765 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:30 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:30.765 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:30 smithi112 ceph-mon[33313]: Adjusting osd_memory_target on smithi112 to 7968M 2024-04-25T02:04:30.765 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:30 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:30.765 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:30 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:30.765 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:30 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:30.765 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:30 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:30.765 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:30 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:04:30.765 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:30 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:30.765 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:30 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:30.765 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:30 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:30.765 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:30 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:04:30.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:30 smithi077 ceph-mon[26330]: Detected new or changed devices on smithi112 2024-04-25T02:04:30.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:30 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:30.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:30 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:30.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:30 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:30.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:30 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:30.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:30 smithi077 ceph-mon[26330]: Adjusting osd_memory_target on smithi112 to 7968M 2024-04-25T02:04:30.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:30 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:30.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:30 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:30.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:30 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:30.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:30 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:30.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:30 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:04:30.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:30 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:30.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:30 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:30.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:30 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:30.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:30 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:04:31.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.295+0000 7f88626cc700 1 -- 172.21.15.112:0/3231205271 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f885c0fce80 msgr2=0x7f885c0fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:31.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.295+0000 7f88626cc700 1 --2- 172.21.15.112:0/3231205271 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f885c0fce80 0x7f885c0fd290 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8850004940 tx=0x7f8850009e30 comp rx=0 tx=0).stop 2024-04-25T02:04:31.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.295+0000 7f88626cc700 1 -- 172.21.15.112:0/3231205271 shutdown_connections 2024-04-25T02:04:31.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.295+0000 7f88626cc700 1 --2- 172.21.15.112:0/3231205271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f885c0fe080 0x7f885c0fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:31.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.295+0000 7f88626cc700 1 --2- 172.21.15.112:0/3231205271 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f885c0fce80 0x7f885c0fd290 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:31.309 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.295+0000 7f88626cc700 1 -- 172.21.15.112:0/3231205271 >> 172.21.15.112:0/3231205271 conn(0x7f885c0f8590 msgr2=0x7f885c0fa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:04:31.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.295+0000 7f88626cc700 1 -- 172.21.15.112:0/3231205271 shutdown_connections 2024-04-25T02:04:31.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.295+0000 7f88626cc700 1 -- 172.21.15.112:0/3231205271 wait complete. 2024-04-25T02:04:31.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.296+0000 7f88626cc700 1 Processor -- start 2024-04-25T02:04:31.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.296+0000 7f88626cc700 1 -- start start 2024-04-25T02:04:31.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.296+0000 7f88626cc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f885c0fce80 0x7f885c10da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:04:31.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.296+0000 7f88626cc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f885c0fe080 0x7f885c10df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:04:31.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.296+0000 7f88626cc700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c10e610 con 0x7f885c0fce80 2024-04-25T02:04:31.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.296+0000 7f88626cc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c10ee00 con 0x7f885c0fe080 2024-04-25T02:04:31.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.296+0000 7f885b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f885c0fe080 0x7f885c10df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:04:31.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.296+0000 7f885b7fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f885c0fe080 0x7f885c10df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53862/0 (socket says 172.21.15.112:53862) 2024-04-25T02:04:31.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.296+0000 7f885b7fe700 1 -- 172.21.15.112:0/2666903975 learned_addr learned my addr 172.21.15.112:0/2666903975 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T02:04:31.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.296+0000 7f885bfff700 1 --2- 172.21.15.112:0/2666903975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f885c0fce80 0x7f885c10da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:04:31.310 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.296+0000 7f885b7fe700 1 -- 172.21.15.112:0/2666903975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f885c0fce80 msgr2=0x7f885c10da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:31.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.296+0000 7f885b7fe700 1 --2- 172.21.15.112:0/2666903975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f885c0fce80 0x7f885c10da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:31.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.296+0000 7f885b7fe700 1 -- 172.21.15.112:0/2666903975 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8850005040 con 0x7f885c0fe080 2024-04-25T02:04:31.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.296+0000 7f885bfff700 1 --2- 172.21.15.112:0/2666903975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f885c0fce80 0x7f885c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:04:31.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.297+0000 7f885b7fe700 1 --2- 172.21.15.112:0/2666903975 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f885c0fe080 0x7f885c10df80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f884c00b790 tx=0x7f884c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:04:31.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.297+0000 7f8858ff9700 1 -- 172.21.15.112:0/2666903975 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f884c00f770 con 0x7f885c0fe080 2024-04-25T02:04:31.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.297+0000 7f8858ff9700 1 -- 172.21.15.112:0/2666903975 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f884c00fda0 con 0x7f885c0fe080 2024-04-25T02:04:31.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.297+0000 7f88626cc700 1 -- 172.21.15.112:0/2666903975 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885c10f0e0 con 0x7f885c0fe080 2024-04-25T02:04:31.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.297+0000 7f8858ff9700 1 -- 172.21.15.112:0/2666903975 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f884c00d310 con 0x7f885c0fe080 2024-04-25T02:04:31.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.297+0000 7f88626cc700 1 -- 172.21.15.112:0/2666903975 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885c10f6a0 con 0x7f885c0fe080 2024-04-25T02:04:31.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.298+0000 7f88626cc700 1 -- 172.21.15.112:0/2666903975 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f885c05f5c0 con 0x7f885c0fe080 2024-04-25T02:04:31.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.298+0000 7f8858ff9700 1 -- 172.21.15.112:0/2666903975 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f884c010420 con 0x7f885c0fe080 2024-04-25T02:04:31.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.298+0000 7f8858ff9700 1 --2- 172.21.15.112:0/2666903975 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f88440692a0 0x7f884406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:04:31.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.299+0000 7f8858ff9700 1 -- 172.21.15.112:0/2666903975 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f884c086cd0 con 0x7f885c0fe080 2024-04-25T02:04:31.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.299+0000 7f885bfff700 1 --2- 172.21.15.112:0/2666903975 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f88440692a0 0x7f884406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:04:31.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.299+0000 7f885bfff700 1 --2- 172.21.15.112:0/2666903975 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f88440692a0 0x7f884406b750 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f885000b3b0 tx=0x7f8850009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:04:31.312 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.303+0000 7f8858ff9700 1 -- 172.21.15.112:0/2666903975 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f884c056f80 con 0x7f885c0fe080 2024-04-25T02:04:31.502 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:31.496+0000 7f88626cc700 1 -- 172.21.15.112:0/2666903975 --> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f885c10f990 con 0x7f88440692a0 2024-04-25T02:04:32.120 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:31 smithi112 ceph-mon[33313]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T02:04:32.120 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:31 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:04:32.120 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:31 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:04:32.120 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:31 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:32.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:31 smithi077 ceph-mon[26330]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T02:04:32.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:04:32.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:04:32.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:32.841 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:32 smithi112 ceph-mon[33313]: from='client.24165 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:04:33.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:32 smithi077 ceph-mon[26330]: from='client.24165 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:04:34.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:33 smithi077 ceph-mon[26330]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T02:04:34.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:33 smithi112 ceph-mon[33313]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T02:04:35.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:34 smithi077 ceph-mon[26330]: from='client.? 172.21.15.112:0/3199396476' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3f693f5-324b-4a48-8f24-77e65c5f7f7a"}]: dispatch 2024-04-25T02:04:35.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:34 smithi077 ceph-mon[26330]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3f693f5-324b-4a48-8f24-77e65c5f7f7a"}]: dispatch 2024-04-25T02:04:35.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:34 smithi077 ceph-mon[26330]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d3f693f5-324b-4a48-8f24-77e65c5f7f7a"}]': finished 2024-04-25T02:04:35.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:34 smithi077 ceph-mon[26330]: osdmap e37: 6 total, 5 up, 6 in 2024-04-25T02:04:35.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:34 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:04:35.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:34 smithi077 ceph-mon[26330]: from='client.? 172.21.15.112:0/1737834442' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:04:35.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:34 smithi112 ceph-mon[33313]: from='client.? 172.21.15.112:0/3199396476' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3f693f5-324b-4a48-8f24-77e65c5f7f7a"}]: dispatch 2024-04-25T02:04:35.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:34 smithi112 ceph-mon[33313]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d3f693f5-324b-4a48-8f24-77e65c5f7f7a"}]: dispatch 2024-04-25T02:04:35.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:34 smithi112 ceph-mon[33313]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d3f693f5-324b-4a48-8f24-77e65c5f7f7a"}]': finished 2024-04-25T02:04:35.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:34 smithi112 ceph-mon[33313]: osdmap e37: 6 total, 5 up, 6 in 2024-04-25T02:04:35.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:34 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:04:35.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:34 smithi112 ceph-mon[33313]: from='client.? 172.21.15.112:0/1737834442' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:04:36.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:35 smithi077 ceph-mon[26330]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T02:04:36.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:35 smithi112 ceph-mon[33313]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T02:04:38.183 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:37 smithi112 ceph-mon[33313]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T02:04:38.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:37 smithi077 ceph-mon[26330]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T02:04:40.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:39 smithi077 ceph-mon[26330]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T02:04:40.268 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:39 smithi112 ceph-mon[33313]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T02:04:42.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:41 smithi077 ceph-mon[26330]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T02:04:42.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:41 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-25T02:04:42.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:41 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:42.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:41 smithi112 ceph-mon[33313]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T02:04:42.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:41 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-25T02:04:42.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:41 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:43.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:42 smithi112 ceph-mon[33313]: Deploying daemon osd.5 on smithi112 2024-04-25T02:04:43.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:42 smithi077 ceph-mon[26330]: Deploying daemon osd.5 on smithi112 2024-04-25T02:04:44.043 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:43 smithi112 ceph-mon[33313]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T02:04:44.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:43 smithi077 ceph-mon[26330]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T02:04:46.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:45 smithi077 ceph-mon[26330]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T02:04:46.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:45 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:04:46.245 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:45 smithi112 ceph-mon[33313]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T02:04:46.245 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:45 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:04:47.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:47 smithi112 ceph-mon[33313]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T02:04:47.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:47 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:47.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:47 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:47.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:47 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:04:47.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:47 smithi077 ceph-mon[26330]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T02:04:47.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:47 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:47.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:47 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:47.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:47 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:04:49.768 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 5 on host 'smithi112' 2024-04-25T02:04:49.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:49.762+0000 7f8858ff9700 1 -- 172.21.15.112:0/2666903975 <== mgr.14208 v2:172.21.15.77:6800/310739264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f885c10f990 con 0x7f88440692a0 2024-04-25T02:04:49.768 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:49 smithi112 ceph-mon[33313]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T02:04:49.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:49.764+0000 7f88626cc700 1 -- 172.21.15.112:0/2666903975 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f88440692a0 msgr2=0x7f884406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:49.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:49.764+0000 7f88626cc700 1 --2- 172.21.15.112:0/2666903975 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f88440692a0 0x7f884406b750 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f885000b3b0 tx=0x7f8850009e30 comp rx=0 tx=0).stop 2024-04-25T02:04:49.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:49.764+0000 7f88626cc700 1 -- 172.21.15.112:0/2666903975 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f885c0fe080 msgr2=0x7f885c10df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:49.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:49.764+0000 7f88626cc700 1 --2- 172.21.15.112:0/2666903975 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f885c0fe080 0x7f885c10df80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f884c00b790 tx=0x7f884c009250 comp rx=0 tx=0).stop 2024-04-25T02:04:49.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:49.764+0000 7f88626cc700 1 -- 172.21.15.112:0/2666903975 shutdown_connections 2024-04-25T02:04:49.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:49.764+0000 7f88626cc700 1 --2- 172.21.15.112:0/2666903975 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f88440692a0 0x7f884406b750 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:49.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:49.764+0000 7f88626cc700 1 --2- 172.21.15.112:0/2666903975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f885c0fce80 0x7f885c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:49.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:49.764+0000 7f88626cc700 1 --2- 172.21.15.112:0/2666903975 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f885c0fe080 0x7f885c10df80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:49.770 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:49.764+0000 7f88626cc700 1 -- 172.21.15.112:0/2666903975 >> 172.21.15.112:0/2666903975 conn(0x7f885c0f8590 msgr2=0x7f885c0f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:04:49.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:49.764+0000 7f88626cc700 1 -- 172.21.15.112:0/2666903975 shutdown_connections 2024-04-25T02:04:49.771 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:04:49.764+0000 7f88626cc700 1 -- 172.21.15.112:0/2666903975 wait complete. 2024-04-25T02:04:49.891 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:49 smithi077 ceph-mon[26330]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T02:04:50.390 DEBUG:teuthology.orchestra.run.smithi112:osd.5> sudo journalctl -f -n 0 -u ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.5.service 2024-04-25T02:04:50.392 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-04-25T02:04:50.393 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-25T02:04:50.655 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:04:50.989 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:50 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:50.990 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:50 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:50.990 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:50 smithi077 ceph-mon[26330]: from='osd.5 [v2:172.21.15.112:6816/4063265473,v1:172.21.15.112:6817/4063265473]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T02:04:50.990 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:50 smithi077 ceph-mon[26330]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T02:04:51.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:50 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:51.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:50 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:51.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:50 smithi112 ceph-mon[33313]: from='osd.5 [v2:172.21.15.112:6816/4063265473,v1:172.21.15.112:6817/4063265473]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T02:04:51.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:50 smithi112 ceph-mon[33313]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T02:04:52.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:51 smithi112 ceph-mon[33313]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T02:04:52.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:51 smithi112 ceph-mon[33313]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-25T02:04:52.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:51 smithi112 ceph-mon[33313]: osdmap e38: 6 total, 5 up, 6 in 2024-04-25T02:04:52.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:51 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:04:52.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:51 smithi112 ceph-mon[33313]: from='osd.5 [v2:172.21.15.112:6816/4063265473,v1:172.21.15.112:6817/4063265473]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T02:04:52.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:51 smithi112 ceph-mon[33313]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T02:04:52.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:51 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:52.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:51 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:52.029 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:04:51 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[52049]: 2024-04-25T02:04:51.744+0000 7f3c4649b700 -1 osd.5 0 waiting for initial osdmap 2024-04-25T02:04:52.029 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:04:51 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[52049]: 2024-04-25T02:04:51.757+0000 7f3c41a97700 -1 osd.5 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:04:52.030 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:51 smithi077 ceph-mon[26330]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T02:04:52.030 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:51 smithi077 ceph-mon[26330]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-25T02:04:52.030 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:51 smithi077 ceph-mon[26330]: osdmap e38: 6 total, 5 up, 6 in 2024-04-25T02:04:52.030 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:51 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:04:52.030 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:51 smithi077 ceph-mon[26330]: from='osd.5 [v2:172.21.15.112:6816/4063265473,v1:172.21.15.112:6817/4063265473]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T02:04:52.030 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:51 smithi077 ceph-mon[26330]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T02:04:52.030 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:51 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:52.030 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:51 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:52.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.242+0000 7f2d28a1f700 1 -- 172.21.15.77:0/2431477504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d240fdfd0 msgr2=0x7f2d240fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:52.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.242+0000 7f2d28a1f700 1 --2- 172.21.15.77:0/2431477504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d240fdfd0 0x7f2d240fe440 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2d18004940 tx=0x7f2d18009e30 comp rx=0 tx=0).stop 2024-04-25T02:04:52.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.242+0000 7f2d28a1f700 1 -- 172.21.15.77:0/2431477504 shutdown_connections 2024-04-25T02:04:52.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.242+0000 7f2d28a1f700 1 --2- 172.21.15.77:0/2431477504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d240fdfd0 0x7f2d240fe440 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:52.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.242+0000 7f2d28a1f700 1 --2- 172.21.15.77:0/2431477504 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d240fce60 0x7f2d240fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:52.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.242+0000 7f2d28a1f700 1 -- 172.21.15.77:0/2431477504 >> 172.21.15.77:0/2431477504 conn(0x7f2d240f8520 msgr2=0x7f2d240fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:04:52.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.242+0000 7f2d28a1f700 1 -- 172.21.15.77:0/2431477504 shutdown_connections 2024-04-25T02:04:52.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.242+0000 7f2d28a1f700 1 -- 172.21.15.77:0/2431477504 wait complete. 2024-04-25T02:04:52.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.242+0000 7f2d28a1f700 1 Processor -- start 2024-04-25T02:04:52.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.242+0000 7f2d28a1f700 1 -- start start 2024-04-25T02:04:52.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.242+0000 7f2d28a1f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d240fce60 0x7f2d24071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:04:52.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.242+0000 7f2d28a1f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d240fdfd0 0x7f2d240702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:04:52.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.242+0000 7f2d28a1f700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d24072200 con 0x7f2d240fce60 2024-04-25T02:04:52.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.242+0000 7f2d28a1f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d240707f0 con 0x7f2d240fdfd0 2024-04-25T02:04:52.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.242+0000 7f2d2259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d240fce60 0x7f2d24071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:04:52.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.243+0000 7f2d2259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d240fce60 0x7f2d24071c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54654/0 (socket says 172.21.15.77:54654) 2024-04-25T02:04:52.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.243+0000 7f2d2259c700 1 -- 172.21.15.77:0/2762229317 learned_addr learned my addr 172.21.15.77:0/2762229317 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:04:52.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.243+0000 7f2d21d9b700 1 --2- 172.21.15.77:0/2762229317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d240fdfd0 0x7f2d240702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:04:52.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.243+0000 7f2d2259c700 1 -- 172.21.15.77:0/2762229317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d240fdfd0 msgr2=0x7f2d240702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:52.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.243+0000 7f2d2259c700 1 --2- 172.21.15.77:0/2762229317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d240fdfd0 0x7f2d240702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:52.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.243+0000 7f2d2259c700 1 -- 172.21.15.77:0/2762229317 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d18005040 con 0x7f2d240fce60 2024-04-25T02:04:52.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.243+0000 7f2d2259c700 1 --2- 172.21.15.77:0/2762229317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d240fce60 0x7f2d24071c00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2d14002a50 tx=0x7f2d140046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:04:52.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.243+0000 7f2d12ffd700 1 -- 172.21.15.77:0/2762229317 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d14007cc0 con 0x7f2d240fce60 2024-04-25T02:04:52.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.243+0000 7f2d28a1f700 1 -- 172.21.15.77:0/2762229317 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d24070aa0 con 0x7f2d240fce60 2024-04-25T02:04:52.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.243+0000 7f2d12ffd700 1 -- 172.21.15.77:0/2762229317 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2d1400f040 con 0x7f2d240fce60 2024-04-25T02:04:52.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.243+0000 7f2d12ffd700 1 -- 172.21.15.77:0/2762229317 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d1400da30 con 0x7f2d240fce60 2024-04-25T02:04:52.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.243+0000 7f2d28a1f700 1 -- 172.21.15.77:0/2762229317 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d24071060 con 0x7f2d240fce60 2024-04-25T02:04:52.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.244+0000 7f2d28a1f700 1 -- 172.21.15.77:0/2762229317 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d2404c710 con 0x7f2d240fce60 2024-04-25T02:04:52.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.245+0000 7f2d12ffd700 1 -- 172.21.15.77:0/2762229317 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f2d1400db90 con 0x7f2d240fce60 2024-04-25T02:04:52.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.245+0000 7f2d12ffd700 1 --2- 172.21.15.77:0/2762229317 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f2d0c0692a0 0x7f2d0c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:04:52.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.245+0000 7f2d21d9b700 1 --2- 172.21.15.77:0/2762229317 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f2d0c0692a0 0x7f2d0c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:04:52.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.245+0000 7f2d12ffd700 1 -- 172.21.15.77:0/2762229317 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4354+0+0 (secure 0 0 0) 0x7f2d14086b10 con 0x7f2d240fce60 2024-04-25T02:04:52.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.245+0000 7f2d21d9b700 1 --2- 172.21.15.77:0/2762229317 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f2d0c0692a0 0x7f2d0c06b750 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2d1800b3b0 tx=0x7f2d18009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:04:52.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.250+0000 7f2d12ffd700 1 -- 172.21.15.77:0/2762229317 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2d14056ca0 con 0x7f2d240fce60 2024-04-25T02:04:52.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.435+0000 7f2d28a1f700 1 -- 172.21.15.77:0/2762229317 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f2d24115ac0 con 0x7f2d240fce60 2024-04-25T02:04:52.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.435+0000 7f2d12ffd700 1 -- 172.21.15.77:0/2762229317 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v39) v1 ==== 74+0+130 (secure 0 0 0) 0x7f2d1405ae60 con 0x7f2d240fce60 2024-04-25T02:04:52.441 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:04:52.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.438+0000 7f2d28a1f700 1 -- 172.21.15.77:0/2762229317 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f2d0c0692a0 msgr2=0x7f2d0c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:52.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.438+0000 7f2d28a1f700 1 --2- 172.21.15.77:0/2762229317 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f2d0c0692a0 0x7f2d0c06b750 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2d1800b3b0 tx=0x7f2d18009e30 comp rx=0 tx=0).stop 2024-04-25T02:04:52.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.438+0000 7f2d28a1f700 1 -- 172.21.15.77:0/2762229317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d240fce60 msgr2=0x7f2d24071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:52.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.438+0000 7f2d28a1f700 1 --2- 172.21.15.77:0/2762229317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d240fce60 0x7f2d24071c00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2d14002a50 tx=0x7f2d140046b0 comp rx=0 tx=0).stop 2024-04-25T02:04:52.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.438+0000 7f2d28a1f700 1 -- 172.21.15.77:0/2762229317 shutdown_connections 2024-04-25T02:04:52.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.438+0000 7f2d28a1f700 1 --2- 172.21.15.77:0/2762229317 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f2d0c0692a0 0x7f2d0c06b750 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:52.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.438+0000 7f2d28a1f700 1 --2- 172.21.15.77:0/2762229317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d240fce60 0x7f2d24071c00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:52.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.438+0000 7f2d28a1f700 1 --2- 172.21.15.77:0/2762229317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d240fdfd0 0x7f2d240702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:52.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.438+0000 7f2d28a1f700 1 -- 172.21.15.77:0/2762229317 >> 172.21.15.77:0/2762229317 conn(0x7f2d240f8520 msgr2=0x7f2d240f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:04:52.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.438+0000 7f2d28a1f700 1 -- 172.21.15.77:0/2762229317 shutdown_connections 2024-04-25T02:04:52.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:52.438+0000 7f2d28a1f700 1 -- 172.21.15.77:0/2762229317 wait complete. 2024-04-25T02:04:52.931 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":39,"num_osds":6,"num_up_osds":5,"osd_up_since":1714010666,"num_in_osds":6,"osd_in_since":1714010673,"num_remapped_pgs":0} 2024-04-25T02:04:53.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:52 smithi112 ceph-mon[33313]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-04-25T02:04:53.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:52 smithi112 ceph-mon[33313]: osdmap e39: 6 total, 5 up, 6 in 2024-04-25T02:04:53.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:52 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:04:53.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:52 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:04:53.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:52 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/2762229317' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-25T02:04:53.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:52 smithi077 ceph-mon[26330]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-04-25T02:04:53.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:52 smithi077 ceph-mon[26330]: osdmap e39: 6 total, 5 up, 6 in 2024-04-25T02:04:53.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:52 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:04:53.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:52 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:04:53.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:52 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/2762229317' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-25T02:04:53.932 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-25T02:04:54.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:53 smithi112 ceph-mon[33313]: purged_snaps scrub starts 2024-04-25T02:04:54.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:53 smithi112 ceph-mon[33313]: purged_snaps scrub ok 2024-04-25T02:04:54.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:53 smithi112 ceph-mon[33313]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T02:04:54.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:53 smithi112 ceph-mon[33313]: osd.5 [v2:172.21.15.112:6816/4063265473,v1:172.21.15.112:6817/4063265473] boot 2024-04-25T02:04:54.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:53 smithi112 ceph-mon[33313]: osdmap e40: 6 total, 6 up, 6 in 2024-04-25T02:04:54.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:53 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:04:54.205 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:04:54.221 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:53 smithi077 ceph-mon[26330]: purged_snaps scrub starts 2024-04-25T02:04:54.222 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:53 smithi077 ceph-mon[26330]: purged_snaps scrub ok 2024-04-25T02:04:54.222 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:53 smithi077 ceph-mon[26330]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T02:04:54.222 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:53 smithi077 ceph-mon[26330]: osd.5 [v2:172.21.15.112:6816/4063265473,v1:172.21.15.112:6817/4063265473] boot 2024-04-25T02:04:54.222 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:53 smithi077 ceph-mon[26330]: osdmap e40: 6 total, 6 up, 6 in 2024-04-25T02:04:54.222 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:53 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:04:54.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:54 smithi077 ceph-mon[26330]: osdmap e41: 6 total, 6 up, 6 in 2024-04-25T02:04:55.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:54 smithi112 ceph-mon[33313]: osdmap e41: 6 total, 6 up, 6 in 2024-04-25T02:04:55.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.633+0000 7f2dd4730700 1 -- 172.21.15.77:0/582533561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dcc0fe420 msgr2=0x7f2dcc0fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:55.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.633+0000 7f2dd4730700 1 --2- 172.21.15.77:0/582533561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dcc0fe420 0x7f2dcc0fe830 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc004940 tx=0x7f2dbc009e30 comp rx=0 tx=0).stop 2024-04-25T02:04:55.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.633+0000 7f2dd4730700 1 -- 172.21.15.77:0/582533561 shutdown_connections 2024-04-25T02:04:55.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.633+0000 7f2dd4730700 1 --2- 172.21.15.77:0/582533561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dcc0fed70 0x7f2dcc0faeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:55.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.633+0000 7f2dd4730700 1 --2- 172.21.15.77:0/582533561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dcc0fe420 0x7f2dcc0fe830 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:55.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.633+0000 7f2dd4730700 1 -- 172.21.15.77:0/582533561 >> 172.21.15.77:0/582533561 conn(0x7f2dcc0f6be0 msgr2=0x7f2dcc0f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:04:55.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.633+0000 7f2dd4730700 1 -- 172.21.15.77:0/582533561 shutdown_connections 2024-04-25T02:04:55.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.633+0000 7f2dd4730700 1 -- 172.21.15.77:0/582533561 wait complete. 2024-04-25T02:04:55.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.634+0000 7f2dd4730700 1 Processor -- start 2024-04-25T02:04:55.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.634+0000 7f2dd4730700 1 -- start start 2024-04-25T02:04:55.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.634+0000 7f2dd4730700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dcc0fe420 0x7f2dcc10d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:04:55.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.634+0000 7f2dd4730700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dcc0fed70 0x7f2dcc10de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:04:55.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.634+0000 7f2dd4730700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc10e430 con 0x7f2dcc0fe420 2024-04-25T02:04:55.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.634+0000 7f2dd4730700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc10e5a0 con 0x7f2dcc0fed70 2024-04-25T02:04:55.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.634+0000 7f2dd24cc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dcc0fe420 0x7f2dcc10d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:04:55.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.634+0000 7f2dd24cc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dcc0fe420 0x7f2dcc10d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54666/0 (socket says 172.21.15.77:54666) 2024-04-25T02:04:55.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.634+0000 7f2dd24cc700 1 -- 172.21.15.77:0/1154518139 learned_addr learned my addr 172.21.15.77:0/1154518139 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:04:55.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.634+0000 7f2dd1ccb700 1 --2- 172.21.15.77:0/1154518139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dcc0fed70 0x7f2dcc10de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:04:55.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.634+0000 7f2dd24cc700 1 -- 172.21.15.77:0/1154518139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dcc0fed70 msgr2=0x7f2dcc10de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:55.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.634+0000 7f2dd24cc700 1 --2- 172.21.15.77:0/1154518139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dcc0fed70 0x7f2dcc10de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:55.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.634+0000 7f2dd24cc700 1 -- 172.21.15.77:0/1154518139 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dbc005040 con 0x7f2dcc0fe420 2024-04-25T02:04:55.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.634+0000 7f2dd1ccb700 1 --2- 172.21.15.77:0/1154518139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dcc0fed70 0x7f2dcc10de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:04:55.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.635+0000 7f2dd24cc700 1 --2- 172.21.15.77:0/1154518139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dcc0fe420 0x7f2dcc10d8f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00b3b0 tx=0x7f2dbc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:04:55.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.635+0000 7f2dc2ffd700 1 -- 172.21.15.77:0/1154518139 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2dbc00e040 con 0x7f2dcc0fe420 2024-04-25T02:04:55.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.635+0000 7f2dc2ffd700 1 -- 172.21.15.77:0/1154518139 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2dbc00bcc0 con 0x7f2dcc0fe420 2024-04-25T02:04:55.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.635+0000 7f2dd4730700 1 -- 172.21.15.77:0/1154518139 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dcc112fa0 con 0x7f2dcc0fe420 2024-04-25T02:04:55.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.635+0000 7f2dc2ffd700 1 -- 172.21.15.77:0/1154518139 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2dbc01c630 con 0x7f2dcc0fe420 2024-04-25T02:04:55.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.635+0000 7f2dd4730700 1 -- 172.21.15.77:0/1154518139 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dcc1134d0 con 0x7f2dcc0fe420 2024-04-25T02:04:55.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.636+0000 7f2dd4730700 1 -- 172.21.15.77:0/1154518139 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dcc04c710 con 0x7f2dcc0fe420 2024-04-25T02:04:55.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.636+0000 7f2dc2ffd700 1 -- 172.21.15.77:0/1154518139 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f2dbc013980 con 0x7f2dcc0fe420 2024-04-25T02:04:55.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.637+0000 7f2dc2ffd700 1 --2- 172.21.15.77:0/1154518139 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f2db80692a0 0x7f2db806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:04:55.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.637+0000 7f2dc2ffd700 1 -- 172.21.15.77:0/1154518139 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2dbc087bd0 con 0x7f2dcc0fe420 2024-04-25T02:04:55.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.637+0000 7f2dd1ccb700 1 --2- 172.21.15.77:0/1154518139 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f2db80692a0 0x7f2db806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:04:55.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.637+0000 7f2dd1ccb700 1 --2- 172.21.15.77:0/1154518139 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f2db80692a0 0x7f2db806b750 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8009fd0 tx=0x7f2dc8009ee0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:04:55.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.641+0000 7f2dc2ffd700 1 -- 172.21.15.77:0/1154518139 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2dbc057cd0 con 0x7f2dcc0fe420 2024-04-25T02:04:55.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.832+0000 7f2dd4730700 1 -- 172.21.15.77:0/1154518139 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f2dcc1058d0 con 0x7f2dcc0fe420 2024-04-25T02:04:55.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.833+0000 7f2dc2ffd700 1 -- 172.21.15.77:0/1154518139 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v41) v1 ==== 74+0+130 (secure 0 0 0) 0x7f2dbc057860 con 0x7f2dcc0fe420 2024-04-25T02:04:55.838 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:04:55.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.835+0000 7f2dd4730700 1 -- 172.21.15.77:0/1154518139 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f2db80692a0 msgr2=0x7f2db806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:55.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.835+0000 7f2dd4730700 1 --2- 172.21.15.77:0/1154518139 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f2db80692a0 0x7f2db806b750 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8009fd0 tx=0x7f2dc8009ee0 comp rx=0 tx=0).stop 2024-04-25T02:04:55.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.835+0000 7f2dd4730700 1 -- 172.21.15.77:0/1154518139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dcc0fe420 msgr2=0x7f2dcc10d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:55.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.835+0000 7f2dd4730700 1 --2- 172.21.15.77:0/1154518139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dcc0fe420 0x7f2dcc10d8f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00b3b0 tx=0x7f2dbc009e30 comp rx=0 tx=0).stop 2024-04-25T02:04:55.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.835+0000 7f2dd4730700 1 -- 172.21.15.77:0/1154518139 shutdown_connections 2024-04-25T02:04:55.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.835+0000 7f2dd4730700 1 --2- 172.21.15.77:0/1154518139 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f2db80692a0 0x7f2db806b750 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:55.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.835+0000 7f2dd4730700 1 --2- 172.21.15.77:0/1154518139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dcc0fe420 0x7f2dcc10d8f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:55.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.835+0000 7f2dd4730700 1 --2- 172.21.15.77:0/1154518139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2dcc0fed70 0x7f2dcc10de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:55.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.835+0000 7f2dd4730700 1 -- 172.21.15.77:0/1154518139 >> 172.21.15.77:0/1154518139 conn(0x7f2dcc0f6be0 msgr2=0x7f2dcc0f8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:04:55.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.835+0000 7f2dd4730700 1 -- 172.21.15.77:0/1154518139 shutdown_connections 2024-04-25T02:04:55.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:55.835+0000 7f2dd4730700 1 -- 172.21.15.77:0/1154518139 wait complete. 2024-04-25T02:04:56.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:55 smithi112 ceph-mon[33313]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:04:56.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:55 smithi112 ceph-mon[33313]: Detected new or changed devices on smithi112 2024-04-25T02:04:56.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:56.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:56.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:56.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:56.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:56.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:55 smithi112 ceph-mon[33313]: Adjusting osd_memory_target on smithi112 to 5312M 2024-04-25T02:04:56.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:56.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:56.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:56.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:56.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:04:56.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:56.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:56.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:55 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:56.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:55 smithi077 ceph-mon[26330]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:04:56.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:55 smithi077 ceph-mon[26330]: Detected new or changed devices on smithi112 2024-04-25T02:04:56.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:55 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:56.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:55 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:56.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:55 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:56.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:55 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:56.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:55 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:56.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:55 smithi077 ceph-mon[26330]: Adjusting osd_memory_target on smithi112 to 5312M 2024-04-25T02:04:56.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:55 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:56.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:55 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:56.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:55 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:56.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:55 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:56.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:55 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:04:56.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:55 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:56.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:55 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:56.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:55 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:04:56.545 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":41,"num_osds":6,"num_up_osds":6,"osd_up_since":1714010692,"num_in_osds":6,"osd_in_since":1714010673,"num_remapped_pgs":0} 2024-04-25T02:04:56.546 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-25T02:04:56.796 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:04:57.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:56 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/1154518139' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-25T02:04:57.075 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:56 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/1154518139' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-25T02:04:57.876 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:57 smithi077 ceph-mon[26330]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:04:58.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:57 smithi112 ceph-mon[33313]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:04:58.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.313+0000 7f33ca01c700 1 -- 172.21.15.77:0/1698420747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33c4103780 msgr2=0x7f33c40fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:58.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.313+0000 7f33ca01c700 1 --2- 172.21.15.77:0/1698420747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33c4103780 0x7f33c40fcdf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f33b8004940 tx=0x7f33b8009e30 comp rx=0 tx=0).stop 2024-04-25T02:04:58.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.313+0000 7f33ca01c700 1 -- 172.21.15.77:0/1698420747 shutdown_connections 2024-04-25T02:04:58.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.313+0000 7f33ca01c700 1 --2- 172.21.15.77:0/1698420747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33c4103780 0x7f33c40fcdf0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:58.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.313+0000 7f33ca01c700 1 --2- 172.21.15.77:0/1698420747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33c4102de0 0x7f33c41031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:58.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.313+0000 7f33ca01c700 1 -- 172.21.15.77:0/1698420747 >> 172.21.15.77:0/1698420747 conn(0x7f33c40f8990 msgr2=0x7f33c40fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:04:58.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.313+0000 7f33ca01c700 1 -- 172.21.15.77:0/1698420747 shutdown_connections 2024-04-25T02:04:58.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.313+0000 7f33ca01c700 1 -- 172.21.15.77:0/1698420747 wait complete. 2024-04-25T02:04:58.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.313+0000 7f33ca01c700 1 Processor -- start 2024-04-25T02:04:58.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.313+0000 7f33ca01c700 1 -- start start 2024-04-25T02:04:58.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.314+0000 7f33ca01c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33c4102de0 0x7f33c4070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:04:58.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.314+0000 7f33ca01c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33c4103780 0x7f33c40707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:04:58.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.314+0000 7f33ca01c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c4072190 con 0x7f33c4103780 2024-04-25T02:04:58.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.314+0000 7f33ca01c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c4070ce0 con 0x7f33c4102de0 2024-04-25T02:04:58.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.314+0000 7f33c2ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33c4103780 0x7f33c40707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:04:58.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.314+0000 7f33c2ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33c4103780 0x7f33c40707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47256/0 (socket says 172.21.15.77:47256) 2024-04-25T02:04:58.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.314+0000 7f33c2ffd700 1 -- 172.21.15.77:0/437250851 learned_addr learned my addr 172.21.15.77:0/437250851 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:04:58.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.314+0000 7f33c37fe700 1 --2- 172.21.15.77:0/437250851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33c4102de0 0x7f33c4070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:04:58.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.314+0000 7f33c2ffd700 1 -- 172.21.15.77:0/437250851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33c4102de0 msgr2=0x7f33c4070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:58.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.314+0000 7f33c2ffd700 1 --2- 172.21.15.77:0/437250851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33c4102de0 0x7f33c4070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:58.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.314+0000 7f33c2ffd700 1 -- 172.21.15.77:0/437250851 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b8005040 con 0x7f33c4103780 2024-04-25T02:04:58.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.314+0000 7f33c2ffd700 1 --2- 172.21.15.77:0/437250851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33c4103780 0x7f33c40707a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f33b800b3b0 tx=0x7f33b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:04:58.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.314+0000 7f33abfff700 1 -- 172.21.15.77:0/437250851 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33b800e040 con 0x7f33c4103780 2024-04-25T02:04:58.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.314+0000 7f33abfff700 1 -- 172.21.15.77:0/437250851 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f33b8013420 con 0x7f33c4103780 2024-04-25T02:04:58.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.314+0000 7f33ca01c700 1 -- 172.21.15.77:0/437250851 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c4070f60 con 0x7f33c4103780 2024-04-25T02:04:58.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.314+0000 7f33abfff700 1 -- 172.21.15.77:0/437250851 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33b801c630 con 0x7f33c4103780 2024-04-25T02:04:58.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.315+0000 7f33ca01c700 1 -- 172.21.15.77:0/437250851 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c411a0b0 con 0x7f33c4103780 2024-04-25T02:04:58.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.315+0000 7f33ca01c700 1 -- 172.21.15.77:0/437250851 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33c40fe530 con 0x7f33c4103780 2024-04-25T02:04:58.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.316+0000 7f33abfff700 1 -- 172.21.15.77:0/437250851 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f33b8013590 con 0x7f33c4103780 2024-04-25T02:04:58.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.316+0000 7f33abfff700 1 --2- 172.21.15.77:0/437250851 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f33ac0692a0 0x7f33ac06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:04:58.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.316+0000 7f33abfff700 1 -- 172.21.15.77:0/437250851 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f33b8087fc0 con 0x7f33c4103780 2024-04-25T02:04:58.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.316+0000 7f33c37fe700 1 --2- 172.21.15.77:0/437250851 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f33ac0692a0 0x7f33ac06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:04:58.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.317+0000 7f33c37fe700 1 --2- 172.21.15.77:0/437250851 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f33ac0692a0 0x7f33ac06b750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f33b4007a40 tx=0x7f33b4009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:04:58.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.321+0000 7f33abfff700 1 -- 172.21.15.77:0/437250851 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f33b8054630 con 0x7f33c4103780 2024-04-25T02:04:58.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.511+0000 7f33ca01c700 1 -- 172.21.15.77:0/437250851 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33c411a2a0 con 0x7f33c4103780 2024-04-25T02:04:58.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.512+0000 7f33abfff700 1 -- 172.21.15.77:0/437250851 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11043 (secure 0 0 0) 0x7f33b8057c50 con 0x7f33c4103780 2024-04-25T02:04:58.518 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:04:58.518 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":41,"fsid":"4bb93d82-02a7-11ef-bc93-c7b262605968","created":"2024-04-25T01:59:22.235413+0000","modified":"2024-04-25T02:04:53.747863+0000","last_up_change":"2024-04-25T02:04:52.742695+0000","last_in_change":"2024-04-25T02:04:33.912973+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:03:38.692032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"1533372f-b1a5-4ec0-9524-9940f870d874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3624813295},{"type":"v1","addr":"172.21.15.77:6803","nonce":3624813295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3624813295},{"type":"v1","addr":"172.21.15.77:6805","nonce":3624813295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3624813295},{"type":"v1","addr":"172.21.15.77:6809","nonce":3624813295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3624813295},{"type":"v1","addr":"172.21.15.77:6807","nonce":3624813295}]},"public_addr":"172.21.15.77:6803/3624813295","cluster_addr":"172.21.15.77:6805/3624813295","heartbeat_back_addr":"172.21.15.77:6809/3624813295","heartbeat_front_addr":"172.21.15.77:6807/3624813295","state":["exists","up"]},{"osd":1,"uuid":"cb083b21-fd25-4ac4-bbde-6387c3253d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3061147623},{"type":"v1","addr":"172.21.15.77:6811","nonce":3061147623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3061147623},{"type":"v1","addr":"172.21.15.77:6813","nonce":3061147623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3061147623},{"type":"v1","addr":"172.21.15.77:6817","nonce":3061147623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3061147623},{"type":"v1","addr":"172.21.15.77:6815","nonce":3061147623}]},"public_addr":"172.21.15.77:6811/3061147623","cluster_addr":"172.21.15.77:6813/3061147623","heartbeat_back_addr":"172.21.15.77:6817/3061147623","heartbeat_front_addr":"172.21.15.77:6815/3061147623","state":["exists","up"]},{"osd":2,"uuid":"39b4553c-c1ed-489b-aead-210f38ac86b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":625070655},{"type":"v1","addr":"172.21.15.77:6819","nonce":625070655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":625070655},{"type":"v1","addr":"172.21.15.77:6821","nonce":625070655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":625070655},{"type":"v1","addr":"172.21.15.77:6825","nonce":625070655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":625070655},{"type":"v1","addr":"172.21.15.77:6823","nonce":625070655}]},"public_addr":"172.21.15.77:6819/625070655","cluster_addr":"172.21.15.77:6821/625070655","heartbeat_back_addr":"172.21.15.77:6825/625070655","heartbeat_front_addr":"172.21.15.77:6823/625070655","state":["exists","up"]},{"osd":3,"uuid":"addec0fa-80ee-465d-9d3e-c801d7bd9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":36251324},{"type":"v1","addr":"172.21.15.112:6801","nonce":36251324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":36251324},{"type":"v1","addr":"172.21.15.112:6803","nonce":36251324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":36251324},{"type":"v1","addr":"172.21.15.112:6807","nonce":36251324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":36251324},{"type":"v1","addr":"172.21.15.112:6805","nonce":36251324}]},"public_addr":"172.21.15.112:6801/36251324","cluster_addr":"172.21.15.112:6803/36251324","heartbeat_back_addr":"172.21.15.112:6807/36251324","heartbeat_front_addr":"172.21.15.112:6805/36251324","state":["exists","up"]},{"osd":4,"uuid":"93465def-0617-4ba8-915a-b3ea85c8f6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":581823847},{"type":"v1","addr":"172.21.15.112:6809","nonce":581823847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":581823847},{"type":"v1","addr":"172.21.15.112:6811","nonce":581823847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":581823847},{"type":"v1","addr":"172.21.15.112:6815","nonce":581823847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":581823847},{"type":"v1","addr":"172.21.15.112:6813","nonce":581823847}]},"public_addr":"172.21.15.112:6809/581823847","cluster_addr":"172.21.15.112:6811/581823847","heartbeat_back_addr":"172.21.15.112:6815/581823847","heartbeat_front_addr":"172.21.15.112:6813/581823847","state":["exists","up"]},{"osd":5,"uuid":"d3f693f5-324b-4a48-8f24-77e65c5f7f7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4063265473},{"type":"v1","addr":"172.21.15.112:6817","nonce":4063265473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4063265473},{"type":"v1","addr":"172.21.15.112:6819","nonce":4063265473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4063265473},{"type":"v1","addr":"172.21.15.112:6823","nonce":4063265473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4063265473},{"type":"v1","addr":"172.21.15.112:6821","nonce":4063265473}]},"public_addr":"172.21.15.112:6817/4063265473","cluster_addr":"172.21.15.112:6819/4063265473","heartbeat_back_addr":"172.21.15.112:6823/4063265473","heartbeat_front_addr":"172.21.15.112:6821/4063265473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:42.635624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:10.189211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:35.781710+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:59.250841+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:25.155356+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:51.315370+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:6801/2375514340":"2024-04-26T02:01:30.377936+0000","172.21.15.77:0/3184722826":"2024-04-26T02:01:30.377936+0000","172.21.15.77:0/2490024809":"2024-04-26T02:01:30.377936+0000","172.21.15.77:0/543110241":"2024-04-26T02:01:30.377936+0000","172.21.15.77:0/1779967375":"2024-04-26T02:00:25.057598+0000","172.21.15.77:0/2265849210":"2024-04-26T02:00:25.057598+0000","172.21.15.77:6801/859750200":"2024-04-26T02:00:25.057598+0000","172.21.15.77:6801/839529497":"2024-04-26T01:59:54.491478+0000","172.21.15.77:6800/859750200":"2024-04-26T02:00:25.057598+0000","172.21.15.77:0/2254838943":"2024-04-26T02:00:25.057598+0000","172.21.15.77:6800/839529497":"2024-04-26T01:59:54.491478+0000","172.21.15.77:0/1177720370":"2024-04-26T01:59:54.491478+0000","172.21.15.77:6800/2375514340":"2024-04-26T02:01:30.377936+0000","172.21.15.77:0/265498985":"2024-04-26T01:59:54.491478+0000","172.21.15.77:0/1743910051":"2024-04-26T01:59:54.491478+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:04:58.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.514+0000 7f33ca01c700 1 -- 172.21.15.77:0/437250851 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f33ac0692a0 msgr2=0x7f33ac06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:58.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.514+0000 7f33ca01c700 1 --2- 172.21.15.77:0/437250851 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f33ac0692a0 0x7f33ac06b750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f33b4007a40 tx=0x7f33b4009da0 comp rx=0 tx=0).stop 2024-04-25T02:04:58.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.514+0000 7f33ca01c700 1 -- 172.21.15.77:0/437250851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33c4103780 msgr2=0x7f33c40707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:58.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.514+0000 7f33ca01c700 1 --2- 172.21.15.77:0/437250851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33c4103780 0x7f33c40707a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f33b800b3b0 tx=0x7f33b8009e30 comp rx=0 tx=0).stop 2024-04-25T02:04:58.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.514+0000 7f33ca01c700 1 -- 172.21.15.77:0/437250851 shutdown_connections 2024-04-25T02:04:58.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.514+0000 7f33ca01c700 1 --2- 172.21.15.77:0/437250851 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f33ac0692a0 0x7f33ac06b750 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:58.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.514+0000 7f33ca01c700 1 --2- 172.21.15.77:0/437250851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33c4102de0 0x7f33c4070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:58.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.514+0000 7f33ca01c700 1 --2- 172.21.15.77:0/437250851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33c4103780 0x7f33c40707a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:58.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.514+0000 7f33ca01c700 1 -- 172.21.15.77:0/437250851 >> 172.21.15.77:0/437250851 conn(0x7f33c40f8990 msgr2=0x7f33c40f9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:04:58.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.514+0000 7f33ca01c700 1 -- 172.21.15.77:0/437250851 shutdown_connections 2024-04-25T02:04:58.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:04:58.514+0000 7f33ca01c700 1 -- 172.21.15.77:0/437250851 wait complete. 2024-04-25T02:04:59.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:58 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/437250851' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:04:59.066 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:58 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/437250851' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:04:59.092 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:03:38.692032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-04-25T02:04:59.092 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-04-25T02:04:59.343 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:05:00.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:04:59 smithi077 ceph-mon[26330]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:00.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:04:59 smithi112 ceph-mon[33313]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:01.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.012+0000 7f5d672e8700 1 -- 172.21.15.77:0/1469215396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d60102de0 msgr2=0x7f5d601031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:01.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.012+0000 7f5d672e8700 1 --2- 172.21.15.77:0/1469215396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d60102de0 0x7f5d601031b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c004940 tx=0x7f5d5c009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:01.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.012+0000 7f5d672e8700 1 -- 172.21.15.77:0/1469215396 shutdown_connections 2024-04-25T02:05:01.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.012+0000 7f5d672e8700 1 --2- 172.21.15.77:0/1469215396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d60103780 0x7f5d600fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:01.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.012+0000 7f5d672e8700 1 --2- 172.21.15.77:0/1469215396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d60102de0 0x7f5d601031b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:01.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.012+0000 7f5d672e8700 1 -- 172.21.15.77:0/1469215396 >> 172.21.15.77:0/1469215396 conn(0x7f5d600f8990 msgr2=0x7f5d600fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:01.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.012+0000 7f5d672e8700 1 -- 172.21.15.77:0/1469215396 shutdown_connections 2024-04-25T02:05:01.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.012+0000 7f5d672e8700 1 -- 172.21.15.77:0/1469215396 wait complete. 2024-04-25T02:05:01.018 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:00 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:05:01.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.012+0000 7f5d672e8700 1 Processor -- start 2024-04-25T02:05:01.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.012+0000 7f5d672e8700 1 -- start start 2024-04-25T02:05:01.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.013+0000 7f5d672e8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d60102de0 0x7f5d60115b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:01.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.013+0000 7f5d672e8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d60103780 0x7f5d601160a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:01.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.013+0000 7f5d672e8700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d60116780 con 0x7f5d60103780 2024-04-25T02:05:01.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.013+0000 7f5d672e8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6010fcd0 con 0x7f5d60102de0 2024-04-25T02:05:01.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.013+0000 7f5d64883700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d60103780 0x7f5d601160a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:01.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.013+0000 7f5d64883700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d60103780 0x7f5d601160a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47274/0 (socket says 172.21.15.77:47274) 2024-04-25T02:05:01.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.013+0000 7f5d64883700 1 -- 172.21.15.77:0/4107874252 learned_addr learned my addr 172.21.15.77:0/4107874252 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:05:01.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.013+0000 7f5d65084700 1 --2- 172.21.15.77:0/4107874252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d60102de0 0x7f5d60115b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:01.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.013+0000 7f5d64883700 1 -- 172.21.15.77:0/4107874252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d60102de0 msgr2=0x7f5d60115b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:01.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.013+0000 7f5d64883700 1 --2- 172.21.15.77:0/4107874252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d60102de0 0x7f5d60115b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:01.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.013+0000 7f5d64883700 1 -- 172.21.15.77:0/4107874252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5c005040 con 0x7f5d60103780 2024-04-25T02:05:01.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.013+0000 7f5d64883700 1 --2- 172.21.15.77:0/4107874252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d60103780 0x7f5d601160a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000b790 tx=0x7f5d50009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:01.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.013+0000 7f5d55ffb700 1 -- 172.21.15.77:0/4107874252 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d5000f6f0 con 0x7f5d60103780 2024-04-25T02:05:01.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.013+0000 7f5d672e8700 1 -- 172.21.15.77:0/4107874252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d6010ff50 con 0x7f5d60103780 2024-04-25T02:05:01.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.013+0000 7f5d55ffb700 1 -- 172.21.15.77:0/4107874252 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5d5000fd20 con 0x7f5d60103780 2024-04-25T02:05:01.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.013+0000 7f5d55ffb700 1 -- 172.21.15.77:0/4107874252 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d500103a0 con 0x7f5d60103780 2024-04-25T02:05:01.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.014+0000 7f5d672e8700 1 -- 172.21.15.77:0/4107874252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d60110510 con 0x7f5d60103780 2024-04-25T02:05:01.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.014+0000 7f5d672e8700 1 -- 172.21.15.77:0/4107874252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d601072e0 con 0x7f5d60103780 2024-04-25T02:05:01.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.015+0000 7f5d55ffb700 1 -- 172.21.15.77:0/4107874252 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f5d5000f850 con 0x7f5d60103780 2024-04-25T02:05:01.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.015+0000 7f5d55ffb700 1 --2- 172.21.15.77:0/4107874252 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f5d4c0692a0 0x7f5d4c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:01.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.016+0000 7f5d65084700 1 --2- 172.21.15.77:0/4107874252 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f5d4c0692a0 0x7f5d4c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:01.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.016+0000 7f5d55ffb700 1 -- 172.21.15.77:0/4107874252 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5d50086ca0 con 0x7f5d60103780 2024-04-25T02:05:01.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.016+0000 7f5d65084700 1 --2- 172.21.15.77:0/4107874252 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f5d4c0692a0 0x7f5d4c06b750 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c004f90 tx=0x7f5d5c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:01.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.020+0000 7f5d55ffb700 1 -- 172.21.15.77:0/4107874252 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5d5008b070 con 0x7f5d60103780 2024-04-25T02:05:01.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.204+0000 7f5d672e8700 1 -- 172.21.15.77:0/4107874252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5d60109f50 con 0x7f5d60103780 2024-04-25T02:05:01.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.205+0000 7f5d55ffb700 1 -- 172.21.15.77:0/4107874252 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5d50056d20 con 0x7f5d60103780 2024-04-25T02:05:01.210 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-25T02:05:01.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.207+0000 7f5d672e8700 1 -- 172.21.15.77:0/4107874252 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f5d4c0692a0 msgr2=0x7f5d4c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:01.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.207+0000 7f5d672e8700 1 --2- 172.21.15.77:0/4107874252 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f5d4c0692a0 0x7f5d4c06b750 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c004f90 tx=0x7f5d5c009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:01.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.207+0000 7f5d672e8700 1 -- 172.21.15.77:0/4107874252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d60103780 msgr2=0x7f5d601160a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:01.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.207+0000 7f5d672e8700 1 --2- 172.21.15.77:0/4107874252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d60103780 0x7f5d601160a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000b790 tx=0x7f5d50009220 comp rx=0 tx=0).stop 2024-04-25T02:05:01.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.207+0000 7f5d672e8700 1 -- 172.21.15.77:0/4107874252 shutdown_connections 2024-04-25T02:05:01.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.207+0000 7f5d672e8700 1 --2- 172.21.15.77:0/4107874252 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f5d4c0692a0 0x7f5d4c06b750 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:01.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.207+0000 7f5d672e8700 1 --2- 172.21.15.77:0/4107874252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d60102de0 0x7f5d60115b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:01.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.207+0000 7f5d672e8700 1 --2- 172.21.15.77:0/4107874252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d60103780 0x7f5d601160a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:01.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.207+0000 7f5d672e8700 1 -- 172.21.15.77:0/4107874252 >> 172.21.15.77:0/4107874252 conn(0x7f5d600f8990 msgr2=0x7f5d600fa490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:01.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.207+0000 7f5d672e8700 1 -- 172.21.15.77:0/4107874252 shutdown_connections 2024-04-25T02:05:01.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:01.207+0000 7f5d672e8700 1 -- 172.21.15.77:0/4107874252 wait complete. 2024-04-25T02:05:01.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:00 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:05:01.772 INFO:tasks.cephadm:Setting up client nodes... 2024-04-25T02:05:01.772 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-25T02:05:02.022 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:05:02.144 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:01 smithi077 ceph-mon[26330]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:02.144 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:01 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/4107874252' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:05:02.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:01 smithi112 ceph-mon[33313]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:02.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:01 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/4107874252' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:05:03.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.573+0000 7f16e23a1700 1 -- 172.21.15.77:0/1453957067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16dc0fe280 msgr2=0x7f16dc0fe690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:03.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.573+0000 7f16e23a1700 1 --2- 172.21.15.77:0/1453957067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16dc0fe280 0x7f16dc0fe690 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f16d8004940 tx=0x7f16d8009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:03.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.573+0000 7f16e23a1700 1 -- 172.21.15.77:0/1453957067 shutdown_connections 2024-04-25T02:05:03.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.573+0000 7f16e23a1700 1 --2- 172.21.15.77:0/1453957067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16dc0febd0 0x7f16dc0fad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:03.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.573+0000 7f16e23a1700 1 --2- 172.21.15.77:0/1453957067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16dc0fe280 0x7f16dc0fe690 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:03.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.573+0000 7f16e23a1700 1 -- 172.21.15.77:0/1453957067 >> 172.21.15.77:0/1453957067 conn(0x7f16dc0f6a00 msgr2=0x7f16dc0f8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:03.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.573+0000 7f16e23a1700 1 -- 172.21.15.77:0/1453957067 shutdown_connections 2024-04-25T02:05:03.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.573+0000 7f16e23a1700 1 -- 172.21.15.77:0/1453957067 wait complete. 2024-04-25T02:05:03.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.574+0000 7f16e23a1700 1 Processor -- start 2024-04-25T02:05:03.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.574+0000 7f16e23a1700 1 -- start start 2024-04-25T02:05:03.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.574+0000 7f16e23a1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16dc0fe280 0x7f16dc0fda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:03.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.574+0000 7f16e23a1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16dc0febd0 0x7f16dc0fbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:03.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.574+0000 7f16e23a1700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc0fc4f0 con 0x7f16dc0fe280 2024-04-25T02:05:03.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.574+0000 7f16e23a1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc0fc660 con 0x7f16dc0febd0 2024-04-25T02:05:03.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.574+0000 7f16e139f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16dc0fe280 0x7f16dc0fda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:03.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.574+0000 7f16e139f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16dc0fe280 0x7f16dc0fda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47294/0 (socket says 172.21.15.77:47294) 2024-04-25T02:05:03.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.574+0000 7f16e139f700 1 -- 172.21.15.77:0/4242388617 learned_addr learned my addr 172.21.15.77:0/4242388617 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:05:03.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.574+0000 7f16e0b9e700 1 --2- 172.21.15.77:0/4242388617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16dc0febd0 0x7f16dc0fbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:03.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.574+0000 7f16e139f700 1 -- 172.21.15.77:0/4242388617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16dc0febd0 msgr2=0x7f16dc0fbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:03.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.574+0000 7f16e139f700 1 --2- 172.21.15.77:0/4242388617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16dc0febd0 0x7f16dc0fbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:03.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.574+0000 7f16e139f700 1 -- 172.21.15.77:0/4242388617 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d8005040 con 0x7f16dc0fe280 2024-04-25T02:05:03.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.574+0000 7f16e139f700 1 --2- 172.21.15.77:0/4242388617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16dc0fe280 0x7f16dc0fda70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f16d800b3b0 tx=0x7f16d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:03.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.575+0000 7f16d1ffb700 1 -- 172.21.15.77:0/4242388617 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16d800e040 con 0x7f16dc0fe280 2024-04-25T02:05:03.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.575+0000 7f16d1ffb700 1 -- 172.21.15.77:0/4242388617 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f16d800bbf0 con 0x7f16dc0fe280 2024-04-25T02:05:03.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.575+0000 7f16e23a1700 1 -- 172.21.15.77:0/4242388617 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16dc0fc8e0 con 0x7f16dc0fe280 2024-04-25T02:05:03.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.575+0000 7f16d1ffb700 1 -- 172.21.15.77:0/4242388617 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16d801c630 con 0x7f16dc0fe280 2024-04-25T02:05:03.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.575+0000 7f16e23a1700 1 -- 172.21.15.77:0/4242388617 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16dc115860 con 0x7f16dc0fe280 2024-04-25T02:05:03.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.576+0000 7f16e23a1700 1 -- 172.21.15.77:0/4242388617 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16dc0fa6c0 con 0x7f16dc0fe280 2024-04-25T02:05:03.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.576+0000 7f16d1ffb700 1 -- 172.21.15.77:0/4242388617 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f16d800bd60 con 0x7f16dc0fe280 2024-04-25T02:05:03.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.577+0000 7f16d1ffb700 1 --2- 172.21.15.77:0/4242388617 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f16c80692a0 0x7f16c806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:03.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.577+0000 7f16d1ffb700 1 -- 172.21.15.77:0/4242388617 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f16d8087b10 con 0x7f16dc0fe280 2024-04-25T02:05:03.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.577+0000 7f16e0b9e700 1 --2- 172.21.15.77:0/4242388617 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f16c80692a0 0x7f16c806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:03.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.577+0000 7f16e0b9e700 1 --2- 172.21.15.77:0/4242388617 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f16c80692a0 0x7f16c806b750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f16cc007fd0 tx=0x7f16cc009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:03.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.581+0000 7f16d1ffb700 1 -- 172.21.15.77:0/4242388617 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f16d8054180 con 0x7f16dc0fe280 2024-04-25T02:05:03.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.842+0000 7f16e23a1700 1 -- 172.21.15.77:0/4242388617 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f16dc1159f0 con 0x7f16dc0fe280 2024-04-25T02:05:03.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.846+0000 7f16d1ffb700 1 -- 172.21.15.77:0/4242388617 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f16d80577a0 con 0x7f16dc0fe280 2024-04-25T02:05:03.852 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2024-04-25T02:05:03.852 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBPuilmRDdTMhAAWjdrhINs8f5JStMxNNMqsg== 2024-04-25T02:05:03.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.848+0000 7f16e23a1700 1 -- 172.21.15.77:0/4242388617 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f16c80692a0 msgr2=0x7f16c806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:03.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.848+0000 7f16e23a1700 1 --2- 172.21.15.77:0/4242388617 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f16c80692a0 0x7f16c806b750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f16cc007fd0 tx=0x7f16cc009040 comp rx=0 tx=0).stop 2024-04-25T02:05:03.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.848+0000 7f16e23a1700 1 -- 172.21.15.77:0/4242388617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16dc0fe280 msgr2=0x7f16dc0fda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:03.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.848+0000 7f16e23a1700 1 --2- 172.21.15.77:0/4242388617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16dc0fe280 0x7f16dc0fda70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f16d800b3b0 tx=0x7f16d8009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:03.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.848+0000 7f16e23a1700 1 -- 172.21.15.77:0/4242388617 shutdown_connections 2024-04-25T02:05:03.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.848+0000 7f16e23a1700 1 --2- 172.21.15.77:0/4242388617 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f16c80692a0 0x7f16c806b750 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:03.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.848+0000 7f16e23a1700 1 --2- 172.21.15.77:0/4242388617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16dc0fe280 0x7f16dc0fda70 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:03.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.848+0000 7f16e23a1700 1 --2- 172.21.15.77:0/4242388617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f16dc0febd0 0x7f16dc0fbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:03.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.848+0000 7f16e23a1700 1 -- 172.21.15.77:0/4242388617 >> 172.21.15.77:0/4242388617 conn(0x7f16dc0f6a00 msgr2=0x7f16dc0f80f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:03.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.848+0000 7f16e23a1700 1 -- 172.21.15.77:0/4242388617 shutdown_connections 2024-04-25T02:05:03.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:03.848+0000 7f16e23a1700 1 -- 172.21.15.77:0/4242388617 wait complete. 2024-04-25T02:05:04.152 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:03 smithi077 ceph-mon[26330]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:04.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:03 smithi112 ceph-mon[33313]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:04.559 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T02:05:04.560 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-25T02:05:04.560 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T02:05:04.596 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-25T02:05:04.857 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi112/config 2024-04-25T02:05:04.979 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:04 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/4242388617' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-25T02:05:04.979 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:04 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/4242388617' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-25T02:05:05.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:04 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/4242388617' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-25T02:05:05.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:04 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/4242388617' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-25T02:05:06.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:05 smithi112 ceph-mon[33313]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:06.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:05 smithi077 ceph-mon[26330]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:06.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.429+0000 7fdee2e3e700 1 -- 172.21.15.112:0/4275127949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdedc0fdfd0 msgr2=0x7fdedc0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:06.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.429+0000 7fdee2e3e700 1 --2- 172.21.15.112:0/4275127949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdedc0fdfd0 0x7fdedc0fe440 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdec8004940 tx=0x7fdec8009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:06.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.429+0000 7fdee2e3e700 1 -- 172.21.15.112:0/4275127949 shutdown_connections 2024-04-25T02:05:06.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.429+0000 7fdee2e3e700 1 --2- 172.21.15.112:0/4275127949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdedc0fdfd0 0x7fdedc0fe440 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:06.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.429+0000 7fdee2e3e700 1 --2- 172.21.15.112:0/4275127949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdedc0fce60 0x7fdedc0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:06.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.429+0000 7fdee2e3e700 1 -- 172.21.15.112:0/4275127949 >> 172.21.15.112:0/4275127949 conn(0x7fdedc0f8540 msgr2=0x7fdedc0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:06.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.429+0000 7fdee2e3e700 1 -- 172.21.15.112:0/4275127949 shutdown_connections 2024-04-25T02:05:06.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.429+0000 7fdee2e3e700 1 -- 172.21.15.112:0/4275127949 wait complete. 2024-04-25T02:05:06.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.430+0000 7fdee2e3e700 1 Processor -- start 2024-04-25T02:05:06.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.430+0000 7fdee2e3e700 1 -- start start 2024-04-25T02:05:06.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.430+0000 7fdee2e3e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdedc0fce60 0x7fdedc071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:06.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.430+0000 7fdee2e3e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdedc0fdfd0 0x7fdedc0702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:06.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.430+0000 7fdee2e3e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc072200 con 0x7fdedc0fce60 2024-04-25T02:05:06.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.430+0000 7fdee2e3e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc0707f0 con 0x7fdedc0fdfd0 2024-04-25T02:05:06.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.431+0000 7fdedbfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdedc0fdfd0 0x7fdedc0702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:06.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.431+0000 7fdedbfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdedc0fdfd0 0x7fdedc0702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45508/0 (socket says 172.21.15.112:45508) 2024-04-25T02:05:06.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.431+0000 7fdedbfff700 1 -- 172.21.15.112:0/4253680868 learned_addr learned my addr 172.21.15.112:0/4253680868 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T02:05:06.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.431+0000 7fdee0bda700 1 --2- 172.21.15.112:0/4253680868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdedc0fce60 0x7fdedc071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:06.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.431+0000 7fdedbfff700 1 -- 172.21.15.112:0/4253680868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdedc0fce60 msgr2=0x7fdedc071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:06.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.431+0000 7fdedbfff700 1 --2- 172.21.15.112:0/4253680868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdedc0fce60 0x7fdedc071c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:06.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.431+0000 7fdedbfff700 1 -- 172.21.15.112:0/4253680868 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec8005040 con 0x7fdedc0fdfd0 2024-04-25T02:05:06.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.431+0000 7fdedbfff700 1 --2- 172.21.15.112:0/4253680868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdedc0fdfd0 0x7fdedc0702b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdec800b3b0 tx=0x7fdec8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:06.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.431+0000 7fded97fa700 1 -- 172.21.15.112:0/4253680868 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdec800e040 con 0x7fdedc0fdfd0 2024-04-25T02:05:06.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.431+0000 7fded97fa700 1 -- 172.21.15.112:0/4253680868 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdec800bcc0 con 0x7fdedc0fdfd0 2024-04-25T02:05:06.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.431+0000 7fdee2e3e700 1 -- 172.21.15.112:0/4253680868 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdedc070a40 con 0x7fdedc0fdfd0 2024-04-25T02:05:06.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.431+0000 7fded97fa700 1 -- 172.21.15.112:0/4253680868 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdec801c630 con 0x7fdedc0fdfd0 2024-04-25T02:05:06.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.431+0000 7fdee2e3e700 1 -- 172.21.15.112:0/4253680868 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdedc071000 con 0x7fdedc0fdfd0 2024-04-25T02:05:06.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.432+0000 7fdee2e3e700 1 -- 172.21.15.112:0/4253680868 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdedc04c710 con 0x7fdedc0fdfd0 2024-04-25T02:05:06.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.433+0000 7fded97fa700 1 -- 172.21.15.112:0/4253680868 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fdec8013420 con 0x7fdedc0fdfd0 2024-04-25T02:05:06.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.433+0000 7fded97fa700 1 --2- 172.21.15.112:0/4253680868 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fdecc0692a0 0x7fdecc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:06.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.433+0000 7fded97fa700 1 -- 172.21.15.112:0/4253680868 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fdec8087ca0 con 0x7fdedc0fdfd0 2024-04-25T02:05:06.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.433+0000 7fdee0bda700 1 --2- 172.21.15.112:0/4253680868 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fdecc0692a0 0x7fdecc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:06.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.434+0000 7fdee0bda700 1 --2- 172.21.15.112:0/4253680868 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fdecc0692a0 0x7fdecc06b750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fded0004d60 tx=0x7fded000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:06.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.437+0000 7fded97fa700 1 -- 172.21.15.112:0/4253680868 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fdec808c070 con 0x7fdedc0fdfd0 2024-04-25T02:05:06.701 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.695+0000 7fdee2e3e700 1 -- 172.21.15.112:0/4253680868 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fdedc1058c0 con 0x7fdedc0fdfd0 2024-04-25T02:05:06.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.700+0000 7fded97fa700 1 -- 172.21.15.112:0/4253680868 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7fdec8057d20 con 0x7fdedc0fdfd0 2024-04-25T02:05:06.706 INFO:teuthology.orchestra.run.smithi112.stdout:[client.1] 2024-04-25T02:05:06.706 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBSuilmtIWVKRAAY/xSHxR4l0uH82PStN70CA== 2024-04-25T02:05:06.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.702+0000 7fdee2e3e700 1 -- 172.21.15.112:0/4253680868 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fdecc0692a0 msgr2=0x7fdecc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:06.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.702+0000 7fdee2e3e700 1 --2- 172.21.15.112:0/4253680868 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fdecc0692a0 0x7fdecc06b750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fded0004d60 tx=0x7fded000b040 comp rx=0 tx=0).stop 2024-04-25T02:05:06.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.702+0000 7fdee2e3e700 1 -- 172.21.15.112:0/4253680868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdedc0fdfd0 msgr2=0x7fdedc0702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:06.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.702+0000 7fdee2e3e700 1 --2- 172.21.15.112:0/4253680868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdedc0fdfd0 0x7fdedc0702b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdec800b3b0 tx=0x7fdec8009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:06.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.702+0000 7fdee2e3e700 1 -- 172.21.15.112:0/4253680868 shutdown_connections 2024-04-25T02:05:06.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.702+0000 7fdee2e3e700 1 --2- 172.21.15.112:0/4253680868 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fdecc0692a0 0x7fdecc06b750 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:06.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.702+0000 7fdee2e3e700 1 --2- 172.21.15.112:0/4253680868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdedc0fce60 0x7fdedc071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:06.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.702+0000 7fdee2e3e700 1 --2- 172.21.15.112:0/4253680868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdedc0fdfd0 0x7fdedc0702b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:06.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.702+0000 7fdee2e3e700 1 -- 172.21.15.112:0/4253680868 >> 172.21.15.112:0/4253680868 conn(0x7fdedc0f8540 msgr2=0x7fdedc0f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:06.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.703+0000 7fdee2e3e700 1 -- 172.21.15.112:0/4253680868 shutdown_connections 2024-04-25T02:05:06.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:05:06.703+0000 7fdee2e3e700 1 -- 172.21.15.112:0/4253680868 wait complete. 2024-04-25T02:05:07.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:06 smithi112 ceph-mon[33313]: from='client.? 172.21.15.112:0/4253680868' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-25T02:05:07.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:06 smithi112 ceph-mon[33313]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-25T02:05:07.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:06 smithi112 ceph-mon[33313]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-25T02:05:07.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:06 smithi077 ceph-mon[26330]: from='client.? 172.21.15.112:0/4253680868' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-25T02:05:07.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:06 smithi077 ceph-mon[26330]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-25T02:05:07.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:06 smithi077 ceph-mon[26330]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-25T02:05:07.375 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T02:05:07.375 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-04-25T02:05:07.375 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-25T02:05:07.412 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T02:05:07.412 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-25T02:05:07.412 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph mgr dump --format=json 2024-04-25T02:05:07.674 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:05:08.080 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:07 smithi077 ceph-mon[26330]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:08.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:07 smithi112 ceph-mon[33313]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:09.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.276+0000 7f79e1f01700 1 -- 172.21.15.77:0/1991890400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79dc101d00 msgr2=0x7f79dc1020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:09.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.276+0000 7f79e1f01700 1 --2- 172.21.15.77:0/1991890400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79dc101d00 0x7f79dc1020d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f79cc004940 tx=0x7f79cc009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:09.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.277+0000 7f79e1f01700 1 -- 172.21.15.77:0/1991890400 shutdown_connections 2024-04-25T02:05:09.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.277+0000 7f79e1f01700 1 --2- 172.21.15.77:0/1991890400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79dc1026a0 0x7f79dc0fbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:09.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.277+0000 7f79e1f01700 1 --2- 172.21.15.77:0/1991890400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79dc101d00 0x7f79dc1020d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:09.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.277+0000 7f79e1f01700 1 -- 172.21.15.77:0/1991890400 >> 172.21.15.77:0/1991890400 conn(0x7f79dc0f7870 msgr2=0x7f79dc0f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:09.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.277+0000 7f79e1f01700 1 -- 172.21.15.77:0/1991890400 shutdown_connections 2024-04-25T02:05:09.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.277+0000 7f79e1f01700 1 -- 172.21.15.77:0/1991890400 wait complete. 2024-04-25T02:05:09.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.277+0000 7f79e1f01700 1 Processor -- start 2024-04-25T02:05:09.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.277+0000 7f79e1f01700 1 -- start start 2024-04-25T02:05:09.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.278+0000 7f79e1f01700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79dc101d00 0x7f79dc112890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:09.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.278+0000 7f79e1f01700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79dc1026a0 0x7f79dc112dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:09.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.278+0000 7f79e1f01700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc1134b0 con 0x7f79dc101d00 2024-04-25T02:05:09.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.278+0000 7f79e1f01700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc10ca20 con 0x7f79dc1026a0 2024-04-25T02:05:09.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.278+0000 7f79db7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79dc101d00 0x7f79dc112890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:09.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.278+0000 7f79db7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79dc101d00 0x7f79dc112890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60530/0 (socket says 172.21.15.77:60530) 2024-04-25T02:05:09.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.278+0000 7f79db7fe700 1 -- 172.21.15.77:0/2485787638 learned_addr learned my addr 172.21.15.77:0/2485787638 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:05:09.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.278+0000 7f79daffd700 1 --2- 172.21.15.77:0/2485787638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79dc1026a0 0x7f79dc112dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:09.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.278+0000 7f79db7fe700 1 -- 172.21.15.77:0/2485787638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79dc1026a0 msgr2=0x7f79dc112dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:09.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.278+0000 7f79db7fe700 1 --2- 172.21.15.77:0/2485787638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79dc1026a0 0x7f79dc112dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:09.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.278+0000 7f79db7fe700 1 -- 172.21.15.77:0/2485787638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79cc005040 con 0x7f79dc101d00 2024-04-25T02:05:09.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.278+0000 7f79daffd700 1 --2- 172.21.15.77:0/2485787638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79dc1026a0 0x7f79dc112dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:05:09.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.278+0000 7f79db7fe700 1 --2- 172.21.15.77:0/2485787638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79dc101d00 0x7f79dc112890 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00b3b0 tx=0x7f79cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:09.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.278+0000 7f79c3fff700 1 -- 172.21.15.77:0/2485787638 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79cc00e040 con 0x7f79dc101d00 2024-04-25T02:05:09.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.278+0000 7f79c3fff700 1 -- 172.21.15.77:0/2485787638 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f79cc00bbc0 con 0x7f79dc101d00 2024-04-25T02:05:09.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.278+0000 7f79e1f01700 1 -- 172.21.15.77:0/2485787638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79dc10cca0 con 0x7f79dc101d00 2024-04-25T02:05:09.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.278+0000 7f79c3fff700 1 -- 172.21.15.77:0/2485787638 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79cc01c3f0 con 0x7f79dc101d00 2024-04-25T02:05:09.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.279+0000 7f79e1f01700 1 -- 172.21.15.77:0/2485787638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79dc10d260 con 0x7f79dc101d00 2024-04-25T02:05:09.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.279+0000 7f79e1f01700 1 -- 172.21.15.77:0/2485787638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79dc0fd450 con 0x7f79dc101d00 2024-04-25T02:05:09.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.280+0000 7f79c3fff700 1 -- 172.21.15.77:0/2485787638 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f79cc00bd30 con 0x7f79dc101d00 2024-04-25T02:05:09.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.280+0000 7f79c3fff700 1 --2- 172.21.15.77:0/2485787638 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f79c40692a0 0x7f79c406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:09.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.280+0000 7f79c3fff700 1 -- 172.21.15.77:0/2485787638 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f79cc088100 con 0x7f79dc101d00 2024-04-25T02:05:09.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.280+0000 7f79daffd700 1 --2- 172.21.15.77:0/2485787638 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f79c40692a0 0x7f79c406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:09.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.281+0000 7f79daffd700 1 --2- 172.21.15.77:0/2485787638 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f79c40692a0 0x7f79c406b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f79d0006fd0 tx=0x7f79d0008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:09.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.285+0000 7f79c3fff700 1 -- 172.21.15.77:0/2485787638 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f79cc058230 con 0x7f79dc101d00 2024-04-25T02:05:09.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.523+0000 7f79e1f01700 1 -- 172.21.15.77:0/2485787638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f79dc108e70 con 0x7f79dc101d00 2024-04-25T02:05:09.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.526+0000 7f79c3fff700 1 -- 172.21.15.77:0/2485787638 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+167174 (secure 0 0 0) 0x7f79cc057dc0 con 0x7f79dc101d00 2024-04-25T02:05:09.535 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:05:09.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.529+0000 7f79e1f01700 1 -- 172.21.15.77:0/2485787638 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f79c40692a0 msgr2=0x7f79c406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:09.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.529+0000 7f79e1f01700 1 --2- 172.21.15.77:0/2485787638 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f79c40692a0 0x7f79c406b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f79d0006fd0 tx=0x7f79d0008040 comp rx=0 tx=0).stop 2024-04-25T02:05:09.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.529+0000 7f79e1f01700 1 -- 172.21.15.77:0/2485787638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79dc101d00 msgr2=0x7f79dc112890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:09.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.529+0000 7f79e1f01700 1 --2- 172.21.15.77:0/2485787638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79dc101d00 0x7f79dc112890 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00b3b0 tx=0x7f79cc009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:09.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.530+0000 7f79e1f01700 1 -- 172.21.15.77:0/2485787638 shutdown_connections 2024-04-25T02:05:09.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.530+0000 7f79e1f01700 1 --2- 172.21.15.77:0/2485787638 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f79c40692a0 0x7f79c406b750 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:09.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.530+0000 7f79e1f01700 1 --2- 172.21.15.77:0/2485787638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79dc101d00 0x7f79dc112890 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:09.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.530+0000 7f79e1f01700 1 --2- 172.21.15.77:0/2485787638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79dc1026a0 0x7f79dc112dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:09.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.530+0000 7f79e1f01700 1 -- 172.21.15.77:0/2485787638 >> 172.21.15.77:0/2485787638 conn(0x7f79dc0f7870 msgr2=0x7f79dc0f8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:09.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.530+0000 7f79e1f01700 1 -- 172.21.15.77:0/2485787638 shutdown_connections 2024-04-25T02:05:09.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:09.530+0000 7f79e1f01700 1 -- 172.21.15.77:0/2485787638 wait complete. 2024-04-25T02:05:10.216 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:09 smithi077 ceph-mon[26330]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:10.216 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:09 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/2485787638' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-25T02:05:10.240 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":19,"flags":0,"active_gid":14208,"active_name":"smithi077.zpflzp","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":310739264},{"type":"v1","addr":"172.21.15.77:6801","nonce":310739264}]},"active_addr":"172.21.15.77:6801/310739264","active_change":"2024-04-25T02:01:30.378043+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14228,"name":"smithi112.cswrxs","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.77:8443/","prometheus":"http://172.21.15.77:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":1802503387}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":863377592}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":2089066429}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":114993391}]}]} 2024-04-25T02:05:10.244 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-25T02:05:10.244 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-25T02:05:10.244 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-25T02:05:10.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:09 smithi112 ceph-mon[33313]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:10.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:09 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/2485787638' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-25T02:05:10.494 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:05:12.126 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:11 smithi077 ceph-mon[26330]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:12.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.134+0000 7f45011fb700 1 -- 172.21.15.77:0/1989074391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44fc0fbd40 msgr2=0x7f44fc0fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:12.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.134+0000 7f45011fb700 1 --2- 172.21.15.77:0/1989074391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44fc0fbd40 0x7f44fc0fc1b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f44e4004940 tx=0x7f44e4009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:12.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.134+0000 7f45011fb700 1 -- 172.21.15.77:0/1989074391 shutdown_connections 2024-04-25T02:05:12.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.134+0000 7f45011fb700 1 --2- 172.21.15.77:0/1989074391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44fc0fbd40 0x7f44fc0fc1b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:12.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.134+0000 7f45011fb700 1 --2- 172.21.15.77:0/1989074391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44fc101d90 0x7f44fc102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:12.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.134+0000 7f45011fb700 1 -- 172.21.15.77:0/1989074391 >> 172.21.15.77:0/1989074391 conn(0x7f44fc071d00 msgr2=0x7f44fc072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:12.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.134+0000 7f45011fb700 1 -- 172.21.15.77:0/1989074391 shutdown_connections 2024-04-25T02:05:12.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.134+0000 7f45011fb700 1 -- 172.21.15.77:0/1989074391 wait complete. 2024-04-25T02:05:12.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.135+0000 7f45011fb700 1 Processor -- start 2024-04-25T02:05:12.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.135+0000 7f45011fb700 1 -- start start 2024-04-25T02:05:12.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.135+0000 7f45011fb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44fc0fbd40 0x7f44fc10ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:12.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.135+0000 7f45011fb700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44fc101d90 0x7f44fc10f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:12.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.135+0000 7f45011fb700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc10f750 con 0x7f44fc101d90 2024-04-25T02:05:12.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.135+0000 7f45011fb700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc10f890 con 0x7f44fc0fbd40 2024-04-25T02:05:12.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.135+0000 7f44fa59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44fc101d90 0x7f44fc10f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:12.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.135+0000 7f44fa59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44fc101d90 0x7f44fc10f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60560/0 (socket says 172.21.15.77:60560) 2024-04-25T02:05:12.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.135+0000 7f44fa59c700 1 -- 172.21.15.77:0/555286254 learned_addr learned my addr 172.21.15.77:0/555286254 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:05:12.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.135+0000 7f44fad9d700 1 --2- 172.21.15.77:0/555286254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44fc0fbd40 0x7f44fc10ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:12.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.135+0000 7f44fa59c700 1 -- 172.21.15.77:0/555286254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44fc0fbd40 msgr2=0x7f44fc10ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:12.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.135+0000 7f44fa59c700 1 --2- 172.21.15.77:0/555286254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44fc0fbd40 0x7f44fc10ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:12.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.135+0000 7f44fa59c700 1 -- 172.21.15.77:0/555286254 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e4005040 con 0x7f44fc101d90 2024-04-25T02:05:12.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.135+0000 7f44fad9d700 1 --2- 172.21.15.77:0/555286254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44fc0fbd40 0x7f44fc10ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:05:12.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.135+0000 7f44fa59c700 1 --2- 172.21.15.77:0/555286254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44fc101d90 0x7f44fc10f210 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f44e400b3b0 tx=0x7f44e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:12.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.135+0000 7f44f37fe700 1 -- 172.21.15.77:0/555286254 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44e400e040 con 0x7f44fc101d90 2024-04-25T02:05:12.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.135+0000 7f45011fb700 1 -- 172.21.15.77:0/555286254 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44fc117b80 con 0x7f44fc101d90 2024-04-25T02:05:12.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.136+0000 7f44f37fe700 1 -- 172.21.15.77:0/555286254 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f44e400bbc0 con 0x7f44fc101d90 2024-04-25T02:05:12.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.136+0000 7f44f37fe700 1 -- 172.21.15.77:0/555286254 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44e401c630 con 0x7f44fc101d90 2024-04-25T02:05:12.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.136+0000 7f45011fb700 1 -- 172.21.15.77:0/555286254 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44fc118110 con 0x7f44fc101d90 2024-04-25T02:05:12.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.136+0000 7f45011fb700 1 -- 172.21.15.77:0/555286254 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44fc0fd430 con 0x7f44fc101d90 2024-04-25T02:05:12.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.137+0000 7f44f37fe700 1 -- 172.21.15.77:0/555286254 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f44e400bd30 con 0x7f44fc101d90 2024-04-25T02:05:12.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.138+0000 7f44f37fe700 1 --2- 172.21.15.77:0/555286254 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f44e80692a0 0x7f44e806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:12.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.138+0000 7f44f37fe700 1 -- 172.21.15.77:0/555286254 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f44e4088120 con 0x7f44fc101d90 2024-04-25T02:05:12.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.138+0000 7f44fad9d700 1 --2- 172.21.15.77:0/555286254 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f44e80692a0 0x7f44e806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:12.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.138+0000 7f44fad9d700 1 --2- 172.21.15.77:0/555286254 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f44e80692a0 0x7f44e806b750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f44f4001250 tx=0x7f44f400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:12.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.142+0000 7f44f37fe700 1 -- 172.21.15.77:0/555286254 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f44e4054830 con 0x7f44fc101d90 2024-04-25T02:05:12.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:11 smithi112 ceph-mon[33313]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:12.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.338+0000 7f45011fb700 1 -- 172.21.15.77:0/555286254 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44fc04bed0 con 0x7f44fc101d90 2024-04-25T02:05:12.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.339+0000 7f44f37fe700 1 -- 172.21.15.77:0/555286254 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11043 (secure 0 0 0) 0x7f44e4057e50 con 0x7f44fc101d90 2024-04-25T02:05:12.346 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:05:12.346 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":41,"fsid":"4bb93d82-02a7-11ef-bc93-c7b262605968","created":"2024-04-25T01:59:22.235413+0000","modified":"2024-04-25T02:04:53.747863+0000","last_up_change":"2024-04-25T02:04:52.742695+0000","last_in_change":"2024-04-25T02:04:33.912973+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:03:38.692032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"1533372f-b1a5-4ec0-9524-9940f870d874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3624813295},{"type":"v1","addr":"172.21.15.77:6803","nonce":3624813295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3624813295},{"type":"v1","addr":"172.21.15.77:6805","nonce":3624813295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3624813295},{"type":"v1","addr":"172.21.15.77:6809","nonce":3624813295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3624813295},{"type":"v1","addr":"172.21.15.77:6807","nonce":3624813295}]},"public_addr":"172.21.15.77:6803/3624813295","cluster_addr":"172.21.15.77:6805/3624813295","heartbeat_back_addr":"172.21.15.77:6809/3624813295","heartbeat_front_addr":"172.21.15.77:6807/3624813295","state":["exists","up"]},{"osd":1,"uuid":"cb083b21-fd25-4ac4-bbde-6387c3253d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3061147623},{"type":"v1","addr":"172.21.15.77:6811","nonce":3061147623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3061147623},{"type":"v1","addr":"172.21.15.77:6813","nonce":3061147623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3061147623},{"type":"v1","addr":"172.21.15.77:6817","nonce":3061147623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3061147623},{"type":"v1","addr":"172.21.15.77:6815","nonce":3061147623}]},"public_addr":"172.21.15.77:6811/3061147623","cluster_addr":"172.21.15.77:6813/3061147623","heartbeat_back_addr":"172.21.15.77:6817/3061147623","heartbeat_front_addr":"172.21.15.77:6815/3061147623","state":["exists","up"]},{"osd":2,"uuid":"39b4553c-c1ed-489b-aead-210f38ac86b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":625070655},{"type":"v1","addr":"172.21.15.77:6819","nonce":625070655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":625070655},{"type":"v1","addr":"172.21.15.77:6821","nonce":625070655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":625070655},{"type":"v1","addr":"172.21.15.77:6825","nonce":625070655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":625070655},{"type":"v1","addr":"172.21.15.77:6823","nonce":625070655}]},"public_addr":"172.21.15.77:6819/625070655","cluster_addr":"172.21.15.77:6821/625070655","heartbeat_back_addr":"172.21.15.77:6825/625070655","heartbeat_front_addr":"172.21.15.77:6823/625070655","state":["exists","up"]},{"osd":3,"uuid":"addec0fa-80ee-465d-9d3e-c801d7bd9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":36251324},{"type":"v1","addr":"172.21.15.112:6801","nonce":36251324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":36251324},{"type":"v1","addr":"172.21.15.112:6803","nonce":36251324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":36251324},{"type":"v1","addr":"172.21.15.112:6807","nonce":36251324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":36251324},{"type":"v1","addr":"172.21.15.112:6805","nonce":36251324}]},"public_addr":"172.21.15.112:6801/36251324","cluster_addr":"172.21.15.112:6803/36251324","heartbeat_back_addr":"172.21.15.112:6807/36251324","heartbeat_front_addr":"172.21.15.112:6805/36251324","state":["exists","up"]},{"osd":4,"uuid":"93465def-0617-4ba8-915a-b3ea85c8f6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":581823847},{"type":"v1","addr":"172.21.15.112:6809","nonce":581823847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":581823847},{"type":"v1","addr":"172.21.15.112:6811","nonce":581823847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":581823847},{"type":"v1","addr":"172.21.15.112:6815","nonce":581823847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":581823847},{"type":"v1","addr":"172.21.15.112:6813","nonce":581823847}]},"public_addr":"172.21.15.112:6809/581823847","cluster_addr":"172.21.15.112:6811/581823847","heartbeat_back_addr":"172.21.15.112:6815/581823847","heartbeat_front_addr":"172.21.15.112:6813/581823847","state":["exists","up"]},{"osd":5,"uuid":"d3f693f5-324b-4a48-8f24-77e65c5f7f7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4063265473},{"type":"v1","addr":"172.21.15.112:6817","nonce":4063265473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4063265473},{"type":"v1","addr":"172.21.15.112:6819","nonce":4063265473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4063265473},{"type":"v1","addr":"172.21.15.112:6823","nonce":4063265473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4063265473},{"type":"v1","addr":"172.21.15.112:6821","nonce":4063265473}]},"public_addr":"172.21.15.112:6817/4063265473","cluster_addr":"172.21.15.112:6819/4063265473","heartbeat_back_addr":"172.21.15.112:6823/4063265473","heartbeat_front_addr":"172.21.15.112:6821/4063265473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:42.635624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:10.189211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:35.781710+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:59.250841+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:25.155356+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:51.315370+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:6801/2375514340":"2024-04-26T02:01:30.377936+0000","172.21.15.77:0/3184722826":"2024-04-26T02:01:30.377936+0000","172.21.15.77:0/2490024809":"2024-04-26T02:01:30.377936+0000","172.21.15.77:0/543110241":"2024-04-26T02:01:30.377936+0000","172.21.15.77:0/1779967375":"2024-04-26T02:00:25.057598+0000","172.21.15.77:0/2265849210":"2024-04-26T02:00:25.057598+0000","172.21.15.77:6801/859750200":"2024-04-26T02:00:25.057598+0000","172.21.15.77:6801/839529497":"2024-04-26T01:59:54.491478+0000","172.21.15.77:6800/859750200":"2024-04-26T02:00:25.057598+0000","172.21.15.77:0/2254838943":"2024-04-26T02:00:25.057598+0000","172.21.15.77:6800/839529497":"2024-04-26T01:59:54.491478+0000","172.21.15.77:0/1177720370":"2024-04-26T01:59:54.491478+0000","172.21.15.77:6800/2375514340":"2024-04-26T02:01:30.377936+0000","172.21.15.77:0/265498985":"2024-04-26T01:59:54.491478+0000","172.21.15.77:0/1743910051":"2024-04-26T01:59:54.491478+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:05:12.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.341+0000 7f45011fb700 1 -- 172.21.15.77:0/555286254 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f44e80692a0 msgr2=0x7f44e806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:12.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.341+0000 7f45011fb700 1 --2- 172.21.15.77:0/555286254 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f44e80692a0 0x7f44e806b750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f44f4001250 tx=0x7f44f400b040 comp rx=0 tx=0).stop 2024-04-25T02:05:12.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.341+0000 7f45011fb700 1 -- 172.21.15.77:0/555286254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44fc101d90 msgr2=0x7f44fc10f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:12.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.341+0000 7f45011fb700 1 --2- 172.21.15.77:0/555286254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44fc101d90 0x7f44fc10f210 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f44e400b3b0 tx=0x7f44e4009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:12.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.341+0000 7f45011fb700 1 -- 172.21.15.77:0/555286254 shutdown_connections 2024-04-25T02:05:12.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.341+0000 7f45011fb700 1 --2- 172.21.15.77:0/555286254 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f44e80692a0 0x7f44e806b750 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:12.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.341+0000 7f45011fb700 1 --2- 172.21.15.77:0/555286254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44fc0fbd40 0x7f44fc10ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:12.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.341+0000 7f45011fb700 1 --2- 172.21.15.77:0/555286254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44fc101d90 0x7f44fc10f210 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:12.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.341+0000 7f45011fb700 1 -- 172.21.15.77:0/555286254 >> 172.21.15.77:0/555286254 conn(0x7f44fc071d00 msgr2=0x7f44fc104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:12.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.341+0000 7f45011fb700 1 -- 172.21.15.77:0/555286254 shutdown_connections 2024-04-25T02:05:12.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:12.341+0000 7f45011fb700 1 -- 172.21.15.77:0/555286254 wait complete. 2024-04-25T02:05:12.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:12 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/555286254' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:05:13.038 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-25T02:05:13.039 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-25T02:05:13.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:12 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/555286254' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:05:13.296 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:05:13.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:13 smithi077 ceph-mon[26330]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:14.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:13 smithi112 ceph-mon[33313]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:14.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.848+0000 7f7309b79700 1 -- 172.21.15.77:0/118417900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7304101cd0 msgr2=0x7f73041020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:14.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.848+0000 7f7309b79700 1 --2- 172.21.15.77:0/118417900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7304101cd0 0x7f73041020a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009ce0 tx=0x7f72fc004d10 comp rx=0 tx=0).stop 2024-04-25T02:05:14.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.848+0000 7f7309b79700 1 -- 172.21.15.77:0/118417900 shutdown_connections 2024-04-25T02:05:14.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.848+0000 7f7309b79700 1 --2- 172.21.15.77:0/118417900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7304102670 0x7f73040fb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:14.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.848+0000 7f7309b79700 1 --2- 172.21.15.77:0/118417900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7304101cd0 0x7f73041020a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:14.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.848+0000 7f7309b79700 1 -- 172.21.15.77:0/118417900 >> 172.21.15.77:0/118417900 conn(0x7f7304071460 msgr2=0x7f7304071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:14.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.848+0000 7f7309b79700 1 -- 172.21.15.77:0/118417900 shutdown_connections 2024-04-25T02:05:14.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.848+0000 7f7309b79700 1 -- 172.21.15.77:0/118417900 wait complete. 2024-04-25T02:05:14.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.849+0000 7f7309b79700 1 Processor -- start 2024-04-25T02:05:14.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.849+0000 7f7309b79700 1 -- start start 2024-04-25T02:05:14.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.849+0000 7f7309b79700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7304101cd0 0x7f7304113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:14.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.849+0000 7f7309b79700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7304102670 0x7f73041140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:14.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.849+0000 7f7309b79700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73041147a0 con 0x7f7304101cd0 2024-04-25T02:05:14.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.849+0000 7f7309b79700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730410db00 con 0x7f7304102670 2024-04-25T02:05:14.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.849+0000 7f73037fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7304101cd0 0x7f7304113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:14.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.849+0000 7f73037fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7304101cd0 0x7f7304113b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60576/0 (socket says 172.21.15.77:60576) 2024-04-25T02:05:14.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.849+0000 7f73037fe700 1 -- 172.21.15.77:0/4090279284 learned_addr learned my addr 172.21.15.77:0/4090279284 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:05:14.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.850+0000 7f73037fe700 1 -- 172.21.15.77:0/4090279284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7304102670 msgr2=0x7f73041140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:14.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.850+0000 7f73037fe700 1 --2- 172.21.15.77:0/4090279284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7304102670 0x7f73041140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:14.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.850+0000 7f73037fe700 1 -- 172.21.15.77:0/4090279284 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc009940 con 0x7f7304101cd0 2024-04-25T02:05:14.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.850+0000 7f73037fe700 1 --2- 172.21.15.77:0/4090279284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7304101cd0 0x7f7304113b80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009fd0 tx=0x7f72fc004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:14.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.850+0000 7f72ebfff700 1 -- 172.21.15.77:0/4090279284 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72fc00e070 con 0x7f7304101cd0 2024-04-25T02:05:14.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.850+0000 7f72ebfff700 1 -- 172.21.15.77:0/4090279284 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f72fc012ac0 con 0x7f7304101cd0 2024-04-25T02:05:14.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.850+0000 7f7309b79700 1 -- 172.21.15.77:0/4090279284 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f730410dd80 con 0x7f7304101cd0 2024-04-25T02:05:14.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.850+0000 7f72ebfff700 1 -- 172.21.15.77:0/4090279284 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72fc01b8f0 con 0x7f7304101cd0 2024-04-25T02:05:14.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.850+0000 7f7309b79700 1 -- 172.21.15.77:0/4090279284 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730410e340 con 0x7f7304101cd0 2024-04-25T02:05:14.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.851+0000 7f7309b79700 1 -- 172.21.15.77:0/4090279284 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7304065200 con 0x7f7304101cd0 2024-04-25T02:05:14.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.852+0000 7f72ebfff700 1 -- 172.21.15.77:0/4090279284 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f72fc019040 con 0x7f7304101cd0 2024-04-25T02:05:14.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.852+0000 7f72ebfff700 1 --2- 172.21.15.77:0/4090279284 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f72ec0692a0 0x7f72ec06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:14.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.852+0000 7f72ebfff700 1 -- 172.21.15.77:0/4090279284 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f72fc088640 con 0x7f7304101cd0 2024-04-25T02:05:14.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.852+0000 7f7302ffd700 1 --2- 172.21.15.77:0/4090279284 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f72ec0692a0 0x7f72ec06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:14.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.852+0000 7f7302ffd700 1 --2- 172.21.15.77:0/4090279284 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f72ec0692a0 0x7f72ec06b750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f72f8006fd0 tx=0x7f72f8006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:14.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:14.856+0000 7f72ebfff700 1 -- 172.21.15.77:0/4090279284 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f72fc058740 con 0x7f7304101cd0 2024-04-25T02:05:15.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:15.044+0000 7f7309b79700 1 -- 172.21.15.77:0/4090279284 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7304109fc0 con 0x7f7304101cd0 2024-04-25T02:05:15.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:15.045+0000 7f72ebfff700 1 -- 172.21.15.77:0/4090279284 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11043 (secure 0 0 0) 0x7f72fc0582d0 con 0x7f7304101cd0 2024-04-25T02:05:15.052 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:05:15.052 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":41,"fsid":"4bb93d82-02a7-11ef-bc93-c7b262605968","created":"2024-04-25T01:59:22.235413+0000","modified":"2024-04-25T02:04:53.747863+0000","last_up_change":"2024-04-25T02:04:52.742695+0000","last_in_change":"2024-04-25T02:04:33.912973+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:03:38.692032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"1533372f-b1a5-4ec0-9524-9940f870d874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3624813295},{"type":"v1","addr":"172.21.15.77:6803","nonce":3624813295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3624813295},{"type":"v1","addr":"172.21.15.77:6805","nonce":3624813295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3624813295},{"type":"v1","addr":"172.21.15.77:6809","nonce":3624813295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3624813295},{"type":"v1","addr":"172.21.15.77:6807","nonce":3624813295}]},"public_addr":"172.21.15.77:6803/3624813295","cluster_addr":"172.21.15.77:6805/3624813295","heartbeat_back_addr":"172.21.15.77:6809/3624813295","heartbeat_front_addr":"172.21.15.77:6807/3624813295","state":["exists","up"]},{"osd":1,"uuid":"cb083b21-fd25-4ac4-bbde-6387c3253d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3061147623},{"type":"v1","addr":"172.21.15.77:6811","nonce":3061147623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3061147623},{"type":"v1","addr":"172.21.15.77:6813","nonce":3061147623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3061147623},{"type":"v1","addr":"172.21.15.77:6817","nonce":3061147623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3061147623},{"type":"v1","addr":"172.21.15.77:6815","nonce":3061147623}]},"public_addr":"172.21.15.77:6811/3061147623","cluster_addr":"172.21.15.77:6813/3061147623","heartbeat_back_addr":"172.21.15.77:6817/3061147623","heartbeat_front_addr":"172.21.15.77:6815/3061147623","state":["exists","up"]},{"osd":2,"uuid":"39b4553c-c1ed-489b-aead-210f38ac86b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":625070655},{"type":"v1","addr":"172.21.15.77:6819","nonce":625070655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":625070655},{"type":"v1","addr":"172.21.15.77:6821","nonce":625070655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":625070655},{"type":"v1","addr":"172.21.15.77:6825","nonce":625070655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":625070655},{"type":"v1","addr":"172.21.15.77:6823","nonce":625070655}]},"public_addr":"172.21.15.77:6819/625070655","cluster_addr":"172.21.15.77:6821/625070655","heartbeat_back_addr":"172.21.15.77:6825/625070655","heartbeat_front_addr":"172.21.15.77:6823/625070655","state":["exists","up"]},{"osd":3,"uuid":"addec0fa-80ee-465d-9d3e-c801d7bd9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":36251324},{"type":"v1","addr":"172.21.15.112:6801","nonce":36251324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":36251324},{"type":"v1","addr":"172.21.15.112:6803","nonce":36251324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":36251324},{"type":"v1","addr":"172.21.15.112:6807","nonce":36251324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":36251324},{"type":"v1","addr":"172.21.15.112:6805","nonce":36251324}]},"public_addr":"172.21.15.112:6801/36251324","cluster_addr":"172.21.15.112:6803/36251324","heartbeat_back_addr":"172.21.15.112:6807/36251324","heartbeat_front_addr":"172.21.15.112:6805/36251324","state":["exists","up"]},{"osd":4,"uuid":"93465def-0617-4ba8-915a-b3ea85c8f6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":581823847},{"type":"v1","addr":"172.21.15.112:6809","nonce":581823847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":581823847},{"type":"v1","addr":"172.21.15.112:6811","nonce":581823847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":581823847},{"type":"v1","addr":"172.21.15.112:6815","nonce":581823847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":581823847},{"type":"v1","addr":"172.21.15.112:6813","nonce":581823847}]},"public_addr":"172.21.15.112:6809/581823847","cluster_addr":"172.21.15.112:6811/581823847","heartbeat_back_addr":"172.21.15.112:6815/581823847","heartbeat_front_addr":"172.21.15.112:6813/581823847","state":["exists","up"]},{"osd":5,"uuid":"d3f693f5-324b-4a48-8f24-77e65c5f7f7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4063265473},{"type":"v1","addr":"172.21.15.112:6817","nonce":4063265473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4063265473},{"type":"v1","addr":"172.21.15.112:6819","nonce":4063265473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4063265473},{"type":"v1","addr":"172.21.15.112:6823","nonce":4063265473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4063265473},{"type":"v1","addr":"172.21.15.112:6821","nonce":4063265473}]},"public_addr":"172.21.15.112:6817/4063265473","cluster_addr":"172.21.15.112:6819/4063265473","heartbeat_back_addr":"172.21.15.112:6823/4063265473","heartbeat_front_addr":"172.21.15.112:6821/4063265473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:42.635624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:10.189211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:35.781710+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:59.250841+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:25.155356+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:51.315370+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:6801/2375514340":"2024-04-26T02:01:30.377936+0000","172.21.15.77:0/3184722826":"2024-04-26T02:01:30.377936+0000","172.21.15.77:0/2490024809":"2024-04-26T02:01:30.377936+0000","172.21.15.77:0/543110241":"2024-04-26T02:01:30.377936+0000","172.21.15.77:0/1779967375":"2024-04-26T02:00:25.057598+0000","172.21.15.77:0/2265849210":"2024-04-26T02:00:25.057598+0000","172.21.15.77:6801/859750200":"2024-04-26T02:00:25.057598+0000","172.21.15.77:6801/839529497":"2024-04-26T01:59:54.491478+0000","172.21.15.77:6800/859750200":"2024-04-26T02:00:25.057598+0000","172.21.15.77:0/2254838943":"2024-04-26T02:00:25.057598+0000","172.21.15.77:6800/839529497":"2024-04-26T01:59:54.491478+0000","172.21.15.77:0/1177720370":"2024-04-26T01:59:54.491478+0000","172.21.15.77:6800/2375514340":"2024-04-26T02:01:30.377936+0000","172.21.15.77:0/265498985":"2024-04-26T01:59:54.491478+0000","172.21.15.77:0/1743910051":"2024-04-26T01:59:54.491478+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:05:15.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:15.047+0000 7f7309b79700 1 -- 172.21.15.77:0/4090279284 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f72ec0692a0 msgr2=0x7f72ec06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:15.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:15.047+0000 7f7309b79700 1 --2- 172.21.15.77:0/4090279284 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f72ec0692a0 0x7f72ec06b750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f72f8006fd0 tx=0x7f72f8006db0 comp rx=0 tx=0).stop 2024-04-25T02:05:15.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:15.047+0000 7f7309b79700 1 -- 172.21.15.77:0/4090279284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7304101cd0 msgr2=0x7f7304113b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:15.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:15.047+0000 7f7309b79700 1 --2- 172.21.15.77:0/4090279284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7304101cd0 0x7f7304113b80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009fd0 tx=0x7f72fc004d10 comp rx=0 tx=0).stop 2024-04-25T02:05:15.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:15.047+0000 7f7309b79700 1 -- 172.21.15.77:0/4090279284 shutdown_connections 2024-04-25T02:05:15.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:15.047+0000 7f7309b79700 1 --2- 172.21.15.77:0/4090279284 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f72ec0692a0 0x7f72ec06b750 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:15.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:15.047+0000 7f7309b79700 1 --2- 172.21.15.77:0/4090279284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7304101cd0 0x7f7304113b80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:15.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:15.047+0000 7f7309b79700 1 --2- 172.21.15.77:0/4090279284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7304102670 0x7f73041140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:15.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:15.047+0000 7f7309b79700 1 -- 172.21.15.77:0/4090279284 >> 172.21.15.77:0/4090279284 conn(0x7f7304071460 msgr2=0x7f73040f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:15.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:15.047+0000 7f7309b79700 1 -- 172.21.15.77:0/4090279284 shutdown_connections 2024-04-25T02:05:15.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:15.048+0000 7f7309b79700 1 -- 172.21.15.77:0/4090279284 wait complete. 2024-04-25T02:05:15.693 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-04-25T02:05:15.694 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-04-25T02:05:15.694 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-04-25T02:05:15.694 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-04-25T02:05:15.695 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-04-25T02:05:15.695 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-04-25T02:05:15.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:15 smithi077 ceph-mon[26330]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:15.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:15 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/4090279284' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:05:15.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:15 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:05:15.994 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:05:16.005 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:05:16.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:15 smithi112 ceph-mon[33313]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:16.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:15 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/4090279284' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:05:16.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:15 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:05:17.967 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:17 smithi077 ceph-mon[26330]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:18.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:17 smithi112 ceph-mon[33313]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:18.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.603+0000 7fa8a29a5700 1 -- 172.21.15.77:0/3282355972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa89c101e20 msgr2=0x7fa89c1021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:18.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.603+0000 7fa8a29a5700 1 --2- 172.21.15.77:0/3282355972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa89c101e20 0x7fa89c1021f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa88c004940 tx=0x7fa88c009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:18.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.603+0000 7fa8a29a5700 1 -- 172.21.15.77:0/3282355972 shutdown_connections 2024-04-25T02:05:18.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.603+0000 7fa8a29a5700 1 --2- 172.21.15.77:0/3282355972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa89c0fc710 0x7fa89c0fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:18.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.603+0000 7fa8a29a5700 1 --2- 172.21.15.77:0/3282355972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa89c101e20 0x7fa89c1021f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:18.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.603+0000 7fa8a29a5700 1 -- 172.21.15.77:0/3282355972 >> 172.21.15.77:0/3282355972 conn(0x7fa89c071460 msgr2=0x7fa89c071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:18.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.603+0000 7fa8a29a5700 1 -- 172.21.15.77:0/3282355972 shutdown_connections 2024-04-25T02:05:18.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.603+0000 7fa8a29a5700 1 -- 172.21.15.77:0/3282355972 wait complete. 2024-04-25T02:05:18.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.603+0000 7fa8a29a5700 1 Processor -- start 2024-04-25T02:05:18.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.604+0000 7fa8a29a5700 1 -- start start 2024-04-25T02:05:18.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.604+0000 7fa8a29a5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa89c0fc710 0x7fa89c10eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:18.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.604+0000 7fa8a29a5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa89c101e20 0x7fa89c10f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:18.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.604+0000 7fa8a29a5700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c10f670 con 0x7fa89c101e20 2024-04-25T02:05:18.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.604+0000 7fa8a29a5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c10f7b0 con 0x7fa89c0fc710 2024-04-25T02:05:18.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.604+0000 7fa89b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa89c101e20 0x7fa89c10f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:18.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.604+0000 7fa89b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa89c101e20 0x7fa89c10f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53078/0 (socket says 172.21.15.77:53078) 2024-04-25T02:05:18.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.604+0000 7fa89b7fe700 1 -- 172.21.15.77:0/3205364611 learned_addr learned my addr 172.21.15.77:0/3205364611 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:05:18.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.604+0000 7fa89bfff700 1 --2- 172.21.15.77:0/3205364611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa89c0fc710 0x7fa89c10eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:18.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.604+0000 7fa89b7fe700 1 -- 172.21.15.77:0/3205364611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa89c0fc710 msgr2=0x7fa89c10eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:18.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.604+0000 7fa89b7fe700 1 --2- 172.21.15.77:0/3205364611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa89c0fc710 0x7fa89c10eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:18.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.604+0000 7fa89b7fe700 1 -- 172.21.15.77:0/3205364611 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c005040 con 0x7fa89c101e20 2024-04-25T02:05:18.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.604+0000 7fa89b7fe700 1 --2- 172.21.15.77:0/3205364611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa89c101e20 0x7fa89c10f020 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa89000c830 tx=0x7fa890004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:18.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.605+0000 7fa898ff9700 1 -- 172.21.15.77:0/3205364611 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8900106f0 con 0x7fa89c101e20 2024-04-25T02:05:18.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.605+0000 7fa898ff9700 1 -- 172.21.15.77:0/3205364611 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa890010d20 con 0x7fa89c101e20 2024-04-25T02:05:18.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.605+0000 7fa8a29a5700 1 -- 172.21.15.77:0/3205364611 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa89c117b50 con 0x7fa89c101e20 2024-04-25T02:05:18.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.605+0000 7fa898ff9700 1 -- 172.21.15.77:0/3205364611 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8900113a0 con 0x7fa89c101e20 2024-04-25T02:05:18.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.605+0000 7fa8a29a5700 1 -- 172.21.15.77:0/3205364611 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa89c1180b0 con 0x7fa89c101e20 2024-04-25T02:05:18.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.605+0000 7fa8a29a5700 1 -- 172.21.15.77:0/3205364611 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa89c05e660 con 0x7fa89c101e20 2024-04-25T02:05:18.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.606+0000 7fa898ff9700 1 -- 172.21.15.77:0/3205364611 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fa890012400 con 0x7fa89c101e20 2024-04-25T02:05:18.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.606+0000 7fa898ff9700 1 --2- 172.21.15.77:0/3205364611 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fa8840692a0 0x7fa88406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:18.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.607+0000 7fa898ff9700 1 -- 172.21.15.77:0/3205364611 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa890087900 con 0x7fa89c101e20 2024-04-25T02:05:18.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.607+0000 7fa89bfff700 1 --2- 172.21.15.77:0/3205364611 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fa8840692a0 0x7fa88406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:18.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.607+0000 7fa898ff9700 1 --2- 172.21.15.77:0/3205364611 >> [v2:172.21.15.77:6802/3624813295,v1:172.21.15.77:6803/3624813295] conn(0x7fa88406ef70 0x7fa884071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:18.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.607+0000 7fa898ff9700 1 -- 172.21.15.77:0/3205364611 --> [v2:172.21.15.77:6802/3624813295,v1:172.21.15.77:6803/3624813295] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa884071a30 con 0x7fa88406ef70 2024-04-25T02:05:18.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.607+0000 7fa898ff9700 1 -- 172.21.15.77:0/3205364611 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa890087ce0 con 0x7fa89c101e20 2024-04-25T02:05:18.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.607+0000 7fa8a0f42700 1 --2- 172.21.15.77:0/3205364611 >> [v2:172.21.15.77:6802/3624813295,v1:172.21.15.77:6803/3624813295] conn(0x7fa88406ef70 0x7fa884071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:18.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.607+0000 7fa89bfff700 1 --2- 172.21.15.77:0/3205364611 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fa8840692a0 0x7fa88406b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa88c004f90 tx=0x7fa88c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:18.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.607+0000 7fa8a0f42700 1 --2- 172.21.15.77:0/3205364611 >> [v2:172.21.15.77:6802/3624813295,v1:172.21.15.77:6803/3624813295] conn(0x7fa88406ef70 0x7fa884071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:18.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.608+0000 7fa898ff9700 1 -- 172.21.15.77:0/3205364611 <== osd.0 v2:172.21.15.77:6802/3624813295 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fa884071a30 con 0x7fa88406ef70 2024-04-25T02:05:18.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.622+0000 7fa8a29a5700 1 -- 172.21.15.77:0/3205364611 --> [v2:172.21.15.77:6802/3624813295,v1:172.21.15.77:6803/3624813295] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa89c05eae0 con 0x7fa88406ef70 2024-04-25T02:05:18.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.623+0000 7fa898ff9700 1 -- 172.21.15.77:0/3205364611 <== osd.0 v2:172.21.15.77:6802/3624813295 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa89c05eae0 con 0x7fa88406ef70 2024-04-25T02:05:18.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.623+0000 7fa8a29a5700 1 -- 172.21.15.77:0/3205364611 >> [v2:172.21.15.77:6802/3624813295,v1:172.21.15.77:6803/3624813295] conn(0x7fa88406ef70 msgr2=0x7fa884071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:18.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.623+0000 7fa8a29a5700 1 --2- 172.21.15.77:0/3205364611 >> [v2:172.21.15.77:6802/3624813295,v1:172.21.15.77:6803/3624813295] conn(0x7fa88406ef70 0x7fa884071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:18.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.623+0000 7fa8a29a5700 1 -- 172.21.15.77:0/3205364611 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fa8840692a0 msgr2=0x7fa88406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:18.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.623+0000 7fa8a29a5700 1 --2- 172.21.15.77:0/3205364611 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fa8840692a0 0x7fa88406b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa88c004f90 tx=0x7fa88c009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:18.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.623+0000 7fa8a29a5700 1 -- 172.21.15.77:0/3205364611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa89c101e20 msgr2=0x7fa89c10f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:18.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.623+0000 7fa8a29a5700 1 --2- 172.21.15.77:0/3205364611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa89c101e20 0x7fa89c10f020 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa89000c830 tx=0x7fa890004470 comp rx=0 tx=0).stop 2024-04-25T02:05:18.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.623+0000 7fa8a29a5700 1 -- 172.21.15.77:0/3205364611 shutdown_connections 2024-04-25T02:05:18.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.623+0000 7fa8a29a5700 1 --2- 172.21.15.77:0/3205364611 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fa8840692a0 0x7fa88406b750 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:18.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.623+0000 7fa8a29a5700 1 --2- 172.21.15.77:0/3205364611 >> [v2:172.21.15.77:6802/3624813295,v1:172.21.15.77:6803/3624813295] conn(0x7fa88406ef70 0x7fa884071380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:18.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.623+0000 7fa8a29a5700 1 --2- 172.21.15.77:0/3205364611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa89c0fc710 0x7fa89c10eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:18.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.623+0000 7fa8a29a5700 1 --2- 172.21.15.77:0/3205364611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa89c101e20 0x7fa89c10f020 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:18.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.623+0000 7fa8a29a5700 1 -- 172.21.15.77:0/3205364611 >> 172.21.15.77:0/3205364611 conn(0x7fa89c071460 msgr2=0x7fa89c0f97d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:18.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.623+0000 7fa8a29a5700 1 -- 172.21.15.77:0/3205364611 shutdown_connections 2024-04-25T02:05:18.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:18.623+0000 7fa8a29a5700 1 -- 172.21.15.77:0/3205364611 wait complete. 2024-04-25T02:05:19.308 INFO:teuthology.orchestra.run.smithi077.stdout:38654705697 2024-04-25T02:05:19.309 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-04-25T02:05:19.494 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:05:19.495 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:05:19.495 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:05:19.495 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:05:19.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.524+0000 7fdac5fdb700 1 -- 172.21.15.77:0/1582476489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac0101e20 msgr2=0x7fdac01021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:19.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.524+0000 7fdac5fdb700 1 --2- 172.21.15.77:0/1582476489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac0101e20 0x7fdac01021f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdab0004940 tx=0x7fdab0009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:19.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.524+0000 7fdac5fdb700 1 -- 172.21.15.77:0/1582476489 shutdown_connections 2024-04-25T02:05:19.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.524+0000 7fdac5fdb700 1 --2- 172.21.15.77:0/1582476489 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdac00fc710 0x7fdac00fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:19.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.524+0000 7fdac5fdb700 1 --2- 172.21.15.77:0/1582476489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac0101e20 0x7fdac01021f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:19.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.524+0000 7fdac5fdb700 1 -- 172.21.15.77:0/1582476489 >> 172.21.15.77:0/1582476489 conn(0x7fdac0071460 msgr2=0x7fdac0071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:19.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.524+0000 7fdac5fdb700 1 -- 172.21.15.77:0/1582476489 shutdown_connections 2024-04-25T02:05:19.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.524+0000 7fdac5fdb700 1 -- 172.21.15.77:0/1582476489 wait complete. 2024-04-25T02:05:19.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.525+0000 7fdac5fdb700 1 Processor -- start 2024-04-25T02:05:19.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.525+0000 7fdac5fdb700 1 -- start start 2024-04-25T02:05:19.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.525+0000 7fdac5fdb700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac00fc710 0x7fdac01108b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:19.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.526+0000 7fdac5fdb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdac0101e20 0x7fdac0110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:19.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.526+0000 7fdac5fdb700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac0111480 con 0x7fdac00fc710 2024-04-25T02:05:19.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.526+0000 7fdac5fdb700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac01166e0 con 0x7fdac0101e20 2024-04-25T02:05:19.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.526+0000 7fdabf7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac00fc710 0x7fdac01108b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:19.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.526+0000 7fdabf7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac00fc710 0x7fdac01108b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53090/0 (socket says 172.21.15.77:53090) 2024-04-25T02:05:19.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.526+0000 7fdabf7fe700 1 -- 172.21.15.77:0/1773175768 learned_addr learned my addr 172.21.15.77:0/1773175768 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:05:19.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.526+0000 7fdabf7fe700 1 -- 172.21.15.77:0/1773175768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdac0101e20 msgr2=0x7fdac0110e30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T02:05:19.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.526+0000 7fdabf7fe700 1 --2- 172.21.15.77:0/1773175768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdac0101e20 0x7fdac0110e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:19.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.526+0000 7fdabf7fe700 1 -- 172.21.15.77:0/1773175768 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab0005040 con 0x7fdac00fc710 2024-04-25T02:05:19.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.527+0000 7fdabf7fe700 1 --2- 172.21.15.77:0/1773175768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac00fc710 0x7fdac01108b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdab000b3b0 tx=0x7fdab0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:19.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.528+0000 7fdaa7fff700 1 -- 172.21.15.77:0/1773175768 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdab000e040 con 0x7fdac00fc710 2024-04-25T02:05:19.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.528+0000 7fdac5fdb700 1 -- 172.21.15.77:0/1773175768 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac0116930 con 0x7fdac00fc710 2024-04-25T02:05:19.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.528+0000 7fdaa7fff700 1 -- 172.21.15.77:0/1773175768 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdab000bbc0 con 0x7fdac00fc710 2024-04-25T02:05:19.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.528+0000 7fdac5fdb700 1 -- 172.21.15.77:0/1773175768 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac0116e70 con 0x7fdac00fc710 2024-04-25T02:05:19.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.528+0000 7fdaa7fff700 1 -- 172.21.15.77:0/1773175768 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdab001c3f0 con 0x7fdac00fc710 2024-04-25T02:05:19.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.530+0000 7fdaa5ffb700 1 -- 172.21.15.77:0/1773175768 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdac010bbb0 con 0x7fdac00fc710 2024-04-25T02:05:19.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.531+0000 7fdaa7fff700 1 -- 172.21.15.77:0/1773175768 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fdab0013420 con 0x7fdac00fc710 2024-04-25T02:05:19.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.531+0000 7fdaa7fff700 1 --2- 172.21.15.77:0/1773175768 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fdaa8069310 0x7fdaa806b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:19.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.532+0000 7fdabeffd700 1 --2- 172.21.15.77:0/1773175768 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fdaa8069310 0x7fdaa806b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:19.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.532+0000 7fdaa7fff700 1 -- 172.21.15.77:0/1773175768 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fdab005b540 con 0x7fdac00fc710 2024-04-25T02:05:19.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.532+0000 7fdaa7fff700 1 --2- 172.21.15.77:0/1773175768 >> [v2:172.21.15.77:6810/3061147623,v1:172.21.15.77:6811/3061147623] conn(0x7fdaa806f8e0 0x7fdaa8071d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:19.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.532+0000 7fdaa7fff700 1 -- 172.21.15.77:0/1773175768 --> [v2:172.21.15.77:6810/3061147623,v1:172.21.15.77:6811/3061147623] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdaa8072440 con 0x7fdaa806f8e0 2024-04-25T02:05:19.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.532+0000 7fdaa7fff700 1 -- 172.21.15.77:0/1773175768 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdab001c3f0 con 0x7fdac00fc710 2024-04-25T02:05:19.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.533+0000 7fdabeffd700 1 --2- 172.21.15.77:0/1773175768 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fdaa8069310 0x7fdaa806b7c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdac010d1f0 tx=0x7fdab4009ce0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:19.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.533+0000 7fdabffff700 1 --2- 172.21.15.77:0/1773175768 >> [v2:172.21.15.77:6810/3061147623,v1:172.21.15.77:6811/3061147623] conn(0x7fdaa806f8e0 0x7fdaa8071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:19.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.533+0000 7fdabffff700 1 --2- 172.21.15.77:0/1773175768 >> [v2:172.21.15.77:6810/3061147623,v1:172.21.15.77:6811/3061147623] conn(0x7fdaa806f8e0 0x7fdaa8071d70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:19.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.535+0000 7fdaa7fff700 1 -- 172.21.15.77:0/1773175768 <== osd.1 v2:172.21.15.77:6810/3061147623 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fdaa8072440 con 0x7fdaa806f8e0 2024-04-25T02:05:19.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.551+0000 7fdaa5ffb700 1 -- 172.21.15.77:0/1773175768 --> [v2:172.21.15.77:6810/3061147623,v1:172.21.15.77:6811/3061147623] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdac010c020 con 0x7fdaa806f8e0 2024-04-25T02:05:19.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.552+0000 7fdaa7fff700 1 -- 172.21.15.77:0/1773175768 <== osd.1 v2:172.21.15.77:6810/3061147623 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdac010c020 con 0x7fdaa806f8e0 2024-04-25T02:05:19.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.552+0000 7fdaa5ffb700 1 -- 172.21.15.77:0/1773175768 >> [v2:172.21.15.77:6810/3061147623,v1:172.21.15.77:6811/3061147623] conn(0x7fdaa806f8e0 msgr2=0x7fdaa8071d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:19.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.552+0000 7fdaa5ffb700 1 --2- 172.21.15.77:0/1773175768 >> [v2:172.21.15.77:6810/3061147623,v1:172.21.15.77:6811/3061147623] conn(0x7fdaa806f8e0 0x7fdaa8071d70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:19.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.552+0000 7fdaa5ffb700 1 -- 172.21.15.77:0/1773175768 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fdaa8069310 msgr2=0x7fdaa806b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:19.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.552+0000 7fdaa5ffb700 1 --2- 172.21.15.77:0/1773175768 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fdaa8069310 0x7fdaa806b7c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdac010d1f0 tx=0x7fdab4009ce0 comp rx=0 tx=0).stop 2024-04-25T02:05:19.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.552+0000 7fdaa5ffb700 1 -- 172.21.15.77:0/1773175768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac00fc710 msgr2=0x7fdac01108b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:19.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.552+0000 7fdaa5ffb700 1 --2- 172.21.15.77:0/1773175768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac00fc710 0x7fdac01108b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdab000b3b0 tx=0x7fdab0009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:19.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.553+0000 7fdaa5ffb700 1 -- 172.21.15.77:0/1773175768 shutdown_connections 2024-04-25T02:05:19.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.553+0000 7fdaa5ffb700 1 --2- 172.21.15.77:0/1773175768 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fdaa8069310 0x7fdaa806b7c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:19.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.553+0000 7fdaa5ffb700 1 --2- 172.21.15.77:0/1773175768 >> [v2:172.21.15.77:6810/3061147623,v1:172.21.15.77:6811/3061147623] conn(0x7fdaa806f8e0 0x7fdaa8071d70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:19.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.553+0000 7fdaa5ffb700 1 --2- 172.21.15.77:0/1773175768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac00fc710 0x7fdac01108b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:19.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.553+0000 7fdaa5ffb700 1 --2- 172.21.15.77:0/1773175768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdac0101e20 0x7fdac0110e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:19.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.553+0000 7fdaa5ffb700 1 -- 172.21.15.77:0/1773175768 >> 172.21.15.77:0/1773175768 conn(0x7fdac0071460 msgr2=0x7fdac00f97d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:19.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.553+0000 7fdaa5ffb700 1 -- 172.21.15.77:0/1773175768 shutdown_connections 2024-04-25T02:05:19.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:19.553+0000 7fdaa5ffb700 1 -- 172.21.15.77:0/1773175768 wait complete. 2024-04-25T02:05:20.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:19 smithi077 ceph-mon[26330]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:20.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:19 smithi112 ceph-mon[33313]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:22.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:21 smithi077 ceph-mon[26330]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:22.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:21 smithi112 ceph-mon[33313]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:22.533 INFO:teuthology.orchestra.run.smithi077.stdout:60129542173 2024-04-25T02:05:22.534 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-04-25T02:05:24.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.107+0000 7f8cbc9a7700 1 -- 172.21.15.77:0/4139762024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cb8101d00 msgr2=0x7f8cb81020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:24.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.107+0000 7f8cbc9a7700 1 --2- 172.21.15.77:0/4139762024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cb8101d00 0x7f8cb81020d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8004940 tx=0x7f8ca8009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:24.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.107+0000 7f8cbc9a7700 1 -- 172.21.15.77:0/4139762024 shutdown_connections 2024-04-25T02:05:24.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.107+0000 7f8cbc9a7700 1 --2- 172.21.15.77:0/4139762024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cb81026a0 0x7f8cb80fbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:24.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.107+0000 7f8cbc9a7700 1 --2- 172.21.15.77:0/4139762024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cb8101d00 0x7f8cb81020d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:24.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.107+0000 7f8cbc9a7700 1 -- 172.21.15.77:0/4139762024 >> 172.21.15.77:0/4139762024 conn(0x7f8cb80f78d0 msgr2=0x7f8cb80f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:24.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.107+0000 7f8cbc9a7700 1 -- 172.21.15.77:0/4139762024 shutdown_connections 2024-04-25T02:05:24.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.107+0000 7f8cbc9a7700 1 -- 172.21.15.77:0/4139762024 wait complete. 2024-04-25T02:05:24.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.108+0000 7f8cbc9a7700 1 Processor -- start 2024-04-25T02:05:24.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.108+0000 7f8cbc9a7700 1 -- start start 2024-04-25T02:05:24.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.108+0000 7f8cbc9a7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cb8101d00 0x7f8cb8112ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:24.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.108+0000 7f8cbc9a7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cb81026a0 0x7f8cb8113000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:24.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.108+0000 7f8cbc9a7700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb8113650 con 0x7f8cb81026a0 2024-04-25T02:05:24.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.108+0000 7f8cbc9a7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb810ca40 con 0x7f8cb8101d00 2024-04-25T02:05:24.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.108+0000 7f8cb5d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cb81026a0 0x7f8cb8113000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:24.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.108+0000 7f8cb5d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cb81026a0 0x7f8cb8113000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53104/0 (socket says 172.21.15.77:53104) 2024-04-25T02:05:24.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.108+0000 7f8cb5d9b700 1 -- 172.21.15.77:0/4150788665 learned_addr learned my addr 172.21.15.77:0/4150788665 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:05:24.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.108+0000 7f8cb659c700 1 --2- 172.21.15.77:0/4150788665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cb8101d00 0x7f8cb8112ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:24.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.108+0000 7f8cb5d9b700 1 -- 172.21.15.77:0/4150788665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cb8101d00 msgr2=0x7f8cb8112ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:24.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.108+0000 7f8cb5d9b700 1 --2- 172.21.15.77:0/4150788665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cb8101d00 0x7f8cb8112ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:24.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.108+0000 7f8cb5d9b700 1 -- 172.21.15.77:0/4150788665 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca8005040 con 0x7f8cb81026a0 2024-04-25T02:05:24.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.109+0000 7f8cb5d9b700 1 --2- 172.21.15.77:0/4150788665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cb81026a0 0x7f8cb8113000 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8cac00c890 tx=0x7f8cac0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:24.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.109+0000 7f8ca6ffd700 1 -- 172.21.15.77:0/4150788665 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cac00a7d0 con 0x7f8cb81026a0 2024-04-25T02:05:24.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.109+0000 7f8ca6ffd700 1 -- 172.21.15.77:0/4150788665 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8cac00ae00 con 0x7f8cb81026a0 2024-04-25T02:05:24.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.109+0000 7f8ca6ffd700 1 -- 172.21.15.77:0/4150788665 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cac0113a0 con 0x7f8cb81026a0 2024-04-25T02:05:24.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.109+0000 7f8cbc9a7700 1 -- 172.21.15.77:0/4150788665 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb810cd20 con 0x7f8cb81026a0 2024-04-25T02:05:24.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.109+0000 7f8cbc9a7700 1 -- 172.21.15.77:0/4150788665 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb810d2e0 con 0x7f8cb81026a0 2024-04-25T02:05:24.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.109+0000 7f8cbc9a7700 1 -- 172.21.15.77:0/4150788665 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8cb810d820 con 0x7f8cb81026a0 2024-04-25T02:05:24.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.110+0000 7f8ca6ffd700 1 -- 172.21.15.77:0/4150788665 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f8cac012400 con 0x7f8cb81026a0 2024-04-25T02:05:24.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.110+0000 7f8ca6ffd700 1 --2- 172.21.15.77:0/4150788665 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f8ca00692a0 0x7f8ca006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:24.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.111+0000 7f8cb659c700 1 --2- 172.21.15.77:0/4150788665 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f8ca00692a0 0x7f8ca006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:24.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.111+0000 7f8ca6ffd700 1 -- 172.21.15.77:0/4150788665 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8cac086f20 con 0x7f8cb81026a0 2024-04-25T02:05:24.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.111+0000 7f8ca6ffd700 1 --2- 172.21.15.77:0/4150788665 >> [v2:172.21.15.112:6800/36251324,v1:172.21.15.112:6801/36251324] conn(0x7f8ca006ef70 0x7f8ca0071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:24.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.111+0000 7f8ca6ffd700 1 -- 172.21.15.77:0/4150788665 --> [v2:172.21.15.112:6800/36251324,v1:172.21.15.112:6801/36251324] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8ca0071a30 con 0x7f8ca006ef70 2024-04-25T02:05:24.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.111+0000 7f8ca6ffd700 1 -- 172.21.15.77:0/4150788665 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8cac08c520 con 0x7f8cb81026a0 2024-04-25T02:05:24.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.111+0000 7f8cb659c700 1 --2- 172.21.15.77:0/4150788665 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f8ca00692a0 0x7f8ca006b750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8004f90 tx=0x7f8ca8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:24.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.111+0000 7f8cb6d9d700 1 --2- 172.21.15.77:0/4150788665 >> [v2:172.21.15.112:6800/36251324,v1:172.21.15.112:6801/36251324] conn(0x7f8ca006ef70 0x7f8ca0071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:24.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.111+0000 7f8cb6d9d700 1 --2- 172.21.15.77:0/4150788665 >> [v2:172.21.15.112:6800/36251324,v1:172.21.15.112:6801/36251324] conn(0x7f8ca006ef70 0x7f8ca0071380 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:24.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.112+0000 7f8ca6ffd700 1 -- 172.21.15.77:0/4150788665 <== osd.3 v2:172.21.15.112:6800/36251324 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f8ca0071a30 con 0x7f8ca006ef70 2024-04-25T02:05:24.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.127+0000 7f8cbc9a7700 1 -- 172.21.15.77:0/4150788665 --> [v2:172.21.15.112:6800/36251324,v1:172.21.15.112:6801/36251324] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8cb80f9270 con 0x7f8ca006ef70 2024-04-25T02:05:24.133 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:23 smithi077 ceph-mon[26330]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:24.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.127+0000 7f8ca6ffd700 1 -- 172.21.15.77:0/4150788665 <== osd.3 v2:172.21.15.112:6800/36251324 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f8cb80f9270 con 0x7f8ca006ef70 2024-04-25T02:05:24.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.127+0000 7f8cbc9a7700 1 -- 172.21.15.77:0/4150788665 >> [v2:172.21.15.112:6800/36251324,v1:172.21.15.112:6801/36251324] conn(0x7f8ca006ef70 msgr2=0x7f8ca0071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:24.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.127+0000 7f8cbc9a7700 1 --2- 172.21.15.77:0/4150788665 >> [v2:172.21.15.112:6800/36251324,v1:172.21.15.112:6801/36251324] conn(0x7f8ca006ef70 0x7f8ca0071380 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:24.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.128+0000 7f8cbc9a7700 1 -- 172.21.15.77:0/4150788665 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f8ca00692a0 msgr2=0x7f8ca006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:24.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.128+0000 7f8cbc9a7700 1 --2- 172.21.15.77:0/4150788665 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f8ca00692a0 0x7f8ca006b750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8004f90 tx=0x7f8ca8009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:24.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.128+0000 7f8cbc9a7700 1 -- 172.21.15.77:0/4150788665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cb81026a0 msgr2=0x7f8cb8113000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:24.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.128+0000 7f8cbc9a7700 1 --2- 172.21.15.77:0/4150788665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cb81026a0 0x7f8cb8113000 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8cac00c890 tx=0x7f8cac0044c0 comp rx=0 tx=0).stop 2024-04-25T02:05:24.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.128+0000 7f8cbc9a7700 1 -- 172.21.15.77:0/4150788665 shutdown_connections 2024-04-25T02:05:24.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.128+0000 7f8cbc9a7700 1 --2- 172.21.15.77:0/4150788665 >> [v2:172.21.15.112:6800/36251324,v1:172.21.15.112:6801/36251324] conn(0x7f8ca006ef70 0x7f8ca0071380 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:24.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.128+0000 7f8cbc9a7700 1 --2- 172.21.15.77:0/4150788665 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f8ca00692a0 0x7f8ca006b750 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:24.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.128+0000 7f8cbc9a7700 1 --2- 172.21.15.77:0/4150788665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cb8101d00 0x7f8cb8112ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:24.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.128+0000 7f8cbc9a7700 1 --2- 172.21.15.77:0/4150788665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cb81026a0 0x7f8cb8113000 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:24.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.128+0000 7f8cbc9a7700 1 -- 172.21.15.77:0/4150788665 >> 172.21.15.77:0/4150788665 conn(0x7f8cb80f78d0 msgr2=0x7f8cb80f88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:24.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.128+0000 7f8cbc9a7700 1 -- 172.21.15.77:0/4150788665 shutdown_connections 2024-04-25T02:05:24.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:24.128+0000 7f8cbc9a7700 1 -- 172.21.15.77:0/4150788665 wait complete. 2024-04-25T02:05:24.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:23 smithi112 ceph-mon[33313]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:24.542 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:05:25.257 INFO:teuthology.orchestra.run.smithi077.stdout:115964117011 2024-04-25T02:05:25.258 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-04-25T02:05:26.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.095+0000 7fbd533d4700 1 -- 172.21.15.77:0/1690907516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd4c102de0 msgr2=0x7fbd4c1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:26.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.095+0000 7fbd533d4700 1 --2- 172.21.15.77:0/1690907516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd4c102de0 0x7fbd4c1031b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbd48004940 tx=0x7fbd48009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:26.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.095+0000 7fbd533d4700 1 -- 172.21.15.77:0/1690907516 shutdown_connections 2024-04-25T02:05:26.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.095+0000 7fbd533d4700 1 --2- 172.21.15.77:0/1690907516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd4c103780 0x7fbd4c0fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:26.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.095+0000 7fbd533d4700 1 --2- 172.21.15.77:0/1690907516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd4c102de0 0x7fbd4c1031b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:26.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.095+0000 7fbd533d4700 1 -- 172.21.15.77:0/1690907516 >> 172.21.15.77:0/1690907516 conn(0x7fbd4c0f8990 msgr2=0x7fbd4c0fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:26.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.095+0000 7fbd533d4700 1 -- 172.21.15.77:0/1690907516 shutdown_connections 2024-04-25T02:05:26.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.095+0000 7fbd533d4700 1 -- 172.21.15.77:0/1690907516 wait complete. 2024-04-25T02:05:26.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.096+0000 7fbd533d4700 1 Processor -- start 2024-04-25T02:05:26.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.096+0000 7fbd533d4700 1 -- start start 2024-04-25T02:05:26.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.096+0000 7fbd533d4700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd4c102de0 0x7fbd4c070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:26.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.096+0000 7fbd533d4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd4c103780 0x7fbd4c0707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:26.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.096+0000 7fbd533d4700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c072160 con 0x7fbd4c102de0 2024-04-25T02:05:26.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.096+0000 7fbd533d4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c070ce0 con 0x7fbd4c103780 2024-04-25T02:05:26.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.096+0000 7fbd51170700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd4c102de0 0x7fbd4c070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:26.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.096+0000 7fbd51170700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd4c102de0 0x7fbd4c070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53134/0 (socket says 172.21.15.77:53134) 2024-04-25T02:05:26.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.096+0000 7fbd51170700 1 -- 172.21.15.77:0/3913123020 learned_addr learned my addr 172.21.15.77:0/3913123020 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:05:26.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.096+0000 7fbd5096f700 1 --2- 172.21.15.77:0/3913123020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd4c103780 0x7fbd4c0707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:26.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.096+0000 7fbd51170700 1 -- 172.21.15.77:0/3913123020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd4c103780 msgr2=0x7fbd4c0707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:26.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.096+0000 7fbd51170700 1 --2- 172.21.15.77:0/3913123020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd4c103780 0x7fbd4c0707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:26.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.096+0000 7fbd51170700 1 -- 172.21.15.77:0/3913123020 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd48005040 con 0x7fbd4c102de0 2024-04-25T02:05:26.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.096+0000 7fbd5096f700 1 --2- 172.21.15.77:0/3913123020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd4c103780 0x7fbd4c0707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:05:26.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.096+0000 7fbd51170700 1 --2- 172.21.15.77:0/3913123020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd4c102de0 0x7fbd4c070260 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800b8b0 tx=0x7fbd48009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:26.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.097+0000 7fbd41ffb700 1 -- 172.21.15.77:0/3913123020 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd4800e040 con 0x7fbd4c102de0 2024-04-25T02:05:26.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.097+0000 7fbd533d4700 1 -- 172.21.15.77:0/3913123020 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd4c070f60 con 0x7fbd4c102de0 2024-04-25T02:05:26.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.097+0000 7fbd41ffb700 1 -- 172.21.15.77:0/3913123020 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbd48004290 con 0x7fbd4c102de0 2024-04-25T02:05:26.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.097+0000 7fbd41ffb700 1 -- 172.21.15.77:0/3913123020 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd4801c3f0 con 0x7fbd4c102de0 2024-04-25T02:05:26.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.097+0000 7fbd533d4700 1 -- 172.21.15.77:0/3913123020 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4c11a110 con 0x7fbd4c102de0 2024-04-25T02:05:26.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.098+0000 7fbd533d4700 1 -- 172.21.15.77:0/3913123020 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbd4c0fe530 con 0x7fbd4c102de0 2024-04-25T02:05:26.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.098+0000 7fbd41ffb700 1 -- 172.21.15.77:0/3913123020 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fbd480137b0 con 0x7fbd4c102de0 2024-04-25T02:05:26.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.099+0000 7fbd41ffb700 1 --2- 172.21.15.77:0/3913123020 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fbd380692a0 0x7fbd3806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:26.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.099+0000 7fbd41ffb700 1 -- 172.21.15.77:0/3913123020 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fbd48088190 con 0x7fbd4c102de0 2024-04-25T02:05:26.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.099+0000 7fbd5096f700 1 --2- 172.21.15.77:0/3913123020 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fbd380692a0 0x7fbd3806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:26.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.099+0000 7fbd41ffb700 1 --2- 172.21.15.77:0/3913123020 >> [v2:172.21.15.112:6808/581823847,v1:172.21.15.112:6809/581823847] conn(0x7fbd3806ef70 0x7fbd38071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:26.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.099+0000 7fbd41ffb700 1 -- 172.21.15.77:0/3913123020 --> [v2:172.21.15.112:6808/581823847,v1:172.21.15.112:6809/581823847] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd38071a30 con 0x7fbd3806ef70 2024-04-25T02:05:26.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.099+0000 7fbd41ffb700 1 -- 172.21.15.77:0/3913123020 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd4808a780 con 0x7fbd4c102de0 2024-04-25T02:05:26.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.099+0000 7fbd51971700 1 --2- 172.21.15.77:0/3913123020 >> [v2:172.21.15.112:6808/581823847,v1:172.21.15.112:6809/581823847] conn(0x7fbd3806ef70 0x7fbd38071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:26.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.099+0000 7fbd5096f700 1 --2- 172.21.15.77:0/3913123020 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fbd380692a0 0x7fbd3806b750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c007fd0 tx=0x7fbd3c009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:26.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.099+0000 7fbd51971700 1 --2- 172.21.15.77:0/3913123020 >> [v2:172.21.15.112:6808/581823847,v1:172.21.15.112:6809/581823847] conn(0x7fbd3806ef70 0x7fbd38071380 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:26.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.100+0000 7fbd41ffb700 1 -- 172.21.15.77:0/3913123020 <== osd.4 v2:172.21.15.112:6808/581823847 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fbd38071a30 con 0x7fbd3806ef70 2024-04-25T02:05:26.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.115+0000 7fbd533d4700 1 -- 172.21.15.77:0/3913123020 --> [v2:172.21.15.112:6808/581823847,v1:172.21.15.112:6809/581823847] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbd4c05e660 con 0x7fbd3806ef70 2024-04-25T02:05:26.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.115+0000 7fbd41ffb700 1 -- 172.21.15.77:0/3913123020 <== osd.4 v2:172.21.15.112:6808/581823847 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fbd4c05e660 con 0x7fbd3806ef70 2024-04-25T02:05:26.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.116+0000 7fbd533d4700 1 -- 172.21.15.77:0/3913123020 >> [v2:172.21.15.112:6808/581823847,v1:172.21.15.112:6809/581823847] conn(0x7fbd3806ef70 msgr2=0x7fbd38071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:26.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.116+0000 7fbd533d4700 1 --2- 172.21.15.77:0/3913123020 >> [v2:172.21.15.112:6808/581823847,v1:172.21.15.112:6809/581823847] conn(0x7fbd3806ef70 0x7fbd38071380 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:26.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.116+0000 7fbd533d4700 1 -- 172.21.15.77:0/3913123020 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fbd380692a0 msgr2=0x7fbd3806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:26.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.116+0000 7fbd533d4700 1 --2- 172.21.15.77:0/3913123020 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fbd380692a0 0x7fbd3806b750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c007fd0 tx=0x7fbd3c009040 comp rx=0 tx=0).stop 2024-04-25T02:05:26.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.116+0000 7fbd533d4700 1 -- 172.21.15.77:0/3913123020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd4c102de0 msgr2=0x7fbd4c070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:26.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.116+0000 7fbd533d4700 1 --2- 172.21.15.77:0/3913123020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd4c102de0 0x7fbd4c070260 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800b8b0 tx=0x7fbd48009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:26.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.116+0000 7fbd533d4700 1 -- 172.21.15.77:0/3913123020 shutdown_connections 2024-04-25T02:05:26.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.116+0000 7fbd533d4700 1 --2- 172.21.15.77:0/3913123020 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fbd380692a0 0x7fbd3806b750 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:26.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.116+0000 7fbd533d4700 1 --2- 172.21.15.77:0/3913123020 >> [v2:172.21.15.112:6808/581823847,v1:172.21.15.112:6809/581823847] conn(0x7fbd3806ef70 0x7fbd38071380 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:26.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.116+0000 7fbd533d4700 1 --2- 172.21.15.77:0/3913123020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd4c102de0 0x7fbd4c070260 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:26.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.116+0000 7fbd533d4700 1 --2- 172.21.15.77:0/3913123020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd4c103780 0x7fbd4c0707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:26.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.116+0000 7fbd533d4700 1 -- 172.21.15.77:0/3913123020 >> 172.21.15.77:0/3913123020 conn(0x7fbd4c0f8990 msgr2=0x7fbd4c107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:26.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.116+0000 7fbd533d4700 1 -- 172.21.15.77:0/3913123020 shutdown_connections 2024-04-25T02:05:26.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.116+0000 7fbd533d4700 1 -- 172.21.15.77:0/3913123020 wait complete. 2024-04-25T02:05:26.198 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:25 smithi077 ceph-mon[26330]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:26.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:25 smithi112 ceph-mon[33313]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:27.907 INFO:teuthology.orchestra.run.smithi077.stdout:150323855374 2024-04-25T02:05:27.908 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-04-25T02:05:28.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.979+0000 7fee291c8700 1 -- 172.21.15.77:0/51510967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee24101cd0 msgr2=0x7fee241020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:28.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.979+0000 7fee291c8700 1 --2- 172.21.15.77:0/51510967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee24101cd0 0x7fee241020a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fee14004940 tx=0x7fee14009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:28.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.979+0000 7fee291c8700 1 -- 172.21.15.77:0/51510967 shutdown_connections 2024-04-25T02:05:28.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.979+0000 7fee291c8700 1 --2- 172.21.15.77:0/51510967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee24102670 0x7fee240fbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:28.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.979+0000 7fee291c8700 1 --2- 172.21.15.77:0/51510967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee24101cd0 0x7fee241020a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:28.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.979+0000 7fee291c8700 1 -- 172.21.15.77:0/51510967 >> 172.21.15.77:0/51510967 conn(0x7fee240f7860 msgr2=0x7fee240f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:28.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.979+0000 7fee291c8700 1 -- 172.21.15.77:0/51510967 shutdown_connections 2024-04-25T02:05:28.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.979+0000 7fee291c8700 1 -- 172.21.15.77:0/51510967 wait complete. 2024-04-25T02:05:28.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.980+0000 7fee291c8700 1 Processor -- start 2024-04-25T02:05:28.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.980+0000 7fee291c8700 1 -- start start 2024-04-25T02:05:28.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.980+0000 7fee291c8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee24101cd0 0x7fee24112860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:28.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.980+0000 7fee291c8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee24102670 0x7fee24112da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:28.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.980+0000 7fee291c8700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee24113480 con 0x7fee24102670 2024-04-25T02:05:28.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.980+0000 7fee291c8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2410c9f0 con 0x7fee24101cd0 2024-04-25T02:05:28.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.980+0000 7fee2259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee24102670 0x7fee24112da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:28.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.980+0000 7fee2259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee24102670 0x7fee24112da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53118/0 (socket says 172.21.15.77:53118) 2024-04-25T02:05:28.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.980+0000 7fee2259c700 1 -- 172.21.15.77:0/131012400 learned_addr learned my addr 172.21.15.77:0/131012400 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:05:28.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.980+0000 7fee22d9d700 1 --2- 172.21.15.77:0/131012400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee24101cd0 0x7fee24112860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:28.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.980+0000 7fee2259c700 1 -- 172.21.15.77:0/131012400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee24101cd0 msgr2=0x7fee24112860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:28.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.980+0000 7fee2259c700 1 --2- 172.21.15.77:0/131012400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee24101cd0 0x7fee24112860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:28.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.980+0000 7fee2259c700 1 -- 172.21.15.77:0/131012400 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee14005040 con 0x7fee24102670 2024-04-25T02:05:28.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.980+0000 7fee2259c700 1 --2- 172.21.15.77:0/131012400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee24102670 0x7fee24112da0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fee1800b790 tx=0x7fee18009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:28.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.981+0000 7fee0b7fe700 1 -- 172.21.15.77:0/131012400 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee1800f6f0 con 0x7fee24102670 2024-04-25T02:05:28.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.981+0000 7fee0b7fe700 1 -- 172.21.15.77:0/131012400 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee1800fd20 con 0x7fee24102670 2024-04-25T02:05:28.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.981+0000 7fee0b7fe700 1 -- 172.21.15.77:0/131012400 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee180103a0 con 0x7fee24102670 2024-04-25T02:05:28.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.981+0000 7fee291c8700 1 -- 172.21.15.77:0/131012400 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee2410ccd0 con 0x7fee24102670 2024-04-25T02:05:28.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.981+0000 7fee291c8700 1 -- 172.21.15.77:0/131012400 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2410d290 con 0x7fee24102670 2024-04-25T02:05:28.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.981+0000 7fee291c8700 1 -- 172.21.15.77:0/131012400 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fee2410d870 con 0x7fee24102670 2024-04-25T02:05:28.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.982+0000 7fee0b7fe700 1 -- 172.21.15.77:0/131012400 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fee18011400 con 0x7fee24102670 2024-04-25T02:05:28.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.982+0000 7fee0b7fe700 1 --2- 172.21.15.77:0/131012400 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fee0c0692a0 0x7fee0c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:28.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.983+0000 7fee0b7fe700 1 -- 172.21.15.77:0/131012400 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fee18087680 con 0x7fee24102670 2024-04-25T02:05:28.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.983+0000 7fee22d9d700 1 --2- 172.21.15.77:0/131012400 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fee0c0692a0 0x7fee0c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:28.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.983+0000 7fee0b7fe700 1 --2- 172.21.15.77:0/131012400 >> [v2:172.21.15.112:6816/4063265473,v1:172.21.15.112:6817/4063265473] conn(0x7fee0c06ef70 0x7fee0c071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:28.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.983+0000 7fee0b7fe700 1 -- 172.21.15.77:0/131012400 --> [v2:172.21.15.112:6816/4063265473,v1:172.21.15.112:6817/4063265473] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fee0c071a30 con 0x7fee0c06ef70 2024-04-25T02:05:28.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.983+0000 7fee0b7fe700 1 -- 172.21.15.77:0/131012400 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee18087a60 con 0x7fee24102670 2024-04-25T02:05:28.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.983+0000 7fee22d9d700 1 --2- 172.21.15.77:0/131012400 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fee0c0692a0 0x7fee0c06b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fee14004f90 tx=0x7fee14009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:28.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.983+0000 7fee2359e700 1 --2- 172.21.15.77:0/131012400 >> [v2:172.21.15.112:6816/4063265473,v1:172.21.15.112:6817/4063265473] conn(0x7fee0c06ef70 0x7fee0c071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:28.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.983+0000 7fee2359e700 1 --2- 172.21.15.77:0/131012400 >> [v2:172.21.15.112:6816/4063265473,v1:172.21.15.112:6817/4063265473] conn(0x7fee0c06ef70 0x7fee0c071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:28.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.984+0000 7fee0b7fe700 1 -- 172.21.15.77:0/131012400 <== osd.5 v2:172.21.15.112:6816/4063265473 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fee0c071a30 con 0x7fee0c06ef70 2024-04-25T02:05:28.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:25.999+0000 7fee291c8700 1 -- 172.21.15.77:0/131012400 --> [v2:172.21.15.112:6816/4063265473,v1:172.21.15.112:6817/4063265473] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fee240f9170 con 0x7fee0c06ef70 2024-04-25T02:05:28.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.000+0000 7fee0b7fe700 1 -- 172.21.15.77:0/131012400 <== osd.5 v2:172.21.15.112:6816/4063265473 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fee240f9170 con 0x7fee0c06ef70 2024-04-25T02:05:28.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.000+0000 7fee291c8700 1 -- 172.21.15.77:0/131012400 >> [v2:172.21.15.112:6816/4063265473,v1:172.21.15.112:6817/4063265473] conn(0x7fee0c06ef70 msgr2=0x7fee0c071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:28.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.000+0000 7fee291c8700 1 --2- 172.21.15.77:0/131012400 >> [v2:172.21.15.112:6816/4063265473,v1:172.21.15.112:6817/4063265473] conn(0x7fee0c06ef70 0x7fee0c071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:28.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.000+0000 7fee291c8700 1 -- 172.21.15.77:0/131012400 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fee0c0692a0 msgr2=0x7fee0c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:28.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.000+0000 7fee291c8700 1 --2- 172.21.15.77:0/131012400 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fee0c0692a0 0x7fee0c06b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fee14004f90 tx=0x7fee14009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:28.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.000+0000 7fee291c8700 1 -- 172.21.15.77:0/131012400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee24102670 msgr2=0x7fee24112da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:28.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.000+0000 7fee291c8700 1 --2- 172.21.15.77:0/131012400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee24102670 0x7fee24112da0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fee1800b790 tx=0x7fee18009220 comp rx=0 tx=0).stop 2024-04-25T02:05:28.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.000+0000 7fee291c8700 1 -- 172.21.15.77:0/131012400 shutdown_connections 2024-04-25T02:05:28.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.000+0000 7fee291c8700 1 --2- 172.21.15.77:0/131012400 >> [v2:172.21.15.112:6816/4063265473,v1:172.21.15.112:6817/4063265473] conn(0x7fee0c06ef70 0x7fee0c071380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:28.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.000+0000 7fee291c8700 1 --2- 172.21.15.77:0/131012400 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fee0c0692a0 0x7fee0c06b750 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:28.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.000+0000 7fee291c8700 1 --2- 172.21.15.77:0/131012400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee24101cd0 0x7fee24112860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:28.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.000+0000 7fee291c8700 1 --2- 172.21.15.77:0/131012400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee24102670 0x7fee24112da0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:28.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.000+0000 7fee291c8700 1 -- 172.21.15.77:0/131012400 >> 172.21.15.77:0/131012400 conn(0x7fee240f7860 msgr2=0x7fee240f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:28.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.001+0000 7fee291c8700 1 -- 172.21.15.77:0/131012400 shutdown_connections 2024-04-25T02:05:28.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:26.001+0000 7fee291c8700 1 -- 172.21.15.77:0/131012400 wait complete. 2024-04-25T02:05:28.229 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:05:28.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:27 smithi077 ceph-mon[26330]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:28.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:27 smithi112 ceph-mon[33313]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:28.695 INFO:teuthology.orchestra.run.smithi077.stdout:171798691849 2024-04-25T02:05:28.696 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-04-25T02:05:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.066+0000 7f362c13a700 1 -- 172.21.15.77:0/903527149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36240fc190 msgr2=0x7f3624101a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.066+0000 7f362c13a700 1 --2- 172.21.15.77:0/903527149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36240fc190 0x7f3624101a70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3620004940 tx=0x7f3620009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.066+0000 7f362c13a700 1 -- 172.21.15.77:0/903527149 shutdown_connections 2024-04-25T02:05:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.066+0000 7f362c13a700 1 --2- 172.21.15.77:0/903527149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36240fc190 0x7f3624101a70 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.066+0000 7f362c13a700 1 --2- 172.21.15.77:0/903527149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36240fb7f0 0x7f36240fbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.066+0000 7f362c13a700 1 -- 172.21.15.77:0/903527149 >> 172.21.15.77:0/903527149 conn(0x7f3624071460 msgr2=0x7f3624071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.066+0000 7f362c13a700 1 -- 172.21.15.77:0/903527149 shutdown_connections 2024-04-25T02:05:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.066+0000 7f362c13a700 1 -- 172.21.15.77:0/903527149 wait complete. 2024-04-25T02:05:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.067+0000 7f362c13a700 1 Processor -- start 2024-04-25T02:05:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.067+0000 7f362c13a700 1 -- start start 2024-04-25T02:05:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.067+0000 7f362c13a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36240fb7f0 0x7f36240fe210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.067+0000 7f362c13a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36240fc190 0x7f36240fc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.067+0000 7f362c13a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36240fcd50 con 0x7f36240fc190 2024-04-25T02:05:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.067+0000 7f362c13a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36240fcec0 con 0x7f36240fb7f0 2024-04-25T02:05:29.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.068+0000 7f36296d5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36240fc190 0x7f36240fc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:29.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.068+0000 7f36296d5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36240fc190 0x7f36240fc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59704/0 (socket says 172.21.15.77:59704) 2024-04-25T02:05:29.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.068+0000 7f36296d5700 1 -- 172.21.15.77:0/3670555514 learned_addr learned my addr 172.21.15.77:0/3670555514 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:05:29.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.068+0000 7f3629ed6700 1 --2- 172.21.15.77:0/3670555514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36240fb7f0 0x7f36240fe210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:29.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.068+0000 7f36296d5700 1 -- 172.21.15.77:0/3670555514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36240fb7f0 msgr2=0x7f36240fe210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:29.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.068+0000 7f36296d5700 1 --2- 172.21.15.77:0/3670555514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36240fb7f0 0x7f36240fe210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:29.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.068+0000 7f36296d5700 1 -- 172.21.15.77:0/3670555514 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3620005040 con 0x7f36240fc190 2024-04-25T02:05:29.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.068+0000 7f36296d5700 1 --2- 172.21.15.77:0/3670555514 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36240fc190 0x7f36240fc780 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f362000b3b0 tx=0x7f3620009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:29.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.068+0000 7f361a7fc700 1 -- 172.21.15.77:0/3670555514 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f362000e040 con 0x7f36240fc190 2024-04-25T02:05:29.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.069+0000 7f361a7fc700 1 -- 172.21.15.77:0/3670555514 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3620013420 con 0x7f36240fc190 2024-04-25T02:05:29.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.069+0000 7f362c13a700 1 -- 172.21.15.77:0/3670555514 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36240fd140 con 0x7f36240fc190 2024-04-25T02:05:29.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.069+0000 7f362c13a700 1 -- 172.21.15.77:0/3670555514 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362411e6e0 con 0x7f36240fc190 2024-04-25T02:05:29.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.069+0000 7f361a7fc700 1 -- 172.21.15.77:0/3670555514 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f362001c630 con 0x7f36240fc190 2024-04-25T02:05:29.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.069+0000 7f362c13a700 1 -- 172.21.15.77:0/3670555514 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3624065f30 con 0x7f36240fc190 2024-04-25T02:05:29.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.070+0000 7f361a7fc700 1 -- 172.21.15.77:0/3670555514 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f362000baf0 con 0x7f36240fc190 2024-04-25T02:05:29.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.070+0000 7f361a7fc700 1 --2- 172.21.15.77:0/3670555514 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f36100692a0 0x7f361006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:29.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.070+0000 7f361a7fc700 1 -- 172.21.15.77:0/3670555514 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f36200880d0 con 0x7f36240fc190 2024-04-25T02:05:29.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.070+0000 7f3629ed6700 1 --2- 172.21.15.77:0/3670555514 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f36100692a0 0x7f361006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:29.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.071+0000 7f3629ed6700 1 --2- 172.21.15.77:0/3670555514 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f36100692a0 0x7f361006b750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3614006fd0 tx=0x7f3614008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:29.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.075+0000 7f361a7fc700 1 -- 172.21.15.77:0/3670555514 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f36200581d0 con 0x7f36240fc190 2024-04-25T02:05:29.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.273+0000 7f362c13a700 1 -- 172.21.15.77:0/3670555514 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f362404c710 con 0x7f36240fc190 2024-04-25T02:05:29.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.273+0000 7f361a7fc700 1 -- 172.21.15.77:0/3670555514 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3620057d60 con 0x7f36240fc190 2024-04-25T02:05:29.279 INFO:teuthology.orchestra.run.smithi077.stdout:38654705699 2024-04-25T02:05:29.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.275+0000 7f362c13a700 1 -- 172.21.15.77:0/3670555514 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f36100692a0 msgr2=0x7f361006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:29.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.275+0000 7f362c13a700 1 --2- 172.21.15.77:0/3670555514 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f36100692a0 0x7f361006b750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3614006fd0 tx=0x7f3614008040 comp rx=0 tx=0).stop 2024-04-25T02:05:29.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.275+0000 7f362c13a700 1 -- 172.21.15.77:0/3670555514 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36240fc190 msgr2=0x7f36240fc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:29.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.275+0000 7f362c13a700 1 --2- 172.21.15.77:0/3670555514 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36240fc190 0x7f36240fc780 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f362000b3b0 tx=0x7f3620009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:29.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.275+0000 7f362c13a700 1 -- 172.21.15.77:0/3670555514 shutdown_connections 2024-04-25T02:05:29.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.275+0000 7f362c13a700 1 --2- 172.21.15.77:0/3670555514 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f36100692a0 0x7f361006b750 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:29.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.275+0000 7f362c13a700 1 --2- 172.21.15.77:0/3670555514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36240fb7f0 0x7f36240fe210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:29.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.275+0000 7f362c13a700 1 --2- 172.21.15.77:0/3670555514 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36240fc190 0x7f36240fc780 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:29.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.275+0000 7f362c13a700 1 -- 172.21.15.77:0/3670555514 >> 172.21.15.77:0/3670555514 conn(0x7f3624071460 msgr2=0x7f3624100a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:29.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.275+0000 7f362c13a700 1 -- 172.21.15.77:0/3670555514 shutdown_connections 2024-04-25T02:05:29.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:29.275+0000 7f362c13a700 1 -- 172.21.15.77:0/3670555514 wait complete. 2024-04-25T02:05:29.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:29 smithi077 ceph-mon[26330]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:29.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:29 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/3670555514' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-25T02:05:30.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.236+0000 7feb831aa700 1 -- 172.21.15.77:0/3065802536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb7c1026a0 msgr2=0x7feb7c0fbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:30.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.236+0000 7feb831aa700 1 --2- 172.21.15.77:0/3065802536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb7c1026a0 0x7feb7c0fbd10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7feb68004880 tx=0x7feb68009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:30.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.236+0000 7feb831aa700 1 -- 172.21.15.77:0/3065802536 shutdown_connections 2024-04-25T02:05:30.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.236+0000 7feb831aa700 1 --2- 172.21.15.77:0/3065802536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb7c1026a0 0x7feb7c0fbd10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:30.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.236+0000 7feb831aa700 1 --2- 172.21.15.77:0/3065802536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb7c101d00 0x7feb7c1020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:30.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.236+0000 7feb831aa700 1 -- 172.21.15.77:0/3065802536 >> 172.21.15.77:0/3065802536 conn(0x7feb7c0f78d0 msgr2=0x7feb7c0f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:30.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.236+0000 7feb831aa700 1 -- 172.21.15.77:0/3065802536 shutdown_connections 2024-04-25T02:05:30.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.236+0000 7feb831aa700 1 -- 172.21.15.77:0/3065802536 wait complete. 2024-04-25T02:05:30.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.237+0000 7feb831aa700 1 Processor -- start 2024-04-25T02:05:30.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.237+0000 7feb831aa700 1 -- start start 2024-04-25T02:05:30.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.237+0000 7feb831aa700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb7c101d00 0x7feb7c113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:30.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.237+0000 7feb831aa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb7c1026a0 0x7feb7c1140f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:30.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.237+0000 7feb831aa700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c114740 con 0x7feb7c101d00 2024-04-25T02:05:30.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.237+0000 7feb831aa700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c10db50 con 0x7feb7c1026a0 2024-04-25T02:05:30.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.237+0000 7feb80f46700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb7c101d00 0x7feb7c113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:30.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.237+0000 7feb80f46700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb7c101d00 0x7feb7c113bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59716/0 (socket says 172.21.15.77:59716) 2024-04-25T02:05:30.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.237+0000 7feb80f46700 1 -- 172.21.15.77:0/3359596251 learned_addr learned my addr 172.21.15.77:0/3359596251 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:05:30.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.237+0000 7feb7bfff700 1 --2- 172.21.15.77:0/3359596251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb7c1026a0 0x7feb7c1140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:30.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.237+0000 7feb80f46700 1 -- 172.21.15.77:0/3359596251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb7c1026a0 msgr2=0x7feb7c1140f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:30.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.237+0000 7feb80f46700 1 --2- 172.21.15.77:0/3359596251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb7c1026a0 0x7feb7c1140f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:30.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.237+0000 7feb80f46700 1 -- 172.21.15.77:0/3359596251 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb68005040 con 0x7feb7c101d00 2024-04-25T02:05:30.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.238+0000 7feb80f46700 1 --2- 172.21.15.77:0/3359596251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb7c101d00 0x7feb7c113bb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7feb700041d0 tx=0x7feb7000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:30.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.238+0000 7feb797fa700 1 -- 172.21.15.77:0/3359596251 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb70007cc0 con 0x7feb7c101d00 2024-04-25T02:05:30.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.238+0000 7feb797fa700 1 -- 172.21.15.77:0/3359596251 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb7000f040 con 0x7feb7c101d00 2024-04-25T02:05:30.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.238+0000 7feb831aa700 1 -- 172.21.15.77:0/3359596251 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb7c10ddd0 con 0x7feb7c101d00 2024-04-25T02:05:30.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.238+0000 7feb797fa700 1 -- 172.21.15.77:0/3359596251 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb7000ca50 con 0x7feb7c101d00 2024-04-25T02:05:30.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.238+0000 7feb831aa700 1 -- 172.21.15.77:0/3359596251 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb7c10e390 con 0x7feb7c101d00 2024-04-25T02:05:30.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.239+0000 7feb831aa700 1 -- 172.21.15.77:0/3359596251 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feb7c10e850 con 0x7feb7c101d00 2024-04-25T02:05:30.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.239+0000 7feb797fa700 1 -- 172.21.15.77:0/3359596251 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7feb7000ccc0 con 0x7feb7c101d00 2024-04-25T02:05:30.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.240+0000 7feb797fa700 1 --2- 172.21.15.77:0/3359596251 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7feb6c0692b0 0x7feb6c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:30.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.240+0000 7feb797fa700 1 -- 172.21.15.77:0/3359596251 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7feb70087400 con 0x7feb7c101d00 2024-04-25T02:05:30.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.240+0000 7feb7bfff700 1 --2- 172.21.15.77:0/3359596251 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7feb6c0692b0 0x7feb6c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:30.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.240+0000 7feb797fa700 1 --2- 172.21.15.77:0/3359596251 >> [v2:172.21.15.77:6818/625070655,v1:172.21.15.77:6819/625070655] conn(0x7feb6c06ef80 0x7feb6c071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:30.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.240+0000 7feb797fa700 1 -- 172.21.15.77:0/3359596251 --> [v2:172.21.15.77:6818/625070655,v1:172.21.15.77:6819/625070655] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feb6c071a40 con 0x7feb6c06ef80 2024-04-25T02:05:30.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.240+0000 7feb797fa700 1 -- 172.21.15.77:0/3359596251 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb700877e0 con 0x7feb7c101d00 2024-04-25T02:05:30.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.240+0000 7feb81747700 1 --2- 172.21.15.77:0/3359596251 >> [v2:172.21.15.77:6818/625070655,v1:172.21.15.77:6819/625070655] conn(0x7feb6c06ef80 0x7feb6c071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:30.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.241+0000 7feb7bfff700 1 --2- 172.21.15.77:0/3359596251 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7feb6c0692b0 0x7feb6c06b760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feb7c10f450 tx=0x7feb68009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:30.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.241+0000 7feb81747700 1 --2- 172.21.15.77:0/3359596251 >> [v2:172.21.15.77:6818/625070655,v1:172.21.15.77:6819/625070655] conn(0x7feb6c06ef80 0x7feb6c071390 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:30.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.241+0000 7feb797fa700 1 -- 172.21.15.77:0/3359596251 <== osd.2 v2:172.21.15.77:6818/625070655 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7feb6c071a40 con 0x7feb6c06ef80 2024-04-25T02:05:30.255 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:05:30.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.258+0000 7feb831aa700 1 -- 172.21.15.77:0/3359596251 --> [v2:172.21.15.77:6818/625070655,v1:172.21.15.77:6819/625070655] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feb7c0fd450 con 0x7feb6c06ef80 2024-04-25T02:05:30.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.258+0000 7feb797fa700 1 -- 172.21.15.77:0/3359596251 <== osd.2 v2:172.21.15.77:6818/625070655 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7feb7c0fd450 con 0x7feb6c06ef80 2024-04-25T02:05:30.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.258+0000 7feb831aa700 1 -- 172.21.15.77:0/3359596251 >> [v2:172.21.15.77:6818/625070655,v1:172.21.15.77:6819/625070655] conn(0x7feb6c06ef80 msgr2=0x7feb6c071390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:30.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.259+0000 7feb831aa700 1 --2- 172.21.15.77:0/3359596251 >> [v2:172.21.15.77:6818/625070655,v1:172.21.15.77:6819/625070655] conn(0x7feb6c06ef80 0x7feb6c071390 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:30.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.259+0000 7feb831aa700 1 -- 172.21.15.77:0/3359596251 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7feb6c0692b0 msgr2=0x7feb6c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:30.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.259+0000 7feb831aa700 1 --2- 172.21.15.77:0/3359596251 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7feb6c0692b0 0x7feb6c06b760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feb7c10f450 tx=0x7feb68009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:30.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.259+0000 7feb831aa700 1 -- 172.21.15.77:0/3359596251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb7c101d00 msgr2=0x7feb7c113bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:30.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.259+0000 7feb831aa700 1 --2- 172.21.15.77:0/3359596251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb7c101d00 0x7feb7c113bb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7feb700041d0 tx=0x7feb7000b040 comp rx=0 tx=0).stop 2024-04-25T02:05:30.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.259+0000 7feb831aa700 1 -- 172.21.15.77:0/3359596251 shutdown_connections 2024-04-25T02:05:30.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.259+0000 7feb831aa700 1 --2- 172.21.15.77:0/3359596251 >> [v2:172.21.15.77:6818/625070655,v1:172.21.15.77:6819/625070655] conn(0x7feb6c06ef80 0x7feb6c071390 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:30.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.259+0000 7feb831aa700 1 --2- 172.21.15.77:0/3359596251 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7feb6c0692b0 0x7feb6c06b760 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:30.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.259+0000 7feb831aa700 1 --2- 172.21.15.77:0/3359596251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb7c101d00 0x7feb7c113bb0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:30.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.259+0000 7feb831aa700 1 --2- 172.21.15.77:0/3359596251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb7c1026a0 0x7feb7c1140f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:30.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.259+0000 7feb831aa700 1 -- 172.21.15.77:0/3359596251 >> 172.21.15.77:0/3359596251 conn(0x7feb7c0f78d0 msgr2=0x7feb7c0f88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:30.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.259+0000 7feb831aa700 1 -- 172.21.15.77:0/3359596251 shutdown_connections 2024-04-25T02:05:30.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:30.259+0000 7feb831aa700 1 -- 172.21.15.77:0/3359596251 wait complete. 2024-04-25T02:05:30.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:29 smithi112 ceph-mon[33313]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:30.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:29 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/3670555514' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-25T02:05:30.751 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705697 got 38654705699 for osd.0 2024-04-25T02:05:30.752 DEBUG:teuthology.parallel:result is None 2024-04-25T02:05:30.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:30 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:05:31.017 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:05:31.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:30 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:05:32.003 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:31 smithi077 ceph-mon[26330]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:32.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:31 smithi112 ceph-mon[33313]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:32.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.389+0000 7ff1193d2700 1 -- 172.21.15.77:0/3400742335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff114103780 msgr2=0x7ff1140fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:32.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.389+0000 7ff1193d2700 1 --2- 172.21.15.77:0/3400742335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff114103780 0x7ff1140fcdf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff108004940 tx=0x7ff108009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:32.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.389+0000 7ff1193d2700 1 -- 172.21.15.77:0/3400742335 shutdown_connections 2024-04-25T02:05:32.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.389+0000 7ff1193d2700 1 --2- 172.21.15.77:0/3400742335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff114103780 0x7ff1140fcdf0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:32.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.389+0000 7ff1193d2700 1 --2- 172.21.15.77:0/3400742335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff114102de0 0x7ff1141031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:32.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.389+0000 7ff1193d2700 1 -- 172.21.15.77:0/3400742335 >> 172.21.15.77:0/3400742335 conn(0x7ff1140f8990 msgr2=0x7ff1140fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:32.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.389+0000 7ff1193d2700 1 -- 172.21.15.77:0/3400742335 shutdown_connections 2024-04-25T02:05:32.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.389+0000 7ff1193d2700 1 -- 172.21.15.77:0/3400742335 wait complete. 2024-04-25T02:05:32.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.390+0000 7ff1193d2700 1 Processor -- start 2024-04-25T02:05:32.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.390+0000 7ff1193d2700 1 -- start start 2024-04-25T02:05:32.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.390+0000 7ff1193d2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff114102de0 0x7ff114070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:32.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.390+0000 7ff1193d2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff114103780 0x7ff1140707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:32.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.390+0000 7ff1193d2700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1140721b0 con 0x7ff114103780 2024-04-25T02:05:32.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.390+0000 7ff1193d2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff114070ce0 con 0x7ff114102de0 2024-04-25T02:05:32.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.390+0000 7ff1127fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff114103780 0x7ff1140707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:32.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.390+0000 7ff1127fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff114103780 0x7ff1140707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59730/0 (socket says 172.21.15.77:59730) 2024-04-25T02:05:32.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.390+0000 7ff1127fc700 1 -- 172.21.15.77:0/1540912582 learned_addr learned my addr 172.21.15.77:0/1540912582 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:05:32.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.390+0000 7ff112ffd700 1 --2- 172.21.15.77:0/1540912582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff114102de0 0x7ff114070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:32.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.390+0000 7ff1127fc700 1 -- 172.21.15.77:0/1540912582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff114102de0 msgr2=0x7ff114070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:32.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.390+0000 7ff1127fc700 1 --2- 172.21.15.77:0/1540912582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff114102de0 0x7ff114070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:32.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.390+0000 7ff1127fc700 1 -- 172.21.15.77:0/1540912582 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff108005040 con 0x7ff114103780 2024-04-25T02:05:32.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.390+0000 7ff1127fc700 1 --2- 172.21.15.77:0/1540912582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff114103780 0x7ff1140707a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff108009100 tx=0x7ff108009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:32.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.391+0000 7ff0fb7fe700 1 -- 172.21.15.77:0/1540912582 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff10800e040 con 0x7ff114103780 2024-04-25T02:05:32.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.391+0000 7ff1193d2700 1 -- 172.21.15.77:0/1540912582 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff114070f60 con 0x7ff114103780 2024-04-25T02:05:32.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.391+0000 7ff0fb7fe700 1 -- 172.21.15.77:0/1540912582 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff108013420 con 0x7ff114103780 2024-04-25T02:05:32.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.391+0000 7ff0fb7fe700 1 -- 172.21.15.77:0/1540912582 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff10801c610 con 0x7ff114103780 2024-04-25T02:05:32.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.391+0000 7ff1193d2700 1 -- 172.21.15.77:0/1540912582 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff11411a0b0 con 0x7ff114103780 2024-04-25T02:05:32.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.392+0000 7ff1193d2700 1 -- 172.21.15.77:0/1540912582 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1141052b0 con 0x7ff114103780 2024-04-25T02:05:32.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.392+0000 7ff0fb7fe700 1 -- 172.21.15.77:0/1540912582 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff108013590 con 0x7ff114103780 2024-04-25T02:05:32.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.393+0000 7ff0fb7fe700 1 --2- 172.21.15.77:0/1540912582 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7ff0fc0692a0 0x7ff0fc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:32.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.393+0000 7ff112ffd700 1 --2- 172.21.15.77:0/1540912582 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7ff0fc0692a0 0x7ff0fc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:32.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.393+0000 7ff0fb7fe700 1 -- 172.21.15.77:0/1540912582 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff1080880e0 con 0x7ff114103780 2024-04-25T02:05:32.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.393+0000 7ff112ffd700 1 --2- 172.21.15.77:0/1540912582 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7ff0fc0692a0 0x7ff0fc06b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff104009fd0 tx=0x7ff104009e90 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:32.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.397+0000 7ff0fb7fe700 1 -- 172.21.15.77:0/1540912582 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff108054750 con 0x7ff114103780 2024-04-25T02:05:32.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.594+0000 7ff1193d2700 1 -- 172.21.15.77:0/1540912582 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff114109ee0 con 0x7ff114103780 2024-04-25T02:05:32.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.594+0000 7ff0fb7fe700 1 -- 172.21.15.77:0/1540912582 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff108057d70 con 0x7ff114103780 2024-04-25T02:05:32.601 INFO:teuthology.orchestra.run.smithi077.stdout:60129542175 2024-04-25T02:05:32.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.596+0000 7ff1193d2700 1 -- 172.21.15.77:0/1540912582 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7ff0fc0692a0 msgr2=0x7ff0fc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:32.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.596+0000 7ff1193d2700 1 --2- 172.21.15.77:0/1540912582 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7ff0fc0692a0 0x7ff0fc06b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff104009fd0 tx=0x7ff104009e90 comp rx=0 tx=0).stop 2024-04-25T02:05:32.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.596+0000 7ff1193d2700 1 -- 172.21.15.77:0/1540912582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff114103780 msgr2=0x7ff1140707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:32.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.596+0000 7ff1193d2700 1 --2- 172.21.15.77:0/1540912582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff114103780 0x7ff1140707a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff108009100 tx=0x7ff108009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:32.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.597+0000 7ff1193d2700 1 -- 172.21.15.77:0/1540912582 shutdown_connections 2024-04-25T02:05:32.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.597+0000 7ff1193d2700 1 --2- 172.21.15.77:0/1540912582 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7ff0fc0692a0 0x7ff0fc06b750 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:32.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.597+0000 7ff1193d2700 1 --2- 172.21.15.77:0/1540912582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff114102de0 0x7ff114070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:32.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.597+0000 7ff1193d2700 1 --2- 172.21.15.77:0/1540912582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff114103780 0x7ff1140707a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:32.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.597+0000 7ff1193d2700 1 -- 172.21.15.77:0/1540912582 >> 172.21.15.77:0/1540912582 conn(0x7ff1140f8990 msgr2=0x7ff1141021e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:32.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.597+0000 7ff1193d2700 1 -- 172.21.15.77:0/1540912582 shutdown_connections 2024-04-25T02:05:32.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:32.597+0000 7ff1193d2700 1 -- 172.21.15.77:0/1540912582 wait complete. 2024-04-25T02:05:33.118 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:32 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/1540912582' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-25T02:05:33.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:32 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/1540912582' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-25T02:05:33.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.395+0000 7f25c0084700 1 -- 172.21.15.77:0/379473510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25b8101560 msgr2=0x7f25b80fb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:33.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.395+0000 7f25c0084700 1 --2- 172.21.15.77:0/379473510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25b8101560 0x7f25b80fb350 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f25a8004940 tx=0x7f25a8009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:33.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.396+0000 7f25c0084700 1 -- 172.21.15.77:0/379473510 shutdown_connections 2024-04-25T02:05:33.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.396+0000 7f25c0084700 1 --2- 172.21.15.77:0/379473510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25b8101560 0x7f25b80fb350 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:33.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.396+0000 7f25c0084700 1 --2- 172.21.15.77:0/379473510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25b8100bc0 0x7f25b8100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:33.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.396+0000 7f25c0084700 1 -- 172.21.15.77:0/379473510 >> 172.21.15.77:0/379473510 conn(0x7f25b8073350 msgr2=0x7f25b8073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:33.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.396+0000 7f25c0084700 1 -- 172.21.15.77:0/379473510 shutdown_connections 2024-04-25T02:05:33.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.396+0000 7f25c0084700 1 -- 172.21.15.77:0/379473510 wait complete. 2024-04-25T02:05:33.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.396+0000 7f25c0084700 1 Processor -- start 2024-04-25T02:05:33.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.396+0000 7f25c0084700 1 -- start start 2024-04-25T02:05:33.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.396+0000 7f25c0084700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25b8100bc0 0x7f25b8119f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:33.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.396+0000 7f25c0084700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25b8101560 0x7f25b811a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:33.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.396+0000 7f25c0084700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b811aac0 con 0x7f25b8101560 2024-04-25T02:05:33.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.396+0000 7f25c0084700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b81140a0 con 0x7f25b8100bc0 2024-04-25T02:05:33.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.397+0000 7f25bd61f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25b8101560 0x7f25b811a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:33.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.397+0000 7f25bd61f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25b8101560 0x7f25b811a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59746/0 (socket says 172.21.15.77:59746) 2024-04-25T02:05:33.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.397+0000 7f25bd61f700 1 -- 172.21.15.77:0/2741949043 learned_addr learned my addr 172.21.15.77:0/2741949043 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:05:33.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.397+0000 7f25bde20700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25b8100bc0 0x7f25b8119f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:33.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.397+0000 7f25bd61f700 1 -- 172.21.15.77:0/2741949043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25b8100bc0 msgr2=0x7f25b8119f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:33.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.397+0000 7f25bd61f700 1 --2- 172.21.15.77:0/2741949043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25b8100bc0 0x7f25b8119f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:33.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.397+0000 7f25bd61f700 1 -- 172.21.15.77:0/2741949043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a8005040 con 0x7f25b8101560 2024-04-25T02:05:33.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.397+0000 7f25bd61f700 1 --2- 172.21.15.77:0/2741949043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25b8101560 0x7f25b811a470 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f25a800b8b0 tx=0x7f25a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:33.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.397+0000 7f25ae7fc700 1 -- 172.21.15.77:0/2741949043 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25a800e040 con 0x7f25b8101560 2024-04-25T02:05:33.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.397+0000 7f25c0084700 1 -- 172.21.15.77:0/2741949043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b8114320 con 0x7f25b8101560 2024-04-25T02:05:33.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.397+0000 7f25ae7fc700 1 -- 172.21.15.77:0/2741949043 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f25a8004290 con 0x7f25b8101560 2024-04-25T02:05:33.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.397+0000 7f25ae7fc700 1 -- 172.21.15.77:0/2741949043 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25a801c3f0 con 0x7f25b8101560 2024-04-25T02:05:33.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.397+0000 7f25c0084700 1 -- 172.21.15.77:0/2741949043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b81148e0 con 0x7f25b8101560 2024-04-25T02:05:33.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.398+0000 7f25c0084700 1 -- 172.21.15.77:0/2741949043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b810c9f0 con 0x7f25b8101560 2024-04-25T02:05:33.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.399+0000 7f25ae7fc700 1 -- 172.21.15.77:0/2741949043 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f25a8013420 con 0x7f25b8101560 2024-04-25T02:05:33.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.399+0000 7f25ae7fc700 1 --2- 172.21.15.77:0/2741949043 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f25a40692a0 0x7f25a406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:33.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.399+0000 7f25ae7fc700 1 -- 172.21.15.77:0/2741949043 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f25a80880b0 con 0x7f25b8101560 2024-04-25T02:05:33.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.399+0000 7f25bde20700 1 --2- 172.21.15.77:0/2741949043 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f25a40692a0 0x7f25a406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:33.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.399+0000 7f25bde20700 1 --2- 172.21.15.77:0/2741949043 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f25a40692a0 0x7f25a406b750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f25b4007fd0 tx=0x7f25b4009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:33.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.403+0000 7f25ae7fc700 1 -- 172.21.15.77:0/2741949043 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f25a80581b0 con 0x7f25b8101560 2024-04-25T02:05:33.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.595+0000 7f25c0084700 1 -- 172.21.15.77:0/2741949043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f25b80fc360 con 0x7f25b8101560 2024-04-25T02:05:33.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.596+0000 7f25ae7fc700 1 -- 172.21.15.77:0/2741949043 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25a8057d40 con 0x7f25b8101560 2024-04-25T02:05:33.602 INFO:teuthology.orchestra.run.smithi077.stdout:115964117013 2024-04-25T02:05:33.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.598+0000 7f25c0084700 1 -- 172.21.15.77:0/2741949043 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f25a40692a0 msgr2=0x7f25a406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:33.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.598+0000 7f25c0084700 1 --2- 172.21.15.77:0/2741949043 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f25a40692a0 0x7f25a406b750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f25b4007fd0 tx=0x7f25b4009040 comp rx=0 tx=0).stop 2024-04-25T02:05:33.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.598+0000 7f25c0084700 1 -- 172.21.15.77:0/2741949043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25b8101560 msgr2=0x7f25b811a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:33.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.598+0000 7f25c0084700 1 --2- 172.21.15.77:0/2741949043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25b8101560 0x7f25b811a470 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f25a800b8b0 tx=0x7f25a8009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:33.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.598+0000 7f25c0084700 1 -- 172.21.15.77:0/2741949043 shutdown_connections 2024-04-25T02:05:33.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.598+0000 7f25c0084700 1 --2- 172.21.15.77:0/2741949043 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f25a40692a0 0x7f25a406b750 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:33.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.598+0000 7f25c0084700 1 --2- 172.21.15.77:0/2741949043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f25b8100bc0 0x7f25b8119f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:33.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.598+0000 7f25c0084700 1 --2- 172.21.15.77:0/2741949043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25b8101560 0x7f25b811a470 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:33.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.598+0000 7f25c0084700 1 -- 172.21.15.77:0/2741949043 >> 172.21.15.77:0/2741949043 conn(0x7f25b8073350 msgr2=0x7f25b80fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:33.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.598+0000 7f25c0084700 1 -- 172.21.15.77:0/2741949043 shutdown_connections 2024-04-25T02:05:33.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:33.598+0000 7f25c0084700 1 -- 172.21.15.77:0/2741949043 wait complete. 2024-04-25T02:05:34.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:33 smithi077 ceph-mon[26330]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:34.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:33 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/2741949043' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-25T02:05:34.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:33 smithi112 ceph-mon[33313]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:34.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:33 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/2741949043' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-25T02:05:35.098 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117011 got 115964117013 for osd.3 2024-04-25T02:05:35.098 DEBUG:teuthology.parallel:result is None 2024-04-25T02:05:35.614 INFO:teuthology.orchestra.run.smithi077.stdout:81604378650 2024-04-25T02:05:35.615 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-04-25T02:05:35.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:35 smithi077 ceph-mon[26330]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:36.010 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:05:36.031 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542173 got 60129542175 for osd.1 2024-04-25T02:05:36.031 DEBUG:teuthology.parallel:result is None 2024-04-25T02:05:36.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:35 smithi112 ceph-mon[33313]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:37.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.111+0000 7fdec427e700 1 -- 172.21.15.77:0/456412342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdebc0fddf0 msgr2=0x7fdebc0fe1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:37.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.111+0000 7fdec427e700 1 --2- 172.21.15.77:0/456412342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdebc0fddf0 0x7fdebc0fe1c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8004970 tx=0x7fdeb8009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:37.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.111+0000 7fdec427e700 1 -- 172.21.15.77:0/456412342 shutdown_connections 2024-04-25T02:05:37.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.112+0000 7fdec427e700 1 --2- 172.21.15.77:0/456412342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdebc0fe790 0x7fdebc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:37.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.112+0000 7fdec427e700 1 --2- 172.21.15.77:0/456412342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdebc0fddf0 0x7fdebc0fe1c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:37.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.112+0000 7fdec427e700 1 -- 172.21.15.77:0/456412342 >> 172.21.15.77:0/456412342 conn(0x7fdebc0f7870 msgr2=0x7fdebc0f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:37.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.112+0000 7fdec427e700 1 -- 172.21.15.77:0/456412342 shutdown_connections 2024-04-25T02:05:37.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.112+0000 7fdec427e700 1 -- 172.21.15.77:0/456412342 wait complete. 2024-04-25T02:05:37.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.112+0000 7fdec427e700 1 Processor -- start 2024-04-25T02:05:37.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.112+0000 7fdec427e700 1 -- start start 2024-04-25T02:05:37.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.112+0000 7fdec427e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdebc0fddf0 0x7fdebc0fbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:37.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.112+0000 7fdec427e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdebc0fe790 0x7fdebc0fc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:37.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.112+0000 7fdec427e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdebc0fdc40 con 0x7fdebc0fddf0 2024-04-25T02:05:37.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.112+0000 7fdec427e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdebc0fc730 con 0x7fdebc0fe790 2024-04-25T02:05:37.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.112+0000 7fdec201a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdebc0fddf0 0x7fdebc0fbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:37.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.112+0000 7fdec201a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdebc0fddf0 0x7fdebc0fbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59766/0 (socket says 172.21.15.77:59766) 2024-04-25T02:05:37.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.112+0000 7fdec201a700 1 -- 172.21.15.77:0/516439323 learned_addr learned my addr 172.21.15.77:0/516439323 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:05:37.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.113+0000 7fdec201a700 1 -- 172.21.15.77:0/516439323 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdebc0fe790 msgr2=0x7fdebc0fc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:37.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.113+0000 7fdec201a700 1 --2- 172.21.15.77:0/516439323 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdebc0fe790 0x7fdebc0fc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:37.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.113+0000 7fdec201a700 1 -- 172.21.15.77:0/516439323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb8005040 con 0x7fdebc0fddf0 2024-04-25T02:05:37.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.113+0000 7fdec201a700 1 --2- 172.21.15.77:0/516439323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdebc0fddf0 0x7fdebc0fbcb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8000c00 tx=0x7fdeb8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:37.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.113+0000 7fdeb2ffd700 1 -- 172.21.15.77:0/516439323 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdeb800e040 con 0x7fdebc0fddf0 2024-04-25T02:05:37.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.113+0000 7fdeb2ffd700 1 -- 172.21.15.77:0/516439323 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdeb800bc10 con 0x7fdebc0fddf0 2024-04-25T02:05:37.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.113+0000 7fdeb2ffd700 1 -- 172.21.15.77:0/516439323 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdeb801c630 con 0x7fdebc0fddf0 2024-04-25T02:05:37.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.113+0000 7fdec427e700 1 -- 172.21.15.77:0/516439323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdebc0fc9b0 con 0x7fdebc0fddf0 2024-04-25T02:05:37.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.113+0000 7fdec427e700 1 -- 172.21.15.77:0/516439323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdebc11a0d0 con 0x7fdebc0fddf0 2024-04-25T02:05:37.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.114+0000 7fdec427e700 1 -- 172.21.15.77:0/516439323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdebc066af0 con 0x7fdebc0fddf0 2024-04-25T02:05:37.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.114+0000 7fdeb2ffd700 1 -- 172.21.15.77:0/516439323 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fdeb800bd80 con 0x7fdebc0fddf0 2024-04-25T02:05:37.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.115+0000 7fdeb2ffd700 1 --2- 172.21.15.77:0/516439323 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fdea80692a0 0x7fdea806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:37.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.115+0000 7fdeb2ffd700 1 -- 172.21.15.77:0/516439323 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fdeb8088090 con 0x7fdebc0fddf0 2024-04-25T02:05:37.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.115+0000 7fdec1819700 1 --2- 172.21.15.77:0/516439323 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fdea80692a0 0x7fdea806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:37.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.115+0000 7fdec1819700 1 --2- 172.21.15.77:0/516439323 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fdea80692a0 0x7fdea806b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdeac006fd0 tx=0x7fdeac006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:37.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.119+0000 7fdeb2ffd700 1 -- 172.21.15.77:0/516439323 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fdeb8054700 con 0x7fdebc0fddf0 2024-04-25T02:05:37.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.312+0000 7fdec427e700 1 -- 172.21.15.77:0/516439323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fdebc04c710 con 0x7fdebc0fddf0 2024-04-25T02:05:37.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.312+0000 7fdeb2ffd700 1 -- 172.21.15.77:0/516439323 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdeb8013e60 con 0x7fdebc0fddf0 2024-04-25T02:05:37.318 INFO:teuthology.orchestra.run.smithi077.stdout:150323855376 2024-04-25T02:05:37.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.314+0000 7fdec427e700 1 -- 172.21.15.77:0/516439323 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fdea80692a0 msgr2=0x7fdea806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:37.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.314+0000 7fdec427e700 1 --2- 172.21.15.77:0/516439323 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fdea80692a0 0x7fdea806b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdeac006fd0 tx=0x7fdeac006db0 comp rx=0 tx=0).stop 2024-04-25T02:05:37.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.314+0000 7fdec427e700 1 -- 172.21.15.77:0/516439323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdebc0fddf0 msgr2=0x7fdebc0fbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:37.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.314+0000 7fdec427e700 1 --2- 172.21.15.77:0/516439323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdebc0fddf0 0x7fdebc0fbcb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8000c00 tx=0x7fdeb8009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:37.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.314+0000 7fdec427e700 1 -- 172.21.15.77:0/516439323 shutdown_connections 2024-04-25T02:05:37.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.314+0000 7fdec427e700 1 --2- 172.21.15.77:0/516439323 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fdea80692a0 0x7fdea806b750 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:37.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.314+0000 7fdec427e700 1 --2- 172.21.15.77:0/516439323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdebc0fddf0 0x7fdebc0fbcb0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:37.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.314+0000 7fdec427e700 1 --2- 172.21.15.77:0/516439323 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdebc0fe790 0x7fdebc0fc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:37.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.314+0000 7fdec427e700 1 -- 172.21.15.77:0/516439323 >> 172.21.15.77:0/516439323 conn(0x7fdebc0f7870 msgr2=0x7fdebc103710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:37.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.314+0000 7fdec427e700 1 -- 172.21.15.77:0/516439323 shutdown_connections 2024-04-25T02:05:37.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:37.314+0000 7fdec427e700 1 -- 172.21.15.77:0/516439323 wait complete. 2024-04-25T02:05:38.083 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:37 smithi077 ceph-mon[26330]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:38.083 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:37 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/516439323' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-25T02:05:38.108 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855374 got 150323855376 for osd.4 2024-04-25T02:05:38.108 DEBUG:teuthology.parallel:result is None 2024-04-25T02:05:38.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:37 smithi112 ceph-mon[33313]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:38.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:37 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/516439323' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-25T02:05:38.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.546+0000 7f3421a31700 1 -- 172.21.15.77:0/942733899 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f341c0702a0 msgr2=0x7f341c070670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:38.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.546+0000 7f3421a31700 1 --2- 172.21.15.77:0/942733899 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f341c0702a0 0x7f341c070670 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f340c004970 tx=0x7f340c009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:38.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.546+0000 7f3421a31700 1 -- 172.21.15.77:0/942733899 shutdown_connections 2024-04-25T02:05:38.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.546+0000 7f3421a31700 1 --2- 172.21.15.77:0/942733899 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f341c070bb0 0x7f341c109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:38.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.546+0000 7f3421a31700 1 --2- 172.21.15.77:0/942733899 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f341c0702a0 0x7f341c070670 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:38.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.546+0000 7f3421a31700 1 -- 172.21.15.77:0/942733899 >> 172.21.15.77:0/942733899 conn(0x7f341c0f8990 msgr2=0x7f341c0fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:38.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.546+0000 7f3421a31700 1 -- 172.21.15.77:0/942733899 shutdown_connections 2024-04-25T02:05:38.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.546+0000 7f3421a31700 1 -- 172.21.15.77:0/942733899 wait complete. 2024-04-25T02:05:38.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.547+0000 7f3421a31700 1 Processor -- start 2024-04-25T02:05:38.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.547+0000 7f3421a31700 1 -- start start 2024-04-25T02:05:38.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.547+0000 7f3421a31700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f341c0702a0 0x7f341c115ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:38.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.547+0000 7f3421a31700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f341c070bb0 0x7f341c1160e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:38.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.547+0000 7f3421a31700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341c1167c0 con 0x7f341c0702a0 2024-04-25T02:05:38.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.547+0000 7f3421a31700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341c10fd10 con 0x7f341c070bb0 2024-04-25T02:05:38.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.547+0000 7f341affd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f341c0702a0 0x7f341c115ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:38.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.548+0000 7f341affd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f341c0702a0 0x7f341c115ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50110/0 (socket says 172.21.15.77:50110) 2024-04-25T02:05:38.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.548+0000 7f341affd700 1 -- 172.21.15.77:0/2119274892 learned_addr learned my addr 172.21.15.77:0/2119274892 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:05:38.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.548+0000 7f341a7fc700 1 --2- 172.21.15.77:0/2119274892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f341c070bb0 0x7f341c1160e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:38.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.548+0000 7f341affd700 1 -- 172.21.15.77:0/2119274892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f341c070bb0 msgr2=0x7f341c1160e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:38.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.548+0000 7f341affd700 1 --2- 172.21.15.77:0/2119274892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f341c070bb0 0x7f341c1160e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:38.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.548+0000 7f341affd700 1 -- 172.21.15.77:0/2119274892 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340c005040 con 0x7f341c0702a0 2024-04-25T02:05:38.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.548+0000 7f341a7fc700 1 --2- 172.21.15.77:0/2119274892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f341c070bb0 0x7f341c1160e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:05:38.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.548+0000 7f341affd700 1 --2- 172.21.15.77:0/2119274892 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f341c0702a0 0x7f341c115ba0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f340c004f50 tx=0x7f340c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:38.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.548+0000 7f34037fe700 1 -- 172.21.15.77:0/2119274892 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f340c00e040 con 0x7f341c0702a0 2024-04-25T02:05:38.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.548+0000 7f3421a31700 1 -- 172.21.15.77:0/2119274892 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f341c10ff30 con 0x7f341c0702a0 2024-04-25T02:05:38.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.548+0000 7f34037fe700 1 -- 172.21.15.77:0/2119274892 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f340c004290 con 0x7f341c0702a0 2024-04-25T02:05:38.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.548+0000 7f34037fe700 1 -- 172.21.15.77:0/2119274892 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f340c01c3f0 con 0x7f341c0702a0 2024-04-25T02:05:38.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.548+0000 7f3421a31700 1 -- 172.21.15.77:0/2119274892 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f341c110470 con 0x7f341c0702a0 2024-04-25T02:05:38.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.549+0000 7f3421a31700 1 -- 172.21.15.77:0/2119274892 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f341c0719e0 con 0x7f341c0702a0 2024-04-25T02:05:38.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.549+0000 7f34037fe700 1 -- 172.21.15.77:0/2119274892 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f340c00bc10 con 0x7f341c0702a0 2024-04-25T02:05:38.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.550+0000 7f34037fe700 1 --2- 172.21.15.77:0/2119274892 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f34040692a0 0x7f340406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:38.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.550+0000 7f34037fe700 1 -- 172.21.15.77:0/2119274892 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f340c088120 con 0x7f341c0702a0 2024-04-25T02:05:38.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.550+0000 7f341a7fc700 1 --2- 172.21.15.77:0/2119274892 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f34040692a0 0x7f340406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:38.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.550+0000 7f341a7fc700 1 --2- 172.21.15.77:0/2119274892 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f34040692a0 0x7f340406b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f341c111440 tx=0x7f3410008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:38.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.554+0000 7f34037fe700 1 -- 172.21.15.77:0/2119274892 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f340c0582d0 con 0x7f341c0702a0 2024-04-25T02:05:38.594 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:05:38.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.749+0000 7f3421a31700 1 -- 172.21.15.77:0/2119274892 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f341c04c710 con 0x7f341c0702a0 2024-04-25T02:05:38.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.750+0000 7f34037fe700 1 -- 172.21.15.77:0/2119274892 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f340c057e60 con 0x7f341c0702a0 2024-04-25T02:05:38.756 INFO:teuthology.orchestra.run.smithi077.stdout:171798691851 2024-04-25T02:05:38.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.752+0000 7f3421a31700 1 -- 172.21.15.77:0/2119274892 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f34040692a0 msgr2=0x7f340406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:38.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.752+0000 7f3421a31700 1 --2- 172.21.15.77:0/2119274892 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f34040692a0 0x7f340406b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f341c111440 tx=0x7f3410008040 comp rx=0 tx=0).stop 2024-04-25T02:05:38.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.752+0000 7f3421a31700 1 -- 172.21.15.77:0/2119274892 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f341c0702a0 msgr2=0x7f341c115ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:38.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.752+0000 7f3421a31700 1 --2- 172.21.15.77:0/2119274892 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f341c0702a0 0x7f341c115ba0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f340c004f50 tx=0x7f340c009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:38.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.752+0000 7f3421a31700 1 -- 172.21.15.77:0/2119274892 shutdown_connections 2024-04-25T02:05:38.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.752+0000 7f3421a31700 1 --2- 172.21.15.77:0/2119274892 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f34040692a0 0x7f340406b750 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:38.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.752+0000 7f3421a31700 1 --2- 172.21.15.77:0/2119274892 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f341c0702a0 0x7f341c115ba0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:38.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.752+0000 7f3421a31700 1 --2- 172.21.15.77:0/2119274892 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f341c070bb0 0x7f341c1160e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:38.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.752+0000 7f3421a31700 1 -- 172.21.15.77:0/2119274892 >> 172.21.15.77:0/2119274892 conn(0x7f341c0f8990 msgr2=0x7f341c0f9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:38.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.752+0000 7f3421a31700 1 -- 172.21.15.77:0/2119274892 shutdown_connections 2024-04-25T02:05:38.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:38.752+0000 7f3421a31700 1 -- 172.21.15.77:0/2119274892 wait complete. 2024-04-25T02:05:38.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:38 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/2119274892' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-25T02:05:39.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:38 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/2119274892' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-25T02:05:39.819 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691849 got 171798691851 for osd.5 2024-04-25T02:05:39.819 DEBUG:teuthology.parallel:result is None 2024-04-25T02:05:40.222 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:39 smithi077 ceph-mon[26330]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:40.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:39 smithi112 ceph-mon[33313]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:40.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.701+0000 7ff9a1dc9700 1 -- 172.21.15.77:0/611371633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff99c070840 msgr2=0x7ff99c070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:40.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.701+0000 7ff9a1dc9700 1 --2- 172.21.15.77:0/611371633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff99c070840 0x7ff99c070cb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff984004970 tx=0x7ff984009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:40.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.701+0000 7ff9a1dc9700 1 -- 172.21.15.77:0/611371633 shutdown_connections 2024-04-25T02:05:40.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.701+0000 7ff9a1dc9700 1 --2- 172.21.15.77:0/611371633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff99c070840 0x7ff99c070cb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:40.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.701+0000 7ff9a1dc9700 1 --2- 172.21.15.77:0/611371633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff99c071f30 0x7ff99c070300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:40.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.701+0000 7ff9a1dc9700 1 -- 172.21.15.77:0/611371633 >> 172.21.15.77:0/611371633 conn(0x7ff99c0f8990 msgr2=0x7ff99c0fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:40.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.701+0000 7ff9a1dc9700 1 -- 172.21.15.77:0/611371633 shutdown_connections 2024-04-25T02:05:40.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.701+0000 7ff9a1dc9700 1 -- 172.21.15.77:0/611371633 wait complete. 2024-04-25T02:05:40.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.701+0000 7ff9a1dc9700 1 Processor -- start 2024-04-25T02:05:40.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.701+0000 7ff9a1dc9700 1 -- start start 2024-04-25T02:05:40.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.701+0000 7ff9a1dc9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff99c070840 0x7ff99c119fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:40.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.701+0000 7ff9a1dc9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff99c071f30 0x7ff99c11a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:40.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.701+0000 7ff9a1dc9700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c11abc0 con 0x7ff99c070840 2024-04-25T02:05:40.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.701+0000 7ff9a1dc9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c114110 con 0x7ff99c071f30 2024-04-25T02:05:40.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.702+0000 7ff99b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff99c070840 0x7ff99c119fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:40.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.702+0000 7ff99b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff99c070840 0x7ff99c119fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50138/0 (socket says 172.21.15.77:50138) 2024-04-25T02:05:40.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.702+0000 7ff99b7fe700 1 -- 172.21.15.77:0/1326939203 learned_addr learned my addr 172.21.15.77:0/1326939203 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:05:40.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.702+0000 7ff99b7fe700 1 -- 172.21.15.77:0/1326939203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff99c071f30 msgr2=0x7ff99c11a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:40.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.702+0000 7ff99b7fe700 1 --2- 172.21.15.77:0/1326939203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff99c071f30 0x7ff99c11a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:40.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.702+0000 7ff99b7fe700 1 -- 172.21.15.77:0/1326939203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff984005040 con 0x7ff99c070840 2024-04-25T02:05:40.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.702+0000 7ff99b7fe700 1 --2- 172.21.15.77:0/1326939203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff99c070840 0x7ff99c119fa0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00b790 tx=0x7ff98c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:40.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.702+0000 7ff998ff9700 1 -- 172.21.15.77:0/1326939203 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff98c00f770 con 0x7ff99c070840 2024-04-25T02:05:40.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.702+0000 7ff998ff9700 1 -- 172.21.15.77:0/1326939203 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff98c00fda0 con 0x7ff99c070840 2024-04-25T02:05:40.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.702+0000 7ff9a1dc9700 1 -- 172.21.15.77:0/1326939203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff99c114390 con 0x7ff99c070840 2024-04-25T02:05:40.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.702+0000 7ff998ff9700 1 -- 172.21.15.77:0/1326939203 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff98c00d310 con 0x7ff99c070840 2024-04-25T02:05:40.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.702+0000 7ff9a1dc9700 1 -- 172.21.15.77:0/1326939203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff99c1148d0 con 0x7ff99c070840 2024-04-25T02:05:40.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.703+0000 7ff9a1dc9700 1 -- 172.21.15.77:0/1326939203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff99c071a40 con 0x7ff99c070840 2024-04-25T02:05:40.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.704+0000 7ff998ff9700 1 -- 172.21.15.77:0/1326939203 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff98c010420 con 0x7ff99c070840 2024-04-25T02:05:40.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.704+0000 7ff998ff9700 1 --2- 172.21.15.77:0/1326939203 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7ff9880692a0 0x7ff98806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:40.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.704+0000 7ff998ff9700 1 -- 172.21.15.77:0/1326939203 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff98c086e80 con 0x7ff99c070840 2024-04-25T02:05:40.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.704+0000 7ff993fff700 1 --2- 172.21.15.77:0/1326939203 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7ff9880692a0 0x7ff98806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:40.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.704+0000 7ff993fff700 1 --2- 172.21.15.77:0/1326939203 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7ff9880692a0 0x7ff98806b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff984004540 tx=0x7ff984009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:40.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.708+0000 7ff998ff9700 1 -- 172.21.15.77:0/1326939203 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff98c056f80 con 0x7ff99c070840 2024-04-25T02:05:40.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.893+0000 7ff9a1dc9700 1 -- 172.21.15.77:0/1326939203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff99c1105b0 con 0x7ff99c070840 2024-04-25T02:05:40.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.894+0000 7ff998ff9700 1 -- 172.21.15.77:0/1326939203 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff98c056b10 con 0x7ff99c070840 2024-04-25T02:05:40.900 INFO:teuthology.orchestra.run.smithi077.stdout:81604378652 2024-04-25T02:05:40.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.896+0000 7ff9a1dc9700 1 -- 172.21.15.77:0/1326939203 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7ff9880692a0 msgr2=0x7ff98806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:40.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.896+0000 7ff9a1dc9700 1 --2- 172.21.15.77:0/1326939203 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7ff9880692a0 0x7ff98806b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff984004540 tx=0x7ff984009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:40.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.896+0000 7ff9a1dc9700 1 -- 172.21.15.77:0/1326939203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff99c070840 msgr2=0x7ff99c119fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:40.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.896+0000 7ff9a1dc9700 1 --2- 172.21.15.77:0/1326939203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff99c070840 0x7ff99c119fa0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00b790 tx=0x7ff98c009250 comp rx=0 tx=0).stop 2024-04-25T02:05:40.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.896+0000 7ff9a1dc9700 1 -- 172.21.15.77:0/1326939203 shutdown_connections 2024-04-25T02:05:40.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.896+0000 7ff9a1dc9700 1 --2- 172.21.15.77:0/1326939203 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7ff9880692a0 0x7ff98806b750 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:40.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.896+0000 7ff9a1dc9700 1 --2- 172.21.15.77:0/1326939203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff99c070840 0x7ff99c119fa0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:40.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.896+0000 7ff9a1dc9700 1 --2- 172.21.15.77:0/1326939203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff99c071f30 0x7ff99c11a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:40.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.896+0000 7ff9a1dc9700 1 -- 172.21.15.77:0/1326939203 >> 172.21.15.77:0/1326939203 conn(0x7ff99c0f8990 msgr2=0x7ff99c0f9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:40.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.896+0000 7ff9a1dc9700 1 -- 172.21.15.77:0/1326939203 shutdown_connections 2024-04-25T02:05:40.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:40.896+0000 7ff9a1dc9700 1 -- 172.21.15.77:0/1326939203 wait complete. 2024-04-25T02:05:41.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:40 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/1326939203' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-25T02:05:41.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:40 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/1326939203' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-25T02:05:41.638 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378650 got 81604378652 for osd.2 2024-04-25T02:05:41.638 DEBUG:teuthology.parallel:result is None 2024-04-25T02:05:41.638 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-25T02:05:41.638 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-25T02:05:41.891 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:05:42.215 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:41 smithi077 ceph-mon[26330]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:42.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:41 smithi112 ceph-mon[33313]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.527+0000 7f631b464700 1 -- 172.21.15.77:0/895156323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63140fde70 msgr2=0x7f63140fe240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.527+0000 7f631b464700 1 --2- 172.21.15.77:0/895156323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63140fde70 0x7f63140fe240 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6310004940 tx=0x7f6310009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.527+0000 7f631b464700 1 -- 172.21.15.77:0/895156323 shutdown_connections 2024-04-25T02:05:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.527+0000 7f631b464700 1 --2- 172.21.15.77:0/895156323 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63140fe810 0x7f6314106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.527+0000 7f631b464700 1 --2- 172.21.15.77:0/895156323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63140fde70 0x7f63140fe240 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.527+0000 7f631b464700 1 -- 172.21.15.77:0/895156323 >> 172.21.15.77:0/895156323 conn(0x7f63140f7860 msgr2=0x7f63140f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.527+0000 7f631b464700 1 -- 172.21.15.77:0/895156323 shutdown_connections 2024-04-25T02:05:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.527+0000 7f631b464700 1 -- 172.21.15.77:0/895156323 wait complete. 2024-04-25T02:05:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.528+0000 7f631b464700 1 Processor -- start 2024-04-25T02:05:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.528+0000 7f631b464700 1 -- start start 2024-04-25T02:05:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.528+0000 7f631b464700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63140fde70 0x7f63141138b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.528+0000 7f631b464700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63140fe810 0x7f6314113df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.528+0000 7f631b464700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6314114440 con 0x7f63140fde70 2024-04-25T02:05:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.528+0000 7f631b464700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631410da40 con 0x7f63140fe810 2024-04-25T02:05:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.528+0000 7f6319200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63140fde70 0x7f63141138b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.528+0000 7f6319200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63140fde70 0x7f63141138b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50146/0 (socket says 172.21.15.77:50146) 2024-04-25T02:05:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.528+0000 7f6319200700 1 -- 172.21.15.77:0/2217206103 learned_addr learned my addr 172.21.15.77:0/2217206103 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:05:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.528+0000 7f63189ff700 1 --2- 172.21.15.77:0/2217206103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63140fe810 0x7f6314113df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.529+0000 7f6319200700 1 -- 172.21.15.77:0/2217206103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63140fe810 msgr2=0x7f6314113df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.529+0000 7f6319200700 1 --2- 172.21.15.77:0/2217206103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63140fe810 0x7f6314113df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.529+0000 7f6319200700 1 -- 172.21.15.77:0/2217206103 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6310005040 con 0x7f63140fde70 2024-04-25T02:05:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.529+0000 7f6319200700 1 --2- 172.21.15.77:0/2217206103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63140fde70 0x7f63141138b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6310000c00 tx=0x7f6310009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.529+0000 7f6309ffb700 1 -- 172.21.15.77:0/2217206103 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6310021070 con 0x7f63140fde70 2024-04-25T02:05:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.529+0000 7f6309ffb700 1 -- 172.21.15.77:0/2217206103 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6310013cd0 con 0x7f63140fde70 2024-04-25T02:05:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.529+0000 7f631b464700 1 -- 172.21.15.77:0/2217206103 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f631410dcc0 con 0x7f63140fde70 2024-04-25T02:05:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.529+0000 7f6309ffb700 1 -- 172.21.15.77:0/2217206103 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f631000e070 con 0x7f63140fde70 2024-04-25T02:05:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.529+0000 7f631b464700 1 -- 172.21.15.77:0/2217206103 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f631410e200 con 0x7f63140fde70 2024-04-25T02:05:43.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.530+0000 7f631b464700 1 -- 172.21.15.77:0/2217206103 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6314066af0 con 0x7f63140fde70 2024-04-25T02:05:43.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.530+0000 7f6309ffb700 1 -- 172.21.15.77:0/2217206103 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f631001c9d0 con 0x7f63140fde70 2024-04-25T02:05:43.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.531+0000 7f6309ffb700 1 --2- 172.21.15.77:0/2217206103 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f63000692a0 0x7f630006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:43.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.531+0000 7f63189ff700 1 --2- 172.21.15.77:0/2217206103 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f63000692a0 0x7f630006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:43.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.531+0000 7f6309ffb700 1 -- 172.21.15.77:0/2217206103 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f63100883d0 con 0x7f63140fde70 2024-04-25T02:05:43.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.531+0000 7f63189ff700 1 --2- 172.21.15.77:0/2217206103 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f63000692a0 0x7f630006b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6304004600 tx=0x7f630400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:43.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.535+0000 7f6309ffb700 1 -- 172.21.15.77:0/2217206103 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f63100584d0 con 0x7f63140fde70 2024-04-25T02:05:43.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.716+0000 7f631b464700 1 -- 172.21.15.77:0/2217206103 --> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6314109e30 con 0x7f63000692a0 2024-04-25T02:05:43.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.718+0000 7f6309ffb700 1 -- 172.21.15.77:0/2217206103 <== mgr.14208 v2:172.21.15.77:6800/310739264 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28293 (secure 0 0 0) 0x7f6314109e30 con 0x7f63000692a0 2024-04-25T02:05:43.724 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:05:43.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.720+0000 7f631b464700 1 -- 172.21.15.77:0/2217206103 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f63000692a0 msgr2=0x7f630006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:43.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.720+0000 7f631b464700 1 --2- 172.21.15.77:0/2217206103 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f63000692a0 0x7f630006b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6304004600 tx=0x7f630400b040 comp rx=0 tx=0).stop 2024-04-25T02:05:43.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.720+0000 7f631b464700 1 -- 172.21.15.77:0/2217206103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63140fde70 msgr2=0x7f63141138b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:43.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.720+0000 7f631b464700 1 --2- 172.21.15.77:0/2217206103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63140fde70 0x7f63141138b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6310000c00 tx=0x7f6310009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:43.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.720+0000 7f631b464700 1 -- 172.21.15.77:0/2217206103 shutdown_connections 2024-04-25T02:05:43.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.720+0000 7f631b464700 1 --2- 172.21.15.77:0/2217206103 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f63000692a0 0x7f630006b750 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:43.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.720+0000 7f631b464700 1 --2- 172.21.15.77:0/2217206103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63140fde70 0x7f63141138b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:43.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.720+0000 7f631b464700 1 --2- 172.21.15.77:0/2217206103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63140fe810 0x7f6314113df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:43.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.720+0000 7f631b464700 1 -- 172.21.15.77:0/2217206103 >> 172.21.15.77:0/2217206103 conn(0x7f63140f7860 msgr2=0x7f63140f8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:43.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.720+0000 7f631b464700 1 -- 172.21.15.77:0/2217206103 shutdown_connections 2024-04-25T02:05:43.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:43.720+0000 7f631b464700 1 -- 172.21.15.77:0/2217206103 wait complete. 2024-04-25T02:05:43.727 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-25T02:05:44.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:43 smithi077 ceph-mon[26330]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:44.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:43 smithi112 ceph-mon[33313]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:44.384 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-04-25T02:05:42.427080+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1788072,"kb_used_data":3924,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682840,"statfs":{"total":575970213888,"available":574139228160,"internally_reserved":0,"allocated":4018176,"data_stored":2624466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001952"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":189,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T02:04:52.746419+0000","last_change":"2024-04-25T02:04:26.484495+0000","last_active":"2024-04-25T02:04:52.746419+0000","last_peered":"2024-04-25T02:04:52.746419+0000","last_clean":"2024-04-25T02:04:52.746419+0000","last_became_active":"2024-04-25T02:04:26.484241+0000","last_became_peered":"2024-04-25T02:04:26.484241+0000","last_unstale":"2024-04-25T02:04:52.746419+0000","last_undegraded":"2024-04-25T02:04:52.746419+0000","last_fullsized":"2024-04-25T02:04:52.746419+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:03:39.122868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:03:39.122868+0000","last_clean_scrub_stamp":"2024-04-25T02:03:39.122868+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:55:13.936919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":4,"up_from":35,"seq":150323855378,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:05:31 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.443}]},{"osd":1,"last update":"Thu Apr 25 02:05:31 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.52900000000000003}]},{"osd":2,"last update":"Thu Apr 25 02:05:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.502},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Apr 25 02:05:31 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":3,"up_from":27,"seq":115964117015,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298304,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446848,"statfs":{"total":95995035648,"available":95689572352,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:05:02 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":3.2280000000000002,"5min":3.2280000000000002,"15min":3.2280000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.202,"5min":3.202,"15min":3.202},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Apr 25 02:05:02 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":3.1829999999999998,"5min":3.1829999999999998,"15min":3.1829999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.1629999999999998,"5min":3.1629999999999998,"15min":3.1629999999999998},"last":0.498}]},{"osd":2,"last update":"Thu Apr 25 02:05:02 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":3.1030000000000002,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":3.2629999999999999,"5min":3.2629999999999999,"15min":3.2629999999999999},"last":0.59499999999999997}]},{"osd":4,"last update":"Thu Apr 25 02:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.40600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297724,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447428,"statfs":{"total":95995035648,"available":95690166272,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:04:41 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.442},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.41299999999999998}]},{"osd":1,"last update":"Thu Apr 25 02:04:41 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Apr 25 02:05:01 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.75800000000000001}]},{"osd":4,"last update":"Thu Apr 25 02:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.67800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705702,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:05:19 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.32600000000000001,"15min":0.32000000000000001},"min":{"1min":0.254,"5min":0.216,"15min":0.216},"max":{"1min":0.46400000000000002,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.317},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.33300000000000002,"15min":0.32700000000000001},"min":{"1min":0.23599999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.247}]},{"osd":2,"last update":"Thu Apr 25 02:04:39 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.28499999999999998}]},{"osd":3,"last update":"Thu Apr 25 02:05:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.69799999999999995}]},{"osd":4,"last update":"Thu Apr 25 02:05:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.628}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298304,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446848,"statfs":{"total":95995035648,"available":95689572352,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:05:18 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.32900000000000001,"15min":0.32100000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.34000000000000002,"15min":0.33700000000000002},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.26400000000000001}]},{"osd":2,"last update":"Thu Apr 25 02:05:41 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.373,"15min":0.38100000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.438,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.38800000000000001,"15min":0.39300000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.46700000000000003,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Apr 25 02:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.66700000000000004}]},{"osd":4,"last update":"Thu Apr 25 02:05:28 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.439}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:05:44.386 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-25T02:05:44.637 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:05:45.054 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:44 smithi077 ceph-mon[26330]: from='client.14402 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:05:45.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:44 smithi112 ceph-mon[33313]: from='client.14402 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:05:46.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.211+0000 7f243bddf700 1 -- 172.21.15.77:0/2241986242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24340fbc00 msgr2=0x7f24340fbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:46.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.211+0000 7f243bddf700 1 --2- 172.21.15.77:0/2241986242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24340fbc00 0x7f24340fbfd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2430004940 tx=0x7f2430009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:46.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.212+0000 7f243bddf700 1 -- 172.21.15.77:0/2241986242 shutdown_connections 2024-04-25T02:05:46.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.212+0000 7f243bddf700 1 --2- 172.21.15.77:0/2241986242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24340fc5a0 0x7f2434100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:46.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.212+0000 7f243bddf700 1 --2- 172.21.15.77:0/2241986242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24340fbc00 0x7f24340fbfd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:46.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.212+0000 7f243bddf700 1 -- 172.21.15.77:0/2241986242 >> 172.21.15.77:0/2241986242 conn(0x7f24340f7860 msgr2=0x7f24340f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:46.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.212+0000 7f243bddf700 1 -- 172.21.15.77:0/2241986242 shutdown_connections 2024-04-25T02:05:46.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.212+0000 7f243bddf700 1 -- 172.21.15.77:0/2241986242 wait complete. 2024-04-25T02:05:46.219 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:45 smithi077 ceph-mon[26330]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:46.219 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:45 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:05:46.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.212+0000 7f243bddf700 1 Processor -- start 2024-04-25T02:05:46.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.212+0000 7f243bddf700 1 -- start start 2024-04-25T02:05:46.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.213+0000 7f243bddf700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24340fbc00 0x7f243411a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:46.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.213+0000 7f243bddf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24340fc5a0 0x7f243411a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:46.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.213+0000 7f243bddf700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243411abe0 con 0x7f24340fbc00 2024-04-25T02:05:46.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.213+0000 7f243bddf700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24341141c0 con 0x7f24340fc5a0 2024-04-25T02:05:46.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.213+0000 7f2439b7b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24340fbc00 0x7f243411a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:46.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.213+0000 7f2439b7b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24340fbc00 0x7f243411a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50162/0 (socket says 172.21.15.77:50162) 2024-04-25T02:05:46.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.213+0000 7f2439b7b700 1 -- 172.21.15.77:0/3122450851 learned_addr learned my addr 172.21.15.77:0/3122450851 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:05:46.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.213+0000 7f243937a700 1 --2- 172.21.15.77:0/3122450851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24340fc5a0 0x7f243411a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:46.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.213+0000 7f2439b7b700 1 -- 172.21.15.77:0/3122450851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24340fc5a0 msgr2=0x7f243411a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:46.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.213+0000 7f2439b7b700 1 --2- 172.21.15.77:0/3122450851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24340fc5a0 0x7f243411a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:46.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.213+0000 7f2439b7b700 1 -- 172.21.15.77:0/3122450851 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2430005040 con 0x7f24340fbc00 2024-04-25T02:05:46.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.213+0000 7f2439b7b700 1 --2- 172.21.15.77:0/3122450851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24340fbc00 0x7f243411a050 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f243000b3b0 tx=0x7f2430009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:46.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.214+0000 7f242a7fc700 1 -- 172.21.15.77:0/3122450851 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f243000e040 con 0x7f24340fbc00 2024-04-25T02:05:46.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.214+0000 7f243bddf700 1 -- 172.21.15.77:0/3122450851 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2434114440 con 0x7f24340fbc00 2024-04-25T02:05:46.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.214+0000 7f243bddf700 1 -- 172.21.15.77:0/3122450851 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2434114980 con 0x7f24340fbc00 2024-04-25T02:05:46.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.214+0000 7f242a7fc700 1 -- 172.21.15.77:0/3122450851 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2430013420 con 0x7f24340fbc00 2024-04-25T02:05:46.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.214+0000 7f242a7fc700 1 -- 172.21.15.77:0/3122450851 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24300255e0 con 0x7f24340fbc00 2024-04-25T02:05:46.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.214+0000 7f243bddf700 1 -- 172.21.15.77:0/3122450851 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2434066b50 con 0x7f24340fbc00 2024-04-25T02:05:46.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.215+0000 7f242a7fc700 1 -- 172.21.15.77:0/3122450851 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f2430013590 con 0x7f24340fbc00 2024-04-25T02:05:46.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.215+0000 7f242a7fc700 1 --2- 172.21.15.77:0/3122450851 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f24200692a0 0x7f242006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:46.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.216+0000 7f242a7fc700 1 -- 172.21.15.77:0/3122450851 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2430088000 con 0x7f24340fbc00 2024-04-25T02:05:46.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.216+0000 7f243937a700 1 --2- 172.21.15.77:0/3122450851 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f24200692a0 0x7f242006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:46.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.216+0000 7f243937a700 1 --2- 172.21.15.77:0/3122450851 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f24200692a0 0x7f242006b750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f24341158f0 tx=0x7f242400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:46.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.220+0000 7f242a7fc700 1 -- 172.21.15.77:0/3122450851 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2430058100 con 0x7f24340fbc00 2024-04-25T02:05:46.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:45 smithi112 ceph-mon[33313]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:46.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:45 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:05:46.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.399+0000 7f243bddf700 1 -- 172.21.15.77:0/3122450851 --> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f24341156a0 con 0x7f24200692a0 2024-04-25T02:05:46.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.401+0000 7f242a7fc700 1 -- 172.21.15.77:0/3122450851 <== mgr.14208 v2:172.21.15.77:6800/310739264 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28223 (secure 0 0 0) 0x7f24341156a0 con 0x7f24200692a0 2024-04-25T02:05:46.407 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:05:46.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.403+0000 7f243bddf700 1 -- 172.21.15.77:0/3122450851 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f24200692a0 msgr2=0x7f242006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:46.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.403+0000 7f243bddf700 1 --2- 172.21.15.77:0/3122450851 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f24200692a0 0x7f242006b750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f24341158f0 tx=0x7f242400b040 comp rx=0 tx=0).stop 2024-04-25T02:05:46.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.403+0000 7f243bddf700 1 -- 172.21.15.77:0/3122450851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24340fbc00 msgr2=0x7f243411a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:46.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.403+0000 7f243bddf700 1 --2- 172.21.15.77:0/3122450851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24340fbc00 0x7f243411a050 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f243000b3b0 tx=0x7f2430009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:46.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.403+0000 7f243bddf700 1 -- 172.21.15.77:0/3122450851 shutdown_connections 2024-04-25T02:05:46.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.403+0000 7f243bddf700 1 --2- 172.21.15.77:0/3122450851 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f24200692a0 0x7f242006b750 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:46.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.403+0000 7f243bddf700 1 --2- 172.21.15.77:0/3122450851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24340fbc00 0x7f243411a050 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:46.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.403+0000 7f243bddf700 1 --2- 172.21.15.77:0/3122450851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24340fc5a0 0x7f243411a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:46.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.403+0000 7f243bddf700 1 -- 172.21.15.77:0/3122450851 >> 172.21.15.77:0/3122450851 conn(0x7f24340f7860 msgr2=0x7f24340f8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:46.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.403+0000 7f243bddf700 1 -- 172.21.15.77:0/3122450851 shutdown_connections 2024-04-25T02:05:46.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:46.403+0000 7f243bddf700 1 -- 172.21.15.77:0/3122450851 wait complete. 2024-04-25T02:05:46.410 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-25T02:05:47.072 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-04-25T02:05:44.427409+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1788072,"kb_used_data":3924,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682840,"statfs":{"total":575970213888,"available":574139228160,"internally_reserved":0,"allocated":4018176,"data_stored":2624466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002013"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":189,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T02:04:52.746419+0000","last_change":"2024-04-25T02:04:26.484495+0000","last_active":"2024-04-25T02:04:52.746419+0000","last_peered":"2024-04-25T02:04:52.746419+0000","last_clean":"2024-04-25T02:04:52.746419+0000","last_became_active":"2024-04-25T02:04:26.484241+0000","last_became_peered":"2024-04-25T02:04:26.484241+0000","last_unstale":"2024-04-25T02:04:52.746419+0000","last_undegraded":"2024-04-25T02:04:52.746419+0000","last_fullsized":"2024-04-25T02:04:52.746419+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:03:39.122868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:03:39.122868+0000","last_clean_scrub_stamp":"2024-04-25T02:03:39.122868+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:55:13.936919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]}]},{"osd":4,"up_from":35,"seq":150323855378,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:05:31 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.443}]},{"osd":1,"last update":"Thu Apr 25 02:05:31 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.52900000000000003}]},{"osd":2,"last update":"Thu Apr 25 02:05:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.502},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Apr 25 02:05:31 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":3,"up_from":27,"seq":115964117015,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298304,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446848,"statfs":{"total":95995035648,"available":95689572352,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:05:02 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":3.2280000000000002,"5min":3.2280000000000002,"15min":3.2280000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.202,"5min":3.202,"15min":3.202},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Apr 25 02:05:02 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":3.1829999999999998,"5min":3.1829999999999998,"15min":3.1829999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.1629999999999998,"5min":3.1629999999999998,"15min":3.1629999999999998},"last":0.498}]},{"osd":2,"last update":"Thu Apr 25 02:05:02 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":3.1030000000000002,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":3.2629999999999999,"5min":3.2629999999999999,"15min":3.2629999999999999},"last":0.59499999999999997}]},{"osd":4,"last update":"Thu Apr 25 02:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.40600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297724,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447428,"statfs":{"total":95995035648,"available":95690166272,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:04:41 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.255},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.314}]},{"osd":1,"last update":"Thu Apr 25 02:04:41 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.27300000000000002}]},{"osd":3,"last update":"Thu Apr 25 02:05:01 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.624},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.64000000000000001}]},{"osd":4,"last update":"Thu Apr 25 02:05:29 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.496},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]}]},{"osd":0,"up_from":9,"seq":38654705702,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:05:19 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.32600000000000001,"15min":0.32000000000000001},"min":{"1min":0.254,"5min":0.216,"15min":0.216},"max":{"1min":0.46400000000000002,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.317},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.33300000000000002,"15min":0.32700000000000001},"min":{"1min":0.23599999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.247}]},{"osd":2,"last update":"Thu Apr 25 02:04:39 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.28499999999999998}]},{"osd":3,"last update":"Thu Apr 25 02:05:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.69799999999999995}]},{"osd":4,"last update":"Thu Apr 25 02:05:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.628}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298304,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446848,"statfs":{"total":95995035648,"available":95689572352,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:05:18 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.32900000000000001,"15min":0.32100000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.34000000000000002,"15min":0.33700000000000002},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.26400000000000001}]},{"osd":2,"last update":"Thu Apr 25 02:05:41 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.373,"15min":0.38100000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.438,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.38800000000000001,"15min":0.39300000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.46700000000000003,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Apr 25 02:05:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.66700000000000004}]},{"osd":4,"last update":"Thu Apr 25 02:05:28 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.439}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:05:47.073 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-25T02:05:47.073 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T02:05:47.073 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-25T02:05:47.073 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph health --format=json 2024-04-25T02:05:47.325 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:05:48.146 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:47 smithi077 ceph-mon[26330]: from='client.14406 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:05:48.147 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:47 smithi077 ceph-mon[26330]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:48.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:47 smithi112 ceph-mon[33313]: from='client.14406 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:05:48.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:47 smithi112 ceph-mon[33313]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:49.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.007+0000 7f473048c700 1 -- 172.21.15.77:0/933971922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47281037a0 msgr2=0x7f47280fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:49.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.007+0000 7f473048c700 1 --2- 172.21.15.77:0/933971922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47281037a0 0x7f47280fce10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4718004940 tx=0x7f4718009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:49.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.007+0000 7f473048c700 1 -- 172.21.15.77:0/933971922 shutdown_connections 2024-04-25T02:05:49.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.007+0000 7f473048c700 1 --2- 172.21.15.77:0/933971922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47281037a0 0x7f47280fce10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:49.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.007+0000 7f473048c700 1 --2- 172.21.15.77:0/933971922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4728102e00 0x7f47281031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:49.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.007+0000 7f473048c700 1 -- 172.21.15.77:0/933971922 >> 172.21.15.77:0/933971922 conn(0x7f47280f89b0 msgr2=0x7f47280fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:49.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.008+0000 7f473048c700 1 -- 172.21.15.77:0/933971922 shutdown_connections 2024-04-25T02:05:49.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.008+0000 7f473048c700 1 -- 172.21.15.77:0/933971922 wait complete. 2024-04-25T02:05:49.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.008+0000 7f473048c700 1 Processor -- start 2024-04-25T02:05:49.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.008+0000 7f473048c700 1 -- start start 2024-04-25T02:05:49.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.008+0000 7f473048c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4728102e00 0x7f4728070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:49.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.008+0000 7f473048c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47281037a0 0x7f47280707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:49.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.008+0000 7f473048c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47280721f0 con 0x7f4728102e00 2024-04-25T02:05:49.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.008+0000 7f473048c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4728070ce0 con 0x7f47281037a0 2024-04-25T02:05:49.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.008+0000 7f472e228700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4728102e00 0x7f4728070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:49.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.008+0000 7f472e228700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4728102e00 0x7f4728070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42422/0 (socket says 172.21.15.77:42422) 2024-04-25T02:05:49.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.009+0000 7f472e228700 1 -- 172.21.15.77:0/2581692884 learned_addr learned my addr 172.21.15.77:0/2581692884 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:05:49.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.009+0000 7f472e228700 1 -- 172.21.15.77:0/2581692884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47281037a0 msgr2=0x7f47280707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:49.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.009+0000 7f472da27700 1 --2- 172.21.15.77:0/2581692884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47281037a0 0x7f47280707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:49.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.009+0000 7f472e228700 1 --2- 172.21.15.77:0/2581692884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47281037a0 0x7f47280707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:49.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.009+0000 7f472e228700 1 -- 172.21.15.77:0/2581692884 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4718005040 con 0x7f4728102e00 2024-04-25T02:05:49.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.009+0000 7f472e228700 1 --2- 172.21.15.77:0/2581692884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4728102e00 0x7f4728070260 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f472000b790 tx=0x7f4720009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:49.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.009+0000 7f471effd700 1 -- 172.21.15.77:0/2581692884 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f472000f770 con 0x7f4728102e00 2024-04-25T02:05:49.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.009+0000 7f471effd700 1 -- 172.21.15.77:0/2581692884 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f472000fda0 con 0x7f4728102e00 2024-04-25T02:05:49.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.009+0000 7f473048c700 1 -- 172.21.15.77:0/2581692884 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4728070fc0 con 0x7f4728102e00 2024-04-25T02:05:49.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.009+0000 7f471effd700 1 -- 172.21.15.77:0/2581692884 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f472000d310 con 0x7f4728102e00 2024-04-25T02:05:49.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.009+0000 7f473048c700 1 -- 172.21.15.77:0/2581692884 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f472811a1b0 con 0x7f4728102e00 2024-04-25T02:05:49.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.010+0000 7f473048c700 1 -- 172.21.15.77:0/2581692884 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4728100110 con 0x7f4728102e00 2024-04-25T02:05:49.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.010+0000 7f471effd700 1 -- 172.21.15.77:0/2581692884 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f4720010420 con 0x7f4728102e00 2024-04-25T02:05:49.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.011+0000 7f471effd700 1 --2- 172.21.15.77:0/2581692884 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f47140692a0 0x7f471406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:49.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.011+0000 7f471effd700 1 -- 172.21.15.77:0/2581692884 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4720086e80 con 0x7f4728102e00 2024-04-25T02:05:49.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.011+0000 7f472da27700 1 --2- 172.21.15.77:0/2581692884 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f47140692a0 0x7f471406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:49.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.011+0000 7f472da27700 1 --2- 172.21.15.77:0/2581692884 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f47140692a0 0x7f471406b750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f471800b3b0 tx=0x7f4718009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:49.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.015+0000 7f471effd700 1 -- 172.21.15.77:0/2581692884 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f47200534f0 con 0x7f4728102e00 2024-04-25T02:05:49.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.244+0000 7f473048c700 1 -- 172.21.15.77:0/2581692884 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f47280fe550 con 0x7f4728102e00 2024-04-25T02:05:49.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.244+0000 7f471effd700 1 -- 172.21.15.77:0/2581692884 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f4720056b10 con 0x7f4728102e00 2024-04-25T02:05:49.250 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:05:49.250 INFO:teuthology.orchestra.run.smithi077.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T02:05:49.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.246+0000 7f473048c700 1 -- 172.21.15.77:0/2581692884 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f47140692a0 msgr2=0x7f471406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:49.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.246+0000 7f473048c700 1 --2- 172.21.15.77:0/2581692884 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f47140692a0 0x7f471406b750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f471800b3b0 tx=0x7f4718009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:49.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.246+0000 7f473048c700 1 -- 172.21.15.77:0/2581692884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4728102e00 msgr2=0x7f4728070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:49.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.246+0000 7f473048c700 1 --2- 172.21.15.77:0/2581692884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4728102e00 0x7f4728070260 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f472000b790 tx=0x7f4720009250 comp rx=0 tx=0).stop 2024-04-25T02:05:49.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.246+0000 7f473048c700 1 -- 172.21.15.77:0/2581692884 shutdown_connections 2024-04-25T02:05:49.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.246+0000 7f473048c700 1 --2- 172.21.15.77:0/2581692884 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f47140692a0 0x7f471406b750 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:49.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.246+0000 7f473048c700 1 --2- 172.21.15.77:0/2581692884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4728102e00 0x7f4728070260 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:49.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.246+0000 7f473048c700 1 --2- 172.21.15.77:0/2581692884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47281037a0 0x7f47280707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:49.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.246+0000 7f473048c700 1 -- 172.21.15.77:0/2581692884 >> 172.21.15.77:0/2581692884 conn(0x7f47280f89b0 msgr2=0x7f47281073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:49.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.246+0000 7f473048c700 1 -- 172.21.15.77:0/2581692884 shutdown_connections 2024-04-25T02:05:49.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:49.246+0000 7f473048c700 1 -- 172.21.15.77:0/2581692884 wait complete. 2024-04-25T02:05:49.940 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-25T02:05:49.940 INFO:tasks.cephadm:Setup complete, yielding 2024-04-25T02:05:49.941 INFO:teuthology.run_tasks:Running task print... 2024-04-25T02:05:49.950 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-04-25T02:05:49.950 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-25T02:05:49.959 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T02:05:49.959 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-04-25T02:05:50.213 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:05:50.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:49 smithi077 ceph-mon[26330]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:50.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:49 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/2581692884' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-25T02:05:50.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:49 smithi112 ceph-mon[33313]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:50.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:49 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/2581692884' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-25T02:05:51.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.636+0000 7f3ad14b6700 1 -- 172.21.15.77:0/2215406971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3acc066ad0 msgr2=0x7f3acc0ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:51.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.636+0000 7f3ad14b6700 1 --2- 172.21.15.77:0/2215406971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3acc066ad0 0x7f3acc0ffa50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3abc004940 tx=0x7f3abc009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:51.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.636+0000 7f3ad14b6700 1 -- 172.21.15.77:0/2215406971 shutdown_connections 2024-04-25T02:05:51.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.636+0000 7f3ad14b6700 1 --2- 172.21.15.77:0/2215406971 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3acc0fff90 0x7f3acc102370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:51.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.636+0000 7f3ad14b6700 1 --2- 172.21.15.77:0/2215406971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3acc066ad0 0x7f3acc0ffa50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:51.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.636+0000 7f3ad14b6700 1 -- 172.21.15.77:0/2215406971 >> 172.21.15.77:0/2215406971 conn(0x7f3acc0f7440 msgr2=0x7f3acc0f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:51.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.636+0000 7f3ad14b6700 1 -- 172.21.15.77:0/2215406971 shutdown_connections 2024-04-25T02:05:51.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.636+0000 7f3ad14b6700 1 -- 172.21.15.77:0/2215406971 wait complete. 2024-04-25T02:05:51.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.636+0000 7f3ad14b6700 1 Processor -- start 2024-04-25T02:05:51.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.636+0000 7f3ad14b6700 1 -- start start 2024-04-25T02:05:51.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.637+0000 7f3ad14b6700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3acc066ad0 0x7f3acc10dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:51.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.637+0000 7f3ad14b6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3acc0fff90 0x7f3acc10e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:51.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.637+0000 7f3ad14b6700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc10e6b0 con 0x7f3acc066ad0 2024-04-25T02:05:51.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.637+0000 7f3ad14b6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc10ee00 con 0x7f3acc0fff90 2024-04-25T02:05:51.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.637+0000 7f3acaffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3acc066ad0 0x7f3acc10dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:51.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.637+0000 7f3acaffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3acc066ad0 0x7f3acc10dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42440/0 (socket says 172.21.15.77:42440) 2024-04-25T02:05:51.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.637+0000 7f3acaffd700 1 -- 172.21.15.77:0/3474193078 learned_addr learned my addr 172.21.15.77:0/3474193078 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:05:51.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.637+0000 7f3acaffd700 1 -- 172.21.15.77:0/3474193078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3acc0fff90 msgr2=0x7f3acc10e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:51.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.637+0000 7f3acaffd700 1 --2- 172.21.15.77:0/3474193078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3acc0fff90 0x7f3acc10e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:51.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.637+0000 7f3acaffd700 1 -- 172.21.15.77:0/3474193078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3abc005040 con 0x7f3acc066ad0 2024-04-25T02:05:51.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.637+0000 7f3acaffd700 1 --2- 172.21.15.77:0/3474193078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3acc066ad0 0x7f3acc10dae0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00b970 tx=0x7f3abc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:51.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.637+0000 7f3ac3fff700 1 -- 172.21.15.77:0/3474193078 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3abc00e040 con 0x7f3acc066ad0 2024-04-25T02:05:51.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.637+0000 7f3ac3fff700 1 -- 172.21.15.77:0/3474193078 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3abc00bbf0 con 0x7f3acc066ad0 2024-04-25T02:05:51.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.637+0000 7f3ad14b6700 1 -- 172.21.15.77:0/3474193078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3acc10f080 con 0x7f3acc066ad0 2024-04-25T02:05:51.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.637+0000 7f3ac3fff700 1 -- 172.21.15.77:0/3474193078 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3abc01c630 con 0x7f3acc066ad0 2024-04-25T02:05:51.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.637+0000 7f3ad14b6700 1 -- 172.21.15.77:0/3474193078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3acc10f640 con 0x7f3acc066ad0 2024-04-25T02:05:51.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.638+0000 7f3ad14b6700 1 -- 172.21.15.77:0/3474193078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3acc05f5c0 con 0x7f3acc066ad0 2024-04-25T02:05:51.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.639+0000 7f3ac3fff700 1 -- 172.21.15.77:0/3474193078 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f3abc00bd60 con 0x7f3acc066ad0 2024-04-25T02:05:51.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.639+0000 7f3ac3fff700 1 --2- 172.21.15.77:0/3474193078 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f3ab80692b0 0x7f3ab806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:51.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.639+0000 7f3ac3fff700 1 -- 172.21.15.77:0/3474193078 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3abc088220 con 0x7f3acc066ad0 2024-04-25T02:05:51.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.639+0000 7f3ac27fc700 1 --2- 172.21.15.77:0/3474193078 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f3ab80692b0 0x7f3ab806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:51.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.640+0000 7f3ac27fc700 1 --2- 172.21.15.77:0/3474193078 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f3ab80692b0 0x7f3ab806b760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4006fd0 tx=0x7f3ab4006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:51.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.644+0000 7f3ac3fff700 1 -- 172.21.15.77:0/3474193078 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3abc0583d0 con 0x7f3acc066ad0 2024-04-25T02:05:51.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.829+0000 7f3ad14b6700 1 -- 172.21.15.77:0/3474193078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f3acc04bed0 con 0x7f3acc066ad0 2024-04-25T02:05:51.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.833+0000 7f3ac3fff700 1 -- 172.21.15.77:0/3474193078 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f3abc057f60 con 0x7f3acc066ad0 2024-04-25T02:05:51.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.835+0000 7f3ad14b6700 1 -- 172.21.15.77:0/3474193078 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f3ab80692b0 msgr2=0x7f3ab806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:51.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.835+0000 7f3ad14b6700 1 --2- 172.21.15.77:0/3474193078 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f3ab80692b0 0x7f3ab806b760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4006fd0 tx=0x7f3ab4006db0 comp rx=0 tx=0).stop 2024-04-25T02:05:51.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.835+0000 7f3ad14b6700 1 -- 172.21.15.77:0/3474193078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3acc066ad0 msgr2=0x7f3acc10dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:51.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.835+0000 7f3ad14b6700 1 --2- 172.21.15.77:0/3474193078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3acc066ad0 0x7f3acc10dae0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00b970 tx=0x7f3abc009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:51.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.835+0000 7f3ad14b6700 1 -- 172.21.15.77:0/3474193078 shutdown_connections 2024-04-25T02:05:51.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.835+0000 7f3ad14b6700 1 --2- 172.21.15.77:0/3474193078 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f3ab80692b0 0x7f3ab806b760 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:51.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.835+0000 7f3ad14b6700 1 --2- 172.21.15.77:0/3474193078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3acc066ad0 0x7f3acc10dae0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:51.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.835+0000 7f3ad14b6700 1 --2- 172.21.15.77:0/3474193078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3acc0fff90 0x7f3acc10e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:51.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.835+0000 7f3ad14b6700 1 -- 172.21.15.77:0/3474193078 >> 172.21.15.77:0/3474193078 conn(0x7f3acc0f7440 msgr2=0x7f3acc0f7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:51.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.835+0000 7f3ad14b6700 1 -- 172.21.15.77:0/3474193078 shutdown_connections 2024-04-25T02:05:51.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:51.835+0000 7f3ad14b6700 1 -- 172.21.15.77:0/3474193078 wait complete. 2024-04-25T02:05:52.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:51 smithi077 ceph-mon[26330]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:52.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:51 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/3474193078' entity='client.admin' 2024-04-25T02:05:52.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:51 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:05:52.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:51 smithi112 ceph-mon[33313]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:52.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:51 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/3474193078' entity='client.admin' 2024-04-25T02:05:52.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:51 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:05:52.575 INFO:teuthology.run_tasks:Running task print... 2024-04-25T02:05:52.583 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-04-25T02:05:52.584 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-25T02:05:52.592 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T02:05:52.592 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- bash -c 'ceph orch status' 2024-04-25T02:05:52.842 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:05:53.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:52 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:05:53.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:52 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:05:53.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:52 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:05:53.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:52 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:05:53.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:52 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:05:53.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:52 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:05:54.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:53 smithi077 ceph-mon[26330]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:54.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:53 smithi112 ceph-mon[33313]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:54.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.502+0000 7fe539416700 1 -- 172.21.15.77:0/1075952655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5340fdfd0 msgr2=0x7fe5340fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:54.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.502+0000 7fe539416700 1 --2- 172.21.15.77:0/1075952655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5340fdfd0 0x7fe5340fe440 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe528004940 tx=0x7fe528009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:54.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.502+0000 7fe539416700 1 -- 172.21.15.77:0/1075952655 shutdown_connections 2024-04-25T02:05:54.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.502+0000 7fe539416700 1 --2- 172.21.15.77:0/1075952655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5340fdfd0 0x7fe5340fe440 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:54.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.502+0000 7fe539416700 1 --2- 172.21.15.77:0/1075952655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5340fce60 0x7fe5340fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:54.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.502+0000 7fe539416700 1 -- 172.21.15.77:0/1075952655 >> 172.21.15.77:0/1075952655 conn(0x7fe5340f8540 msgr2=0x7fe5340fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:54.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.502+0000 7fe539416700 1 -- 172.21.15.77:0/1075952655 shutdown_connections 2024-04-25T02:05:54.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.502+0000 7fe539416700 1 -- 172.21.15.77:0/1075952655 wait complete. 2024-04-25T02:05:54.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.503+0000 7fe539416700 1 Processor -- start 2024-04-25T02:05:54.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.503+0000 7fe539416700 1 -- start start 2024-04-25T02:05:54.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.503+0000 7fe539416700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5340fce60 0x7fe53410d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:54.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.503+0000 7fe539416700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5340fdfd0 0x7fe53410de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:54.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.503+0000 7fe539416700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53410e450 con 0x7fe5340fdfd0 2024-04-25T02:05:54.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.503+0000 7fe539416700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53410e5c0 con 0x7fe5340fce60 2024-04-25T02:05:54.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.503+0000 7fe5327fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5340fdfd0 0x7fe53410de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:54.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.503+0000 7fe5327fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5340fdfd0 0x7fe53410de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42446/0 (socket says 172.21.15.77:42446) 2024-04-25T02:05:54.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.503+0000 7fe5327fc700 1 -- 172.21.15.77:0/1653239897 learned_addr learned my addr 172.21.15.77:0/1653239897 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:05:54.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.503+0000 7fe532ffd700 1 --2- 172.21.15.77:0/1653239897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5340fce60 0x7fe53410d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:54.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.503+0000 7fe5327fc700 1 -- 172.21.15.77:0/1653239897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5340fce60 msgr2=0x7fe53410d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:54.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.503+0000 7fe5327fc700 1 --2- 172.21.15.77:0/1653239897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5340fce60 0x7fe53410d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:54.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.503+0000 7fe5327fc700 1 -- 172.21.15.77:0/1653239897 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe528005040 con 0x7fe5340fdfd0 2024-04-25T02:05:54.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.503+0000 7fe5327fc700 1 --2- 172.21.15.77:0/1653239897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5340fdfd0 0x7fe53410de50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe52800b3b0 tx=0x7fe528009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:54.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.504+0000 7fe51b7fe700 1 -- 172.21.15.77:0/1653239897 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe52800e040 con 0x7fe5340fdfd0 2024-04-25T02:05:54.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.504+0000 7fe539416700 1 -- 172.21.15.77:0/1653239897 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe534112fc0 con 0x7fe5340fdfd0 2024-04-25T02:05:54.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.504+0000 7fe51b7fe700 1 -- 172.21.15.77:0/1653239897 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe52800bbf0 con 0x7fe5340fdfd0 2024-04-25T02:05:54.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.504+0000 7fe51b7fe700 1 -- 172.21.15.77:0/1653239897 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe52801c630 con 0x7fe5340fdfd0 2024-04-25T02:05:54.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.504+0000 7fe539416700 1 -- 172.21.15.77:0/1653239897 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe534113550 con 0x7fe5340fdfd0 2024-04-25T02:05:54.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.505+0000 7fe539416700 1 -- 172.21.15.77:0/1653239897 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe53404c710 con 0x7fe5340fdfd0 2024-04-25T02:05:54.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.505+0000 7fe51b7fe700 1 -- 172.21.15.77:0/1653239897 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fe52800bd60 con 0x7fe5340fdfd0 2024-04-25T02:05:54.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.506+0000 7fe51b7fe700 1 --2- 172.21.15.77:0/1653239897 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fe51c0692a0 0x7fe51c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:54.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.506+0000 7fe51b7fe700 1 -- 172.21.15.77:0/1653239897 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe528087b40 con 0x7fe5340fdfd0 2024-04-25T02:05:54.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.506+0000 7fe532ffd700 1 --2- 172.21.15.77:0/1653239897 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fe51c0692a0 0x7fe51c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:54.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.506+0000 7fe532ffd700 1 --2- 172.21.15.77:0/1653239897 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fe51c0692a0 0x7fe51c06b750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe524004f40 tx=0x7fe52400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:54.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.510+0000 7fe51b7fe700 1 -- 172.21.15.77:0/1653239897 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe528057c40 con 0x7fe5340fdfd0 2024-04-25T02:05:54.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.709+0000 7fe539416700 1 -- 172.21.15.77:0/1653239897 --> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5341023e0 con 0x7fe51c0692a0 2024-04-25T02:05:54.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.710+0000 7fe51b7fe700 1 -- 172.21.15.77:0/1653239897 <== mgr.14208 v2:172.21.15.77:6800/310739264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fe5341023e0 con 0x7fe51c0692a0 2024-04-25T02:05:54.717 INFO:teuthology.orchestra.run.smithi077.stdout:Backend: cephadm 2024-04-25T02:05:54.717 INFO:teuthology.orchestra.run.smithi077.stdout:Available: Yes 2024-04-25T02:05:54.717 INFO:teuthology.orchestra.run.smithi077.stdout:Paused: No 2024-04-25T02:05:54.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.713+0000 7fe539416700 1 -- 172.21.15.77:0/1653239897 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fe51c0692a0 msgr2=0x7fe51c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:54.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.713+0000 7fe539416700 1 --2- 172.21.15.77:0/1653239897 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fe51c0692a0 0x7fe51c06b750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe524004f40 tx=0x7fe52400b040 comp rx=0 tx=0).stop 2024-04-25T02:05:54.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.713+0000 7fe539416700 1 -- 172.21.15.77:0/1653239897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5340fdfd0 msgr2=0x7fe53410de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:54.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.713+0000 7fe539416700 1 --2- 172.21.15.77:0/1653239897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5340fdfd0 0x7fe53410de50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe52800b3b0 tx=0x7fe528009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:54.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.713+0000 7fe539416700 1 -- 172.21.15.77:0/1653239897 shutdown_connections 2024-04-25T02:05:54.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.713+0000 7fe539416700 1 --2- 172.21.15.77:0/1653239897 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fe51c0692a0 0x7fe51c06b750 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:54.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.713+0000 7fe539416700 1 --2- 172.21.15.77:0/1653239897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5340fce60 0x7fe53410d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:54.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.713+0000 7fe539416700 1 --2- 172.21.15.77:0/1653239897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5340fdfd0 0x7fe53410de50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:54.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.713+0000 7fe539416700 1 -- 172.21.15.77:0/1653239897 >> 172.21.15.77:0/1653239897 conn(0x7fe5340f8540 msgr2=0x7fe5340f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:54.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.713+0000 7fe539416700 1 -- 172.21.15.77:0/1653239897 shutdown_connections 2024-04-25T02:05:54.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:54.713+0000 7fe539416700 1 -- 172.21.15.77:0/1653239897 wait complete. 2024-04-25T02:05:55.490 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ps' 2024-04-25T02:05:55.755 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:05:56.027 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:55 smithi077 ceph-mon[26330]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:56.027 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:55 smithi077 ceph-mon[26330]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:05:56.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:55 smithi112 ceph-mon[33313]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:56.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:55 smithi112 ceph-mon[33313]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:05:57.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.309+0000 7fc545821700 1 -- 172.21.15.77:0/3826917796 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5400fbce0 msgr2=0x7fc5400fc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:57.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.309+0000 7fc545821700 1 --2- 172.21.15.77:0/3826917796 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5400fbce0 0x7fc5400fc0f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc530004940 tx=0x7fc530009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:57.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.309+0000 7fc545821700 1 -- 172.21.15.77:0/3826917796 shutdown_connections 2024-04-25T02:05:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.309+0000 7fc545821700 1 --2- 172.21.15.77:0/3826917796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5400fcf90 0x7fc5400fd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.309+0000 7fc545821700 1 --2- 172.21.15.77:0/3826917796 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5400fbce0 0x7fc5400fc0f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.309+0000 7fc545821700 1 -- 172.21.15.77:0/3826917796 >> 172.21.15.77:0/3826917796 conn(0x7fc5400f7480 msgr2=0x7fc5400f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.309+0000 7fc545821700 1 -- 172.21.15.77:0/3826917796 shutdown_connections 2024-04-25T02:05:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.309+0000 7fc545821700 1 -- 172.21.15.77:0/3826917796 wait complete. 2024-04-25T02:05:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.309+0000 7fc545821700 1 Processor -- start 2024-04-25T02:05:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.309+0000 7fc545821700 1 -- start start 2024-04-25T02:05:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.310+0000 7fc545821700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5400fbce0 0x7fc540066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.310+0000 7fc545821700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5400fcf90 0x7fc540112750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.310+0000 7fc545821700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc540112c90 con 0x7fc5400fbce0 2024-04-25T02:05:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.310+0000 7fc545821700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc540112e00 con 0x7fc5400fcf90 2024-04-25T02:05:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.310+0000 7fc53effd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5400fbce0 0x7fc540066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.310+0000 7fc53effd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5400fbce0 0x7fc540066cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42472/0 (socket says 172.21.15.77:42472) 2024-04-25T02:05:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.310+0000 7fc53effd700 1 -- 172.21.15.77:0/3263415052 learned_addr learned my addr 172.21.15.77:0/3263415052 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:05:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.310+0000 7fc5367fc700 1 --2- 172.21.15.77:0/3263415052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5400fcf90 0x7fc540112750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.310+0000 7fc53effd700 1 -- 172.21.15.77:0/3263415052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5400fcf90 msgr2=0x7fc540112750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.310+0000 7fc53effd700 1 --2- 172.21.15.77:0/3263415052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5400fcf90 0x7fc540112750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.310+0000 7fc53effd700 1 -- 172.21.15.77:0/3263415052 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc530005040 con 0x7fc5400fbce0 2024-04-25T02:05:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.310+0000 7fc53effd700 1 --2- 172.21.15.77:0/3263415052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5400fbce0 0x7fc540066cd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc53000b3b0 tx=0x7fc530009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.310+0000 7fc537fff700 1 -- 172.21.15.77:0/3263415052 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc53000e040 con 0x7fc5400fbce0 2024-04-25T02:05:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.310+0000 7fc537fff700 1 -- 172.21.15.77:0/3263415052 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc53000bcc0 con 0x7fc5400fbce0 2024-04-25T02:05:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.310+0000 7fc545821700 1 -- 172.21.15.77:0/3263415052 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc540113080 con 0x7fc5400fbce0 2024-04-25T02:05:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.310+0000 7fc537fff700 1 -- 172.21.15.77:0/3263415052 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc53001c630 con 0x7fc5400fbce0 2024-04-25T02:05:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.310+0000 7fc545821700 1 -- 172.21.15.77:0/3263415052 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc540113640 con 0x7fc5400fbce0 2024-04-25T02:05:57.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.311+0000 7fc545821700 1 -- 172.21.15.77:0/3263415052 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc54004c710 con 0x7fc5400fbce0 2024-04-25T02:05:57.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.312+0000 7fc537fff700 1 -- 172.21.15.77:0/3263415052 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fc530013980 con 0x7fc5400fbce0 2024-04-25T02:05:57.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.312+0000 7fc537fff700 1 --2- 172.21.15.77:0/3263415052 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fc52c0692a0 0x7fc52c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:57.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.312+0000 7fc537fff700 1 -- 172.21.15.77:0/3263415052 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc530087c90 con 0x7fc5400fbce0 2024-04-25T02:05:57.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.312+0000 7fc5367fc700 1 --2- 172.21.15.77:0/3263415052 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fc52c0692a0 0x7fc52c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:57.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.313+0000 7fc5367fc700 1 --2- 172.21.15.77:0/3263415052 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fc52c0692a0 0x7fc52c06b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc528006fd0 tx=0x7fc528008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:57.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.317+0000 7fc537fff700 1 -- 172.21.15.77:0/3263415052 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc530057d10 con 0x7fc5400fbce0 2024-04-25T02:05:57.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.510+0000 7fc545821700 1 -- 172.21.15.77:0/3263415052 --> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc540101230 con 0x7fc52c0692a0 2024-04-25T02:05:57.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.518+0000 7fc537fff700 1 -- 172.21.15.77:0/3263415052 <== mgr.14208 v2:172.21.15.77:6800/310739264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2682 (secure 0 0 0) 0x7fc540101230 con 0x7fc52c0692a0 2024-04-25T02:05:57.525 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T02:05:57.525 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (3m) 2m ago 5m 25.5M - 0.25.0 c8568f914cd2 54c6f8f4d32d 2024-04-25T02:05:57.525 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (5m) 2m ago 5m 6665k - 17.2.7-902-gc61472c8 0de407c1b3af 2ad2e3d2b09e 2024-04-25T02:05:57.525 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi112 smithi112 running (4m) 66s ago 4m 6660k - 17.2.7-902-gc61472c8 0de407c1b3af 9235dc5eb15d 2024-04-25T02:05:57.525 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (3m) 2m ago 4m 78.2M - 9.4.7 954c08fa6188 d3b9c1566a82 2024-04-25T02:05:57.525 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.zpflzp smithi077 *:9283 running (6m) 2m ago 6m 469M - 17.2.7-902-gc61472c8 0de407c1b3af 8c5e41dfcae2 2024-04-25T02:05:57.525 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi112.cswrxs smithi112 *:8443,9283 running (4m) 66s ago 4m 434M - 17.2.7-902-gc61472c8 0de407c1b3af afbb948e9239 2024-04-25T02:05:57.525 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (6m) 2m ago 6m 41.5M 2048M 17.2.7-902-gc61472c8 0de407c1b3af adb57965a306 2024-04-25T02:05:57.525 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi112 smithi112 running (4m) 66s ago 4m 38.0M 2048M 17.2.7-902-gc61472c8 0de407c1b3af db2fb9b09789 2024-04-25T02:05:57.526 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (5m) 2m ago 5m 15.0M - 1.5.0 0da6a335fe13 ec91684b7e6d 2024-04-25T02:05:57.526 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi112 smithi112 *:9100 running (4m) 66s ago 4m 16.5M - 1.5.0 0da6a335fe13 3a7c783c933b 2024-04-25T02:05:57.526 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (3m) 2m ago 3m 35.5M 4288M 17.2.7-902-gc61472c8 0de407c1b3af c741abec3b94 2024-04-25T02:05:57.526 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (2m) 2m ago 2m 35.5M 4288M 17.2.7-902-gc61472c8 0de407c1b3af 256ff3ced322 2024-04-25T02:05:57.526 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (2m) 2m ago 2m 13.5M 4288M 17.2.7-902-gc61472c8 0de407c1b3af c5d7d8c993f4 2024-04-25T02:05:57.526 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi112 running (2m) 66s ago 2m 39.6M 5312M 17.2.7-902-gc61472c8 0de407c1b3af 68429d0dbf88 2024-04-25T02:05:57.526 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi112 running (97s) 66s ago 97s 39.0M 5312M 17.2.7-902-gc61472c8 0de407c1b3af 66eb71201444 2024-04-25T02:05:57.526 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi112 running (71s) 66s ago 71s 10.7M 5312M 17.2.7-902-gc61472c8 0de407c1b3af 963e700d6aea 2024-04-25T02:05:57.526 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (3m) 2m ago 4m 35.7M - 2.43.0 a07b618ecd1d 85f5766c90c7 2024-04-25T02:05:57.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.520+0000 7fc545821700 1 -- 172.21.15.77:0/3263415052 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fc52c0692a0 msgr2=0x7fc52c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:57.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.520+0000 7fc545821700 1 --2- 172.21.15.77:0/3263415052 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fc52c0692a0 0x7fc52c06b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc528006fd0 tx=0x7fc528008040 comp rx=0 tx=0).stop 2024-04-25T02:05:57.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.520+0000 7fc545821700 1 -- 172.21.15.77:0/3263415052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5400fbce0 msgr2=0x7fc540066cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:57.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.520+0000 7fc545821700 1 --2- 172.21.15.77:0/3263415052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5400fbce0 0x7fc540066cd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc53000b3b0 tx=0x7fc530009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:57.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.520+0000 7fc545821700 1 -- 172.21.15.77:0/3263415052 shutdown_connections 2024-04-25T02:05:57.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.520+0000 7fc545821700 1 --2- 172.21.15.77:0/3263415052 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fc52c0692a0 0x7fc52c06b750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:57.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.520+0000 7fc545821700 1 --2- 172.21.15.77:0/3263415052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5400fbce0 0x7fc540066cd0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:57.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.520+0000 7fc545821700 1 --2- 172.21.15.77:0/3263415052 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5400fcf90 0x7fc540112750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:57.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.520+0000 7fc545821700 1 -- 172.21.15.77:0/3263415052 >> 172.21.15.77:0/3263415052 conn(0x7fc5400f7480 msgr2=0x7fc5400f8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:57.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.520+0000 7fc545821700 1 -- 172.21.15.77:0/3263415052 shutdown_connections 2024-04-25T02:05:57.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:57.520+0000 7fc545821700 1 -- 172.21.15.77:0/3263415052 wait complete. 2024-04-25T02:05:58.146 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ls' 2024-04-25T02:05:58.168 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:57 smithi077 ceph-mon[26330]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:58.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:57 smithi112 ceph-mon[33313]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:05:58.397 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:05:59.201 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:58 smithi077 ceph-mon[26330]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:05:59.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:58 smithi112 ceph-mon[33313]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:05:59.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.940+0000 7f974e1c7700 1 -- 172.21.15.77:0/1381617383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97480fcf70 msgr2=0x7f97480fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:59.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.940+0000 7f974e1c7700 1 --2- 172.21.15.77:0/1381617383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97480fcf70 0x7f97480fd3e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f973c004940 tx=0x7f973c009e30 comp rx=0 tx=0).stop 2024-04-25T02:05:59.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.940+0000 7f974e1c7700 1 -- 172.21.15.77:0/1381617383 shutdown_connections 2024-04-25T02:05:59.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.940+0000 7f974e1c7700 1 --2- 172.21.15.77:0/1381617383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97480fcf70 0x7f97480fd3e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:59.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.940+0000 7f974e1c7700 1 --2- 172.21.15.77:0/1381617383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97480fbcc0 0x7f97480fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:59.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.940+0000 7f974e1c7700 1 -- 172.21.15.77:0/1381617383 >> 172.21.15.77:0/1381617383 conn(0x7f97480f7420 msgr2=0x7f97480f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:59.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.940+0000 7f974e1c7700 1 -- 172.21.15.77:0/1381617383 shutdown_connections 2024-04-25T02:05:59.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.940+0000 7f974e1c7700 1 -- 172.21.15.77:0/1381617383 wait complete. 2024-04-25T02:05:59.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.941+0000 7f974e1c7700 1 Processor -- start 2024-04-25T02:05:59.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.941+0000 7f974e1c7700 1 -- start start 2024-04-25T02:05:59.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.941+0000 7f974e1c7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97480fbcc0 0x7f9748066cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:59.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.941+0000 7f974e1c7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97480fcf70 0x7f9748112770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:59.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.941+0000 7f974e1c7700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9748112cb0 con 0x7f97480fbcc0 2024-04-25T02:05:59.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.941+0000 7f974e1c7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9748112e20 con 0x7f97480fcf70 2024-04-25T02:05:59.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.941+0000 7f97477fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97480fbcc0 0x7f9748066cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:59.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.941+0000 7f97477fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97480fbcc0 0x7f9748066cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50396/0 (socket says 172.21.15.77:50396) 2024-04-25T02:05:59.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.941+0000 7f97477fe700 1 -- 172.21.15.77:0/1117368137 learned_addr learned my addr 172.21.15.77:0/1117368137 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:05:59.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.941+0000 7f9746ffd700 1 --2- 172.21.15.77:0/1117368137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97480fcf70 0x7f9748112770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:59.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.942+0000 7f97477fe700 1 -- 172.21.15.77:0/1117368137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97480fcf70 msgr2=0x7f9748112770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:59.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.942+0000 7f97477fe700 1 --2- 172.21.15.77:0/1117368137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97480fcf70 0x7f9748112770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:59.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.942+0000 7f97477fe700 1 -- 172.21.15.77:0/1117368137 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c005040 con 0x7f97480fbcc0 2024-04-25T02:05:59.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.942+0000 7f97477fe700 1 --2- 172.21.15.77:0/1117368137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97480fbcc0 0x7f9748066cf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f973800b790 tx=0x7f9738009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:59.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.942+0000 7f972ffff700 1 -- 172.21.15.77:0/1117368137 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f973800f770 con 0x7f97480fbcc0 2024-04-25T02:05:59.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.942+0000 7f972ffff700 1 -- 172.21.15.77:0/1117368137 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f973800fda0 con 0x7f97480fbcc0 2024-04-25T02:05:59.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.942+0000 7f972ffff700 1 -- 172.21.15.77:0/1117368137 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f973800d310 con 0x7f97480fbcc0 2024-04-25T02:05:59.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.942+0000 7f974e1c7700 1 -- 172.21.15.77:0/1117368137 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9748113100 con 0x7f97480fbcc0 2024-04-25T02:05:59.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.942+0000 7f974e1c7700 1 -- 172.21.15.77:0/1117368137 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9748113670 con 0x7f97480fbcc0 2024-04-25T02:05:59.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.943+0000 7f974e1c7700 1 -- 172.21.15.77:0/1117368137 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f974804c710 con 0x7f97480fbcc0 2024-04-25T02:05:59.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.943+0000 7f972ffff700 1 -- 172.21.15.77:0/1117368137 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f9738010420 con 0x7f97480fbcc0 2024-04-25T02:05:59.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.944+0000 7f972ffff700 1 --2- 172.21.15.77:0/1117368137 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f97300692a0 0x7f973006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:59.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.944+0000 7f972ffff700 1 -- 172.21.15.77:0/1117368137 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9738086e80 con 0x7f97480fbcc0 2024-04-25T02:05:59.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.944+0000 7f9746ffd700 1 --2- 172.21.15.77:0/1117368137 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f97300692a0 0x7f973006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:59.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.944+0000 7f9746ffd700 1 --2- 172.21.15.77:0/1117368137 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f97300692a0 0x7f973006b750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f973c004f90 tx=0x7f973c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:59.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:05:59.948+0000 7f972ffff700 1 -- 172.21.15.77:0/1117368137 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9738056f80 con 0x7f97480fbcc0 2024-04-25T02:06:00.153 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:05:59 smithi077 ceph-mon[26330]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:06:00.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:00.146+0000 7f974e1c7700 1 -- 172.21.15.77:0/1117368137 --> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f97481012e0 con 0x7f97300692a0 2024-04-25T02:06:00.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:00.151+0000 7f972ffff700 1 -- 172.21.15.77:0/1117368137 <== mgr.14208 v2:172.21.15.77:6800/310739264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1170 (secure 0 0 0) 0x7f97481012e0 con 0x7f97300692a0 2024-04-25T02:06:00.157 INFO:teuthology.orchestra.run.smithi077.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-25T02:06:00.157 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-04-25T02:06:00.157 INFO:teuthology.orchestra.run.smithi077.stdout:crash 2/2 2m ago 5m * 2024-04-25T02:06:00.157 INFO:teuthology.orchestra.run.smithi077.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-04-25T02:06:00.158 INFO:teuthology.orchestra.run.smithi077.stdout:mgr 2/2 2m ago 5m count:2 2024-04-25T02:06:00.158 INFO:teuthology.orchestra.run.smithi077.stdout:mon 2/2 2m ago 5m smithi077:172.21.15.77=smithi077;smithi112:172.21.15.112=smithi112;count:2 2024-04-25T02:06:00.158 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-04-25T02:06:00.158 INFO:teuthology.orchestra.run.smithi077.stdout:osd 6 2m ago - 2024-04-25T02:06:00.158 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-04-25T02:06:00.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:00.153+0000 7f974e1c7700 1 -- 172.21.15.77:0/1117368137 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f97300692a0 msgr2=0x7f973006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:00.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:00.153+0000 7f974e1c7700 1 --2- 172.21.15.77:0/1117368137 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f97300692a0 0x7f973006b750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f973c004f90 tx=0x7f973c009e30 comp rx=0 tx=0).stop 2024-04-25T02:06:00.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:00.153+0000 7f974e1c7700 1 -- 172.21.15.77:0/1117368137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97480fbcc0 msgr2=0x7f9748066cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:00.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:00.153+0000 7f974e1c7700 1 --2- 172.21.15.77:0/1117368137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97480fbcc0 0x7f9748066cf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f973800b790 tx=0x7f9738009250 comp rx=0 tx=0).stop 2024-04-25T02:06:00.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:00.153+0000 7f974e1c7700 1 -- 172.21.15.77:0/1117368137 shutdown_connections 2024-04-25T02:06:00.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:00.153+0000 7f974e1c7700 1 --2- 172.21.15.77:0/1117368137 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f97300692a0 0x7f973006b750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:00.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:00.153+0000 7f974e1c7700 1 --2- 172.21.15.77:0/1117368137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97480fbcc0 0x7f9748066cf0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:00.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:00.153+0000 7f974e1c7700 1 --2- 172.21.15.77:0/1117368137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97480fcf70 0x7f9748112770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:00.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:00.153+0000 7f974e1c7700 1 -- 172.21.15.77:0/1117368137 >> 172.21.15.77:0/1117368137 conn(0x7f97480f7420 msgr2=0x7f97480f8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:00.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:00.153+0000 7f974e1c7700 1 -- 172.21.15.77:0/1117368137 shutdown_connections 2024-04-25T02:06:00.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:00.153+0000 7f974e1c7700 1 -- 172.21.15.77:0/1117368137 wait complete. 2024-04-25T02:06:00.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:05:59 smithi112 ceph-mon[33313]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:06:00.776 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- bash -c 'ceph orch host ls' 2024-04-25T02:06:01.069 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:06:01.191 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:00 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:06:01.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:00 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:06:02.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:01 smithi112 ceph-mon[33313]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:06:02.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:01 smithi112 ceph-mon[33313]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:06:02.324 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:01 smithi077 ceph-mon[26330]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:06:02.324 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:01 smithi077 ceph-mon[26330]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:06:02.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.536+0000 7f6080135700 1 -- 172.21.15.77:0/2772246021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60780fce60 msgr2=0x7f60780fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:02.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.536+0000 7f6080135700 1 --2- 172.21.15.77:0/2772246021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60780fce60 0x7f60780fd270 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6074004940 tx=0x7f6074009e30 comp rx=0 tx=0).stop 2024-04-25T02:06:02.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.537+0000 7f6080135700 1 -- 172.21.15.77:0/2772246021 shutdown_connections 2024-04-25T02:06:02.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.537+0000 7f6080135700 1 --2- 172.21.15.77:0/2772246021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60780fdfd0 0x7f60780fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:02.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.537+0000 7f6080135700 1 --2- 172.21.15.77:0/2772246021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60780fce60 0x7f60780fd270 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:02.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.537+0000 7f6080135700 1 -- 172.21.15.77:0/2772246021 >> 172.21.15.77:0/2772246021 conn(0x7f60780f8540 msgr2=0x7f60780fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:02.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.537+0000 7f6080135700 1 -- 172.21.15.77:0/2772246021 shutdown_connections 2024-04-25T02:06:02.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.537+0000 7f6080135700 1 -- 172.21.15.77:0/2772246021 wait complete. 2024-04-25T02:06:02.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.537+0000 7f6080135700 1 Processor -- start 2024-04-25T02:06:02.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.537+0000 7f6080135700 1 -- start start 2024-04-25T02:06:02.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.537+0000 7f6080135700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60780fce60 0x7f607810d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:02.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.537+0000 7f6080135700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60780fdfd0 0x7f607810de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:02.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.537+0000 7f6080135700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607810e480 con 0x7f60780fce60 2024-04-25T02:06:02.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.537+0000 7f6080135700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607810e5f0 con 0x7f60780fdfd0 2024-04-25T02:06:02.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.537+0000 7f607ded1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60780fce60 0x7f607810d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:02.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.537+0000 7f607ded1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60780fce60 0x7f607810d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50406/0 (socket says 172.21.15.77:50406) 2024-04-25T02:06:02.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.537+0000 7f607ded1700 1 -- 172.21.15.77:0/2889547976 learned_addr learned my addr 172.21.15.77:0/2889547976 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:06:02.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.538+0000 7f607d6d0700 1 --2- 172.21.15.77:0/2889547976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60780fdfd0 0x7f607810de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:02.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.538+0000 7f607ded1700 1 -- 172.21.15.77:0/2889547976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60780fdfd0 msgr2=0x7f607810de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:02.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.538+0000 7f607ded1700 1 --2- 172.21.15.77:0/2889547976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60780fdfd0 0x7f607810de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:02.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.538+0000 7f607ded1700 1 -- 172.21.15.77:0/2889547976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6074005040 con 0x7f60780fce60 2024-04-25T02:06:02.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.538+0000 7f607d6d0700 1 --2- 172.21.15.77:0/2889547976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60780fdfd0 0x7f607810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:06:02.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.538+0000 7f607ded1700 1 --2- 172.21.15.77:0/2889547976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60780fce60 0x7f607810d940 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f607400b3b0 tx=0x7f6074009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:02.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.538+0000 7f606e7fc700 1 -- 172.21.15.77:0/2889547976 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f607400e040 con 0x7f60780fce60 2024-04-25T02:06:02.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.538+0000 7f606e7fc700 1 -- 172.21.15.77:0/2889547976 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f607400bcc0 con 0x7f60780fce60 2024-04-25T02:06:02.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.538+0000 7f6080135700 1 -- 172.21.15.77:0/2889547976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6078112ff0 con 0x7f60780fce60 2024-04-25T02:06:02.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.538+0000 7f606e7fc700 1 -- 172.21.15.77:0/2889547976 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f607401c630 con 0x7f60780fce60 2024-04-25T02:06:02.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.538+0000 7f6080135700 1 -- 172.21.15.77:0/2889547976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6078113520 con 0x7f60780fce60 2024-04-25T02:06:02.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.539+0000 7f6080135700 1 -- 172.21.15.77:0/2889547976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607804c710 con 0x7f60780fce60 2024-04-25T02:06:02.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.539+0000 7f606e7fc700 1 -- 172.21.15.77:0/2889547976 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f6074026440 con 0x7f60780fce60 2024-04-25T02:06:02.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.540+0000 7f606e7fc700 1 --2- 172.21.15.77:0/2889547976 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f60640692a0 0x7f606406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:02.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.540+0000 7f606e7fc700 1 -- 172.21.15.77:0/2889547976 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6074087cd0 con 0x7f60780fce60 2024-04-25T02:06:02.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.540+0000 7f607d6d0700 1 --2- 172.21.15.77:0/2889547976 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f60640692a0 0x7f606406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:02.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.540+0000 7f607d6d0700 1 --2- 172.21.15.77:0/2889547976 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f60640692a0 0x7f606406b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6068009fd0 tx=0x7f606800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:02.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.544+0000 7f606e7fc700 1 -- 172.21.15.77:0/2889547976 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6074057ea0 con 0x7f60780fce60 2024-04-25T02:06:02.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.739+0000 7f6080135700 1 -- 172.21.15.77:0/2889547976 --> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f6078113740 con 0x7f60640692a0 2024-04-25T02:06:02.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.740+0000 7f606e7fc700 1 -- 172.21.15.77:0/2889547976 <== mgr.14208 v2:172.21.15.77:6800/310739264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f6078113740 con 0x7f60640692a0 2024-04-25T02:06:02.747 INFO:teuthology.orchestra.run.smithi077.stdout:HOST ADDR LABELS STATUS 2024-04-25T02:06:02.747 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077 172.21.15.77 2024-04-25T02:06:02.747 INFO:teuthology.orchestra.run.smithi077.stdout:smithi112 172.21.15.112 2024-04-25T02:06:02.747 INFO:teuthology.orchestra.run.smithi077.stdout:2 hosts in cluster 2024-04-25T02:06:02.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.742+0000 7f6080135700 1 -- 172.21.15.77:0/2889547976 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f60640692a0 msgr2=0x7f606406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:02.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.742+0000 7f6080135700 1 --2- 172.21.15.77:0/2889547976 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f60640692a0 0x7f606406b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6068009fd0 tx=0x7f606800b040 comp rx=0 tx=0).stop 2024-04-25T02:06:02.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.742+0000 7f6080135700 1 -- 172.21.15.77:0/2889547976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60780fce60 msgr2=0x7f607810d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:02.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.742+0000 7f6080135700 1 --2- 172.21.15.77:0/2889547976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60780fce60 0x7f607810d940 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f607400b3b0 tx=0x7f6074009e30 comp rx=0 tx=0).stop 2024-04-25T02:06:02.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.742+0000 7f6080135700 1 -- 172.21.15.77:0/2889547976 shutdown_connections 2024-04-25T02:06:02.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.742+0000 7f6080135700 1 --2- 172.21.15.77:0/2889547976 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f60640692a0 0x7f606406b750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:02.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.742+0000 7f6080135700 1 --2- 172.21.15.77:0/2889547976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60780fce60 0x7f607810d940 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:02.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.742+0000 7f6080135700 1 --2- 172.21.15.77:0/2889547976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60780fdfd0 0x7f607810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:02.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.742+0000 7f6080135700 1 -- 172.21.15.77:0/2889547976 >> 172.21.15.77:0/2889547976 conn(0x7f60780f8540 msgr2=0x7f60780f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:02.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.743+0000 7f6080135700 1 -- 172.21.15.77:0/2889547976 shutdown_connections 2024-04-25T02:06:02.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:02.743+0000 7f6080135700 1 -- 172.21.15.77:0/2889547976 wait complete. 2024-04-25T02:06:03.347 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- bash -c 'ceph orch device ls' 2024-04-25T02:06:03.597 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:06:04.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:03 smithi077 ceph-mon[26330]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:06:04.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:03 smithi077 ceph-mon[26330]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:06:04.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:03 smithi112 ceph-mon[33313]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:06:04.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:03 smithi112 ceph-mon[33313]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:06:05.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.165+0000 7fb623dc1700 1 -- 172.21.15.77:0/1159100928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb61c0fb1e0 msgr2=0x7fb61c0fb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:05.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.165+0000 7fb623dc1700 1 --2- 172.21.15.77:0/1159100928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb61c0fb1e0 0x7fb61c0fb5f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb614009ce0 tx=0x7fb614004d10 comp rx=0 tx=0).stop 2024-04-25T02:06:05.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.165+0000 7fb623dc1700 1 -- 172.21.15.77:0/1159100928 shutdown_connections 2024-04-25T02:06:05.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.165+0000 7fb623dc1700 1 --2- 172.21.15.77:0/1159100928 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb61c0fbb30 0x7fb61c0fe390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:05.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.165+0000 7fb623dc1700 1 --2- 172.21.15.77:0/1159100928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb61c0fb1e0 0x7fb61c0fb5f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:05.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.165+0000 7fb623dc1700 1 -- 172.21.15.77:0/1159100928 >> 172.21.15.77:0/1159100928 conn(0x7fb61c0f6be0 msgr2=0x7fb61c0f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:05.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.165+0000 7fb623dc1700 1 -- 172.21.15.77:0/1159100928 shutdown_connections 2024-04-25T02:06:05.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.165+0000 7fb623dc1700 1 -- 172.21.15.77:0/1159100928 wait complete. 2024-04-25T02:06:05.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.166+0000 7fb623dc1700 1 Processor -- start 2024-04-25T02:06:05.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.166+0000 7fb623dc1700 1 -- start start 2024-04-25T02:06:05.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.166+0000 7fb623dc1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb61c0fb1e0 0x7fb61c10dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:05.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.166+0000 7fb623dc1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb61c0fbb30 0x7fb61c10e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:05.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.166+0000 7fb623dc1700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c10e8f0 con 0x7fb61c0fbb30 2024-04-25T02:06:05.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.166+0000 7fb623dc1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c113200 con 0x7fb61c0fb1e0 2024-04-25T02:06:05.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.166+0000 7fb62135c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb61c0fbb30 0x7fb61c10e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:05.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.166+0000 7fb62135c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb61c0fbb30 0x7fb61c10e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50428/0 (socket says 172.21.15.77:50428) 2024-04-25T02:06:05.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.166+0000 7fb62135c700 1 -- 172.21.15.77:0/864140322 learned_addr learned my addr 172.21.15.77:0/864140322 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:06:05.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.166+0000 7fb621b5d700 1 --2- 172.21.15.77:0/864140322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb61c0fb1e0 0x7fb61c10dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:05.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.166+0000 7fb62135c700 1 -- 172.21.15.77:0/864140322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb61c0fb1e0 msgr2=0x7fb61c10dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:05.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.166+0000 7fb62135c700 1 --2- 172.21.15.77:0/864140322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb61c0fb1e0 0x7fb61c10dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:05.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.166+0000 7fb62135c700 1 -- 172.21.15.77:0/864140322 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb614009940 con 0x7fb61c0fbb30 2024-04-25T02:06:05.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.167+0000 7fb62135c700 1 --2- 172.21.15.77:0/864140322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb61c0fbb30 0x7fb61c10e1e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb60c00b790 tx=0x7fb60c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:05.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.167+0000 7fb6127fc700 1 -- 172.21.15.77:0/864140322 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb60c00f6f0 con 0x7fb61c0fbb30 2024-04-25T02:06:05.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.167+0000 7fb6127fc700 1 -- 172.21.15.77:0/864140322 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb60c00fd20 con 0x7fb61c0fbb30 2024-04-25T02:06:05.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.167+0000 7fb6127fc700 1 -- 172.21.15.77:0/864140322 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb60c0103a0 con 0x7fb61c0fbb30 2024-04-25T02:06:05.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.167+0000 7fb623dc1700 1 -- 172.21.15.77:0/864140322 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb61c113460 con 0x7fb61c0fbb30 2024-04-25T02:06:05.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.167+0000 7fb623dc1700 1 -- 172.21.15.77:0/864140322 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61c1139f0 con 0x7fb61c0fbb30 2024-04-25T02:06:05.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.168+0000 7fb623dc1700 1 -- 172.21.15.77:0/864140322 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb61c04c710 con 0x7fb61c0fbb30 2024-04-25T02:06:05.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.168+0000 7fb6127fc700 1 -- 172.21.15.77:0/864140322 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fb60c011400 con 0x7fb61c0fbb30 2024-04-25T02:06:05.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.168+0000 7fb6127fc700 1 --2- 172.21.15.77:0/864140322 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fb6080692a0 0x7fb60806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:05.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.169+0000 7fb621b5d700 1 --2- 172.21.15.77:0/864140322 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fb6080692a0 0x7fb60806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:05.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.169+0000 7fb6127fc700 1 -- 172.21.15.77:0/864140322 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb60c086b60 con 0x7fb61c0fbb30 2024-04-25T02:06:05.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.169+0000 7fb621b5d700 1 --2- 172.21.15.77:0/864140322 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fb6080692a0 0x7fb60806b750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb614009470 tx=0x7fb614004d10 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:05.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.173+0000 7fb6127fc700 1 -- 172.21.15.77:0/864140322 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb60c053270 con 0x7fb61c0fbb30 2024-04-25T02:06:05.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.365+0000 7fb623dc1700 1 -- 172.21.15.77:0/864140322 --> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb61c102630 con 0x7fb6080692a0 2024-04-25T02:06:05.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.366+0000 7fb6127fc700 1 -- 172.21.15.77:0/864140322 <== mgr.14208 v2:172.21.15.77:6800/310739264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7fb61c102630 con 0x7fb6080692a0 2024-04-25T02:06:05.373 INFO:teuthology.orchestra.run.smithi077.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-25T02:06:05.373 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400ZJ400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-04-25T02:06:05.374 INFO:teuthology.orchestra.run.smithi077.stdout:smithi112 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400NV400BGN 372G No 70s ago Has a FileSystem, LVM detected 2024-04-25T02:06:05.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.368+0000 7fb623dc1700 1 -- 172.21.15.77:0/864140322 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fb6080692a0 msgr2=0x7fb60806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:05.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.368+0000 7fb623dc1700 1 --2- 172.21.15.77:0/864140322 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fb6080692a0 0x7fb60806b750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb614009470 tx=0x7fb614004d10 comp rx=0 tx=0).stop 2024-04-25T02:06:05.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.368+0000 7fb623dc1700 1 -- 172.21.15.77:0/864140322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb61c0fbb30 msgr2=0x7fb61c10e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:05.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.368+0000 7fb623dc1700 1 --2- 172.21.15.77:0/864140322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb61c0fbb30 0x7fb61c10e1e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb60c00b790 tx=0x7fb60c009250 comp rx=0 tx=0).stop 2024-04-25T02:06:05.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.368+0000 7fb623dc1700 1 -- 172.21.15.77:0/864140322 shutdown_connections 2024-04-25T02:06:05.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.368+0000 7fb623dc1700 1 --2- 172.21.15.77:0/864140322 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fb6080692a0 0x7fb60806b750 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:05.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.368+0000 7fb623dc1700 1 --2- 172.21.15.77:0/864140322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb61c0fb1e0 0x7fb61c10dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:05.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.368+0000 7fb623dc1700 1 --2- 172.21.15.77:0/864140322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb61c0fbb30 0x7fb61c10e1e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:05.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.368+0000 7fb623dc1700 1 -- 172.21.15.77:0/864140322 >> 172.21.15.77:0/864140322 conn(0x7fb61c0f6be0 msgr2=0x7fb61c0f81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:05.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.369+0000 7fb623dc1700 1 -- 172.21.15.77:0/864140322 shutdown_connections 2024-04-25T02:06:05.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:05.369+0000 7fb623dc1700 1 -- 172.21.15.77:0/864140322 wait complete. 2024-04-25T02:06:06.019 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-25T02:06:06.028 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T02:06:06.028 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-04-25T02:06:06.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:05 smithi112 ceph-mon[33313]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:06:06.282 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:06:06.404 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:05 smithi077 ceph-mon[26330]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:06:07.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:06 smithi112 ceph-mon[33313]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:06:07.358 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:06 smithi077 ceph-mon[26330]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:06:07.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.847+0000 7fc8d9d2c700 1 -- 172.21.15.77:0/1015843654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8d40fe4e0 msgr2=0x7fc8d40fe8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:07.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.847+0000 7fc8d9d2c700 1 --2- 172.21.15.77:0/1015843654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8d40fe4e0 0x7fc8d40fe8f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4004940 tx=0x7fc8c4009e30 comp rx=0 tx=0).stop 2024-04-25T02:06:07.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.848+0000 7fc8d9d2c700 1 -- 172.21.15.77:0/1015843654 shutdown_connections 2024-04-25T02:06:07.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.848+0000 7fc8d9d2c700 1 --2- 172.21.15.77:0/1015843654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8d40fee30 0x7fc8d40faf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:07.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.848+0000 7fc8d9d2c700 1 --2- 172.21.15.77:0/1015843654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8d40fe4e0 0x7fc8d40fe8f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:07.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.848+0000 7fc8d9d2c700 1 -- 172.21.15.77:0/1015843654 >> 172.21.15.77:0/1015843654 conn(0x7fc8d40f6be0 msgr2=0x7fc8d40f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:07.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.848+0000 7fc8d9d2c700 1 -- 172.21.15.77:0/1015843654 shutdown_connections 2024-04-25T02:06:07.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.848+0000 7fc8d9d2c700 1 -- 172.21.15.77:0/1015843654 wait complete. 2024-04-25T02:06:07.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.848+0000 7fc8d9d2c700 1 Processor -- start 2024-04-25T02:06:07.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.848+0000 7fc8d9d2c700 1 -- start start 2024-04-25T02:06:07.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.848+0000 7fc8d9d2c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8d40fe4e0 0x7fc8d410d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:07.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.848+0000 7fc8d9d2c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8d40fee30 0x7fc8d410de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:07.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.848+0000 7fc8d9d2c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d410e4d0 con 0x7fc8d40fe4e0 2024-04-25T02:06:07.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.848+0000 7fc8d9d2c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d4112e70 con 0x7fc8d40fee30 2024-04-25T02:06:07.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.849+0000 7fc8d37fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8d40fe4e0 0x7fc8d410d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:07.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.849+0000 7fc8d37fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8d40fe4e0 0x7fc8d410d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34910/0 (socket says 172.21.15.77:34910) 2024-04-25T02:06:07.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.849+0000 7fc8d37fe700 1 -- 172.21.15.77:0/1936977303 learned_addr learned my addr 172.21.15.77:0/1936977303 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:06:07.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.849+0000 7fc8d37fe700 1 -- 172.21.15.77:0/1936977303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8d40fee30 msgr2=0x7fc8d410de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:07.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.849+0000 7fc8d37fe700 1 --2- 172.21.15.77:0/1936977303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8d40fee30 0x7fc8d410de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:07.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.849+0000 7fc8d37fe700 1 -- 172.21.15.77:0/1936977303 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c4005040 con 0x7fc8d40fe4e0 2024-04-25T02:06:07.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.849+0000 7fc8d37fe700 1 --2- 172.21.15.77:0/1936977303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8d40fe4e0 0x7fc8d410d900 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4009150 tx=0x7fc8c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:07.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.849+0000 7fc8bbfff700 1 -- 172.21.15.77:0/1936977303 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8c400e040 con 0x7fc8d40fe4e0 2024-04-25T02:06:07.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.849+0000 7fc8d9d2c700 1 -- 172.21.15.77:0/1936977303 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d4113070 con 0x7fc8d40fe4e0 2024-04-25T02:06:07.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.849+0000 7fc8bbfff700 1 -- 172.21.15.77:0/1936977303 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc8c400bbf0 con 0x7fc8d40fe4e0 2024-04-25T02:06:07.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.849+0000 7fc8bbfff700 1 -- 172.21.15.77:0/1936977303 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8c401c630 con 0x7fc8d40fe4e0 2024-04-25T02:06:07.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.849+0000 7fc8d9d2c700 1 -- 172.21.15.77:0/1936977303 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d41135e0 con 0x7fc8d40fe4e0 2024-04-25T02:06:07.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.850+0000 7fc8d9d2c700 1 -- 172.21.15.77:0/1936977303 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d404c710 con 0x7fc8d40fe4e0 2024-04-25T02:06:07.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.851+0000 7fc8bbfff700 1 -- 172.21.15.77:0/1936977303 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fc8c400bd60 con 0x7fc8d40fe4e0 2024-04-25T02:06:07.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.851+0000 7fc8bbfff700 1 --2- 172.21.15.77:0/1936977303 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fc8bc0692a0 0x7fc8bc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:07.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.851+0000 7fc8bbfff700 1 -- 172.21.15.77:0/1936977303 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc8c40881c0 con 0x7fc8d40fe4e0 2024-04-25T02:06:07.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.851+0000 7fc8d2ffd700 1 --2- 172.21.15.77:0/1936977303 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fc8bc0692a0 0x7fc8bc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:07.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.851+0000 7fc8d2ffd700 1 --2- 172.21.15.77:0/1936977303 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fc8bc0692a0 0x7fc8bc06b750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8006fd0 tx=0x7fc8c8006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:07.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:07.855+0000 7fc8bbfff700 1 -- 172.21.15.77:0/1936977303 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc8c4058410 con 0x7fc8d40fe4e0 2024-04-25T02:06:08.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:08.071+0000 7fc8d9d2c700 1 -- 172.21.15.77:0/1936977303 --> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8d4102560 con 0x7fc8bc0692a0 2024-04-25T02:06:08.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:07 smithi112 ceph-mon[33313]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:06:08.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:07 smithi077 ceph-mon[26330]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:06:09.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:08 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-04-25T02:06:09.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:08 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-04-25T02:06:10.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:10.027+0000 7fc8bbfff700 1 -- 172.21.15.77:0/1936977303 <== mgr.14208 v2:172.21.15.77:6800/310739264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc8d4102560 con 0x7fc8bc0692a0 2024-04-25T02:06:10.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:10.030+0000 7fc8d9d2c700 1 -- 172.21.15.77:0/1936977303 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fc8bc0692a0 msgr2=0x7fc8bc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:10.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:10.030+0000 7fc8d9d2c700 1 --2- 172.21.15.77:0/1936977303 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fc8bc0692a0 0x7fc8bc06b750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8006fd0 tx=0x7fc8c8006db0 comp rx=0 tx=0).stop 2024-04-25T02:06:10.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:10.030+0000 7fc8d9d2c700 1 -- 172.21.15.77:0/1936977303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8d40fe4e0 msgr2=0x7fc8d410d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:10.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:10.030+0000 7fc8d9d2c700 1 --2- 172.21.15.77:0/1936977303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8d40fe4e0 0x7fc8d410d900 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4009150 tx=0x7fc8c4009e30 comp rx=0 tx=0).stop 2024-04-25T02:06:10.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:10.030+0000 7fc8d9d2c700 1 -- 172.21.15.77:0/1936977303 shutdown_connections 2024-04-25T02:06:10.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:10.030+0000 7fc8d9d2c700 1 --2- 172.21.15.77:0/1936977303 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fc8bc0692a0 0x7fc8bc06b750 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:10.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:10.030+0000 7fc8d9d2c700 1 --2- 172.21.15.77:0/1936977303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8d40fe4e0 0x7fc8d410d900 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:10.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:10.030+0000 7fc8d9d2c700 1 --2- 172.21.15.77:0/1936977303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8d40fee30 0x7fc8d410de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:10.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:10.030+0000 7fc8d9d2c700 1 -- 172.21.15.77:0/1936977303 >> 172.21.15.77:0/1936977303 conn(0x7fc8d40f6be0 msgr2=0x7fc8d40f81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:10.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:10.030+0000 7fc8d9d2c700 1 -- 172.21.15.77:0/1936977303 shutdown_connections 2024-04-25T02:06:10.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:10.030+0000 7fc8d9d2c700 1 -- 172.21.15.77:0/1936977303 wait complete. 2024-04-25T02:06:10.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:09 smithi077 ceph-mon[26330]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:06:10.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:09 smithi077 ceph-mon[26330]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:06:10.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:09 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-04-25T02:06:10.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:09 smithi077 ceph-mon[26330]: osdmap e42: 6 total, 6 up, 6 in 2024-04-25T02:06:10.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:09 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-04-25T02:06:10.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:10 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi077[26326]: 2024-04-25T02:06:10.007+0000 7fab09313700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:06:10.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:09 smithi112 ceph-mon[33313]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:06:10.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:09 smithi112 ceph-mon[33313]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:06:10.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:09 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-04-25T02:06:10.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:09 smithi112 ceph-mon[33313]: osdmap e42: 6 total, 6 up, 6 in 2024-04-25T02:06:10.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:09 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-04-25T02:06:10.716 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-25T02:06:10.977 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:06:11.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:11 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-04-25T02:06:11.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:11 smithi112 ceph-mon[33313]: osdmap e43: 6 total, 6 up, 6 in 2024-04-25T02:06:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:11 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-04-25T02:06:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:11 smithi112 ceph-mon[33313]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:06:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:11 smithi112 ceph-mon[33313]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-25T02:06:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:11 smithi112 ceph-mon[33313]: osdmap e44: 6 total, 6 up, 6 in 2024-04-25T02:06:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:11 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-04-25T02:06:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:11 smithi112 ceph-mon[33313]: fsmap cephfs:0 2024-04-25T02:06:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:11 smithi112 ceph-mon[33313]: Saving service mds.cephfs spec with placement count:4 2024-04-25T02:06:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:11 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:11 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:06:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:11 smithi112 ceph-mon[33313]: pgmap v172: 65 pgs: 3 creating+peering, 1 active+clean, 61 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:06:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:11 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:11 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:06:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:11 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:11.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:11 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.oadrkb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:11.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:11 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.oadrkb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:11.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:11 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:11.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:11 smithi112 ceph-mon[33313]: Deploying daemon mds.cephfs.smithi077.oadrkb on smithi077 2024-04-25T02:06:11.319 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:11 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-04-25T02:06:11.319 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:11 smithi077 ceph-mon[26330]: osdmap e43: 6 total, 6 up, 6 in 2024-04-25T02:06:11.319 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:11 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-04-25T02:06:11.319 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:11 smithi077 ceph-mon[26330]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:06:11.319 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:11 smithi077 ceph-mon[26330]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-25T02:06:11.319 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:11 smithi077 ceph-mon[26330]: osdmap e44: 6 total, 6 up, 6 in 2024-04-25T02:06:11.319 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:11 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-04-25T02:06:11.319 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:11 smithi077 ceph-mon[26330]: fsmap cephfs:0 2024-04-25T02:06:11.320 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:11 smithi077 ceph-mon[26330]: Saving service mds.cephfs spec with placement count:4 2024-04-25T02:06:11.320 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:11 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:11.320 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:11 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:06:11.320 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:11 smithi077 ceph-mon[26330]: pgmap v172: 65 pgs: 3 creating+peering, 1 active+clean, 61 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:06:11.320 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:11 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:11.320 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:11 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:06:11.320 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:11 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:11.320 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:11 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.oadrkb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:11.320 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:11 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.oadrkb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:11.320 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:11 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:11.320 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:11 smithi077 ceph-mon[26330]: Deploying daemon mds.cephfs.smithi077.oadrkb on smithi077 2024-04-25T02:06:12.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:12 smithi112 ceph-mon[33313]: osdmap e45: 6 total, 6 up, 6 in 2024-04-25T02:06:12.307 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:12 smithi077 ceph-mon[26330]: osdmap e45: 6 total, 6 up, 6 in 2024-04-25T02:06:13.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:13 smithi112 ceph-mon[33313]: osdmap e46: 6 total, 6 up, 6 in 2024-04-25T02:06:13.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:13 smithi112 ceph-mon[33313]: pgmap v175: 65 pgs: 28 active+clean, 9 creating+peering, 28 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:06:13.458 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:13 smithi077 ceph-mon[26330]: osdmap e46: 6 total, 6 up, 6 in 2024-04-25T02:06:13.458 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:13 smithi077 ceph-mon[26330]: pgmap v175: 65 pgs: 28 active+clean, 9 creating+peering, 28 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:06:13.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.666+0000 7f007e73f700 1 -- 172.21.15.77:0/3779422351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00780fe3e0 msgr2=0x7f00780fe7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:13.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.666+0000 7f007e73f700 1 --2- 172.21.15.77:0/3779422351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00780fe3e0 0x7f00780fe7f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0068004940 tx=0x7f0068009e30 comp rx=0 tx=0).stop 2024-04-25T02:06:13.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.666+0000 7f007e73f700 1 -- 172.21.15.77:0/3779422351 shutdown_connections 2024-04-25T02:06:13.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.666+0000 7f007e73f700 1 --2- 172.21.15.77:0/3779422351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00780fed30 0x7f00780fae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:13.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.666+0000 7f007e73f700 1 --2- 172.21.15.77:0/3779422351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00780fe3e0 0x7f00780fe7f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:13.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.666+0000 7f007e73f700 1 -- 172.21.15.77:0/3779422351 >> 172.21.15.77:0/3779422351 conn(0x7f00780f6b80 msgr2=0x7f00780f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:13.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.666+0000 7f007e73f700 1 -- 172.21.15.77:0/3779422351 shutdown_connections 2024-04-25T02:06:13.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.667+0000 7f007e73f700 1 -- 172.21.15.77:0/3779422351 wait complete. 2024-04-25T02:06:13.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.667+0000 7f007e73f700 1 Processor -- start 2024-04-25T02:06:13.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.667+0000 7f007e73f700 1 -- start start 2024-04-25T02:06:13.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.667+0000 7f007e73f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00780fe3e0 0x7f007810da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:13.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.667+0000 7f007e73f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00780fed30 0x7f007810df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:13.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.668+0000 7f007e73f700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007810e560 con 0x7f00780fe3e0 2024-04-25T02:06:13.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.668+0000 7f007e73f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007810edb0 con 0x7f00780fed30 2024-04-25T02:06:13.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.668+0000 7f0077fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00780fe3e0 0x7f007810da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:13.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.668+0000 7f0077fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00780fe3e0 0x7f007810da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34928/0 (socket says 172.21.15.77:34928) 2024-04-25T02:06:13.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.668+0000 7f0077fff700 1 -- 172.21.15.77:0/486845478 learned_addr learned my addr 172.21.15.77:0/486845478 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:06:13.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.668+0000 7f00777fe700 1 --2- 172.21.15.77:0/486845478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00780fed30 0x7f007810df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:13.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.668+0000 7f0077fff700 1 -- 172.21.15.77:0/486845478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00780fed30 msgr2=0x7f007810df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:13.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.668+0000 7f0077fff700 1 --2- 172.21.15.77:0/486845478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00780fed30 0x7f007810df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:13.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.668+0000 7f0077fff700 1 -- 172.21.15.77:0/486845478 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0068005040 con 0x7f00780fe3e0 2024-04-25T02:06:13.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.668+0000 7f00777fe700 1 --2- 172.21.15.77:0/486845478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00780fed30 0x7f007810df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:13.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.668+0000 7f0077fff700 1 --2- 172.21.15.77:0/486845478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00780fe3e0 0x7f007810da20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0068009150 tx=0x7f0068009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:13.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.669+0000 7f0074ff9700 1 -- 172.21.15.77:0/486845478 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f006800e040 con 0x7f00780fe3e0 2024-04-25T02:06:13.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.669+0000 7f007e73f700 1 -- 172.21.15.77:0/486845478 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007810f030 con 0x7f00780fe3e0 2024-04-25T02:06:13.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.669+0000 7f007e73f700 1 -- 172.21.15.77:0/486845478 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007810f570 con 0x7f00780fe3e0 2024-04-25T02:06:13.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.669+0000 7f0074ff9700 1 -- 172.21.15.77:0/486845478 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0068004290 con 0x7f00780fe3e0 2024-04-25T02:06:13.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.669+0000 7f0074ff9700 1 -- 172.21.15.77:0/486845478 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f006801c630 con 0x7f00780fe3e0 2024-04-25T02:06:13.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.670+0000 7f007e73f700 1 -- 172.21.15.77:0/486845478 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f007805f5c0 con 0x7f00780fe3e0 2024-04-25T02:06:13.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.670+0000 7f0074ff9700 1 -- 172.21.15.77:0/486845478 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f006800bbf0 con 0x7f00780fe3e0 2024-04-25T02:06:13.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.671+0000 7f0074ff9700 1 --2- 172.21.15.77:0/486845478 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f00600692a0 0x7f006006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:13.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.671+0000 7f0074ff9700 1 -- 172.21.15.77:0/486845478 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0068087e00 con 0x7f00780fe3e0 2024-04-25T02:06:13.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.671+0000 7f00777fe700 1 --2- 172.21.15.77:0/486845478 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f00600692a0 0x7f006006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:13.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.671+0000 7f00777fe700 1 --2- 172.21.15.77:0/486845478 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f00600692a0 0x7f006006b750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f006c010520 tx=0x7f006c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:13.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.676+0000 7f0074ff9700 1 -- 172.21.15.77:0/486845478 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0068057bd0 con 0x7f00780fe3e0 2024-04-25T02:06:13.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.928+0000 7f007e73f700 1 -- 172.21.15.77:0/486845478 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f007810f910 con 0x7f00780fe3e0 2024-04-25T02:06:13.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.928+0000 7f0074ff9700 1 -- 172.21.15.77:0/486845478 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7f0068057760 con 0x7f00780fe3e0 2024-04-25T02:06:13.936 INFO:teuthology.orchestra.run.smithi077.stdout:e2 2024-04-25T02:06:13.936 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T02:06:13.936 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:06:13.936 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-04-25T02:06:13.937 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:06:13.937 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-04-25T02:06:13.937 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-04-25T02:06:13.937 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 2 2024-04-25T02:06:13.937 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-25T02:06:13.937 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-04-25T02:06:10.008979+0000 2024-04-25T02:06:13.938 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-04-25T02:06:10.009055+0000 2024-04-25T02:06:13.938 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-04-25T02:06:13.938 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-04-25T02:06:13.938 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-04-25T02:06:13.938 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-04-25T02:06:13.939 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-04-25T02:06:13.939 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-04-25T02:06:13.939 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-04-25T02:06:13.939 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 0 2024-04-25T02:06:13.939 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:06:13.939 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-04-25T02:06:13.940 INFO:teuthology.orchestra.run.smithi077.stdout:in 2024-04-25T02:06:13.940 INFO:teuthology.orchestra.run.smithi077.stdout:up {} 2024-04-25T02:06:13.940 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-04-25T02:06:13.940 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-04-25T02:06:13.940 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-04-25T02:06:13.940 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-04-25T02:06:13.940 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-04-25T02:06:13.941 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-04-25T02:06:13.941 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-04-25T02:06:13.941 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 0 2024-04-25T02:06:13.941 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:06:13.941 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:06:13.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.930+0000 7f007e73f700 1 -- 172.21.15.77:0/486845478 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f00600692a0 msgr2=0x7f006006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:13.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.930+0000 7f007e73f700 1 --2- 172.21.15.77:0/486845478 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f00600692a0 0x7f006006b750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f006c010520 tx=0x7f006c00b040 comp rx=0 tx=0).stop 2024-04-25T02:06:13.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.930+0000 7f007e73f700 1 -- 172.21.15.77:0/486845478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00780fe3e0 msgr2=0x7f007810da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:13.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.930+0000 7f007e73f700 1 --2- 172.21.15.77:0/486845478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00780fe3e0 0x7f007810da20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0068009150 tx=0x7f0068009e30 comp rx=0 tx=0).stop 2024-04-25T02:06:13.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.930+0000 7f007e73f700 1 -- 172.21.15.77:0/486845478 shutdown_connections 2024-04-25T02:06:13.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.930+0000 7f007e73f700 1 --2- 172.21.15.77:0/486845478 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f00600692a0 0x7f006006b750 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:13.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.930+0000 7f007e73f700 1 --2- 172.21.15.77:0/486845478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00780fe3e0 0x7f007810da20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:13.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.930+0000 7f007e73f700 1 --2- 172.21.15.77:0/486845478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00780fed30 0x7f007810df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:13.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.930+0000 7f007e73f700 1 -- 172.21.15.77:0/486845478 >> 172.21.15.77:0/486845478 conn(0x7f00780f6b80 msgr2=0x7f00780f8280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:13.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.930+0000 7f007e73f700 1 -- 172.21.15.77:0/486845478 shutdown_connections 2024-04-25T02:06:13.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:13.930+0000 7f007e73f700 1 -- 172.21.15.77:0/486845478 wait complete. 2024-04-25T02:06:13.944 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 2 2024-04-25T02:06:14.219 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:14 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/486845478' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:06:14.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:14 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/486845478' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:06:14.746 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-25T02:06:14.762 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T02:06:14.763 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-04-25T02:06:15.015 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:06:15.507 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:15 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:15.508 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:15 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:15.508 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:15 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:15.508 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:15 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.dvwudt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:15.508 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:15 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.dvwudt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:15.508 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:15 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:15.508 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:15 smithi112 ceph-mon[33313]: Deploying daemon mds.cephfs.smithi112.dvwudt on smithi112 2024-04-25T02:06:15.508 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:15 smithi112 ceph-mon[33313]: pgmap v176: 65 pgs: 50 active+clean, 9 creating+peering, 6 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:06:15.508 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:15 smithi112 ceph-mon[33313]: mds.? [v2:172.21.15.77:6826/4228767448,v1:172.21.15.77:6827/4228767448] up:boot 2024-04-25T02:06:15.508 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:15 smithi112 ceph-mon[33313]: daemon mds.cephfs.smithi077.oadrkb assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-04-25T02:06:15.508 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:15 smithi112 ceph-mon[33313]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-25T02:06:15.508 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:15 smithi112 ceph-mon[33313]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-25T02:06:15.508 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:15 smithi112 ceph-mon[33313]: Cluster is now healthy 2024-04-25T02:06:15.508 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:15 smithi112 ceph-mon[33313]: fsmap cephfs:0 1 up:standby 2024-04-25T02:06:15.509 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:15 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.oadrkb"}]: dispatch 2024-04-25T02:06:15.509 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:15 smithi112 ceph-mon[33313]: fsmap cephfs:1 {0=cephfs.smithi077.oadrkb=up:creating} 2024-04-25T02:06:15.509 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:15 smithi112 ceph-mon[33313]: daemon mds.cephfs.smithi077.oadrkb is now active in filesystem cephfs as rank 0 2024-04-25T02:06:15.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:15 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:15.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:15 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:15.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:15 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:15.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:15 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.dvwudt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:15.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:15 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.dvwudt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:15.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:15 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:15.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:15 smithi077 ceph-mon[26330]: Deploying daemon mds.cephfs.smithi112.dvwudt on smithi112 2024-04-25T02:06:15.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:15 smithi077 ceph-mon[26330]: pgmap v176: 65 pgs: 50 active+clean, 9 creating+peering, 6 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:06:15.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:15 smithi077 ceph-mon[26330]: mds.? [v2:172.21.15.77:6826/4228767448,v1:172.21.15.77:6827/4228767448] up:boot 2024-04-25T02:06:15.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:15 smithi077 ceph-mon[26330]: daemon mds.cephfs.smithi077.oadrkb assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-04-25T02:06:15.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:15 smithi077 ceph-mon[26330]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-25T02:06:15.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:15 smithi077 ceph-mon[26330]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-25T02:06:15.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:15 smithi077 ceph-mon[26330]: Cluster is now healthy 2024-04-25T02:06:15.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:15 smithi077 ceph-mon[26330]: fsmap cephfs:0 1 up:standby 2024-04-25T02:06:15.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:15 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.oadrkb"}]: dispatch 2024-04-25T02:06:15.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:15 smithi077 ceph-mon[26330]: fsmap cephfs:1 {0=cephfs.smithi077.oadrkb=up:creating} 2024-04-25T02:06:15.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:15 smithi077 ceph-mon[26330]: daemon mds.cephfs.smithi077.oadrkb is now active in filesystem cephfs as rank 0 2024-04-25T02:06:16.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:16 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:06:16.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:16 smithi112 ceph-mon[33313]: mds.? [v2:172.21.15.77:6826/4228767448,v1:172.21.15.77:6827/4228767448] up:active 2024-04-25T02:06:16.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:16 smithi112 ceph-mon[33313]: fsmap cephfs:1 {0=cephfs.smithi077.oadrkb=up:active} 2024-04-25T02:06:16.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.611+0000 7ff288aec700 1 -- 172.21.15.77:0/2751226776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff284070830 msgr2=0x7ff284070ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:16.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.611+0000 7ff288aec700 1 --2- 172.21.15.77:0/2751226776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff284070830 0x7ff284070ca0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff278004880 tx=0x7ff278009e30 comp rx=0 tx=0).stop 2024-04-25T02:06:16.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.611+0000 7ff288aec700 1 -- 172.21.15.77:0/2751226776 shutdown_connections 2024-04-25T02:06:16.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.611+0000 7ff288aec700 1 --2- 172.21.15.77:0/2751226776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff284070830 0x7ff284070ca0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:16.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.611+0000 7ff288aec700 1 --2- 172.21.15.77:0/2751226776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff284071de0 0x7ff2840702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:16.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.611+0000 7ff288aec700 1 -- 172.21.15.77:0/2751226776 >> 172.21.15.77:0/2751226776 conn(0x7ff2840f8540 msgr2=0x7ff2840fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:16.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.611+0000 7ff288aec700 1 -- 172.21.15.77:0/2751226776 shutdown_connections 2024-04-25T02:06:16.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.611+0000 7ff288aec700 1 -- 172.21.15.77:0/2751226776 wait complete. 2024-04-25T02:06:16.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.611+0000 7ff288aec700 1 Processor -- start 2024-04-25T02:06:16.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.611+0000 7ff288aec700 1 -- start start 2024-04-25T02:06:16.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.612+0000 7ff288aec700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff284070830 0x7ff28410fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:16.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.612+0000 7ff288aec700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff284071de0 0x7ff284110050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:16.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.612+0000 7ff288aec700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff284110650 con 0x7ff284071de0 2024-04-25T02:06:16.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.612+0000 7ff288aec700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2841107c0 con 0x7ff284070830 2024-04-25T02:06:16.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.612+0000 7ff281d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff284071de0 0x7ff284110050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:16.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.612+0000 7ff28259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff284070830 0x7ff28410fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:16.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.612+0000 7ff281d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff284071de0 0x7ff284110050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34958/0 (socket says 172.21.15.77:34958) 2024-04-25T02:06:16.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.612+0000 7ff281d9b700 1 -- 172.21.15.77:0/3052427580 learned_addr learned my addr 172.21.15.77:0/3052427580 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:06:16.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.612+0000 7ff281d9b700 1 -- 172.21.15.77:0/3052427580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff284070830 msgr2=0x7ff28410fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:16.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.612+0000 7ff281d9b700 1 --2- 172.21.15.77:0/3052427580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff284070830 0x7ff28410fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:16.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.612+0000 7ff281d9b700 1 -- 172.21.15.77:0/3052427580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff274005040 con 0x7ff284071de0 2024-04-25T02:06:16.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.612+0000 7ff281d9b700 1 --2- 172.21.15.77:0/3052427580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff284071de0 0x7ff284110050 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff278000c00 tx=0x7ff278009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:16.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.612+0000 7ff272ffd700 1 -- 172.21.15.77:0/3052427580 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff27800e030 con 0x7ff284071de0 2024-04-25T02:06:16.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.612+0000 7ff272ffd700 1 -- 172.21.15.77:0/3052427580 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff278013e90 con 0x7ff284071de0 2024-04-25T02:06:16.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.612+0000 7ff272ffd700 1 -- 172.21.15.77:0/3052427580 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff27801ce30 con 0x7ff284071de0 2024-04-25T02:06:16.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.612+0000 7ff288aec700 1 -- 172.21.15.77:0/3052427580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff278005040 con 0x7ff284071de0 2024-04-25T02:06:16.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.613+0000 7ff288aec700 1 -- 172.21.15.77:0/3052427580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2841155f0 con 0x7ff284071de0 2024-04-25T02:06:16.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.613+0000 7ff288aec700 1 -- 172.21.15.77:0/3052427580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff28404c710 con 0x7ff284071de0 2024-04-25T02:06:16.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.614+0000 7ff272ffd700 1 -- 172.21.15.77:0/3052427580 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff27801c620 con 0x7ff284071de0 2024-04-25T02:06:16.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.614+0000 7ff272ffd700 1 --2- 172.21.15.77:0/3052427580 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7ff26c0692a0 0x7ff26c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:16.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.614+0000 7ff28259c700 1 --2- 172.21.15.77:0/3052427580 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7ff26c0692a0 0x7ff26c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:16.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.614+0000 7ff272ffd700 1 -- 172.21.15.77:0/3052427580 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff278088ac0 con 0x7ff284071de0 2024-04-25T02:06:16.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.615+0000 7ff28259c700 1 --2- 172.21.15.77:0/3052427580 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7ff26c0692a0 0x7ff26c06b750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff284071b20 tx=0x7ff27400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:16.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.619+0000 7ff272ffd700 1 -- 172.21.15.77:0/3052427580 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff278058920 con 0x7ff284071de0 2024-04-25T02:06:16.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:16 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:06:16.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:16 smithi077 ceph-mon[26330]: mds.? [v2:172.21.15.77:6826/4228767448,v1:172.21.15.77:6827/4228767448] up:active 2024-04-25T02:06:16.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:16 smithi077 ceph-mon[26330]: fsmap cephfs:1 {0=cephfs.smithi077.oadrkb=up:active} 2024-04-25T02:06:16.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:16.858+0000 7ff288aec700 1 -- 172.21.15.77:0/3052427580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7ff284107ac0 con 0x7ff284071de0 2024-04-25T02:06:17.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:17.430+0000 7ff272ffd700 1 -- 172.21.15.77:0/3052427580 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7ff2780584b0 con 0x7ff284071de0 2024-04-25T02:06:17.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:17.432+0000 7ff288aec700 1 -- 172.21.15.77:0/3052427580 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7ff26c0692a0 msgr2=0x7ff26c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:17.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:17.432+0000 7ff288aec700 1 --2- 172.21.15.77:0/3052427580 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7ff26c0692a0 0x7ff26c06b750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff284071b20 tx=0x7ff27400b040 comp rx=0 tx=0).stop 2024-04-25T02:06:17.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:17.432+0000 7ff288aec700 1 -- 172.21.15.77:0/3052427580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff284071de0 msgr2=0x7ff284110050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:17.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:17.432+0000 7ff288aec700 1 --2- 172.21.15.77:0/3052427580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff284071de0 0x7ff284110050 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff278000c00 tx=0x7ff278009e30 comp rx=0 tx=0).stop 2024-04-25T02:06:17.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:17.432+0000 7ff288aec700 1 -- 172.21.15.77:0/3052427580 shutdown_connections 2024-04-25T02:06:17.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:17.432+0000 7ff288aec700 1 --2- 172.21.15.77:0/3052427580 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7ff26c0692a0 0x7ff26c06b750 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:17.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:17.432+0000 7ff288aec700 1 --2- 172.21.15.77:0/3052427580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff284070830 0x7ff28410fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:17.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:17.432+0000 7ff288aec700 1 --2- 172.21.15.77:0/3052427580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff284071de0 0x7ff284110050 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:17.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:17.432+0000 7ff288aec700 1 -- 172.21.15.77:0/3052427580 >> 172.21.15.77:0/3052427580 conn(0x7ff2840f8540 msgr2=0x7ff2840f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:17.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:17.432+0000 7ff288aec700 1 -- 172.21.15.77:0/3052427580 shutdown_connections 2024-04-25T02:06:17.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:17.432+0000 7ff288aec700 1 -- 172.21.15.77:0/3052427580 wait complete. 2024-04-25T02:06:17.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:17 smithi077 ceph-mon[26330]: pgmap v177: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 478 B/s wr, 2 op/s 2024-04-25T02:06:17.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:17 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:17.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:17 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:17.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:17 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:17.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:17 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.gcfygj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:17.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:17 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.gcfygj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:17.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:17 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:17.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:17 smithi077 ceph-mon[26330]: Deploying daemon mds.cephfs.smithi077.gcfygj on smithi077 2024-04-25T02:06:17.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:17 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/3052427580' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-25T02:06:17.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:17 smithi077 ceph-mon[26330]: mds.? [v2:172.21.15.112:6824/3687767796,v1:172.21.15.112:6825/3687767796] up:boot 2024-04-25T02:06:17.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:17 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/3052427580' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-04-25T02:06:17.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:17 smithi077 ceph-mon[26330]: fsmap cephfs:1 {0=cephfs.smithi077.oadrkb=up:active} 1 up:standby 2024-04-25T02:06:17.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:17 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.dvwudt"}]: dispatch 2024-04-25T02:06:17.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:17 smithi077 ceph-mon[26330]: fsmap cephfs:1 {0=cephfs.smithi077.oadrkb=up:active} 1 up:standby 2024-04-25T02:06:18.271 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-25T02:06:18.282 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T02:06:18.282 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-04-25T02:06:18.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:17 smithi112 ceph-mon[33313]: pgmap v177: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 478 B/s wr, 2 op/s 2024-04-25T02:06:18.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:17 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:18.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:17 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:18.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:17 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:18.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:17 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.gcfygj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:18.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:17 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.gcfygj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:18.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:17 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:18.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:17 smithi112 ceph-mon[33313]: Deploying daemon mds.cephfs.smithi077.gcfygj on smithi077 2024-04-25T02:06:18.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:17 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/3052427580' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-25T02:06:18.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:17 smithi112 ceph-mon[33313]: mds.? [v2:172.21.15.112:6824/3687767796,v1:172.21.15.112:6825/3687767796] up:boot 2024-04-25T02:06:18.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:17 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/3052427580' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-04-25T02:06:18.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:17 smithi112 ceph-mon[33313]: fsmap cephfs:1 {0=cephfs.smithi077.oadrkb=up:active} 1 up:standby 2024-04-25T02:06:18.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:17 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.dvwudt"}]: dispatch 2024-04-25T02:06:18.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:17 smithi112 ceph-mon[33313]: fsmap cephfs:1 {0=cephfs.smithi077.oadrkb=up:active} 1 up:standby 2024-04-25T02:06:18.875 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:06:20.067 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:19 smithi077 ceph-mon[26330]: pgmap v178: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 4 op/s 2024-04-25T02:06:20.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:19 smithi112 ceph-mon[33313]: pgmap v178: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 4 op/s 2024-04-25T02:06:20.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.519+0000 7f2307426700 1 -- 172.21.15.77:0/3778943954 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23000fce60 msgr2=0x7f23000fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:20.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.519+0000 7f2307426700 1 --2- 172.21.15.77:0/3778943954 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23000fce60 0x7f23000fd270 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f22fc009ce0 tx=0x7f22fc004d10 comp rx=0 tx=0).stop 2024-04-25T02:06:20.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.519+0000 7f2307426700 1 -- 172.21.15.77:0/3778943954 shutdown_connections 2024-04-25T02:06:20.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.519+0000 7f2307426700 1 --2- 172.21.15.77:0/3778943954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23000fdfd0 0x7f23000fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:20.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.519+0000 7f2307426700 1 --2- 172.21.15.77:0/3778943954 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23000fce60 0x7f23000fd270 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:20.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.519+0000 7f2307426700 1 -- 172.21.15.77:0/3778943954 >> 172.21.15.77:0/3778943954 conn(0x7f23000f8540 msgr2=0x7f23000fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:20.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.519+0000 7f2307426700 1 -- 172.21.15.77:0/3778943954 shutdown_connections 2024-04-25T02:06:20.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.519+0000 7f2307426700 1 -- 172.21.15.77:0/3778943954 wait complete. 2024-04-25T02:06:20.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.519+0000 7f2307426700 1 Processor -- start 2024-04-25T02:06:20.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.519+0000 7f2307426700 1 -- start start 2024-04-25T02:06:20.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.520+0000 7f2307426700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23000fce60 0x7f230010dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:20.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.520+0000 7f2307426700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23000fdfd0 0x7f230010e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:20.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.520+0000 7f2307426700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230010e740 con 0x7f23000fdfd0 2024-04-25T02:06:20.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.520+0000 7f2307426700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230010ef90 con 0x7f23000fce60 2024-04-25T02:06:20.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.520+0000 7f23049c1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23000fdfd0 0x7f230010e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:20.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.520+0000 7f23049c1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23000fdfd0 0x7f230010e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52738/0 (socket says 172.21.15.77:52738) 2024-04-25T02:06:20.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.520+0000 7f23049c1700 1 -- 172.21.15.77:0/1256413205 learned_addr learned my addr 172.21.15.77:0/1256413205 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:06:20.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.520+0000 7f23051c2700 1 --2- 172.21.15.77:0/1256413205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23000fce60 0x7f230010dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:20.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.520+0000 7f23049c1700 1 -- 172.21.15.77:0/1256413205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23000fce60 msgr2=0x7f230010dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:20.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.520+0000 7f23049c1700 1 --2- 172.21.15.77:0/1256413205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23000fce60 0x7f230010dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:20.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.520+0000 7f23049c1700 1 -- 172.21.15.77:0/1256413205 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22fc009940 con 0x7f23000fdfd0 2024-04-25T02:06:20.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.520+0000 7f23049c1700 1 --2- 172.21.15.77:0/1256413205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23000fdfd0 0x7f230010e140 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f22f0002a50 tx=0x7f22f00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:20.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.520+0000 7f22f5ffb700 1 -- 172.21.15.77:0/1256413205 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22f0007cc0 con 0x7f23000fdfd0 2024-04-25T02:06:20.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.520+0000 7f2307426700 1 -- 172.21.15.77:0/1256413205 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f230010f270 con 0x7f23000fdfd0 2024-04-25T02:06:20.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.520+0000 7f22f5ffb700 1 -- 172.21.15.77:0/1256413205 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f22f000f040 con 0x7f23000fdfd0 2024-04-25T02:06:20.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.520+0000 7f22f5ffb700 1 -- 172.21.15.77:0/1256413205 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22f000da30 con 0x7f23000fdfd0 2024-04-25T02:06:20.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.521+0000 7f2307426700 1 -- 172.21.15.77:0/1256413205 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f230010f7b0 con 0x7f23000fdfd0 2024-04-25T02:06:20.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.521+0000 7f2307426700 1 -- 172.21.15.77:0/1256413205 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f230005f5c0 con 0x7f23000fdfd0 2024-04-25T02:06:20.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.522+0000 7f22f5ffb700 1 -- 172.21.15.77:0/1256413205 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f22f000dbb0 con 0x7f23000fdfd0 2024-04-25T02:06:20.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.522+0000 7f22f5ffb700 1 --2- 172.21.15.77:0/1256413205 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f22ec0692b0 0x7f22ec06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:20.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.522+0000 7f22f5ffb700 1 -- 172.21.15.77:0/1256413205 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f22f0086f30 con 0x7f23000fdfd0 2024-04-25T02:06:20.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.522+0000 7f23051c2700 1 --2- 172.21.15.77:0/1256413205 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f22ec0692b0 0x7f22ec06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:20.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.523+0000 7f23051c2700 1 --2- 172.21.15.77:0/1256413205 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f22ec0692b0 0x7f22ec06b760 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f22fc015040 tx=0x7f22fc004d10 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:20.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.526+0000 7f22f5ffb700 1 -- 172.21.15.77:0/1256413205 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f22f0056c70 con 0x7f23000fdfd0 2024-04-25T02:06:20.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.783+0000 7f2307426700 1 -- 172.21.15.77:0/1256413205 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f23001058c0 con 0x7f23000fdfd0 2024-04-25T02:06:20.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.810+0000 7f22f5ffb700 1 -- 172.21.15.77:0/1256413205 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f22f0056800 con 0x7f23000fdfd0 2024-04-25T02:06:20.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.812+0000 7f2307426700 1 -- 172.21.15.77:0/1256413205 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f22ec0692b0 msgr2=0x7f22ec06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:20.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.812+0000 7f2307426700 1 --2- 172.21.15.77:0/1256413205 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f22ec0692b0 0x7f22ec06b760 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f22fc015040 tx=0x7f22fc004d10 comp rx=0 tx=0).stop 2024-04-25T02:06:20.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.812+0000 7f2307426700 1 -- 172.21.15.77:0/1256413205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23000fdfd0 msgr2=0x7f230010e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:20.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.812+0000 7f2307426700 1 --2- 172.21.15.77:0/1256413205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23000fdfd0 0x7f230010e140 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f22f0002a50 tx=0x7f22f00046b0 comp rx=0 tx=0).stop 2024-04-25T02:06:20.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.812+0000 7f2307426700 1 -- 172.21.15.77:0/1256413205 shutdown_connections 2024-04-25T02:06:20.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.813+0000 7f2307426700 1 --2- 172.21.15.77:0/1256413205 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f22ec0692b0 0x7f22ec06b760 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:20.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.813+0000 7f2307426700 1 --2- 172.21.15.77:0/1256413205 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23000fce60 0x7f230010dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:20.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.813+0000 7f2307426700 1 --2- 172.21.15.77:0/1256413205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23000fdfd0 0x7f230010e140 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:20.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.813+0000 7f2307426700 1 -- 172.21.15.77:0/1256413205 >> 172.21.15.77:0/1256413205 conn(0x7f23000f8540 msgr2=0x7f23000f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:20.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.813+0000 7f2307426700 1 -- 172.21.15.77:0/1256413205 shutdown_connections 2024-04-25T02:06:20.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:20.813+0000 7f2307426700 1 -- 172.21.15.77:0/1256413205 wait complete. 2024-04-25T02:06:21.129 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:20 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/1256413205' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-04-25T02:06:21.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:20 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/1256413205' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-04-25T02:06:21.731 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-25T02:06:21.741 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T02:06:21.741 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data false' 2024-04-25T02:06:21.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:21 smithi077 ceph-mon[26330]: pgmap v179: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-04-25T02:06:21.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:21 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/1256413205' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-04-25T02:06:21.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:21 smithi077 ceph-mon[26330]: fsmap cephfs:1 {0=cephfs.smithi077.oadrkb=up:active} 1 up:standby 2024-04-25T02:06:21.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:21 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:21.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:21 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:21.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:21 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:21.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:21 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.fjnadi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:21.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:21 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.fjnadi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:21.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:21 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:21.998 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:06:22.082 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:21 smithi112 ceph-mon[33313]: pgmap v179: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-04-25T02:06:22.082 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:21 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/1256413205' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-04-25T02:06:22.083 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:21 smithi112 ceph-mon[33313]: fsmap cephfs:1 {0=cephfs.smithi077.oadrkb=up:active} 1 up:standby 2024-04-25T02:06:22.083 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:21 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:22.083 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:21 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:22.083 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:21 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:22.083 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:21 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.fjnadi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:22.083 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:21 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.fjnadi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:22.083 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:21 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:23.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:22 smithi112 ceph-mon[33313]: Deploying daemon mds.cephfs.smithi112.fjnadi on smithi112 2024-04-25T02:06:23.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:22 smithi112 ceph-mon[33313]: mds.? [v2:172.21.15.77:6828/691698671,v1:172.21.15.77:6829/691698671] up:boot 2024-04-25T02:06:23.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:22 smithi112 ceph-mon[33313]: fsmap cephfs:1 {0=cephfs.smithi077.oadrkb=up:active} 2 up:standby 2024-04-25T02:06:23.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:22 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.gcfygj"}]: dispatch 2024-04-25T02:06:23.197 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:22 smithi077 ceph-mon[26330]: Deploying daemon mds.cephfs.smithi112.fjnadi on smithi112 2024-04-25T02:06:23.197 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:22 smithi077 ceph-mon[26330]: mds.? [v2:172.21.15.77:6828/691698671,v1:172.21.15.77:6829/691698671] up:boot 2024-04-25T02:06:23.197 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:22 smithi077 ceph-mon[26330]: fsmap cephfs:1 {0=cephfs.smithi077.oadrkb=up:active} 2 up:standby 2024-04-25T02:06:23.197 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:22 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.gcfygj"}]: dispatch 2024-04-25T02:06:23.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.671+0000 7f3ec9431700 1 -- 172.21.15.77:0/6909592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ec40ffee0 msgr2=0x7f3ec4102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:23.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.671+0000 7f3ec9431700 1 --2- 172.21.15.77:0/6909592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ec40ffee0 0x7f3ec4102300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3eac004940 tx=0x7f3eac009e30 comp rx=0 tx=0).stop 2024-04-25T02:06:23.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.671+0000 7f3ec9431700 1 -- 172.21.15.77:0/6909592 shutdown_connections 2024-04-25T02:06:23.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.671+0000 7f3ec9431700 1 --2- 172.21.15.77:0/6909592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ec40ffee0 0x7f3ec4102300 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:23.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.671+0000 7f3ec9431700 1 --2- 172.21.15.77:0/6909592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ec40662c0 0x7f3ec40ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:23.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.671+0000 7f3ec9431700 1 -- 172.21.15.77:0/6909592 >> 172.21.15.77:0/6909592 conn(0x7f3ec40f7430 msgr2=0x7f3ec40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:23.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.671+0000 7f3ec9431700 1 -- 172.21.15.77:0/6909592 shutdown_connections 2024-04-25T02:06:23.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.671+0000 7f3ec9431700 1 -- 172.21.15.77:0/6909592 wait complete. 2024-04-25T02:06:23.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.671+0000 7f3ec9431700 1 Processor -- start 2024-04-25T02:06:23.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.671+0000 7f3ec9431700 1 -- start start 2024-04-25T02:06:23.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.672+0000 7f3ec9431700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ec40662c0 0x7f3ec410da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:23.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.672+0000 7f3ec9431700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ec40ffee0 0x7f3ec410df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:23.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.672+0000 7f3ec9431700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec410e540 con 0x7f3ec40ffee0 2024-04-25T02:06:23.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.672+0000 7f3ec9431700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec410ed90 con 0x7f3ec40662c0 2024-04-25T02:06:23.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.672+0000 7f3eba7fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ec40ffee0 0x7f3ec410df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:23.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.672+0000 7f3eba7fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ec40ffee0 0x7f3ec410df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52766/0 (socket says 172.21.15.77:52766) 2024-04-25T02:06:23.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.672+0000 7f3eba7fc700 1 -- 172.21.15.77:0/1431355915 learned_addr learned my addr 172.21.15.77:0/1431355915 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:06:23.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.672+0000 7f3ec2ffd700 1 --2- 172.21.15.77:0/1431355915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ec40662c0 0x7f3ec410da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:23.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.672+0000 7f3eba7fc700 1 -- 172.21.15.77:0/1431355915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ec40662c0 msgr2=0x7f3ec410da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:23.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.672+0000 7f3eba7fc700 1 --2- 172.21.15.77:0/1431355915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ec40662c0 0x7f3ec410da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:23.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.672+0000 7f3eba7fc700 1 -- 172.21.15.77:0/1431355915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac005040 con 0x7f3ec40ffee0 2024-04-25T02:06:23.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.672+0000 7f3eba7fc700 1 --2- 172.21.15.77:0/1431355915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ec40ffee0 0x7f3ec410df40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00b970 tx=0x7f3eac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:23.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.672+0000 7f3ebbfff700 1 -- 172.21.15.77:0/1431355915 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3eac00e040 con 0x7f3ec40ffee0 2024-04-25T02:06:23.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.673+0000 7f3ec9431700 1 -- 172.21.15.77:0/1431355915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec410f010 con 0x7f3ec40ffee0 2024-04-25T02:06:23.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.673+0000 7f3ebbfff700 1 -- 172.21.15.77:0/1431355915 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3eac00bbf0 con 0x7f3ec40ffee0 2024-04-25T02:06:23.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.673+0000 7f3ebbfff700 1 -- 172.21.15.77:0/1431355915 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3eac01c630 con 0x7f3ec40ffee0 2024-04-25T02:06:23.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.673+0000 7f3ec9431700 1 -- 172.21.15.77:0/1431355915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec410f550 con 0x7f3ec40ffee0 2024-04-25T02:06:23.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.674+0000 7f3ec9431700 1 -- 172.21.15.77:0/1431355915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec405f5c0 con 0x7f3ec40ffee0 2024-04-25T02:06:23.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.674+0000 7f3ebbfff700 1 -- 172.21.15.77:0/1431355915 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f3eac01c8f0 con 0x7f3ec40ffee0 2024-04-25T02:06:23.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.674+0000 7f3ebbfff700 1 --2- 172.21.15.77:0/1431355915 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f3eb00692a0 0x7f3eb006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:23.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.674+0000 7f3ebbfff700 1 -- 172.21.15.77:0/1431355915 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f3eac0884d0 con 0x7f3ec40ffee0 2024-04-25T02:06:23.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.674+0000 7f3ec2ffd700 1 --2- 172.21.15.77:0/1431355915 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f3eb00692a0 0x7f3eb006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:23.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.675+0000 7f3ec2ffd700 1 --2- 172.21.15.77:0/1431355915 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f3eb00692a0 0x7f3eb006b750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4066000 tx=0x7f3eb400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:23.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.679+0000 7f3ebbfff700 1 -- 172.21.15.77:0/1431355915 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3eac058290 con 0x7f3ec40ffee0 2024-04-25T02:06:23.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:23.929+0000 7f3ec9431700 1 -- 172.21.15.77:0/1431355915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f3ec404bed0 con 0x7f3ec40ffee0 2024-04-25T02:06:24.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:23 smithi112 ceph-mon[33313]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 4 op/s 2024-04-25T02:06:24.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:23 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:24.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:23 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:24.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:23 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:24.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:23 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:24.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:23 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:24.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:23 smithi077 ceph-mon[26330]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 4 op/s 2024-04-25T02:06:24.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:23 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:24.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:23 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:24.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:23 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:24.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:23 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:24.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:23 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:24.841 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:24 smithi077 ceph-mon[26330]: mds.? [v2:172.21.15.112:6826/2036319817,v1:172.21.15.112:6827/2036319817] up:boot 2024-04-25T02:06:24.841 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:24 smithi077 ceph-mon[26330]: fsmap cephfs:1 {0=cephfs.smithi077.oadrkb=up:active} 3 up:standby 2024-04-25T02:06:24.842 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:24 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.fjnadi"}]: dispatch 2024-04-25T02:06:24.842 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:24 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:06:24.842 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:24 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/1431355915' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-04-25T02:06:24.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:24.839+0000 7f3ebbfff700 1 -- 172.21.15.77:0/1431355915 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v11) v1 ==== 133+0+0 (secure 0 0 0) 0x7f3eac057e20 con 0x7f3ec40ffee0 2024-04-25T02:06:24.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:24.841+0000 7f3ec9431700 1 -- 172.21.15.77:0/1431355915 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f3eb00692a0 msgr2=0x7f3eb006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:24.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:24.841+0000 7f3ec9431700 1 --2- 172.21.15.77:0/1431355915 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f3eb00692a0 0x7f3eb006b750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4066000 tx=0x7f3eb400b040 comp rx=0 tx=0).stop 2024-04-25T02:06:24.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:24.841+0000 7f3ec9431700 1 -- 172.21.15.77:0/1431355915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ec40ffee0 msgr2=0x7f3ec410df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:24.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:24.841+0000 7f3ec9431700 1 --2- 172.21.15.77:0/1431355915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ec40ffee0 0x7f3ec410df40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00b970 tx=0x7f3eac009e30 comp rx=0 tx=0).stop 2024-04-25T02:06:24.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:24.842+0000 7f3ec9431700 1 -- 172.21.15.77:0/1431355915 shutdown_connections 2024-04-25T02:06:24.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:24.842+0000 7f3ec9431700 1 --2- 172.21.15.77:0/1431355915 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f3eb00692a0 0x7f3eb006b750 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:24.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:24.842+0000 7f3ec9431700 1 --2- 172.21.15.77:0/1431355915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ec40662c0 0x7f3ec410da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:24.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:24.842+0000 7f3ec9431700 1 --2- 172.21.15.77:0/1431355915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ec40ffee0 0x7f3ec410df40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:24.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:24.842+0000 7f3ec9431700 1 -- 172.21.15.77:0/1431355915 >> 172.21.15.77:0/1431355915 conn(0x7f3ec40f7430 msgr2=0x7f3ec40f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:24.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:24.842+0000 7f3ec9431700 1 -- 172.21.15.77:0/1431355915 shutdown_connections 2024-04-25T02:06:24.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:24.842+0000 7f3ec9431700 1 -- 172.21.15.77:0/1431355915 wait complete. 2024-04-25T02:06:24.849 INFO:teuthology.orchestra.run.smithi077.stderr:inline data disabled 2024-04-25T02:06:25.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:24 smithi112 ceph-mon[33313]: mds.? [v2:172.21.15.112:6826/2036319817,v1:172.21.15.112:6827/2036319817] up:boot 2024-04-25T02:06:25.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:24 smithi112 ceph-mon[33313]: fsmap cephfs:1 {0=cephfs.smithi077.oadrkb=up:active} 3 up:standby 2024-04-25T02:06:25.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:24 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.fjnadi"}]: dispatch 2024-04-25T02:06:25.188 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:24 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:06:25.189 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:24 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/1431355915' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-04-25T02:06:25.451 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-25T02:06:25.462 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T02:06:25.462 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-25T02:06:26.224 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:06:26.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:25 smithi077 ceph-mon[26330]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-04-25T02:06:26.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:25 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/1431355915' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-04-25T02:06:26.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:25 smithi077 ceph-mon[26330]: mds.? [v2:172.21.15.112:6824/3687767796,v1:172.21.15.112:6825/3687767796] up:standby 2024-04-25T02:06:26.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:25 smithi077 ceph-mon[26330]: Dropping low affinity active daemon mds.cephfs.smithi077.oadrkb in favor of higher affinity standby. 2024-04-25T02:06:26.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:25 smithi077 ceph-mon[26330]: Replacing daemon mds.cephfs.smithi077.oadrkb as rank 0 with standby daemon mds.cephfs.smithi112.dvwudt 2024-04-25T02:06:26.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:25 smithi077 ceph-mon[26330]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-25T02:06:26.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:25 smithi077 ceph-mon[26330]: fsmap cephfs:1 {0=cephfs.smithi077.oadrkb=up:active} 3 up:standby 2024-04-25T02:06:26.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:25 smithi077 ceph-mon[26330]: osdmap e47: 6 total, 6 up, 6 in 2024-04-25T02:06:26.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:25 smithi077 ceph-mon[26330]: fsmap cephfs:1/1 {0=cephfs.smithi112.dvwudt=up:replay} 2 up:standby 2024-04-25T02:06:26.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:25 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:26.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:25 smithi112 ceph-mon[33313]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-04-25T02:06:26.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:25 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/1431355915' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-04-25T02:06:26.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:25 smithi112 ceph-mon[33313]: mds.? [v2:172.21.15.112:6824/3687767796,v1:172.21.15.112:6825/3687767796] up:standby 2024-04-25T02:06:26.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:25 smithi112 ceph-mon[33313]: Dropping low affinity active daemon mds.cephfs.smithi077.oadrkb in favor of higher affinity standby. 2024-04-25T02:06:26.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:25 smithi112 ceph-mon[33313]: Replacing daemon mds.cephfs.smithi077.oadrkb as rank 0 with standby daemon mds.cephfs.smithi112.dvwudt 2024-04-25T02:06:26.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:25 smithi112 ceph-mon[33313]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-25T02:06:26.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:25 smithi112 ceph-mon[33313]: fsmap cephfs:1 {0=cephfs.smithi077.oadrkb=up:active} 3 up:standby 2024-04-25T02:06:26.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:25 smithi112 ceph-mon[33313]: osdmap e47: 6 total, 6 up, 6 in 2024-04-25T02:06:26.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:25 smithi112 ceph-mon[33313]: fsmap cephfs:1/1 {0=cephfs.smithi112.dvwudt=up:replay} 2 up:standby 2024-04-25T02:06:26.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:25 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:27.196 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:26 smithi077 ceph-mon[26330]: mds.? [v2:172.21.15.112:6824/3687767796,v1:172.21.15.112:6825/3687767796] up:reconnect 2024-04-25T02:06:27.197 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:26 smithi077 ceph-mon[26330]: mds.? [v2:172.21.15.77:6826/26222645,v1:172.21.15.77:6827/26222645] up:boot 2024-04-25T02:06:27.197 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:26 smithi077 ceph-mon[26330]: mds.? [v2:172.21.15.77:6828/691698671,v1:172.21.15.77:6829/691698671] up:standby 2024-04-25T02:06:27.197 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:26 smithi077 ceph-mon[26330]: fsmap cephfs:1/1 {0=cephfs.smithi112.dvwudt=up:reconnect} 3 up:standby 2024-04-25T02:06:27.197 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:26 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.oadrkb"}]: dispatch 2024-04-25T02:06:27.197 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:26 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:27.197 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:26 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:27.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:26 smithi112 ceph-mon[33313]: mds.? [v2:172.21.15.112:6824/3687767796,v1:172.21.15.112:6825/3687767796] up:reconnect 2024-04-25T02:06:27.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:26 smithi112 ceph-mon[33313]: mds.? [v2:172.21.15.77:6826/26222645,v1:172.21.15.77:6827/26222645] up:boot 2024-04-25T02:06:27.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:26 smithi112 ceph-mon[33313]: mds.? [v2:172.21.15.77:6828/691698671,v1:172.21.15.77:6829/691698671] up:standby 2024-04-25T02:06:27.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:26 smithi112 ceph-mon[33313]: fsmap cephfs:1/1 {0=cephfs.smithi112.dvwudt=up:reconnect} 3 up:standby 2024-04-25T02:06:27.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:26 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.oadrkb"}]: dispatch 2024-04-25T02:06:27.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:26 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:27.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:26 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:27.973 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:27 smithi077 ceph-mon[26330]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1023 B/s wr, 3 op/s 2024-04-25T02:06:27.973 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:27 smithi077 ceph-mon[26330]: mds.? [v2:172.21.15.112:6824/3687767796,v1:172.21.15.112:6825/3687767796] up:rejoin 2024-04-25T02:06:27.973 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:27 smithi077 ceph-mon[26330]: fsmap cephfs:1/1 {0=cephfs.smithi112.dvwudt=up:rejoin} 3 up:standby 2024-04-25T02:06:27.973 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:27 smithi077 ceph-mon[26330]: daemon mds.cephfs.smithi112.dvwudt is now active in filesystem cephfs as rank 0 2024-04-25T02:06:28.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:27 smithi112 ceph-mon[33313]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1023 B/s wr, 3 op/s 2024-04-25T02:06:28.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:27 smithi112 ceph-mon[33313]: mds.? [v2:172.21.15.112:6824/3687767796,v1:172.21.15.112:6825/3687767796] up:rejoin 2024-04-25T02:06:28.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:27 smithi112 ceph-mon[33313]: fsmap cephfs:1/1 {0=cephfs.smithi112.dvwudt=up:rejoin} 3 up:standby 2024-04-25T02:06:28.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:27 smithi112 ceph-mon[33313]: daemon mds.cephfs.smithi112.dvwudt is now active in filesystem cephfs as rank 0 2024-04-25T02:06:29.140 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:28 smithi077 ceph-mon[26330]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-25T02:06:29.140 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:28 smithi077 ceph-mon[26330]: Cluster is now healthy 2024-04-25T02:06:29.140 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:28 smithi077 ceph-mon[26330]: mds.? [v2:172.21.15.112:6824/3687767796,v1:172.21.15.112:6825/3687767796] up:active 2024-04-25T02:06:29.140 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:28 smithi077 ceph-mon[26330]: mds.? [v2:172.21.15.112:6826/2036319817,v1:172.21.15.112:6827/2036319817] up:standby 2024-04-25T02:06:29.140 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:28 smithi077 ceph-mon[26330]: fsmap cephfs:1 {0=cephfs.smithi112.dvwudt=up:active} 3 up:standby 2024-04-25T02:06:29.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:28 smithi112 ceph-mon[33313]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-25T02:06:29.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:28 smithi112 ceph-mon[33313]: Cluster is now healthy 2024-04-25T02:06:29.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:28 smithi112 ceph-mon[33313]: mds.? [v2:172.21.15.112:6824/3687767796,v1:172.21.15.112:6825/3687767796] up:active 2024-04-25T02:06:29.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:28 smithi112 ceph-mon[33313]: mds.? [v2:172.21.15.112:6826/2036319817,v1:172.21.15.112:6827/2036319817] up:standby 2024-04-25T02:06:29.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:28 smithi112 ceph-mon[33313]: fsmap cephfs:1 {0=cephfs.smithi112.dvwudt=up:active} 3 up:standby 2024-04-25T02:06:29.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.944+0000 7fcd88926700 1 -- 172.21.15.77:0/306127550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd840fe420 msgr2=0x7fcd840fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:29.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.944+0000 7fcd88926700 1 --2- 172.21.15.77:0/306127550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd840fe420 0x7fcd840fe830 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcd78004940 tx=0x7fcd78009e30 comp rx=0 tx=0).stop 2024-04-25T02:06:29.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.944+0000 7fcd88926700 1 -- 172.21.15.77:0/306127550 shutdown_connections 2024-04-25T02:06:29.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.944+0000 7fcd88926700 1 --2- 172.21.15.77:0/306127550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd840fed70 0x7fcd840faeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:29.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.944+0000 7fcd88926700 1 --2- 172.21.15.77:0/306127550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd840fe420 0x7fcd840fe830 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:29.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.944+0000 7fcd88926700 1 -- 172.21.15.77:0/306127550 >> 172.21.15.77:0/306127550 conn(0x7fcd840f6be0 msgr2=0x7fcd840f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:29.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.944+0000 7fcd88926700 1 -- 172.21.15.77:0/306127550 shutdown_connections 2024-04-25T02:06:29.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.944+0000 7fcd88926700 1 -- 172.21.15.77:0/306127550 wait complete. 2024-04-25T02:06:29.952 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:29 smithi077 ceph-mon[26330]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 716 B/s wr, 3 op/s 2024-04-25T02:06:29.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.945+0000 7fcd88926700 1 Processor -- start 2024-04-25T02:06:29.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.945+0000 7fcd88926700 1 -- start start 2024-04-25T02:06:29.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.945+0000 7fcd88926700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd840fe420 0x7fcd8410d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:29.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.945+0000 7fcd88926700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd840fed70 0x7fcd8410de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:29.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.945+0000 7fcd88926700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8410e430 con 0x7fcd840fe420 2024-04-25T02:06:29.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.945+0000 7fcd88926700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8410e5a0 con 0x7fcd840fed70 2024-04-25T02:06:29.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.945+0000 7fcd8259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd840fe420 0x7fcd8410d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:29.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.945+0000 7fcd8259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd840fe420 0x7fcd8410d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54482/0 (socket says 172.21.15.77:54482) 2024-04-25T02:06:29.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.945+0000 7fcd8259c700 1 -- 172.21.15.77:0/1013723164 learned_addr learned my addr 172.21.15.77:0/1013723164 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:06:29.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.945+0000 7fcd81d9b700 1 --2- 172.21.15.77:0/1013723164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd840fed70 0x7fcd8410de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:29.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.946+0000 7fcd8259c700 1 -- 172.21.15.77:0/1013723164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd840fed70 msgr2=0x7fcd8410de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:29.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.946+0000 7fcd8259c700 1 --2- 172.21.15.77:0/1013723164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd840fed70 0x7fcd8410de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:29.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.946+0000 7fcd8259c700 1 -- 172.21.15.77:0/1013723164 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd78005040 con 0x7fcd840fe420 2024-04-25T02:06:29.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.946+0000 7fcd8259c700 1 --2- 172.21.15.77:0/1013723164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd840fe420 0x7fcd8410d8f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcd7800b970 tx=0x7fcd78009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:29.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.946+0000 7fcd72ffd700 1 -- 172.21.15.77:0/1013723164 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd7800e040 con 0x7fcd840fe420 2024-04-25T02:06:29.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.946+0000 7fcd72ffd700 1 -- 172.21.15.77:0/1013723164 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd7800bbf0 con 0x7fcd840fe420 2024-04-25T02:06:29.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.946+0000 7fcd88926700 1 -- 172.21.15.77:0/1013723164 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd84112fa0 con 0x7fcd840fe420 2024-04-25T02:06:29.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.946+0000 7fcd72ffd700 1 -- 172.21.15.77:0/1013723164 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd7801c630 con 0x7fcd840fe420 2024-04-25T02:06:29.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.946+0000 7fcd88926700 1 -- 172.21.15.77:0/1013723164 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd841134d0 con 0x7fcd840fe420 2024-04-25T02:06:29.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.947+0000 7fcd88926700 1 -- 172.21.15.77:0/1013723164 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd8404c710 con 0x7fcd840fe420 2024-04-25T02:06:29.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.947+0000 7fcd72ffd700 1 -- 172.21.15.77:0/1013723164 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fcd7800bd60 con 0x7fcd840fe420 2024-04-25T02:06:29.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.948+0000 7fcd72ffd700 1 --2- 172.21.15.77:0/1013723164 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fcd6c0692a0 0x7fcd6c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:29.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.948+0000 7fcd81d9b700 1 --2- 172.21.15.77:0/1013723164 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fcd6c0692a0 0x7fcd6c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:29.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.948+0000 7fcd72ffd700 1 -- 172.21.15.77:0/1013723164 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fcd78088520 con 0x7fcd840fe420 2024-04-25T02:06:29.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.948+0000 7fcd81d9b700 1 --2- 172.21.15.77:0/1013723164 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fcd6c0692a0 0x7fcd6c06b750 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcd740041d0 tx=0x7fcd740043c0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:29.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:29.952+0000 7fcd72ffd700 1 -- 172.21.15.77:0/1013723164 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fcd78058290 con 0x7fcd840fe420 2024-04-25T02:06:30.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:30.205+0000 7fcd88926700 1 -- 172.21.15.77:0/1013723164 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcd841058d0 con 0x7fcd840fe420 2024-04-25T02:06:30.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:30.206+0000 7fcd72ffd700 1 -- 172.21.15.77:0/1013723164 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1806 (secure 0 0 0) 0x7fcd78057e20 con 0x7fcd840fe420 2024-04-25T02:06:30.212 INFO:teuthology.orchestra.run.smithi077.stdout:e15 2024-04-25T02:06:30.212 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T02:06:30.212 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:06:30.212 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-04-25T02:06:30.212 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:06:30.213 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-04-25T02:06:30.213 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-04-25T02:06:30.213 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 15 2024-04-25T02:06:30.213 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-25T02:06:30.213 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-04-25T02:06:10.008979+0000 2024-04-25T02:06:30.213 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-04-25T02:06:27.849984+0000 2024-04-25T02:06:30.213 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-04-25T02:06:30.213 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-04-25T02:06:30.213 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-04-25T02:06:30.213 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-04-25T02:06:30.213 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-04-25T02:06:30.213 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-04-25T02:06:30.213 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-04-25T02:06:30.213 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 47 2024-04-25T02:06:30.213 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:06:30.213 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-04-25T02:06:30.214 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-04-25T02:06:30.214 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=24257} 2024-04-25T02:06:30.214 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-04-25T02:06:30.214 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-04-25T02:06:30.214 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-04-25T02:06:30.214 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-04-25T02:06:30.214 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-04-25T02:06:30.214 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-04-25T02:06:30.214 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-04-25T02:06:30.214 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-04-25T02:06:30.214 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi112.dvwudt{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.112:6824/3687767796,v1:172.21.15.112:6825/3687767796] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:06:30.214 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:06:30.214 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:06:30.214 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-04-25T02:06:30.215 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:06:30.215 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.gcfygj{-1:14462} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/691698671,v1:172.21.15.77:6829/691698671] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:06:30.215 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.oadrkb{-1:14474} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.77:6826/26222645,v1:172.21.15.77:6827/26222645] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:06:30.215 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi112.fjnadi{-1:24269} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/2036319817,v1:172.21.15.112:6827/2036319817] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:06:30.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:30.208+0000 7fcd88926700 1 -- 172.21.15.77:0/1013723164 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fcd6c0692a0 msgr2=0x7fcd6c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:30.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:30.208+0000 7fcd88926700 1 --2- 172.21.15.77:0/1013723164 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fcd6c0692a0 0x7fcd6c06b750 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcd740041d0 tx=0x7fcd740043c0 comp rx=0 tx=0).stop 2024-04-25T02:06:30.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:30.208+0000 7fcd88926700 1 -- 172.21.15.77:0/1013723164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd840fe420 msgr2=0x7fcd8410d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:30.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:30.208+0000 7fcd88926700 1 --2- 172.21.15.77:0/1013723164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd840fe420 0x7fcd8410d8f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcd7800b970 tx=0x7fcd78009e30 comp rx=0 tx=0).stop 2024-04-25T02:06:30.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:30.208+0000 7fcd88926700 1 -- 172.21.15.77:0/1013723164 shutdown_connections 2024-04-25T02:06:30.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:30.208+0000 7fcd88926700 1 --2- 172.21.15.77:0/1013723164 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fcd6c0692a0 0x7fcd6c06b750 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:30.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:30.208+0000 7fcd88926700 1 --2- 172.21.15.77:0/1013723164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd840fe420 0x7fcd8410d8f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:30.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:30.208+0000 7fcd88926700 1 --2- 172.21.15.77:0/1013723164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd840fed70 0x7fcd8410de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:30.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:30.208+0000 7fcd88926700 1 -- 172.21.15.77:0/1013723164 >> 172.21.15.77:0/1013723164 conn(0x7fcd840f6be0 msgr2=0x7fcd840f8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:30.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:30.208+0000 7fcd88926700 1 -- 172.21.15.77:0/1013723164 shutdown_connections 2024-04-25T02:06:30.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:30.208+0000 7fcd88926700 1 -- 172.21.15.77:0/1013723164 wait complete. 2024-04-25T02:06:30.216 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 15 2024-04-25T02:06:30.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:29 smithi112 ceph-mon[33313]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 716 B/s wr, 3 op/s 2024-04-25T02:06:30.747 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-04-25T02:06:31.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:31.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:31.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:31.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:06:31.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:31.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:31 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/1013723164' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:06:31.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:06:31.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:31 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:06:31.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:31 smithi077 ceph-mon[26330]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.6 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-25T02:06:31.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:31 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:31.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:31 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:31.512 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:31 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:31.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:31 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:06:31.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:31 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:31.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:31 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/1013723164' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:06:31.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:31 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:06:31.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:31 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:06:31.513 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:31 smithi112 ceph-mon[33313]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.6 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-25T02:06:31.564 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:06:33.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.062+0000 7f34ef46b700 1 -- 172.21.15.77:0/4261712267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34e80fcf70 msgr2=0x7f34e80fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:33.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.062+0000 7f34ef46b700 1 --2- 172.21.15.77:0/4261712267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34e80fcf70 0x7f34e80fd3e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f34e4004940 tx=0x7f34e4009e30 comp rx=0 tx=0).stop 2024-04-25T02:06:33.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.062+0000 7f34ef46b700 1 -- 172.21.15.77:0/4261712267 shutdown_connections 2024-04-25T02:06:33.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.062+0000 7f34ef46b700 1 --2- 172.21.15.77:0/4261712267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34e80fcf70 0x7f34e80fd3e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:33.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.062+0000 7f34ef46b700 1 --2- 172.21.15.77:0/4261712267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34e80fbcc0 0x7f34e80fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:33.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.062+0000 7f34ef46b700 1 -- 172.21.15.77:0/4261712267 >> 172.21.15.77:0/4261712267 conn(0x7f34e80f7440 msgr2=0x7f34e80f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:33.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.062+0000 7f34ef46b700 1 -- 172.21.15.77:0/4261712267 shutdown_connections 2024-04-25T02:06:33.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.062+0000 7f34ef46b700 1 -- 172.21.15.77:0/4261712267 wait complete. 2024-04-25T02:06:33.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.063+0000 7f34ef46b700 1 Processor -- start 2024-04-25T02:06:33.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.063+0000 7f34ef46b700 1 -- start start 2024-04-25T02:06:33.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.063+0000 7f34ef46b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34e80fbcc0 0x7f34e8066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:33.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.063+0000 7f34ef46b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34e80fcf70 0x7f34e8112710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:33.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.063+0000 7f34ef46b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e8112c50 con 0x7f34e80fcf70 2024-04-25T02:06:33.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.063+0000 7f34ef46b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e8112d90 con 0x7f34e80fbcc0 2024-04-25T02:06:33.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.063+0000 7f34eca06700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34e80fcf70 0x7f34e8112710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:33.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.063+0000 7f34eca06700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34e80fcf70 0x7f34e8112710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54510/0 (socket says 172.21.15.77:54510) 2024-04-25T02:06:33.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.063+0000 7f34eca06700 1 -- 172.21.15.77:0/2882448130 learned_addr learned my addr 172.21.15.77:0/2882448130 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:06:33.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.063+0000 7f34ed207700 1 --2- 172.21.15.77:0/2882448130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34e80fbcc0 0x7f34e8066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:33.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.063+0000 7f34eca06700 1 -- 172.21.15.77:0/2882448130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34e80fbcc0 msgr2=0x7f34e8066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:33.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.063+0000 7f34eca06700 1 --2- 172.21.15.77:0/2882448130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34e80fbcc0 0x7f34e8066cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:33.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.063+0000 7f34eca06700 1 -- 172.21.15.77:0/2882448130 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e4005040 con 0x7f34e80fcf70 2024-04-25T02:06:33.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.064+0000 7f34eca06700 1 --2- 172.21.15.77:0/2882448130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34e80fcf70 0x7f34e8112710 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f34e4013870 tx=0x7f34e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:33.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.064+0000 7f34ddffb700 1 -- 172.21.15.77:0/2882448130 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34e400e070 con 0x7f34e80fcf70 2024-04-25T02:06:33.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.064+0000 7f34ddffb700 1 -- 172.21.15.77:0/2882448130 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f34e401c400 con 0x7f34e80fcf70 2024-04-25T02:06:33.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.064+0000 7f34ef46b700 1 -- 172.21.15.77:0/2882448130 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e8112f90 con 0x7f34e80fcf70 2024-04-25T02:06:33.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.064+0000 7f34ddffb700 1 -- 172.21.15.77:0/2882448130 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34e400b650 con 0x7f34e80fcf70 2024-04-25T02:06:33.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.064+0000 7f34ef46b700 1 -- 172.21.15.77:0/2882448130 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e8113440 con 0x7f34e80fcf70 2024-04-25T02:06:33.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.065+0000 7f34ef46b700 1 -- 172.21.15.77:0/2882448130 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e804c710 con 0x7f34e80fcf70 2024-04-25T02:06:33.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.065+0000 7f34ddffb700 1 -- 172.21.15.77:0/2882448130 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f34e401ca00 con 0x7f34e80fcf70 2024-04-25T02:06:33.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.066+0000 7f34ddffb700 1 --2- 172.21.15.77:0/2882448130 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f34d40692a0 0x7f34d406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:33.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.066+0000 7f34ed207700 1 --2- 172.21.15.77:0/2882448130 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f34d40692a0 0x7f34d406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:33.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.066+0000 7f34ddffb700 1 -- 172.21.15.77:0/2882448130 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f34e4088870 con 0x7f34e80fcf70 2024-04-25T02:06:33.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.066+0000 7f34ed207700 1 --2- 172.21.15.77:0/2882448130 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f34d40692a0 0x7f34d406b750 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f34d8004600 tx=0x7f34d800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:33.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.070+0000 7f34ddffb700 1 -- 172.21.15.77:0/2882448130 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f34e40585e0 con 0x7f34e80fcf70 2024-04-25T02:06:33.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.305+0000 7f34ef46b700 1 -- 172.21.15.77:0/2882448130 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34e81047b0 con 0x7f34e80fcf70 2024-04-25T02:06:33.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.305+0000 7f34ddffb700 1 -- 172.21.15.77:0/2882448130 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4685 (secure 0 0 0) 0x7f34e4004490 con 0x7f34e80fcf70 2024-04-25T02:06:33.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.307+0000 7f34ef46b700 1 -- 172.21.15.77:0/2882448130 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f34d40692a0 msgr2=0x7f34d406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:33.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.307+0000 7f34ef46b700 1 --2- 172.21.15.77:0/2882448130 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f34d40692a0 0x7f34d406b750 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f34d8004600 tx=0x7f34d800b040 comp rx=0 tx=0).stop 2024-04-25T02:06:33.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.307+0000 7f34ef46b700 1 -- 172.21.15.77:0/2882448130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34e80fcf70 msgr2=0x7f34e8112710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:33.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.307+0000 7f34ef46b700 1 --2- 172.21.15.77:0/2882448130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34e80fcf70 0x7f34e8112710 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f34e4013870 tx=0x7f34e4009e30 comp rx=0 tx=0).stop 2024-04-25T02:06:33.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.307+0000 7f34ef46b700 1 -- 172.21.15.77:0/2882448130 shutdown_connections 2024-04-25T02:06:33.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.307+0000 7f34ef46b700 1 --2- 172.21.15.77:0/2882448130 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f34d40692a0 0x7f34d406b750 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:33.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.307+0000 7f34ef46b700 1 --2- 172.21.15.77:0/2882448130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34e80fbcc0 0x7f34e8066cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:33.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.307+0000 7f34ef46b700 1 --2- 172.21.15.77:0/2882448130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34e80fcf70 0x7f34e8112710 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:33.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.307+0000 7f34ef46b700 1 -- 172.21.15.77:0/2882448130 >> 172.21.15.77:0/2882448130 conn(0x7f34e80f7440 msgr2=0x7f34e80f8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:33.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.307+0000 7f34ef46b700 1 -- 172.21.15.77:0/2882448130 shutdown_connections 2024-04-25T02:06:33.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:33.307+0000 7f34ef46b700 1 -- 172.21.15.77:0/2882448130 wait complete. 2024-04-25T02:06:33.314 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 15 2024-04-25T02:06:33.324 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-04-25T02:06:33.626 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:33 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:33.626 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:33 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:33.626 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:33 smithi077 ceph-mon[26330]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-25T02:06:33.626 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:33 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/2882448130' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:33.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:33 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:33.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:33 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:33.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:33 smithi112 ceph-mon[33313]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-25T02:06:33.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:33 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/2882448130' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:34.260 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-04-25T02:06:34.947 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:06:35.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:35 smithi077 ceph-mon[26330]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-25T02:06:35.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:35 smithi112 ceph-mon[33313]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-25T02:06:37.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.049+0000 7feea3087700 1 -- 172.21.15.77:0/2164003584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee9c0fcf90 msgr2=0x7fee9c0fd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:37.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.049+0000 7feea3087700 1 --2- 172.21.15.77:0/2164003584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee9c0fcf90 0x7fee9c0fd400 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fee88004940 tx=0x7fee88009e30 comp rx=0 tx=0).stop 2024-04-25T02:06:37.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.049+0000 7feea3087700 1 -- 172.21.15.77:0/2164003584 shutdown_connections 2024-04-25T02:06:37.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.049+0000 7feea3087700 1 --2- 172.21.15.77:0/2164003584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee9c0fcf90 0x7fee9c0fd400 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:37.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.049+0000 7feea3087700 1 --2- 172.21.15.77:0/2164003584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee9c0fbce0 0x7fee9c0fc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:37.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.049+0000 7feea3087700 1 -- 172.21.15.77:0/2164003584 >> 172.21.15.77:0/2164003584 conn(0x7fee9c0f7420 msgr2=0x7fee9c0f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:37.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.049+0000 7feea3087700 1 -- 172.21.15.77:0/2164003584 shutdown_connections 2024-04-25T02:06:37.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.049+0000 7feea3087700 1 -- 172.21.15.77:0/2164003584 wait complete. 2024-04-25T02:06:37.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.049+0000 7feea3087700 1 Processor -- start 2024-04-25T02:06:37.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.049+0000 7feea3087700 1 -- start start 2024-04-25T02:06:37.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.050+0000 7feea3087700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee9c0fbce0 0x7fee9c10c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:37.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.050+0000 7feea3087700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee9c0fcf90 0x7fee9c10cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:37.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.050+0000 7feea3087700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c10d360 con 0x7fee9c0fcf90 2024-04-25T02:06:37.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.050+0000 7feea3087700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c10d4d0 con 0x7fee9c0fbce0 2024-04-25T02:06:37.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.050+0000 7fee9bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee9c0fcf90 0x7fee9c10cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:37.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.050+0000 7fee9bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee9c0fcf90 0x7fee9c10cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54532/0 (socket says 172.21.15.77:54532) 2024-04-25T02:06:37.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.050+0000 7fee9bfff700 1 -- 172.21.15.77:0/2212529635 learned_addr learned my addr 172.21.15.77:0/2212529635 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:06:37.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.050+0000 7feea0e23700 1 --2- 172.21.15.77:0/2212529635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee9c0fbce0 0x7fee9c10c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:37.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.050+0000 7fee9bfff700 1 -- 172.21.15.77:0/2212529635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee9c0fbce0 msgr2=0x7fee9c10c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:37.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.050+0000 7fee9bfff700 1 --2- 172.21.15.77:0/2212529635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee9c0fbce0 0x7fee9c10c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:37.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.050+0000 7fee9bfff700 1 -- 172.21.15.77:0/2212529635 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee88005040 con 0x7fee9c0fcf90 2024-04-25T02:06:37.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.050+0000 7fee9bfff700 1 --2- 172.21.15.77:0/2212529635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee9c0fcf90 0x7fee9c10cd60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fee88009fd0 tx=0x7fee88009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:37.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.051+0000 7fee997fa700 1 -- 172.21.15.77:0/2212529635 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee8800e040 con 0x7fee9c0fcf90 2024-04-25T02:06:37.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.051+0000 7feea3087700 1 -- 172.21.15.77:0/2212529635 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee9c0661f0 con 0x7fee9c0fcf90 2024-04-25T02:06:37.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.051+0000 7fee997fa700 1 -- 172.21.15.77:0/2212529635 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee8800be00 con 0x7fee9c0fcf90 2024-04-25T02:06:37.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.051+0000 7fee997fa700 1 -- 172.21.15.77:0/2212529635 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee880137f0 con 0x7fee9c0fcf90 2024-04-25T02:06:37.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.051+0000 7feea3087700 1 -- 172.21.15.77:0/2212529635 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee9c0667b0 con 0x7fee9c0fcf90 2024-04-25T02:06:37.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.052+0000 7feea3087700 1 -- 172.21.15.77:0/2212529635 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee9c04c710 con 0x7fee9c0fcf90 2024-04-25T02:06:37.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.052+0000 7fee997fa700 1 -- 172.21.15.77:0/2212529635 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fee88013a60 con 0x7fee9c0fcf90 2024-04-25T02:06:37.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.052+0000 7fee997fa700 1 --2- 172.21.15.77:0/2212529635 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fee8c0692a0 0x7fee8c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:37.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.053+0000 7fee997fa700 1 -- 172.21.15.77:0/2212529635 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fee8808ab30 con 0x7fee9c0fcf90 2024-04-25T02:06:37.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.053+0000 7feea0e23700 1 --2- 172.21.15.77:0/2212529635 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fee8c0692a0 0x7fee8c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:37.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.053+0000 7feea0e23700 1 --2- 172.21.15.77:0/2212529635 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fee8c0692a0 0x7fee8c06b750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fee900041d0 tx=0x7fee900043c0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:37.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.057+0000 7fee997fa700 1 -- 172.21.15.77:0/2212529635 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fee8805a8d0 con 0x7fee9c0fcf90 2024-04-25T02:06:37.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.331+0000 7feea3087700 1 -- 172.21.15.77:0/2212529635 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7fee9c1047d0 con 0x7fee9c0fcf90 2024-04-25T02:06:37.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.331+0000 7fee997fa700 1 -- 172.21.15.77:0/2212529635 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v15) v1 ==== 78+0+99 (secure 0 0 0) 0x7fee88024080 con 0x7fee9c0fcf90 2024-04-25T02:06:37.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.333+0000 7feea3087700 1 -- 172.21.15.77:0/2212529635 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fee8c0692a0 msgr2=0x7fee8c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:37.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.333+0000 7feea3087700 1 --2- 172.21.15.77:0/2212529635 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fee8c0692a0 0x7fee8c06b750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fee900041d0 tx=0x7fee900043c0 comp rx=0 tx=0).stop 2024-04-25T02:06:37.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.333+0000 7feea3087700 1 -- 172.21.15.77:0/2212529635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee9c0fcf90 msgr2=0x7fee9c10cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:37.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.333+0000 7feea3087700 1 --2- 172.21.15.77:0/2212529635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee9c0fcf90 0x7fee9c10cd60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fee88009fd0 tx=0x7fee88009e30 comp rx=0 tx=0).stop 2024-04-25T02:06:37.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.333+0000 7feea3087700 1 -- 172.21.15.77:0/2212529635 shutdown_connections 2024-04-25T02:06:37.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.333+0000 7feea3087700 1 --2- 172.21.15.77:0/2212529635 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fee8c0692a0 0x7fee8c06b750 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:37.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.333+0000 7feea3087700 1 --2- 172.21.15.77:0/2212529635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee9c0fbce0 0x7fee9c10c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:37.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.333+0000 7feea3087700 1 --2- 172.21.15.77:0/2212529635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee9c0fcf90 0x7fee9c10cd60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:37.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.333+0000 7feea3087700 1 -- 172.21.15.77:0/2212529635 >> 172.21.15.77:0/2212529635 conn(0x7fee9c0f7420 msgr2=0x7fee9c0f8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:37.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.333+0000 7feea3087700 1 -- 172.21.15.77:0/2212529635 shutdown_connections 2024-04-25T02:06:37.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:37.333+0000 7feea3087700 1 -- 172.21.15.77:0/2212529635 wait complete. 2024-04-25T02:06:37.349 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-04-25T02:06:37.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:37 smithi112 ceph-mon[33313]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-25T02:06:37.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:37 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/2212529635' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-04-25T02:06:37.895 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:37 smithi077 ceph-mon[26330]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-25T02:06:37.895 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:37 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/2212529635' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-04-25T02:06:38.170 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-04-25T02:06:38.183 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:06:38.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.291+0000 7f72cef5d640 1 -- 172.21.15.77:0/2579353499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72c80fd450 msgr2=0x7f72c80fd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:38.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.291+0000 7f72cef5d640 1 --2- 172.21.15.77:0/2579353499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72c80fd450 0x7f72c80fd8c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f72b40048d0 tx=0x7f72b4009da0 comp rx=0 tx=0).stop 2024-04-25T02:06:38.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.291+0000 7f72cef5d640 1 -- 172.21.15.77:0/2579353499 shutdown_connections 2024-04-25T02:06:38.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.291+0000 7f72cef5d640 1 --2- 172.21.15.77:0/2579353499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72c80fd450 0x7f72c80fd8c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:38.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.291+0000 7f72cef5d640 1 --2- 172.21.15.77:0/2579353499 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72c80fc180 0x7f72c80fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:38.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.291+0000 7f72cef5d640 1 -- 172.21.15.77:0/2579353499 >> 172.21.15.77:0/2579353499 conn(0x7f72c80f7920 msgr2=0x7f72c80f9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:38.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.291+0000 7f72cef5d640 1 -- 172.21.15.77:0/2579353499 shutdown_connections 2024-04-25T02:06:38.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.291+0000 7f72cef5d640 1 -- 172.21.15.77:0/2579353499 wait complete. 2024-04-25T02:06:38.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.292+0000 7f72cef5d640 1 Processor -- start 2024-04-25T02:06:38.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.292+0000 7f72cef5d640 1 -- start start 2024-04-25T02:06:38.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.292+0000 7f72cef5d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72c80fc180 0x7f72c810cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:38.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.292+0000 7f72cef5d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72c80fd450 0x7f72c810d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:38.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.292+0000 7f72cef5d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c810d8d0 con 0x7f72c80fd450 2024-04-25T02:06:38.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.292+0000 7f72cef5d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c8112240 con 0x7f72c80fc180 2024-04-25T02:06:38.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.292+0000 7f72c7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72c80fd450 0x7f72c810d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:38.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.293+0000 7f72c7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72c80fd450 0x7f72c810d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47446/0 (socket says 172.21.15.77:47446) 2024-04-25T02:06:38.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.293+0000 7f72c7fff640 1 -- 172.21.15.77:0/1805117719 learned_addr learned my addr 172.21.15.77:0/1805117719 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:06:38.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.293+0000 7f72cccf9640 1 --2- 172.21.15.77:0/1805117719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72c80fc180 0x7f72c810cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:38.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.293+0000 7f72c7fff640 1 -- 172.21.15.77:0/1805117719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72c80fc180 msgr2=0x7f72c810cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:38.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.293+0000 7f72c7fff640 1 --2- 172.21.15.77:0/1805117719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72c80fc180 0x7f72c810cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:38.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.293+0000 7f72c7fff640 1 -- 172.21.15.77:0/1805117719 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b4005040 con 0x7f72c80fd450 2024-04-25T02:06:38.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.293+0000 7f72c7fff640 1 --2- 172.21.15.77:0/1805117719 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72c80fd450 0x7f72c810d250 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f72b4007dd0 tx=0x7f72b4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:38.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.293+0000 7f72c57fa640 1 -- 172.21.15.77:0/1805117719 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72b40094c0 con 0x7f72c80fd450 2024-04-25T02:06:38.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.293+0000 7f72cef5d640 1 -- 172.21.15.77:0/1805117719 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c8112380 con 0x7f72c80fd450 2024-04-25T02:06:38.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.293+0000 7f72c57fa640 1 -- 172.21.15.77:0/1805117719 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f72b4009620 con 0x7f72c80fd450 2024-04-25T02:06:38.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.293+0000 7f72c57fa640 1 -- 172.21.15.77:0/1805117719 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72b403b640 con 0x7f72c80fd450 2024-04-25T02:06:38.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.293+0000 7f72cef5d640 1 -- 172.21.15.77:0/1805117719 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c8112870 con 0x7f72c80fd450 2024-04-25T02:06:38.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.294+0000 7f72cef5d640 1 -- 172.21.15.77:0/1805117719 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c804bcc0 con 0x7f72c80fd450 2024-04-25T02:06:38.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.295+0000 7f72c57fa640 1 -- 172.21.15.77:0/1805117719 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f72b402f070 con 0x7f72c80fd450 2024-04-25T02:06:38.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.295+0000 7f72c57fa640 1 --2- 172.21.15.77:0/1805117719 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f72b8069210 0x7f72b806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:38.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.295+0000 7f72c57fa640 1 -- 172.21.15.77:0/1805117719 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f72b40a96f0 con 0x7f72c80fd450 2024-04-25T02:06:38.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.295+0000 7f72cccf9640 1 --2- 172.21.15.77:0/1805117719 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f72b8069210 0x7f72b806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:38.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.295+0000 7f72cccf9640 1 --2- 172.21.15.77:0/1805117719 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f72b8069210 0x7f72b806b6c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f72c80f88d0 tx=0x7f72bc00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:38.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.303+0000 7f72c57fa640 1 -- 172.21.15.77:0/1805117719 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f72b4075950 con 0x7f72c80fd450 2024-04-25T02:06:38.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.478+0000 7f72cef5d640 1 -- 172.21.15.77:0/1805117719 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72c8112d60 con 0x7f72c80fd450 2024-04-25T02:06:38.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.479+0000 7f72c57fa640 1 -- 172.21.15.77:0/1805117719 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+14358 (secure 0 0 0) 0x7f72b4078f70 con 0x7f72c80fd450 2024-04-25T02:06:38.485 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:06:38.485 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":47,"fsid":"4bb93d82-02a7-11ef-bc93-c7b262605968","created":"2024-04-25T01:59:22.235413+0000","modified":"2024-04-25T02:06:24.840002+0000","last_up_change":"2024-04-25T02:04:52.742695+0000","last_in_change":"2024-04-25T02:04:33.912973+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:03:38.692032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-25T02:06:08.304706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-25T02:06:09.237302+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1533372f-b1a5-4ec0-9524-9940f870d874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3624813295},{"type":"v1","addr":"172.21.15.77:6803","nonce":3624813295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3624813295},{"type":"v1","addr":"172.21.15.77:6805","nonce":3624813295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3624813295},{"type":"v1","addr":"172.21.15.77:6809","nonce":3624813295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3624813295},{"type":"v1","addr":"172.21.15.77:6807","nonce":3624813295}]},"public_addr":"172.21.15.77:6803/3624813295","cluster_addr":"172.21.15.77:6805/3624813295","heartbeat_back_addr":"172.21.15.77:6809/3624813295","heartbeat_front_addr":"172.21.15.77:6807/3624813295","state":["exists","up"]},{"osd":1,"uuid":"cb083b21-fd25-4ac4-bbde-6387c3253d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3061147623},{"type":"v1","addr":"172.21.15.77:6811","nonce":3061147623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3061147623},{"type":"v1","addr":"172.21.15.77:6813","nonce":3061147623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3061147623},{"type":"v1","addr":"172.21.15.77:6817","nonce":3061147623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3061147623},{"type":"v1","addr":"172.21.15.77:6815","nonce":3061147623}]},"public_addr":"172.21.15.77:6811/3061147623","cluster_addr":"172.21.15.77:6813/3061147623","heartbeat_back_addr":"172.21.15.77:6817/3061147623","heartbeat_front_addr":"172.21.15.77:6815/3061147623","state":["exists","up"]},{"osd":2,"uuid":"39b4553c-c1ed-489b-aead-210f38ac86b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":625070655},{"type":"v1","addr":"172.21.15.77:6819","nonce":625070655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":625070655},{"type":"v1","addr":"172.21.15.77:6821","nonce":625070655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":625070655},{"type":"v1","addr":"172.21.15.77:6825","nonce":625070655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":625070655},{"type":"v1","addr":"172.21.15.77:6823","nonce":625070655}]},"public_addr":"172.21.15.77:6819/625070655","cluster_addr":"172.21.15.77:6821/625070655","heartbeat_back_addr":"172.21.15.77:6825/625070655","heartbeat_front_addr":"172.21.15.77:6823/625070655","state":["exists","up"]},{"osd":3,"uuid":"addec0fa-80ee-465d-9d3e-c801d7bd9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":36251324},{"type":"v1","addr":"172.21.15.112:6801","nonce":36251324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":36251324},{"type":"v1","addr":"172.21.15.112:6803","nonce":36251324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":36251324},{"type":"v1","addr":"172.21.15.112:6807","nonce":36251324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":36251324},{"type":"v1","addr":"172.21.15.112:6805","nonce":36251324}]},"public_addr":"172.21.15.112:6801/36251324","cluster_addr":"172.21.15.112:6803/36251324","heartbeat_back_addr":"172.21.15.112:6807/36251324","heartbeat_front_addr":"172.21.15.112:6805/36251324","state":["exists","up"]},{"osd":4,"uuid":"93465def-0617-4ba8-915a-b3ea85c8f6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":581823847},{"type":"v1","addr":"172.21.15.112:6809","nonce":581823847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":581823847},{"type":"v1","addr":"172.21.15.112:6811","nonce":581823847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":581823847},{"type":"v1","addr":"172.21.15.112:6815","nonce":581823847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":581823847},{"type":"v1","addr":"172.21.15.112:6813","nonce":581823847}]},"public_addr":"172.21.15.112:6809/581823847","cluster_addr":"172.21.15.112:6811/581823847","heartbeat_back_addr":"172.21.15.112:6815/581823847","heartbeat_front_addr":"172.21.15.112:6813/581823847","state":["exists","up"]},{"osd":5,"uuid":"d3f693f5-324b-4a48-8f24-77e65c5f7f7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":4063265473},{"type":"v1","addr":"172.21.15.112:6817","nonce":4063265473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":4063265473},{"type":"v1","addr":"172.21.15.112:6819","nonce":4063265473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":4063265473},{"type":"v1","addr":"172.21.15.112:6823","nonce":4063265473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":4063265473},{"type":"v1","addr":"172.21.15.112:6821","nonce":4063265473}]},"public_addr":"172.21.15.112:6817/4063265473","cluster_addr":"172.21.15.112:6819/4063265473","heartbeat_back_addr":"172.21.15.112:6823/4063265473","heartbeat_front_addr":"172.21.15.112:6821/4063265473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:42.635624+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:10.189211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:35.781710+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:59.250841+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:25.155356+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:51.315370+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:6827/4228767448":"2024-04-26T02:06:24.839959+0000","172.21.15.77:0/1743910051":"2024-04-26T01:59:54.491478+0000","172.21.15.77:0/265498985":"2024-04-26T01:59:54.491478+0000","172.21.15.77:6800/2375514340":"2024-04-26T02:01:30.377936+0000","172.21.15.77:0/1177720370":"2024-04-26T01:59:54.491478+0000","172.21.15.77:6800/839529497":"2024-04-26T01:59:54.491478+0000","172.21.15.77:0/2254838943":"2024-04-26T02:00:25.057598+0000","172.21.15.77:6801/839529497":"2024-04-26T01:59:54.491478+0000","172.21.15.77:6801/859750200":"2024-04-26T02:00:25.057598+0000","172.21.15.77:0/2265849210":"2024-04-26T02:00:25.057598+0000","172.21.15.77:6800/859750200":"2024-04-26T02:00:25.057598+0000","172.21.15.77:0/1779967375":"2024-04-26T02:00:25.057598+0000","172.21.15.77:6826/4228767448":"2024-04-26T02:06:24.839959+0000","172.21.15.77:0/543110241":"2024-04-26T02:01:30.377936+0000","172.21.15.77:0/2490024809":"2024-04-26T02:01:30.377936+0000","172.21.15.77:0/3184722826":"2024-04-26T02:01:30.377936+0000","172.21.15.77:6801/2375514340":"2024-04-26T02:01:30.377936+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:06:38.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.481+0000 7f72cef5d640 1 -- 172.21.15.77:0/1805117719 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f72b8069210 msgr2=0x7f72b806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:38.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.481+0000 7f72cef5d640 1 --2- 172.21.15.77:0/1805117719 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f72b8069210 0x7f72b806b6c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f72c80f88d0 tx=0x7f72bc00b040 comp rx=0 tx=0).stop 2024-04-25T02:06:38.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.481+0000 7f72cef5d640 1 -- 172.21.15.77:0/1805117719 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72c80fd450 msgr2=0x7f72c810d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:38.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.481+0000 7f72cef5d640 1 --2- 172.21.15.77:0/1805117719 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72c80fd450 0x7f72c810d250 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f72b4007dd0 tx=0x7f72b4009da0 comp rx=0 tx=0).stop 2024-04-25T02:06:38.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.481+0000 7f72cef5d640 1 -- 172.21.15.77:0/1805117719 shutdown_connections 2024-04-25T02:06:38.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.481+0000 7f72cef5d640 1 --2- 172.21.15.77:0/1805117719 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f72b8069210 0x7f72b806b6c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:38.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.481+0000 7f72cef5d640 1 --2- 172.21.15.77:0/1805117719 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72c80fd450 0x7f72c810d250 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:38.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.481+0000 7f72cef5d640 1 --2- 172.21.15.77:0/1805117719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72c80fc180 0x7f72c810cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:38.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.481+0000 7f72cef5d640 1 -- 172.21.15.77:0/1805117719 >> 172.21.15.77:0/1805117719 conn(0x7f72c80f7920 msgr2=0x7f72c80f93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:38.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.481+0000 7f72cef5d640 1 -- 172.21.15.77:0/1805117719 shutdown_connections 2024-04-25T02:06:38.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.481+0000 7f72cef5d640 1 -- 172.21.15.77:0/1805117719 wait complete. 2024-04-25T02:06:38.499 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:03:38.692032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-25T02:06:08.304706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-25T02:06:09.237302+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:06:38.499 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:06:38.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.589+0000 7f76ec6ae640 1 -- 172.21.15.77:0/1961003936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76e40ff370 msgr2=0x7f76e4101750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:38.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.589+0000 7f76ec6ae640 1 --2- 172.21.15.77:0/1961003936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76e40ff370 0x7f76e4101750 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f76d40048d0 tx=0x7f76d4009da0 comp rx=0 tx=0).stop 2024-04-25T02:06:38.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.589+0000 7f76ec6ae640 1 -- 172.21.15.77:0/1961003936 shutdown_connections 2024-04-25T02:06:38.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.589+0000 7f76ec6ae640 1 --2- 172.21.15.77:0/1961003936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76e40ff370 0x7f76e4101750 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:38.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.589+0000 7f76ec6ae640 1 --2- 172.21.15.77:0/1961003936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76e4064f50 0x7f76e40fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:38.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.589+0000 7f76ec6ae640 1 -- 172.21.15.77:0/1961003936 >> 172.21.15.77:0/1961003936 conn(0x7f76e40f6820 msgr2=0x7f76e40f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:38.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.589+0000 7f76ec6ae640 1 -- 172.21.15.77:0/1961003936 shutdown_connections 2024-04-25T02:06:38.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.590+0000 7f76ec6ae640 1 -- 172.21.15.77:0/1961003936 wait complete. 2024-04-25T02:06:38.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.590+0000 7f76ec6ae640 1 Processor -- start 2024-04-25T02:06:38.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.590+0000 7f76ec6ae640 1 -- start start 2024-04-25T02:06:38.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.590+0000 7f76ec6ae640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76e4064f50 0x7f76e410cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:38.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.590+0000 7f76ec6ae640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76e40ff370 0x7f76e410d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:38.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.590+0000 7f76ec6ae640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e410d890 con 0x7f76e40ff370 2024-04-25T02:06:38.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.590+0000 7f76ec6ae640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e4112250 con 0x7f76e4064f50 2024-04-25T02:06:38.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.590+0000 7f76e9c49640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76e40ff370 0x7f76e410d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:38.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.590+0000 7f76e9c49640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76e40ff370 0x7f76e410d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47466/0 (socket says 172.21.15.77:47466) 2024-04-25T02:06:38.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.590+0000 7f76e9c49640 1 -- 172.21.15.77:0/1331852934 learned_addr learned my addr 172.21.15.77:0/1331852934 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:06:38.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.590+0000 7f76ea44a640 1 --2- 172.21.15.77:0/1331852934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76e4064f50 0x7f76e410cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:38.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.590+0000 7f76e9c49640 1 -- 172.21.15.77:0/1331852934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76e4064f50 msgr2=0x7f76e410cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:38.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.590+0000 7f76e9c49640 1 --2- 172.21.15.77:0/1331852934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76e4064f50 0x7f76e410cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:38.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.590+0000 7f76e9c49640 1 -- 172.21.15.77:0/1331852934 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d4005040 con 0x7f76e40ff370 2024-04-25T02:06:38.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.591+0000 7f76e9c49640 1 --2- 172.21.15.77:0/1331852934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76e40ff370 0x7f76e410d240 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f76d4007da0 tx=0x7f76d4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:38.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.591+0000 7f76daffd640 1 -- 172.21.15.77:0/1331852934 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76d40094c0 con 0x7f76e40ff370 2024-04-25T02:06:38.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.591+0000 7f76daffd640 1 -- 172.21.15.77:0/1331852934 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f76d4009620 con 0x7f76e40ff370 2024-04-25T02:06:38.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.591+0000 7f76ec6ae640 1 -- 172.21.15.77:0/1331852934 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e4112390 con 0x7f76e40ff370 2024-04-25T02:06:38.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.591+0000 7f76daffd640 1 -- 172.21.15.77:0/1331852934 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76d403b620 con 0x7f76e40ff370 2024-04-25T02:06:38.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.591+0000 7f76ec6ae640 1 -- 172.21.15.77:0/1331852934 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e4112860 con 0x7f76e40ff370 2024-04-25T02:06:38.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.592+0000 7f76ec6ae640 1 -- 172.21.15.77:0/1331852934 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e404bcc0 con 0x7f76e40ff370 2024-04-25T02:06:38.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.592+0000 7f76daffd640 1 -- 172.21.15.77:0/1331852934 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f76d402f070 con 0x7f76e40ff370 2024-04-25T02:06:38.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.592+0000 7f76daffd640 1 --2- 172.21.15.77:0/1331852934 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f76d0069210 0x7f76d006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:38.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.593+0000 7f76ea44a640 1 --2- 172.21.15.77:0/1331852934 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f76d0069210 0x7f76d006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:38.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.593+0000 7f76daffd640 1 -- 172.21.15.77:0/1331852934 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f76d40a9800 con 0x7f76e40ff370 2024-04-25T02:06:38.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.593+0000 7f76ea44a640 1 --2- 172.21.15.77:0/1331852934 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f76d0069210 0x7f76d006b6c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f76e0009fd0 tx=0x7f76e0009e50 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:38.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.597+0000 7f76daffd640 1 -- 172.21.15.77:0/1331852934 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f76d4075a60 con 0x7f76e40ff370 2024-04-25T02:06:38.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.762+0000 7f76ec6ae640 1 -- 172.21.15.77:0/1331852934 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f76e41129f0 con 0x7f76e40ff370 2024-04-25T02:06:38.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.762+0000 7f76daffd640 1 -- 172.21.15.77:0/1331852934 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f76d4079080 con 0x7f76e40ff370 2024-04-25T02:06:38.769 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-25T02:06:38.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.764+0000 7f76ec6ae640 1 -- 172.21.15.77:0/1331852934 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f76d0069210 msgr2=0x7f76d006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:38.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.764+0000 7f76ec6ae640 1 --2- 172.21.15.77:0/1331852934 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f76d0069210 0x7f76d006b6c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f76e0009fd0 tx=0x7f76e0009e50 comp rx=0 tx=0).stop 2024-04-25T02:06:38.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.764+0000 7f76ec6ae640 1 -- 172.21.15.77:0/1331852934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76e40ff370 msgr2=0x7f76e410d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:38.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.764+0000 7f76ec6ae640 1 --2- 172.21.15.77:0/1331852934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76e40ff370 0x7f76e410d240 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f76d4007da0 tx=0x7f76d4009da0 comp rx=0 tx=0).stop 2024-04-25T02:06:38.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.764+0000 7f76ec6ae640 1 -- 172.21.15.77:0/1331852934 shutdown_connections 2024-04-25T02:06:38.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.764+0000 7f76ec6ae640 1 --2- 172.21.15.77:0/1331852934 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f76d0069210 0x7f76d006b6c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:38.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.764+0000 7f76ec6ae640 1 --2- 172.21.15.77:0/1331852934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76e40ff370 0x7f76e410d240 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:38.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.764+0000 7f76ec6ae640 1 --2- 172.21.15.77:0/1331852934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76e4064f50 0x7f76e410cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:38.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.764+0000 7f76ec6ae640 1 -- 172.21.15.77:0/1331852934 >> 172.21.15.77:0/1331852934 conn(0x7f76e40f6820 msgr2=0x7f76e40f6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:38.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.764+0000 7f76ec6ae640 1 -- 172.21.15.77:0/1331852934 shutdown_connections 2024-04-25T02:06:38.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.764+0000 7f76ec6ae640 1 -- 172.21.15.77:0/1331852934 wait complete. 2024-04-25T02:06:38.781 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-25T02:06:38.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.871+0000 7f1d4ecae640 1 -- 172.21.15.77:0/4289772656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d480fc330 msgr2=0x7f1d480fc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:38.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.871+0000 7f1d4ecae640 1 --2- 172.21.15.77:0/4289772656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d480fc330 0x7f1d480fc7a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1d340048d0 tx=0x7f1d34009da0 comp rx=0 tx=0).stop 2024-04-25T02:06:38.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.871+0000 7f1d4ecae640 1 -- 172.21.15.77:0/4289772656 shutdown_connections 2024-04-25T02:06:38.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.871+0000 7f1d4ecae640 1 --2- 172.21.15.77:0/4289772656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d480fc330 0x7f1d480fc7a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:38.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.871+0000 7f1d4ecae640 1 --2- 172.21.15.77:0/4289772656 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d480fb060 0x7f1d480fb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:38.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.871+0000 7f1d4ecae640 1 -- 172.21.15.77:0/4289772656 >> 172.21.15.77:0/4289772656 conn(0x7f1d480f6820 msgr2=0x7f1d480f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:38.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.871+0000 7f1d4ecae640 1 -- 172.21.15.77:0/4289772656 shutdown_connections 2024-04-25T02:06:38.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.871+0000 7f1d4ecae640 1 -- 172.21.15.77:0/4289772656 wait complete. 2024-04-25T02:06:38.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.872+0000 7f1d4ecae640 1 Processor -- start 2024-04-25T02:06:38.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.872+0000 7f1d4ecae640 1 -- start start 2024-04-25T02:06:38.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.872+0000 7f1d4ecae640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d480fb060 0x7f1d4810bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:38.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.872+0000 7f1d4ecae640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d480fc330 0x7f1d4810c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:38.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.872+0000 7f1d4ecae640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4810c720 con 0x7f1d480fb060 2024-04-25T02:06:38.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.872+0000 7f1d4ecae640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d48111120 con 0x7f1d480fc330 2024-04-25T02:06:38.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.872+0000 7f1d4ca4a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d480fb060 0x7f1d4810bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:38.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.872+0000 7f1d4ca4a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d480fb060 0x7f1d4810bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47482/0 (socket says 172.21.15.77:47482) 2024-04-25T02:06:38.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.872+0000 7f1d4ca4a640 1 -- 172.21.15.77:0/1842330849 learned_addr learned my addr 172.21.15.77:0/1842330849 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:06:38.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.872+0000 7f1d47fff640 1 --2- 172.21.15.77:0/1842330849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d480fc330 0x7f1d4810c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:38.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.873+0000 7f1d4ca4a640 1 -- 172.21.15.77:0/1842330849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d480fc330 msgr2=0x7f1d4810c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:38.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.873+0000 7f1d4ca4a640 1 --2- 172.21.15.77:0/1842330849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d480fc330 0x7f1d4810c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:38.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.873+0000 7f1d4ca4a640 1 -- 172.21.15.77:0/1842330849 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d34005040 con 0x7f1d480fb060 2024-04-25T02:06:38.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.873+0000 7f1d47fff640 1 --2- 172.21.15.77:0/1842330849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d480fc330 0x7f1d4810c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:06:38.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.873+0000 7f1d4ca4a640 1 --2- 172.21.15.77:0/1842330849 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d480fb060 0x7f1d4810bb90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c00c830 tx=0x7f1d3c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:38.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.873+0000 7f1d457fa640 1 -- 172.21.15.77:0/1842330849 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d3c00a850 con 0x7f1d480fb060 2024-04-25T02:06:38.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.873+0000 7f1d457fa640 1 -- 172.21.15.77:0/1842330849 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1d3c00ae80 con 0x7f1d480fb060 2024-04-25T02:06:38.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.873+0000 7f1d4ecae640 1 -- 172.21.15.77:0/1842330849 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d481112c0 con 0x7f1d480fb060 2024-04-25T02:06:38.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.873+0000 7f1d457fa640 1 -- 172.21.15.77:0/1842330849 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d3c012ea0 con 0x7f1d480fb060 2024-04-25T02:06:38.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.873+0000 7f1d4ecae640 1 -- 172.21.15.77:0/1842330849 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d481117b0 con 0x7f1d480fb060 2024-04-25T02:06:38.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.874+0000 7f1d4ecae640 1 -- 172.21.15.77:0/1842330849 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4804bcc0 con 0x7f1d480fb060 2024-04-25T02:06:38.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.874+0000 7f1d457fa640 1 -- 172.21.15.77:0/1842330849 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f1d3c012400 con 0x7f1d480fb060 2024-04-25T02:06:38.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.875+0000 7f1d457fa640 1 --2- 172.21.15.77:0/1842330849 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f1d38069210 0x7f1d3806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:38.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.875+0000 7f1d457fa640 1 -- 172.21.15.77:0/1842330849 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1d3c087460 con 0x7f1d480fb060 2024-04-25T02:06:38.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.875+0000 7f1d47fff640 1 --2- 172.21.15.77:0/1842330849 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f1d38069210 0x7f1d3806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:38.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.875+0000 7f1d47fff640 1 --2- 172.21.15.77:0/1842330849 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f1d38069210 0x7f1d3806b6c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1d4810d090 tx=0x7f1d34009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:38.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:38.879+0000 7f1d457fa640 1 -- 172.21.15.77:0/1842330849 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1d3c053740 con 0x7f1d480fb060 2024-04-25T02:06:39.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.043+0000 7f1d4ecae640 1 -- 172.21.15.77:0/1842330849 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f1d48111a30 con 0x7f1d480fb060 2024-04-25T02:06:39.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.044+0000 7f1d457fa640 1 -- 172.21.15.77:0/1842330849 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v47) v1 ==== 107+0+11 (secure 0 0 0) 0x7f1d3c0126b0 con 0x7f1d480fb060 2024-04-25T02:06:39.050 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T02:06:39.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.046+0000 7f1d4ecae640 1 -- 172.21.15.77:0/1842330849 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f1d38069210 msgr2=0x7f1d3806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.046+0000 7f1d4ecae640 1 --2- 172.21.15.77:0/1842330849 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f1d38069210 0x7f1d3806b6c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1d4810d090 tx=0x7f1d34009da0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.046+0000 7f1d4ecae640 1 -- 172.21.15.77:0/1842330849 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d480fb060 msgr2=0x7f1d4810bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.046+0000 7f1d4ecae640 1 --2- 172.21.15.77:0/1842330849 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d480fb060 0x7f1d4810bb90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c00c830 tx=0x7f1d3c004430 comp rx=0 tx=0).stop 2024-04-25T02:06:39.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.046+0000 7f1d4ecae640 1 -- 172.21.15.77:0/1842330849 shutdown_connections 2024-04-25T02:06:39.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.046+0000 7f1d4ecae640 1 --2- 172.21.15.77:0/1842330849 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f1d38069210 0x7f1d3806b6c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.046+0000 7f1d4ecae640 1 --2- 172.21.15.77:0/1842330849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d480fc330 0x7f1d4810c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.046+0000 7f1d4ecae640 1 --2- 172.21.15.77:0/1842330849 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d480fb060 0x7f1d4810bb90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.046+0000 7f1d4ecae640 1 -- 172.21.15.77:0/1842330849 >> 172.21.15.77:0/1842330849 conn(0x7f1d480f6820 msgr2=0x7f1d480f7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:39.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.046+0000 7f1d4ecae640 1 -- 172.21.15.77:0/1842330849 shutdown_connections 2024-04-25T02:06:39.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.046+0000 7f1d4ecae640 1 -- 172.21.15.77:0/1842330849 wait complete. 2024-04-25T02:06:39.063 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-25T02:06:39.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.153+0000 7f10cea6e640 1 -- 172.21.15.77:0/3097390487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10c80fd430 msgr2=0x7f10c80fd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.153+0000 7f10cea6e640 1 --2- 172.21.15.77:0/3097390487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10c80fd430 0x7f10c80fd8a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f10b00048d0 tx=0x7f10b0009da0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.153+0000 7f10cea6e640 1 -- 172.21.15.77:0/3097390487 shutdown_connections 2024-04-25T02:06:39.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.153+0000 7f10cea6e640 1 --2- 172.21.15.77:0/3097390487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10c80fd430 0x7f10c80fd8a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.153+0000 7f10cea6e640 1 --2- 172.21.15.77:0/3097390487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c80fc200 0x7f10c80fc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.153+0000 7f10cea6e640 1 -- 172.21.15.77:0/3097390487 >> 172.21.15.77:0/3097390487 conn(0x7f10c80f7900 msgr2=0x7f10c80f9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:39.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.153+0000 7f10cea6e640 1 -- 172.21.15.77:0/3097390487 shutdown_connections 2024-04-25T02:06:39.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.153+0000 7f10cea6e640 1 -- 172.21.15.77:0/3097390487 wait complete. 2024-04-25T02:06:39.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.154+0000 7f10cea6e640 1 Processor -- start 2024-04-25T02:06:39.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.154+0000 7f10cea6e640 1 -- start start 2024-04-25T02:06:39.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.154+0000 7f10cea6e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10c80fc200 0x7f10c810ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:39.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.154+0000 7f10cea6e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c80fd430 0x7f10c810d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:39.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.154+0000 7f10cea6e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c810d860 con 0x7f10c80fc200 2024-04-25T02:06:39.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.154+0000 7f10cea6e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c81121b0 con 0x7f10c80fd430 2024-04-25T02:06:39.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.154+0000 7f10cc80a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10c80fc200 0x7f10c810ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:39.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.154+0000 7f10cc80a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10c80fc200 0x7f10c810ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47496/0 (socket says 172.21.15.77:47496) 2024-04-25T02:06:39.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.154+0000 7f10cc80a640 1 -- 172.21.15.77:0/772737518 learned_addr learned my addr 172.21.15.77:0/772737518 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:06:39.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.154+0000 7f10c7fff640 1 --2- 172.21.15.77:0/772737518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c80fd430 0x7f10c810d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:39.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.155+0000 7f10cc80a640 1 -- 172.21.15.77:0/772737518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c80fd430 msgr2=0x7f10c810d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.155+0000 7f10cc80a640 1 --2- 172.21.15.77:0/772737518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c80fd430 0x7f10c810d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.155+0000 7f10cc80a640 1 -- 172.21.15.77:0/772737518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b0005040 con 0x7f10c80fc200 2024-04-25T02:06:39.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.155+0000 7f10c7fff640 1 --2- 172.21.15.77:0/772737518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c80fd430 0x7f10c810d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:06:39.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.155+0000 7f10cc80a640 1 --2- 172.21.15.77:0/772737518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10c80fc200 0x7f10c810ccd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f10b8002840 tx=0x7f10b8004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:39.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.155+0000 7f10c57fa640 1 -- 172.21.15.77:0/772737518 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10b8007c30 con 0x7f10c80fc200 2024-04-25T02:06:39.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.155+0000 7f10c57fa640 1 -- 172.21.15.77:0/772737518 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f10b800f040 con 0x7f10c80fc200 2024-04-25T02:06:39.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.155+0000 7f10c57fa640 1 -- 172.21.15.77:0/772737518 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10b8009570 con 0x7f10c80fc200 2024-04-25T02:06:39.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.155+0000 7f10cea6e640 1 -- 172.21.15.77:0/772737518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c8112350 con 0x7f10c80fc200 2024-04-25T02:06:39.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.155+0000 7f10cea6e640 1 -- 172.21.15.77:0/772737518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c8112820 con 0x7f10c80fc200 2024-04-25T02:06:39.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.156+0000 7f10cea6e640 1 -- 172.21.15.77:0/772737518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c804bcc0 con 0x7f10c80fc200 2024-04-25T02:06:39.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.156+0000 7f10c57fa640 1 -- 172.21.15.77:0/772737518 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f10b800dc80 con 0x7f10c80fc200 2024-04-25T02:06:39.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.157+0000 7f10c57fa640 1 --2- 172.21.15.77:0/772737518 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f10b4069210 0x7f10b406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:39.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.157+0000 7f10c57fa640 1 -- 172.21.15.77:0/772737518 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f10b8087110 con 0x7f10c80fc200 2024-04-25T02:06:39.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.157+0000 7f10c7fff640 1 --2- 172.21.15.77:0/772737518 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f10b4069210 0x7f10b406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:39.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.157+0000 7f10c7fff640 1 --2- 172.21.15.77:0/772737518 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f10b4069210 0x7f10b406b6c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f10b0003080 tx=0x7f10b0009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:39.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.161+0000 7f10c57fa640 1 -- 172.21.15.77:0/772737518 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f10b80533f0 con 0x7f10c80fc200 2024-04-25T02:06:39.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.327+0000 7f10cea6e640 1 -- 172.21.15.77:0/772737518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f10c8112a90 con 0x7f10c80fc200 2024-04-25T02:06:39.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.327+0000 7f10c57fa640 1 -- 172.21.15.77:0/772737518 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v47) v1 ==== 107+0+11 (secure 0 0 0) 0x7f10b8056a10 con 0x7f10c80fc200 2024-04-25T02:06:39.334 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T02:06:39.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.329+0000 7f10cea6e640 1 -- 172.21.15.77:0/772737518 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f10b4069210 msgr2=0x7f10b406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.329+0000 7f10cea6e640 1 --2- 172.21.15.77:0/772737518 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f10b4069210 0x7f10b406b6c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f10b0003080 tx=0x7f10b0009da0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.329+0000 7f10cea6e640 1 -- 172.21.15.77:0/772737518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10c80fc200 msgr2=0x7f10c810ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.329+0000 7f10cea6e640 1 --2- 172.21.15.77:0/772737518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10c80fc200 0x7f10c810ccd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f10b8002840 tx=0x7f10b8004570 comp rx=0 tx=0).stop 2024-04-25T02:06:39.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.329+0000 7f10cea6e640 1 -- 172.21.15.77:0/772737518 shutdown_connections 2024-04-25T02:06:39.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.329+0000 7f10cea6e640 1 --2- 172.21.15.77:0/772737518 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f10b4069210 0x7f10b406b6c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.329+0000 7f10cea6e640 1 --2- 172.21.15.77:0/772737518 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10c80fd430 0x7f10c810d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.329+0000 7f10cea6e640 1 --2- 172.21.15.77:0/772737518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10c80fc200 0x7f10c810ccd0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.329+0000 7f10cea6e640 1 -- 172.21.15.77:0/772737518 >> 172.21.15.77:0/772737518 conn(0x7f10c80f7900 msgr2=0x7f10c80f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:39.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.329+0000 7f10cea6e640 1 -- 172.21.15.77:0/772737518 shutdown_connections 2024-04-25T02:06:39.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.329+0000 7f10cea6e640 1 -- 172.21.15.77:0/772737518 wait complete. 2024-04-25T02:06:39.346 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:06:39.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.436+0000 7fb3f1b5d640 1 -- 172.21.15.77:0/3746844204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3ec0fd7c0 msgr2=0x7fb3ec0fdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.436+0000 7fb3f1b5d640 1 --2- 172.21.15.77:0/3746844204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3ec0fd7c0 0x7fb3ec0fdbd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0048d0 tx=0x7fb3dc009da0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.436+0000 7fb3f1b5d640 1 -- 172.21.15.77:0/3746844204 shutdown_connections 2024-04-25T02:06:39.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.436+0000 7fb3f1b5d640 1 --2- 172.21.15.77:0/3746844204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3ec0fe110 0x7fb3ec0fa270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.436+0000 7fb3f1b5d640 1 --2- 172.21.15.77:0/3746844204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3ec0fd7c0 0x7fb3ec0fdbd0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.436+0000 7fb3f1b5d640 1 -- 172.21.15.77:0/3746844204 >> 172.21.15.77:0/3746844204 conn(0x7fb3ec0f5fc0 msgr2=0x7fb3ec0f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:39.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.436+0000 7fb3f1b5d640 1 -- 172.21.15.77:0/3746844204 shutdown_connections 2024-04-25T02:06:39.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.436+0000 7fb3f1b5d640 1 -- 172.21.15.77:0/3746844204 wait complete. 2024-04-25T02:06:39.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.436+0000 7fb3f1b5d640 1 Processor -- start 2024-04-25T02:06:39.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.436+0000 7fb3f1b5d640 1 -- start start 2024-04-25T02:06:39.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.436+0000 7fb3f1b5d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3ec0fd7c0 0x7fb3ec10cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:39.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.436+0000 7fb3f1b5d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3ec0fe110 0x7fb3ec10d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:39.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.436+0000 7fb3f1b5d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec10d860 con 0x7fb3ec0fd7c0 2024-04-25T02:06:39.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.436+0000 7fb3f1b5d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec112220 con 0x7fb3ec0fe110 2024-04-25T02:06:39.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.436+0000 7fb3eb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3ec0fd7c0 0x7fb3ec10cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:39.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.436+0000 7fb3eb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3ec0fd7c0 0x7fb3ec10cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47506/0 (socket says 172.21.15.77:47506) 2024-04-25T02:06:39.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.436+0000 7fb3eb7fe640 1 -- 172.21.15.77:0/3530319182 learned_addr learned my addr 172.21.15.77:0/3530319182 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:06:39.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.436+0000 7fb3e3fff640 1 --2- 172.21.15.77:0/3530319182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3ec0fe110 0x7fb3ec10d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:39.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.437+0000 7fb3eb7fe640 1 -- 172.21.15.77:0/3530319182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3ec0fe110 msgr2=0x7fb3ec10d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.437+0000 7fb3eb7fe640 1 --2- 172.21.15.77:0/3530319182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3ec0fe110 0x7fb3ec10d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.437+0000 7fb3eb7fe640 1 -- 172.21.15.77:0/3530319182 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc005040 con 0x7fb3ec0fd7c0 2024-04-25T02:06:39.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.437+0000 7fb3eb7fe640 1 --2- 172.21.15.77:0/3530319182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3ec0fd7c0 0x7fb3ec10cca0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc007dd0 tx=0x7fb3dc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:39.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.437+0000 7fb3e8ff9640 1 -- 172.21.15.77:0/3530319182 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3dc0094c0 con 0x7fb3ec0fd7c0 2024-04-25T02:06:39.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.437+0000 7fb3e8ff9640 1 -- 172.21.15.77:0/3530319182 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb3dc009620 con 0x7fb3ec0fd7c0 2024-04-25T02:06:39.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.437+0000 7fb3f1b5d640 1 -- 172.21.15.77:0/3530319182 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3ec112360 con 0x7fb3ec0fd7c0 2024-04-25T02:06:39.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.437+0000 7fb3e8ff9640 1 -- 172.21.15.77:0/3530319182 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3dc03b640 con 0x7fb3ec0fd7c0 2024-04-25T02:06:39.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.437+0000 7fb3f1b5d640 1 -- 172.21.15.77:0/3530319182 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3ec112850 con 0x7fb3ec0fd7c0 2024-04-25T02:06:39.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.438+0000 7fb3f1b5d640 1 -- 172.21.15.77:0/3530319182 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3ec04bcc0 con 0x7fb3ec0fd7c0 2024-04-25T02:06:39.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.438+0000 7fb3e8ff9640 1 -- 172.21.15.77:0/3530319182 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fb3dc02f070 con 0x7fb3ec0fd7c0 2024-04-25T02:06:39.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.439+0000 7fb3e8ff9640 1 --2- 172.21.15.77:0/3530319182 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fb3d8069210 0x7fb3d806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:39.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.439+0000 7fb3e3fff640 1 --2- 172.21.15.77:0/3530319182 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fb3d8069210 0x7fb3d806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:39.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.439+0000 7fb3e8ff9640 1 -- 172.21.15.77:0/3530319182 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb3dc0a96c0 con 0x7fb3ec0fd7c0 2024-04-25T02:06:39.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.439+0000 7fb3e3fff640 1 --2- 172.21.15.77:0/3530319182 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fb3d8069210 0x7fb3d806b6c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec10e190 tx=0x7fb3d400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:39.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.443+0000 7fb3e8ff9640 1 -- 172.21.15.77:0/3530319182 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb3dc075920 con 0x7fb3ec0fd7c0 2024-04-25T02:06:39.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.643+0000 7fb3f1b5d640 1 -- 172.21.15.77:0/3530319182 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3ec104d00 con 0x7fb3ec0fd7c0 2024-04-25T02:06:39.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.644+0000 7fb3e8ff9640 1 -- 172.21.15.77:0/3530319182 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4685 (secure 0 0 0) 0x7fb3dc078f40 con 0x7fb3ec0fd7c0 2024-04-25T02:06:39.650 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:06:39.651 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14462,"name":"cephfs.smithi077.gcfygj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.77:6829/691698671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":691698671},{"type":"v1","addr":"172.21.15.77:6829","nonce":691698671}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":14474,"name":"cephfs.smithi077.oadrkb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6827/26222645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":26222645},{"type":"v1","addr":"172.21.15.77:6827","nonce":26222645}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24269,"name":"cephfs.smithi112.fjnadi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.112:6827/2036319817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2036319817},{"type":"v1","addr":"172.21.15.112:6827","nonce":2036319817}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:06:10.008979+0000","modified":"2024-04-25T02:06:27.849984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24257":{"gid":24257,"name":"cephfs.smithi112.dvwudt","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6825/3687767796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":3687767796},{"type":"v1","addr":"172.21.15.112:6825","nonce":3687767796}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-04-25T02:06:39.651 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 15 2024-04-25T02:06:39.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.646+0000 7fb3f1b5d640 1 -- 172.21.15.77:0/3530319182 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fb3d8069210 msgr2=0x7fb3d806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.646+0000 7fb3f1b5d640 1 --2- 172.21.15.77:0/3530319182 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fb3d8069210 0x7fb3d806b6c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec10e190 tx=0x7fb3d400b040 comp rx=0 tx=0).stop 2024-04-25T02:06:39.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.646+0000 7fb3f1b5d640 1 -- 172.21.15.77:0/3530319182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3ec0fd7c0 msgr2=0x7fb3ec10cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.646+0000 7fb3f1b5d640 1 --2- 172.21.15.77:0/3530319182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3ec0fd7c0 0x7fb3ec10cca0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc007dd0 tx=0x7fb3dc009da0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.646+0000 7fb3f1b5d640 1 -- 172.21.15.77:0/3530319182 shutdown_connections 2024-04-25T02:06:39.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.646+0000 7fb3f1b5d640 1 --2- 172.21.15.77:0/3530319182 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fb3d8069210 0x7fb3d806b6c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.646+0000 7fb3f1b5d640 1 --2- 172.21.15.77:0/3530319182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3ec0fe110 0x7fb3ec10d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.646+0000 7fb3f1b5d640 1 --2- 172.21.15.77:0/3530319182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3ec0fd7c0 0x7fb3ec10cca0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.646+0000 7fb3f1b5d640 1 -- 172.21.15.77:0/3530319182 >> 172.21.15.77:0/3530319182 conn(0x7fb3ec0f5fc0 msgr2=0x7fb3ec0f7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:39.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.646+0000 7fb3f1b5d640 1 -- 172.21.15.77:0/3530319182 shutdown_connections 2024-04-25T02:06:39.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:39.646+0000 7fb3f1b5d640 1 -- 172.21.15.77:0/3530319182 wait complete. 2024-04-25T02:06:39.662 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:39 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:39.662 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:39 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:39.662 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:39 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:39.662 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:39 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:06:39.662 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:39 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:39.662 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:39 smithi077 ceph-mon[26330]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-25T02:06:39.662 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:39 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/1805117719' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:06:39.662 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:39 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/1331852934' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:06:39.662 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:39 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/1842330849' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-25T02:06:39.662 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:39 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/772737518' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-25T02:06:39.663 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 1, 'flags': 18} 2024-04-25T02:06:39.663 INFO:teuthology.run_tasks:Running task kclient... 2024-04-25T02:06:39.691 INFO:tasks.kclient:Mounting kernel clients... 2024-04-25T02:06:39.692 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-04-25T02:06:39.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:39.692 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-04-25T02:06:39.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:39.707 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link delete ceph-brx 2024-04-25T02:06:39.773 INFO:teuthology.orchestra.run.smithi077.stderr:Cannot find device "ceph-brx" 2024-04-25T02:06:39.774 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:06:39.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:39.775 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-04-25T02:06:39.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:39 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:39.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:39 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:39.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:39 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:39.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:39 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:06:39.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:39 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:06:39.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:39 smithi112 ceph-mon[33313]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-25T02:06:39.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:39 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/1805117719' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:06:39.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:39 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/1331852934' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:06:39.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:39 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/1842330849' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-25T02:06:39.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:39 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/772737518' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-25T02:06:39.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:39.794 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2024-04-25T02:06:39.867 INFO:teuthology.orchestra.run.smithi112.stderr:Cannot find device "ceph-brx" 2024-04-25T02:06:39.869 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:06:39.869 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-04-25T02:06:39.869 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T02:06:39.869 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:06:39.869 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-25T02:06:40.117 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:06:40.533 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:40 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/3530319182' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:40.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:40 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/3530319182' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:41.443 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:41 smithi077 ceph-mon[26330]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-25T02:06:41.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.640+0000 7f9bc4682700 1 -- 172.21.15.77:0/3709316597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bbc103790 msgr2=0x7f9bbc0fce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:41.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.640+0000 7f9bc4682700 1 --2- 172.21.15.77:0/3709316597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bbc103790 0x7f9bbc0fce00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9bac004940 tx=0x7f9bac009e30 comp rx=0 tx=0).stop 2024-04-25T02:06:41.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.640+0000 7f9bc4682700 1 -- 172.21.15.77:0/3709316597 shutdown_connections 2024-04-25T02:06:41.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.640+0000 7f9bc4682700 1 --2- 172.21.15.77:0/3709316597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bbc103790 0x7f9bbc0fce00 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:41.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.640+0000 7f9bc4682700 1 --2- 172.21.15.77:0/3709316597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bbc102df0 0x7f9bbc1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:41.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.640+0000 7f9bc4682700 1 -- 172.21.15.77:0/3709316597 >> 172.21.15.77:0/3709316597 conn(0x7f9bbc0f8980 msgr2=0x7f9bbc0fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:41.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.640+0000 7f9bc4682700 1 -- 172.21.15.77:0/3709316597 shutdown_connections 2024-04-25T02:06:41.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.640+0000 7f9bc4682700 1 -- 172.21.15.77:0/3709316597 wait complete. 2024-04-25T02:06:41.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.641+0000 7f9bc4682700 1 Processor -- start 2024-04-25T02:06:41.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.641+0000 7f9bc4682700 1 -- start start 2024-04-25T02:06:41.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.641+0000 7f9bc4682700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bbc102df0 0x7f9bbc113b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:41.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.641+0000 7f9bc4682700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bbc103790 0x7f9bbc1140b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:41.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.641+0000 7f9bc4682700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc114700 con 0x7f9bbc103790 2024-04-25T02:06:41.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.641+0000 7f9bc4682700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc10daf0 con 0x7f9bbc102df0 2024-04-25T02:06:41.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.641+0000 7f9bc1c1d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bbc103790 0x7f9bbc1140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:41.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.641+0000 7f9bc1c1d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bbc103790 0x7f9bbc1140b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47516/0 (socket says 172.21.15.77:47516) 2024-04-25T02:06:41.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.641+0000 7f9bc1c1d700 1 -- 172.21.15.77:0/809919023 learned_addr learned my addr 172.21.15.77:0/809919023 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:06:41.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.641+0000 7f9bc1c1d700 1 -- 172.21.15.77:0/809919023 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bbc102df0 msgr2=0x7f9bbc113b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:41.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.641+0000 7f9bc1c1d700 1 --2- 172.21.15.77:0/809919023 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bbc102df0 0x7f9bbc113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:41.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.641+0000 7f9bc1c1d700 1 -- 172.21.15.77:0/809919023 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bac005040 con 0x7f9bbc103790 2024-04-25T02:06:41.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.641+0000 7f9bc1c1d700 1 --2- 172.21.15.77:0/809919023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bbc103790 0x7f9bbc1140b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9bac009100 tx=0x7f9bac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:41.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.641+0000 7f9bb2ffd700 1 -- 172.21.15.77:0/809919023 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bac00e040 con 0x7f9bbc103790 2024-04-25T02:06:41.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.641+0000 7f9bc4682700 1 -- 172.21.15.77:0/809919023 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bbc10dd70 con 0x7f9bbc103790 2024-04-25T02:06:41.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.641+0000 7f9bb2ffd700 1 -- 172.21.15.77:0/809919023 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9bac013420 con 0x7f9bbc103790 2024-04-25T02:06:41.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.641+0000 7f9bb2ffd700 1 -- 172.21.15.77:0/809919023 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bac01c610 con 0x7f9bbc103790 2024-04-25T02:06:41.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.642+0000 7f9bc4682700 1 -- 172.21.15.77:0/809919023 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bbc10e330 con 0x7f9bbc103790 2024-04-25T02:06:41.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.642+0000 7f9bc4682700 1 -- 172.21.15.77:0/809919023 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bbc0fe540 con 0x7f9bbc103790 2024-04-25T02:06:41.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.643+0000 7f9bb2ffd700 1 -- 172.21.15.77:0/809919023 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f9bac013590 con 0x7f9bbc103790 2024-04-25T02:06:41.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.643+0000 7f9bb2ffd700 1 --2- 172.21.15.77:0/809919023 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f9ba80692a0 0x7f9ba806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:41.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.643+0000 7f9bb2ffd700 1 -- 172.21.15.77:0/809919023 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9bac088470 con 0x7f9bbc103790 2024-04-25T02:06:41.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.643+0000 7f9bc241e700 1 --2- 172.21.15.77:0/809919023 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f9ba80692a0 0x7f9ba806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:41.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.644+0000 7f9bc241e700 1 --2- 172.21.15.77:0/809919023 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f9ba80692a0 0x7f9ba806b750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4007fd0 tx=0x7f9bb4007b20 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:41.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.648+0000 7f9bb2ffd700 1 -- 172.21.15.77:0/809919023 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9bac0581e0 con 0x7f9bbc103790 2024-04-25T02:06:41.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:41 smithi112 ceph-mon[33313]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-25T02:06:41.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.877+0000 7f9bc4682700 1 -- 172.21.15.77:0/809919023 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9bbc109ed0 con 0x7f9bbc103790 2024-04-25T02:06:41.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.878+0000 7f9bb2ffd700 1 -- 172.21.15.77:0/809919023 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7f9bac057d70 con 0x7f9bbc103790 2024-04-25T02:06:41.885 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-04-25T02:06:41.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.880+0000 7f9bc4682700 1 -- 172.21.15.77:0/809919023 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f9ba80692a0 msgr2=0x7f9ba806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:41.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.880+0000 7f9bc4682700 1 --2- 172.21.15.77:0/809919023 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f9ba80692a0 0x7f9ba806b750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4007fd0 tx=0x7f9bb4007b20 comp rx=0 tx=0).stop 2024-04-25T02:06:41.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.880+0000 7f9bc4682700 1 -- 172.21.15.77:0/809919023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bbc103790 msgr2=0x7f9bbc1140b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:41.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.880+0000 7f9bc4682700 1 --2- 172.21.15.77:0/809919023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bbc103790 0x7f9bbc1140b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9bac009100 tx=0x7f9bac009e30 comp rx=0 tx=0).stop 2024-04-25T02:06:41.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.880+0000 7f9bc4682700 1 -- 172.21.15.77:0/809919023 shutdown_connections 2024-04-25T02:06:41.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.880+0000 7f9bc4682700 1 --2- 172.21.15.77:0/809919023 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f9ba80692a0 0x7f9ba806b750 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:41.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.880+0000 7f9bc4682700 1 --2- 172.21.15.77:0/809919023 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bbc102df0 0x7f9bbc113b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:41.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.880+0000 7f9bc4682700 1 --2- 172.21.15.77:0/809919023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bbc103790 0x7f9bbc1140b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:41.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.880+0000 7f9bc4682700 1 -- 172.21.15.77:0/809919023 >> 172.21.15.77:0/809919023 conn(0x7f9bbc0f8980 msgr2=0x7f9bbc0f99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:41.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.880+0000 7f9bc4682700 1 -- 172.21.15.77:0/809919023 shutdown_connections 2024-04-25T02:06:41.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:41.880+0000 7f9bc4682700 1 -- 172.21.15.77:0/809919023 wait complete. 2024-04-25T02:06:42.486 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:42 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/809919023' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-25T02:06:42.511 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T02:06:42.511 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:06:42.511 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2024-04-25T02:06:42.511 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T02:06:42.511 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:06:42.511 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T02:06:42.511 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T02:06:42.511 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:06:42.512 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:06:42.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:42.512 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2024-04-25T02:06:42.528 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:06:42.528 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:06:42.528 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:06:42.528 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:06:42.528 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2024-04-25T02:06:42.528 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:06:42.528 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:06:42.528 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:06:42.528 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2024-04-25T02:06:42.529 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:06:42.529 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:06:42.529 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2024-04-25T02:06:42.529 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:06:42.529 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:06:42.529 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:06:42.529 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:06:42.529 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:06:42.529 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42276sec preferred_lft 42276sec 2024-04-25T02:06:42.529 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ebf8:3c3f:efd0:53e8/64 scope link noprefixroute 2024-04-25T02:06:42.529 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:06:42.530 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T02:06:42.530 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:06:42.530 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-04-25T02:06:42.530 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add name ceph-brx type bridge 2024-04-25T02:06:42.530 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr flush dev ceph-brx 2024-04-25T02:06:42.530 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set ceph-brx up 2024-04-25T02:06:42.530 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T02:06:42.530 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-04-25T02:06:42.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:06:42.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:42.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:42.706 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:06:42.730 INFO:teuthology.orchestra.run.smithi077.stdout:1 2024-04-25T02:06:42.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:42.732 DEBUG:teuthology.orchestra.run.smithi077:> route 2024-04-25T02:06:42.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:42 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/809919023' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-25T02:06:42.805 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2024-04-25T02:06:42.805 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:06:42.805 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:06:42.805 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:06:42.805 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:06:42.805 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:06:42.806 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-04-25T02:06:42.806 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:06:42.806 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:06:42.806 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:06:42.806 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-04-25T02:06:42.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:06:43.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:43.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:43.116 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-04-25T02:06:43.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:43.131 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list-id 2024-04-25T02:06:43.186 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:06:43.186 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-04-25T02:06:43.186 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:06:43.186 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T02:06:43.186 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-04-25T02:06:43.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:06:43.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:43.303 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T02:06:43.304 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:06:43.304 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-04-25T02:06:43.304 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T02:06:43.304 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T02:06:43.304 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T02:06:43.304 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T02:06:43.304 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T02:06:43.304 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-04-25T02:06:43.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:06:43.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:43.447 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:06:43.447 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-04-25T02:06:43.447 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2024-04-25T02:06:43.447 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T02:06:43.447 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-04-25T02:06:43.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:06:43.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:43.523 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:06:43.523 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T02:06:43.537 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:06:43.537 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:06:43.537 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:06:43.592 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:06:43.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:43.593 DEBUG:teuthology.orchestra.run.smithi077:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:06:43.653 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:43 smithi077 ceph-mon[26330]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-25T02:06:43.681 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:06:43.681 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:06:43.681 INFO:teuthology.orchestra.run.smithi077.stdout:invalid new device string format 2024-04-25T02:06:43.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:43 smithi112 ceph-mon[33313]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-04-25T02:06:43.800 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:06:43.800 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:06:43.800 INFO:teuthology.orchestra.run.smithi077.stdout:invalid new device string format 2024-04-25T02:06:43.800 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.112:3300" 2024-04-25T02:06:43.800 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:06:43.805 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:06:43.805 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T02:06:43.806 INFO:teuthology.orchestra.run.smithi077.stdout:invalid new device string format 2024-04-25T02:06:43.806 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.112:3300" 2024-04-25T02:06:43.806 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:06:43.806 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: resolved to: "172.21.15.77:6789,172.21.15.112:6789" 2024-04-25T02:06:43.806 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.77:6789,172.21.15.112:6789:/ 2024-04-25T02:06:43.806 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=4bb93d82-02a7-11ef-bc93-c7b262605968" will pass to kernel 2024-04-25T02:06:43.807 INFO:teuthology.orchestra.run.smithi077.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T02:06:43.808 INFO:teuthology.orchestra.run.smithi077.stdout: You just mounted a file system that supports labels which does not 2024-04-25T02:06:43.808 INFO:teuthology.orchestra.run.smithi077.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T02:06:43.808 INFO:teuthology.orchestra.run.smithi077.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T02:06:43.808 INFO:teuthology.orchestra.run.smithi077.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T02:06:43.808 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:06:43.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:43.808 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:06:43.873 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:06:43.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:06:43.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:43.974 INFO:teuthology.orchestra.run.smithi077.stdout:client14512 2024-04-25T02:06:43.974 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T02:06:43.974 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:06:43.991 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:06:44.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:06:44.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:44.092 INFO:teuthology.orchestra.run.smithi077.stdout:client14512 2024-04-25T02:06:44.092 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:06:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:06:44.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:44.154 INFO:teuthology.orchestra.run.smithi077.stdout:client14512 2024-04-25T02:06:44.154 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968.client14512/status') 2024-04-25T02:06:44.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:06:44.215 INFO:teuthology.orchestra.run.smithi077.stdout:instance: client.14512 (3)192.168.0.1:0/1415948385 2024-04-25T02:06:44.215 INFO:teuthology.orchestra.run.smithi077.stdout:blocklisted: false 2024-04-25T02:06:44.216 INFO:teuthology.orchestra.run.smithi077.stderr:0+1 records in 2024-04-25T02:06:44.216 INFO:teuthology.orchestra.run.smithi077.stderr:0+1 records out 2024-04-25T02:06:44.216 INFO:teuthology.orchestra.run.smithi077.stderr:70 bytes copied, 2.2577e-05 s, 3.1 MB/s 2024-04-25T02:06:44.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:44.225 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-04-25T02:06:44.225 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T02:06:44.225 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T02:06:44.226 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-25T02:06:44.477 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:06:45.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:45 smithi112 ceph-mon[33313]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:06:45.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:45 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:06:45.803 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:45 smithi077 ceph-mon[26330]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:06:45.803 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:45 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:06:46.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.031+0000 7f0448aca700 1 -- 172.21.15.77:0/3367744561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0444101d00 msgr2=0x7f04441020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:46.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.031+0000 7f0448aca700 1 --2- 172.21.15.77:0/3367744561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0444101d00 0x7f04441020d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0434004940 tx=0x7f0434009e30 comp rx=0 tx=0).stop 2024-04-25T02:06:46.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.032+0000 7f0448aca700 1 -- 172.21.15.77:0/3367744561 shutdown_connections 2024-04-25T02:06:46.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.032+0000 7f0448aca700 1 --2- 172.21.15.77:0/3367744561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04441026a0 0x7f04440fbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:46.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.032+0000 7f0448aca700 1 --2- 172.21.15.77:0/3367744561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0444101d00 0x7f04441020d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:46.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.032+0000 7f0448aca700 1 -- 172.21.15.77:0/3367744561 >> 172.21.15.77:0/3367744561 conn(0x7f04440f7870 msgr2=0x7f04440f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:46.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.032+0000 7f0448aca700 1 -- 172.21.15.77:0/3367744561 shutdown_connections 2024-04-25T02:06:46.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.032+0000 7f0448aca700 1 -- 172.21.15.77:0/3367744561 wait complete. 2024-04-25T02:06:46.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.032+0000 7f0448aca700 1 Processor -- start 2024-04-25T02:06:46.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.032+0000 7f0448aca700 1 -- start start 2024-04-25T02:06:46.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.032+0000 7f0448aca700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0444101d00 0x7f0444112890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:46.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.032+0000 7f0448aca700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04441026a0 0x7f0444112dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:46.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.032+0000 7f0448aca700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04441134b0 con 0x7f04441026a0 2024-04-25T02:06:46.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.032+0000 7f0448aca700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044410ca20 con 0x7f0444101d00 2024-04-25T02:06:46.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.032+0000 7f043bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04441026a0 0x7f0444112dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:46.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.032+0000 7f043bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04441026a0 0x7f0444112dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47532/0 (socket says 172.21.15.77:47532) 2024-04-25T02:06:46.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.032+0000 7f043bfff700 1 -- 172.21.15.77:0/2137370241 learned_addr learned my addr 172.21.15.77:0/2137370241 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:06:46.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.033+0000 7f044259c700 1 --2- 172.21.15.77:0/2137370241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0444101d00 0x7f0444112890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:46.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.033+0000 7f043bfff700 1 -- 172.21.15.77:0/2137370241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0444101d00 msgr2=0x7f0444112890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:46.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.033+0000 7f043bfff700 1 --2- 172.21.15.77:0/2137370241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0444101d00 0x7f0444112890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:46.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.033+0000 7f043bfff700 1 -- 172.21.15.77:0/2137370241 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0434005040 con 0x7f04441026a0 2024-04-25T02:06:46.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.033+0000 7f044259c700 1 --2- 172.21.15.77:0/2137370241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0444101d00 0x7f0444112890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:06:46.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.033+0000 7f043bfff700 1 --2- 172.21.15.77:0/2137370241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04441026a0 0x7f0444112dd0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f042c00b790 tx=0x7f042c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:46.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.033+0000 7f043affd700 1 -- 172.21.15.77:0/2137370241 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f042c00f6f0 con 0x7f04441026a0 2024-04-25T02:06:46.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.033+0000 7f043affd700 1 -- 172.21.15.77:0/2137370241 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f042c00fd20 con 0x7f04441026a0 2024-04-25T02:06:46.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.033+0000 7f0448aca700 1 -- 172.21.15.77:0/2137370241 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f044410cd00 con 0x7f04441026a0 2024-04-25T02:06:46.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.033+0000 7f043affd700 1 -- 172.21.15.77:0/2137370241 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f042c0103a0 con 0x7f04441026a0 2024-04-25T02:06:46.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.033+0000 7f0448aca700 1 -- 172.21.15.77:0/2137370241 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f044410d2c0 con 0x7f04441026a0 2024-04-25T02:06:46.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.034+0000 7f0448aca700 1 -- 172.21.15.77:0/2137370241 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04440fd450 con 0x7f04441026a0 2024-04-25T02:06:46.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.034+0000 7f043affd700 1 -- 172.21.15.77:0/2137370241 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f042c011400 con 0x7f04441026a0 2024-04-25T02:06:46.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.035+0000 7f043affd700 1 --2- 172.21.15.77:0/2137370241 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f04300692a0 0x7f043006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:46.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.035+0000 7f043affd700 1 -- 172.21.15.77:0/2137370241 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f042c0870b0 con 0x7f04441026a0 2024-04-25T02:06:46.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.035+0000 7f044259c700 1 --2- 172.21.15.77:0/2137370241 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f04300692a0 0x7f043006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:46.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.035+0000 7f044259c700 1 --2- 172.21.15.77:0/2137370241 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f04300692a0 0x7f043006b750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0434004f90 tx=0x7f0434009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:46.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.039+0000 7f043affd700 1 -- 172.21.15.77:0/2137370241 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f042c056da0 con 0x7f04441026a0 2024-04-25T02:06:46.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.270+0000 7f0448aca700 1 -- 172.21.15.77:0/2137370241 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f044404c710 con 0x7f04441026a0 2024-04-25T02:06:46.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.270+0000 7f043affd700 1 -- 172.21.15.77:0/2137370241 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7f042c056930 con 0x7f04441026a0 2024-04-25T02:06:46.277 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-04-25T02:06:46.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.272+0000 7f0448aca700 1 -- 172.21.15.77:0/2137370241 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f04300692a0 msgr2=0x7f043006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:46.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.272+0000 7f0448aca700 1 --2- 172.21.15.77:0/2137370241 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f04300692a0 0x7f043006b750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0434004f90 tx=0x7f0434009e30 comp rx=0 tx=0).stop 2024-04-25T02:06:46.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.272+0000 7f0448aca700 1 -- 172.21.15.77:0/2137370241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04441026a0 msgr2=0x7f0444112dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:46.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.272+0000 7f0448aca700 1 --2- 172.21.15.77:0/2137370241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04441026a0 0x7f0444112dd0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f042c00b790 tx=0x7f042c009220 comp rx=0 tx=0).stop 2024-04-25T02:06:46.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.272+0000 7f0448aca700 1 -- 172.21.15.77:0/2137370241 shutdown_connections 2024-04-25T02:06:46.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.272+0000 7f0448aca700 1 --2- 172.21.15.77:0/2137370241 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f04300692a0 0x7f043006b750 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:46.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.272+0000 7f0448aca700 1 --2- 172.21.15.77:0/2137370241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0444101d00 0x7f0444112890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:46.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.272+0000 7f0448aca700 1 --2- 172.21.15.77:0/2137370241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04441026a0 0x7f0444112dd0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:46.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.272+0000 7f0448aca700 1 -- 172.21.15.77:0/2137370241 >> 172.21.15.77:0/2137370241 conn(0x7f04440f7870 msgr2=0x7f04440f8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:46.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.272+0000 7f0448aca700 1 -- 172.21.15.77:0/2137370241 shutdown_connections 2024-04-25T02:06:46.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:46.272+0000 7f0448aca700 1 -- 172.21.15.77:0/2137370241 wait complete. 2024-04-25T02:06:46.618 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:46 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/2137370241' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-25T02:06:46.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:46 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/2137370241' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-25T02:06:46.853 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T02:06:46.853 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:06:46.853 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-04-25T02:06:46.853 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-25T02:06:46.853 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T02:06:46.853 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T02:06:46.853 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T02:06:46.853 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:06:46.853 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T02:06:46.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:46.853 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-04-25T02:06:46.869 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:06:46.869 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:06:46.869 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:06:46.869 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:06:46.869 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-04-25T02:06:46.869 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:06:46.869 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:06:46.869 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-04-25T02:06:46.869 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-04-25T02:06:46.869 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:06:46.870 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-04-25T02:06:46.870 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-04-25T02:06:46.870 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:06:46.870 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:06:46.870 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:06:46.870 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:06:46.870 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:06:46.870 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42280sec preferred_lft 42280sec 2024-04-25T02:06:46.870 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::a0da:9085:75bb:ec26/64 scope link noprefixroute 2024-04-25T02:06:46.870 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:06:46.870 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T02:06:46.871 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:06:46.871 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-04-25T02:06:46.871 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add name ceph-brx type bridge 2024-04-25T02:06:46.871 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr flush dev ceph-brx 2024-04-25T02:06:46.871 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set ceph-brx up 2024-04-25T02:06:46.871 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T02:06:46.871 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-04-25T02:06:46.958 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:06:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:06:47.043 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:06:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:47.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:47.053 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:06:47.077 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-04-25T02:06:47.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:47.078 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-04-25T02:06:47.149 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-04-25T02:06:47.149 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:06:47.149 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:06:47.149 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:06:47.149 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:06:47.150 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:06:47.150 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-04-25T02:06:47.150 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:06:47.150 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:06:47.150 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:06:47.150 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-04-25T02:06:47.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:06:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:06:47.425 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:06:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:47.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:47.431 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-04-25T02:06:47.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:47.446 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list-id 2024-04-25T02:06:47.501 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:06:47.501 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-04-25T02:06:47.501 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T02:06:47.501 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-25T02:06:47.501 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-04-25T02:06:47.589 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:06:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:06:47.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:06:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:47.616 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-25T02:06:47.616 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:06:47.616 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-04-25T02:06:47.616 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-25T02:06:47.616 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T02:06:47.616 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-25T02:06:47.617 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-25T02:06:47.617 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-25T02:06:47.617 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-04-25T02:06:47.664 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:06:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:06:47.752 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:06:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:47.758 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:06:47.758 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-04-25T02:06:47.759 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2024-04-25T02:06:47.759 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T02:06:47.759 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-04-25T02:06:47.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:47 smithi112 ceph-mon[33313]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-25T02:06:47.806 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:06:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:06:47.827 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:06:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:47.833 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:06:47.833 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-25T02:06:47.888 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-25T02:06:47.888 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:06:47.888 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-25T02:06:47.942 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:06:47.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:47.943 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T02:06:47.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:47 smithi077 ceph-mon[26330]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-25T02:06:48.040 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T02:06:48.041 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T02:06:48.041 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2024-04-25T02:06:48.143 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T02:06:48.143 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T02:06:48.143 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2024-04-25T02:06:48.143 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.112:3300" 2024-04-25T02:06:48.144 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:06:48.147 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T02:06:48.148 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T02:06:48.148 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2024-04-25T02:06:48.148 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.112:3300" 2024-04-25T02:06:48.148 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T02:06:48.148 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.77:6789,172.21.15.112:6789" 2024-04-25T02:06:48.148 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.77:6789,172.21.15.112:6789:/ 2024-04-25T02:06:48.148 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=4bb93d82-02a7-11ef-bc93-c7b262605968" will pass to kernel 2024-04-25T02:06:48.149 INFO:teuthology.orchestra.run.smithi112.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-25T02:06:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: You just mounted a file system that supports labels which does not 2024-04-25T02:06:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T02:06:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T02:06:48.149 INFO:teuthology.orchestra.run.smithi112.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T02:06:48.150 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:06:48.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:48.151 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-25T02:06:48.173 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:06:48.261 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:06:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:06:48.263 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:06:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:48.269 INFO:teuthology.orchestra.run.smithi112.stdout:client14518 2024-04-25T02:06:48.269 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T02:06:48.269 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:06:48.285 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:06:48.372 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:06:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:06:48.373 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:06:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:48.379 INFO:teuthology.orchestra.run.smithi112.stdout:client14518 2024-04-25T02:06:48.379 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:06:48.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:06:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:06:48.427 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:06:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:48.433 INFO:teuthology.orchestra.run.smithi112.stdout:client14518 2024-04-25T02:06:48.434 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968.client14518/status') 2024-04-25T02:06:48.481 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:06:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:06:48.490 INFO:teuthology.orchestra.run.smithi112.stdout:instance: client.14518 (3)172.21.15.112:0/2995074108 2024-04-25T02:06:48.490 INFO:teuthology.orchestra.run.smithi112.stdout:blocklisted: false 2024-04-25T02:06:48.490 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2024-04-25T02:06:48.490 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2024-04-25T02:06:48.491 INFO:teuthology.orchestra.run.smithi112.stderr:72 bytes copied, 2.1435e-05 s, 3.4 MB/s 2024-04-25T02:06:48.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T02:06:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:48.497 INFO:teuthology.run_tasks:Running task print... 2024-04-25T02:06:48.507 INFO:teuthology.task.print:**** done client 2024-04-25T02:06:48.507 INFO:teuthology.run_tasks:Running task parallel... 2024-04-25T02:06:48.529 INFO:teuthology.task.parallel:starting parallel... 2024-04-25T02:06:48.529 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-25T02:06:48.530 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-25T02:06:48.530 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T02:06:48.530 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -e sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-04-25T02:06:48.531 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-25T02:06:48.531 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-04-25T02:06:48.534 INFO:tasks.workunit:Pulling workunits from ref d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:06:48.535 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-25T02:06:48.535 INFO:tasks.workunit:timeout=3h 2024-04-25T02:06:48.535 INFO:tasks.workunit:cleanup=True 2024-04-25T02:06:48.535 DEBUG:teuthology.orchestra.run.smithi077:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-25T02:06:48.555 INFO:teuthology.orchestra.run.smithi077.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-25T02:06:48.555 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-25T02:06:48.555 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 58h/88d Inode: 1 Links: 2 2024-04-25T02:06:48.555 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:06:48.555 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-25T02:06:48.555 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-25T02:06:48.555 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-04-25 02:06:15.032286091 +0000 2024-04-25T02:06:48.555 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-04-25 02:06:43.863941526 +0000 2024-04-25T02:06:48.555 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-04-25 02:06:15.032286091 +0000 2024-04-25T02:06:48.556 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-25T02:06:48.556 DEBUG:teuthology.orchestra.run.smithi077:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-25T02:06:48.625 DEBUG:teuthology.orchestra.run.smithi112:> stat -- /home/ubuntu/cephtest/mnt.1 2024-04-25T02:06:48.640 INFO:teuthology.orchestra.run.smithi112.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-04-25T02:06:48.640 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-04-25T02:06:48.641 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 70h/112d Inode: 1 Links: 3 2024-04-25T02:06:48.641 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:06:48.641 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-25T02:06:48.641 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-25T02:06:48.641 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-04-25 02:06:48.613844275 +0000 2024-04-25T02:06:48.641 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-04-25 02:06:48.613844275 +0000 2024-04-25T02:06:48.641 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-04-25 02:06:15.032286091 +0000 2024-04-25T02:06:48.641 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-04-25T02:06:48.641 DEBUG:teuthology.orchestra.run.smithi112:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-04-25T02:06:48.709 DEBUG:teuthology.orchestra.run.smithi077:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:06:48.709 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:06:48.724 INFO:tasks.workunit.client.0.smithi077.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-25T02:06:48.765 INFO:tasks.workunit.client.1.smithi112.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-04-25T02:06:48.806 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:06:49.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:49 smithi112 ceph-mon[33313]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-25T02:06:49.844 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:49 smithi077 ceph-mon[26330]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-25T02:06:50.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.320+0000 7f8f9304d700 1 -- 172.21.15.77:0/3670992491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f8c0fbca0 msgr2=0x7f8f8c0fc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:50.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.320+0000 7f8f9304d700 1 --2- 172.21.15.77:0/3670992491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f8c0fbca0 0x7f8f8c0fc0b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8f80004940 tx=0x7f8f80009e30 comp rx=0 tx=0).stop 2024-04-25T02:06:50.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.320+0000 7f8f9304d700 1 -- 172.21.15.77:0/3670992491 shutdown_connections 2024-04-25T02:06:50.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.320+0000 7f8f9304d700 1 --2- 172.21.15.77:0/3670992491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f8c0fcf50 0x7f8f8c0fd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:50.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.320+0000 7f8f9304d700 1 --2- 172.21.15.77:0/3670992491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f8c0fbca0 0x7f8f8c0fc0b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:50.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.320+0000 7f8f9304d700 1 -- 172.21.15.77:0/3670992491 >> 172.21.15.77:0/3670992491 conn(0x7f8f8c0f7420 msgr2=0x7f8f8c0f9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:50.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.320+0000 7f8f9304d700 1 -- 172.21.15.77:0/3670992491 shutdown_connections 2024-04-25T02:06:50.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.320+0000 7f8f9304d700 1 -- 172.21.15.77:0/3670992491 wait complete. 2024-04-25T02:06:50.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.320+0000 7f8f9304d700 1 Processor -- start 2024-04-25T02:06:50.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.320+0000 7f8f9304d700 1 -- start start 2024-04-25T02:06:50.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.320+0000 7f8f9304d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f8c0fbca0 0x7f8f8c066d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:50.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.321+0000 7f8f9304d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f8c0fcf50 0x7f8f8c112720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:50.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.321+0000 7f8f9304d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c112c60 con 0x7f8f8c0fbca0 2024-04-25T02:06:50.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.321+0000 7f8f9304d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c112dd0 con 0x7f8f8c0fcf50 2024-04-25T02:06:50.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.321+0000 7f8f90de9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f8c0fbca0 0x7f8f8c066d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:50.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.321+0000 7f8f90de9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f8c0fbca0 0x7f8f8c066d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55758/0 (socket says 172.21.15.77:55758) 2024-04-25T02:06:50.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.321+0000 7f8f90de9700 1 -- 172.21.15.77:0/4064671238 learned_addr learned my addr 172.21.15.77:0/4064671238 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:06:50.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.321+0000 7f8f8bfff700 1 --2- 172.21.15.77:0/4064671238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f8c0fcf50 0x7f8f8c112720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:50.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.321+0000 7f8f90de9700 1 -- 172.21.15.77:0/4064671238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f8c0fcf50 msgr2=0x7f8f8c112720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:50.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.321+0000 7f8f90de9700 1 --2- 172.21.15.77:0/4064671238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f8c0fcf50 0x7f8f8c112720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:50.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.321+0000 7f8f90de9700 1 -- 172.21.15.77:0/4064671238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f80005040 con 0x7f8f8c0fbca0 2024-04-25T02:06:50.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.321+0000 7f8f90de9700 1 --2- 172.21.15.77:0/4064671238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f8c0fbca0 0x7f8f8c066d30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8f80009150 tx=0x7f8f80009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:50.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.321+0000 7f8f897fa700 1 -- 172.21.15.77:0/4064671238 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f8000e040 con 0x7f8f8c0fbca0 2024-04-25T02:06:50.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.321+0000 7f8f9304d700 1 -- 172.21.15.77:0/4064671238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f8c113050 con 0x7f8f8c0fbca0 2024-04-25T02:06:50.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.321+0000 7f8f897fa700 1 -- 172.21.15.77:0/4064671238 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8f8000bcc0 con 0x7f8f8c0fbca0 2024-04-25T02:06:50.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.321+0000 7f8f897fa700 1 -- 172.21.15.77:0/4064671238 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f8001c630 con 0x7f8f8c0fbca0 2024-04-25T02:06:50.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.321+0000 7f8f9304d700 1 -- 172.21.15.77:0/4064671238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f8c113610 con 0x7f8f8c0fbca0 2024-04-25T02:06:50.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.322+0000 7f8f9304d700 1 -- 172.21.15.77:0/4064671238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f8c04c710 con 0x7f8f8c0fbca0 2024-04-25T02:06:50.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.323+0000 7f8f897fa700 1 -- 172.21.15.77:0/4064671238 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f8f80013420 con 0x7f8f8c0fbca0 2024-04-25T02:06:50.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.323+0000 7f8f897fa700 1 --2- 172.21.15.77:0/4064671238 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f8f7c0692a0 0x7f8f7c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:50.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.323+0000 7f8f897fa700 1 -- 172.21.15.77:0/4064671238 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8f80087fc0 con 0x7f8f8c0fbca0 2024-04-25T02:06:50.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.323+0000 7f8f8bfff700 1 --2- 172.21.15.77:0/4064671238 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f8f7c0692a0 0x7f8f7c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:50.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.324+0000 7f8f8bfff700 1 --2- 172.21.15.77:0/4064671238 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f8f7c0692a0 0x7f8f7c06b750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8f78006fd0 tx=0x7f8f78008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:50.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.327+0000 7f8f897fa700 1 -- 172.21.15.77:0/4064671238 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8f80057d30 con 0x7f8f8c0fbca0 2024-04-25T02:06:50.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.519+0000 7f8f9304d700 1 -- 172.21.15.77:0/4064671238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f8f8c113a00 con 0x7f8f8c0fbca0 2024-04-25T02:06:50.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.519+0000 7f8f897fa700 1 -- 172.21.15.77:0/4064671238 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f8f800578c0 con 0x7f8f8c0fbca0 2024-04-25T02:06:50.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.521+0000 7f8f9304d700 1 -- 172.21.15.77:0/4064671238 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f8f7c0692a0 msgr2=0x7f8f7c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:50.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.521+0000 7f8f9304d700 1 --2- 172.21.15.77:0/4064671238 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f8f7c0692a0 0x7f8f7c06b750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8f78006fd0 tx=0x7f8f78008040 comp rx=0 tx=0).stop 2024-04-25T02:06:50.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.521+0000 7f8f9304d700 1 -- 172.21.15.77:0/4064671238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f8c0fbca0 msgr2=0x7f8f8c066d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:50.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.521+0000 7f8f9304d700 1 --2- 172.21.15.77:0/4064671238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f8c0fbca0 0x7f8f8c066d30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8f80009150 tx=0x7f8f80009e30 comp rx=0 tx=0).stop 2024-04-25T02:06:50.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.521+0000 7f8f9304d700 1 -- 172.21.15.77:0/4064671238 shutdown_connections 2024-04-25T02:06:50.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.521+0000 7f8f9304d700 1 --2- 172.21.15.77:0/4064671238 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f8f7c0692a0 0x7f8f7c06b750 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:50.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.521+0000 7f8f9304d700 1 --2- 172.21.15.77:0/4064671238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f8c0fbca0 0x7f8f8c066d30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:50.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.521+0000 7f8f9304d700 1 --2- 172.21.15.77:0/4064671238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f8c0fcf50 0x7f8f8c112720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:50.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.521+0000 7f8f9304d700 1 -- 172.21.15.77:0/4064671238 >> 172.21.15.77:0/4064671238 conn(0x7f8f8c0f7420 msgr2=0x7f8f8c0f8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:50.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.521+0000 7f8f9304d700 1 -- 172.21.15.77:0/4064671238 shutdown_connections 2024-04-25T02:06:50.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:50.521+0000 7f8f9304d700 1 -- 172.21.15.77:0/4064671238 wait complete. 2024-04-25T02:06:51.152 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -e sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-04-25T02:06:51.452 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:06:51.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:51 smithi112 ceph-mon[33313]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-25T02:06:51.790 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:51 smithi077 ceph-mon[26330]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-25T02:06:53.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.033+0000 7fdbce125700 1 -- 172.21.15.77:0/1593297516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbc80ffef0 msgr2=0x7fdbc8102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:53.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.033+0000 7fdbce125700 1 --2- 172.21.15.77:0/1593297516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbc80ffef0 0x7fdbc8102310 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc004940 tx=0x7fdbbc009e30 comp rx=0 tx=0).stop 2024-04-25T02:06:53.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.033+0000 7fdbce125700 1 -- 172.21.15.77:0/1593297516 shutdown_connections 2024-04-25T02:06:53.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.033+0000 7fdbce125700 1 --2- 172.21.15.77:0/1593297516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbc80ffef0 0x7fdbc8102310 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:53.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.033+0000 7fdbce125700 1 --2- 172.21.15.77:0/1593297516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbc8066f70 0x7fdbc80ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:53.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.033+0000 7fdbce125700 1 -- 172.21.15.77:0/1593297516 >> 172.21.15.77:0/1593297516 conn(0x7fdbc80f7420 msgr2=0x7fdbc80f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:53.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.033+0000 7fdbce125700 1 -- 172.21.15.77:0/1593297516 shutdown_connections 2024-04-25T02:06:53.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.033+0000 7fdbce125700 1 -- 172.21.15.77:0/1593297516 wait complete. 2024-04-25T02:06:53.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.034+0000 7fdbce125700 1 Processor -- start 2024-04-25T02:06:53.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.034+0000 7fdbce125700 1 -- start start 2024-04-25T02:06:53.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.034+0000 7fdbce125700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbc8066f70 0x7fdbc810d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:53.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.034+0000 7fdbce125700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbc80ffef0 0x7fdbc810de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:53.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.034+0000 7fdbce125700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc810e480 con 0x7fdbc8066f70 2024-04-25T02:06:53.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.034+0000 7fdbce125700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc810e5f0 con 0x7fdbc80ffef0 2024-04-25T02:06:53.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.034+0000 7fdbc77fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbc8066f70 0x7fdbc810d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:53.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.035+0000 7fdbc77fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbc8066f70 0x7fdbc810d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55778/0 (socket says 172.21.15.77:55778) 2024-04-25T02:06:53.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.035+0000 7fdbc77fe700 1 -- 172.21.15.77:0/3922167911 learned_addr learned my addr 172.21.15.77:0/3922167911 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:06:53.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.035+0000 7fdbc6ffd700 1 --2- 172.21.15.77:0/3922167911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbc80ffef0 0x7fdbc810de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:53.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.035+0000 7fdbc77fe700 1 -- 172.21.15.77:0/3922167911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbc80ffef0 msgr2=0x7fdbc810de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:53.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.035+0000 7fdbc77fe700 1 --2- 172.21.15.77:0/3922167911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbc80ffef0 0x7fdbc810de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:53.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.035+0000 7fdbc77fe700 1 -- 172.21.15.77:0/3922167911 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc005040 con 0x7fdbc8066f70 2024-04-25T02:06:53.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.035+0000 7fdbc77fe700 1 --2- 172.21.15.77:0/3922167911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbc8066f70 0x7fdbc810d940 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8002a50 tx=0x7fdbb8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:53.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.035+0000 7fdbaffff700 1 -- 172.21.15.77:0/3922167911 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbb8007cc0 con 0x7fdbc8066f70 2024-04-25T02:06:53.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.035+0000 7fdbce125700 1 -- 172.21.15.77:0/3922167911 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc8112ff0 con 0x7fdbc8066f70 2024-04-25T02:06:53.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.035+0000 7fdbaffff700 1 -- 172.21.15.77:0/3922167911 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdbb800f040 con 0x7fdbc8066f70 2024-04-25T02:06:53.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.035+0000 7fdbaffff700 1 -- 172.21.15.77:0/3922167911 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbb800d9c0 con 0x7fdbc8066f70 2024-04-25T02:06:53.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.035+0000 7fdbce125700 1 -- 172.21.15.77:0/3922167911 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc8113580 con 0x7fdbc8066f70 2024-04-25T02:06:53.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.036+0000 7fdbce125700 1 -- 172.21.15.77:0/3922167911 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc804c710 con 0x7fdbc8066f70 2024-04-25T02:06:53.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.037+0000 7fdbaffff700 1 -- 172.21.15.77:0/3922167911 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fdbb8009730 con 0x7fdbc8066f70 2024-04-25T02:06:53.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.037+0000 7fdbaffff700 1 --2- 172.21.15.77:0/3922167911 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fdbb00692a0 0x7fdbb006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:53.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.037+0000 7fdbaffff700 1 -- 172.21.15.77:0/3922167911 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fdbb8086f50 con 0x7fdbc8066f70 2024-04-25T02:06:53.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.037+0000 7fdbc6ffd700 1 --2- 172.21.15.77:0/3922167911 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fdbb00692a0 0x7fdbb006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:53.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.038+0000 7fdbc6ffd700 1 --2- 172.21.15.77:0/3922167911 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fdbb00692a0 0x7fdbb006b750 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc009fd0 tx=0x7fdbbc009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:53.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.042+0000 7fdbaffff700 1 -- 172.21.15.77:0/3922167911 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fdbb8056c40 con 0x7fdbc8066f70 2024-04-25T02:06:53.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.227+0000 7fdbce125700 1 -- 172.21.15.77:0/3922167911 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fdbc8105950 con 0x7fdbc8066f70 2024-04-25T02:06:53.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.227+0000 7fdbaffff700 1 -- 172.21.15.77:0/3922167911 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7fdbc8105950 con 0x7fdbc8066f70 2024-04-25T02:06:53.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.229+0000 7fdbce125700 1 -- 172.21.15.77:0/3922167911 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fdbb00692a0 msgr2=0x7fdbb006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:53.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.229+0000 7fdbce125700 1 --2- 172.21.15.77:0/3922167911 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fdbb00692a0 0x7fdbb006b750 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc009fd0 tx=0x7fdbbc009e30 comp rx=0 tx=0).stop 2024-04-25T02:06:53.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.229+0000 7fdbce125700 1 -- 172.21.15.77:0/3922167911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbc8066f70 msgr2=0x7fdbc810d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:53.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.229+0000 7fdbce125700 1 --2- 172.21.15.77:0/3922167911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbc8066f70 0x7fdbc810d940 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8002a50 tx=0x7fdbb8004600 comp rx=0 tx=0).stop 2024-04-25T02:06:53.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.229+0000 7fdbce125700 1 -- 172.21.15.77:0/3922167911 shutdown_connections 2024-04-25T02:06:53.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.229+0000 7fdbce125700 1 --2- 172.21.15.77:0/3922167911 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fdbb00692a0 0x7fdbb006b750 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:53.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.229+0000 7fdbce125700 1 --2- 172.21.15.77:0/3922167911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbc8066f70 0x7fdbc810d940 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:53.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.229+0000 7fdbce125700 1 --2- 172.21.15.77:0/3922167911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbc80ffef0 0x7fdbc810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:53.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.229+0000 7fdbce125700 1 -- 172.21.15.77:0/3922167911 >> 172.21.15.77:0/3922167911 conn(0x7fdbc80f7420 msgr2=0x7fdbc80f7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:53.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.230+0000 7fdbce125700 1 -- 172.21.15.77:0/3922167911 shutdown_connections 2024-04-25T02:06:53.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:53.230+0000 7fdbce125700 1 -- 172.21.15.77:0/3922167911 wait complete. 2024-04-25T02:06:53.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:53 smithi112 ceph-mon[33313]: pgmap v196: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-04-25T02:06:53.933 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:53 smithi077 ceph-mon[26330]: pgmap v196: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-04-25T02:06:53.958 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -e sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 -- bash -c 'ceph config set global log_to_journald false --force' 2024-04-25T02:06:54.209 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:06:55.618 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:55 smithi077 ceph-mon[26330]: pgmap v197: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-04-25T02:06:55.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:55 smithi112 ceph-mon[33313]: pgmap v197: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-04-25T02:06:55.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.864+0000 7f36d46b3700 1 -- 172.21.15.77:0/663345257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36cc066ef0 msgr2=0x7f36cc0ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:55.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.864+0000 7f36d46b3700 1 --2- 172.21.15.77:0/663345257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36cc066ef0 0x7f36cc0ffa30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f36c8004940 tx=0x7f36c8009e30 comp rx=0 tx=0).stop 2024-04-25T02:06:55.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.864+0000 7f36d46b3700 1 -- 172.21.15.77:0/663345257 shutdown_connections 2024-04-25T02:06:55.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.864+0000 7f36d46b3700 1 --2- 172.21.15.77:0/663345257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36cc0fff70 0x7f36cc102350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:55.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.864+0000 7f36d46b3700 1 --2- 172.21.15.77:0/663345257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36cc066ef0 0x7f36cc0ffa30 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:55.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.864+0000 7f36d46b3700 1 -- 172.21.15.77:0/663345257 >> 172.21.15.77:0/663345257 conn(0x7f36cc0f7420 msgr2=0x7f36cc0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:55.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.864+0000 7f36d46b3700 1 -- 172.21.15.77:0/663345257 shutdown_connections 2024-04-25T02:06:55.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.864+0000 7f36d46b3700 1 -- 172.21.15.77:0/663345257 wait complete. 2024-04-25T02:06:55.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.865+0000 7f36d46b3700 1 Processor -- start 2024-04-25T02:06:55.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.865+0000 7f36d46b3700 1 -- start start 2024-04-25T02:06:55.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.865+0000 7f36d46b3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36cc066ef0 0x7f36cc113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:55.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.865+0000 7f36d46b3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36cc0fff70 0x7f36cc1144e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:55.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.865+0000 7f36d46b3700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36cc114ae0 con 0x7f36cc066ef0 2024-04-25T02:06:55.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.865+0000 7f36d46b3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36cc114c50 con 0x7f36cc0fff70 2024-04-25T02:06:55.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.865+0000 7f36d244f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36cc066ef0 0x7f36cc113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:55.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.865+0000 7f36d244f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36cc066ef0 0x7f36cc113fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55800/0 (socket says 172.21.15.77:55800) 2024-04-25T02:06:55.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.865+0000 7f36d244f700 1 -- 172.21.15.77:0/2428420638 learned_addr learned my addr 172.21.15.77:0/2428420638 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:06:55.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.866+0000 7f36d1c4e700 1 --2- 172.21.15.77:0/2428420638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36cc0fff70 0x7f36cc1144e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:55.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.866+0000 7f36d244f700 1 -- 172.21.15.77:0/2428420638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36cc0fff70 msgr2=0x7f36cc1144e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:55.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.866+0000 7f36d244f700 1 --2- 172.21.15.77:0/2428420638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36cc0fff70 0x7f36cc1144e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:55.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.866+0000 7f36d244f700 1 -- 172.21.15.77:0/2428420638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c8005040 con 0x7f36cc066ef0 2024-04-25T02:06:55.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.866+0000 7f36d1c4e700 1 --2- 172.21.15.77:0/2428420638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36cc0fff70 0x7f36cc1144e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:06:55.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.866+0000 7f36d244f700 1 --2- 172.21.15.77:0/2428420638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36cc066ef0 0x7f36cc113fa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f36c8009fd0 tx=0x7f36c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:55.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.866+0000 7f36c2ffd700 1 -- 172.21.15.77:0/2428420638 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36c800e040 con 0x7f36cc066ef0 2024-04-25T02:06:55.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.866+0000 7f36c2ffd700 1 -- 172.21.15.77:0/2428420638 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f36c800bbf0 con 0x7f36cc066ef0 2024-04-25T02:06:55.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.866+0000 7f36d46b3700 1 -- 172.21.15.77:0/2428420638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36cc119650 con 0x7f36cc066ef0 2024-04-25T02:06:55.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.866+0000 7f36d46b3700 1 -- 172.21.15.77:0/2428420638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36cc119c10 con 0x7f36cc066ef0 2024-04-25T02:06:55.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.866+0000 7f36c2ffd700 1 -- 172.21.15.77:0/2428420638 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36c801c630 con 0x7f36cc066ef0 2024-04-25T02:06:55.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.867+0000 7f36d46b3700 1 -- 172.21.15.77:0/2428420638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b00052e0 con 0x7f36cc066ef0 2024-04-25T02:06:55.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.867+0000 7f36c2ffd700 1 -- 172.21.15.77:0/2428420638 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f36c8013980 con 0x7f36cc066ef0 2024-04-25T02:06:55.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.868+0000 7f36c2ffd700 1 --2- 172.21.15.77:0/2428420638 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f36b80692a0 0x7f36b806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:55.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.868+0000 7f36c2ffd700 1 -- 172.21.15.77:0/2428420638 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f36c8088440 con 0x7f36cc066ef0 2024-04-25T02:06:55.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.868+0000 7f36d1c4e700 1 --2- 172.21.15.77:0/2428420638 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f36b80692a0 0x7f36b806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:55.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.868+0000 7f36d1c4e700 1 --2- 172.21.15.77:0/2428420638 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f36b80692a0 0x7f36b806b750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f36bc007fd0 tx=0x7f36bc009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:55.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:55.872+0000 7f36c2ffd700 1 -- 172.21.15.77:0/2428420638 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f36c80581b0 con 0x7f36cc066ef0 2024-04-25T02:06:56.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:56.057+0000 7f36d46b3700 1 -- 172.21.15.77:0/2428420638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f36b0005b10 con 0x7f36cc066ef0 2024-04-25T02:06:56.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:56.057+0000 7f36c2ffd700 1 -- 172.21.15.77:0/2428420638 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f36c8057d40 con 0x7f36cc066ef0 2024-04-25T02:06:56.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:56.059+0000 7f36d46b3700 1 -- 172.21.15.77:0/2428420638 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f36b80692a0 msgr2=0x7f36b806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:56.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:56.059+0000 7f36d46b3700 1 --2- 172.21.15.77:0/2428420638 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f36b80692a0 0x7f36b806b750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f36bc007fd0 tx=0x7f36bc009040 comp rx=0 tx=0).stop 2024-04-25T02:06:56.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:56.059+0000 7f36d46b3700 1 -- 172.21.15.77:0/2428420638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36cc066ef0 msgr2=0x7f36cc113fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:56.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:56.059+0000 7f36d46b3700 1 --2- 172.21.15.77:0/2428420638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36cc066ef0 0x7f36cc113fa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f36c8009fd0 tx=0x7f36c8009e30 comp rx=0 tx=0).stop 2024-04-25T02:06:56.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:56.059+0000 7f36d46b3700 1 -- 172.21.15.77:0/2428420638 shutdown_connections 2024-04-25T02:06:56.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:56.059+0000 7f36d46b3700 1 --2- 172.21.15.77:0/2428420638 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f36b80692a0 0x7f36b806b750 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:56.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:56.059+0000 7f36d46b3700 1 --2- 172.21.15.77:0/2428420638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36cc066ef0 0x7f36cc113fa0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:56.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:56.059+0000 7f36d46b3700 1 --2- 172.21.15.77:0/2428420638 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36cc0fff70 0x7f36cc1144e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:56.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:56.059+0000 7f36d46b3700 1 -- 172.21.15.77:0/2428420638 >> 172.21.15.77:0/2428420638 conn(0x7f36cc0f7420 msgr2=0x7f36cc0fba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:56.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:56.059+0000 7f36d46b3700 1 -- 172.21.15.77:0/2428420638 shutdown_connections 2024-04-25T02:06:56.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:56.059+0000 7f36d46b3700 1 -- 172.21.15.77:0/2428420638 wait complete. 2024-04-25T02:06:56.647 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -e sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-04-25T02:06:56.900 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:06:57.664 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:57 smithi077 ceph-mon[26330]: pgmap v198: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-04-25T02:06:57.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:57 smithi112 ceph-mon[33313]: pgmap v198: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-04-25T02:06:58.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.362+0000 7f5222b98700 1 -- 172.21.15.77:0/213781855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f521c0fbcc0 msgr2=0x7f521c0fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:58.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.362+0000 7f5222b98700 1 --2- 172.21.15.77:0/213781855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f521c0fbcc0 0x7f521c0fc0d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5210004940 tx=0x7f5210009e30 comp rx=0 tx=0).stop 2024-04-25T02:06:58.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.363+0000 7f5222b98700 1 -- 172.21.15.77:0/213781855 shutdown_connections 2024-04-25T02:06:58.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.363+0000 7f5222b98700 1 --2- 172.21.15.77:0/213781855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f521c0fcf70 0x7f521c0fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:58.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.363+0000 7f5222b98700 1 --2- 172.21.15.77:0/213781855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f521c0fbcc0 0x7f521c0fc0d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:58.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.363+0000 7f5222b98700 1 -- 172.21.15.77:0/213781855 >> 172.21.15.77:0/213781855 conn(0x7f521c0f7440 msgr2=0x7f521c0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:58.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.363+0000 7f5222b98700 1 -- 172.21.15.77:0/213781855 shutdown_connections 2024-04-25T02:06:58.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.363+0000 7f5222b98700 1 -- 172.21.15.77:0/213781855 wait complete. 2024-04-25T02:06:58.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.363+0000 7f5222b98700 1 Processor -- start 2024-04-25T02:06:58.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.363+0000 7f5222b98700 1 -- start start 2024-04-25T02:06:58.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.364+0000 7f5222b98700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f521c0fbcc0 0x7f521c10c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:58.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.364+0000 7f5222b98700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f521c0fcf70 0x7f521c10cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:58.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.364+0000 7f5222b98700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521c10d370 con 0x7f521c0fbcc0 2024-04-25T02:06:58.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.364+0000 7f5222b98700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521c10d4e0 con 0x7f521c0fcf70 2024-04-25T02:06:58.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.364+0000 7f5220934700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f521c0fbcc0 0x7f521c10c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:58.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.364+0000 7f5220934700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f521c0fbcc0 0x7f521c10c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58782/0 (socket says 172.21.15.77:58782) 2024-04-25T02:06:58.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.364+0000 7f5220934700 1 -- 172.21.15.77:0/4229526095 learned_addr learned my addr 172.21.15.77:0/4229526095 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:06:58.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.364+0000 7f521bfff700 1 --2- 172.21.15.77:0/4229526095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f521c0fcf70 0x7f521c10cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:58.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.364+0000 7f5220934700 1 -- 172.21.15.77:0/4229526095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f521c0fcf70 msgr2=0x7f521c10cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:58.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.364+0000 7f5220934700 1 --2- 172.21.15.77:0/4229526095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f521c0fcf70 0x7f521c10cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:58.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.364+0000 7f5220934700 1 -- 172.21.15.77:0/4229526095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5210005040 con 0x7f521c0fbcc0 2024-04-25T02:06:58.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.364+0000 7f5220934700 1 --2- 172.21.15.77:0/4229526095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f521c0fbcc0 0x7f521c10c830 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5210009150 tx=0x7f5210009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:58.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.364+0000 7f52197fa700 1 -- 172.21.15.77:0/4229526095 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f521000e040 con 0x7f521c0fbcc0 2024-04-25T02:06:58.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.364+0000 7f52197fa700 1 -- 172.21.15.77:0/4229526095 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f521000bcc0 con 0x7f521c0fbcc0 2024-04-25T02:06:58.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.364+0000 7f5222b98700 1 -- 172.21.15.77:0/4229526095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f521c111ee0 con 0x7f521c0fbcc0 2024-04-25T02:06:58.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.365+0000 7f52197fa700 1 -- 172.21.15.77:0/4229526095 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f521001c630 con 0x7f521c0fbcc0 2024-04-25T02:06:58.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.365+0000 7f5222b98700 1 -- 172.21.15.77:0/4229526095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f521c112410 con 0x7f521c0fbcc0 2024-04-25T02:06:58.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.365+0000 7f5222b98700 1 -- 172.21.15.77:0/4229526095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f521c04c710 con 0x7f521c0fbcc0 2024-04-25T02:06:58.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.366+0000 7f52197fa700 1 -- 172.21.15.77:0/4229526095 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f5210013420 con 0x7f521c0fbcc0 2024-04-25T02:06:58.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.366+0000 7f52197fa700 1 --2- 172.21.15.77:0/4229526095 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f520c0692a0 0x7f520c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:58.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.366+0000 7f521bfff700 1 --2- 172.21.15.77:0/4229526095 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f520c0692a0 0x7f520c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:58.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.366+0000 7f52197fa700 1 -- 172.21.15.77:0/4229526095 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f5210087e70 con 0x7f521c0fbcc0 2024-04-25T02:06:58.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.367+0000 7f521bfff700 1 --2- 172.21.15.77:0/4229526095 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f520c0692a0 0x7f520c06b750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5208004990 tx=0x7f5208009ee0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:58.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.371+0000 7f52197fa700 1 -- 172.21.15.77:0/4229526095 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5210057c80 con 0x7f521c0fbcc0 2024-04-25T02:06:58.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:06:58.576+0000 7f5222b98700 1 -- 172.21.15.77:0/4229526095 --> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f521c1013e0 con 0x7f520c0692a0 2024-04-25T02:06:59.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:59 smithi112 ceph-mon[33313]: pgmap v199: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-04-25T02:06:59.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:06:59 smithi112 ceph-mon[33313]: from='client.14534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:06:59.893 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:59 smithi077 ceph-mon[26330]: pgmap v199: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-04-25T02:06:59.893 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:06:59 smithi077 ceph-mon[26330]: from='client.14534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:07:00.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:00 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:07:00.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:00 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:07:01.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:01 smithi112 ceph-mon[33313]: pgmap v200: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-04-25T02:07:01.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:01 smithi077 ceph-mon[26330]: pgmap v200: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-04-25T02:07:03.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:03 smithi112 ceph-mon[33313]: pgmap v201: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-04-25T02:07:03.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:03 smithi077 ceph-mon[26330]: pgmap v201: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-04-25T02:07:05.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:05 smithi077 ceph-mon[26330]: pgmap v202: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:06.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:05 smithi112 ceph-mon[33313]: pgmap v202: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:07.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:07 smithi112 ceph-mon[33313]: pgmap v203: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:07.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:07 smithi077 ceph-mon[26330]: pgmap v203: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:09.892 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:09 smithi077 ceph-mon[26330]: pgmap v204: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:10.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:09 smithi112 ceph-mon[33313]: pgmap v204: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:11.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:11 smithi077 ceph-mon[26330]: pgmap v205: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:12.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:11 smithi112 ceph-mon[33313]: pgmap v205: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:13.794 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:13 smithi077 ceph-mon[26330]: pgmap v206: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:14.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:13 smithi112 ceph-mon[33313]: pgmap v206: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:15.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:15 smithi077 ceph-mon[26330]: pgmap v207: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:15.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:15 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:07:16.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:15 smithi112 ceph-mon[33313]: pgmap v207: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:16.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:15 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:07:17.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:17 smithi112 ceph-mon[33313]: pgmap v208: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:17.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:17 smithi077 ceph-mon[26330]: pgmap v208: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:19.893 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:19 smithi077 ceph-mon[26330]: pgmap v209: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:20.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:19 smithi112 ceph-mon[33313]: pgmap v209: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:21.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:21 smithi077 ceph-mon[26330]: pgmap v210: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:22.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:21 smithi112 ceph-mon[33313]: pgmap v210: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:23.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:23 smithi077 ceph-mon[26330]: pgmap v211: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-04-25T02:07:24.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:23 smithi112 ceph-mon[33313]: pgmap v211: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-04-25T02:07:25.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:25 smithi077 ceph-mon[26330]: pgmap v212: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-04-25T02:07:26.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:25 smithi112 ceph-mon[33313]: pgmap v212: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-04-25T02:07:27.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:27 smithi077 ceph-mon[26330]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-25T02:07:28.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:27 smithi112 ceph-mon[33313]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-25T02:07:30.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:29 smithi077 ceph-mon[26330]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-25T02:07:30.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:29 smithi112 ceph-mon[33313]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-25T02:07:31.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:30 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:07:31.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:30 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:07:32.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:31 smithi077 ceph-mon[26330]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-25T02:07:32.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:31 smithi112 ceph-mon[33313]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-25T02:07:33.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:33.342+0000 7f52197fa700 1 -- 172.21.15.77:0/4229526095 <== mgr.14208 v2:172.21.15.77:6800/310739264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f521c1013e0 con 0x7f520c0692a0 2024-04-25T02:07:33.350 INFO:teuthology.orchestra.run.smithi077.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:07:33.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:33.344+0000 7f5222b98700 1 -- 172.21.15.77:0/4229526095 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f520c0692a0 msgr2=0x7f520c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:33.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:33.344+0000 7f5222b98700 1 --2- 172.21.15.77:0/4229526095 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f520c0692a0 0x7f520c06b750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5208004990 tx=0x7f5208009ee0 comp rx=0 tx=0).stop 2024-04-25T02:07:33.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:33.344+0000 7f5222b98700 1 -- 172.21.15.77:0/4229526095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f521c0fbcc0 msgr2=0x7f521c10c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:33.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:33.344+0000 7f5222b98700 1 --2- 172.21.15.77:0/4229526095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f521c0fbcc0 0x7f521c10c830 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5210009150 tx=0x7f5210009e30 comp rx=0 tx=0).stop 2024-04-25T02:07:33.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:33.344+0000 7f5222b98700 1 -- 172.21.15.77:0/4229526095 shutdown_connections 2024-04-25T02:07:33.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:33.344+0000 7f5222b98700 1 --2- 172.21.15.77:0/4229526095 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f520c0692a0 0x7f520c06b750 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:33.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:33.344+0000 7f5222b98700 1 --2- 172.21.15.77:0/4229526095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f521c0fbcc0 0x7f521c10c830 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:33.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:33.344+0000 7f5222b98700 1 --2- 172.21.15.77:0/4229526095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f521c0fcf70 0x7f521c10cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:33.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:33.344+0000 7f5222b98700 1 -- 172.21.15.77:0/4229526095 >> 172.21.15.77:0/4229526095 conn(0x7f521c0f7440 msgr2=0x7f521c0f8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:33.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:33.344+0000 7f5222b98700 1 -- 172.21.15.77:0/4229526095 shutdown_connections 2024-04-25T02:07:33.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:33.345+0000 7f5222b98700 1 -- 172.21.15.77:0/4229526095 wait complete. 2024-04-25T02:07:34.211 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:33 smithi077 ceph-mon[26330]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-04-25T02:07:34.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:33 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:07:34.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:33 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:07:34.244 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -e sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-04-25T02:07:34.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:33 smithi112 ceph-mon[33313]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-04-25T02:07:34.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:33 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:07:34.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:33 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:07:34.594 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:07:34.975 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:34 smithi077 ceph-mon[26330]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:07:34.975 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:34 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:07:34.975 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:34 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:07:34.975 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:34 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:07:34.976 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:34 smithi077 ceph-mon[26330]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:07:35.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:34 smithi112 ceph-mon[33313]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:07:35.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:34 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:07:35.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:34 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:07:35.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:34 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:07:35.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:34 smithi112 ceph-mon[33313]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:07:36.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:35 smithi077 ceph-mon[26330]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-25T02:07:36.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:35 smithi112 ceph-mon[33313]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-25T02:07:38.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:37 smithi077 ceph-mon[26330]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-25T02:07:38.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:37 smithi112 ceph-mon[33313]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-25T02:07:40.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:39 smithi077 ceph-mon[26330]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-25T02:07:40.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:39 smithi112 ceph-mon[33313]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-25T02:07:42.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:41 smithi077 ceph-mon[26330]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-04-25T02:07:42.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:41 smithi112 ceph-mon[33313]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-04-25T02:07:44.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:43 smithi077 ceph-mon[26330]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-04-25T02:07:44.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:43 smithi112 ceph-mon[33313]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-04-25T02:07:45.892 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:45 smithi077 ceph-mon[26330]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:45.893 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:45 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:07:46.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:45 smithi112 ceph-mon[33313]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:46.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:45 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:07:46.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.260+0000 7f18913f5700 1 -- 172.21.15.77:0/473922431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f188c0ffee0 msgr2=0x7f188c102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:46.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.260+0000 7f18913f5700 1 --2- 172.21.15.77:0/473922431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f188c0ffee0 0x7f188c102300 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1880004940 tx=0x7f1880009e30 comp rx=0 tx=0).stop 2024-04-25T02:07:46.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.260+0000 7f18913f5700 1 -- 172.21.15.77:0/473922431 shutdown_connections 2024-04-25T02:07:46.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.260+0000 7f18913f5700 1 --2- 172.21.15.77:0/473922431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f188c0ffee0 0x7f188c102300 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:46.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.260+0000 7f18913f5700 1 --2- 172.21.15.77:0/473922431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f188c066ed0 0x7f188c0ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:46.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.260+0000 7f18913f5700 1 -- 172.21.15.77:0/473922431 >> 172.21.15.77:0/473922431 conn(0x7f188c0f7430 msgr2=0x7f188c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:46.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.260+0000 7f18913f5700 1 -- 172.21.15.77:0/473922431 shutdown_connections 2024-04-25T02:07:46.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.260+0000 7f18913f5700 1 -- 172.21.15.77:0/473922431 wait complete. 2024-04-25T02:07:46.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.261+0000 7f18913f5700 1 Processor -- start 2024-04-25T02:07:46.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.261+0000 7f18913f5700 1 -- start start 2024-04-25T02:07:46.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.261+0000 7f18913f5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f188c066ed0 0x7f188c10d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:46.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.261+0000 7f18913f5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f188c0ffee0 0x7f188c10dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:46.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.261+0000 7f18913f5700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c10e4a0 con 0x7f188c066ed0 2024-04-25T02:07:46.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.261+0000 7f18913f5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c10e610 con 0x7f188c0ffee0 2024-04-25T02:07:46.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.262+0000 7f188affd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f188c066ed0 0x7f188c10d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:46.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.262+0000 7f188affd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f188c066ed0 0x7f188c10d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41104/0 (socket says 172.21.15.77:41104) 2024-04-25T02:07:46.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.262+0000 7f188affd700 1 -- 172.21.15.77:0/3516668694 learned_addr learned my addr 172.21.15.77:0/3516668694 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:07:46.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.262+0000 7f188affd700 1 -- 172.21.15.77:0/3516668694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f188c0ffee0 msgr2=0x7f188c10dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:46.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.262+0000 7f188a7fc700 1 --2- 172.21.15.77:0/3516668694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f188c0ffee0 0x7f188c10dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:46.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.262+0000 7f188affd700 1 --2- 172.21.15.77:0/3516668694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f188c0ffee0 0x7f188c10dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:46.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.262+0000 7f188affd700 1 -- 172.21.15.77:0/3516668694 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1880005040 con 0x7f188c066ed0 2024-04-25T02:07:46.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.262+0000 7f188a7fc700 1 --2- 172.21.15.77:0/3516668694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f188c0ffee0 0x7f188c10dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:07:46.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.262+0000 7f188affd700 1 --2- 172.21.15.77:0/3516668694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f188c066ed0 0x7f188c10d960 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f187c00eb40 tx=0x7f187c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:46.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.262+0000 7f18737fe700 1 -- 172.21.15.77:0/3516668694 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f187c007cc0 con 0x7f188c066ed0 2024-04-25T02:07:46.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.262+0000 7f18737fe700 1 -- 172.21.15.77:0/3516668694 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f187c00f040 con 0x7f188c066ed0 2024-04-25T02:07:46.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.263+0000 7f18737fe700 1 -- 172.21.15.77:0/3516668694 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f187c0095e0 con 0x7f188c066ed0 2024-04-25T02:07:46.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.263+0000 7f18913f5700 1 -- 172.21.15.77:0/3516668694 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f188c112f70 con 0x7f188c066ed0 2024-04-25T02:07:46.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.263+0000 7f18913f5700 1 -- 172.21.15.77:0/3516668694 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f188c113420 con 0x7f188c066ed0 2024-04-25T02:07:46.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.265+0000 7f18913f5700 1 -- 172.21.15.77:0/3516668694 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f188c04c710 con 0x7f188c066ed0 2024-04-25T02:07:46.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.265+0000 7f18737fe700 1 -- 172.21.15.77:0/3516668694 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f187c009740 con 0x7f188c066ed0 2024-04-25T02:07:46.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.265+0000 7f18737fe700 1 --2- 172.21.15.77:0/3516668694 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f1874069090 0x7f187406b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:46.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.265+0000 7f18737fe700 1 -- 172.21.15.77:0/3516668694 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f187c086980 con 0x7f188c066ed0 2024-04-25T02:07:46.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.266+0000 7f188a7fc700 1 --2- 172.21.15.77:0/3516668694 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f1874069090 0x7f187406b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:46.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.266+0000 7f188a7fc700 1 --2- 172.21.15.77:0/3516668694 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f1874069090 0x7f187406b540 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1880013870 tx=0x7f1880009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:46.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.270+0000 7f18737fe700 1 -- 172.21.15.77:0/3516668694 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f187c0566f0 con 0x7f188c066ed0 2024-04-25T02:07:46.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.535+0000 7f18913f5700 1 -- 172.21.15.77:0/3516668694 --> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f188c113610 con 0x7f1874069090 2024-04-25T02:07:46.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.536+0000 7f18737fe700 1 -- 172.21.15.77:0/3516668694 <== mgr.14208 v2:172.21.15.77:6800/310739264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7f188c113610 con 0x7f1874069090 2024-04-25T02:07:46.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.539+0000 7f18913f5700 1 -- 172.21.15.77:0/3516668694 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f1874069090 msgr2=0x7f187406b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:46.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.539+0000 7f18913f5700 1 --2- 172.21.15.77:0/3516668694 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f1874069090 0x7f187406b540 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1880013870 tx=0x7f1880009e30 comp rx=0 tx=0).stop 2024-04-25T02:07:46.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.539+0000 7f18913f5700 1 -- 172.21.15.77:0/3516668694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f188c066ed0 msgr2=0x7f188c10d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:46.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.539+0000 7f18913f5700 1 --2- 172.21.15.77:0/3516668694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f188c066ed0 0x7f188c10d960 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f187c00eb40 tx=0x7f187c00b040 comp rx=0 tx=0).stop 2024-04-25T02:07:46.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.539+0000 7f18913f5700 1 -- 172.21.15.77:0/3516668694 shutdown_connections 2024-04-25T02:07:46.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.539+0000 7f18913f5700 1 --2- 172.21.15.77:0/3516668694 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f1874069090 0x7f187406b540 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:46.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.539+0000 7f18913f5700 1 --2- 172.21.15.77:0/3516668694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f188c066ed0 0x7f188c10d960 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:46.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.539+0000 7f18913f5700 1 --2- 172.21.15.77:0/3516668694 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f188c0ffee0 0x7f188c10dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:46.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.539+0000 7f18913f5700 1 -- 172.21.15.77:0/3516668694 >> 172.21.15.77:0/3516668694 conn(0x7f188c0f7430 msgr2=0x7f188c0f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:46.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.539+0000 7f18913f5700 1 -- 172.21.15.77:0/3516668694 shutdown_connections 2024-04-25T02:07:46.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.539+0000 7f18913f5700 1 -- 172.21.15.77:0/3516668694 wait complete. 2024-04-25T02:07:46.560 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-04-25T02:07:46.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.649+0000 7f8a01268700 1 -- 172.21.15.77:0/3090145362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89fc0662c0 msgr2=0x7f89fc0ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:46.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.649+0000 7f8a01268700 1 --2- 172.21.15.77:0/3090145362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89fc0662c0 0x7f89fc0ff9a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f89ec004940 tx=0x7f89ec009e30 comp rx=0 tx=0).stop 2024-04-25T02:07:46.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.649+0000 7f8a01268700 1 -- 172.21.15.77:0/3090145362 shutdown_connections 2024-04-25T02:07:46.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.649+0000 7f8a01268700 1 --2- 172.21.15.77:0/3090145362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89fc0ffee0 0x7f89fc102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:46.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.649+0000 7f8a01268700 1 --2- 172.21.15.77:0/3090145362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89fc0662c0 0x7f89fc0ff9a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:46.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.649+0000 7f8a01268700 1 -- 172.21.15.77:0/3090145362 >> 172.21.15.77:0/3090145362 conn(0x7f89fc0f7430 msgr2=0x7f89fc0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:46.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.649+0000 7f8a01268700 1 -- 172.21.15.77:0/3090145362 shutdown_connections 2024-04-25T02:07:46.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.649+0000 7f8a01268700 1 -- 172.21.15.77:0/3090145362 wait complete. 2024-04-25T02:07:46.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.650+0000 7f8a01268700 1 Processor -- start 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.650+0000 7f8a01268700 1 -- start start 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.650+0000 7f8a01268700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89fc0662c0 0x7f89fc06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.650+0000 7f8a01268700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89fc0ffee0 0x7f89fc06e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.650+0000 7f8a01268700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc06fea0 con 0x7f89fc0ffee0 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.650+0000 7f8a01268700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc06ffe0 con 0x7f89fc0662c0 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.651+0000 7f89faffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89fc0662c0 0x7f89fc06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.651+0000 7f89faffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89fc0662c0 0x7f89fc06e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.77:39888/0 (socket says 172.21.15.77:39888) 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.651+0000 7f89faffd700 1 -- 172.21.15.77:0/799480133 learned_addr learned my addr 172.21.15.77:0/799480133 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.651+0000 7f89fa7fc700 1 --2- 172.21.15.77:0/799480133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89fc0ffee0 0x7f89fc06e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.651+0000 7f89faffd700 1 -- 172.21.15.77:0/799480133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89fc0ffee0 msgr2=0x7f89fc06e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.651+0000 7f89faffd700 1 --2- 172.21.15.77:0/799480133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89fc0ffee0 0x7f89fc06e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.651+0000 7f89faffd700 1 -- 172.21.15.77:0/799480133 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec005040 con 0x7f89fc0662c0 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.651+0000 7f89faffd700 1 --2- 172.21.15.77:0/799480133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89fc0662c0 0x7f89fc06e3c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f89ec000c00 tx=0x7f89ec009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:46.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.651+0000 7f89e37fe700 1 -- 172.21.15.77:0/799480133 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89ec00e040 con 0x7f89fc0662c0 2024-04-25T02:07:46.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.652+0000 7f8a01268700 1 -- 172.21.15.77:0/799480133 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89fc06ee40 con 0x7f89fc0662c0 2024-04-25T02:07:46.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.652+0000 7f89e37fe700 1 -- 172.21.15.77:0/799480133 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f89ec00bbf0 con 0x7f89fc0662c0 2024-04-25T02:07:46.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.652+0000 7f89e37fe700 1 -- 172.21.15.77:0/799480133 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89ec01c630 con 0x7f89fc0662c0 2024-04-25T02:07:46.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.652+0000 7f8a01268700 1 -- 172.21.15.77:0/799480133 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89fc11e190 con 0x7f89fc0662c0 2024-04-25T02:07:46.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.652+0000 7f8a01268700 1 -- 172.21.15.77:0/799480133 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89fc05f5c0 con 0x7f89fc0662c0 2024-04-25T02:07:46.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.655+0000 7f89e37fe700 1 -- 172.21.15.77:0/799480133 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f89ec00bd60 con 0x7f89fc0662c0 2024-04-25T02:07:46.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.655+0000 7f89e37fe700 1 --2- 172.21.15.77:0/799480133 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f89e4069370 0x7f89e406b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:46.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.655+0000 7f89e37fe700 1 -- 172.21.15.77:0/799480133 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f89ec088700 con 0x7f89fc0662c0 2024-04-25T02:07:46.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.655+0000 7f89fa7fc700 1 --2- 172.21.15.77:0/799480133 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f89e4069370 0x7f89e406b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:46.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.656+0000 7f89fa7fc700 1 --2- 172.21.15.77:0/799480133 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f89e4069370 0x7f89e406b820 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f89f0009fd0 tx=0x7f89f000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:46.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.661+0000 7f89e37fe700 1 -- 172.21.15.77:0/799480133 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f89ec0549c0 con 0x7f89fc0662c0 2024-04-25T02:07:46.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.881+0000 7f8a01268700 1 -- 172.21.15.77:0/799480133 --> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f89fc0f8f20 con 0x7f89e4069370 2024-04-25T02:07:46.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.882+0000 7f89e37fe700 1 -- 172.21.15.77:0/799480133 <== mgr.14208 v2:172.21.15.77:6800/310739264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7f89fc0f8f20 con 0x7f89e4069370 2024-04-25T02:07:46.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.885+0000 7f8a01268700 1 -- 172.21.15.77:0/799480133 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f89e4069370 msgr2=0x7f89e406b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:46.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.885+0000 7f8a01268700 1 --2- 172.21.15.77:0/799480133 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f89e4069370 0x7f89e406b820 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f89f0009fd0 tx=0x7f89f000b040 comp rx=0 tx=0).stop 2024-04-25T02:07:46.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.885+0000 7f8a01268700 1 -- 172.21.15.77:0/799480133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89fc0662c0 msgr2=0x7f89fc06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:46.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.885+0000 7f8a01268700 1 --2- 172.21.15.77:0/799480133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89fc0662c0 0x7f89fc06e3c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f89ec000c00 tx=0x7f89ec009e30 comp rx=0 tx=0).stop 2024-04-25T02:07:46.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.885+0000 7f8a01268700 1 -- 172.21.15.77:0/799480133 shutdown_connections 2024-04-25T02:07:46.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.885+0000 7f8a01268700 1 --2- 172.21.15.77:0/799480133 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f89e4069370 0x7f89e406b820 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:46.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.885+0000 7f8a01268700 1 --2- 172.21.15.77:0/799480133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89fc0662c0 0x7f89fc06e3c0 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f89ec000c00 tx=0x7f89ec009e30 comp rx=0 tx=0).stop 2024-04-25T02:07:46.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.885+0000 7f8a01268700 1 --2- 172.21.15.77:0/799480133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89fc0ffee0 0x7f89fc06e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:46.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.885+0000 7f8a01268700 1 -- 172.21.15.77:0/799480133 >> 172.21.15.77:0/799480133 conn(0x7f89fc0f7430 msgr2=0x7f89fc0f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:46.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.886+0000 7f8a01268700 1 -- 172.21.15.77:0/799480133 shutdown_connections 2024-04-25T02:07:46.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:46.886+0000 7f8a01268700 1 -- 172.21.15.77:0/799480133 wait complete. 2024-04-25T02:07:47.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.036+0000 7faaa1d2f700 1 -- 172.21.15.77:0/2400695062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa9c0ffee0 msgr2=0x7faa9c102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:47.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.036+0000 7faaa1d2f700 1 --2- 172.21.15.77:0/2400695062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa9c0ffee0 0x7faa9c102300 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7faa90004940 tx=0x7faa90009e30 comp rx=0 tx=0).stop 2024-04-25T02:07:47.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.036+0000 7faaa1d2f700 1 -- 172.21.15.77:0/2400695062 shutdown_connections 2024-04-25T02:07:47.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.036+0000 7faaa1d2f700 1 --2- 172.21.15.77:0/2400695062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa9c0ffee0 0x7faa9c102300 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:47.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.036+0000 7faaa1d2f700 1 --2- 172.21.15.77:0/2400695062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa9c0662c0 0x7faa9c0ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:47.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.036+0000 7faaa1d2f700 1 -- 172.21.15.77:0/2400695062 >> 172.21.15.77:0/2400695062 conn(0x7faa9c0f7430 msgr2=0x7faa9c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:47.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.036+0000 7faaa1d2f700 1 -- 172.21.15.77:0/2400695062 shutdown_connections 2024-04-25T02:07:47.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.036+0000 7faaa1d2f700 1 -- 172.21.15.77:0/2400695062 wait complete. 2024-04-25T02:07:47.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.037+0000 7faaa1d2f700 1 Processor -- start 2024-04-25T02:07:47.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.037+0000 7faaa1d2f700 1 -- start start 2024-04-25T02:07:47.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.037+0000 7faaa1d2f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa9c0662c0 0x7faa9c10d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:47.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.037+0000 7faaa1d2f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa9c0ffee0 0x7faa9c10df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:47.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.038+0000 7faaa1d2f700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa9c10e510 con 0x7faa9c0662c0 2024-04-25T02:07:47.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.038+0000 7faaa1d2f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa9c10ed10 con 0x7faa9c0ffee0 2024-04-25T02:07:47.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.038+0000 7faa9b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa9c0662c0 0x7faa9c10d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:47.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.038+0000 7faa9affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa9c0ffee0 0x7faa9c10df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:47.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.038+0000 7faa9affd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa9c0ffee0 0x7faa9c10df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.77:39910/0 (socket says 172.21.15.77:39910) 2024-04-25T02:07:47.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.038+0000 7faa9affd700 1 -- 172.21.15.77:0/2654420270 learned_addr learned my addr 172.21.15.77:0/2654420270 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:07:47.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.038+0000 7faa9b7fe700 1 -- 172.21.15.77:0/2654420270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa9c0ffee0 msgr2=0x7faa9c10df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:47.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.038+0000 7faa9b7fe700 1 --2- 172.21.15.77:0/2654420270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa9c0ffee0 0x7faa9c10df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:47.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.038+0000 7faa9b7fe700 1 -- 172.21.15.77:0/2654420270 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa90005040 con 0x7faa9c0662c0 2024-04-25T02:07:47.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.038+0000 7faa9affd700 1 --2- 172.21.15.77:0/2654420270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa9c0ffee0 0x7faa9c10df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:47.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.038+0000 7faa9b7fe700 1 --2- 172.21.15.77:0/2654420270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa9c0662c0 0x7faa9c10d9d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7faa9c066000 tx=0x7faa8c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:47.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.039+0000 7faa83fff700 1 -- 172.21.15.77:0/2654420270 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa8c004e90 con 0x7faa9c0662c0 2024-04-25T02:07:47.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.039+0000 7faaa1d2f700 1 -- 172.21.15.77:0/2654420270 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa9c10ef90 con 0x7faa9c0662c0 2024-04-25T02:07:47.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.039+0000 7faaa1d2f700 1 -- 172.21.15.77:0/2654420270 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa9c10f4d0 con 0x7faa9c0662c0 2024-04-25T02:07:47.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.039+0000 7faa83fff700 1 -- 172.21.15.77:0/2654420270 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faa8c00f040 con 0x7faa9c0662c0 2024-04-25T02:07:47.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.039+0000 7faa83fff700 1 -- 172.21.15.77:0/2654420270 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa8c00ca20 con 0x7faa9c0662c0 2024-04-25T02:07:47.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.040+0000 7faaa1d2f700 1 -- 172.21.15.77:0/2654420270 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa9c05f5c0 con 0x7faa9c0662c0 2024-04-25T02:07:47.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.041+0000 7faa83fff700 1 -- 172.21.15.77:0/2654420270 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7faa8c007cc0 con 0x7faa9c0662c0 2024-04-25T02:07:47.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.042+0000 7faa83fff700 1 --2- 172.21.15.77:0/2654420270 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7faa840692b0 0x7faa8406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:47.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.042+0000 7faa9affd700 1 --2- 172.21.15.77:0/2654420270 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7faa840692b0 0x7faa8406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:47.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.042+0000 7faa83fff700 1 -- 172.21.15.77:0/2654420270 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7faa8c086bf0 con 0x7faa9c0662c0 2024-04-25T02:07:47.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.042+0000 7faa9affd700 1 --2- 172.21.15.77:0/2654420270 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7faa840692b0 0x7faa8406b760 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faa90013740 tx=0x7faa90009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:47.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.051+0000 7faa83fff700 1 -- 172.21.15.77:0/2654420270 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7faa8c04e250 con 0x7faa9c0662c0 2024-04-25T02:07:47.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.322+0000 7faaa1d2f700 1 -- 172.21.15.77:0/2654420270 --> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faa9c10f7b0 con 0x7faa840692b0 2024-04-25T02:07:47.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.333+0000 7faa83fff700 1 -- 172.21.15.77:0/2654420270 <== mgr.14208 v2:172.21.15.77:6800/310739264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7faa9c10f7b0 con 0x7faa840692b0 2024-04-25T02:07:47.341 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T02:07:47.341 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (5m) 68s ago 6m 24.4M - 0.25.0 c8568f914cd2 54c6f8f4d32d 2024-04-25T02:07:47.341 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (7m) 68s ago 7m 6665k - 17.2.7-902-gc61472c8 0de407c1b3af 2ad2e3d2b09e 2024-04-25T02:07:47.341 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi112 smithi112 running (6m) 75s ago 6m 6660k - 17.2.7-902-gc61472c8 0de407c1b3af 9235dc5eb15d 2024-04-25T02:07:47.341 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (5m) 68s ago 6m 85.0M - 9.4.7 954c08fa6188 d3b9c1566a82 2024-04-25T02:07:47.341 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.gcfygj smithi077 running (86s) 68s ago 85s 12.1M - 17.2.7-902-gc61472c8 0de407c1b3af 382dd7abf674 2024-04-25T02:07:47.341 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.oadrkb smithi077 running (93s) 68s ago 92s 10.4M - 17.2.7-902-gc61472c8 0de407c1b3af 6992064a4b2a 2024-04-25T02:07:47.342 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.dvwudt smithi112 running (90s) 75s ago 90s 16.6M - 17.2.7-902-gc61472c8 0de407c1b3af 0792e451abfd 2024-04-25T02:07:47.342 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.fjnadi smithi112 running (84s) 75s ago 83s 11.8M - 17.2.7-902-gc61472c8 0de407c1b3af c8093f622f6b 2024-04-25T02:07:47.342 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.zpflzp smithi077 *:9283 running (8m) 68s ago 8m 481M - 17.2.7-902-gc61472c8 0de407c1b3af 8c5e41dfcae2 2024-04-25T02:07:47.342 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi112.cswrxs smithi112 *:8443,9283 running (5m) 75s ago 5m 434M - 17.2.7-902-gc61472c8 0de407c1b3af afbb948e9239 2024-04-25T02:07:47.342 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (8m) 68s ago 8m 42.5M 2048M 17.2.7-902-gc61472c8 0de407c1b3af adb57965a306 2024-04-25T02:07:47.342 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi112 smithi112 running (5m) 75s ago 5m 32.2M 2048M 17.2.7-902-gc61472c8 0de407c1b3af db2fb9b09789 2024-04-25T02:07:47.342 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (7m) 68s ago 7m 15.3M - 1.5.0 0da6a335fe13 ec91684b7e6d 2024-04-25T02:07:47.342 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi112 smithi112 *:9100 running (6m) 75s ago 6m 16.4M - 1.5.0 0da6a335fe13 3a7c783c933b 2024-04-25T02:07:47.342 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (5m) 68s ago 5m 44.9M 4288M 17.2.7-902-gc61472c8 0de407c1b3af c741abec3b94 2024-04-25T02:07:47.342 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (4m) 68s ago 4m 44.7M 4288M 17.2.7-902-gc61472c8 0de407c1b3af 256ff3ced322 2024-04-25T02:07:47.342 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (4m) 68s ago 4m 47.4M 4288M 17.2.7-902-gc61472c8 0de407c1b3af c5d7d8c993f4 2024-04-25T02:07:47.342 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi112 running (3m) 75s ago 3m 44.4M 5312M 17.2.7-902-gc61472c8 0de407c1b3af 68429d0dbf88 2024-04-25T02:07:47.342 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi112 running (3m) 75s ago 3m 44.0M 5312M 17.2.7-902-gc61472c8 0de407c1b3af 66eb71201444 2024-04-25T02:07:47.342 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi112 running (3m) 75s ago 3m 41.6M 5312M 17.2.7-902-gc61472c8 0de407c1b3af 963e700d6aea 2024-04-25T02:07:47.343 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (5m) 68s ago 6m 51.4M - 2.43.0 a07b618ecd1d 85f5766c90c7 2024-04-25T02:07:47.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.336+0000 7faaa1d2f700 1 -- 172.21.15.77:0/2654420270 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7faa840692b0 msgr2=0x7faa8406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:47.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.336+0000 7faaa1d2f700 1 --2- 172.21.15.77:0/2654420270 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7faa840692b0 0x7faa8406b760 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faa90013740 tx=0x7faa90009e30 comp rx=0 tx=0).stop 2024-04-25T02:07:47.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.336+0000 7faaa1d2f700 1 -- 172.21.15.77:0/2654420270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa9c0662c0 msgr2=0x7faa9c10d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:47.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.336+0000 7faaa1d2f700 1 --2- 172.21.15.77:0/2654420270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa9c0662c0 0x7faa9c10d9d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7faa9c066000 tx=0x7faa8c00b040 comp rx=0 tx=0).stop 2024-04-25T02:07:47.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.336+0000 7faaa1d2f700 1 -- 172.21.15.77:0/2654420270 shutdown_connections 2024-04-25T02:07:47.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.336+0000 7faaa1d2f700 1 --2- 172.21.15.77:0/2654420270 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7faa840692b0 0x7faa8406b760 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:47.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.336+0000 7faaa1d2f700 1 --2- 172.21.15.77:0/2654420270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa9c0662c0 0x7faa9c10d9d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:47.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.336+0000 7faaa1d2f700 1 --2- 172.21.15.77:0/2654420270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa9c0ffee0 0x7faa9c10df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:47.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.336+0000 7faaa1d2f700 1 -- 172.21.15.77:0/2654420270 >> 172.21.15.77:0/2654420270 conn(0x7faa9c0f7430 msgr2=0x7faa9c0f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:47.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.336+0000 7faaa1d2f700 1 -- 172.21.15.77:0/2654420270 shutdown_connections 2024-04-25T02:07:47.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.336+0000 7faaa1d2f700 1 -- 172.21.15.77:0/2654420270 wait complete. 2024-04-25T02:07:47.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.442+0000 7f072affe700 1 -- 172.21.15.77:0/3105387211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07240fcf60 msgr2=0x7f07240fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:47.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.442+0000 7f072affe700 1 --2- 172.21.15.77:0/3105387211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07240fcf60 0x7f07240fd3d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0710004940 tx=0x7f0710009e30 comp rx=0 tx=0).stop 2024-04-25T02:07:47.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.442+0000 7f072affe700 1 -- 172.21.15.77:0/3105387211 shutdown_connections 2024-04-25T02:07:47.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.442+0000 7f072affe700 1 --2- 172.21.15.77:0/3105387211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07240fcf60 0x7f07240fd3d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:47.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.442+0000 7f072affe700 1 --2- 172.21.15.77:0/3105387211 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07240fbcb0 0x7f07240fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:47.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.442+0000 7f072affe700 1 -- 172.21.15.77:0/3105387211 >> 172.21.15.77:0/3105387211 conn(0x7f07240f7430 msgr2=0x7f07240f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:47.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.442+0000 7f072affe700 1 -- 172.21.15.77:0/3105387211 shutdown_connections 2024-04-25T02:07:47.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.442+0000 7f072affe700 1 -- 172.21.15.77:0/3105387211 wait complete. 2024-04-25T02:07:47.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.442+0000 7f072affe700 1 Processor -- start 2024-04-25T02:07:47.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.442+0000 7f072affe700 1 -- start start 2024-04-25T02:07:47.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.443+0000 7f072affe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07240fbcb0 0x7f07240ffd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:47.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.443+0000 7f072affe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07240fcf60 0x7f07240fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:47.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.443+0000 7f072affe700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07241116f0 con 0x7f07240fbcb0 2024-04-25T02:07:47.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.443+0000 7f072affe700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0724111830 con 0x7f07240fcf60 2024-04-25T02:07:47.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.443+0000 7f0728d9a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07240fbcb0 0x7f07240ffd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:47.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.443+0000 7f0728d9a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07240fbcb0 0x7f07240ffd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36294/0 (socket says 172.21.15.77:36294) 2024-04-25T02:07:47.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.443+0000 7f0728d9a700 1 -- 172.21.15.77:0/1710110138 learned_addr learned my addr 172.21.15.77:0/1710110138 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:07:47.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.443+0000 7f0723fff700 1 --2- 172.21.15.77:0/1710110138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07240fcf60 0x7f07240fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:47.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.443+0000 7f0728d9a700 1 -- 172.21.15.77:0/1710110138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07240fcf60 msgr2=0x7f07240fe2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:47.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.443+0000 7f0728d9a700 1 --2- 172.21.15.77:0/1710110138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07240fcf60 0x7f07240fe2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:47.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.443+0000 7f0728d9a700 1 -- 172.21.15.77:0/1710110138 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0710005040 con 0x7f07240fbcb0 2024-04-25T02:07:47.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.444+0000 7f0728d9a700 1 --2- 172.21.15.77:0/1710110138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07240fbcb0 0x7f07240ffd80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0718002a50 tx=0x7f07180046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:47.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.444+0000 7f07217fa700 1 -- 172.21.15.77:0/1710110138 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0718007cc0 con 0x7f07240fbcb0 2024-04-25T02:07:47.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.444+0000 7f07217fa700 1 -- 172.21.15.77:0/1710110138 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f071800f040 con 0x7f07240fbcb0 2024-04-25T02:07:47.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.444+0000 7f07217fa700 1 -- 172.21.15.77:0/1710110138 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f071800da30 con 0x7f07240fbcb0 2024-04-25T02:07:47.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.444+0000 7f072affe700 1 -- 172.21.15.77:0/1710110138 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07240fe8a0 con 0x7f07240fbcb0 2024-04-25T02:07:47.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.444+0000 7f072affe700 1 -- 172.21.15.77:0/1710110138 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07240fee30 con 0x7f07240fbcb0 2024-04-25T02:07:47.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.445+0000 7f072affe700 1 -- 172.21.15.77:0/1710110138 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0724101af0 con 0x7f07240fbcb0 2024-04-25T02:07:47.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.446+0000 7f07217fa700 1 -- 172.21.15.77:0/1710110138 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f071800dbb0 con 0x7f07240fbcb0 2024-04-25T02:07:47.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.446+0000 7f07217fa700 1 --2- 172.21.15.77:0/1710110138 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f07140692a0 0x7f071406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:47.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.447+0000 7f07217fa700 1 -- 172.21.15.77:0/1710110138 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0718086ee0 con 0x7f07240fbcb0 2024-04-25T02:07:47.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.447+0000 7f0723fff700 1 --2- 172.21.15.77:0/1710110138 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f07140692a0 0x7f071406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:47.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.447+0000 7f0723fff700 1 --2- 172.21.15.77:0/1710110138 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f07140692a0 0x7f071406b750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f071000b970 tx=0x7f0710009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:47.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.454+0000 7f07217fa700 1 -- 172.21.15.77:0/1710110138 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0718056c50 con 0x7f07240fbcb0 2024-04-25T02:07:47.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.950+0000 7f072affe700 1 -- 172.21.15.77:0/1710110138 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f07241047a0 con 0x7f07240fbcb0 2024-04-25T02:07:47.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.951+0000 7f07217fa700 1 -- 172.21.15.77:0/1710110138 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f07180567e0 con 0x7f07240fbcb0 2024-04-25T02:07:47.958 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:07:47.958 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-04-25T02:07:47.958 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2 2024-04-25T02:07:47.958 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:07:47.958 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-04-25T02:07:47.959 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2 2024-04-25T02:07:47.959 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:07:47.959 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-04-25T02:07:47.959 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 6 2024-04-25T02:07:47.959 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:07:47.959 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-04-25T02:07:47.959 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T02:07:47.959 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:07:47.959 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-04-25T02:07:47.959 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 14 2024-04-25T02:07:47.959 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-25T02:07:47.959 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:07:47.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.953+0000 7f072affe700 1 -- 172.21.15.77:0/1710110138 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f07140692a0 msgr2=0x7f071406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:47.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.953+0000 7f072affe700 1 --2- 172.21.15.77:0/1710110138 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f07140692a0 0x7f071406b750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f071000b970 tx=0x7f0710009e30 comp rx=0 tx=0).stop 2024-04-25T02:07:47.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.953+0000 7f072affe700 1 -- 172.21.15.77:0/1710110138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07240fbcb0 msgr2=0x7f07240ffd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:47.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.954+0000 7f072affe700 1 --2- 172.21.15.77:0/1710110138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07240fbcb0 0x7f07240ffd80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0718002a50 tx=0x7f07180046b0 comp rx=0 tx=0).stop 2024-04-25T02:07:47.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.954+0000 7f072affe700 1 -- 172.21.15.77:0/1710110138 shutdown_connections 2024-04-25T02:07:47.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.954+0000 7f072affe700 1 --2- 172.21.15.77:0/1710110138 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f07140692a0 0x7f071406b750 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:47.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.954+0000 7f072affe700 1 --2- 172.21.15.77:0/1710110138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07240fbcb0 0x7f07240ffd80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:47.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.954+0000 7f072affe700 1 --2- 172.21.15.77:0/1710110138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07240fcf60 0x7f07240fe2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:47.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.954+0000 7f072affe700 1 -- 172.21.15.77:0/1710110138 >> 172.21.15.77:0/1710110138 conn(0x7f07240f7430 msgr2=0x7f0724065bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:47.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.954+0000 7f072affe700 1 -- 172.21.15.77:0/1710110138 shutdown_connections 2024-04-25T02:07:47.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:47.954+0000 7f072affe700 1 -- 172.21.15.77:0/1710110138 wait complete. 2024-04-25T02:07:48.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.089+0000 7f794bd20700 1 -- 172.21.15.77:0/3324518970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7944066260 msgr2=0x7f7944101e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:48.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.089+0000 7f794bd20700 1 --2- 172.21.15.77:0/3324518970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7944066260 0x7f7944101e00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7940004940 tx=0x7f7940009e30 comp rx=0 tx=0).stop 2024-04-25T02:07:48.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.089+0000 7f794bd20700 1 -- 172.21.15.77:0/3324518970 shutdown_connections 2024-04-25T02:07:48.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.089+0000 7f794bd20700 1 --2- 172.21.15.77:0/3324518970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7944102340 0x7f7944104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:48.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.089+0000 7f794bd20700 1 --2- 172.21.15.77:0/3324518970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7944066260 0x7f7944101e00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:48.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.089+0000 7f794bd20700 1 -- 172.21.15.77:0/3324518970 >> 172.21.15.77:0/3324518970 conn(0x7f79440f7430 msgr2=0x7f79440f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:48.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.089+0000 7f794bd20700 1 -- 172.21.15.77:0/3324518970 shutdown_connections 2024-04-25T02:07:48.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.089+0000 7f794bd20700 1 -- 172.21.15.77:0/3324518970 wait complete. 2024-04-25T02:07:48.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.090+0000 7f794bd20700 1 Processor -- start 2024-04-25T02:07:48.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.090+0000 7f794bd20700 1 -- start start 2024-04-25T02:07:48.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.090+0000 7f794bd20700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7944102340 0x7f794410fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:48.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.090+0000 7f794bd20700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79441102f0 0x7f7944111060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:48.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.090+0000 7f794bd20700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79441107b0 con 0x7f79441102f0 2024-04-25T02:07:48.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.090+0000 7f794bd20700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7944110920 con 0x7f7944102340 2024-04-25T02:07:48.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.091+0000 7f7949abc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7944102340 0x7f794410fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:48.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.091+0000 7f79492bb700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79441102f0 0x7f7944111060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:48.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.091+0000 7f79492bb700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79441102f0 0x7f7944111060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36310/0 (socket says 172.21.15.77:36310) 2024-04-25T02:07:48.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.091+0000 7f79492bb700 1 -- 172.21.15.77:0/388936675 learned_addr learned my addr 172.21.15.77:0/388936675 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:07:48.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.091+0000 7f79492bb700 1 -- 172.21.15.77:0/388936675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7944102340 msgr2=0x7f794410fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:48.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.091+0000 7f79492bb700 1 --2- 172.21.15.77:0/388936675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7944102340 0x7f794410fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:48.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.091+0000 7f79492bb700 1 -- 172.21.15.77:0/388936675 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7940005040 con 0x7f79441102f0 2024-04-25T02:07:48.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.091+0000 7f79492bb700 1 --2- 172.21.15.77:0/388936675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79441102f0 0x7f7944111060 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f793400eb40 tx=0x7f793400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:48.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.091+0000 7f793a7fc700 1 -- 172.21.15.77:0/388936675 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7934007cc0 con 0x7f79441102f0 2024-04-25T02:07:48.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.092+0000 7f793a7fc700 1 -- 172.21.15.77:0/388936675 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f793400f040 con 0x7f79441102f0 2024-04-25T02:07:48.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.092+0000 7f794bd20700 1 -- 172.21.15.77:0/388936675 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79441116e0 con 0x7f79441102f0 2024-04-25T02:07:48.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.092+0000 7f794bd20700 1 -- 172.21.15.77:0/388936675 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7944111bf0 con 0x7f79441102f0 2024-04-25T02:07:48.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.092+0000 7f793a7fc700 1 -- 172.21.15.77:0/388936675 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79340095e0 con 0x7f79441102f0 2024-04-25T02:07:48.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.093+0000 7f794bd20700 1 -- 172.21.15.77:0/388936675 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79280052e0 con 0x7f79441102f0 2024-04-25T02:07:48.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.094+0000 7f793a7fc700 1 -- 172.21.15.77:0/388936675 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f7934009740 con 0x7f79441102f0 2024-04-25T02:07:48.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.094+0000 7f793a7fc700 1 --2- 172.21.15.77:0/388936675 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f7930069370 0x7f793006b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:48.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.094+0000 7f793a7fc700 1 -- 172.21.15.77:0/388936675 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f7934086b60 con 0x7f79441102f0 2024-04-25T02:07:48.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.095+0000 7f7949abc700 1 --2- 172.21.15.77:0/388936675 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f7930069370 0x7f793006b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:48.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.095+0000 7f7949abc700 1 --2- 172.21.15.77:0/388936675 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f7930069370 0x7f793006b820 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7940009fd0 tx=0x7f7940009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:48.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.099+0000 7f793a7fc700 1 -- 172.21.15.77:0/388936675 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7934052ee0 con 0x7f79441102f0 2024-04-25T02:07:48.207 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:47 smithi112 ceph-mon[33313]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:48.207 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:47 smithi112 ceph-mon[33313]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:07:48.207 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:47 smithi112 ceph-mon[33313]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:07:48.207 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:47 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:07:48.207 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:47 smithi112 ceph-mon[33313]: Upgrade: Target is version 19.0.0-2445-gd2c45d97 (unknown) 2024-04-25T02:07:48.207 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:47 smithi112 ceph-mon[33313]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901'] 2024-04-25T02:07:48.207 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:47 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:07:48.208 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:47 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:07:48.208 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:47 smithi112 ceph-mon[33313]: Upgrade: Need to upgrade myself (mgr.smithi077.zpflzp) 2024-04-25T02:07:48.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:47 smithi077 ceph-mon[26330]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:48.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:47 smithi077 ceph-mon[26330]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:07:48.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:47 smithi077 ceph-mon[26330]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:07:48.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:47 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:07:48.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:47 smithi077 ceph-mon[26330]: Upgrade: Target is version 19.0.0-2445-gd2c45d97 (unknown) 2024-04-25T02:07:48.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:47 smithi077 ceph-mon[26330]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901'] 2024-04-25T02:07:48.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:47 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:07:48.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:47 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:07:48.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:47 smithi077 ceph-mon[26330]: Upgrade: Need to upgrade myself (mgr.smithi077.zpflzp) 2024-04-25T02:07:48.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.330+0000 7f794bd20700 1 -- 172.21.15.77:0/388936675 --> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7928000bf0 con 0x7f7930069370 2024-04-25T02:07:48.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.331+0000 7f793a7fc700 1 -- 172.21.15.77:0/388936675 <== mgr.14208 v2:172.21.15.77:6800/310739264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f7928000bf0 con 0x7f7930069370 2024-04-25T02:07:48.339 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:07:48.339 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901", 2024-04-25T02:07:48.339 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-04-25T02:07:48.339 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-25T02:07:48.339 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [], 2024-04-25T02:07:48.339 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "0/2 daemons upgraded", 2024-04-25T02:07:48.339 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 image on host smithi112", 2024-04-25T02:07:48.339 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-04-25T02:07:48.339 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:07:48.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.334+0000 7f794bd20700 1 -- 172.21.15.77:0/388936675 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f7930069370 msgr2=0x7f793006b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:48.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.334+0000 7f794bd20700 1 --2- 172.21.15.77:0/388936675 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f7930069370 0x7f793006b820 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7940009fd0 tx=0x7f7940009e30 comp rx=0 tx=0).stop 2024-04-25T02:07:48.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.334+0000 7f794bd20700 1 -- 172.21.15.77:0/388936675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79441102f0 msgr2=0x7f7944111060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:48.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.334+0000 7f794bd20700 1 --2- 172.21.15.77:0/388936675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79441102f0 0x7f7944111060 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f793400eb40 tx=0x7f793400b040 comp rx=0 tx=0).stop 2024-04-25T02:07:48.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.334+0000 7f794bd20700 1 -- 172.21.15.77:0/388936675 shutdown_connections 2024-04-25T02:07:48.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.334+0000 7f794bd20700 1 --2- 172.21.15.77:0/388936675 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f7930069370 0x7f793006b820 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:48.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.334+0000 7f794bd20700 1 --2- 172.21.15.77:0/388936675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7944102340 0x7f794410fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:48.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.334+0000 7f794bd20700 1 --2- 172.21.15.77:0/388936675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79441102f0 0x7f7944111060 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:48.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.334+0000 7f794bd20700 1 -- 172.21.15.77:0/388936675 >> 172.21.15.77:0/388936675 conn(0x7f79440f7430 msgr2=0x7f79440f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:48.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.334+0000 7f794bd20700 1 -- 172.21.15.77:0/388936675 shutdown_connections 2024-04-25T02:07:48.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:07:48.334+0000 7f794bd20700 1 -- 172.21.15.77:0/388936675 wait complete. 2024-04-25T02:07:49.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:48 smithi077 ceph-mon[26330]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 on smithi112 2024-04-25T02:07:49.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:48 smithi077 ceph-mon[26330]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:07:49.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:48 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/1710110138' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:07:49.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:48 smithi112 ceph-mon[33313]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 on smithi112 2024-04-25T02:07:49.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:48 smithi112 ceph-mon[33313]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:07:49.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:48 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/1710110138' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:07:50.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:49 smithi077 ceph-mon[26330]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:07:50.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:49 smithi077 ceph-mon[26330]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:50.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:49 smithi112 ceph-mon[33313]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:07:50.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:49 smithi112 ceph-mon[33313]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:52.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:51 smithi077 ceph-mon[26330]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:52.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:51 smithi112 ceph-mon[33313]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:54.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:53 smithi077 ceph-mon[26330]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:54.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:53 smithi112 ceph-mon[33313]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:56.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:55 smithi077 ceph-mon[26330]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:56.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:55 smithi112 ceph-mon[33313]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:58.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:57 smithi077 ceph-mon[26330]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:07:58.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:57 smithi112 ceph-mon[33313]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:08:00.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:07:59 smithi112 ceph-mon[33313]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:08:00.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:07:59 smithi077 ceph-mon[26330]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:08:00.672 INFO:tasks.workunit.client.1.smithi112.stderr:Updating files: 98% (12250/12492) Updating files: 99% (12368/12492) Updating files: 100% (12492/12492) Updating files: 100% (12492/12492), done. 2024-04-25T02:08:01.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:00 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:08:01.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:00 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:08:01.339 INFO:tasks.workunit.client.0.smithi077.stderr:Note: switching to 'd2c45d977142e024a59b68a8f1dce8f0b9840551'. 2024-04-25T02:08:01.339 INFO:tasks.workunit.client.0.smithi077.stderr: 2024-04-25T02:08:01.339 INFO:tasks.workunit.client.0.smithi077.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T02:08:01.339 INFO:tasks.workunit.client.0.smithi077.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T02:08:01.339 INFO:tasks.workunit.client.0.smithi077.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T02:08:01.340 INFO:tasks.workunit.client.0.smithi077.stderr: 2024-04-25T02:08:01.340 INFO:tasks.workunit.client.0.smithi077.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T02:08:01.340 INFO:tasks.workunit.client.0.smithi077.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T02:08:01.340 INFO:tasks.workunit.client.0.smithi077.stderr: 2024-04-25T02:08:01.340 INFO:tasks.workunit.client.0.smithi077.stderr: git switch -c 2024-04-25T02:08:01.340 INFO:tasks.workunit.client.0.smithi077.stderr: 2024-04-25T02:08:01.340 INFO:tasks.workunit.client.0.smithi077.stderr:Or undo this operation with: 2024-04-25T02:08:01.340 INFO:tasks.workunit.client.0.smithi077.stderr: 2024-04-25T02:08:01.340 INFO:tasks.workunit.client.0.smithi077.stderr: git switch - 2024-04-25T02:08:01.340 INFO:tasks.workunit.client.0.smithi077.stderr: 2024-04-25T02:08:01.340 INFO:tasks.workunit.client.0.smithi077.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T02:08:01.340 INFO:tasks.workunit.client.0.smithi077.stderr: 2024-04-25T02:08:01.340 INFO:tasks.workunit.client.0.smithi077.stderr:HEAD is now at d2c45d97714 Merge pull request #56528 from adk3798/squid-mypy-bump 2024-04-25T02:08:01.343 DEBUG:teuthology.orchestra.run.smithi077:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-25T02:08:01.362 INFO:tasks.workunit.client.1.smithi112.stderr:Note: switching to 'd2c45d977142e024a59b68a8f1dce8f0b9840551'. 2024-04-25T02:08:01.362 INFO:tasks.workunit.client.1.smithi112.stderr: 2024-04-25T02:08:01.362 INFO:tasks.workunit.client.1.smithi112.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T02:08:01.363 INFO:tasks.workunit.client.1.smithi112.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T02:08:01.363 INFO:tasks.workunit.client.1.smithi112.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T02:08:01.363 INFO:tasks.workunit.client.1.smithi112.stderr: 2024-04-25T02:08:01.363 INFO:tasks.workunit.client.1.smithi112.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T02:08:01.363 INFO:tasks.workunit.client.1.smithi112.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T02:08:01.363 INFO:tasks.workunit.client.1.smithi112.stderr: 2024-04-25T02:08:01.363 INFO:tasks.workunit.client.1.smithi112.stderr: git switch -c 2024-04-25T02:08:01.363 INFO:tasks.workunit.client.1.smithi112.stderr: 2024-04-25T02:08:01.363 INFO:tasks.workunit.client.1.smithi112.stderr:Or undo this operation with: 2024-04-25T02:08:01.363 INFO:tasks.workunit.client.1.smithi112.stderr: 2024-04-25T02:08:01.363 INFO:tasks.workunit.client.1.smithi112.stderr: git switch - 2024-04-25T02:08:01.363 INFO:tasks.workunit.client.1.smithi112.stderr: 2024-04-25T02:08:01.363 INFO:tasks.workunit.client.1.smithi112.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T02:08:01.363 INFO:tasks.workunit.client.1.smithi112.stderr: 2024-04-25T02:08:01.363 INFO:tasks.workunit.client.1.smithi112.stderr:HEAD is now at d2c45d97714 Merge pull request #56528 from adk3798/squid-mypy-bump 2024-04-25T02:08:01.366 DEBUG:teuthology.orchestra.run.smithi112:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-04-25T02:08:01.368 INFO:tasks.workunit.client.0.smithi077.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-25T02:08:01.370 INFO:tasks.workunit.client.0.smithi077.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T02:08:01.370 INFO:tasks.workunit.client.0.smithi077.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-25T02:08:01.475 INFO:tasks.workunit.client.1.smithi112.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-25T02:08:01.477 INFO:tasks.workunit.client.1.smithi112.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-25T02:08:01.477 INFO:tasks.workunit.client.1.smithi112.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-25T02:08:02.073 INFO:tasks.workunit.client.0.smithi077.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-25T02:08:02.111 INFO:tasks.workunit.client.1.smithi112.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-25T02:08:02.129 INFO:tasks.workunit.client.0.smithi077.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-25T02:08:02.163 INFO:tasks.workunit.client.1.smithi112.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-25T02:08:02.170 INFO:tasks.workunit.client.0.smithi077.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T02:08:02.171 INFO:tasks.workunit.client.0.smithi077.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T02:08:02.173 INFO:tasks.workunit.client.0.smithi077.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-25T02:08:02.202 INFO:tasks.workunit.client.1.smithi112.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-25T02:08:02.203 INFO:tasks.workunit.client.1.smithi112.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-25T02:08:02.204 INFO:tasks.workunit.client.1.smithi112.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-25T02:08:02.210 INFO:tasks.workunit.client.0.smithi077.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T02:08:02.213 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T02:08:02.213 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-25T02:08:02.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:01 smithi077 ceph-mon[26330]: pgmap v230: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:08:02.243 INFO:tasks.workunit.client.1.smithi112.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-25T02:08:02.245 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-25T02:08:02.246 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-25T02:08:02.246 DEBUG:teuthology.orchestra.run.smithi077:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2c45d977142e024a59b68a8f1dce8f0b9840551 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-25T02:08:02.248 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T02:08:02.248 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-04-25T02:08:02.262 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-04-25T02:08:02.264 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-25T02:08:02.264 DEBUG:teuthology.orchestra.run.smithi112:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2c45d977142e024a59b68a8f1dce8f0b9840551 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-04-25T02:08:02.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:01 smithi112 ceph-mon[33313]: pgmap v230: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:08:02.299 INFO:tasks.workunit.client.1.smithi112.stderr:+ mkdir -p fsstress 2024-04-25T02:08:02.301 INFO:tasks.workunit.client.1.smithi112.stderr:+ pushd fsstress 2024-04-25T02:08:02.301 INFO:tasks.workunit.client.1.smithi112.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-25T02:08:02.301 INFO:tasks.workunit.client.1.smithi112.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-25T02:08:02.306 INFO:tasks.workunit.client.0.smithi077.stderr:+ mkdir -p fsstress 2024-04-25T02:08:02.308 INFO:tasks.workunit.client.0.smithi077.stderr:+ pushd fsstress 2024-04-25T02:08:02.308 INFO:tasks.workunit.client.0.smithi077.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T02:08:02.308 INFO:tasks.workunit.client.0.smithi077.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-25T02:08:02.824 INFO:tasks.workunit.client.0.smithi077.stderr:+ tar xzf ltp-full.tgz 2024-04-25T02:08:04.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:03 smithi077 ceph-mon[26330]: pgmap v231: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:08:04.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:03 smithi112 ceph-mon[33313]: pgmap v231: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:08:05.527 INFO:tasks.workunit.client.1.smithi112.stderr:+ tar xzf ltp-full.tgz 2024-04-25T02:08:06.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:05 smithi077 ceph-mon[26330]: pgmap v232: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:08:06.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:05 smithi112 ceph-mon[33313]: pgmap v232: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:08:08.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:07 smithi077 ceph-mon[26330]: pgmap v233: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 KiB/s wr, 0 op/s 2024-04-25T02:08:08.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:07 smithi112 ceph-mon[33313]: pgmap v233: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 KiB/s wr, 0 op/s 2024-04-25T02:08:10.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:09 smithi077 ceph-mon[26330]: pgmap v234: 65 pgs: 65 active+clean; 12 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s wr, 56 op/s 2024-04-25T02:08:10.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:09 smithi112 ceph-mon[33313]: pgmap v234: 65 pgs: 65 active+clean; 12 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s wr, 56 op/s 2024-04-25T02:08:12.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:11 smithi077 ceph-mon[26330]: pgmap v235: 65 pgs: 65 active+clean; 40 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.4 MiB/s wr, 253 op/s 2024-04-25T02:08:12.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:11 smithi112 ceph-mon[33313]: pgmap v235: 65 pgs: 65 active+clean; 40 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.4 MiB/s wr, 253 op/s 2024-04-25T02:08:14.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:13 smithi077 ceph-mon[26330]: pgmap v236: 65 pgs: 65 active+clean; 64 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 5.6 MiB/s wr, 448 op/s 2024-04-25T02:08:14.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:13 smithi112 ceph-mon[33313]: pgmap v236: 65 pgs: 65 active+clean; 64 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 5.6 MiB/s wr, 448 op/s 2024-04-25T02:08:16.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:15 smithi077 ceph-mon[26330]: pgmap v237: 65 pgs: 65 active+clean; 68 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 5.9 MiB/s wr, 451 op/s 2024-04-25T02:08:16.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:15 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:08:16.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:15 smithi112 ceph-mon[33313]: pgmap v237: 65 pgs: 65 active+clean; 68 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 5.9 MiB/s wr, 451 op/s 2024-04-25T02:08:16.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:15 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:08:18.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:17 smithi077 ceph-mon[26330]: pgmap v238: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.8 MiB/s wr, 464 op/s 2024-04-25T02:08:18.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:17 smithi112 ceph-mon[33313]: pgmap v238: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.8 MiB/s wr, 464 op/s 2024-04-25T02:08:18.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.458+0000 7f7c31c4e700 1 -- 172.21.15.77:0/2594731887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c2c066e70 msgr2=0x7f7c2c0ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:18.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.458+0000 7f7c31c4e700 1 --2- 172.21.15.77:0/2594731887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c2c066e70 0x7f7c2c0ffaa0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7c20004940 tx=0x7f7c20009e30 comp rx=0 tx=0).stop 2024-04-25T02:08:18.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.458+0000 7f7c31c4e700 1 -- 172.21.15.77:0/2594731887 shutdown_connections 2024-04-25T02:08:18.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.458+0000 7f7c31c4e700 1 --2- 172.21.15.77:0/2594731887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c2c0fffe0 0x7f7c2c1023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:18.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.458+0000 7f7c31c4e700 1 --2- 172.21.15.77:0/2594731887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c2c066e70 0x7f7c2c0ffaa0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:18.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.458+0000 7f7c31c4e700 1 -- 172.21.15.77:0/2594731887 >> 172.21.15.77:0/2594731887 conn(0x7f7c2c0f7450 msgr2=0x7f7c2c0f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:18.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.458+0000 7f7c31c4e700 1 -- 172.21.15.77:0/2594731887 shutdown_connections 2024-04-25T02:08:18.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.458+0000 7f7c31c4e700 1 -- 172.21.15.77:0/2594731887 wait complete. 2024-04-25T02:08:18.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.459+0000 7f7c31c4e700 1 Processor -- start 2024-04-25T02:08:18.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.459+0000 7f7c31c4e700 1 -- start start 2024-04-25T02:08:18.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.459+0000 7f7c31c4e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c2c066e70 0x7f7c2c10d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:18.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.459+0000 7f7c31c4e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c2c0fffe0 0x7f7c2c10dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:18.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.459+0000 7f7c31c4e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c10e4a0 con 0x7f7c2c066e70 2024-04-25T02:08:18.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.459+0000 7f7c31c4e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c10e610 con 0x7f7c2c0fffe0 2024-04-25T02:08:18.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.459+0000 7f7c2b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c2c066e70 0x7f7c2c10d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:18.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.460+0000 7f7c2b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c2c066e70 0x7f7c2c10d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37052/0 (socket says 172.21.15.77:37052) 2024-04-25T02:08:18.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.460+0000 7f7c2b7fe700 1 -- 172.21.15.77:0/996304129 learned_addr learned my addr 172.21.15.77:0/996304129 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:08:18.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.460+0000 7f7c2affd700 1 --2- 172.21.15.77:0/996304129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c2c0fffe0 0x7f7c2c10dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:18.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.460+0000 7f7c2b7fe700 1 -- 172.21.15.77:0/996304129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c2c0fffe0 msgr2=0x7f7c2c10dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:18.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.460+0000 7f7c2b7fe700 1 --2- 172.21.15.77:0/996304129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c2c0fffe0 0x7f7c2c10dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:18.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.460+0000 7f7c2b7fe700 1 -- 172.21.15.77:0/996304129 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c20005040 con 0x7f7c2c066e70 2024-04-25T02:08:18.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.460+0000 7f7c2b7fe700 1 --2- 172.21.15.77:0/996304129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c2c066e70 0x7f7c2c10d960 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7c20000c00 tx=0x7f7c20009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:18.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.460+0000 7f7c13fff700 1 -- 172.21.15.77:0/996304129 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c2000e030 con 0x7f7c2c066e70 2024-04-25T02:08:18.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.460+0000 7f7c13fff700 1 -- 172.21.15.77:0/996304129 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7c20013de0 con 0x7f7c2c066e70 2024-04-25T02:08:18.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.460+0000 7f7c31c4e700 1 -- 172.21.15.77:0/996304129 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2c112fc0 con 0x7f7c2c066e70 2024-04-25T02:08:18.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.460+0000 7f7c13fff700 1 -- 172.21.15.77:0/996304129 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c2001ce50 con 0x7f7c2c066e70 2024-04-25T02:08:18.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.460+0000 7f7c31c4e700 1 -- 172.21.15.77:0/996304129 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2c113470 con 0x7f7c2c066e70 2024-04-25T02:08:18.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.461+0000 7f7c31c4e700 1 -- 172.21.15.77:0/996304129 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c2c04c710 con 0x7f7c2c066e70 2024-04-25T02:08:18.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.462+0000 7f7c13fff700 1 -- 172.21.15.77:0/996304129 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f7c2001c400 con 0x7f7c2c066e70 2024-04-25T02:08:18.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.462+0000 7f7c13fff700 1 --2- 172.21.15.77:0/996304129 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f7c140692a0 0x7f7c1406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:18.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.462+0000 7f7c13fff700 1 -- 172.21.15.77:0/996304129 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f7c20088b70 con 0x7f7c2c066e70 2024-04-25T02:08:18.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.463+0000 7f7c2affd700 1 --2- 172.21.15.77:0/996304129 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f7c140692a0 0x7f7c1406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:18.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.463+0000 7f7c2affd700 1 --2- 172.21.15.77:0/996304129 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f7c140692a0 0x7f7c1406b750 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009b80 tx=0x7f7c1c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:18.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.467+0000 7f7c13fff700 1 -- 172.21.15.77:0/996304129 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7c200588e0 con 0x7f7c2c066e70 2024-04-25T02:08:18.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.783+0000 7f7c31c4e700 1 -- 172.21.15.77:0/996304129 --> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c2c113690 con 0x7f7c140692a0 2024-04-25T02:08:18.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.785+0000 7f7c13fff700 1 -- 172.21.15.77:0/996304129 <== mgr.14208 v2:172.21.15.77:6800/310739264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f7c2c113690 con 0x7f7c140692a0 2024-04-25T02:08:18.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.791+0000 7f7c31c4e700 1 -- 172.21.15.77:0/996304129 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f7c140692a0 msgr2=0x7f7c1406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:18.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.791+0000 7f7c31c4e700 1 --2- 172.21.15.77:0/996304129 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f7c140692a0 0x7f7c1406b750 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009b80 tx=0x7f7c1c00b040 comp rx=0 tx=0).stop 2024-04-25T02:08:18.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.791+0000 7f7c31c4e700 1 -- 172.21.15.77:0/996304129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c2c066e70 msgr2=0x7f7c2c10d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:18.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.791+0000 7f7c31c4e700 1 --2- 172.21.15.77:0/996304129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c2c066e70 0x7f7c2c10d960 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7c20000c00 tx=0x7f7c20009e30 comp rx=0 tx=0).stop 2024-04-25T02:08:18.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.792+0000 7f7c31c4e700 1 -- 172.21.15.77:0/996304129 shutdown_connections 2024-04-25T02:08:18.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.792+0000 7f7c31c4e700 1 --2- 172.21.15.77:0/996304129 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f7c140692a0 0x7f7c1406b750 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:18.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.792+0000 7f7c31c4e700 1 --2- 172.21.15.77:0/996304129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c2c066e70 0x7f7c2c10d960 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:18.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.792+0000 7f7c31c4e700 1 --2- 172.21.15.77:0/996304129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c2c0fffe0 0x7f7c2c10dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:18.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.792+0000 7f7c31c4e700 1 -- 172.21.15.77:0/996304129 >> 172.21.15.77:0/996304129 conn(0x7f7c2c0f7450 msgr2=0x7f7c2c0f7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:18.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.795+0000 7f7c31c4e700 1 -- 172.21.15.77:0/996304129 shutdown_connections 2024-04-25T02:08:18.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.795+0000 7f7c31c4e700 1 -- 172.21.15.77:0/996304129 wait complete. 2024-04-25T02:08:18.823 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-04-25T02:08:18.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.983+0000 7f4451e52700 1 -- 172.21.15.77:0/3467082949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f444c0fb270 msgr2=0x7f444c0fb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:18.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.983+0000 7f4451e52700 1 --2- 172.21.15.77:0/3467082949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f444c0fb270 0x7f444c0fb680 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4444009ce0 tx=0x7f4444004d10 comp rx=0 tx=0).stop 2024-04-25T02:08:18.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.985+0000 7f4451e52700 1 -- 172.21.15.77:0/3467082949 shutdown_connections 2024-04-25T02:08:18.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.985+0000 7f4451e52700 1 --2- 172.21.15.77:0/3467082949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f444c0fc520 0x7f444c0fc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:18.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.985+0000 7f4451e52700 1 --2- 172.21.15.77:0/3467082949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f444c0fb270 0x7f444c0fb680 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:18.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.985+0000 7f4451e52700 1 -- 172.21.15.77:0/3467082949 >> 172.21.15.77:0/3467082949 conn(0x7f444c0f69d0 msgr2=0x7f444c0f8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:18.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.987+0000 7f4451e52700 1 -- 172.21.15.77:0/3467082949 shutdown_connections 2024-04-25T02:08:18.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.987+0000 7f4451e52700 1 -- 172.21.15.77:0/3467082949 wait complete. 2024-04-25T02:08:18.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.988+0000 7f4451e52700 1 Processor -- start 2024-04-25T02:08:18.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.988+0000 7f4451e52700 1 -- start start 2024-04-25T02:08:18.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.989+0000 7f4451e52700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f444c0fb270 0x7f444c113c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:18.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.989+0000 7f4451e52700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f444c0fc520 0x7f444c1141a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:18.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.989+0000 7f4451e52700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c1147a0 con 0x7f444c0fc520 2024-04-25T02:08:18.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.989+0000 7f4451e52700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c114ff0 con 0x7f444c0fb270 2024-04-25T02:08:18.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.990+0000 7f444bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f444c0fc520 0x7f444c1141a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:18.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.990+0000 7f444bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f444c0fc520 0x7f444c1141a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37080/0 (socket says 172.21.15.77:37080) 2024-04-25T02:08:18.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.990+0000 7f444bfff700 1 -- 172.21.15.77:0/1527308361 learned_addr learned my addr 172.21.15.77:0/1527308361 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:08:18.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.990+0000 7f4450e50700 1 --2- 172.21.15.77:0/1527308361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f444c0fb270 0x7f444c113c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:18.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.991+0000 7f444bfff700 1 -- 172.21.15.77:0/1527308361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f444c0fb270 msgr2=0x7f444c113c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:18.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.991+0000 7f444bfff700 1 --2- 172.21.15.77:0/1527308361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f444c0fb270 0x7f444c113c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:18.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.991+0000 7f444bfff700 1 -- 172.21.15.77:0/1527308361 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4444009940 con 0x7f444c0fc520 2024-04-25T02:08:18.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.992+0000 7f444bfff700 1 --2- 172.21.15.77:0/1527308361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f444c0fc520 0x7f444c1141a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f443c00c830 tx=0x7f443c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:19.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.992+0000 7f44497fa700 1 -- 172.21.15.77:0/1527308361 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f443c00a760 con 0x7f444c0fc520 2024-04-25T02:08:19.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.992+0000 7f4451e52700 1 -- 172.21.15.77:0/1527308361 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f444c1152d0 con 0x7f444c0fc520 2024-04-25T02:08:19.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.992+0000 7f4451e52700 1 -- 172.21.15.77:0/1527308361 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f444c115810 con 0x7f444c0fc520 2024-04-25T02:08:19.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.993+0000 7f44497fa700 1 -- 172.21.15.77:0/1527308361 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f443c00ad90 con 0x7f444c0fc520 2024-04-25T02:08:19.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.994+0000 7f44497fa700 1 -- 172.21.15.77:0/1527308361 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f443c00a760 con 0x7f444c0fc520 2024-04-25T02:08:19.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.994+0000 7f4451e52700 1 -- 172.21.15.77:0/1527308361 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f444c05f5c0 con 0x7f444c0fc520 2024-04-25T02:08:19.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.996+0000 7f44497fa700 1 -- 172.21.15.77:0/1527308361 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f443c012400 con 0x7f444c0fc520 2024-04-25T02:08:19.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.997+0000 7f44497fa700 1 --2- 172.21.15.77:0/1527308361 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f44340693b0 0x7f443406b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:19.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.997+0000 7f44497fa700 1 -- 172.21.15.77:0/1527308361 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f443c012730 con 0x7f444c0fc520 2024-04-25T02:08:19.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.998+0000 7f4450e50700 1 --2- 172.21.15.77:0/1527308361 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f44340693b0 0x7f443406b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:19.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:18.999+0000 7f4450e50700 1 --2- 172.21.15.77:0/1527308361 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f44340693b0 0x7f443406b860 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f444400b740 tx=0x7f4444004d10 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:19.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.006+0000 7f44497fa700 1 -- 172.21.15.77:0/1527308361 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f443c0543c0 con 0x7f444c0fc520 2024-04-25T02:08:19.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.325+0000 7f4451e52700 1 -- 172.21.15.77:0/1527308361 --> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f444c115c60 con 0x7f44340693b0 2024-04-25T02:08:19.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.326+0000 7f44497fa700 1 -- 172.21.15.77:0/1527308361 <== mgr.14208 v2:172.21.15.77:6800/310739264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f444c115c60 con 0x7f44340693b0 2024-04-25T02:08:19.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.329+0000 7f4451e52700 1 -- 172.21.15.77:0/1527308361 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f44340693b0 msgr2=0x7f443406b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:19.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.329+0000 7f4451e52700 1 --2- 172.21.15.77:0/1527308361 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f44340693b0 0x7f443406b860 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f444400b740 tx=0x7f4444004d10 comp rx=0 tx=0).stop 2024-04-25T02:08:19.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.329+0000 7f4451e52700 1 -- 172.21.15.77:0/1527308361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f444c0fc520 msgr2=0x7f444c1141a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:19.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.329+0000 7f4451e52700 1 --2- 172.21.15.77:0/1527308361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f444c0fc520 0x7f444c1141a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f443c00c830 tx=0x7f443c004470 comp rx=0 tx=0).stop 2024-04-25T02:08:19.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.329+0000 7f4451e52700 1 -- 172.21.15.77:0/1527308361 shutdown_connections 2024-04-25T02:08:19.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.329+0000 7f4451e52700 1 --2- 172.21.15.77:0/1527308361 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f44340693b0 0x7f443406b860 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:19.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.329+0000 7f4451e52700 1 --2- 172.21.15.77:0/1527308361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f444c0fb270 0x7f444c113c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:19.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.329+0000 7f4451e52700 1 --2- 172.21.15.77:0/1527308361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f444c0fc520 0x7f444c1141a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:19.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.329+0000 7f4451e52700 1 -- 172.21.15.77:0/1527308361 >> 172.21.15.77:0/1527308361 conn(0x7f444c0f69d0 msgr2=0x7f444c0f7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:19.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.329+0000 7f4451e52700 1 -- 172.21.15.77:0/1527308361 shutdown_connections 2024-04-25T02:08:19.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.329+0000 7f4451e52700 1 -- 172.21.15.77:0/1527308361 wait complete. 2024-04-25T02:08:19.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.455+0000 7fe4f2e6e700 1 -- 172.21.15.77:0/3759216335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4ec0fff80 msgr2=0x7fe4ec102360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:19.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.455+0000 7fe4f2e6e700 1 --2- 172.21.15.77:0/3759216335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4ec0fff80 0x7fe4ec102360 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8004940 tx=0x7fe4d8009e30 comp rx=0 tx=0).stop 2024-04-25T02:08:19.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.455+0000 7fe4f2e6e700 1 -- 172.21.15.77:0/3759216335 shutdown_connections 2024-04-25T02:08:19.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.455+0000 7fe4f2e6e700 1 --2- 172.21.15.77:0/3759216335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4ec0fff80 0x7fe4ec102360 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:19.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.455+0000 7fe4f2e6e700 1 --2- 172.21.15.77:0/3759216335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4ec066220 0x7fe4ec0ffa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:19.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.455+0000 7fe4f2e6e700 1 -- 172.21.15.77:0/3759216335 >> 172.21.15.77:0/3759216335 conn(0x7fe4ec0f7430 msgr2=0x7fe4ec0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:19.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.455+0000 7fe4f2e6e700 1 -- 172.21.15.77:0/3759216335 shutdown_connections 2024-04-25T02:08:19.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.455+0000 7fe4f2e6e700 1 -- 172.21.15.77:0/3759216335 wait complete. 2024-04-25T02:08:19.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.455+0000 7fe4f2e6e700 1 Processor -- start 2024-04-25T02:08:19.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.455+0000 7fe4f2e6e700 1 -- start start 2024-04-25T02:08:19.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.456+0000 7fe4f2e6e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4ec066220 0x7fe4ec0fd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:19.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.456+0000 7fe4f2e6e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4ec0fff80 0x7fe4ec0fb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:19.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.456+0000 7fe4f2e6e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec0fbef0 con 0x7fe4ec0fff80 2024-04-25T02:08:19.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.456+0000 7fe4f2e6e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec0fc060 con 0x7fe4ec066220 2024-04-25T02:08:19.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.456+0000 7fe4ebfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4ec0fff80 0x7fe4ec0fb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:19.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.456+0000 7fe4ebfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4ec0fff80 0x7fe4ec0fb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37098/0 (socket says 172.21.15.77:37098) 2024-04-25T02:08:19.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.456+0000 7fe4ebfff700 1 -- 172.21.15.77:0/3643954243 learned_addr learned my addr 172.21.15.77:0/3643954243 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:08:19.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.456+0000 7fe4ebfff700 1 -- 172.21.15.77:0/3643954243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4ec066220 msgr2=0x7fe4ec0fd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.456+0000 7fe4f0c0a700 1 --2- 172.21.15.77:0/3643954243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4ec066220 0x7fe4ec0fd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.456+0000 7fe4ebfff700 1 --2- 172.21.15.77:0/3643954243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4ec066220 0x7fe4ec0fd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.456+0000 7fe4ebfff700 1 -- 172.21.15.77:0/3643954243 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d8005040 con 0x7fe4ec0fff80 2024-04-25T02:08:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.456+0000 7fe4f0c0a700 1 --2- 172.21.15.77:0/3643954243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4ec066220 0x7fe4ec0fd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:08:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.456+0000 7fe4ebfff700 1 --2- 172.21.15.77:0/3643954243 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4ec0fff80 0x7fe4ec0fb940 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe4d800b3b0 tx=0x7fe4d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.457+0000 7fe4e97fa700 1 -- 172.21.15.77:0/3643954243 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4d800e040 con 0x7fe4ec0fff80 2024-04-25T02:08:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.457+0000 7fe4f2e6e700 1 -- 172.21.15.77:0/3643954243 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ec0fc2e0 con 0x7fe4ec0fff80 2024-04-25T02:08:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.457+0000 7fe4e97fa700 1 -- 172.21.15.77:0/3643954243 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe4d800bcc0 con 0x7fe4ec0fff80 2024-04-25T02:08:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.457+0000 7fe4e97fa700 1 -- 172.21.15.77:0/3643954243 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4d801c630 con 0x7fe4ec0fff80 2024-04-25T02:08:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.457+0000 7fe4f2e6e700 1 -- 172.21.15.77:0/3643954243 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4ec115a50 con 0x7fe4ec0fff80 2024-04-25T02:08:19.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.458+0000 7fe4f2e6e700 1 -- 172.21.15.77:0/3643954243 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4ec05f5c0 con 0x7fe4ec0fff80 2024-04-25T02:08:19.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.459+0000 7fe4e97fa700 1 -- 172.21.15.77:0/3643954243 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fe4d8013420 con 0x7fe4ec0fff80 2024-04-25T02:08:19.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.459+0000 7fe4e97fa700 1 --2- 172.21.15.77:0/3643954243 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fe4dc0692a0 0x7fe4dc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:19.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.459+0000 7fe4e97fa700 1 -- 172.21.15.77:0/3643954243 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe4d8087ff0 con 0x7fe4ec0fff80 2024-04-25T02:08:19.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.459+0000 7fe4f0c0a700 1 --2- 172.21.15.77:0/3643954243 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fe4dc0692a0 0x7fe4dc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:19.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.460+0000 7fe4f0c0a700 1 --2- 172.21.15.77:0/3643954243 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fe4dc0692a0 0x7fe4dc06b750 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0009fd0 tx=0x7fe4e000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:19.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.464+0000 7fe4e97fa700 1 -- 172.21.15.77:0/3643954243 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe4d80542d0 con 0x7fe4ec0fff80 2024-04-25T02:08:19.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.680+0000 7fe4f2e6e700 1 -- 172.21.15.77:0/3643954243 --> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4ec0f8f20 con 0x7fe4dc0692a0 2024-04-25T02:08:19.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.690+0000 7fe4e97fa700 1 -- 172.21.15.77:0/3643954243 <== mgr.14208 v2:172.21.15.77:6800/310739264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fe4ec0f8f20 con 0x7fe4dc0692a0 2024-04-25T02:08:19.698 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T02:08:19.698 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (6m) 101s ago 7m 24.4M - 0.25.0 c8568f914cd2 54c6f8f4d32d 2024-04-25T02:08:19.698 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (7m) 101s ago 7m 6665k - 17.2.7-902-gc61472c8 0de407c1b3af 2ad2e3d2b09e 2024-04-25T02:08:19.698 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi112 smithi112 running (6m) 107s ago 6m 6660k - 17.2.7-902-gc61472c8 0de407c1b3af 9235dc5eb15d 2024-04-25T02:08:19.698 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (5m) 101s ago 7m 85.0M - 9.4.7 954c08fa6188 d3b9c1566a82 2024-04-25T02:08:19.698 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.gcfygj smithi077 running (119s) 101s ago 118s 12.1M - 17.2.7-902-gc61472c8 0de407c1b3af 382dd7abf674 2024-04-25T02:08:19.698 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.oadrkb smithi077 running (2m) 101s ago 2m 10.4M - 17.2.7-902-gc61472c8 0de407c1b3af 6992064a4b2a 2024-04-25T02:08:19.698 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.dvwudt smithi112 running (2m) 107s ago 2m 16.6M - 17.2.7-902-gc61472c8 0de407c1b3af 0792e451abfd 2024-04-25T02:08:19.698 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.fjnadi smithi112 running (116s) 107s ago 115s 11.8M - 17.2.7-902-gc61472c8 0de407c1b3af c8093f622f6b 2024-04-25T02:08:19.698 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.zpflzp smithi077 *:9283 running (8m) 101s ago 8m 481M - 17.2.7-902-gc61472c8 0de407c1b3af 8c5e41dfcae2 2024-04-25T02:08:19.698 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi112.cswrxs smithi112 *:8443,9283 running (6m) 107s ago 6m 434M - 17.2.7-902-gc61472c8 0de407c1b3af afbb948e9239 2024-04-25T02:08:19.698 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (8m) 101s ago 8m 42.5M 2048M 17.2.7-902-gc61472c8 0de407c1b3af adb57965a306 2024-04-25T02:08:19.698 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi112 smithi112 running (6m) 107s ago 6m 32.2M 2048M 17.2.7-902-gc61472c8 0de407c1b3af db2fb9b09789 2024-04-25T02:08:19.698 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (7m) 101s ago 7m 15.3M - 1.5.0 0da6a335fe13 ec91684b7e6d 2024-04-25T02:08:19.699 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi112 smithi112 *:9100 running (6m) 107s ago 6m 16.4M - 1.5.0 0da6a335fe13 3a7c783c933b 2024-04-25T02:08:19.699 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (5m) 101s ago 5m 44.9M 4288M 17.2.7-902-gc61472c8 0de407c1b3af c741abec3b94 2024-04-25T02:08:19.699 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (5m) 101s ago 5m 44.7M 4288M 17.2.7-902-gc61472c8 0de407c1b3af 256ff3ced322 2024-04-25T02:08:19.699 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (4m) 101s ago 4m 47.4M 4288M 17.2.7-902-gc61472c8 0de407c1b3af c5d7d8c993f4 2024-04-25T02:08:19.699 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi112 running (4m) 107s ago 4m 44.4M 5312M 17.2.7-902-gc61472c8 0de407c1b3af 68429d0dbf88 2024-04-25T02:08:19.699 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi112 running (3m) 107s ago 3m 44.0M 5312M 17.2.7-902-gc61472c8 0de407c1b3af 66eb71201444 2024-04-25T02:08:19.699 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi112 running (3m) 107s ago 3m 41.6M 5312M 17.2.7-902-gc61472c8 0de407c1b3af 963e700d6aea 2024-04-25T02:08:19.699 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (5m) 101s ago 6m 51.4M - 2.43.0 a07b618ecd1d 85f5766c90c7 2024-04-25T02:08:19.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.692+0000 7fe4f2e6e700 1 -- 172.21.15.77:0/3643954243 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fe4dc0692a0 msgr2=0x7fe4dc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:19.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.692+0000 7fe4f2e6e700 1 --2- 172.21.15.77:0/3643954243 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fe4dc0692a0 0x7fe4dc06b750 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0009fd0 tx=0x7fe4e000b040 comp rx=0 tx=0).stop 2024-04-25T02:08:19.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.692+0000 7fe4f2e6e700 1 -- 172.21.15.77:0/3643954243 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4ec0fff80 msgr2=0x7fe4ec0fb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:19.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.692+0000 7fe4f2e6e700 1 --2- 172.21.15.77:0/3643954243 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4ec0fff80 0x7fe4ec0fb940 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe4d800b3b0 tx=0x7fe4d8009e30 comp rx=0 tx=0).stop 2024-04-25T02:08:19.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.692+0000 7fe4f2e6e700 1 -- 172.21.15.77:0/3643954243 shutdown_connections 2024-04-25T02:08:19.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.692+0000 7fe4f2e6e700 1 --2- 172.21.15.77:0/3643954243 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fe4dc0692a0 0x7fe4dc06b750 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:19.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.692+0000 7fe4f2e6e700 1 --2- 172.21.15.77:0/3643954243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4ec066220 0x7fe4ec0fd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:19.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.692+0000 7fe4f2e6e700 1 --2- 172.21.15.77:0/3643954243 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4ec0fff80 0x7fe4ec0fb940 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:19.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.692+0000 7fe4f2e6e700 1 -- 172.21.15.77:0/3643954243 >> 172.21.15.77:0/3643954243 conn(0x7fe4ec0f7430 msgr2=0x7fe4ec0f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:19.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.692+0000 7fe4f2e6e700 1 -- 172.21.15.77:0/3643954243 shutdown_connections 2024-04-25T02:08:19.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.692+0000 7fe4f2e6e700 1 -- 172.21.15.77:0/3643954243 wait complete. 2024-04-25T02:08:19.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.794+0000 7faec8eb5700 1 -- 172.21.15.77:0/1593134678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faec40fbb30 msgr2=0x7faec40fe390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:19.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.794+0000 7faec8eb5700 1 --2- 172.21.15.77:0/1593134678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faec40fbb30 0x7faec40fe390 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7faeb8004940 tx=0x7faeb8009e30 comp rx=0 tx=0).stop 2024-04-25T02:08:19.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.795+0000 7faec8eb5700 1 -- 172.21.15.77:0/1593134678 shutdown_connections 2024-04-25T02:08:19.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.795+0000 7faec8eb5700 1 --2- 172.21.15.77:0/1593134678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faec40fbb30 0x7faec40fe390 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:19.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.795+0000 7faec8eb5700 1 --2- 172.21.15.77:0/1593134678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec40fb1e0 0x7faec40fb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:19.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.795+0000 7faec8eb5700 1 -- 172.21.15.77:0/1593134678 >> 172.21.15.77:0/1593134678 conn(0x7faec40f6be0 msgr2=0x7faec40f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:19.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.795+0000 7faec8eb5700 1 -- 172.21.15.77:0/1593134678 shutdown_connections 2024-04-25T02:08:19.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.795+0000 7faec8eb5700 1 -- 172.21.15.77:0/1593134678 wait complete. 2024-04-25T02:08:19.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.795+0000 7faec8eb5700 1 Processor -- start 2024-04-25T02:08:19.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.795+0000 7faec8eb5700 1 -- start start 2024-04-25T02:08:19.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.795+0000 7faec8eb5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec40fb1e0 0x7faec410da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:19.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.795+0000 7faec8eb5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faec40fbb30 0x7faec410dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:19.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.795+0000 7faec8eb5700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec410e5d0 con 0x7faec40fbb30 2024-04-25T02:08:19.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.795+0000 7faec8eb5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec410e740 con 0x7faec40fb1e0 2024-04-25T02:08:19.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.795+0000 7faec1d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faec40fbb30 0x7faec410dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:19.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.796+0000 7faec259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec40fb1e0 0x7faec410da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:19.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.796+0000 7faec1d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faec40fbb30 0x7faec410dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37110/0 (socket says 172.21.15.77:37110) 2024-04-25T02:08:19.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.796+0000 7faec1d9b700 1 -- 172.21.15.77:0/4111712192 learned_addr learned my addr 172.21.15.77:0/4111712192 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:08:19.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.796+0000 7faec259c700 1 -- 172.21.15.77:0/4111712192 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faec40fbb30 msgr2=0x7faec410dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:19.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.796+0000 7faec259c700 1 --2- 172.21.15.77:0/4111712192 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faec40fbb30 0x7faec410dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:19.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.796+0000 7faec259c700 1 -- 172.21.15.77:0/4111712192 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb8005040 con 0x7faec40fb1e0 2024-04-25T02:08:19.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.796+0000 7faec1d9b700 1 --2- 172.21.15.77:0/4111712192 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faec40fbb30 0x7faec410dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:19.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.796+0000 7faec259c700 1 --2- 172.21.15.77:0/4111712192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec40fb1e0 0x7faec410da90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009fd0 tx=0x7faeb400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:19.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.796+0000 7faeb2ffd700 1 -- 172.21.15.77:0/4111712192 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faeb4004e90 con 0x7faec40fb1e0 2024-04-25T02:08:19.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.796+0000 7faec8eb5700 1 -- 172.21.15.77:0/4111712192 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec4113140 con 0x7faec40fb1e0 2024-04-25T02:08:19.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.796+0000 7faeb2ffd700 1 -- 172.21.15.77:0/4111712192 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faeb400f040 con 0x7faec40fb1e0 2024-04-25T02:08:19.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.796+0000 7faeb2ffd700 1 -- 172.21.15.77:0/4111712192 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faeb400ca50 con 0x7faec40fb1e0 2024-04-25T02:08:19.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.796+0000 7faec8eb5700 1 -- 172.21.15.77:0/4111712192 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec4113680 con 0x7faec40fb1e0 2024-04-25T02:08:19.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.797+0000 7faec8eb5700 1 -- 172.21.15.77:0/4111712192 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec404c710 con 0x7faec40fb1e0 2024-04-25T02:08:19.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.798+0000 7faeb2ffd700 1 -- 172.21.15.77:0/4111712192 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7faeb4007cc0 con 0x7faec40fb1e0 2024-04-25T02:08:19.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.798+0000 7faeb2ffd700 1 --2- 172.21.15.77:0/4111712192 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7faeac0692a0 0x7faeac06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:19.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.798+0000 7faeb2ffd700 1 -- 172.21.15.77:0/4111712192 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7faeb4086cf0 con 0x7faec40fb1e0 2024-04-25T02:08:19.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.798+0000 7faec1d9b700 1 --2- 172.21.15.77:0/4111712192 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7faeac0692a0 0x7faeac06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:19.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.798+0000 7faec1d9b700 1 --2- 172.21.15.77:0/4111712192 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7faeac0692a0 0x7faeac06b750 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faeb800b0d0 tx=0x7faeb8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:19.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:19.803+0000 7faeb2ffd700 1 -- 172.21.15.77:0/4111712192 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7faeb404e250 con 0x7faec40fb1e0 2024-04-25T02:08:20.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.077+0000 7faec8eb5700 1 -- 172.21.15.77:0/4111712192 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faec4066030 con 0x7faec40fb1e0 2024-04-25T02:08:20.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.078+0000 7faeb2ffd700 1 -- 172.21.15.77:0/4111712192 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7faeb40569f0 con 0x7faec40fb1e0 2024-04-25T02:08:20.086 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:08:20.086 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-04-25T02:08:20.086 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2 2024-04-25T02:08:20.086 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:08:20.086 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-04-25T02:08:20.086 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2 2024-04-25T02:08:20.086 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:08:20.086 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-04-25T02:08:20.086 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 6 2024-04-25T02:08:20.086 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:08:20.086 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-04-25T02:08:20.086 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T02:08:20.086 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:08:20.087 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-04-25T02:08:20.087 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 14 2024-04-25T02:08:20.087 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-25T02:08:20.087 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:08:20.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.080+0000 7faec8eb5700 1 -- 172.21.15.77:0/4111712192 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7faeac0692a0 msgr2=0x7faeac06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:20.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.080+0000 7faec8eb5700 1 --2- 172.21.15.77:0/4111712192 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7faeac0692a0 0x7faeac06b750 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faeb800b0d0 tx=0x7faeb8009e30 comp rx=0 tx=0).stop 2024-04-25T02:08:20.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.080+0000 7faec8eb5700 1 -- 172.21.15.77:0/4111712192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec40fb1e0 msgr2=0x7faec410da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:20.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.080+0000 7faec8eb5700 1 --2- 172.21.15.77:0/4111712192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec40fb1e0 0x7faec410da90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009fd0 tx=0x7faeb400b040 comp rx=0 tx=0).stop 2024-04-25T02:08:20.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.080+0000 7faec8eb5700 1 -- 172.21.15.77:0/4111712192 shutdown_connections 2024-04-25T02:08:20.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.080+0000 7faec8eb5700 1 --2- 172.21.15.77:0/4111712192 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7faeac0692a0 0x7faeac06b750 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.080+0000 7faec8eb5700 1 --2- 172.21.15.77:0/4111712192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec40fb1e0 0x7faec410da90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.080+0000 7faec8eb5700 1 --2- 172.21.15.77:0/4111712192 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faec40fbb30 0x7faec410dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.080+0000 7faec8eb5700 1 -- 172.21.15.77:0/4111712192 >> 172.21.15.77:0/4111712192 conn(0x7faec40f6be0 msgr2=0x7faec40f8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:20.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.080+0000 7faec8eb5700 1 -- 172.21.15.77:0/4111712192 shutdown_connections 2024-04-25T02:08:20.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.080+0000 7faec8eb5700 1 -- 172.21.15.77:0/4111712192 wait complete. 2024-04-25T02:08:20.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.182+0000 7f4f91828700 1 -- 172.21.15.77:0/3893626168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f8c0fdfd0 msgr2=0x7f4f8c0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:20.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.182+0000 7f4f91828700 1 --2- 172.21.15.77:0/3893626168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f8c0fdfd0 0x7f4f8c0fe440 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4f80004940 tx=0x7f4f80009e30 comp rx=0 tx=0).stop 2024-04-25T02:08:20.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.182+0000 7f4f91828700 1 -- 172.21.15.77:0/3893626168 shutdown_connections 2024-04-25T02:08:20.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.182+0000 7f4f91828700 1 --2- 172.21.15.77:0/3893626168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f8c0fdfd0 0x7f4f8c0fe440 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.182+0000 7f4f91828700 1 --2- 172.21.15.77:0/3893626168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f8c0fce60 0x7f4f8c0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.182+0000 7f4f91828700 1 -- 172.21.15.77:0/3893626168 >> 172.21.15.77:0/3893626168 conn(0x7f4f8c0f8540 msgr2=0x7f4f8c0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:20.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.182+0000 7f4f91828700 1 -- 172.21.15.77:0/3893626168 shutdown_connections 2024-04-25T02:08:20.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.182+0000 7f4f91828700 1 -- 172.21.15.77:0/3893626168 wait complete. 2024-04-25T02:08:20.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.183+0000 7f4f91828700 1 Processor -- start 2024-04-25T02:08:20.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.183+0000 7f4f91828700 1 -- start start 2024-04-25T02:08:20.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.183+0000 7f4f91828700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f8c0fce60 0x7f4f8c10d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:20.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.183+0000 7f4f91828700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f8c0fdfd0 0x7f4f8c10ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:20.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.183+0000 7f4f91828700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c10e3c0 con 0x7f4f8c0fce60 2024-04-25T02:08:20.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.183+0000 7f4f91828700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c10e530 con 0x7f4f8c0fdfd0 2024-04-25T02:08:20.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.183+0000 7f4f8affd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f8c0fce60 0x7f4f8c10d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:20.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.183+0000 7f4f8affd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f8c0fce60 0x7f4f8c10d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37128/0 (socket says 172.21.15.77:37128) 2024-04-25T02:08:20.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.183+0000 7f4f8affd700 1 -- 172.21.15.77:0/4101740444 learned_addr learned my addr 172.21.15.77:0/4101740444 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:08:20.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.183+0000 7f4f8a7fc700 1 --2- 172.21.15.77:0/4101740444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f8c0fdfd0 0x7f4f8c10ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:20.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.184+0000 7f4f8affd700 1 -- 172.21.15.77:0/4101740444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f8c0fdfd0 msgr2=0x7f4f8c10ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:20.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.184+0000 7f4f8affd700 1 --2- 172.21.15.77:0/4101740444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f8c0fdfd0 0x7f4f8c10ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.184+0000 7f4f8affd700 1 -- 172.21.15.77:0/4101740444 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f80005040 con 0x7f4f8c0fce60 2024-04-25T02:08:20.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.184+0000 7f4f8affd700 1 --2- 172.21.15.77:0/4101740444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f8c0fce60 0x7f4f8c10d880 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c00eb40 tx=0x7f4f7c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:20.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.184+0000 7f4f737fe700 1 -- 172.21.15.77:0/4101740444 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f7c007cc0 con 0x7f4f8c0fce60 2024-04-25T02:08:20.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.184+0000 7f4f91828700 1 -- 172.21.15.77:0/4101740444 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8c070190 con 0x7f4f8c0fce60 2024-04-25T02:08:20.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.184+0000 7f4f737fe700 1 -- 172.21.15.77:0/4101740444 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f7c00f040 con 0x7f4f8c0fce60 2024-04-25T02:08:20.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.184+0000 7f4f737fe700 1 -- 172.21.15.77:0/4101740444 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f7c00ca10 con 0x7f4f8c0fce60 2024-04-25T02:08:20.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.184+0000 7f4f91828700 1 -- 172.21.15.77:0/4101740444 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8c0706d0 con 0x7f4f8c0fce60 2024-04-25T02:08:20.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.185+0000 7f4f91828700 1 -- 172.21.15.77:0/4101740444 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f8c04c710 con 0x7f4f8c0fce60 2024-04-25T02:08:20.198 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:19 smithi077 ceph-mon[26330]: pgmap v239: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.5 MiB/s wr, 463 op/s 2024-04-25T02:08:20.199 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:19 smithi077 ceph-mon[26330]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:08:20.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.186+0000 7f4f737fe700 1 -- 172.21.15.77:0/4101740444 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f4f7c00cc80 con 0x7f4f8c0fce60 2024-04-25T02:08:20.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.186+0000 7f4f737fe700 1 --2- 172.21.15.77:0/4101740444 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f4f740692a0 0x7f4f7406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:20.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.186+0000 7f4f737fe700 1 -- 172.21.15.77:0/4101740444 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4f7c086dd0 con 0x7f4f8c0fce60 2024-04-25T02:08:20.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.186+0000 7f4f8a7fc700 1 --2- 172.21.15.77:0/4101740444 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f4f740692a0 0x7f4f7406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:20.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.187+0000 7f4f8a7fc700 1 --2- 172.21.15.77:0/4101740444 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f4f740692a0 0x7f4f7406b750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009b30 tx=0x7f4f8001c040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:20.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.190+0000 7f4f737fe700 1 -- 172.21.15.77:0/4101740444 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4f7c04e250 con 0x7f4f8c0fce60 2024-04-25T02:08:20.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:19 smithi112 ceph-mon[33313]: pgmap v239: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.5 MiB/s wr, 463 op/s 2024-04-25T02:08:20.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:19 smithi112 ceph-mon[33313]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:08:20.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.400+0000 7f4f91828700 1 -- 172.21.15.77:0/4101740444 --> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f8c1022a0 con 0x7f4f740692a0 2024-04-25T02:08:20.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.401+0000 7f4f737fe700 1 -- 172.21.15.77:0/4101740444 <== mgr.14208 v2:172.21.15.77:6800/310739264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f4f8c1022a0 con 0x7f4f740692a0 2024-04-25T02:08:20.409 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:08:20.409 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901", 2024-04-25T02:08:20.409 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-04-25T02:08:20.409 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-25T02:08:20.409 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [], 2024-04-25T02:08:20.409 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "0/2 daemons upgraded", 2024-04-25T02:08:20.409 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 image on host smithi112", 2024-04-25T02:08:20.409 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-04-25T02:08:20.409 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:08:20.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.403+0000 7f4f91828700 1 -- 172.21.15.77:0/4101740444 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f4f740692a0 msgr2=0x7f4f7406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:20.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.403+0000 7f4f91828700 1 --2- 172.21.15.77:0/4101740444 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f4f740692a0 0x7f4f7406b750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009b30 tx=0x7f4f8001c040 comp rx=0 tx=0).stop 2024-04-25T02:08:20.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.403+0000 7f4f91828700 1 -- 172.21.15.77:0/4101740444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f8c0fce60 msgr2=0x7f4f8c10d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:20.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.403+0000 7f4f91828700 1 --2- 172.21.15.77:0/4101740444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f8c0fce60 0x7f4f8c10d880 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c00eb40 tx=0x7f4f7c00b040 comp rx=0 tx=0).stop 2024-04-25T02:08:20.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.403+0000 7f4f91828700 1 -- 172.21.15.77:0/4101740444 shutdown_connections 2024-04-25T02:08:20.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.403+0000 7f4f91828700 1 --2- 172.21.15.77:0/4101740444 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f4f740692a0 0x7f4f7406b750 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.403+0000 7f4f91828700 1 --2- 172.21.15.77:0/4101740444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f8c0fce60 0x7f4f8c10d880 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.403+0000 7f4f91828700 1 --2- 172.21.15.77:0/4101740444 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f8c0fdfd0 0x7f4f8c10ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:20.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.403+0000 7f4f91828700 1 -- 172.21.15.77:0/4101740444 >> 172.21.15.77:0/4101740444 conn(0x7f4f8c0f8540 msgr2=0x7f4f8c0f9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:20.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.403+0000 7f4f91828700 1 -- 172.21.15.77:0/4101740444 shutdown_connections 2024-04-25T02:08:20.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:20.403+0000 7f4f91828700 1 -- 172.21.15.77:0/4101740444 wait complete. 2024-04-25T02:08:21.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:20 smithi077 ceph-mon[26330]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:08:21.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:20 smithi077 ceph-mon[26330]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:08:21.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:20 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/4111712192' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:08:21.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:20 smithi112 ceph-mon[33313]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:08:21.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:20 smithi112 ceph-mon[33313]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:08:21.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:20 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/4111712192' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:08:22.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:21 smithi077 ceph-mon[26330]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:08:22.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:21 smithi077 ceph-mon[26330]: pgmap v240: 65 pgs: 65 active+clean; 86 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.5 MiB/s wr, 473 op/s 2024-04-25T02:08:22.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:21 smithi112 ceph-mon[33313]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:08:22.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:21 smithi112 ceph-mon[33313]: pgmap v240: 65 pgs: 65 active+clean; 86 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.5 MiB/s wr, 473 op/s 2024-04-25T02:08:24.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:23 smithi077 ceph-mon[26330]: pgmap v241: 65 pgs: 65 active+clean; 100 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 5.2 MiB/s wr, 416 op/s 2024-04-25T02:08:24.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:23 smithi112 ceph-mon[33313]: pgmap v241: 65 pgs: 65 active+clean; 100 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 5.2 MiB/s wr, 416 op/s 2024-04-25T02:08:26.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:25 smithi077 ceph-mon[26330]: pgmap v242: 65 pgs: 65 active+clean; 110 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 4.0 MiB/s wr, 335 op/s 2024-04-25T02:08:26.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:25 smithi112 ceph-mon[33313]: pgmap v242: 65 pgs: 65 active+clean; 110 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 4.0 MiB/s wr, 335 op/s 2024-04-25T02:08:28.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:27 smithi112 ceph-mon[33313]: pgmap v243: 65 pgs: 65 active+clean; 119 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 4.4 MiB/s wr, 342 op/s 2024-04-25T02:08:28.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:27 smithi077 ceph-mon[26330]: pgmap v243: 65 pgs: 65 active+clean; 119 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 4.4 MiB/s wr, 342 op/s 2024-04-25T02:08:30.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:29 smithi077 ceph-mon[26330]: pgmap v244: 65 pgs: 65 active+clean; 119 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s wr, 330 op/s 2024-04-25T02:08:30.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:29 smithi112 ceph-mon[33313]: pgmap v244: 65 pgs: 65 active+clean; 119 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s wr, 330 op/s 2024-04-25T02:08:31.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:30 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:08:31.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:30 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:08:32.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:31 smithi077 ceph-mon[26330]: pgmap v245: 65 pgs: 65 active+clean; 131 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.6 MiB/s wr, 508 op/s 2024-04-25T02:08:32.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:31 smithi112 ceph-mon[33313]: pgmap v245: 65 pgs: 65 active+clean; 131 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.6 MiB/s wr, 508 op/s 2024-04-25T02:08:34.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:33 smithi077 ceph-mon[26330]: pgmap v246: 65 pgs: 65 active+clean; 158 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 6.4 MiB/s wr, 785 op/s 2024-04-25T02:08:34.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:33 smithi112 ceph-mon[33313]: pgmap v246: 65 pgs: 65 active+clean; 158 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 6.4 MiB/s wr, 785 op/s 2024-04-25T02:08:36.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:35 smithi077 ceph-mon[26330]: pgmap v247: 65 pgs: 65 active+clean; 183 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 7.5 MiB/s wr, 915 op/s 2024-04-25T02:08:36.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:35 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:08:36.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:35 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.cswrxs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T02:08:36.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:35 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T02:08:36.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:35 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:08:36.241 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:35 smithi112 ceph-mon[33313]: pgmap v247: 65 pgs: 65 active+clean; 183 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 7.5 MiB/s wr, 915 op/s 2024-04-25T02:08:36.241 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:35 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:08:36.241 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:35 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.cswrxs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T02:08:36.241 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:35 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T02:08:36.242 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:35 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:08:37.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:36 smithi077 ceph-mon[26330]: Upgrade: Updating mgr.smithi112.cswrxs 2024-04-25T02:08:37.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:36 smithi077 ceph-mon[26330]: Deploying daemon mgr.smithi112.cswrxs on smithi112 2024-04-25T02:08:37.236 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:36 smithi112 ceph-mon[33313]: Upgrade: Updating mgr.smithi112.cswrxs 2024-04-25T02:08:37.236 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:36 smithi112 ceph-mon[33313]: Deploying daemon mgr.smithi112.cswrxs on smithi112 2024-04-25T02:08:38.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:37 smithi077 ceph-mon[26330]: pgmap v248: 65 pgs: 65 active+clean; 184 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 6.6 MiB/s wr, 822 op/s 2024-04-25T02:08:38.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:37 smithi112 ceph-mon[33313]: pgmap v248: 65 pgs: 65 active+clean; 184 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 6.6 MiB/s wr, 822 op/s 2024-04-25T02:08:38.605 INFO:tasks.workunit.client.0.smithi077.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-25T02:08:38.605 INFO:tasks.workunit.client.0.smithi077.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T02:08:38.605 INFO:tasks.workunit.client.0.smithi077.stderr:+ make 2024-04-25T02:08:39.002 INFO:tasks.workunit.client.0.smithi077.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-25T02:08:39.319 INFO:tasks.workunit.client.0.smithi077.stderr:++ readlink -f fsstress 2024-04-25T02:08:39.320 INFO:tasks.workunit.client.0.smithi077.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-25T02:08:39.320 INFO:tasks.workunit.client.0.smithi077.stderr:+ popd 2024-04-25T02:08:39.321 INFO:tasks.workunit.client.0.smithi077.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T02:08:39.321 INFO:tasks.workunit.client.0.smithi077.stderr:+ popd 2024-04-25T02:08:39.321 INFO:tasks.workunit.client.0.smithi077.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-25T02:08:39.321 INFO:tasks.workunit.client.0.smithi077.stderr:++ mktemp -d -p . 2024-04-25T02:08:39.324 INFO:tasks.workunit.client.0.smithi077.stderr:+ T=./tmp.ZbkMo10vOc 2024-04-25T02:08:39.324 INFO:tasks.workunit.client.0.smithi077.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.ZbkMo10vOc -l 1 -n 1000 -p 10 -v 2024-04-25T02:08:39.326 INFO:tasks.workunit.client.0.smithi077.stdout:seed = 1714249317 2024-04-25T02:08:39.331 INFO:tasks.workunit.client.0.smithi077.stdout:0/0: stat - no entries 2024-04-25T02:08:39.334 INFO:tasks.workunit.client.0.smithi077.stdout:1/0: fdatasync - no filename 2024-04-25T02:08:39.335 INFO:tasks.workunit.client.0.smithi077.stdout:0/1: symlink l0 0 2024-04-25T02:08:39.335 INFO:tasks.workunit.client.0.smithi077.stdout:0/2: chown l0 30139190 1 2024-04-25T02:08:39.337 INFO:tasks.workunit.client.0.smithi077.stdout:1/1: creat f0 x:0 0 0 2024-04-25T02:08:39.339 INFO:tasks.workunit.client.0.smithi077.stdout:3/0: chown . 8145 1 2024-04-25T02:08:39.339 INFO:tasks.workunit.client.0.smithi077.stdout:3/1: chown . 112724272 1 2024-04-25T02:08:39.340 INFO:tasks.workunit.client.0.smithi077.stdout:3/2: dwrite - no filename 2024-04-25T02:08:39.340 INFO:tasks.workunit.client.0.smithi077.stdout:3/3: getdents . 0 2024-04-25T02:08:39.341 INFO:tasks.workunit.client.0.smithi077.stdout:2/0: creat f0 x:0 0 0 2024-04-25T02:08:39.341 INFO:tasks.workunit.client.0.smithi077.stdout:2/1: dread - f0 zero size 2024-04-25T02:08:39.342 INFO:tasks.workunit.client.0.smithi077.stdout:4/0: dread - no filename 2024-04-25T02:08:39.342 INFO:tasks.workunit.client.0.smithi077.stdout:4/1: rmdir - no directory 2024-04-25T02:08:39.344 INFO:tasks.workunit.client.0.smithi077.stdout:3/4: mkdir d0 0 2024-04-25T02:08:39.344 INFO:tasks.workunit.client.0.smithi077.stdout:3/5: getdents d0 0 2024-04-25T02:08:39.344 INFO:tasks.workunit.client.0.smithi077.stdout:3/6: write - no filename 2024-04-25T02:08:39.344 INFO:tasks.workunit.client.0.smithi077.stdout:3/7: write - no filename 2024-04-25T02:08:39.345 INFO:tasks.workunit.client.0.smithi077.stdout:5/0: unlink - no file 2024-04-25T02:08:39.347 INFO:tasks.workunit.client.0.smithi077.stdout:4/2: mkdir d0 0 2024-04-25T02:08:39.349 INFO:tasks.workunit.client.0.smithi077.stdout:3/8: creat d0/f1 x:0 0 0 2024-04-25T02:08:39.351 INFO:tasks.workunit.client.0.smithi077.stdout:6/0: dread - no filename 2024-04-25T02:08:39.351 INFO:tasks.workunit.client.0.smithi077.stdout:6/1: dwrite - no filename 2024-04-25T02:08:39.353 INFO:tasks.workunit.client.0.smithi077.stdout:5/1: mkdir d0 0 2024-04-25T02:08:39.353 INFO:tasks.workunit.client.0.smithi077.stdout:5/2: dread - no filename 2024-04-25T02:08:39.353 INFO:tasks.workunit.client.0.smithi077.stdout:5/3: chown d0 1 1 2024-04-25T02:08:39.353 INFO:tasks.workunit.client.0.smithi077.stdout:5/4: dread - no filename 2024-04-25T02:08:39.353 INFO:tasks.workunit.client.0.smithi077.stdout:5/5: dwrite - no filename 2024-04-25T02:08:39.353 INFO:tasks.workunit.client.0.smithi077.stdout:5/6: read - no filename 2024-04-25T02:08:39.354 INFO:tasks.workunit.client.0.smithi077.stdout:4/3: mkdir d0/d1 0 2024-04-25T02:08:39.354 INFO:tasks.workunit.client.0.smithi077.stdout:4/4: truncate - no filename 2024-04-25T02:08:39.354 INFO:tasks.workunit.client.0.smithi077.stdout:4/5: dwrite - no filename 2024-04-25T02:08:39.354 INFO:tasks.workunit.client.0.smithi077.stdout:4/6: unlink - no file 2024-04-25T02:08:39.355 INFO:tasks.workunit.client.0.smithi077.stdout:4/7: truncate - no filename 2024-04-25T02:08:39.356 INFO:tasks.workunit.client.0.smithi077.stdout:1/2: dwrite f0 [0,4194304] 0 2024-04-25T02:08:39.356 INFO:tasks.workunit.client.0.smithi077.stdout:1/3: fdatasync f0 0 2024-04-25T02:08:39.356 INFO:tasks.workunit.client.0.smithi077.stdout:1/4: rmdir - no directory 2024-04-25T02:08:39.356 INFO:tasks.workunit.client.0.smithi077.stdout:1/5: stat f0 0 2024-04-25T02:08:39.359 INFO:tasks.workunit.client.0.smithi077.stdout:7/0: fsync - no filename 2024-04-25T02:08:39.359 INFO:tasks.workunit.client.0.smithi077.stdout:7/1: dwrite - no filename 2024-04-25T02:08:39.359 INFO:tasks.workunit.client.0.smithi077.stdout:7/2: dwrite - no filename 2024-04-25T02:08:39.359 INFO:tasks.workunit.client.0.smithi077.stdout:7/3: stat - no entries 2024-04-25T02:08:39.359 INFO:tasks.workunit.client.0.smithi077.stdout:7/4: dwrite - no filename 2024-04-25T02:08:39.361 INFO:tasks.workunit.client.0.smithi077.stdout:6/2: creat f0 x:0 0 0 2024-04-25T02:08:39.361 INFO:tasks.workunit.client.0.smithi077.stdout:6/3: creat f1 x:0 0 0 2024-04-25T02:08:39.361 INFO:tasks.workunit.client.0.smithi077.stdout:6/4: creat f2 x:0 0 0 2024-04-25T02:08:39.363 INFO:tasks.workunit.client.0.smithi077.stdout:5/7: symlink d0/l1 0 2024-04-25T02:08:39.363 INFO:tasks.workunit.client.0.smithi077.stdout:1/6: dread f0 [0,4194304] 0 2024-04-25T02:08:39.363 INFO:tasks.workunit.client.0.smithi077.stdout:1/7: chown f0 274497508 1 2024-04-25T02:08:39.364 INFO:tasks.workunit.client.0.smithi077.stdout:2/2: dwrite f0 [0,4194304] 0 2024-04-25T02:08:39.365 INFO:tasks.workunit.client.0.smithi077.stdout:4/8: creat d0/d1/f2 x:0 0 0 2024-04-25T02:08:39.365 INFO:tasks.workunit.client.0.smithi077.stdout:4/9: readlink - no filename 2024-04-25T02:08:39.371 INFO:tasks.workunit.client.0.smithi077.stdout:8/0: truncate - no filename 2024-04-25T02:08:39.371 INFO:tasks.workunit.client.0.smithi077.stdout:8/1: rename - no filename 2024-04-25T02:08:39.371 INFO:tasks.workunit.client.0.smithi077.stdout:8/2: getdents . 0 2024-04-25T02:08:39.372 INFO:tasks.workunit.client.0.smithi077.stdout:7/5: mknod c0 0 2024-04-25T02:08:39.377 INFO:tasks.workunit.client.0.smithi077.stdout:6/5: symlink l3 0 2024-04-25T02:08:39.377 INFO:tasks.workunit.client.0.smithi077.stdout:6/6: write f2 [79715,76305] 0 2024-04-25T02:08:39.379 INFO:tasks.workunit.client.0.smithi077.stdout:5/8: mkdir d0/d2 0 2024-04-25T02:08:39.379 INFO:tasks.workunit.client.0.smithi077.stdout:5/9: dwrite - no filename 2024-04-25T02:08:39.380 INFO:tasks.workunit.client.0.smithi077.stdout:1/8: rename f0 to f1 0 2024-04-25T02:08:39.380 INFO:tasks.workunit.client.0.smithi077.stdout:1/9: chown f1 8680 1 2024-04-25T02:08:39.383 INFO:tasks.workunit.client.0.smithi077.stdout:1/10: write f1 [3184091,85951] 0 2024-04-25T02:08:39.387 INFO:tasks.workunit.client.0.smithi077.stdout:4/10: symlink d0/l3 0 2024-04-25T02:08:39.387 INFO:tasks.workunit.client.0.smithi077.stdout:4/11: dread - d0/d1/f2 zero size 2024-04-25T02:08:39.387 INFO:tasks.workunit.client.0.smithi077.stdout:4/12: truncate d0/d1/f2 329002 0 2024-04-25T02:08:39.387 INFO:tasks.workunit.client.0.smithi077.stdout:4/13: readlink d0/l3 0 2024-04-25T02:08:39.387 INFO:tasks.workunit.client.0.smithi077.stdout:4/14: rename d0 to d0/d1/d4 22 2024-04-25T02:08:39.387 INFO:tasks.workunit.client.0.smithi077.stdout:4/15: chown d0 1552902958 1 2024-04-25T02:08:39.388 INFO:tasks.workunit.client.0.smithi077.stdout:9/0: chown . 39689409 1 2024-04-25T02:08:39.388 INFO:tasks.workunit.client.0.smithi077.stdout:9/1: link - no file 2024-04-25T02:08:39.388 INFO:tasks.workunit.client.0.smithi077.stdout:9/2: dread - no filename 2024-04-25T02:08:39.388 INFO:tasks.workunit.client.0.smithi077.stdout:9/3: truncate - no filename 2024-04-25T02:08:39.390 INFO:tasks.workunit.client.0.smithi077.stdout:8/3: symlink l0 0 2024-04-25T02:08:39.390 INFO:tasks.workunit.client.0.smithi077.stdout:8/4: write - no filename 2024-04-25T02:08:39.390 INFO:tasks.workunit.client.0.smithi077.stdout:8/5: write - no filename 2024-04-25T02:08:39.390 INFO:tasks.workunit.client.0.smithi077.stdout:8/6: write - no filename 2024-04-25T02:08:39.390 INFO:tasks.workunit.client.0.smithi077.stdout:8/7: truncate - no filename 2024-04-25T02:08:39.391 INFO:tasks.workunit.client.0.smithi077.stdout:7/6: creat f1 x:0 0 0 2024-04-25T02:08:39.393 INFO:tasks.workunit.client.0.smithi077.stdout:6/7: mknod c4 0 2024-04-25T02:08:39.393 INFO:tasks.workunit.client.0.smithi077.stdout:6/8: creat f5 x:0 0 0 2024-04-25T02:08:39.393 INFO:tasks.workunit.client.0.smithi077.stdout:6/9: stat l3 0 2024-04-25T02:08:39.395 INFO:tasks.workunit.client.0.smithi077.stdout:5/10: mkdir d0/d2/d3 0 2024-04-25T02:08:39.395 INFO:tasks.workunit.client.0.smithi077.stdout:5/11: fsync - no filename 2024-04-25T02:08:39.395 INFO:tasks.workunit.client.0.smithi077.stdout:5/12: rename d0 to d0/d2/d4 22 2024-04-25T02:08:39.395 INFO:tasks.workunit.client.0.smithi077.stdout:5/13: write - no filename 2024-04-25T02:08:39.395 INFO:tasks.workunit.client.0.smithi077.stdout:5/14: write - no filename 2024-04-25T02:08:39.400 INFO:tasks.workunit.client.0.smithi077.stdout:4/16: symlink d0/l5 0 2024-04-25T02:08:39.403 INFO:tasks.workunit.client.0.smithi077.stdout:9/4: symlink l0 0 2024-04-25T02:08:39.407 INFO:tasks.workunit.client.0.smithi077.stdout:8/8: symlink l1 0 2024-04-25T02:08:39.407 INFO:tasks.workunit.client.0.smithi077.stdout:8/9: chown l1 1263281 1 2024-04-25T02:08:39.407 INFO:tasks.workunit.client.0.smithi077.stdout:8/10: fsync - no filename 2024-04-25T02:08:39.408 INFO:tasks.workunit.client.0.smithi077.stdout:8/11: rmdir - no directory 2024-04-25T02:08:39.408 INFO:tasks.workunit.client.0.smithi077.stdout:8/12: write - no filename 2024-04-25T02:08:39.408 INFO:tasks.workunit.client.0.smithi077.stdout:8/13: write - no filename 2024-04-25T02:08:39.408 INFO:tasks.workunit.client.0.smithi077.stdout:8/14: stat l1 0 2024-04-25T02:08:39.408 INFO:tasks.workunit.client.0.smithi077.stdout:8/15: truncate - no filename 2024-04-25T02:08:39.408 INFO:tasks.workunit.client.0.smithi077.stdout:8/16: fdatasync - no filename 2024-04-25T02:08:39.412 INFO:tasks.workunit.client.0.smithi077.stdout:6/10: symlink l6 0 2024-04-25T02:08:39.412 INFO:tasks.workunit.client.0.smithi077.stdout:6/11: creat f7 x:0 0 0 2024-04-25T02:08:39.412 INFO:tasks.workunit.client.0.smithi077.stdout:6/12: stat l3 0 2024-04-25T02:08:39.415 INFO:tasks.workunit.client.0.smithi077.stdout:5/15: mkdir d0/d2/d5 0 2024-04-25T02:08:39.415 INFO:tasks.workunit.client.0.smithi077.stdout:5/16: dwrite - no filename 2024-04-25T02:08:39.422 INFO:tasks.workunit.client.0.smithi077.stdout:9/5: link l0 l1 0 2024-04-25T02:08:39.431 INFO:tasks.workunit.client.0.smithi077.stdout:8/17: symlink l2 0 2024-04-25T02:08:39.431 INFO:tasks.workunit.client.0.smithi077.stdout:8/18: write - no filename 2024-04-25T02:08:39.431 INFO:tasks.workunit.client.0.smithi077.stdout:8/19: truncate - no filename 2024-04-25T02:08:39.431 INFO:tasks.workunit.client.0.smithi077.stdout:8/20: write - no filename 2024-04-25T02:08:39.431 INFO:tasks.workunit.client.0.smithi077.stdout:8/21: truncate - no filename 2024-04-25T02:08:39.431 INFO:tasks.workunit.client.0.smithi077.stdout:8/22: rmdir - no directory 2024-04-25T02:08:39.444 INFO:tasks.workunit.client.0.smithi077.stdout:6/13: mknod c8 0 2024-04-25T02:08:39.444 INFO:tasks.workunit.client.0.smithi077.stdout:6/14: write f7 [15644,70066] 0 2024-04-25T02:08:39.445 INFO:tasks.workunit.client.0.smithi077.stdout:6/15: write f7 [916832,94888] 0 2024-04-25T02:08:39.445 INFO:tasks.workunit.client.0.smithi077.stdout:6/16: write f2 [575590,128401] 0 2024-04-25T02:08:39.458 INFO:tasks.workunit.client.0.smithi077.stdout:5/17: mknod d0/d2/d3/c6 0 2024-04-25T02:08:39.458 INFO:tasks.workunit.client.0.smithi077.stdout:5/18: fdatasync - no filename 2024-04-25T02:08:39.458 INFO:tasks.workunit.client.0.smithi077.stdout:5/19: dread - no filename 2024-04-25T02:08:39.459 INFO:tasks.workunit.client.0.smithi077.stdout:5/20: truncate - no filename 2024-04-25T02:08:39.459 INFO:tasks.workunit.client.0.smithi077.stdout:5/21: fdatasync - no filename 2024-04-25T02:08:39.463 INFO:tasks.workunit.client.0.smithi077.stdout:9/6: symlink l2 0 2024-04-25T02:08:39.506 INFO:tasks.workunit.client.0.smithi077.stdout:8/23: mkdir d3 0 2024-04-25T02:08:39.528 INFO:tasks.workunit.client.0.smithi077.stdout:0/3: getdents . 0 2024-04-25T02:08:39.528 INFO:tasks.workunit.client.0.smithi077.stdout:0/4: readlink l0 0 2024-04-25T02:08:39.528 INFO:tasks.workunit.client.0.smithi077.stdout:0/5: dread - no filename 2024-04-25T02:08:39.528 INFO:tasks.workunit.client.0.smithi077.stdout:0/6: dread - no filename 2024-04-25T02:08:39.528 INFO:tasks.workunit.client.0.smithi077.stdout:0/7: stat l0 0 2024-04-25T02:08:39.528 INFO:tasks.workunit.client.0.smithi077.stdout:0/8: chown l0 62869121 1 2024-04-25T02:08:39.534 INFO:tasks.workunit.client.0.smithi077.stdout:2/3: fsync f0 0 2024-04-25T02:08:39.544 INFO:tasks.workunit.client.0.smithi077.stdout:3/9: getdents d0 0 2024-04-25T02:08:39.545 INFO:tasks.workunit.client.0.smithi077.stdout:3/10: dread - d0/f1 zero size 2024-04-25T02:08:39.545 INFO:tasks.workunit.client.0.smithi077.stdout:3/11: chown d0 65183065 1 2024-04-25T02:08:39.545 INFO:tasks.workunit.client.0.smithi077.stdout:3/12: getdents d0 0 2024-04-25T02:08:39.545 INFO:tasks.workunit.client.0.smithi077.stdout:3/13: dread - d0/f1 zero size 2024-04-25T02:08:39.546 INFO:tasks.workunit.client.0.smithi077.stdout:6/17: link f2 f9 0 2024-04-25T02:08:39.567 INFO:tasks.workunit.client.0.smithi077.stdout:6/18: dwrite f9 [0,4194304] 0 2024-04-25T02:08:39.567 INFO:tasks.workunit.client.0.smithi077.stdout:6/19: chown c4 104 1 2024-04-25T02:08:39.568 INFO:tasks.workunit.client.0.smithi077.stdout:6/20: truncate f0 958226 0 2024-04-25T02:08:39.574 INFO:tasks.workunit.client.0.smithi077.stdout:1/11: dwrite f1 [4194304,4194304] 0 2024-04-25T02:08:39.574 INFO:tasks.workunit.client.0.smithi077.stdout:1/12: write f1 [1165479,67949] 0 2024-04-25T02:08:39.591 INFO:tasks.workunit.client.0.smithi077.stdout:1/13: dwrite f1 [4194304,4194304] 0 2024-04-25T02:08:39.591 INFO:tasks.workunit.client.0.smithi077.stdout:1/14: creat f2 x:0 0 0 2024-04-25T02:08:39.606 INFO:tasks.workunit.client.0.smithi077.stdout:1/15: dwrite f1 [0,4194304] 0 2024-04-25T02:08:39.606 INFO:tasks.workunit.client.0.smithi077.stdout:1/16: dread - f2 zero size 2024-04-25T02:08:39.606 INFO:tasks.workunit.client.0.smithi077.stdout:1/17: creat f3 x:0 0 0 2024-04-25T02:08:39.628 INFO:tasks.workunit.client.0.smithi077.stdout:5/22: creat d0/d2/f7 x:0 0 0 2024-04-25T02:08:39.628 INFO:tasks.workunit.client.0.smithi077.stdout:5/23: truncate d0/d2/f7 954430 0 2024-04-25T02:08:39.680 INFO:tasks.workunit.client.0.smithi077.stdout:9/7: creat f3 x:0 0 0 2024-04-25T02:08:39.694 INFO:tasks.workunit.client.0.smithi077.stdout:9/8: dwrite f3 [0,4194304] 0 2024-04-25T02:08:39.977 INFO:tasks.workunit.client.0.smithi077.stdout:8/24: creat d3/f4 x:0 0 0 2024-04-25T02:08:40.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:39 smithi077 ceph-mon[26330]: pgmap v249: 65 pgs: 65 active+clean; 192 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 6.5 MiB/s wr, 815 op/s 2024-04-25T02:08:40.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:39 smithi112 ceph-mon[33313]: pgmap v249: 65 pgs: 65 active+clean; 192 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 6.5 MiB/s wr, 815 op/s 2024-04-25T02:08:40.516 INFO:tasks.workunit.client.1.smithi112.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-25T02:08:40.530 INFO:tasks.workunit.client.1.smithi112.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-25T02:08:40.530 INFO:tasks.workunit.client.1.smithi112.stderr:+ make 2024-04-25T02:08:40.920 INFO:tasks.workunit.client.0.smithi077.stdout:0/9: creat f1 x:0 0 0 2024-04-25T02:08:40.921 INFO:tasks.workunit.client.0.smithi077.stdout:0/10: write f1 [635370,1780] 0 2024-04-25T02:08:40.923 INFO:tasks.workunit.client.0.smithi077.stdout:3/14: mkdir d0/d2 0 2024-04-25T02:08:40.924 INFO:tasks.workunit.client.0.smithi077.stdout:6/21: mknod ca 0 2024-04-25T02:08:40.926 INFO:tasks.workunit.client.0.smithi077.stdout:0/11: dread f1 [0,4194304] 0 2024-04-25T02:08:40.928 INFO:tasks.workunit.client.0.smithi077.stdout:1/18: mknod c4 0 2024-04-25T02:08:40.928 INFO:tasks.workunit.client.0.smithi077.stdout:1/19: write f2 [161145,70138] 0 2024-04-25T02:08:40.933 INFO:tasks.workunit.client.0.smithi077.stdout:6/22: read f2 [916130,92846] 0 2024-04-25T02:08:40.936 INFO:tasks.workunit.client.0.smithi077.stdout:1/20: dread f1 [0,4194304] 0 2024-04-25T02:08:40.937 INFO:tasks.workunit.client.0.smithi077.stdout:1/21: read f2 [225825,129068] 0 2024-04-25T02:08:40.937 INFO:tasks.workunit.client.0.smithi077.stdout:8/25: mknod d3/c5 0 2024-04-25T02:08:40.937 INFO:tasks.workunit.client.0.smithi077.stdout:2/4: truncate f0 4124618 0 2024-04-25T02:08:40.937 INFO:tasks.workunit.client.0.smithi077.stdout:1/22: write f1 [9308953,31084] 0 2024-04-25T02:08:40.937 INFO:tasks.workunit.client.0.smithi077.stdout:8/26: creat d3/f6 x:0 0 0 2024-04-25T02:08:40.937 INFO:tasks.workunit.client.0.smithi077.stdout:8/27: truncate d3/f4 660741 0 2024-04-25T02:08:40.937 INFO:tasks.workunit.client.0.smithi077.stdout:8/28: dread - d3/f6 zero size 2024-04-25T02:08:40.937 INFO:tasks.workunit.client.0.smithi077.stdout:8/29: creat d3/f7 x:0 0 0 2024-04-25T02:08:40.937 INFO:tasks.workunit.client.0.smithi077.stdout:8/30: creat d3/f8 x:0 0 0 2024-04-25T02:08:40.937 INFO:tasks.workunit.client.0.smithi077.stdout:3/15: write d0/f1 [204618,20517] 0 2024-04-25T02:08:40.938 INFO:tasks.workunit.client.0.smithi077.stdout:3/16: fdatasync d0/f1 0 2024-04-25T02:08:40.938 INFO:tasks.workunit.client.0.smithi077.stdout:3/17: truncate d0/f1 525239 0 2024-04-25T02:08:40.939 INFO:tasks.workunit.client.0.smithi077.stdout:5/24: unlink d0/d2/f7 0 2024-04-25T02:08:40.939 INFO:tasks.workunit.client.0.smithi077.stdout:5/25: dwrite - no filename 2024-04-25T02:08:40.940 INFO:tasks.workunit.client.0.smithi077.stdout:3/18: dread d0/f1 [0,4194304] 0 2024-04-25T02:08:40.942 INFO:tasks.workunit.client.0.smithi077.stdout:1/23: symlink l5 0 2024-04-25T02:08:40.944 INFO:tasks.workunit.client.0.smithi077.stdout:8/31: mknod d3/c9 0 2024-04-25T02:08:40.945 INFO:tasks.workunit.client.0.smithi077.stdout:8/32: write d3/f6 [884743,33575] 0 2024-04-25T02:08:40.945 INFO:tasks.workunit.client.0.smithi077.stdout:8/33: write d3/f8 [174268,97355] 0 2024-04-25T02:08:40.945 INFO:tasks.workunit.client.0.smithi077.stdout:5/26: mknod d0/d2/d3/c8 0 2024-04-25T02:08:40.946 INFO:tasks.workunit.client.0.smithi077.stdout:5/27: dwrite - no filename 2024-04-25T02:08:40.947 INFO:tasks.workunit.client.0.smithi077.stdout:3/19: mkdir d0/d2/d3 0 2024-04-25T02:08:40.947 INFO:tasks.workunit.client.0.smithi077.stdout:3/20: rename d0 to d0/d2/d4 22 2024-04-25T02:08:40.947 INFO:tasks.workunit.client.0.smithi077.stdout:3/21: fsync d0/f1 0 2024-04-25T02:08:40.947 INFO:tasks.workunit.client.0.smithi077.stdout:3/22: truncate d0/f1 553580 0 2024-04-25T02:08:40.948 INFO:tasks.workunit.client.0.smithi077.stdout:1/24: symlink l6 0 2024-04-25T02:08:40.949 INFO:tasks.workunit.client.0.smithi077.stdout:8/34: mkdir d3/da 0 2024-04-25T02:08:40.950 INFO:tasks.workunit.client.0.smithi077.stdout:5/28: mkdir d0/d2/d3/d9 0 2024-04-25T02:08:40.952 INFO:tasks.workunit.client.0.smithi077.stdout:3/23: rmdir d0/d2 39 2024-04-25T02:08:40.954 INFO:tasks.workunit.client.0.smithi077.stdout:3/24: dread d0/f1 [0,4194304] 0 2024-04-25T02:08:40.954 INFO:tasks.workunit.client.0.smithi077.stdout:1/25: rename c4 to c7 0 2024-04-25T02:08:40.954 INFO:tasks.workunit.client.0.smithi077.stdout:1/26: write f3 [23777,85708] 0 2024-04-25T02:08:40.955 INFO:tasks.workunit.client.0.smithi077.stdout:3/25: dread d0/f1 [0,4194304] 0 2024-04-25T02:08:40.956 INFO:tasks.workunit.client.0.smithi077.stdout:5/29: getdents d0 0 2024-04-25T02:08:40.956 INFO:tasks.workunit.client.0.smithi077.stdout:5/30: dread - no filename 2024-04-25T02:08:40.956 INFO:tasks.workunit.client.0.smithi077.stdout:5/31: dread - no filename 2024-04-25T02:08:40.956 INFO:tasks.workunit.client.0.smithi077.stdout:6/23: dwrite f7 [0,4194304] 0 2024-04-25T02:08:40.958 INFO:tasks.workunit.client.0.smithi077.stdout:5/32: unlink d0/l1 0 2024-04-25T02:08:40.958 INFO:tasks.workunit.client.0.smithi077.stdout:5/33: dread - no filename 2024-04-25T02:08:40.959 INFO:tasks.workunit.client.0.smithi077.stdout:1/27: dread f2 [0,4194304] 0 2024-04-25T02:08:40.959 INFO:tasks.workunit.client.0.smithi077.stdout:5/34: creat d0/fa x:0 0 0 2024-04-25T02:08:40.959 INFO:tasks.workunit.client.0.smithi077.stdout:1/28: creat f8 x:0 0 0 2024-04-25T02:08:40.962 INFO:tasks.workunit.client.0.smithi077.stdout:1/29: mknod c9 0 2024-04-25T02:08:40.963 INFO:tasks.workunit.client.0.smithi077.stdout:5/35: symlink d0/lb 0 2024-04-25T02:08:40.963 INFO:tasks.workunit.client.0.smithi077.stdout:5/36: write d0/fa [1043775,66660] 0 2024-04-25T02:08:40.963 INFO:tasks.workunit.client.0.smithi077.stdout:5/37: write d0/fa [1228761,126565] 0 2024-04-25T02:08:40.978 INFO:tasks.workunit.client.0.smithi077.stdout:6/24: dwrite f0 [0,4194304] 0 2024-04-25T02:08:40.978 INFO:tasks.workunit.client.0.smithi077.stdout:3/26: dwrite d0/f1 [0,4194304] 0 2024-04-25T02:08:40.978 INFO:tasks.workunit.client.0.smithi077.stdout:3/27: fdatasync d0/f1 0 2024-04-25T02:08:40.978 INFO:tasks.workunit.client.0.smithi077.stdout:1/30: dread f3 [0,4194304] 0 2024-04-25T02:08:40.984 INFO:tasks.workunit.client.0.smithi077.stdout:6/25: symlink lb 0 2024-04-25T02:08:40.987 INFO:tasks.workunit.client.0.smithi077.stdout:1/31: mknod ca 0 2024-04-25T02:08:40.987 INFO:tasks.workunit.client.0.smithi077.stdout:3/28: write d0/f1 [2255018,9523] 0 2024-04-25T02:08:40.988 INFO:tasks.workunit.client.0.smithi077.stdout:3/29: getdents d0/d2/d3 0 2024-04-25T02:08:40.988 INFO:tasks.workunit.client.0.smithi077.stdout:3/30: stat d0/d2 0 2024-04-25T02:08:40.988 INFO:tasks.workunit.client.0.smithi077.stdout:1/32: mkdir db 0 2024-04-25T02:08:40.990 INFO:tasks.workunit.client.0.smithi077.stdout:1/33: mknod db/cc 0 2024-04-25T02:08:40.990 INFO:tasks.workunit.client.0.smithi077.stdout:1/34: truncate f2 666260 0 2024-04-25T02:08:40.997 INFO:tasks.workunit.client.0.smithi077.stdout:3/31: dread d0/f1 [0,4194304] 0 2024-04-25T02:08:40.999 INFO:tasks.workunit.client.0.smithi077.stdout:3/32: creat d0/d2/f5 x:0 0 0 2024-04-25T02:08:41.000 INFO:tasks.workunit.client.0.smithi077.stdout:3/33: symlink d0/d2/d3/l6 0 2024-04-25T02:08:41.000 INFO:tasks.workunit.client.0.smithi077.stdout:3/34: chown d0/d2/d3/l6 916014 1 2024-04-25T02:08:41.004 INFO:tasks.workunit.client.0.smithi077.stdout:6/26: dwrite f2 [0,4194304] 0 2024-04-25T02:08:41.006 INFO:tasks.workunit.client.0.smithi077.stdout:6/27: link c4 cc 0 2024-04-25T02:08:41.006 INFO:tasks.workunit.client.0.smithi077.stdout:6/28: creat fd x:0 0 0 2024-04-25T02:08:41.006 INFO:tasks.workunit.client.0.smithi077.stdout:6/29: chown fd 2 1 2024-04-25T02:08:41.008 INFO:tasks.workunit.client.0.smithi077.stdout:6/30: mkdir de 0 2024-04-25T02:08:41.033 INFO:tasks.workunit.client.0.smithi077.stdout:8/35: fsync d3/f4 0 2024-04-25T02:08:41.033 INFO:tasks.workunit.client.0.smithi077.stdout:8/36: chown l0 126764838 1 2024-04-25T02:08:41.035 INFO:tasks.workunit.client.0.smithi077.stdout:8/37: dread d3/f8 [0,4194304] 0 2024-04-25T02:08:41.036 INFO:tasks.workunit.client.0.smithi077.stdout:8/38: mkdir d3/da/db 0 2024-04-25T02:08:41.059 INFO:tasks.workunit.client.0.smithi077.stdout:8/39: dwrite d3/f8 [0,4194304] 0 2024-04-25T02:08:41.061 INFO:tasks.workunit.client.0.smithi077.stdout:8/40: mknod d3/da/cc 0 2024-04-25T02:08:41.061 INFO:tasks.workunit.client.0.smithi077.stdout:8/41: creat d3/fd x:0 0 0 2024-04-25T02:08:41.061 INFO:tasks.workunit.client.0.smithi077.stdout:8/42: write d3/fd [479168,103964] 0 2024-04-25T02:08:41.063 INFO:tasks.workunit.client.0.smithi077.stdout:8/43: dread d3/f6 [0,4194304] 0 2024-04-25T02:08:41.064 INFO:tasks.workunit.client.0.smithi077.stdout:8/44: mkdir d3/de 0 2024-04-25T02:08:41.064 INFO:tasks.workunit.client.0.smithi077.stdout:8/45: readlink l1 0 2024-04-25T02:08:41.340 INFO:tasks.workunit.client.0.smithi077.stdout:0/12: fsync f1 0 2024-04-25T02:08:41.341 INFO:tasks.workunit.client.0.smithi077.stdout:0/13: mkdir d2 0 2024-04-25T02:08:41.341 INFO:tasks.workunit.client.0.smithi077.stdout:0/14: chown l0 0 1 2024-04-25T02:08:41.341 INFO:tasks.workunit.client.0.smithi077.stdout:0/15: readlink l0 0 2024-04-25T02:08:41.342 INFO:tasks.workunit.client.0.smithi077.stdout:0/16: write f1 [583972,116179] 0 2024-04-25T02:08:41.344 INFO:tasks.workunit.client.0.smithi077.stdout:0/17: creat d2/f3 x:0 0 0 2024-04-25T02:08:41.345 INFO:tasks.workunit.client.0.smithi077.stdout:0/18: creat d2/f4 x:0 0 0 2024-04-25T02:08:41.345 INFO:tasks.workunit.client.0.smithi077.stdout:9/9: truncate f3 1188149 0 2024-04-25T02:08:41.346 INFO:tasks.workunit.client.0.smithi077.stdout:0/19: fsync f1 0 2024-04-25T02:08:41.349 INFO:tasks.workunit.client.0.smithi077.stdout:6/31: write f2 [4359592,13576] 0 2024-04-25T02:08:41.350 INFO:tasks.workunit.client.0.smithi077.stdout:6/32: symlink de/lf 0 2024-04-25T02:08:41.351 INFO:tasks.workunit.client.0.smithi077.stdout:6/33: symlink de/l10 0 2024-04-25T02:08:41.351 INFO:tasks.workunit.client.0.smithi077.stdout:6/34: stat de/l10 0 2024-04-25T02:08:41.351 INFO:tasks.workunit.client.0.smithi077.stdout:6/35: write fd [1014163,104849] 0 2024-04-25T02:08:41.352 INFO:tasks.workunit.client.0.smithi077.stdout:7/7: sync 2024-04-25T02:08:41.352 INFO:tasks.workunit.client.0.smithi077.stdout:4/17: sync 2024-04-25T02:08:41.353 INFO:tasks.workunit.client.0.smithi077.stdout:7/8: rename c0 to c2 0 2024-04-25T02:08:41.354 INFO:tasks.workunit.client.0.smithi077.stdout:4/18: truncate d0/d1/f2 252678 0 2024-04-25T02:08:41.356 INFO:tasks.workunit.client.0.smithi077.stdout:7/9: symlink l3 0 2024-04-25T02:08:41.358 INFO:tasks.workunit.client.0.smithi077.stdout:2/5: dread f0 [0,4194304] 0 2024-04-25T02:08:41.359 INFO:tasks.workunit.client.0.smithi077.stdout:4/19: getdents d0 0 2024-04-25T02:08:41.361 INFO:tasks.workunit.client.0.smithi077.stdout:7/10: mkdir d4 0 2024-04-25T02:08:41.361 INFO:tasks.workunit.client.0.smithi077.stdout:7/11: write f1 [250775,36871] 0 2024-04-25T02:08:41.361 INFO:tasks.workunit.client.0.smithi077.stdout:7/12: readlink l3 0 2024-04-25T02:08:41.361 INFO:tasks.workunit.client.0.smithi077.stdout:2/6: dread f0 [0,4194304] 0 2024-04-25T02:08:41.367 INFO:tasks.workunit.client.0.smithi077.stdout:6/36: dwrite f5 [0,4194304] 0 2024-04-25T02:08:41.372 INFO:tasks.workunit.client.0.smithi077.stdout:3/35: rename d0/d2/d3 to d0/d7 0 2024-04-25T02:08:41.375 INFO:tasks.workunit.client.0.smithi077.stdout:8/46: rmdir d3 39 2024-04-25T02:08:41.378 INFO:tasks.workunit.client.1.smithi112.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-25T02:08:41.379 INFO:tasks.workunit.client.0.smithi077.stdout:9/10: truncate f3 1582075 0 2024-04-25T02:08:41.383 INFO:tasks.workunit.client.0.smithi077.stdout:6/37: truncate f2 1241031 0 2024-04-25T02:08:41.385 INFO:tasks.workunit.client.0.smithi077.stdout:4/20: dread d0/d1/f2 [0,4194304] 0 2024-04-25T02:08:41.386 INFO:tasks.workunit.client.0.smithi077.stdout:4/21: read d0/d1/f2 [224684,38311] 0 2024-04-25T02:08:41.386 INFO:tasks.workunit.client.0.smithi077.stdout:4/22: creat d0/d1/f6 x:0 0 0 2024-04-25T02:08:41.386 INFO:tasks.workunit.client.0.smithi077.stdout:4/23: readlink d0/l3 0 2024-04-25T02:08:41.386 INFO:tasks.workunit.client.0.smithi077.stdout:4/24: write d0/d1/f2 [141383,6307] 0 2024-04-25T02:08:41.386 INFO:tasks.workunit.client.0.smithi077.stdout:6/38: link lb de/l11 0 2024-04-25T02:08:41.387 INFO:tasks.workunit.client.0.smithi077.stdout:7/13: truncate f1 171103 0 2024-04-25T02:08:41.388 INFO:tasks.workunit.client.0.smithi077.stdout:4/25: creat d0/f7 x:0 0 0 2024-04-25T02:08:41.389 INFO:tasks.workunit.client.0.smithi077.stdout:4/26: write d0/f7 [303800,14140] 0 2024-04-25T02:08:41.389 INFO:tasks.workunit.client.0.smithi077.stdout:4/27: dread - d0/d1/f6 zero size 2024-04-25T02:08:41.390 INFO:tasks.workunit.client.0.smithi077.stdout:6/39: rmdir de 39 2024-04-25T02:08:41.392 INFO:tasks.workunit.client.0.smithi077.stdout:1/35: sync 2024-04-25T02:08:41.392 INFO:tasks.workunit.client.0.smithi077.stdout:5/38: sync 2024-04-25T02:08:41.392 INFO:tasks.workunit.client.0.smithi077.stdout:5/39: write d0/fa [1468226,104321] 0 2024-04-25T02:08:41.393 INFO:tasks.workunit.client.0.smithi077.stdout:4/28: mkdir d0/d1/d8 0 2024-04-25T02:08:41.393 INFO:tasks.workunit.client.0.smithi077.stdout:4/29: stat d0 0 2024-04-25T02:08:41.394 INFO:tasks.workunit.client.0.smithi077.stdout:8/47: dwrite d3/f7 [0,4194304] 0 2024-04-25T02:08:41.394 INFO:tasks.workunit.client.0.smithi077.stdout:6/40: mkdir de/d12 0 2024-04-25T02:08:41.397 INFO:tasks.workunit.client.0.smithi077.stdout:1/36: creat db/fd x:0 0 0 2024-04-25T02:08:41.398 INFO:tasks.workunit.client.0.smithi077.stdout:5/40: chown d0/d2/d3 3 1 2024-04-25T02:08:41.398 INFO:tasks.workunit.client.0.smithi077.stdout:5/41: read d0/fa [1377042,123375] 0 2024-04-25T02:08:41.402 INFO:tasks.workunit.client.0.smithi077.stdout:8/48: rmdir d3/de 0 2024-04-25T02:08:41.403 INFO:tasks.workunit.client.0.smithi077.stdout:6/41: creat de/f13 x:0 0 0 2024-04-25T02:08:41.403 INFO:tasks.workunit.client.0.smithi077.stdout:6/42: write de/f13 [1015985,70040] 0 2024-04-25T02:08:41.404 INFO:tasks.workunit.client.0.smithi077.stdout:1/37: mknod db/ce 0 2024-04-25T02:08:41.404 INFO:tasks.workunit.client.0.smithi077.stdout:8/49: mkdir d3/da/db/df 0 2024-04-25T02:08:41.405 INFO:tasks.workunit.client.0.smithi077.stdout:6/43: creat de/d12/f14 x:0 0 0 2024-04-25T02:08:41.405 INFO:tasks.workunit.client.0.smithi077.stdout:1/38: mkdir db/df 0 2024-04-25T02:08:41.405 INFO:tasks.workunit.client.0.smithi077.stdout:1/39: dread - db/fd zero size 2024-04-25T02:08:41.406 INFO:tasks.workunit.client.0.smithi077.stdout:6/44: mkdir de/d15 0 2024-04-25T02:08:41.430 INFO:tasks.workunit.client.0.smithi077.stdout:5/42: fsync d0/fa 0 2024-04-25T02:08:41.431 INFO:tasks.workunit.client.0.smithi077.stdout:7/14: dread f1 [0,4194304] 0 2024-04-25T02:08:41.431 INFO:tasks.workunit.client.0.smithi077.stdout:7/15: fsync f1 0 2024-04-25T02:08:41.434 INFO:tasks.workunit.client.0.smithi077.stdout:5/43: link d0/lb d0/d2/d3/d9/lc 0 2024-04-25T02:08:41.434 INFO:tasks.workunit.client.0.smithi077.stdout:6/45: write f9 [1080084,5765] 0 2024-04-25T02:08:41.435 INFO:tasks.workunit.client.0.smithi077.stdout:7/16: creat d4/f5 x:0 0 0 2024-04-25T02:08:41.436 INFO:tasks.workunit.client.0.smithi077.stdout:7/17: write f1 [14719,30889] 0 2024-04-25T02:08:41.436 INFO:tasks.workunit.client.0.smithi077.stdout:7/18: fdatasync d4/f5 0 2024-04-25T02:08:41.436 INFO:tasks.workunit.client.0.smithi077.stdout:7/19: truncate d4/f5 291444 0 2024-04-25T02:08:41.437 INFO:tasks.workunit.client.0.smithi077.stdout:5/44: creat d0/fd x:0 0 0 2024-04-25T02:08:41.437 INFO:tasks.workunit.client.0.smithi077.stdout:6/46: mknod de/c16 0 2024-04-25T02:08:41.437 INFO:tasks.workunit.client.0.smithi077.stdout:6/47: creat de/d12/f17 x:0 0 0 2024-04-25T02:08:41.439 INFO:tasks.workunit.client.0.smithi077.stdout:7/20: fdatasync f1 0 2024-04-25T02:08:41.439 INFO:tasks.workunit.client.0.smithi077.stdout:8/50: dwrite d3/f7 [0,4194304] 0 2024-04-25T02:08:41.440 INFO:tasks.workunit.client.0.smithi077.stdout:6/48: symlink de/d15/l18 0 2024-04-25T02:08:41.442 INFO:tasks.workunit.client.0.smithi077.stdout:7/21: rename f1 to d4/f6 0 2024-04-25T02:08:41.444 INFO:tasks.workunit.client.0.smithi077.stdout:8/51: rmdir d3 39 2024-04-25T02:08:41.445 INFO:tasks.workunit.client.0.smithi077.stdout:6/49: rename cc to de/d15/c19 0 2024-04-25T02:08:41.445 INFO:tasks.workunit.client.0.smithi077.stdout:6/50: truncate f0 4782398 0 2024-04-25T02:08:41.446 INFO:tasks.workunit.client.0.smithi077.stdout:8/52: creat d3/da/db/df/f10 x:0 0 0 2024-04-25T02:08:41.450 INFO:tasks.workunit.client.0.smithi077.stdout:5/45: fsync d0/fd 0 2024-04-25T02:08:41.450 INFO:tasks.workunit.client.0.smithi077.stdout:8/53: write d3/f6 [827986,57266] 0 2024-04-25T02:08:41.451 INFO:tasks.workunit.client.0.smithi077.stdout:5/46: mknod d0/d2/d5/ce 0 2024-04-25T02:08:41.452 INFO:tasks.workunit.client.0.smithi077.stdout:5/47: write d0/fd [95620,79698] 0 2024-04-25T02:08:41.452 INFO:tasks.workunit.client.0.smithi077.stdout:5/48: write d0/fa [2246409,57295] 0 2024-04-25T02:08:41.452 INFO:tasks.workunit.client.0.smithi077.stdout:8/54: mkdir d3/da/db/d11 0 2024-04-25T02:08:41.454 INFO:tasks.workunit.client.0.smithi077.stdout:8/55: symlink d3/l12 0 2024-04-25T02:08:41.460 INFO:tasks.workunit.client.0.smithi077.stdout:7/22: dwrite d4/f6 [0,4194304] 0 2024-04-25T02:08:41.460 INFO:tasks.workunit.client.0.smithi077.stdout:7/23: chown d4/f6 376918 1 2024-04-25T02:08:41.460 INFO:tasks.workunit.client.0.smithi077.stdout:4/30: dwrite d0/f7 [0,4194304] 0 2024-04-25T02:08:41.460 INFO:tasks.workunit.client.0.smithi077.stdout:4/31: stat d0 0 2024-04-25T02:08:41.470 INFO:tasks.workunit.client.0.smithi077.stdout:6/51: dwrite f7 [0,4194304] 0 2024-04-25T02:08:41.473 INFO:tasks.workunit.client.0.smithi077.stdout:6/52: mknod de/c1a 0 2024-04-25T02:08:41.474 INFO:tasks.workunit.client.0.smithi077.stdout:6/53: stat de 0 2024-04-25T02:08:41.485 INFO:tasks.workunit.client.0.smithi077.stdout:6/54: write f5 [3671299,92604] 0 2024-04-25T02:08:41.485 INFO:tasks.workunit.client.0.smithi077.stdout:6/55: creat de/d12/f1b x:0 0 0 2024-04-25T02:08:41.485 INFO:tasks.workunit.client.0.smithi077.stdout:6/56: chown f7 2271752 1 2024-04-25T02:08:41.502 INFO:tasks.workunit.client.0.smithi077.stdout:8/56: dwrite d3/da/db/df/f10 [0,4194304] 0 2024-04-25T02:08:41.502 INFO:tasks.workunit.client.0.smithi077.stdout:5/49: dwrite d0/fa [0,4194304] 0 2024-04-25T02:08:41.502 INFO:tasks.workunit.client.0.smithi077.stdout:6/57: fsync f5 0 2024-04-25T02:08:41.502 INFO:tasks.workunit.client.0.smithi077.stdout:6/58: creat de/d12/f1c x:0 0 0 2024-04-25T02:08:41.503 INFO:tasks.workunit.client.0.smithi077.stdout:6/59: write f5 [3580557,50873] 0 2024-04-25T02:08:41.503 INFO:tasks.workunit.client.0.smithi077.stdout:7/24: dwrite d4/f6 [0,4194304] 0 2024-04-25T02:08:41.505 INFO:tasks.workunit.client.0.smithi077.stdout:8/57: mknod d3/da/db/df/c13 0 2024-04-25T02:08:41.510 INFO:tasks.workunit.client.0.smithi077.stdout:8/58: symlink d3/da/l14 0 2024-04-25T02:08:41.511 INFO:tasks.workunit.client.0.smithi077.stdout:6/60: truncate f0 3330822 0 2024-04-25T02:08:41.513 INFO:tasks.workunit.client.0.smithi077.stdout:6/61: symlink de/d15/l1d 0 2024-04-25T02:08:41.513 INFO:tasks.workunit.client.0.smithi077.stdout:6/62: chown de 26375672 1 2024-04-25T02:08:41.513 INFO:tasks.workunit.client.0.smithi077.stdout:8/59: dread d3/f6 [0,4194304] 0 2024-04-25T02:08:41.513 INFO:tasks.workunit.client.0.smithi077.stdout:8/60: chown l1 528856287 1 2024-04-25T02:08:41.514 INFO:tasks.workunit.client.0.smithi077.stdout:8/61: chown d3/f6 15990075 1 2024-04-25T02:08:41.514 INFO:tasks.workunit.client.0.smithi077.stdout:6/63: mknod de/d15/c1e 0 2024-04-25T02:08:41.515 INFO:tasks.workunit.client.0.smithi077.stdout:5/50: dread d0/fa [0,4194304] 0 2024-04-25T02:08:41.515 INFO:tasks.workunit.client.0.smithi077.stdout:5/51: write d0/fd [307487,72369] 0 2024-04-25T02:08:41.515 INFO:tasks.workunit.client.0.smithi077.stdout:8/62: mkdir d3/da/d15 0 2024-04-25T02:08:41.517 INFO:tasks.workunit.client.0.smithi077.stdout:5/52: rename d0/fa to d0/d2/ff 0 2024-04-25T02:08:41.518 INFO:tasks.workunit.client.0.smithi077.stdout:6/64: dread f5 [0,4194304] 0 2024-04-25T02:08:41.518 INFO:tasks.workunit.client.0.smithi077.stdout:6/65: fsync de/d12/f1c 0 2024-04-25T02:08:41.518 INFO:tasks.workunit.client.0.smithi077.stdout:6/66: chown de/d15 363 1 2024-04-25T02:08:41.521 INFO:tasks.workunit.client.0.smithi077.stdout:6/67: link de/l10 de/l1f 0 2024-04-25T02:08:41.521 INFO:tasks.workunit.client.0.smithi077.stdout:0/20: sync 2024-04-25T02:08:41.521 INFO:tasks.workunit.client.0.smithi077.stdout:5/53: symlink d0/l10 0 2024-04-25T02:08:41.523 INFO:tasks.workunit.client.0.smithi077.stdout:6/68: symlink de/l20 0 2024-04-25T02:08:41.523 INFO:tasks.workunit.client.0.smithi077.stdout:6/69: write f0 [4240818,29907] 0 2024-04-25T02:08:41.523 INFO:tasks.workunit.client.0.smithi077.stdout:6/70: write de/d12/f17 [74413,85492] 0 2024-04-25T02:08:41.523 INFO:tasks.workunit.client.0.smithi077.stdout:6/71: creat de/f21 x:0 0 0 2024-04-25T02:08:41.523 INFO:tasks.workunit.client.0.smithi077.stdout:6/72: dread - de/d12/f1c zero size 2024-04-25T02:08:41.523 INFO:tasks.workunit.client.0.smithi077.stdout:6/73: write f1 [916937,81274] 0 2024-04-25T02:08:41.523 INFO:tasks.workunit.client.0.smithi077.stdout:6/74: stat de/d15/c1e 0 2024-04-25T02:08:41.524 INFO:tasks.workunit.client.0.smithi077.stdout:0/21: rename f1 to d2/f5 0 2024-04-25T02:08:41.524 INFO:tasks.workunit.client.0.smithi077.stdout:0/22: read - d2/f4 zero size 2024-04-25T02:08:41.524 INFO:tasks.workunit.client.0.smithi077.stdout:0/23: creat d2/f6 x:0 0 0 2024-04-25T02:08:41.529 INFO:tasks.workunit.client.0.smithi077.stdout:5/54: symlink d0/l11 0 2024-04-25T02:08:41.532 INFO:tasks.workunit.client.0.smithi077.stdout:0/24: rmdir d2 39 2024-04-25T02:08:41.532 INFO:tasks.workunit.client.0.smithi077.stdout:0/25: fdatasync d2/f4 0 2024-04-25T02:08:41.532 INFO:tasks.workunit.client.0.smithi077.stdout:0/26: stat d2/f6 0 2024-04-25T02:08:41.532 INFO:tasks.workunit.client.0.smithi077.stdout:0/27: truncate d2/f4 389063 0 2024-04-25T02:08:41.532 INFO:tasks.workunit.client.0.smithi077.stdout:0/28: write d2/f6 [481448,74388] 0 2024-04-25T02:08:41.533 INFO:tasks.workunit.client.0.smithi077.stdout:0/29: getdents d2 0 2024-04-25T02:08:41.533 INFO:tasks.workunit.client.0.smithi077.stdout:0/30: stat d2/f5 0 2024-04-25T02:08:41.533 INFO:tasks.workunit.client.0.smithi077.stdout:0/31: chown d2/f5 351428961 1 2024-04-25T02:08:41.533 INFO:tasks.workunit.client.0.smithi077.stdout:0/32: write d2/f3 [140075,125744] 0 2024-04-25T02:08:41.533 INFO:tasks.workunit.client.0.smithi077.stdout:0/33: truncate d2/f6 1467713 0 2024-04-25T02:08:41.534 INFO:tasks.workunit.client.0.smithi077.stdout:0/34: symlink d2/l7 0 2024-04-25T02:08:41.535 INFO:tasks.workunit.client.0.smithi077.stdout:0/35: mkdir d2/d8 0 2024-04-25T02:08:41.536 INFO:tasks.workunit.client.0.smithi077.stdout:0/36: chown d2/l7 3013281 1 2024-04-25T02:08:41.537 INFO:tasks.workunit.client.0.smithi077.stdout:0/37: mkdir d2/d9 0 2024-04-25T02:08:41.544 INFO:tasks.workunit.client.0.smithi077.stdout:6/75: dwrite f1 [0,4194304] 0 2024-04-25T02:08:41.546 INFO:tasks.workunit.client.0.smithi077.stdout:5/55: dwrite d0/fd [0,4194304] 0 2024-04-25T02:08:41.547 INFO:tasks.workunit.client.0.smithi077.stdout:6/76: rename de/d12/f1b to de/d15/f22 0 2024-04-25T02:08:41.547 INFO:tasks.workunit.client.0.smithi077.stdout:6/77: readlink de/l11 0 2024-04-25T02:08:41.547 INFO:tasks.workunit.client.0.smithi077.stdout:6/78: write f7 [5214978,31611] 0 2024-04-25T02:08:41.548 INFO:tasks.workunit.client.0.smithi077.stdout:0/38: dread d2/f6 [0,4194304] 0 2024-04-25T02:08:41.549 INFO:tasks.workunit.client.0.smithi077.stdout:0/39: chown d2/d8 698154 1 2024-04-25T02:08:41.549 INFO:tasks.workunit.client.0.smithi077.stdout:5/56: mkdir d0/d2/d5/d12 0 2024-04-25T02:08:41.550 INFO:tasks.workunit.client.0.smithi077.stdout:0/40: creat d2/d8/fa x:0 0 0 2024-04-25T02:08:41.553 INFO:tasks.workunit.client.0.smithi077.stdout:0/41: mknod d2/cb 0 2024-04-25T02:08:41.558 INFO:tasks.workunit.client.0.smithi077.stdout:0/42: dread d2/f5 [0,4194304] 0 2024-04-25T02:08:41.559 INFO:tasks.workunit.client.0.smithi077.stdout:0/43: mknod d2/d8/cc 0 2024-04-25T02:08:41.559 INFO:tasks.workunit.client.0.smithi077.stdout:0/44: truncate d2/f5 1250556 0 2024-04-25T02:08:41.559 INFO:tasks.workunit.client.0.smithi077.stdout:0/45: write d2/d8/fa [575808,7988] 0 2024-04-25T02:08:41.560 INFO:tasks.workunit.client.0.smithi077.stdout:0/46: unlink d2/cb 0 2024-04-25T02:08:41.573 INFO:tasks.workunit.client.0.smithi077.stdout:6/79: dwrite f5 [0,4194304] 0 2024-04-25T02:08:41.573 INFO:tasks.workunit.client.0.smithi077.stdout:5/57: dwrite d0/fd [4194304,4194304] 0 2024-04-25T02:08:41.577 INFO:tasks.workunit.client.0.smithi077.stdout:6/80: rename de/d15/c1e to de/d15/c23 0 2024-04-25T02:08:41.577 INFO:tasks.workunit.client.0.smithi077.stdout:6/81: read f9 [862909,79311] 0 2024-04-25T02:08:41.580 INFO:tasks.workunit.client.0.smithi077.stdout:5/58: rename d0/d2/d3/c8 to d0/d2/d5/c13 0 2024-04-25T02:08:41.581 INFO:tasks.workunit.client.0.smithi077.stdout:6/82: mknod de/d15/c24 0 2024-04-25T02:08:41.583 INFO:tasks.workunit.client.0.smithi077.stdout:5/59: creat d0/d2/d3/d9/f14 x:0 0 0 2024-04-25T02:08:41.583 INFO:tasks.workunit.client.0.smithi077.stdout:5/60: write d0/d2/d3/d9/f14 [782457,123439] 0 2024-04-25T02:08:41.585 INFO:tasks.workunit.client.0.smithi077.stdout:5/61: unlink d0/d2/d5/ce 0 2024-04-25T02:08:41.585 INFO:tasks.workunit.client.0.smithi077.stdout:5/62: chown d0/d2/d5/c13 172453071 1 2024-04-25T02:08:41.587 INFO:tasks.workunit.client.0.smithi077.stdout:5/63: creat d0/d2/d3/f15 x:0 0 0 2024-04-25T02:08:41.588 INFO:tasks.workunit.client.0.smithi077.stdout:5/64: mknod d0/d2/c16 0 2024-04-25T02:08:41.588 INFO:tasks.workunit.client.0.smithi077.stdout:5/65: creat d0/d2/d3/f17 x:0 0 0 2024-04-25T02:08:41.588 INFO:tasks.workunit.client.0.smithi077.stdout:0/47: dwrite d2/d8/fa [0,4194304] 0 2024-04-25T02:08:41.589 INFO:tasks.workunit.client.0.smithi077.stdout:0/48: write d2/f6 [2037793,49544] 0 2024-04-25T02:08:41.590 INFO:tasks.workunit.client.0.smithi077.stdout:5/66: symlink d0/d2/d3/d9/l18 0 2024-04-25T02:08:41.593 INFO:tasks.workunit.client.0.smithi077.stdout:5/67: unlink d0/lb 0 2024-04-25T02:08:41.593 INFO:tasks.workunit.client.0.smithi077.stdout:5/68: truncate d0/d2/ff 3875668 0 2024-04-25T02:08:41.596 INFO:tasks.workunit.client.0.smithi077.stdout:2/7: sync 2024-04-25T02:08:41.596 INFO:tasks.workunit.client.0.smithi077.stdout:3/36: sync 2024-04-25T02:08:41.597 INFO:tasks.workunit.client.0.smithi077.stdout:6/83: dwrite de/d12/f1c [0,4194304] 0 2024-04-25T02:08:41.602 INFO:tasks.workunit.client.0.smithi077.stdout:3/37: symlink d0/l8 0 2024-04-25T02:08:41.602 INFO:tasks.workunit.client.0.smithi077.stdout:3/38: stat d0/d2/f5 0 2024-04-25T02:08:41.602 INFO:tasks.workunit.client.0.smithi077.stdout:3/39: chown d0/f1 22049560 1 2024-04-25T02:08:41.602 INFO:tasks.workunit.client.0.smithi077.stdout:2/8: write f0 [221365,100903] 0 2024-04-25T02:08:41.602 INFO:tasks.workunit.client.0.smithi077.stdout:2/9: write f0 [4101287,128795] 0 2024-04-25T02:08:41.602 INFO:tasks.workunit.client.0.smithi077.stdout:2/10: chown f0 7 1 2024-04-25T02:08:41.602 INFO:tasks.workunit.client.0.smithi077.stdout:2/11: write f0 [3791871,114438] 0 2024-04-25T02:08:41.602 INFO:tasks.workunit.client.0.smithi077.stdout:0/49: dread d2/f6 [0,4194304] 0 2024-04-25T02:08:41.602 INFO:tasks.workunit.client.0.smithi077.stdout:0/50: creat d2/d8/fd x:0 0 0 2024-04-25T02:08:41.602 INFO:tasks.workunit.client.0.smithi077.stdout:0/51: stat d2/d8/fd 0 2024-04-25T02:08:41.602 INFO:tasks.workunit.client.0.smithi077.stdout:0/52: chown d2/d9 89739 1 2024-04-25T02:08:41.602 INFO:tasks.workunit.client.0.smithi077.stdout:0/53: creat d2/d8/fe x:0 0 0 2024-04-25T02:08:41.606 INFO:tasks.workunit.client.0.smithi077.stdout:0/54: creat d2/d9/ff x:0 0 0 2024-04-25T02:08:41.606 INFO:tasks.workunit.client.0.smithi077.stdout:0/55: readlink l0 0 2024-04-25T02:08:41.606 INFO:tasks.workunit.client.0.smithi077.stdout:0/56: chown d2/d9 545389 1 2024-04-25T02:08:41.606 INFO:tasks.workunit.client.0.smithi077.stdout:5/69: rmdir d0/d2/d3 39 2024-04-25T02:08:41.608 INFO:tasks.workunit.client.0.smithi077.stdout:0/57: mkdir d2/d8/d10 0 2024-04-25T02:08:41.608 INFO:tasks.workunit.client.0.smithi077.stdout:0/58: truncate d2/d8/fa 5200990 0 2024-04-25T02:08:41.616 INFO:tasks.workunit.client.0.smithi077.stdout:5/70: rmdir d0 39 2024-04-25T02:08:41.618 INFO:tasks.workunit.client.0.smithi077.stdout:0/59: rename l0 to d2/l11 0 2024-04-25T02:08:41.619 INFO:tasks.workunit.client.0.smithi077.stdout:0/60: dread - d2/d8/fd zero size 2024-04-25T02:08:41.619 INFO:tasks.workunit.client.0.smithi077.stdout:0/61: fsync d2/d8/fa 0 2024-04-25T02:08:41.620 INFO:tasks.workunit.client.0.smithi077.stdout:6/84: dwrite de/d15/f22 [0,4194304] 0 2024-04-25T02:08:41.620 INFO:tasks.workunit.client.0.smithi077.stdout:6/85: write de/d12/f1c [4948536,34666] 0 2024-04-25T02:08:41.623 INFO:tasks.workunit.client.0.smithi077.stdout:5/71: truncate d0/d2/d3/d9/f14 590735 0 2024-04-25T02:08:41.625 INFO:tasks.workunit.client.0.smithi077.stdout:2/12: dwrite f0 [0,4194304] 0 2024-04-25T02:08:41.626 INFO:tasks.workunit.client.0.smithi077.stdout:0/62: link d2/d8/fa d2/f12 0 2024-04-25T02:08:41.626 INFO:tasks.workunit.client.0.smithi077.stdout:0/63: truncate d2/d8/fe 808431 0 2024-04-25T02:08:41.627 INFO:tasks.workunit.client.0.smithi077.stdout:5/72: getdents d0/d2 0 2024-04-25T02:08:41.633 INFO:tasks.workunit.client.0.smithi077.stdout:5/73: rename d0/l10 to d0/d2/l19 0 2024-04-25T02:08:41.635 INFO:tasks.workunit.client.0.smithi077.stdout:5/74: stat d0/d2/d5 0 2024-04-25T02:08:41.644 INFO:tasks.workunit.client.0.smithi077.stdout:6/86: dwrite f1 [0,4194304] 0 2024-04-25T02:08:41.644 INFO:tasks.workunit.client.0.smithi077.stdout:6/87: write de/d12/f14 [268625,90694] 0 2024-04-25T02:08:41.644 INFO:tasks.workunit.client.0.smithi077.stdout:6/88: fsync de/f13 0 2024-04-25T02:08:41.646 INFO:tasks.workunit.client.0.smithi077.stdout:6/89: mkdir de/d12/d25 0 2024-04-25T02:08:41.647 INFO:tasks.workunit.client.0.smithi077.stdout:5/75: dread d0/fd [4194304,4194304] 0 2024-04-25T02:08:41.650 INFO:tasks.workunit.client.0.smithi077.stdout:5/76: write d0/d2/d3/d9/f14 [488529,119779] 0 2024-04-25T02:08:41.651 INFO:tasks.workunit.client.0.smithi077.stdout:5/77: creat d0/d2/d5/d12/f1a x:0 0 0 2024-04-25T02:08:41.651 INFO:tasks.workunit.client.0.smithi077.stdout:5/78: fsync d0/d2/ff 0 2024-04-25T02:08:41.652 INFO:tasks.workunit.client.0.smithi077.stdout:5/79: mkdir d0/d2/d1b 0 2024-04-25T02:08:41.653 INFO:tasks.workunit.client.0.smithi077.stdout:5/80: creat d0/d2/d3/d9/f1c x:0 0 0 2024-04-25T02:08:41.655 INFO:tasks.workunit.client.0.smithi077.stdout:2/13: dwrite f0 [0,4194304] 0 2024-04-25T02:08:41.657 INFO:tasks.workunit.client.0.smithi077.stdout:0/64: dwrite d2/f6 [0,4194304] 0 2024-04-25T02:08:41.661 INFO:tasks.workunit.client.0.smithi077.stdout:2/14: dread f0 [0,4194304] 0 2024-04-25T02:08:41.662 INFO:tasks.workunit.client.0.smithi077.stdout:0/65: rename d2/f5 to d2/d8/f13 0 2024-04-25T02:08:41.662 INFO:tasks.workunit.client.0.smithi077.stdout:0/66: write d2/d8/fd [88090,70285] 0 2024-04-25T02:08:41.663 INFO:tasks.workunit.client.0.smithi077.stdout:0/67: rename d2/f12 to d2/d9/f14 0 2024-04-25T02:08:41.665 INFO:tasks.workunit.client.0.smithi077.stdout:4/32: sync 2024-04-25T02:08:41.665 INFO:tasks.workunit.client.0.smithi077.stdout:9/11: sync 2024-04-25T02:08:41.665 INFO:tasks.workunit.client.0.smithi077.stdout:8/63: sync 2024-04-25T02:08:41.665 INFO:tasks.workunit.client.0.smithi077.stdout:7/25: sync 2024-04-25T02:08:41.665 INFO:tasks.workunit.client.0.smithi077.stdout:1/40: sync 2024-04-25T02:08:41.665 INFO:tasks.workunit.client.0.smithi077.stdout:8/64: readlink d3/l12 0 2024-04-25T02:08:41.665 INFO:tasks.workunit.client.0.smithi077.stdout:9/12: write f3 [2333991,30404] 0 2024-04-25T02:08:41.666 INFO:tasks.workunit.client.0.smithi077.stdout:1/41: rename c9 to db/df/c10 0 2024-04-25T02:08:41.668 INFO:tasks.workunit.client.0.smithi077.stdout:8/65: mkdir d3/da/d15/d16 0 2024-04-25T02:08:41.670 INFO:tasks.workunit.client.0.smithi077.stdout:9/13: mknod c4 0 2024-04-25T02:08:41.670 INFO:tasks.workunit.client.0.smithi077.stdout:9/14: fdatasync f3 0 2024-04-25T02:08:41.670 INFO:tasks.workunit.client.0.smithi077.stdout:9/15: truncate f3 2612531 0 2024-04-25T02:08:41.670 INFO:tasks.workunit.client.0.smithi077.stdout:9/16: chown f3 75147530 1 2024-04-25T02:08:41.671 INFO:tasks.workunit.client.0.smithi077.stdout:1/42: mkdir db/d11 0 2024-04-25T02:08:41.671 INFO:tasks.workunit.client.0.smithi077.stdout:1/43: chown f8 885215459 1 2024-04-25T02:08:41.672 INFO:tasks.workunit.client.0.smithi077.stdout:4/33: getdents d0/d1 0 2024-04-25T02:08:41.675 INFO:tasks.workunit.client.0.smithi077.stdout:1/44: dread f2 [0,4194304] 0 2024-04-25T02:08:41.675 INFO:tasks.workunit.client.0.smithi077.stdout:1/45: creat db/f12 x:0 0 0 2024-04-25T02:08:41.675 INFO:tasks.workunit.client.0.smithi077.stdout:1/46: fsync f1 0 2024-04-25T02:08:41.675 INFO:tasks.workunit.client.0.smithi077.stdout:4/34: link d0/l5 d0/d1/l9 0 2024-04-25T02:08:41.675 INFO:tasks.workunit.client.0.smithi077.stdout:4/35: stat d0/d1 0 2024-04-25T02:08:41.679 INFO:tasks.workunit.client.0.smithi077.stdout:1/47: rename ca to db/d11/c13 0 2024-04-25T02:08:41.680 INFO:tasks.workunit.client.0.smithi077.stdout:1/48: mkdir db/df/d14 0 2024-04-25T02:08:41.681 INFO:tasks.workunit.client.0.smithi077.stdout:4/36: mkdir d0/d1/da 0 2024-04-25T02:08:41.682 INFO:tasks.workunit.client.0.smithi077.stdout:1/49: link f3 db/d11/f15 0 2024-04-25T02:08:41.682 INFO:tasks.workunit.client.0.smithi077.stdout:1/50: write db/f12 [988921,38196] 0 2024-04-25T02:08:41.682 INFO:tasks.workunit.client.0.smithi077.stdout:1/51: write db/fd [201402,129544] 0 2024-04-25T02:08:41.683 INFO:tasks.workunit.client.0.smithi077.stdout:4/37: read - d0/d1/f6 zero size 2024-04-25T02:08:41.683 INFO:tasks.workunit.client.0.smithi077.stdout:4/38: write d0/d1/f6 [111687,20939] 0 2024-04-25T02:08:41.689 INFO:tasks.workunit.client.0.smithi077.stdout:2/15: dwrite f0 [4194304,4194304] 0 2024-04-25T02:08:41.689 INFO:tasks.workunit.client.0.smithi077.stdout:2/16: chown f0 3 1 2024-04-25T02:08:41.690 INFO:tasks.workunit.client.0.smithi077.stdout:9/17: dwrite f3 [0,4194304] 0 2024-04-25T02:08:41.690 INFO:tasks.workunit.client.0.smithi077.stdout:9/18: creat f5 x:0 0 0 2024-04-25T02:08:41.691 INFO:tasks.workunit.client.0.smithi077.stdout:8/66: dwrite d3/f4 [0,4194304] 0 2024-04-25T02:08:41.693 INFO:tasks.workunit.client.0.smithi077.stdout:8/67: dread d3/fd [0,4194304] 0 2024-04-25T02:08:41.693 INFO:tasks.workunit.client.0.smithi077.stdout:4/39: dread d0/f7 [0,4194304] 0 2024-04-25T02:08:41.710 INFO:tasks.workunit.client.0.smithi077.stdout:0/68: dwrite d2/d8/fd [0,4194304] 0 2024-04-25T02:08:41.736 INFO:tasks.workunit.client.0.smithi077.stdout:8/68: link d3/l12 d3/da/db/df/l17 0 2024-04-25T02:08:41.757 INFO:tasks.workunit.client.0.smithi077.stdout:4/40: creat d0/d1/da/fb x:0 0 0 2024-04-25T02:08:41.758 INFO:tasks.workunit.client.0.smithi077.stdout:2/17: truncate f0 796490 0 2024-04-25T02:08:41.760 INFO:tasks.workunit.client.0.smithi077.stdout:0/69: chown d2/f4 0 1 2024-04-25T02:08:41.762 INFO:tasks.workunit.client.0.smithi077.stdout:8/69: mknod d3/da/db/d11/c18 0 2024-04-25T02:08:41.762 INFO:tasks.workunit.client.0.smithi077.stdout:8/70: chown d3/f7 102327 1 2024-04-25T02:08:41.763 INFO:tasks.workunit.client.0.smithi077.stdout:9/19: getdents . 0 2024-04-25T02:08:41.763 INFO:tasks.workunit.client.0.smithi077.stdout:9/20: stat c4 0 2024-04-25T02:08:41.763 INFO:tasks.workunit.client.0.smithi077.stdout:9/21: readlink l0 0 2024-04-25T02:08:41.763 INFO:tasks.workunit.client.0.smithi077.stdout:9/22: truncate f5 879211 0 2024-04-25T02:08:41.772 INFO:tasks.workunit.client.0.smithi077.stdout:9/23: creat f6 x:0 0 0 2024-04-25T02:08:41.776 INFO:tasks.workunit.client.0.smithi077.stdout:4/41: symlink d0/d1/lc 0 2024-04-25T02:08:41.776 INFO:tasks.workunit.client.0.smithi077.stdout:4/42: dread - d0/d1/da/fb zero size 2024-04-25T02:08:41.776 INFO:tasks.workunit.client.0.smithi077.stdout:0/70: mknod d2/c15 0 2024-04-25T02:08:41.777 INFO:tasks.workunit.client.0.smithi077.stdout:0/71: chown d2/d8/f13 349451 1 2024-04-25T02:08:41.777 INFO:tasks.workunit.client.0.smithi077.stdout:0/72: write d2/d8/fa [4448044,23011] 0 2024-04-25T02:08:41.777 INFO:tasks.workunit.client.0.smithi077.stdout:0/73: fsync d2/d8/f13 0 2024-04-25T02:08:41.779 INFO:tasks.workunit.client.0.smithi077.stdout:9/24: dread f5 [0,4194304] 0 2024-04-25T02:08:41.780 INFO:tasks.workunit.client.0.smithi077.stdout:8/71: dwrite d3/da/db/df/f10 [0,4194304] 0 2024-04-25T02:08:41.784 INFO:tasks.workunit.client.0.smithi077.stdout:0/74: mkdir d2/d16 0 2024-04-25T02:08:41.788 INFO:tasks.workunit.client.0.smithi077.stdout:0/75: rmdir d2/d16 0 2024-04-25T02:08:41.789 INFO:tasks.workunit.client.0.smithi077.stdout:9/25: dread f3 [0,4194304] 0 2024-04-25T02:08:41.791 INFO:tasks.workunit.client.0.smithi077.stdout:4/43: dwrite d0/f7 [0,4194304] 0 2024-04-25T02:08:41.791 INFO:tasks.workunit.client.0.smithi077.stdout:0/76: mkdir d2/d17 0 2024-04-25T02:08:41.793 INFO:tasks.workunit.client.0.smithi077.stdout:0/77: rename d2/d8/fa to d2/d8/d10/f18 0 2024-04-25T02:08:41.795 INFO:tasks.workunit.client.0.smithi077.stdout:0/78: symlink d2/d8/d10/l19 0 2024-04-25T02:08:41.797 INFO:tasks.workunit.client.0.smithi077.stdout:0/79: symlink d2/d8/l1a 0 2024-04-25T02:08:41.807 INFO:tasks.workunit.client.0.smithi077.stdout:2/18: link f0 f1 0 2024-04-25T02:08:41.809 INFO:tasks.workunit.client.0.smithi077.stdout:2/19: mkdir d2 0 2024-04-25T02:08:41.809 INFO:tasks.workunit.client.0.smithi077.stdout:5/81: sync 2024-04-25T02:08:41.809 INFO:tasks.workunit.client.0.smithi077.stdout:1/52: sync 2024-04-25T02:08:41.809 INFO:tasks.workunit.client.0.smithi077.stdout:3/40: sync 2024-04-25T02:08:41.809 INFO:tasks.workunit.client.0.smithi077.stdout:6/90: sync 2024-04-25T02:08:41.809 INFO:tasks.workunit.client.0.smithi077.stdout:7/26: sync 2024-04-25T02:08:41.809 INFO:tasks.workunit.client.0.smithi077.stdout:1/53: chown l5 18198743 1 2024-04-25T02:08:41.809 INFO:tasks.workunit.client.0.smithi077.stdout:1/54: readlink l5 0 2024-04-25T02:08:41.809 INFO:tasks.workunit.client.0.smithi077.stdout:5/82: read d0/d2/d3/d9/f14 [70559,16521] 0 2024-04-25T02:08:41.809 INFO:tasks.workunit.client.0.smithi077.stdout:6/91: write f9 [345775,24690] 0 2024-04-25T02:08:41.809 INFO:tasks.workunit.client.0.smithi077.stdout:5/83: truncate d0/d2/d5/d12/f1a 624705 0 2024-04-25T02:08:41.809 INFO:tasks.workunit.client.0.smithi077.stdout:1/55: creat db/f16 x:0 0 0 2024-04-25T02:08:41.809 INFO:tasks.workunit.client.0.smithi077.stdout:0/80: write d2/d8/fd [2591834,59397] 0 2024-04-25T02:08:41.810 INFO:tasks.workunit.client.0.smithi077.stdout:7/27: dread d4/f5 [0,4194304] 0 2024-04-25T02:08:41.811 INFO:tasks.workunit.client.0.smithi077.stdout:7/28: chown d4/f6 123 1 2024-04-25T02:08:41.811 INFO:tasks.workunit.client.0.smithi077.stdout:7/29: truncate d4/f5 592245 0 2024-04-25T02:08:41.812 INFO:tasks.workunit.client.0.smithi077.stdout:4/44: dwrite d0/f7 [0,4194304] 0 2024-04-25T02:08:41.812 INFO:tasks.workunit.client.0.smithi077.stdout:4/45: dread - d0/d1/da/fb zero size 2024-04-25T02:08:41.812 INFO:tasks.workunit.client.0.smithi077.stdout:9/26: dwrite f5 [0,4194304] 0 2024-04-25T02:08:41.814 INFO:tasks.workunit.client.0.smithi077.stdout:6/92: rename de/d12/f14 to de/d12/d25/f26 0 2024-04-25T02:08:41.816 INFO:tasks.workunit.client.0.smithi077.stdout:5/84: mkdir d0/d2/d3/d1d 0 2024-04-25T02:08:41.817 INFO:tasks.workunit.client.0.smithi077.stdout:1/56: creat db/df/d14/f17 x:0 0 0 2024-04-25T02:08:41.818 INFO:tasks.workunit.client.0.smithi077.stdout:1/57: chown f8 3435132 1 2024-04-25T02:08:41.819 INFO:tasks.workunit.client.0.smithi077.stdout:3/41: link d0/f1 d0/f9 0 2024-04-25T02:08:41.821 INFO:tasks.workunit.client.0.smithi077.stdout:0/81: symlink d2/d8/l1b 0 2024-04-25T02:08:41.828 INFO:tasks.workunit.client.0.smithi077.stdout:7/30: dread d4/f6 [0,4194304] 0 2024-04-25T02:08:41.829 INFO:tasks.workunit.client.0.smithi077.stdout:4/46: dread d0/d1/f2 [0,4194304] 0 2024-04-25T02:08:41.830 INFO:tasks.workunit.client.0.smithi077.stdout:6/93: rename de/lf to de/d12/d25/l27 0 2024-04-25T02:08:41.831 INFO:tasks.workunit.client.0.smithi077.stdout:3/42: getdents d0/d7 0 2024-04-25T02:08:41.831 INFO:tasks.workunit.client.0.smithi077.stdout:3/43: read d0/f9 [3195440,108176] 0 2024-04-25T02:08:41.831 INFO:tasks.workunit.client.0.smithi077.stdout:3/44: truncate d0/f1 5072843 0 2024-04-25T02:08:41.831 INFO:tasks.workunit.client.0.smithi077.stdout:3/45: creat d0/d2/fa x:0 0 0 2024-04-25T02:08:41.832 INFO:tasks.workunit.client.0.smithi077.stdout:3/46: chown d0/d7/l6 6 1 2024-04-25T02:08:41.836 INFO:tasks.workunit.client.0.smithi077.stdout:9/27: getdents . 0 2024-04-25T02:08:41.836 INFO:tasks.workunit.client.0.smithi077.stdout:9/28: dread - f6 zero size 2024-04-25T02:08:41.837 INFO:tasks.workunit.client.0.smithi077.stdout:2/20: dwrite f0 [0,4194304] 0 2024-04-25T02:08:41.838 INFO:tasks.workunit.client.0.smithi077.stdout:2/21: chown f1 1927990658 1 2024-04-25T02:08:41.838 INFO:tasks.workunit.client.0.smithi077.stdout:4/47: symlink d0/d1/da/ld 0 2024-04-25T02:08:41.838 INFO:tasks.workunit.client.0.smithi077.stdout:3/47: dread d0/f9 [0,4194304] 0 2024-04-25T02:08:41.838 INFO:tasks.workunit.client.0.smithi077.stdout:1/58: dwrite db/d11/f15 [0,4194304] 0 2024-04-25T02:08:41.838 INFO:tasks.workunit.client.0.smithi077.stdout:3/48: write d0/f1 [3139066,29001] 0 2024-04-25T02:08:41.839 INFO:tasks.workunit.client.0.smithi077.stdout:5/85: rename d0/d2 to d0/d2/d3/d9/d1e 22 2024-04-25T02:08:41.841 INFO:tasks.workunit.client.0.smithi077.stdout:0/82: mkdir d2/d1c 0 2024-04-25T02:08:41.845 INFO:tasks.workunit.client.0.smithi077.stdout:9/29: creat f7 x:0 0 0 2024-04-25T02:08:41.849 INFO:tasks.workunit.client.0.smithi077.stdout:2/22: write f1 [303036,93947] 0 2024-04-25T02:08:41.849 INFO:tasks.workunit.client.0.smithi077.stdout:1/59: truncate db/fd 20111 0 2024-04-25T02:08:41.851 INFO:tasks.workunit.client.0.smithi077.stdout:3/49: mknod d0/d7/cb 0 2024-04-25T02:08:41.851 INFO:tasks.workunit.client.0.smithi077.stdout:3/50: write d0/f9 [2812416,64549] 0 2024-04-25T02:08:41.854 INFO:tasks.workunit.client.0.smithi077.stdout:5/86: creat d0/d2/d3/d1d/f1f x:0 0 0 2024-04-25T02:08:41.854 INFO:tasks.workunit.client.0.smithi077.stdout:5/87: chown d0/fd 675218 1 2024-04-25T02:08:41.855 INFO:tasks.workunit.client.0.smithi077.stdout:9/30: creat f8 x:0 0 0 2024-04-25T02:08:41.855 INFO:tasks.workunit.client.0.smithi077.stdout:9/31: dread - f7 zero size 2024-04-25T02:08:41.857 INFO:tasks.workunit.client.0.smithi077.stdout:7/31: dwrite d4/f5 [0,4194304] 0 2024-04-25T02:08:41.857 INFO:tasks.workunit.client.0.smithi077.stdout:2/23: mkdir d2/d3 0 2024-04-25T02:08:41.859 INFO:tasks.workunit.client.0.smithi077.stdout:3/51: mknod d0/d2/cc 0 2024-04-25T02:08:41.859 INFO:tasks.workunit.client.0.smithi077.stdout:3/52: chown d0 6 1 2024-04-25T02:08:41.862 INFO:tasks.workunit.client.0.smithi077.stdout:4/48: rename d0/d1/d8 to d0/de 0 2024-04-25T02:08:41.863 INFO:tasks.workunit.client.0.smithi077.stdout:9/32: unlink f8 0 2024-04-25T02:08:41.863 INFO:tasks.workunit.client.0.smithi077.stdout:9/33: truncate f7 770584 0 2024-04-25T02:08:41.867 INFO:tasks.workunit.client.0.smithi077.stdout:7/32: link c2 d4/c7 0 2024-04-25T02:08:41.868 INFO:tasks.workunit.client.0.smithi077.stdout:2/24: rmdir d2 39 2024-04-25T02:08:41.868 INFO:tasks.workunit.client.0.smithi077.stdout:2/25: chown f1 40 1 2024-04-25T02:08:41.871 INFO:tasks.workunit.client.0.smithi077.stdout:1/60: rename f2 to db/f18 0 2024-04-25T02:08:41.872 INFO:tasks.workunit.client.0.smithi077.stdout:7/33: read d4/f6 [4190471,110404] 0 2024-04-25T02:08:41.873 INFO:tasks.workunit.client.0.smithi077.stdout:0/83: dwrite d2/f6 [0,4194304] 0 2024-04-25T02:08:41.873 INFO:tasks.workunit.client.0.smithi077.stdout:6/94: dwrite de/d12/d25/f26 [0,4194304] 0 2024-04-25T02:08:41.873 INFO:tasks.workunit.client.0.smithi077.stdout:6/95: write f2 [2233436,91229] 0 2024-04-25T02:08:41.873 INFO:tasks.workunit.client.0.smithi077.stdout:6/96: creat de/d12/f28 x:0 0 0 2024-04-25T02:08:41.873 INFO:tasks.workunit.client.0.smithi077.stdout:5/88: dwrite d0/d2/d3/d9/f14 [0,4194304] 0 2024-04-25T02:08:41.874 INFO:tasks.workunit.client.0.smithi077.stdout:2/26: rmdir d2/d3 0 2024-04-25T02:08:41.874 INFO:tasks.workunit.client.0.smithi077.stdout:2/27: rename d2 to d2/d4 22 2024-04-25T02:08:41.874 INFO:tasks.workunit.client.0.smithi077.stdout:2/28: chown d2 993 1 2024-04-25T02:08:41.876 INFO:tasks.workunit.client.0.smithi077.stdout:1/61: symlink db/df/d14/l19 0 2024-04-25T02:08:41.880 INFO:tasks.workunit.client.0.smithi077.stdout:4/49: dwrite d0/f7 [0,4194304] 0 2024-04-25T02:08:41.880 INFO:tasks.workunit.client.0.smithi077.stdout:4/50: readlink d0/l5 0 2024-04-25T02:08:41.881 INFO:tasks.workunit.client.0.smithi077.stdout:3/53: dread d0/f9 [0,4194304] 0 2024-04-25T02:08:41.884 INFO:tasks.workunit.client.0.smithi077.stdout:6/97: write de/d15/f22 [2153067,21492] 0 2024-04-25T02:08:41.889 INFO:tasks.workunit.client.0.smithi077.stdout:0/84: mkdir d2/d17/d1d 0 2024-04-25T02:08:41.892 INFO:tasks.workunit.client.0.smithi077.stdout:2/29: creat d2/f5 x:0 0 0 2024-04-25T02:08:41.894 INFO:tasks.workunit.client.0.smithi077.stdout:1/62: mknod db/df/d14/c1a 0 2024-04-25T02:08:41.896 INFO:tasks.workunit.client.0.smithi077.stdout:7/34: dwrite d4/f5 [0,4194304] 0 2024-04-25T02:08:41.896 INFO:tasks.workunit.client.0.smithi077.stdout:9/34: link l0 l9 0 2024-04-25T02:08:41.897 INFO:tasks.workunit.client.0.smithi077.stdout:4/51: mkdir d0/d1/da/df 0 2024-04-25T02:08:41.897 INFO:tasks.workunit.client.0.smithi077.stdout:6/98: creat de/d12/d25/f29 x:0 0 0 2024-04-25T02:08:41.902 INFO:tasks.workunit.client.0.smithi077.stdout:5/89: mkdir d0/d2/d20 0 2024-04-25T02:08:41.903 INFO:tasks.workunit.client.0.smithi077.stdout:5/90: truncate d0/d2/d3/d9/f1c 120782 0 2024-04-25T02:08:41.903 INFO:tasks.workunit.client.0.smithi077.stdout:2/30: link f1 d2/f6 0 2024-04-25T02:08:41.906 INFO:tasks.workunit.client.0.smithi077.stdout:2/31: dread f0 [0,4194304] 0 2024-04-25T02:08:41.907 INFO:tasks.workunit.client.0.smithi077.stdout:2/32: dread - d2/f5 zero size 2024-04-25T02:08:41.907 INFO:tasks.workunit.client.0.smithi077.stdout:2/33: rename d2 to d2/d7 22 2024-04-25T02:08:41.907 INFO:tasks.workunit.client.0.smithi077.stdout:2/34: read - d2/f5 zero size 2024-04-25T02:08:41.907 INFO:tasks.workunit.client.0.smithi077.stdout:2/35: truncate d2/f5 186612 0 2024-04-25T02:08:41.907 INFO:tasks.workunit.client.0.smithi077.stdout:9/35: creat fa x:0 0 0 2024-04-25T02:08:41.908 INFO:tasks.workunit.client.0.smithi077.stdout:4/52: creat d0/d1/f10 x:0 0 0 2024-04-25T02:08:41.908 INFO:tasks.workunit.client.0.smithi077.stdout:1/63: write f3 [1587298,82551] 0 2024-04-25T02:08:41.909 INFO:tasks.workunit.client.0.smithi077.stdout:6/99: stat de/l11 0 2024-04-25T02:08:41.911 INFO:tasks.workunit.client.0.smithi077.stdout:6/100: dread de/f13 [0,4194304] 0 2024-04-25T02:08:41.911 INFO:tasks.workunit.client.0.smithi077.stdout:7/35: getdents d4 0 2024-04-25T02:08:41.911 INFO:tasks.workunit.client.0.smithi077.stdout:7/36: chown d4 48678970 1 2024-04-25T02:08:41.913 INFO:tasks.workunit.client.0.smithi077.stdout:9/36: dread - f6 zero size 2024-04-25T02:08:41.914 INFO:tasks.workunit.client.0.smithi077.stdout:4/53: creat d0/de/f11 x:0 0 0 2024-04-25T02:08:41.917 INFO:tasks.workunit.client.0.smithi077.stdout:9/37: chown c4 5854386 1 2024-04-25T02:08:41.918 INFO:tasks.workunit.client.0.smithi077.stdout:8/72: sync 2024-04-25T02:08:41.920 INFO:tasks.workunit.client.0.smithi077.stdout:5/91: truncate d0/d2/d3/d9/f14 170916 0 2024-04-25T02:08:41.920 INFO:tasks.workunit.client.0.smithi077.stdout:5/92: write d0/d2/d3/f15 [812095,12117] 0 2024-04-25T02:08:41.920 INFO:tasks.workunit.client.0.smithi077.stdout:5/93: write d0/d2/d3/d9/f1c [950605,104851] 0 2024-04-25T02:08:41.926 INFO:tasks.workunit.client.0.smithi077.stdout:2/36: rmdir d2 39 2024-04-25T02:08:41.926 INFO:tasks.workunit.client.0.smithi077.stdout:2/37: chown d2/f6 36323614 1 2024-04-25T02:08:41.926 INFO:tasks.workunit.client.0.smithi077.stdout:2/38: fdatasync f1 0 2024-04-25T02:08:41.928 INFO:tasks.workunit.client.0.smithi077.stdout:2/39: mkdir d2/d8 0 2024-04-25T02:08:41.929 INFO:tasks.workunit.client.0.smithi077.stdout:2/40: chown d2 1435500 1 2024-04-25T02:08:41.929 INFO:tasks.workunit.client.0.smithi077.stdout:2/41: chown d2/f6 47010 1 2024-04-25T02:08:41.929 INFO:tasks.workunit.client.0.smithi077.stdout:2/42: write f1 [4733571,86389] 0 2024-04-25T02:08:41.931 INFO:tasks.workunit.client.0.smithi077.stdout:8/73: dread d3/f4 [0,4194304] 0 2024-04-25T02:08:41.935 INFO:tasks.workunit.client.0.smithi077.stdout:8/74: rename d3/c5 to d3/da/db/c19 0 2024-04-25T02:08:41.992 INFO:tasks.workunit.client.0.smithi077.stdout:6/101: dwrite de/d12/f28 [0,4194304] 0 2024-04-25T02:08:41.995 INFO:tasks.workunit.client.0.smithi077.stdout:2/43: dread d2/f6 [0,4194304] 0 2024-04-25T02:08:41.995 INFO:tasks.workunit.client.0.smithi077.stdout:6/102: unlink l3 0 2024-04-25T02:08:41.995 INFO:tasks.workunit.client.0.smithi077.stdout:6/103: creat de/d12/f2a x:0 0 0 2024-04-25T02:08:42.017 INFO:tasks.workunit.client.0.smithi077.stdout:7/37: dwrite d4/f5 [0,4194304] 0 2024-04-25T02:08:42.017 INFO:tasks.workunit.client.0.smithi077.stdout:7/38: chown d4 12450535 1 2024-04-25T02:08:42.018 INFO:tasks.workunit.client.0.smithi077.stdout:9/38: dwrite f7 [0,4194304] 0 2024-04-25T02:08:42.018 INFO:tasks.workunit.client.0.smithi077.stdout:9/39: truncate f6 367755 0 2024-04-25T02:08:42.018 INFO:tasks.workunit.client.0.smithi077.stdout:7/39: mknod d4/c8 0 2024-04-25T02:08:42.020 INFO:tasks.workunit.client.0.smithi077.stdout:4/54: dwrite d0/d1/f2 [0,4194304] 0 2024-04-25T02:08:42.020 INFO:tasks.workunit.client.0.smithi077.stdout:6/104: dwrite fd [0,4194304] 0 2024-04-25T02:08:42.020 INFO:tasks.workunit.client.0.smithi077.stdout:4/55: chown d0/l3 665323691 1 2024-04-25T02:08:42.020 INFO:tasks.workunit.client.0.smithi077.stdout:6/105: truncate de/f21 934127 0 2024-04-25T02:08:42.020 INFO:tasks.workunit.client.0.smithi077.stdout:5/94: dwrite d0/d2/d3/d9/f14 [0,4194304] 0 2024-04-25T02:08:42.020 INFO:tasks.workunit.client.0.smithi077.stdout:5/95: fdatasync d0/d2/d3/f17 0 2024-04-25T02:08:42.020 INFO:tasks.workunit.client.0.smithi077.stdout:8/75: dwrite d3/f4 [0,4194304] 0 2024-04-25T02:08:42.024 INFO:tasks.workunit.client.0.smithi077.stdout:2/44: truncate f0 1119690 0 2024-04-25T02:08:42.029 INFO:tasks.workunit.client.0.smithi077.stdout:4/56: mkdir d0/d1/da/d12 0 2024-04-25T02:08:42.029 INFO:tasks.workunit.client.0.smithi077.stdout:4/57: chown d0/d1/da 494 1 2024-04-25T02:08:42.029 INFO:tasks.workunit.client.0.smithi077.stdout:4/58: write d0/d1/da/fb [731342,51446] 0 2024-04-25T02:08:42.029 INFO:tasks.workunit.client.0.smithi077.stdout:4/59: write d0/d1/da/fb [1291436,72341] 0 2024-04-25T02:08:42.029 INFO:tasks.workunit.client.0.smithi077.stdout:4/60: write d0/de/f11 [895609,80237] 0 2024-04-25T02:08:42.029 INFO:tasks.workunit.client.0.smithi077.stdout:4/61: chown d0/de/f11 30624 1 2024-04-25T02:08:42.029 INFO:tasks.workunit.client.0.smithi077.stdout:4/62: write d0/d1/f10 [440724,51146] 0 2024-04-25T02:08:42.030 INFO:tasks.workunit.client.0.smithi077.stdout:9/40: dwrite fa [0,4194304] 0 2024-04-25T02:08:42.031 INFO:tasks.workunit.client.0.smithi077.stdout:5/96: creat d0/d2/d20/f21 x:0 0 0 2024-04-25T02:08:42.036 INFO:tasks.workunit.client.0.smithi077.stdout:8/76: truncate d3/f7 906348 0 2024-04-25T02:08:42.038 INFO:tasks.workunit.client.0.smithi077.stdout:2/45: mkdir d2/d9 0 2024-04-25T02:08:42.038 INFO:tasks.workunit.client.0.smithi077.stdout:2/46: readlink - no filename 2024-04-25T02:08:42.041 INFO:tasks.workunit.client.0.smithi077.stdout:6/106: getdents de/d12/d25 0 2024-04-25T02:08:42.046 INFO:tasks.workunit.client.0.smithi077.stdout:5/97: mknod d0/d2/d3/d1d/c22 0 2024-04-25T02:08:42.046 INFO:tasks.workunit.client.0.smithi077.stdout:5/98: truncate d0/d2/d3/d9/f1c 1953977 0 2024-04-25T02:08:42.046 INFO:tasks.workunit.client.0.smithi077.stdout:5/99: dread - d0/d2/d3/d1d/f1f zero size 2024-04-25T02:08:42.048 INFO:tasks.workunit.client.0.smithi077.stdout:4/63: rmdir d0/d1 39 2024-04-25T02:08:42.051 INFO:tasks.workunit.client.0.smithi077.stdout:6/107: symlink de/d12/d25/l2b 0 2024-04-25T02:08:42.051 INFO:tasks.workunit.client.0.smithi077.stdout:6/108: dread - de/d12/f2a zero size 2024-04-25T02:08:42.051 INFO:tasks.workunit.client.0.smithi077.stdout:6/109: stat de/d15/l1d 0 2024-04-25T02:08:42.052 INFO:tasks.workunit.client.0.smithi077.stdout:9/41: dwrite fa [0,4194304] 0 2024-04-25T02:08:42.052 INFO:tasks.workunit.client.0.smithi077.stdout:4/64: symlink d0/d1/da/d12/l13 0 2024-04-25T02:08:42.052 INFO:tasks.workunit.client.0.smithi077.stdout:3/54: sync 2024-04-25T02:08:42.052 INFO:tasks.workunit.client.0.smithi077.stdout:3/55: chown d0/d7/cb 165373586 1 2024-04-25T02:08:42.053 INFO:tasks.workunit.client.0.smithi077.stdout:6/110: unlink f2 0 2024-04-25T02:08:42.058 INFO:tasks.workunit.client.0.smithi077.stdout:4/65: mkdir d0/d14 0 2024-04-25T02:08:42.059 INFO:tasks.workunit.client.0.smithi077.stdout:6/111: truncate de/d12/f1c 4033844 0 2024-04-25T02:08:42.061 INFO:tasks.workunit.client.0.smithi077.stdout:9/42: mknod cb 0 2024-04-25T02:08:42.063 INFO:tasks.workunit.client.0.smithi077.stdout:9/43: creat fc x:0 0 0 2024-04-25T02:08:42.065 INFO:tasks.workunit.client.0.smithi077.stdout:9/44: rename f6 to fd 0 2024-04-25T02:08:42.068 INFO:tasks.workunit.client.0.smithi077.stdout:9/45: link l2 le 0 2024-04-25T02:08:42.069 INFO:tasks.workunit.client.0.smithi077.stdout:9/46: readlink l1 0 2024-04-25T02:08:42.069 INFO:tasks.workunit.client.0.smithi077.stdout:9/47: write fc [518084,69361] 0 2024-04-25T02:08:42.070 INFO:tasks.workunit.client.0.smithi077.stdout:9/48: dread fd [0,4194304] 0 2024-04-25T02:08:42.073 INFO:tasks.workunit.client.0.smithi077.stdout:9/49: mkdir df 0 2024-04-25T02:08:42.073 INFO:tasks.workunit.client.0.smithi077.stdout:4/66: write d0/d1/f2 [3993543,26976] 0 2024-04-25T02:08:42.074 INFO:tasks.workunit.client.0.smithi077.stdout:9/50: creat df/f10 x:0 0 0 2024-04-25T02:08:42.075 INFO:tasks.workunit.client.0.smithi077.stdout:4/67: creat d0/de/f15 x:0 0 0 2024-04-25T02:08:42.076 INFO:tasks.workunit.client.0.smithi077.stdout:9/51: symlink df/l11 0 2024-04-25T02:08:42.077 INFO:tasks.workunit.client.0.smithi077.stdout:8/77: dwrite d3/f6 [0,4194304] 0 2024-04-25T02:08:42.080 INFO:tasks.workunit.client.0.smithi077.stdout:8/78: link d3/da/l14 d3/da/d15/d16/l1a 0 2024-04-25T02:08:42.081 INFO:tasks.workunit.client.0.smithi077.stdout:8/79: stat d3/da/d15/d16/l1a 0 2024-04-25T02:08:42.081 INFO:tasks.workunit.client.0.smithi077.stdout:2/47: dwrite f1 [0,4194304] 0 2024-04-25T02:08:42.081 INFO:tasks.workunit.client.0.smithi077.stdout:8/80: truncate d3/f8 2963894 0 2024-04-25T02:08:42.083 INFO:tasks.workunit.client.0.smithi077.stdout:3/56: dwrite d0/f9 [0,4194304] 0 2024-04-25T02:08:42.083 INFO:tasks.workunit.client.0.smithi077.stdout:2/48: unlink d2/f6 0 2024-04-25T02:08:42.083 INFO:tasks.workunit.client.0.smithi077.stdout:5/100: dwrite d0/d2/d3/d9/f14 [0,4194304] 0 2024-04-25T02:08:42.088 INFO:tasks.workunit.client.0.smithi077.stdout:4/68: dread d0/d1/da/fb [0,4194304] 0 2024-04-25T02:08:42.088 INFO:tasks.workunit.client.0.smithi077.stdout:4/69: truncate d0/d1/f6 306868 0 2024-04-25T02:08:42.088 INFO:tasks.workunit.client.0.smithi077.stdout:3/57: unlink d0/f1 0 2024-04-25T02:08:42.088 INFO:tasks.workunit.client.0.smithi077.stdout:3/58: write d0/d2/f5 [237569,72460] 0 2024-04-25T02:08:42.088 INFO:tasks.workunit.client.0.smithi077.stdout:3/59: fdatasync d0/d2/fa 0 2024-04-25T02:08:42.089 INFO:tasks.workunit.client.0.smithi077.stdout:2/49: creat d2/d8/fa x:0 0 0 2024-04-25T02:08:42.090 INFO:tasks.workunit.client.0.smithi077.stdout:2/50: chown d2 786 1 2024-04-25T02:08:42.095 INFO:tasks.workunit.client.0.smithi077.stdout:9/52: dwrite f3 [4194304,4194304] 0 2024-04-25T02:08:42.098 INFO:tasks.workunit.client.0.smithi077.stdout:5/101: dwrite d0/d2/d3/d9/f1c [0,4194304] 0 2024-04-25T02:08:42.101 INFO:tasks.workunit.client.0.smithi077.stdout:4/70: getdents d0/d1/da/d12 0 2024-04-25T02:08:42.101 INFO:tasks.workunit.client.0.smithi077.stdout:4/71: creat d0/f16 x:0 0 0 2024-04-25T02:08:42.103 INFO:tasks.workunit.client.0.smithi077.stdout:2/51: creat d2/d9/fb x:0 0 0 2024-04-25T02:08:42.103 INFO:tasks.workunit.client.0.smithi077.stdout:2/52: write d2/d9/fb [595233,63056] 0 2024-04-25T02:08:42.103 INFO:tasks.workunit.client.0.smithi077.stdout:2/53: truncate d2/d8/fa 836143 0 2024-04-25T02:08:42.109 INFO:tasks.workunit.client.0.smithi077.stdout:8/81: rename d3/da/d15 to d3/da/d1b 0 2024-04-25T02:08:42.109 INFO:tasks.workunit.client.0.smithi077.stdout:8/82: chown d3/f7 94245905 1 2024-04-25T02:08:42.110 INFO:tasks.workunit.client.0.smithi077.stdout:6/112: read de/d12/f1c [2497470,3901] 0 2024-04-25T02:08:42.119 INFO:tasks.workunit.client.0.smithi077.stdout:5/102: mkdir d0/d2/d20/d23 0 2024-04-25T02:08:42.122 INFO:tasks.workunit.client.0.smithi077.stdout:4/72: symlink d0/d14/l17 0 2024-04-25T02:08:42.122 INFO:tasks.workunit.client.0.smithi077.stdout:4/73: creat d0/f18 x:0 0 0 2024-04-25T02:08:42.123 INFO:tasks.workunit.client.0.smithi077.stdout:3/60: rmdir d0/d2 39 2024-04-25T02:08:42.124 INFO:tasks.workunit.client.0.smithi077.stdout:2/54: creat d2/fc x:0 0 0 2024-04-25T02:08:42.125 INFO:tasks.workunit.client.0.smithi077.stdout:6/113: creat de/f2c x:0 0 0 2024-04-25T02:08:42.126 INFO:tasks.workunit.client.0.smithi077.stdout:5/103: dread d0/d2/d3/d9/f1c [0,4194304] 0 2024-04-25T02:08:42.126 INFO:tasks.workunit.client.0.smithi077.stdout:5/104: stat d0/d2/d1b 0 2024-04-25T02:08:42.133 INFO:tasks.workunit.client.0.smithi077.stdout:0/85: sync 2024-04-25T02:08:42.133 INFO:tasks.workunit.client.0.smithi077.stdout:1/64: sync 2024-04-25T02:08:42.134 INFO:tasks.workunit.client.0.smithi077.stdout:6/114: creat de/d12/d25/f2d x:0 0 0 2024-04-25T02:08:42.135 INFO:tasks.workunit.client.0.smithi077.stdout:5/105: truncate d0/d2/d3/d9/f14 1787080 0 2024-04-25T02:08:42.136 INFO:tasks.workunit.client.0.smithi077.stdout:7/40: sync 2024-04-25T02:08:42.137 INFO:tasks.workunit.client.0.smithi077.stdout:7/41: fdatasync d4/f6 0 2024-04-25T02:08:42.137 INFO:tasks.workunit.client.0.smithi077.stdout:0/86: truncate d2/d8/d10/f18 624011 0 2024-04-25T02:08:42.137 INFO:tasks.workunit.client.0.smithi077.stdout:0/87: chown d2/d17 295109152 1 2024-04-25T02:08:42.137 INFO:tasks.workunit.client.0.smithi077.stdout:0/88: read d2/d8/fe [234596,118084] 0 2024-04-25T02:08:42.137 INFO:tasks.workunit.client.0.smithi077.stdout:1/65: mkdir db/df/d1b 0 2024-04-25T02:08:42.137 INFO:tasks.workunit.client.0.smithi077.stdout:1/66: creat db/df/d14/f1c x:0 0 0 2024-04-25T02:08:42.138 INFO:tasks.workunit.client.0.smithi077.stdout:6/115: rename de/d15/l1d to de/d15/l2e 0 2024-04-25T02:08:42.138 INFO:tasks.workunit.client.0.smithi077.stdout:5/106: symlink d0/d2/d5/l24 0 2024-04-25T02:08:42.139 INFO:tasks.workunit.client.0.smithi077.stdout:0/89: symlink d2/d8/d10/l1e 0 2024-04-25T02:08:42.139 INFO:tasks.workunit.client.0.smithi077.stdout:0/90: write d2/d9/ff [654670,69710] 0 2024-04-25T02:08:42.141 INFO:tasks.workunit.client.0.smithi077.stdout:1/67: creat db/df/f1d x:0 0 0 2024-04-25T02:08:42.141 INFO:tasks.workunit.client.0.smithi077.stdout:1/68: write f3 [2702100,6706] 0 2024-04-25T02:08:42.142 INFO:tasks.workunit.client.0.smithi077.stdout:0/91: symlink d2/d1c/l1f 0 2024-04-25T02:08:42.145 INFO:tasks.workunit.client.0.smithi077.stdout:5/107: rename d0/d2/d5/d12 to d0/d25 0 2024-04-25T02:08:42.145 INFO:tasks.workunit.client.0.smithi077.stdout:5/108: readlink d0/d2/l19 0 2024-04-25T02:08:42.145 INFO:tasks.workunit.client.0.smithi077.stdout:5/109: write d0/d2/d20/f21 [53525,4152] 0 2024-04-25T02:08:42.145 INFO:tasks.workunit.client.0.smithi077.stdout:0/92: rename d2/d8/fd to d2/d17/d1d/f20 0 2024-04-25T02:08:42.146 INFO:tasks.workunit.client.0.smithi077.stdout:5/110: creat d0/d2/d1b/f26 x:0 0 0 2024-04-25T02:08:42.146 INFO:tasks.workunit.client.0.smithi077.stdout:5/111: chown d0/l11 42578647 1 2024-04-25T02:08:42.147 INFO:tasks.workunit.client.0.smithi077.stdout:0/93: unlink d2/l11 0 2024-04-25T02:08:42.147 INFO:tasks.workunit.client.0.smithi077.stdout:0/94: chown d2/d8 471753 1 2024-04-25T02:08:42.148 INFO:tasks.workunit.client.0.smithi077.stdout:5/112: rename d0/d2/l19 to d0/d2/d3/d1d/l27 0 2024-04-25T02:08:42.151 INFO:tasks.workunit.client.0.smithi077.stdout:6/116: dread f5 [0,4194304] 0 2024-04-25T02:08:42.160 INFO:tasks.workunit.client.0.smithi077.stdout:2/55: dread d2/d8/fa [0,4194304] 0 2024-04-25T02:08:42.160 INFO:tasks.workunit.client.0.smithi077.stdout:2/56: readlink - no filename 2024-04-25T02:08:42.160 INFO:tasks.workunit.client.0.smithi077.stdout:2/57: creat d2/fd x:0 0 0 2024-04-25T02:08:42.160 INFO:tasks.workunit.client.0.smithi077.stdout:2/58: write d2/d8/fa [1586079,24649] 0 2024-04-25T02:08:42.160 INFO:tasks.workunit.client.0.smithi077.stdout:2/59: write d2/d8/fa [1859639,34087] 0 2024-04-25T02:08:42.160 INFO:tasks.workunit.client.0.smithi077.stdout:1/69: dwrite db/f16 [0,4194304] 0 2024-04-25T02:08:42.160 INFO:tasks.workunit.client.0.smithi077.stdout:1/70: write db/df/d14/f17 [527579,58338] 0 2024-04-25T02:08:42.161 INFO:tasks.workunit.client.0.smithi077.stdout:1/71: write f1 [8482059,50810] 0 2024-04-25T02:08:42.161 INFO:tasks.workunit.client.0.smithi077.stdout:1/72: readlink l6 0 2024-04-25T02:08:42.161 INFO:tasks.workunit.client.0.smithi077.stdout:1/73: fsync db/f12 0 2024-04-25T02:08:42.161 INFO:tasks.workunit.client.0.smithi077.stdout:1/74: chown db/f16 7462973 1 2024-04-25T02:08:42.162 INFO:tasks.workunit.client.0.smithi077.stdout:1/75: write db/df/d14/f17 [377424,50628] 0 2024-04-25T02:08:42.164 INFO:tasks.workunit.client.0.smithi077.stdout:2/60: symlink d2/le 0 2024-04-25T02:08:42.164 INFO:tasks.workunit.client.0.smithi077.stdout:2/61: chown d2/d8/fa 44458 1 2024-04-25T02:08:42.164 INFO:tasks.workunit.client.0.smithi077.stdout:0/95: mknod d2/c21 0 2024-04-25T02:08:42.166 INFO:tasks.workunit.client.0.smithi077.stdout:6/117: link ca de/d12/c2f 0 2024-04-25T02:08:42.166 INFO:tasks.workunit.client.0.smithi077.stdout:8/83: dwrite d3/f6 [0,4194304] 0 2024-04-25T02:08:42.166 INFO:tasks.workunit.client.0.smithi077.stdout:6/118: creat de/d12/f30 x:0 0 0 2024-04-25T02:08:42.166 INFO:tasks.workunit.client.0.smithi077.stdout:8/84: fdatasync d3/f8 0 2024-04-25T02:08:42.166 INFO:tasks.workunit.client.0.smithi077.stdout:6/119: chown de/f2c 1354 1 2024-04-25T02:08:42.167 INFO:tasks.workunit.client.0.smithi077.stdout:6/120: fdatasync de/d12/f1c 0 2024-04-25T02:08:42.167 INFO:tasks.workunit.client.0.smithi077.stdout:8/85: write d3/f8 [3525009,66273] 0 2024-04-25T02:08:42.167 INFO:tasks.workunit.client.0.smithi077.stdout:1/76: fdatasync db/d11/f15 0 2024-04-25T02:08:42.169 INFO:tasks.workunit.client.0.smithi077.stdout:2/62: mkdir d2/d9/df 0 2024-04-25T02:08:42.170 INFO:tasks.workunit.client.0.smithi077.stdout:0/96: creat d2/d17/f22 x:0 0 0 2024-04-25T02:08:42.170 INFO:tasks.workunit.client.0.smithi077.stdout:0/97: chown d2/d8 341 1 2024-04-25T02:08:42.176 INFO:tasks.workunit.client.0.smithi077.stdout:8/86: write d3/f8 [577948,5700] 0 2024-04-25T02:08:42.181 INFO:tasks.workunit.client.0.smithi077.stdout:2/63: mknod d2/d9/c10 0 2024-04-25T02:08:42.183 INFO:tasks.workunit.client.0.smithi077.stdout:6/121: rename de/f21 to de/d12/d25/f31 0 2024-04-25T02:08:42.184 INFO:tasks.workunit.client.0.smithi077.stdout:1/77: dwrite db/f18 [0,4194304] 0 2024-04-25T02:08:42.185 INFO:tasks.workunit.client.0.smithi077.stdout:8/87: creat d3/da/d1b/d16/f1c x:0 0 0 2024-04-25T02:08:42.185 INFO:tasks.workunit.client.0.smithi077.stdout:7/42: dwrite d4/f5 [0,4194304] 0 2024-04-25T02:08:42.187 INFO:tasks.workunit.client.0.smithi077.stdout:6/122: dread de/d15/f22 [0,4194304] 0 2024-04-25T02:08:42.189 INFO:tasks.workunit.client.0.smithi077.stdout:5/113: dwrite d0/d2/d1b/f26 [0,4194304] 0 2024-04-25T02:08:42.189 INFO:tasks.workunit.client.0.smithi077.stdout:5/114: creat d0/d2/d3/d1d/f28 x:0 0 0 2024-04-25T02:08:42.190 INFO:tasks.workunit.client.0.smithi077.stdout:0/98: rename d2/d1c/l1f to d2/d17/d1d/l23 0 2024-04-25T02:08:42.190 INFO:tasks.workunit.client.0.smithi077.stdout:0/99: fdatasync d2/f6 0 2024-04-25T02:08:42.194 INFO:tasks.workunit.client.0.smithi077.stdout:8/88: creat d3/da/db/d11/f1d x:0 0 0 2024-04-25T02:08:42.198 INFO:tasks.workunit.client.0.smithi077.stdout:2/64: truncate f1 3972914 0 2024-04-25T02:08:42.199 INFO:tasks.workunit.client.0.smithi077.stdout:3/61: dwrite d0/f9 [0,4194304] 0 2024-04-25T02:08:42.200 INFO:tasks.workunit.client.0.smithi077.stdout:6/123: creat de/d12/d25/f32 x:0 0 0 2024-04-25T02:08:42.207 INFO:tasks.workunit.client.0.smithi077.stdout:5/115: dwrite d0/d2/d1b/f26 [0,4194304] 0 2024-04-25T02:08:42.207 INFO:tasks.workunit.client.0.smithi077.stdout:5/116: fsync d0/d2/d20/f21 0 2024-04-25T02:08:42.208 INFO:tasks.workunit.client.0.smithi077.stdout:1/78: rename db/cc to db/d11/c1e 0 2024-04-25T02:08:42.209 INFO:tasks.workunit.client.0.smithi077.stdout:0/100: creat d2/d1c/f24 x:0 0 0 2024-04-25T02:08:42.211 INFO:tasks.workunit.client.0.smithi077.stdout:8/89: creat d3/da/d1b/f1e x:0 0 0 2024-04-25T02:08:42.217 INFO:tasks.workunit.client.0.smithi077.stdout:6/124: rmdir de/d15 39 2024-04-25T02:08:42.217 INFO:tasks.workunit.client.0.smithi077.stdout:6/125: chown de/l1f 63486001 1 2024-04-25T02:08:42.217 INFO:tasks.workunit.client.0.smithi077.stdout:6/126: read de/d12/f1c [2959261,105784] 0 2024-04-25T02:08:42.222 INFO:tasks.workunit.client.0.smithi077.stdout:0/101: mknod d2/d17/c25 0 2024-04-25T02:08:42.223 INFO:tasks.workunit.client.0.smithi077.stdout:8/90: symlink d3/l1f 0 2024-04-25T02:08:42.223 INFO:tasks.workunit.client.0.smithi077.stdout:8/91: chown d3/da/l14 210 1 2024-04-25T02:08:42.226 INFO:tasks.workunit.client.0.smithi077.stdout:3/62: creat d0/d7/fd x:0 0 0 2024-04-25T02:08:42.229 INFO:tasks.workunit.client.0.smithi077.stdout:6/127: getdents de/d15 0 2024-04-25T02:08:42.229 INFO:tasks.workunit.client.0.smithi077.stdout:6/128: truncate de/d12/f30 409723 0 2024-04-25T02:08:42.230 INFO:tasks.workunit.client.0.smithi077.stdout:0/102: unlink d2/d17/f22 0 2024-04-25T02:08:42.231 INFO:tasks.workunit.client.0.smithi077.stdout:3/63: mkdir d0/d2/de 0 2024-04-25T02:08:42.234 INFO:tasks.workunit.client.0.smithi077.stdout:3/64: symlink d0/d2/de/lf 0 2024-04-25T02:08:42.235 INFO:tasks.workunit.client.0.smithi077.stdout:2/65: rmdir d2 39 2024-04-25T02:08:42.236 INFO:tasks.workunit.client.0.smithi077.stdout:2/66: fsync d2/d8/fa 0 2024-04-25T02:08:42.236 INFO:tasks.workunit.client.0.smithi077.stdout:2/67: chown d2 27 1 2024-04-25T02:08:42.237 INFO:tasks.workunit.client.0.smithi077.stdout:6/129: rename de/d12/d25/f26 to de/d15/f33 0 2024-04-25T02:08:42.238 INFO:tasks.workunit.client.0.smithi077.stdout:8/92: write d3/f6 [174802,8772] 0 2024-04-25T02:08:42.239 INFO:tasks.workunit.client.0.smithi077.stdout:5/117: dwrite d0/d2/d3/f15 [0,4194304] 0 2024-04-25T02:08:42.239 INFO:tasks.workunit.client.0.smithi077.stdout:5/118: fsync d0/d2/ff 0 2024-04-25T02:08:42.239 INFO:tasks.workunit.client.0.smithi077.stdout:1/79: dwrite db/df/d14/f1c [0,4194304] 0 2024-04-25T02:08:42.239 INFO:tasks.workunit.client.0.smithi077.stdout:6/130: symlink de/d15/l34 0 2024-04-25T02:08:42.239 INFO:tasks.workunit.client.0.smithi077.stdout:6/131: stat f5 0 2024-04-25T02:08:42.242 INFO:tasks.workunit.client.0.smithi077.stdout:8/93: creat d3/da/db/f20 x:0 0 0 2024-04-25T02:08:42.242 INFO:tasks.workunit.client.0.smithi077.stdout:8/94: stat d3/da/d1b/d16/f1c 0 2024-04-25T02:08:42.243 INFO:tasks.workunit.client.0.smithi077.stdout:3/65: link d0/d7/cb d0/c10 0 2024-04-25T02:08:42.247 INFO:tasks.workunit.client.0.smithi077.stdout:5/119: mknod d0/d2/d3/d1d/c29 0 2024-04-25T02:08:42.247 INFO:tasks.workunit.client.0.smithi077.stdout:5/120: dread - d0/d2/d3/d1d/f1f zero size 2024-04-25T02:08:42.247 INFO:tasks.workunit.client.0.smithi077.stdout:5/121: dread - d0/d2/d3/d1d/f28 zero size 2024-04-25T02:08:42.249 INFO:tasks.workunit.client.0.smithi077.stdout:1/80: mknod db/df/d14/c1f 0 2024-04-25T02:08:42.250 INFO:tasks.workunit.client.0.smithi077.stdout:6/132: write f0 [4263933,47555] 0 2024-04-25T02:08:42.251 INFO:tasks.workunit.client.0.smithi077.stdout:6/133: dread de/d12/f30 [0,4194304] 0 2024-04-25T02:08:42.251 INFO:tasks.workunit.client.0.smithi077.stdout:6/134: dread - de/f2c zero size 2024-04-25T02:08:42.252 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:41 smithi112 ceph-mon[33313]: pgmap v250: 65 pgs: 65 active+clean; 193 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 6.5 MiB/s wr, 823 op/s 2024-04-25T02:08:42.253 INFO:tasks.workunit.client.0.smithi077.stdout:3/66: mknod d0/d2/de/c11 0 2024-04-25T02:08:42.253 INFO:tasks.workunit.client.0.smithi077.stdout:1/81: dread db/f12 [0,4194304] 0 2024-04-25T02:08:42.253 INFO:tasks.workunit.client.0.smithi077.stdout:1/82: creat db/df/f20 x:0 0 0 2024-04-25T02:08:42.253 INFO:tasks.workunit.client.0.smithi077.stdout:9/53: sync 2024-04-25T02:08:42.253 INFO:tasks.workunit.client.0.smithi077.stdout:9/54: creat df/f12 x:0 0 0 2024-04-25T02:08:42.253 INFO:tasks.workunit.client.0.smithi077.stdout:9/55: write fd [206101,84475] 0 2024-04-25T02:08:42.254 INFO:tasks.workunit.client.0.smithi077.stdout:6/135: stat f1 0 2024-04-25T02:08:42.256 INFO:tasks.workunit.client.0.smithi077.stdout:3/67: link d0/d2/de/c11 d0/d7/c12 0 2024-04-25T02:08:42.260 INFO:tasks.workunit.client.0.smithi077.stdout:4/74: sync 2024-04-25T02:08:42.260 INFO:tasks.workunit.client.0.smithi077.stdout:2/68: dwrite d2/fc [0,4194304] 0 2024-04-25T02:08:42.260 INFO:tasks.workunit.client.0.smithi077.stdout:0/103: dwrite d2/f3 [0,4194304] 0 2024-04-25T02:08:42.261 INFO:tasks.workunit.client.0.smithi077.stdout:1/83: dread f3 [0,4194304] 0 2024-04-25T02:08:42.261 INFO:tasks.workunit.client.0.smithi077.stdout:8/95: dwrite d3/f4 [0,4194304] 0 2024-04-25T02:08:42.263 INFO:tasks.workunit.client.0.smithi077.stdout:6/136: fsync fd 0 2024-04-25T02:08:42.263 INFO:tasks.workunit.client.0.smithi077.stdout:3/68: creat d0/d2/f13 x:0 0 0 2024-04-25T02:08:42.269 INFO:tasks.workunit.client.0.smithi077.stdout:4/75: dread d0/f7 [0,4194304] 0 2024-04-25T02:08:42.270 INFO:tasks.workunit.client.0.smithi077.stdout:4/76: dread - d0/f16 zero size 2024-04-25T02:08:42.271 INFO:tasks.workunit.client.0.smithi077.stdout:4/77: dread d0/d1/f6 [0,4194304] 0 2024-04-25T02:08:42.272 INFO:tasks.workunit.client.0.smithi077.stdout:0/104: unlink d2/f3 0 2024-04-25T02:08:42.278 INFO:tasks.workunit.client.0.smithi077.stdout:9/56: write f5 [2878141,81770] 0 2024-04-25T02:08:42.278 INFO:tasks.workunit.client.0.smithi077.stdout:9/57: creat df/f13 x:0 0 0 2024-04-25T02:08:42.279 INFO:tasks.workunit.client.0.smithi077.stdout:8/96: dread d3/da/db/df/f10 [0,4194304] 0 2024-04-25T02:08:42.280 INFO:tasks.workunit.client.0.smithi077.stdout:5/122: truncate d0/d2/d3/f15 2531120 0 2024-04-25T02:08:42.280 INFO:tasks.workunit.client.0.smithi077.stdout:5/123: write d0/d25/f1a [1452883,37306] 0 2024-04-25T02:08:42.285 INFO:tasks.workunit.client.0.smithi077.stdout:2/69: dwrite d2/f5 [0,4194304] 0 2024-04-25T02:08:42.285 INFO:tasks.workunit.client.0.smithi077.stdout:2/70: chown f1 3 1 2024-04-25T02:08:42.288 INFO:tasks.workunit.client.0.smithi077.stdout:4/78: mknod d0/d1/da/df/c19 0 2024-04-25T02:08:42.288 INFO:tasks.workunit.client.0.smithi077.stdout:4/79: fdatasync d0/d1/f2 0 2024-04-25T02:08:42.292 INFO:tasks.workunit.client.0.smithi077.stdout:6/137: dread f9 [0,4194304] 0 2024-04-25T02:08:42.292 INFO:tasks.workunit.client.0.smithi077.stdout:6/138: stat de/d15 0 2024-04-25T02:08:42.293 INFO:tasks.workunit.client.0.smithi077.stdout:6/139: read - de/f2c zero size 2024-04-25T02:08:42.293 INFO:tasks.workunit.client.0.smithi077.stdout:6/140: chown de/d15/l34 3 1 2024-04-25T02:08:42.294 INFO:tasks.workunit.client.0.smithi077.stdout:1/84: getdents db/df 0 2024-04-25T02:08:42.296 INFO:tasks.workunit.client.0.smithi077.stdout:8/97: getdents d3 0 2024-04-25T02:08:42.296 INFO:tasks.workunit.client.0.smithi077.stdout:8/98: creat d3/da/d1b/f21 x:0 0 0 2024-04-25T02:08:42.296 INFO:tasks.workunit.client.0.smithi077.stdout:8/99: creat d3/da/d1b/d16/f22 x:0 0 0 2024-04-25T02:08:42.297 INFO:tasks.workunit.client.0.smithi077.stdout:8/100: stat l0 0 2024-04-25T02:08:42.297 INFO:tasks.workunit.client.0.smithi077.stdout:8/101: read - d3/da/d1b/d16/f22 zero size 2024-04-25T02:08:42.303 INFO:tasks.workunit.client.0.smithi077.stdout:2/71: rmdir d2 39 2024-04-25T02:08:42.304 INFO:tasks.workunit.client.0.smithi077.stdout:3/69: dwrite d0/d7/fd [0,4194304] 0 2024-04-25T02:08:42.304 INFO:tasks.workunit.client.0.smithi077.stdout:8/102: write d3/f7 [82902,57053] 0 2024-04-25T02:08:42.304 INFO:tasks.workunit.client.0.smithi077.stdout:8/103: fsync d3/da/db/f20 0 2024-04-25T02:08:42.306 INFO:tasks.workunit.client.0.smithi077.stdout:1/85: rename db/f16 to db/df/f21 0 2024-04-25T02:08:42.308 INFO:tasks.workunit.client.0.smithi077.stdout:7/43: sync 2024-04-25T02:08:42.308 INFO:tasks.workunit.client.0.smithi077.stdout:7/44: read d4/f6 [4068697,101278] 0 2024-04-25T02:08:42.309 INFO:tasks.workunit.client.0.smithi077.stdout:8/104: write d3/da/db/df/f10 [958883,49581] 0 2024-04-25T02:08:42.310 INFO:tasks.workunit.client.0.smithi077.stdout:8/105: write d3/f6 [3691701,36769] 0 2024-04-25T02:08:42.310 INFO:tasks.workunit.client.0.smithi077.stdout:2/72: write f1 [426766,127713] 0 2024-04-25T02:08:42.313 INFO:tasks.workunit.client.0.smithi077.stdout:7/45: mknod d4/c9 0 2024-04-25T02:08:42.315 INFO:tasks.workunit.client.0.smithi077.stdout:4/80: dwrite d0/d1/f10 [0,4194304] 0 2024-04-25T02:08:42.316 INFO:tasks.workunit.client.0.smithi077.stdout:5/124: dwrite d0/d2/d1b/f26 [0,4194304] 0 2024-04-25T02:08:42.316 INFO:tasks.workunit.client.0.smithi077.stdout:2/73: symlink d2/l11 0 2024-04-25T02:08:42.316 INFO:tasks.workunit.client.0.smithi077.stdout:2/74: chown d2/l11 13916506 1 2024-04-25T02:08:42.319 INFO:tasks.workunit.client.0.smithi077.stdout:3/70: mknod d0/c14 0 2024-04-25T02:08:42.319 INFO:tasks.workunit.client.0.smithi077.stdout:3/71: chown d0/c14 1125230 1 2024-04-25T02:08:42.321 INFO:tasks.workunit.client.0.smithi077.stdout:1/86: creat db/df/d1b/f22 x:0 0 0 2024-04-25T02:08:42.321 INFO:tasks.workunit.client.0.smithi077.stdout:8/106: read d3/f4 [1143422,44305] 0 2024-04-25T02:08:42.321 INFO:tasks.workunit.client.0.smithi077.stdout:9/58: rmdir df 39 2024-04-25T02:08:42.321 INFO:tasks.workunit.client.0.smithi077.stdout:9/59: fsync fc 0 2024-04-25T02:08:42.323 INFO:tasks.workunit.client.0.smithi077.stdout:1/87: read f1 [2367712,5987] 0 2024-04-25T02:08:42.324 INFO:tasks.workunit.client.0.smithi077.stdout:5/125: rmdir d0/d25 39 2024-04-25T02:08:42.329 INFO:tasks.workunit.client.0.smithi077.stdout:5/126: read d0/fd [7934421,31162] 0 2024-04-25T02:08:42.329 INFO:tasks.workunit.client.0.smithi077.stdout:3/72: mkdir d0/d7/d15 0 2024-04-25T02:08:42.329 INFO:tasks.workunit.client.0.smithi077.stdout:3/73: chown d0 199931 1 2024-04-25T02:08:42.329 INFO:tasks.workunit.client.0.smithi077.stdout:3/74: getdents d0/d7/d15 0 2024-04-25T02:08:42.332 INFO:tasks.workunit.client.0.smithi077.stdout:9/60: creat df/f14 x:0 0 0 2024-04-25T02:08:42.333 INFO:tasks.workunit.client.0.smithi077.stdout:1/88: truncate db/df/f20 959496 0 2024-04-25T02:08:42.334 INFO:tasks.workunit.client.0.smithi077.stdout:2/75: truncate f1 929934 0 2024-04-25T02:08:42.335 INFO:tasks.workunit.client.0.smithi077.stdout:5/127: creat d0/d2/d3/d9/f2a x:0 0 0 2024-04-25T02:08:42.336 INFO:tasks.workunit.client.0.smithi077.stdout:4/81: dwrite d0/de/f11 [0,4194304] 0 2024-04-25T02:08:42.336 INFO:tasks.workunit.client.0.smithi077.stdout:4/82: fdatasync d0/f18 0 2024-04-25T02:08:42.337 INFO:tasks.workunit.client.0.smithi077.stdout:3/75: unlink d0/d2/f5 0 2024-04-25T02:08:42.338 INFO:tasks.workunit.client.0.smithi077.stdout:8/107: rmdir d3/da/db 39 2024-04-25T02:08:42.338 INFO:tasks.workunit.client.0.smithi077.stdout:8/108: write d3/f4 [4116394,38636] 0 2024-04-25T02:08:42.339 INFO:tasks.workunit.client.0.smithi077.stdout:9/61: mknod df/c15 0 2024-04-25T02:08:42.340 INFO:tasks.workunit.client.0.smithi077.stdout:2/76: symlink d2/d9/df/l12 0 2024-04-25T02:08:42.345 INFO:tasks.workunit.client.0.smithi077.stdout:4/83: mknod d0/d1/da/c1a 0 2024-04-25T02:08:42.348 INFO:tasks.workunit.client.0.smithi077.stdout:8/109: symlink d3/da/d1b/d16/l23 0 2024-04-25T02:08:42.349 INFO:tasks.workunit.client.0.smithi077.stdout:8/110: chown d3/da/db/d11 25123 1 2024-04-25T02:08:42.349 INFO:tasks.workunit.client.0.smithi077.stdout:8/111: getdents d3 0 2024-04-25T02:08:42.349 INFO:tasks.workunit.client.0.smithi077.stdout:9/62: mknod df/c16 0 2024-04-25T02:08:42.349 INFO:tasks.workunit.client.0.smithi077.stdout:0/105: sync 2024-04-25T02:08:42.352 INFO:tasks.workunit.client.0.smithi077.stdout:1/89: link db/ce db/df/d14/c23 0 2024-04-25T02:08:42.352 INFO:tasks.workunit.client.0.smithi077.stdout:9/63: dread fc [0,4194304] 0 2024-04-25T02:08:42.352 INFO:tasks.workunit.client.0.smithi077.stdout:9/64: chown l1 16 1 2024-04-25T02:08:42.352 INFO:tasks.workunit.client.0.smithi077.stdout:9/65: readlink le 0 2024-04-25T02:08:42.353 INFO:tasks.workunit.client.0.smithi077.stdout:2/77: link d2/f5 d2/d9/f13 0 2024-04-25T02:08:42.355 INFO:tasks.workunit.client.0.smithi077.stdout:3/76: link d0/f9 d0/d2/f16 0 2024-04-25T02:08:42.355 INFO:tasks.workunit.client.0.smithi077.stdout:3/77: chown d0/d7/l6 175093906 1 2024-04-25T02:08:42.356 INFO:tasks.workunit.client.0.smithi077.stdout:8/112: symlink d3/l24 0 2024-04-25T02:08:42.359 INFO:tasks.workunit.client.0.smithi077.stdout:0/106: rename d2/d9/f14 to d2/d8/f26 0 2024-04-25T02:08:42.360 INFO:tasks.workunit.client.0.smithi077.stdout:1/90: getdents db/d11 0 2024-04-25T02:08:42.361 INFO:tasks.workunit.client.0.smithi077.stdout:1/91: write db/df/f20 [827096,91695] 0 2024-04-25T02:08:42.361 INFO:tasks.workunit.client.0.smithi077.stdout:3/78: truncate d0/d7/fd 234289 0 2024-04-25T02:08:42.363 INFO:tasks.workunit.client.0.smithi077.stdout:8/113: mkdir d3/da/d1b/d16/d25 0 2024-04-25T02:08:42.365 INFO:tasks.workunit.client.0.smithi077.stdout:1/92: rename c7 to db/d11/c24 0 2024-04-25T02:08:42.366 INFO:tasks.workunit.client.0.smithi077.stdout:8/114: mknod d3/da/c26 0 2024-04-25T02:08:42.371 INFO:tasks.workunit.client.0.smithi077.stdout:0/107: write d2/f6 [2271718,9817] 0 2024-04-25T02:08:42.376 INFO:tasks.workunit.client.0.smithi077.stdout:8/115: rename d3/da/d1b to d3/da/d27 0 2024-04-25T02:08:42.376 INFO:tasks.workunit.client.0.smithi077.stdout:8/116: write d3/da/d27/f21 [948530,105627] 0 2024-04-25T02:08:42.376 INFO:tasks.workunit.client.0.smithi077.stdout:8/117: chown d3/da/d27/d16/f1c 29 1 2024-04-25T02:08:42.376 INFO:tasks.workunit.client.0.smithi077.stdout:8/118: write d3/da/db/d11/f1d [224850,32554] 0 2024-04-25T02:08:42.376 INFO:tasks.workunit.client.0.smithi077.stdout:8/119: stat d3/f6 0 2024-04-25T02:08:42.376 INFO:tasks.workunit.client.0.smithi077.stdout:8/120: readlink l0 0 2024-04-25T02:08:42.376 INFO:tasks.workunit.client.0.smithi077.stdout:8/121: chown d3/da/d27/d16 0 1 2024-04-25T02:08:42.377 INFO:tasks.workunit.client.0.smithi077.stdout:0/108: mkdir d2/d27 0 2024-04-25T02:08:42.377 INFO:tasks.workunit.client.0.smithi077.stdout:0/109: stat d2/d17 0 2024-04-25T02:08:42.378 INFO:tasks.workunit.client.0.smithi077.stdout:1/93: dread db/df/f21 [0,4194304] 0 2024-04-25T02:08:42.378 INFO:tasks.workunit.client.0.smithi077.stdout:8/122: truncate d3/f6 32501 0 2024-04-25T02:08:42.378 INFO:tasks.workunit.client.0.smithi077.stdout:8/123: chown d3/f7 19 1 2024-04-25T02:08:42.380 INFO:tasks.workunit.client.0.smithi077.stdout:0/110: unlink d2/f4 0 2024-04-25T02:08:42.380 INFO:tasks.workunit.client.0.smithi077.stdout:0/111: chown d2/d27 386201 1 2024-04-25T02:08:42.380 INFO:tasks.workunit.client.0.smithi077.stdout:1/94: mknod db/c25 0 2024-04-25T02:08:42.380 INFO:tasks.workunit.client.0.smithi077.stdout:9/66: dwrite f3 [4194304,4194304] 0 2024-04-25T02:08:42.381 INFO:tasks.workunit.client.0.smithi077.stdout:2/78: dwrite d2/d9/fb [0,4194304] 0 2024-04-25T02:08:42.381 INFO:tasks.workunit.client.0.smithi077.stdout:0/112: link d2/d8/cc d2/d17/c28 0 2024-04-25T02:08:42.382 INFO:tasks.workunit.client.0.smithi077.stdout:4/84: dwrite d0/f16 [0,4194304] 0 2024-04-25T02:08:42.382 INFO:tasks.workunit.client.0.smithi077.stdout:1/95: mkdir db/d26 0 2024-04-25T02:08:42.382 INFO:tasks.workunit.client.0.smithi077.stdout:4/85: chown d0/d1/da/df 403652479 1 2024-04-25T02:08:42.383 INFO:tasks.workunit.client.0.smithi077.stdout:9/67: unlink fa 0 2024-04-25T02:08:42.383 INFO:tasks.workunit.client.0.smithi077.stdout:9/68: creat df/f17 x:0 0 0 2024-04-25T02:08:42.389 INFO:tasks.workunit.client.0.smithi077.stdout:2/79: mkdir d2/d14 0 2024-04-25T02:08:42.394 INFO:tasks.workunit.client.0.smithi077.stdout:1/96: unlink l5 0 2024-04-25T02:08:42.394 INFO:tasks.workunit.client.0.smithi077.stdout:1/97: write db/df/f20 [681128,99269] 0 2024-04-25T02:08:42.394 INFO:tasks.workunit.client.0.smithi077.stdout:1/98: fsync db/df/d1b/f22 0 2024-04-25T02:08:42.395 INFO:tasks.workunit.client.0.smithi077.stdout:3/79: dwrite d0/d7/fd [0,4194304] 0 2024-04-25T02:08:42.395 INFO:tasks.workunit.client.0.smithi077.stdout:3/80: dread - d0/d2/f13 zero size 2024-04-25T02:08:42.396 INFO:tasks.workunit.client.0.smithi077.stdout:8/124: dwrite d3/da/d27/d16/f1c [0,4194304] 0 2024-04-25T02:08:42.396 INFO:tasks.workunit.client.0.smithi077.stdout:8/125: write d3/da/d27/f21 [1931406,81838] 0 2024-04-25T02:08:42.396 INFO:tasks.workunit.client.0.smithi077.stdout:8/126: stat d3/da/c26 0 2024-04-25T02:08:42.397 INFO:tasks.workunit.client.0.smithi077.stdout:4/86: rename d0/d1/lc to d0/d1/da/d12/l1b 0 2024-04-25T02:08:42.400 INFO:tasks.workunit.client.0.smithi077.stdout:0/113: dread d2/f6 [0,4194304] 0 2024-04-25T02:08:42.400 INFO:tasks.workunit.client.0.smithi077.stdout:2/80: symlink d2/d9/df/l15 0 2024-04-25T02:08:42.403 INFO:tasks.workunit.client.0.smithi077.stdout:1/99: mknod db/c27 0 2024-04-25T02:08:42.406 INFO:tasks.workunit.client.0.smithi077.stdout:1/100: dread f1 [0,4194304] 0 2024-04-25T02:08:42.410 INFO:tasks.workunit.client.0.smithi077.stdout:4/87: creat d0/d14/f1c x:0 0 0 2024-04-25T02:08:42.410 INFO:tasks.workunit.client.0.smithi077.stdout:4/88: fdatasync d0/d1/f2 0 2024-04-25T02:08:42.410 INFO:tasks.workunit.client.0.smithi077.stdout:8/127: dwrite d3/da/d27/d16/f22 [0,4194304] 0 2024-04-25T02:08:42.410 INFO:tasks.workunit.client.0.smithi077.stdout:8/128: stat l0 0 2024-04-25T02:08:42.410 INFO:tasks.workunit.client.0.smithi077.stdout:0/114: mkdir d2/d17/d29 0 2024-04-25T02:08:42.411 INFO:tasks.workunit.client.0.smithi077.stdout:2/81: getdents d2 0 2024-04-25T02:08:42.411 INFO:tasks.workunit.client.0.smithi077.stdout:2/82: chown d2/d9/f13 29 1 2024-04-25T02:08:42.412 INFO:tasks.workunit.client.0.smithi077.stdout:4/89: write d0/f7 [842692,66342] 0 2024-04-25T02:08:42.412 INFO:tasks.workunit.client.0.smithi077.stdout:1/101: truncate f3 3190803 0 2024-04-25T02:08:42.413 INFO:tasks.workunit.client.0.smithi077.stdout:0/115: write d2/d8/d10/f18 [237690,119555] 0 2024-04-25T02:08:42.414 INFO:tasks.workunit.client.0.smithi077.stdout:3/81: mkdir d0/d17 0 2024-04-25T02:08:42.414 INFO:tasks.workunit.client.0.smithi077.stdout:6/141: sync 2024-04-25T02:08:42.414 INFO:tasks.workunit.client.0.smithi077.stdout:7/46: sync 2024-04-25T02:08:42.414 INFO:tasks.workunit.client.0.smithi077.stdout:3/82: truncate d0/d2/fa 527544 0 2024-04-25T02:08:42.414 INFO:tasks.workunit.client.0.smithi077.stdout:7/47: write d4/f6 [1848897,91461] 0 2024-04-25T02:08:42.414 INFO:tasks.workunit.client.0.smithi077.stdout:3/83: creat d0/d2/f18 x:0 0 0 2024-04-25T02:08:42.416 INFO:tasks.workunit.client.0.smithi077.stdout:8/129: creat d3/da/db/f28 x:0 0 0 2024-04-25T02:08:42.418 INFO:tasks.workunit.client.0.smithi077.stdout:2/83: unlink d2/d9/c10 0 2024-04-25T02:08:42.418 INFO:tasks.workunit.client.0.smithi077.stdout:4/90: getdents d0/d1/da/d12 0 2024-04-25T02:08:42.421 INFO:tasks.workunit.client.0.smithi077.stdout:3/84: creat d0/d17/f19 x:0 0 0 2024-04-25T02:08:42.423 INFO:tasks.workunit.client.0.smithi077.stdout:7/48: creat d4/fa x:0 0 0 2024-04-25T02:08:42.423 INFO:tasks.workunit.client.0.smithi077.stdout:7/49: chown d4/c9 0 1 2024-04-25T02:08:42.423 INFO:tasks.workunit.client.0.smithi077.stdout:7/50: readlink l3 0 2024-04-25T02:08:42.423 INFO:tasks.workunit.client.0.smithi077.stdout:7/51: creat d4/fb x:0 0 0 2024-04-25T02:08:42.423 INFO:tasks.workunit.client.0.smithi077.stdout:7/52: truncate d4/f6 5143038 0 2024-04-25T02:08:42.423 INFO:tasks.workunit.client.0.smithi077.stdout:7/53: fdatasync d4/f5 0 2024-04-25T02:08:42.426 INFO:tasks.workunit.client.0.smithi077.stdout:8/130: creat d3/da/f29 x:0 0 0 2024-04-25T02:08:42.426 INFO:tasks.workunit.client.0.smithi077.stdout:8/131: chown d3/c9 694114 1 2024-04-25T02:08:42.426 INFO:tasks.workunit.client.0.smithi077.stdout:8/132: chown d3/f4 329 1 2024-04-25T02:08:42.427 INFO:tasks.workunit.client.0.smithi077.stdout:2/84: unlink d2/d9/f13 0 2024-04-25T02:08:42.427 INFO:tasks.workunit.client.0.smithi077.stdout:2/85: fdatasync d2/d9/fb 0 2024-04-25T02:08:42.427 INFO:tasks.workunit.client.0.smithi077.stdout:2/86: chown d2/d8 20 1 2024-04-25T02:08:42.429 INFO:tasks.workunit.client.0.smithi077.stdout:0/116: getdents d2 0 2024-04-25T02:08:42.430 INFO:tasks.workunit.client.0.smithi077.stdout:3/85: unlink d0/d2/fa 0 2024-04-25T02:08:42.433 INFO:tasks.workunit.client.0.smithi077.stdout:7/54: symlink d4/lc 0 2024-04-25T02:08:42.433 INFO:tasks.workunit.client.0.smithi077.stdout:7/55: write d4/fb [743927,54803] 0 2024-04-25T02:08:42.436 INFO:tasks.workunit.client.0.smithi077.stdout:8/133: creat d3/f2a x:0 0 0 2024-04-25T02:08:42.438 INFO:tasks.workunit.client.0.smithi077.stdout:8/134: dread d3/fd [0,4194304] 0 2024-04-25T02:08:42.438 INFO:tasks.workunit.client.0.smithi077.stdout:2/87: link d2/d9/df/l12 d2/d9/df/l16 0 2024-04-25T02:08:42.440 INFO:tasks.workunit.client.0.smithi077.stdout:4/91: rmdir d0 39 2024-04-25T02:08:42.441 INFO:tasks.workunit.client.0.smithi077.stdout:3/86: symlink d0/d7/l1a 0 2024-04-25T02:08:42.442 INFO:tasks.workunit.client.0.smithi077.stdout:3/87: write d0/d2/f13 [890947,68743] 0 2024-04-25T02:08:42.442 INFO:tasks.workunit.client.0.smithi077.stdout:7/56: symlink d4/ld 0 2024-04-25T02:08:42.444 INFO:tasks.workunit.client.0.smithi077.stdout:8/135: rename d3/da/db/d11 to d3/da/db/df/d2b 0 2024-04-25T02:08:42.445 INFO:tasks.workunit.client.0.smithi077.stdout:2/88: dread d2/d9/fb [0,4194304] 0 2024-04-25T02:08:42.446 INFO:tasks.workunit.client.0.smithi077.stdout:3/88: unlink d0/d7/l1a 0 2024-04-25T02:08:42.449 INFO:tasks.workunit.client.0.smithi077.stdout:4/92: mkdir d0/d1/d1d 0 2024-04-25T02:08:42.449 INFO:tasks.workunit.client.0.smithi077.stdout:4/93: truncate d0/d14/f1c 496844 0 2024-04-25T02:08:42.450 INFO:tasks.workunit.client.0.smithi077.stdout:4/94: dread d0/d14/f1c [0,4194304] 0 2024-04-25T02:08:42.450 INFO:tasks.workunit.client.0.smithi077.stdout:2/89: creat d2/d9/f17 x:0 0 0 2024-04-25T02:08:42.451 INFO:tasks.workunit.client.0.smithi077.stdout:3/89: creat d0/d2/de/f1b x:0 0 0 2024-04-25T02:08:42.455 INFO:tasks.workunit.client.0.smithi077.stdout:2/90: rename d2/d8 to d2/d9/d18 0 2024-04-25T02:08:42.455 INFO:tasks.workunit.client.0.smithi077.stdout:2/91: fdatasync d2/fc 0 2024-04-25T02:08:42.455 INFO:tasks.workunit.client.0.smithi077.stdout:2/92: truncate d2/fd 258084 0 2024-04-25T02:08:42.455 INFO:tasks.workunit.client.0.smithi077.stdout:5/128: sync 2024-04-25T02:08:42.455 INFO:tasks.workunit.client.0.smithi077.stdout:7/57: rmdir d4 39 2024-04-25T02:08:42.455 INFO:tasks.workunit.client.0.smithi077.stdout:7/58: chown d4/lc 2895050 1 2024-04-25T02:08:42.457 INFO:tasks.workunit.client.0.smithi077.stdout:3/90: symlink d0/d2/l1c 0 2024-04-25T02:08:42.457 INFO:tasks.workunit.client.0.smithi077.stdout:3/91: dread - d0/d17/f19 zero size 2024-04-25T02:08:42.457 INFO:tasks.workunit.client.0.smithi077.stdout:3/92: write d0/d2/f18 [178689,30937] 0 2024-04-25T02:08:42.457 INFO:tasks.workunit.client.0.smithi077.stdout:3/93: chown d0/d2/de/c11 0 1 2024-04-25T02:08:42.458 INFO:tasks.workunit.client.0.smithi077.stdout:8/136: dwrite d3/da/db/df/d2b/f1d [0,4194304] 0 2024-04-25T02:08:42.460 INFO:tasks.workunit.client.0.smithi077.stdout:2/93: mkdir d2/d9/d19 0 2024-04-25T02:08:42.460 INFO:tasks.workunit.client.0.smithi077.stdout:2/94: chown f1 0 1 2024-04-25T02:08:42.460 INFO:tasks.workunit.client.0.smithi077.stdout:7/59: creat d4/fe x:0 0 0 2024-04-25T02:08:42.462 INFO:tasks.workunit.client.0.smithi077.stdout:8/137: mknod d3/da/db/c2c 0 2024-04-25T02:08:42.471 INFO:tasks.workunit.client.0.smithi077.stdout:2/95: rename d2/fc to d2/d9/d19/f1a 0 2024-04-25T02:08:42.471 INFO:tasks.workunit.client.0.smithi077.stdout:2/96: readlink d2/d9/df/l12 0 2024-04-25T02:08:42.472 INFO:tasks.workunit.client.0.smithi077.stdout:7/60: symlink d4/lf 0 2024-04-25T02:08:42.476 INFO:tasks.workunit.client.0.smithi077.stdout:8/138: unlink d3/da/db/df/l17 0 2024-04-25T02:08:42.479 INFO:tasks.workunit.client.0.smithi077.stdout:8/139: creat d3/da/d27/f2d x:0 0 0 2024-04-25T02:08:42.480 INFO:tasks.workunit.client.0.smithi077.stdout:5/129: dwrite d0/d2/d20/f21 [0,4194304] 0 2024-04-25T02:08:42.480 INFO:tasks.workunit.client.0.smithi077.stdout:3/94: dwrite d0/d7/fd [0,4194304] 0 2024-04-25T02:08:42.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:41 smithi077 ceph-mon[26330]: pgmap v250: 65 pgs: 65 active+clean; 193 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 6.5 MiB/s wr, 823 op/s 2024-04-25T02:08:42.481 INFO:tasks.workunit.client.0.smithi077.stdout:8/140: truncate d3/f8 2231962 0 2024-04-25T02:08:42.488 INFO:tasks.workunit.client.0.smithi077.stdout:3/95: rename d0/d7/fd to d0/d7/d15/f1d 0 2024-04-25T02:08:42.491 INFO:tasks.workunit.client.0.smithi077.stdout:5/130: link d0/d2/d3/f15 d0/d2/d3/d9/f2b 0 2024-04-25T02:08:42.493 INFO:tasks.workunit.client.0.smithi077.stdout:3/96: mknod d0/d7/c1e 0 2024-04-25T02:08:42.494 INFO:tasks.workunit.client.0.smithi077.stdout:8/141: rmdir d3/da/d27 39 2024-04-25T02:08:42.494 INFO:tasks.workunit.client.0.smithi077.stdout:8/142: write d3/f6 [844998,13922] 0 2024-04-25T02:08:42.494 INFO:tasks.workunit.client.0.smithi077.stdout:8/143: truncate d3/fd 840494 0 2024-04-25T02:08:42.498 INFO:tasks.workunit.client.0.smithi077.stdout:5/131: link d0/d2/d3/d9/f2b d0/d2/d5/f2c 0 2024-04-25T02:08:42.498 INFO:tasks.workunit.client.0.smithi077.stdout:5/132: symlink d0/d2/d20/d23/l2d 0 2024-04-25T02:08:42.499 INFO:tasks.workunit.client.0.smithi077.stdout:5/133: readlink d0/d2/d3/d9/l18 0 2024-04-25T02:08:42.500 INFO:tasks.workunit.client.0.smithi077.stdout:5/134: symlink d0/d2/d20/l2e 0 2024-04-25T02:08:42.503 INFO:tasks.workunit.client.0.smithi077.stdout:8/144: read d3/da/db/df/d2b/f1d [484937,2948] 0 2024-04-25T02:08:42.505 INFO:tasks.workunit.client.0.smithi077.stdout:8/145: rmdir d3/da/d27/d16/d25 0 2024-04-25T02:08:42.505 INFO:tasks.workunit.client.0.smithi077.stdout:8/146: stat d3/l12 0 2024-04-25T02:08:42.507 INFO:tasks.workunit.client.0.smithi077.stdout:5/135: dread d0/d2/d20/f21 [0,4194304] 0 2024-04-25T02:08:42.509 INFO:tasks.workunit.client.0.smithi077.stdout:8/147: write d3/da/d27/f21 [823137,33327] 0 2024-04-25T02:08:42.509 INFO:tasks.workunit.client.0.smithi077.stdout:8/148: read - d3/da/db/f20 zero size 2024-04-25T02:08:42.509 INFO:tasks.workunit.client.0.smithi077.stdout:8/149: write d3/da/d27/f1e [163823,119838] 0 2024-04-25T02:08:42.509 INFO:tasks.workunit.client.0.smithi077.stdout:8/150: mknod d3/da/d27/d16/c2e 0 2024-04-25T02:08:42.514 INFO:tasks.workunit.client.0.smithi077.stdout:8/151: dread d3/f7 [0,4194304] 0 2024-04-25T02:08:42.514 INFO:tasks.workunit.client.0.smithi077.stdout:8/152: dread - d3/da/db/f20 zero size 2024-04-25T02:08:42.515 INFO:tasks.workunit.client.0.smithi077.stdout:8/153: stat d3/da/db/df 0 2024-04-25T02:08:42.515 INFO:tasks.workunit.client.0.smithi077.stdout:8/154: stat l1 0 2024-04-25T02:08:42.515 INFO:tasks.workunit.client.0.smithi077.stdout:8/155: write d3/f8 [312424,59138] 0 2024-04-25T02:08:42.515 INFO:tasks.workunit.client.0.smithi077.stdout:8/156: truncate d3/da/f29 984442 0 2024-04-25T02:08:42.516 INFO:tasks.workunit.client.0.smithi077.stdout:7/61: dwrite d4/f5 [4194304,4194304] 0 2024-04-25T02:08:42.516 INFO:tasks.workunit.client.0.smithi077.stdout:7/62: chown c2 17294 1 2024-04-25T02:08:42.516 INFO:tasks.workunit.client.0.smithi077.stdout:2/97: dwrite d2/fd [0,4194304] 0 2024-04-25T02:08:42.516 INFO:tasks.workunit.client.0.smithi077.stdout:3/97: dwrite d0/d7/d15/f1d [0,4194304] 0 2024-04-25T02:08:42.516 INFO:tasks.workunit.client.0.smithi077.stdout:3/98: truncate d0/d17/f19 518038 0 2024-04-25T02:08:42.516 INFO:tasks.workunit.client.0.smithi077.stdout:8/157: symlink d3/da/d27/l2f 0 2024-04-25T02:08:42.516 INFO:tasks.workunit.client.0.smithi077.stdout:8/158: chown d3/f7 88860711 1 2024-04-25T02:08:42.524 INFO:tasks.workunit.client.0.smithi077.stdout:7/63: dread d4/f5 [0,4194304] 0 2024-04-25T02:08:42.525 INFO:tasks.workunit.client.0.smithi077.stdout:7/64: read - d4/fa zero size 2024-04-25T02:08:42.525 INFO:tasks.workunit.client.0.smithi077.stdout:7/65: write d4/fb [1230644,95622] 0 2024-04-25T02:08:42.527 INFO:tasks.workunit.client.0.smithi077.stdout:5/136: dwrite d0/d2/d3/d1d/f1f [0,4194304] 0 2024-04-25T02:08:42.528 INFO:tasks.workunit.client.0.smithi077.stdout:7/66: write d4/f5 [78812,64503] 0 2024-04-25T02:08:42.529 INFO:tasks.workunit.client.0.smithi077.stdout:8/159: mkdir d3/da/db/df/d30 0 2024-04-25T02:08:42.529 INFO:tasks.workunit.client.0.smithi077.stdout:8/160: chown d3/da/c26 18882883 1 2024-04-25T02:08:42.532 INFO:tasks.workunit.client.0.smithi077.stdout:2/98: dwrite d2/d9/fb [0,4194304] 0 2024-04-25T02:08:42.534 INFO:tasks.workunit.client.0.smithi077.stdout:5/137: creat d0/d2/d3/f2f x:0 0 0 2024-04-25T02:08:42.534 INFO:tasks.workunit.client.0.smithi077.stdout:5/138: readlink d0/d2/d3/d1d/l27 0 2024-04-25T02:08:42.535 INFO:tasks.workunit.client.0.smithi077.stdout:3/99: getdents d0/d7 0 2024-04-25T02:08:42.539 INFO:tasks.workunit.client.0.smithi077.stdout:3/100: creat d0/f1f x:0 0 0 2024-04-25T02:08:42.540 INFO:tasks.workunit.client.0.smithi077.stdout:8/161: truncate d3/f8 119839 0 2024-04-25T02:08:42.543 INFO:tasks.workunit.client.0.smithi077.stdout:9/69: sync 2024-04-25T02:08:42.543 INFO:tasks.workunit.client.0.smithi077.stdout:1/102: sync 2024-04-25T02:08:42.543 INFO:tasks.workunit.client.0.smithi077.stdout:0/117: sync 2024-04-25T02:08:42.543 INFO:tasks.workunit.client.0.smithi077.stdout:6/142: sync 2024-04-25T02:08:42.543 INFO:tasks.workunit.client.0.smithi077.stdout:9/70: creat df/f18 x:0 0 0 2024-04-25T02:08:42.543 INFO:tasks.workunit.client.0.smithi077.stdout:9/71: fsync df/f13 0 2024-04-25T02:08:42.543 INFO:tasks.workunit.client.0.smithi077.stdout:7/67: dwrite d4/fa [0,4194304] 0 2024-04-25T02:08:42.543 INFO:tasks.workunit.client.0.smithi077.stdout:8/162: mknod d3/c31 0 2024-04-25T02:08:42.544 INFO:tasks.workunit.client.0.smithi077.stdout:3/101: rmdir d0/d2/de 39 2024-04-25T02:08:42.544 INFO:tasks.workunit.client.0.smithi077.stdout:8/163: dread d3/da/f29 [0,4194304] 0 2024-04-25T02:08:42.544 INFO:tasks.workunit.client.0.smithi077.stdout:8/164: write d3/da/db/f28 [67257,58282] 0 2024-04-25T02:08:42.545 INFO:tasks.workunit.client.0.smithi077.stdout:2/99: dread d2/d9/d19/f1a [0,4194304] 0 2024-04-25T02:08:42.545 INFO:tasks.workunit.client.0.smithi077.stdout:2/100: chown d2/d9/d19 289 1 2024-04-25T02:08:42.545 INFO:tasks.workunit.client.0.smithi077.stdout:0/118: rmdir d2/d17/d29 0 2024-04-25T02:08:42.547 INFO:tasks.workunit.client.0.smithi077.stdout:1/103: link db/ce db/df/d1b/c28 0 2024-04-25T02:08:42.547 INFO:tasks.workunit.client.0.smithi077.stdout:6/143: mkdir de/d15/d35 0 2024-04-25T02:08:42.549 INFO:tasks.workunit.client.0.smithi077.stdout:4/95: sync 2024-04-25T02:08:42.551 INFO:tasks.workunit.client.0.smithi077.stdout:9/72: mkdir df/d19 0 2024-04-25T02:08:42.551 INFO:tasks.workunit.client.0.smithi077.stdout:9/73: dread - df/f18 zero size 2024-04-25T02:08:42.551 INFO:tasks.workunit.client.0.smithi077.stdout:9/74: write df/f10 [77899,10564] 0 2024-04-25T02:08:42.551 INFO:tasks.workunit.client.0.smithi077.stdout:9/75: dread - df/f12 zero size 2024-04-25T02:08:42.551 INFO:tasks.workunit.client.0.smithi077.stdout:9/76: write df/f12 [448004,16880] 0 2024-04-25T02:08:42.551 INFO:tasks.workunit.client.0.smithi077.stdout:9/77: read - df/f17 zero size 2024-04-25T02:08:42.551 INFO:tasks.workunit.client.0.smithi077.stdout:5/139: dwrite d0/d2/d3/f15 [0,4194304] 0 2024-04-25T02:08:42.553 INFO:tasks.workunit.client.0.smithi077.stdout:7/68: symlink d4/l10 0 2024-04-25T02:08:42.554 INFO:tasks.workunit.client.0.smithi077.stdout:3/102: mknod d0/d7/c20 0 2024-04-25T02:08:42.554 INFO:tasks.workunit.client.0.smithi077.stdout:3/103: write d0/f1f [198392,1789] 0 2024-04-25T02:08:42.556 INFO:tasks.workunit.client.0.smithi077.stdout:8/165: mknod d3/da/d27/c32 0 2024-04-25T02:08:42.556 INFO:tasks.workunit.client.0.smithi077.stdout:8/166: stat l2 0 2024-04-25T02:08:42.558 INFO:tasks.workunit.client.0.smithi077.stdout:2/101: mkdir d2/d9/d18/d1b 0 2024-04-25T02:08:42.558 INFO:tasks.workunit.client.0.smithi077.stdout:2/102: readlink d2/d9/df/l12 0 2024-04-25T02:08:42.559 INFO:tasks.workunit.client.0.smithi077.stdout:0/119: mkdir d2/d9/d2a 0 2024-04-25T02:08:42.559 INFO:tasks.workunit.client.0.smithi077.stdout:0/120: chown d2 12579202 1 2024-04-25T02:08:42.561 INFO:tasks.workunit.client.0.smithi077.stdout:1/104: mknod db/df/d14/c29 0 2024-04-25T02:08:42.561 INFO:tasks.workunit.client.0.smithi077.stdout:1/105: fdatasync db/fd 0 2024-04-25T02:08:42.561 INFO:tasks.workunit.client.0.smithi077.stdout:2/103: read d2/d9/d19/f1a [4170257,16716] 0 2024-04-25T02:08:42.563 INFO:tasks.workunit.client.0.smithi077.stdout:4/96: rename d0/l5 to d0/de/l1e 0 2024-04-25T02:08:42.563 INFO:tasks.workunit.client.0.smithi077.stdout:4/97: stat d0/l3 0 2024-04-25T02:08:42.565 INFO:tasks.workunit.client.0.smithi077.stdout:2/104: write d2/d9/d18/fa [1579250,78146] 0 2024-04-25T02:08:42.565 INFO:tasks.workunit.client.0.smithi077.stdout:5/140: stat d0/d2/c16 0 2024-04-25T02:08:42.565 INFO:tasks.workunit.client.0.smithi077.stdout:5/141: fsync d0/d2/d3/d1d/f28 0 2024-04-25T02:08:42.568 INFO:tasks.workunit.client.0.smithi077.stdout:3/104: link d0/d7/c1e d0/d2/de/c21 0 2024-04-25T02:08:42.570 INFO:tasks.workunit.client.0.smithi077.stdout:0/121: creat d2/d27/f2b x:0 0 0 2024-04-25T02:08:42.570 INFO:tasks.workunit.client.0.smithi077.stdout:0/122: read - d2/d1c/f24 zero size 2024-04-25T02:08:42.570 INFO:tasks.workunit.client.0.smithi077.stdout:0/123: chown d2/d8/f26 7714 1 2024-04-25T02:08:42.570 INFO:tasks.workunit.client.0.smithi077.stdout:1/106: rmdir db/df 39 2024-04-25T02:08:42.570 INFO:tasks.workunit.client.0.smithi077.stdout:1/107: write db/f18 [4560616,11300] 0 2024-04-25T02:08:42.572 INFO:tasks.workunit.client.0.smithi077.stdout:9/78: rename f7 to df/f1a 0 2024-04-25T02:08:42.572 INFO:tasks.workunit.client.0.smithi077.stdout:7/69: dwrite d4/fe [0,4194304] 0 2024-04-25T02:08:42.574 INFO:tasks.workunit.client.0.smithi077.stdout:2/105: mkdir d2/d9/d19/d1c 0 2024-04-25T02:08:42.574 INFO:tasks.workunit.client.0.smithi077.stdout:1/108: dread f3 [0,4194304] 0 2024-04-25T02:08:42.575 INFO:tasks.workunit.client.0.smithi077.stdout:5/142: link d0/d2/d3/f17 d0/d25/f30 0 2024-04-25T02:08:42.576 INFO:tasks.workunit.client.0.smithi077.stdout:3/105: readlink d0/l8 0 2024-04-25T02:08:42.577 INFO:tasks.workunit.client.0.smithi077.stdout:2/106: dread d2/d9/d19/f1a [0,4194304] 0 2024-04-25T02:08:42.578 INFO:tasks.workunit.client.0.smithi077.stdout:9/79: dread f5 [0,4194304] 0 2024-04-25T02:08:42.580 INFO:tasks.workunit.client.0.smithi077.stdout:7/70: link d4/fa d4/f11 0 2024-04-25T02:08:42.580 INFO:tasks.workunit.client.0.smithi077.stdout:7/71: creat d4/f12 x:0 0 0 2024-04-25T02:08:42.581 INFO:tasks.workunit.client.0.smithi077.stdout:7/72: write d4/fb [785157,73552] 0 2024-04-25T02:08:42.581 INFO:tasks.workunit.client.0.smithi077.stdout:1/109: getdents db/d11 0 2024-04-25T02:08:42.583 INFO:tasks.workunit.client.0.smithi077.stdout:3/106: mkdir d0/d7/d22 0 2024-04-25T02:08:42.583 INFO:tasks.workunit.client.0.smithi077.stdout:3/107: readlink d0/l8 0 2024-04-25T02:08:42.584 INFO:tasks.workunit.client.0.smithi077.stdout:2/107: dread d2/fd [0,4194304] 0 2024-04-25T02:08:42.587 INFO:tasks.workunit.client.0.smithi077.stdout:3/108: stat d0/d7/c12 0 2024-04-25T02:08:42.589 INFO:tasks.workunit.client.0.smithi077.stdout:2/108: symlink d2/d9/l1d 0 2024-04-25T02:08:42.591 INFO:tasks.workunit.client.0.smithi077.stdout:3/109: rename d0/d2/f16 to d0/f23 0 2024-04-25T02:08:42.592 INFO:tasks.workunit.client.0.smithi077.stdout:7/73: dread d4/fe [0,4194304] 0 2024-04-25T02:08:42.592 INFO:tasks.workunit.client.0.smithi077.stdout:7/74: write d4/fb [2097533,75101] 0 2024-04-25T02:08:42.592 INFO:tasks.workunit.client.0.smithi077.stdout:3/110: mkdir d0/d7/d15/d24 0 2024-04-25T02:08:42.593 INFO:tasks.workunit.client.0.smithi077.stdout:7/75: mkdir d4/d13 0 2024-04-25T02:08:42.594 INFO:tasks.workunit.client.0.smithi077.stdout:2/109: dread d2/d9/d18/fa [0,4194304] 0 2024-04-25T02:08:42.595 INFO:tasks.workunit.client.0.smithi077.stdout:2/110: creat d2/d9/d19/d1c/f1e x:0 0 0 2024-04-25T02:08:42.598 INFO:tasks.workunit.client.0.smithi077.stdout:9/80: dwrite df/f18 [0,4194304] 0 2024-04-25T02:08:42.599 INFO:tasks.workunit.client.0.smithi077.stdout:2/111: dread d2/d9/d19/f1a [0,4194304] 0 2024-04-25T02:08:42.602 INFO:tasks.workunit.client.0.smithi077.stdout:9/81: rmdir df/d19 0 2024-04-25T02:08:42.603 INFO:tasks.workunit.client.0.smithi077.stdout:1/110: dwrite db/df/f1d [0,4194304] 0 2024-04-25T02:08:42.605 INFO:tasks.workunit.client.0.smithi077.stdout:2/112: dread d2/d9/d18/fa [0,4194304] 0 2024-04-25T02:08:42.608 INFO:tasks.workunit.client.0.smithi077.stdout:1/111: dread db/df/f20 [0,4194304] 0 2024-04-25T02:08:42.608 INFO:tasks.workunit.client.0.smithi077.stdout:2/113: dread f1 [0,4194304] 0 2024-04-25T02:08:42.610 INFO:tasks.workunit.client.0.smithi077.stdout:1/112: unlink db/df/f21 0 2024-04-25T02:08:42.613 INFO:tasks.workunit.client.0.smithi077.stdout:2/114: unlink d2/d9/d19/d1c/f1e 0 2024-04-25T02:08:42.614 INFO:tasks.workunit.client.0.smithi077.stdout:2/115: symlink d2/d9/d18/l1f 0 2024-04-25T02:08:42.614 INFO:tasks.workunit.client.0.smithi077.stdout:2/116: chown d2/d9/df/l15 90527602 1 2024-04-25T02:08:42.617 INFO:tasks.workunit.client.0.smithi077.stdout:2/117: dread d2/fd [0,4194304] 0 2024-04-25T02:08:42.617 INFO:tasks.workunit.client.0.smithi077.stdout:2/118: creat d2/d9/f20 x:0 0 0 2024-04-25T02:08:42.623 INFO:tasks.workunit.client.0.smithi077.stdout:1/113: dread db/df/f1d [0,4194304] 0 2024-04-25T02:08:42.623 INFO:tasks.workunit.client.0.smithi077.stdout:1/114: stat db/df/d1b/c28 0 2024-04-25T02:08:42.623 INFO:tasks.workunit.client.0.smithi077.stdout:1/115: write db/df/d14/f17 [644814,59285] 0 2024-04-25T02:08:42.624 INFO:tasks.workunit.client.0.smithi077.stdout:1/116: symlink db/df/d1b/l2a 0 2024-04-25T02:08:42.624 INFO:tasks.workunit.client.0.smithi077.stdout:1/117: chown db/df/d14/c29 10 1 2024-04-25T02:08:42.630 INFO:tasks.workunit.client.0.smithi077.stdout:9/82: dwrite fc [0,4194304] 0 2024-04-25T02:08:42.632 INFO:tasks.workunit.client.0.smithi077.stdout:3/111: dwrite d0/d7/d15/f1d [0,4194304] 0 2024-04-25T02:08:42.632 INFO:tasks.workunit.client.0.smithi077.stdout:3/112: chown d0/d7/c12 2939 1 2024-04-25T02:08:42.634 INFO:tasks.workunit.client.0.smithi077.stdout:3/113: rmdir d0 39 2024-04-25T02:08:42.678 INFO:tasks.workunit.client.0.smithi077.stdout:7/76: dwrite d4/f12 [0,4194304] 0 2024-04-25T02:08:42.678 INFO:tasks.workunit.client.0.smithi077.stdout:7/77: readlink l3 0 2024-04-25T02:08:42.680 INFO:tasks.workunit.client.0.smithi077.stdout:7/78: creat d4/d13/f14 x:0 0 0 2024-04-25T02:08:42.680 INFO:tasks.workunit.client.0.smithi077.stdout:7/79: chown d4/d13/f14 2365 1 2024-04-25T02:08:42.681 INFO:tasks.workunit.client.0.smithi077.stdout:7/80: mknod d4/c15 0 2024-04-25T02:08:42.687 INFO:tasks.workunit.client.0.smithi077.stdout:7/81: dread d4/fa [0,4194304] 0 2024-04-25T02:08:42.687 INFO:tasks.workunit.client.0.smithi077.stdout:3/114: dwrite d0/d2/f13 [0,4194304] 0 2024-04-25T02:08:42.688 INFO:tasks.workunit.client.0.smithi077.stdout:2/119: dwrite d2/d9/d19/f1a [0,4194304] 0 2024-04-25T02:08:42.690 INFO:tasks.workunit.client.0.smithi077.stdout:3/115: creat d0/d7/d15/f25 x:0 0 0 2024-04-25T02:08:42.692 INFO:tasks.workunit.client.0.smithi077.stdout:2/120: rename d2/d9/l1d to d2/d9/l21 0 2024-04-25T02:08:42.692 INFO:tasks.workunit.client.0.smithi077.stdout:2/121: chown f0 11408 1 2024-04-25T02:08:42.692 INFO:tasks.workunit.client.0.smithi077.stdout:1/118: dwrite db/f18 [0,4194304] 0 2024-04-25T02:08:42.694 INFO:tasks.workunit.client.0.smithi077.stdout:2/122: symlink d2/d9/df/l22 0 2024-04-25T02:08:42.694 INFO:tasks.workunit.client.0.smithi077.stdout:2/123: fdatasync d2/d9/f17 0 2024-04-25T02:08:42.697 INFO:tasks.workunit.client.0.smithi077.stdout:2/124: creat d2/d9/d19/f23 x:0 0 0 2024-04-25T02:08:42.697 INFO:tasks.workunit.client.0.smithi077.stdout:1/119: dread db/d11/f15 [0,4194304] 0 2024-04-25T02:08:42.697 INFO:tasks.workunit.client.0.smithi077.stdout:1/120: chown db/df/d14/f17 54 1 2024-04-25T02:08:42.698 INFO:tasks.workunit.client.0.smithi077.stdout:2/125: symlink d2/d9/df/l24 0 2024-04-25T02:08:42.700 INFO:tasks.workunit.client.0.smithi077.stdout:1/121: mknod db/d26/c2b 0 2024-04-25T02:08:42.700 INFO:tasks.workunit.client.0.smithi077.stdout:7/82: dread d4/f12 [0,4194304] 0 2024-04-25T02:08:42.701 INFO:tasks.workunit.client.0.smithi077.stdout:7/83: fsync d4/d13/f14 0 2024-04-25T02:08:42.701 INFO:tasks.workunit.client.0.smithi077.stdout:2/126: mknod d2/d9/d19/d1c/c25 0 2024-04-25T02:08:42.704 INFO:tasks.workunit.client.0.smithi077.stdout:2/127: rmdir d2/d14 0 2024-04-25T02:08:42.705 INFO:tasks.workunit.client.0.smithi077.stdout:1/122: getdents db/df/d1b 0 2024-04-25T02:08:42.705 INFO:tasks.workunit.client.0.smithi077.stdout:1/123: chown db/d11/c13 36954373 1 2024-04-25T02:08:42.705 INFO:tasks.workunit.client.0.smithi077.stdout:1/124: chown db/df/d14/c29 162 1 2024-04-25T02:08:42.707 INFO:tasks.workunit.client.0.smithi077.stdout:2/128: rename d2/d9/d19/d1c/c25 to d2/d9/d18/d1b/c26 0 2024-04-25T02:08:42.708 INFO:tasks.workunit.client.0.smithi077.stdout:2/129: mkdir d2/d27 0 2024-04-25T02:08:42.708 INFO:tasks.workunit.client.0.smithi077.stdout:6/144: sync 2024-04-25T02:08:42.710 INFO:tasks.workunit.client.0.smithi077.stdout:2/130: dread f1 [0,4194304] 0 2024-04-25T02:08:42.712 INFO:tasks.workunit.client.0.smithi077.stdout:2/131: mkdir d2/d28 0 2024-04-25T02:08:42.712 INFO:tasks.workunit.client.0.smithi077.stdout:2/132: write d2/fd [4704038,29889] 0 2024-04-25T02:08:42.714 INFO:tasks.workunit.client.0.smithi077.stdout:1/125: write db/f18 [2709190,116805] 0 2024-04-25T02:08:42.716 INFO:tasks.workunit.client.0.smithi077.stdout:3/116: dwrite d0/f23 [4194304,4194304] 0 2024-04-25T02:08:42.718 INFO:tasks.workunit.client.0.smithi077.stdout:2/133: dread d2/d9/d18/fa [0,4194304] 0 2024-04-25T02:08:42.718 INFO:tasks.workunit.client.0.smithi077.stdout:2/134: chown d2/d9/f17 156849 1 2024-04-25T02:08:42.718 INFO:tasks.workunit.client.0.smithi077.stdout:3/117: mknod d0/d7/d15/d24/c26 0 2024-04-25T02:08:42.718 INFO:tasks.workunit.client.0.smithi077.stdout:3/118: stat d0/d17/f19 0 2024-04-25T02:08:42.719 INFO:tasks.workunit.client.0.smithi077.stdout:2/135: creat d2/d9/d18/f29 x:0 0 0 2024-04-25T02:08:42.720 INFO:tasks.workunit.client.0.smithi077.stdout:3/119: mkdir d0/d2/de/d27 0 2024-04-25T02:08:42.720 INFO:tasks.workunit.client.0.smithi077.stdout:3/120: dread - d0/d2/de/f1b zero size 2024-04-25T02:08:42.721 INFO:tasks.workunit.client.0.smithi077.stdout:3/121: rename d0/l8 to d0/d7/d15/d24/l28 0 2024-04-25T02:08:42.722 INFO:tasks.workunit.client.0.smithi077.stdout:3/122: creat d0/d7/f29 x:0 0 0 2024-04-25T02:08:42.723 INFO:tasks.workunit.client.0.smithi077.stdout:7/84: dwrite d4/fa [0,4194304] 0 2024-04-25T02:08:42.723 INFO:tasks.workunit.client.0.smithi077.stdout:7/85: truncate d4/d13/f14 791606 0 2024-04-25T02:08:42.723 INFO:tasks.workunit.client.0.smithi077.stdout:7/86: creat d4/f16 x:0 0 0 2024-04-25T02:08:42.732 INFO:tasks.workunit.client.0.smithi077.stdout:2/136: dread d2/d9/d19/f1a [0,4194304] 0 2024-04-25T02:08:42.733 INFO:tasks.workunit.client.0.smithi077.stdout:2/137: truncate f1 1390282 0 2024-04-25T02:08:42.739 INFO:tasks.workunit.client.0.smithi077.stdout:7/87: dread d4/f11 [0,4194304] 0 2024-04-25T02:08:42.739 INFO:tasks.workunit.client.0.smithi077.stdout:3/123: dread d0/f9 [4194304,4194304] 0 2024-04-25T02:08:42.739 INFO:tasks.workunit.client.0.smithi077.stdout:7/88: truncate d4/d13/f14 1095793 0 2024-04-25T02:08:42.740 INFO:tasks.workunit.client.0.smithi077.stdout:4/98: sync 2024-04-25T02:08:42.741 INFO:tasks.workunit.client.0.smithi077.stdout:0/124: sync 2024-04-25T02:08:42.741 INFO:tasks.workunit.client.0.smithi077.stdout:5/143: sync 2024-04-25T02:08:42.741 INFO:tasks.workunit.client.0.smithi077.stdout:5/144: creat d0/d2/d3/f31 x:0 0 0 2024-04-25T02:08:42.741 INFO:tasks.workunit.client.0.smithi077.stdout:9/83: sync 2024-04-25T02:08:42.741 INFO:tasks.workunit.client.0.smithi077.stdout:9/84: fdatasync f3 0 2024-04-25T02:08:42.741 INFO:tasks.workunit.client.0.smithi077.stdout:5/145: write d0/d2/d5/f2c [4803546,37453] 0 2024-04-25T02:08:42.741 INFO:tasks.workunit.client.0.smithi077.stdout:8/167: sync 2024-04-25T02:08:42.741 INFO:tasks.workunit.client.0.smithi077.stdout:5/146: chown d0/d2/d3/d9 1 1 2024-04-25T02:08:42.743 INFO:tasks.workunit.client.0.smithi077.stdout:0/125: unlink d2/d17/c28 0 2024-04-25T02:08:42.744 INFO:tasks.workunit.client.0.smithi077.stdout:7/89: dread d4/f11 [0,4194304] 0 2024-04-25T02:08:42.744 INFO:tasks.workunit.client.0.smithi077.stdout:6/145: dwrite de/f13 [0,4194304] 0 2024-04-25T02:08:42.744 INFO:tasks.workunit.client.0.smithi077.stdout:6/146: write fd [4498092,49140] 0 2024-04-25T02:08:42.745 INFO:tasks.workunit.client.0.smithi077.stdout:9/85: mkdir df/d1b 0 2024-04-25T02:08:42.746 INFO:tasks.workunit.client.0.smithi077.stdout:1/126: dwrite db/df/f1d [0,4194304] 0 2024-04-25T02:08:42.747 INFO:tasks.workunit.client.0.smithi077.stdout:8/168: link d3/f7 d3/da/db/df/f33 0 2024-04-25T02:08:42.748 INFO:tasks.workunit.client.0.smithi077.stdout:8/169: write d3/da/db/df/f33 [308411,110483] 0 2024-04-25T02:08:42.748 INFO:tasks.workunit.client.0.smithi077.stdout:0/126: symlink d2/d8/l2c 0 2024-04-25T02:08:42.752 INFO:tasks.workunit.client.0.smithi077.stdout:6/147: mkdir de/d15/d36 0 2024-04-25T02:08:42.753 INFO:tasks.workunit.client.0.smithi077.stdout:6/148: readlink de/l1f 0 2024-04-25T02:08:42.753 INFO:tasks.workunit.client.0.smithi077.stdout:6/149: write f5 [4708492,46069] 0 2024-04-25T02:08:42.754 INFO:tasks.workunit.client.0.smithi077.stdout:9/86: symlink df/l1c 0 2024-04-25T02:08:42.754 INFO:tasks.workunit.client.0.smithi077.stdout:9/87: creat df/f1d x:0 0 0 2024-04-25T02:08:42.754 INFO:tasks.workunit.client.0.smithi077.stdout:9/88: dread - df/f1d zero size 2024-04-25T02:08:42.754 INFO:tasks.workunit.client.0.smithi077.stdout:9/89: write df/f10 [345398,31628] 0 2024-04-25T02:08:42.759 INFO:tasks.workunit.client.0.smithi077.stdout:8/170: mkdir d3/d34 0 2024-04-25T02:08:42.759 INFO:tasks.workunit.client.0.smithi077.stdout:0/127: mkdir d2/d27/d2d 0 2024-04-25T02:08:42.759 INFO:tasks.workunit.client.0.smithi077.stdout:8/171: readlink d3/da/d27/d16/l1a 0 2024-04-25T02:08:42.759 INFO:tasks.workunit.client.0.smithi077.stdout:8/172: creat d3/da/f35 x:0 0 0 2024-04-25T02:08:42.760 INFO:tasks.workunit.client.0.smithi077.stdout:8/173: write d3/da/db/df/f33 [267050,36265] 0 2024-04-25T02:08:42.760 INFO:tasks.workunit.client.0.smithi077.stdout:0/128: write d2/d17/d1d/f20 [672917,129126] 0 2024-04-25T02:08:42.760 INFO:tasks.workunit.client.0.smithi077.stdout:8/174: chown l2 0 1 2024-04-25T02:08:42.760 INFO:tasks.workunit.client.0.smithi077.stdout:0/129: write d2/d8/f13 [2113963,77135] 0 2024-04-25T02:08:42.760 INFO:tasks.workunit.client.0.smithi077.stdout:6/150: rename de/d15/c23 to de/d12/c37 0 2024-04-25T02:08:42.766 INFO:tasks.workunit.client.0.smithi077.stdout:6/151: mkdir de/d12/d25/d38 0 2024-04-25T02:08:42.768 INFO:tasks.workunit.client.0.smithi077.stdout:6/152: symlink de/l39 0 2024-04-25T02:08:42.775 INFO:tasks.workunit.client.0.smithi077.stdout:2/138: dwrite f0 [0,4194304] 0 2024-04-25T02:08:42.777 INFO:tasks.workunit.client.0.smithi077.stdout:2/139: rmdir d2/d27 0 2024-04-25T02:08:42.779 INFO:tasks.workunit.client.0.smithi077.stdout:2/140: mkdir d2/d9/d18/d2a 0 2024-04-25T02:08:42.780 INFO:tasks.workunit.client.0.smithi077.stdout:6/153: dread de/d12/f1c [0,4194304] 0 2024-04-25T02:08:42.780 INFO:tasks.workunit.client.0.smithi077.stdout:6/154: write de/d12/f1c [4318625,81012] 0 2024-04-25T02:08:42.781 INFO:tasks.workunit.client.0.smithi077.stdout:6/155: chown de/d12/d25/l27 112582431 1 2024-04-25T02:08:42.782 INFO:tasks.workunit.client.0.smithi077.stdout:2/141: dread d2/d9/d18/fa [0,4194304] 0 2024-04-25T02:08:42.784 INFO:tasks.workunit.client.0.smithi077.stdout:6/156: mkdir de/d12/d25/d3a 0 2024-04-25T02:08:42.784 INFO:tasks.workunit.client.0.smithi077.stdout:6/157: stat de/d15 0 2024-04-25T02:08:42.784 INFO:tasks.workunit.client.0.smithi077.stdout:6/158: chown de/d12/f17 324 1 2024-04-25T02:08:42.785 INFO:tasks.workunit.client.0.smithi077.stdout:0/130: fdatasync d2/d8/f13 0 2024-04-25T02:08:42.785 INFO:tasks.workunit.client.0.smithi077.stdout:6/159: mkdir de/d3b 0 2024-04-25T02:08:42.802 INFO:tasks.workunit.client.0.smithi077.stdout:3/124: dwrite d0/d2/f18 [0,4194304] 0 2024-04-25T02:08:42.803 INFO:tasks.workunit.client.0.smithi077.stdout:3/125: creat d0/d7/d15/f2a x:0 0 0 2024-04-25T02:08:42.803 INFO:tasks.workunit.client.0.smithi077.stdout:3/126: dread - d0/d2/de/f1b zero size 2024-04-25T02:08:42.803 INFO:tasks.workunit.client.0.smithi077.stdout:3/127: creat d0/d7/d15/f2b x:0 0 0 2024-04-25T02:08:42.812 INFO:tasks.workunit.client.0.smithi077.stdout:5/147: dwrite d0/fd [0,4194304] 0 2024-04-25T02:08:42.813 INFO:tasks.workunit.client.0.smithi077.stdout:8/175: dwrite d3/da/d27/d16/f22 [0,4194304] 0 2024-04-25T02:08:42.813 INFO:tasks.workunit.client.0.smithi077.stdout:7/90: dwrite d4/fb [0,4194304] 0 2024-04-25T02:08:42.814 INFO:tasks.workunit.client.0.smithi077.stdout:4/99: dwrite d0/d1/f6 [0,4194304] 0 2024-04-25T02:08:42.814 INFO:tasks.workunit.client.0.smithi077.stdout:4/100: chown d0/d1/da/df/c19 2 1 2024-04-25T02:08:42.814 INFO:tasks.workunit.client.0.smithi077.stdout:9/90: dwrite fc [0,4194304] 0 2024-04-25T02:08:42.814 INFO:tasks.workunit.client.0.smithi077.stdout:9/91: write df/f17 [237914,77101] 0 2024-04-25T02:08:42.814 INFO:tasks.workunit.client.0.smithi077.stdout:5/148: fsync d0/d2/d3/d9/f2b 0 2024-04-25T02:08:42.817 INFO:tasks.workunit.client.0.smithi077.stdout:7/91: rename d4/f11 to d4/d13/f17 0 2024-04-25T02:08:42.818 INFO:tasks.workunit.client.0.smithi077.stdout:2/142: dwrite d2/d9/f17 [0,4194304] 0 2024-04-25T02:08:42.818 INFO:tasks.workunit.client.0.smithi077.stdout:3/128: dread d0/d2/f18 [0,4194304] 0 2024-04-25T02:08:42.819 INFO:tasks.workunit.client.0.smithi077.stdout:1/127: dwrite db/df/f20 [0,4194304] 0 2024-04-25T02:08:42.819 INFO:tasks.workunit.client.0.smithi077.stdout:2/143: dread - d2/d9/d19/f23 zero size 2024-04-25T02:08:42.819 INFO:tasks.workunit.client.0.smithi077.stdout:3/129: chown d0/d2/f13 91728 1 2024-04-25T02:08:42.822 INFO:tasks.workunit.client.0.smithi077.stdout:2/144: read d2/fd [3723964,58237] 0 2024-04-25T02:08:42.822 INFO:tasks.workunit.client.0.smithi077.stdout:2/145: fsync d2/d9/d18/f29 0 2024-04-25T02:08:42.822 INFO:tasks.workunit.client.0.smithi077.stdout:2/146: write d2/d9/f20 [609186,126745] 0 2024-04-25T02:08:42.823 INFO:tasks.workunit.client.0.smithi077.stdout:7/92: mkdir d4/d13/d18 0 2024-04-25T02:08:42.830 INFO:tasks.workunit.client.0.smithi077.stdout:4/101: dread d0/d1/f6 [0,4194304] 0 2024-04-25T02:08:42.831 INFO:tasks.workunit.client.0.smithi077.stdout:1/128: dread db/f12 [0,4194304] 0 2024-04-25T02:08:42.832 INFO:tasks.workunit.client.0.smithi077.stdout:5/149: rename d0/d2/d3/d9/f14 to d0/f32 0 2024-04-25T02:08:42.834 INFO:tasks.workunit.client.0.smithi077.stdout:7/93: mknod d4/d13/c19 0 2024-04-25T02:08:42.834 INFO:tasks.workunit.client.0.smithi077.stdout:0/131: truncate d2/d17/d1d/f20 3785573 0 2024-04-25T02:08:42.837 INFO:tasks.workunit.client.0.smithi077.stdout:9/92: write df/f18 [313847,50504] 0 2024-04-25T02:08:42.837 INFO:tasks.workunit.client.0.smithi077.stdout:4/102: truncate d0/f16 3768772 0 2024-04-25T02:08:42.837 INFO:tasks.workunit.client.0.smithi077.stdout:2/147: getdents d2/d9/d19/d1c 0 2024-04-25T02:08:42.839 INFO:tasks.workunit.client.0.smithi077.stdout:7/94: symlink d4/l1a 0 2024-04-25T02:08:42.840 INFO:tasks.workunit.client.0.smithi077.stdout:0/132: symlink d2/d17/l2e 0 2024-04-25T02:08:42.842 INFO:tasks.workunit.client.0.smithi077.stdout:2/148: symlink d2/l2b 0 2024-04-25T02:08:42.843 INFO:tasks.workunit.client.0.smithi077.stdout:6/160: truncate de/d12/f1c 1903586 0 2024-04-25T02:08:42.845 INFO:tasks.workunit.client.0.smithi077.stdout:2/149: write d2/d9/d19/f1a [776733,16464] 0 2024-04-25T02:08:42.846 INFO:tasks.workunit.client.0.smithi077.stdout:7/95: unlink d4/d13/f14 0 2024-04-25T02:08:42.846 INFO:tasks.workunit.client.0.smithi077.stdout:7/96: creat d4/d13/f1b x:0 0 0 2024-04-25T02:08:42.848 INFO:tasks.workunit.client.0.smithi077.stdout:0/133: creat d2/d27/d2d/f2f x:0 0 0 2024-04-25T02:08:42.848 INFO:tasks.workunit.client.0.smithi077.stdout:0/134: truncate d2/d8/d10/f18 888147 0 2024-04-25T02:08:42.848 INFO:tasks.workunit.client.0.smithi077.stdout:9/93: write fc [3957533,82484] 0 2024-04-25T02:08:42.849 INFO:tasks.workunit.client.0.smithi077.stdout:6/161: symlink de/d12/d25/d38/l3c 0 2024-04-25T02:08:42.855 INFO:tasks.workunit.client.0.smithi077.stdout:1/129: dwrite db/df/d1b/f22 [0,4194304] 0 2024-04-25T02:08:42.856 INFO:tasks.workunit.client.0.smithi077.stdout:8/176: dwrite d3/da/db/df/f10 [0,4194304] 0 2024-04-25T02:08:42.856 INFO:tasks.workunit.client.0.smithi077.stdout:8/177: write d3/f4 [1976800,55822] 0 2024-04-25T02:08:42.856 INFO:tasks.workunit.client.0.smithi077.stdout:2/150: rmdir d2/d9/d18/d2a 0 2024-04-25T02:08:42.856 INFO:tasks.workunit.client.0.smithi077.stdout:2/151: chown f0 141 1 2024-04-25T02:08:42.858 INFO:tasks.workunit.client.0.smithi077.stdout:7/97: dread d4/fb [0,4194304] 0 2024-04-25T02:08:42.858 INFO:tasks.workunit.client.0.smithi077.stdout:7/98: chown d4/fb 1 1 2024-04-25T02:08:42.860 INFO:tasks.workunit.client.0.smithi077.stdout:0/135: mknod d2/d17/d1d/c30 0 2024-04-25T02:08:42.865 INFO:tasks.workunit.client.0.smithi077.stdout:6/162: symlink de/d15/d35/l3d 0 2024-04-25T02:08:42.868 INFO:tasks.workunit.client.0.smithi077.stdout:8/178: mknod d3/da/db/c36 0 2024-04-25T02:08:42.868 INFO:tasks.workunit.client.0.smithi077.stdout:8/179: chown d3/da/db/df/d30 1709306 1 2024-04-25T02:08:42.868 INFO:tasks.workunit.client.0.smithi077.stdout:8/180: chown d3/d34 9336117 1 2024-04-25T02:08:42.872 INFO:tasks.workunit.client.0.smithi077.stdout:6/163: link c4 de/c3e 0 2024-04-25T02:08:42.872 INFO:tasks.workunit.client.0.smithi077.stdout:6/164: write f9 [974619,123525] 0 2024-04-25T02:08:42.875 INFO:tasks.workunit.client.0.smithi077.stdout:6/165: creat de/d15/f3f x:0 0 0 2024-04-25T02:08:42.875 INFO:tasks.workunit.client.0.smithi077.stdout:6/166: chown fd 912 1 2024-04-25T02:08:42.875 INFO:tasks.workunit.client.0.smithi077.stdout:6/167: write de/d15/f3f [781499,19611] 0 2024-04-25T02:08:42.879 INFO:tasks.workunit.client.0.smithi077.stdout:9/94: dwrite df/f18 [0,4194304] 0 2024-04-25T02:08:42.879 INFO:tasks.workunit.client.0.smithi077.stdout:9/95: fsync df/f1a 0 2024-04-25T02:08:42.879 INFO:tasks.workunit.client.0.smithi077.stdout:6/168: dread f5 [0,4194304] 0 2024-04-25T02:08:42.879 INFO:tasks.workunit.client.0.smithi077.stdout:1/130: dwrite f3 [0,4194304] 0 2024-04-25T02:08:42.879 INFO:tasks.workunit.client.0.smithi077.stdout:1/131: getdents db/df/d1b 0 2024-04-25T02:08:42.886 INFO:tasks.workunit.client.0.smithi077.stdout:9/96: rename c4 to df/d1b/c1e 0 2024-04-25T02:08:42.887 INFO:tasks.workunit.client.0.smithi077.stdout:6/169: getdents de/d15/d35 0 2024-04-25T02:08:42.889 INFO:tasks.workunit.client.0.smithi077.stdout:1/132: rmdir db/d26 39 2024-04-25T02:08:42.889 INFO:tasks.workunit.client.0.smithi077.stdout:1/133: creat db/f2c x:0 0 0 2024-04-25T02:08:42.890 INFO:tasks.workunit.client.0.smithi077.stdout:8/181: truncate d3/da/db/df/f10 833685 0 2024-04-25T02:08:42.891 INFO:tasks.workunit.client.0.smithi077.stdout:9/97: truncate f5 3680647 0 2024-04-25T02:08:42.891 INFO:tasks.workunit.client.0.smithi077.stdout:9/98: chown df/f18 1 1 2024-04-25T02:08:42.894 INFO:tasks.workunit.client.0.smithi077.stdout:1/134: mknod db/d11/c2d 0 2024-04-25T02:08:42.896 INFO:tasks.workunit.client.0.smithi077.stdout:9/99: link fd df/d1b/f1f 0 2024-04-25T02:08:42.896 INFO:tasks.workunit.client.0.smithi077.stdout:9/100: fdatasync f5 0 2024-04-25T02:08:42.897 INFO:tasks.workunit.client.0.smithi077.stdout:6/170: rename de/d12/d25/f32 to de/d12/d25/f40 0 2024-04-25T02:08:42.898 INFO:tasks.workunit.client.0.smithi077.stdout:9/101: read df/f12 [244550,80878] 0 2024-04-25T02:08:42.899 INFO:tasks.workunit.client.0.smithi077.stdout:6/171: mknod de/d12/c41 0 2024-04-25T02:08:42.899 INFO:tasks.workunit.client.0.smithi077.stdout:6/172: write de/d12/d25/f40 [401916,129113] 0 2024-04-25T02:08:42.899 INFO:tasks.workunit.client.0.smithi077.stdout:6/173: chown de/f2c 377871069 1 2024-04-25T02:08:42.900 INFO:tasks.workunit.client.0.smithi077.stdout:4/103: truncate d0/f16 3156334 0 2024-04-25T02:08:42.901 INFO:tasks.workunit.client.0.smithi077.stdout:9/102: creat df/d1b/f20 x:0 0 0 2024-04-25T02:08:42.902 INFO:tasks.workunit.client.0.smithi077.stdout:1/135: link db/df/c10 db/c2e 0 2024-04-25T02:08:42.903 INFO:tasks.workunit.client.0.smithi077.stdout:6/174: truncate f0 3793675 0 2024-04-25T02:08:42.905 INFO:tasks.workunit.client.0.smithi077.stdout:4/104: symlink d0/d1/da/d12/l1f 0 2024-04-25T02:08:42.907 INFO:tasks.workunit.client.0.smithi077.stdout:9/103: mkdir df/d1b/d21 0 2024-04-25T02:08:42.925 INFO:tasks.workunit.client.0.smithi077.stdout:8/182: dwrite d3/f8 [0,4194304] 0 2024-04-25T02:08:42.925 INFO:tasks.workunit.client.0.smithi077.stdout:3/130: sync 2024-04-25T02:08:42.925 INFO:tasks.workunit.client.0.smithi077.stdout:3/131: chown d0/d2/f13 21 1 2024-04-25T02:08:42.925 INFO:tasks.workunit.client.0.smithi077.stdout:3/132: creat d0/d7/f2c x:0 0 0 2024-04-25T02:08:42.926 INFO:tasks.workunit.client.0.smithi077.stdout:9/104: dwrite df/d1b/f1f [0,4194304] 0 2024-04-25T02:08:42.926 INFO:tasks.workunit.client.0.smithi077.stdout:6/175: dwrite fd [0,4194304] 0 2024-04-25T02:08:42.926 INFO:tasks.workunit.client.0.smithi077.stdout:6/176: fsync de/d12/f28 0 2024-04-25T02:08:42.927 INFO:tasks.workunit.client.0.smithi077.stdout:8/183: mkdir d3/da/db/df/d2b/d37 0 2024-04-25T02:08:42.927 INFO:tasks.workunit.client.0.smithi077.stdout:8/184: write d3/da/d27/f21 [915286,115524] 0 2024-04-25T02:08:42.928 INFO:tasks.workunit.client.0.smithi077.stdout:5/150: sync 2024-04-25T02:08:42.934 INFO:tasks.workunit.client.0.smithi077.stdout:9/105: rmdir df/d1b/d21 0 2024-04-25T02:08:42.934 INFO:tasks.workunit.client.0.smithi077.stdout:8/185: dread d3/da/db/df/f33 [0,4194304] 0 2024-04-25T02:08:42.934 INFO:tasks.workunit.client.0.smithi077.stdout:8/186: chown d3/da/db/f20 244106990 1 2024-04-25T02:08:42.935 INFO:tasks.workunit.client.0.smithi077.stdout:6/177: mknod de/d15/d35/c42 0 2024-04-25T02:08:42.936 INFO:tasks.workunit.client.0.smithi077.stdout:8/187: symlink d3/l38 0 2024-04-25T02:08:42.940 INFO:tasks.workunit.client.0.smithi077.stdout:8/188: truncate d3/da/f29 300756 0 2024-04-25T02:08:42.940 INFO:tasks.workunit.client.0.smithi077.stdout:9/106: dread df/f1a [0,4194304] 0 2024-04-25T02:08:42.941 INFO:tasks.workunit.client.0.smithi077.stdout:6/178: link c8 de/d15/d35/c43 0 2024-04-25T02:08:42.942 INFO:tasks.workunit.client.0.smithi077.stdout:8/189: mknod d3/da/c39 0 2024-04-25T02:08:42.943 INFO:tasks.workunit.client.0.smithi077.stdout:8/190: symlink d3/da/l3a 0 2024-04-25T02:08:42.944 INFO:tasks.workunit.client.0.smithi077.stdout:6/179: dread de/d12/f1c [0,4194304] 0 2024-04-25T02:08:42.945 INFO:tasks.workunit.client.0.smithi077.stdout:8/191: creat d3/da/db/df/d2b/f3b x:0 0 0 2024-04-25T02:08:42.948 INFO:tasks.workunit.client.0.smithi077.stdout:3/133: dwrite d0/d7/f2c [0,4194304] 0 2024-04-25T02:08:42.952 INFO:tasks.workunit.client.0.smithi077.stdout:3/134: rmdir d0/d17 39 2024-04-25T02:08:42.953 INFO:tasks.workunit.client.0.smithi077.stdout:5/151: dwrite d0/d25/f30 [0,4194304] 0 2024-04-25T02:08:42.967 INFO:tasks.workunit.client.0.smithi077.stdout:3/135: dread d0/d7/d15/f1d [0,4194304] 0 2024-04-25T02:08:42.976 INFO:tasks.workunit.client.0.smithi077.stdout:5/152: write d0/d2/d3/f17 [1590755,45216] 0 2024-04-25T02:08:42.976 INFO:tasks.workunit.client.0.smithi077.stdout:5/153: creat d0/d2/d3/d1d/f33 x:0 0 0 2024-04-25T02:08:42.976 INFO:tasks.workunit.client.0.smithi077.stdout:5/154: creat d0/d2/d3/f34 x:0 0 0 2024-04-25T02:08:42.979 INFO:tasks.workunit.client.0.smithi077.stdout:9/107: dwrite fd [0,4194304] 0 2024-04-25T02:08:42.979 INFO:tasks.workunit.client.0.smithi077.stdout:9/108: creat df/d1b/f22 x:0 0 0 2024-04-25T02:08:42.982 INFO:tasks.workunit.client.0.smithi077.stdout:9/109: link df/c16 df/c23 0 2024-04-25T02:08:42.982 INFO:tasks.workunit.client.0.smithi077.stdout:9/110: chown df/d1b/f22 972947 1 2024-04-25T02:08:42.982 INFO:tasks.workunit.client.0.smithi077.stdout:9/111: write df/f14 [710065,50116] 0 2024-04-25T02:08:42.982 INFO:tasks.workunit.client.0.smithi077.stdout:9/112: readlink l1 0 2024-04-25T02:08:42.982 INFO:tasks.workunit.client.0.smithi077.stdout:9/113: readlink l0 0 2024-04-25T02:08:42.994 INFO:tasks.workunit.client.0.smithi077.stdout:8/192: dwrite d3/f7 [0,4194304] 0 2024-04-25T02:08:42.997 INFO:tasks.workunit.client.0.smithi077.stdout:8/193: rmdir d3 39 2024-04-25T02:08:42.998 INFO:tasks.workunit.client.0.smithi077.stdout:6/180: dwrite f9 [0,4194304] 0 2024-04-25T02:08:42.998 INFO:tasks.workunit.client.0.smithi077.stdout:6/181: write de/d12/f1c [771854,89106] 0 2024-04-25T02:08:42.998 INFO:tasks.workunit.client.0.smithi077.stdout:6/182: stat de/d12/d25/l2b 0 2024-04-25T02:08:42.998 INFO:tasks.workunit.client.0.smithi077.stdout:3/136: dwrite d0/d17/f19 [0,4194304] 0 2024-04-25T02:08:42.999 INFO:tasks.workunit.client.0.smithi077.stdout:5/155: dwrite d0/d2/d3/f15 [0,4194304] 0 2024-04-25T02:08:43.000 INFO:tasks.workunit.client.0.smithi077.stdout:6/183: dread de/d15/f3f [0,4194304] 0 2024-04-25T02:08:43.005 INFO:tasks.workunit.client.0.smithi077.stdout:9/114: getdents df/d1b 0 2024-04-25T02:08:43.012 INFO:tasks.workunit.client.0.smithi077.stdout:6/184: mkdir de/d12/d25/d44 0 2024-04-25T02:08:43.013 INFO:tasks.workunit.client.0.smithi077.stdout:6/185: symlink de/d12/d25/d38/l45 0 2024-04-25T02:08:43.013 INFO:tasks.workunit.client.0.smithi077.stdout:6/186: creat de/f46 x:0 0 0 2024-04-25T02:08:43.016 INFO:tasks.workunit.client.0.smithi077.stdout:2/152: sync 2024-04-25T02:08:43.016 INFO:tasks.workunit.client.0.smithi077.stdout:2/153: fsync d2/d9/f20 0 2024-04-25T02:08:43.016 INFO:tasks.workunit.client.0.smithi077.stdout:2/154: fsync d2/d9/d19/f23 0 2024-04-25T02:08:43.016 INFO:tasks.workunit.client.0.smithi077.stdout:2/155: readlink d2/d9/df/l12 0 2024-04-25T02:08:43.017 INFO:tasks.workunit.client.0.smithi077.stdout:3/137: write d0/f23 [3309704,90074] 0 2024-04-25T02:08:43.017 INFO:tasks.workunit.client.0.smithi077.stdout:8/194: write d3/f7 [2543171,67765] 0 2024-04-25T02:08:43.018 INFO:tasks.workunit.client.0.smithi077.stdout:2/156: mkdir d2/d9/d19/d2c 0 2024-04-25T02:08:43.019 INFO:tasks.workunit.client.0.smithi077.stdout:3/138: mkdir d0/d7/d22/d2d 0 2024-04-25T02:08:43.019 INFO:tasks.workunit.client.0.smithi077.stdout:0/136: sync 2024-04-25T02:08:43.019 INFO:tasks.workunit.client.0.smithi077.stdout:4/105: sync 2024-04-25T02:08:43.019 INFO:tasks.workunit.client.0.smithi077.stdout:7/99: sync 2024-04-25T02:08:43.019 INFO:tasks.workunit.client.0.smithi077.stdout:0/137: chown d2/d17/d1d/c30 304883 1 2024-04-25T02:08:43.019 INFO:tasks.workunit.client.0.smithi077.stdout:1/136: sync 2024-04-25T02:08:43.022 INFO:tasks.workunit.client.0.smithi077.stdout:2/157: dread d2/fd [0,4194304] 0 2024-04-25T02:08:43.022 INFO:tasks.workunit.client.0.smithi077.stdout:2/158: stat d2/d9/d18/fa 0 2024-04-25T02:08:43.023 INFO:tasks.workunit.client.0.smithi077.stdout:8/195: link d3/da/d27/d16/f22 d3/da/db/df/d30/f3c 0 2024-04-25T02:08:43.023 INFO:tasks.workunit.client.0.smithi077.stdout:8/196: chown d3 153030261 1 2024-04-25T02:08:43.023 INFO:tasks.workunit.client.0.smithi077.stdout:5/156: dwrite d0/d2/d3/f2f [0,4194304] 0 2024-04-25T02:08:43.023 INFO:tasks.workunit.client.0.smithi077.stdout:7/100: write d4/fa [2861869,115666] 0 2024-04-25T02:08:43.024 INFO:tasks.workunit.client.0.smithi077.stdout:4/106: rmdir d0/d1/da/df 39 2024-04-25T02:08:43.024 INFO:tasks.workunit.client.0.smithi077.stdout:4/107: chown d0/d1/da/df 3 1 2024-04-25T02:08:43.026 INFO:tasks.workunit.client.0.smithi077.stdout:0/138: rename d2/d8/l1a to d2/l31 0 2024-04-25T02:08:43.027 INFO:tasks.workunit.client.0.smithi077.stdout:2/159: symlink d2/d9/d19/l2d 0 2024-04-25T02:08:43.029 INFO:tasks.workunit.client.0.smithi077.stdout:5/157: mkdir d0/d2/d1b/d35 0 2024-04-25T02:08:43.029 INFO:tasks.workunit.client.0.smithi077.stdout:5/158: write d0/d2/d3/f31 [441581,118677] 0 2024-04-25T02:08:43.030 INFO:tasks.workunit.client.0.smithi077.stdout:4/108: link d0/de/f15 d0/f20 0 2024-04-25T02:08:43.030 INFO:tasks.workunit.client.0.smithi077.stdout:0/139: mknod d2/d9/c32 0 2024-04-25T02:08:43.031 INFO:tasks.workunit.client.0.smithi077.stdout:2/160: symlink d2/d9/d18/l2e 0 2024-04-25T02:08:43.033 INFO:tasks.workunit.client.0.smithi077.stdout:4/109: mkdir d0/d14/d21 0 2024-04-25T02:08:43.033 INFO:tasks.workunit.client.0.smithi077.stdout:4/110: chown d0/d1/da/d12/l13 327040 1 2024-04-25T02:08:43.033 INFO:tasks.workunit.client.0.smithi077.stdout:4/111: read - d0/de/f15 zero size 2024-04-25T02:08:43.035 INFO:tasks.workunit.client.0.smithi077.stdout:8/197: dread d3/da/db/df/d2b/f1d [0,4194304] 0 2024-04-25T02:08:43.035 INFO:tasks.workunit.client.0.smithi077.stdout:6/187: dwrite de/d15/f3f [0,4194304] 0 2024-04-25T02:08:43.037 INFO:tasks.workunit.client.0.smithi077.stdout:9/115: dwrite df/f10 [0,4194304] 0 2024-04-25T02:08:43.038 INFO:tasks.workunit.client.0.smithi077.stdout:4/112: getdents d0/de 0 2024-04-25T02:08:43.039 INFO:tasks.workunit.client.0.smithi077.stdout:2/161: getdents d2/d9 0 2024-04-25T02:08:43.042 INFO:tasks.workunit.client.0.smithi077.stdout:7/101: dread d4/d13/f17 [0,4194304] 0 2024-04-25T02:08:43.045 INFO:tasks.workunit.client.0.smithi077.stdout:3/139: dread d0/f23 [0,4194304] 0 2024-04-25T02:08:43.054 INFO:tasks.workunit.client.0.smithi077.stdout:4/113: getdents d0 0 2024-04-25T02:08:43.055 INFO:tasks.workunit.client.0.smithi077.stdout:4/114: write d0/f7 [3051496,16572] 0 2024-04-25T02:08:43.058 INFO:tasks.workunit.client.0.smithi077.stdout:2/162: mkdir d2/d9/d2f 0 2024-04-25T02:08:43.060 INFO:tasks.workunit.client.0.smithi077.stdout:7/102: link c2 d4/d13/c1c 0 2024-04-25T02:08:43.060 INFO:tasks.workunit.client.0.smithi077.stdout:7/103: write d4/d13/f17 [3766689,90395] 0 2024-04-25T02:08:43.061 INFO:tasks.workunit.client.0.smithi077.stdout:4/115: creat d0/d14/d21/f22 x:0 0 0 2024-04-25T02:08:43.061 INFO:tasks.workunit.client.0.smithi077.stdout:4/116: write d0/d14/f1c [1091276,119490] 0 2024-04-25T02:08:43.062 INFO:tasks.workunit.client.0.smithi077.stdout:7/104: symlink d4/l1d 0 2024-04-25T02:08:43.063 INFO:tasks.workunit.client.0.smithi077.stdout:4/117: mknod d0/c23 0 2024-04-25T02:08:43.064 INFO:tasks.workunit.client.0.smithi077.stdout:5/159: dwrite d0/fd [0,4194304] 0 2024-04-25T02:08:43.076 INFO:tasks.workunit.client.0.smithi077.stdout:8/198: dwrite d3/da/db/df/d2b/f3b [0,4194304] 0 2024-04-25T02:08:43.076 INFO:tasks.workunit.client.0.smithi077.stdout:0/140: dwrite d2/f6 [0,4194304] 0 2024-04-25T02:08:43.080 INFO:tasks.workunit.client.0.smithi077.stdout:0/141: getdents d2/d8 0 2024-04-25T02:08:43.081 INFO:tasks.workunit.client.0.smithi077.stdout:0/142: symlink d2/d17/d1d/l33 0 2024-04-25T02:08:43.081 INFO:tasks.workunit.client.0.smithi077.stdout:0/143: fdatasync d2/d17/d1d/f20 0 2024-04-25T02:08:43.081 INFO:tasks.workunit.client.0.smithi077.stdout:0/144: write d2/d8/f13 [2329788,23842] 0 2024-04-25T02:08:43.082 INFO:tasks.workunit.client.0.smithi077.stdout:0/145: stat d2/d27/d2d/f2f 0 2024-04-25T02:08:43.082 INFO:tasks.workunit.client.0.smithi077.stdout:0/146: truncate d2/d8/f13 2617231 0 2024-04-25T02:08:43.082 INFO:tasks.workunit.client.0.smithi077.stdout:0/147: mkdir d2/d17/d1d/d34 0 2024-04-25T02:08:43.084 INFO:tasks.workunit.client.0.smithi077.stdout:5/160: dread d0/fd [0,4194304] 0 2024-04-25T02:08:43.084 INFO:tasks.workunit.client.0.smithi077.stdout:5/161: chown d0/d2/d3/d9/f2a 15150 1 2024-04-25T02:08:43.084 INFO:tasks.workunit.client.0.smithi077.stdout:5/162: truncate d0/d2/d3/d1d/f33 434197 0 2024-04-25T02:08:43.084 INFO:tasks.workunit.client.0.smithi077.stdout:5/163: chown d0/d2/d3/f34 71 1 2024-04-25T02:08:43.084 INFO:tasks.workunit.client.0.smithi077.stdout:5/164: chown d0/d2/d3/d1d/f33 120179 1 2024-04-25T02:08:43.085 INFO:tasks.workunit.client.0.smithi077.stdout:5/165: creat d0/d25/f36 x:0 0 0 2024-04-25T02:08:43.089 INFO:tasks.workunit.client.0.smithi077.stdout:0/148: write d2/f6 [2994109,113528] 0 2024-04-25T02:08:43.089 INFO:tasks.workunit.client.0.smithi077.stdout:0/149: write d2/d17/d1d/f20 [1063684,50792] 0 2024-04-25T02:08:43.089 INFO:tasks.workunit.client.0.smithi077.stdout:0/150: dread - d2/d1c/f24 zero size 2024-04-25T02:08:43.091 INFO:tasks.workunit.client.0.smithi077.stdout:0/151: symlink d2/l35 0 2024-04-25T02:08:43.091 INFO:tasks.workunit.client.0.smithi077.stdout:0/152: truncate d2/d1c/f24 845738 0 2024-04-25T02:08:43.092 INFO:tasks.workunit.client.0.smithi077.stdout:8/199: write d3/f8 [347972,123450] 0 2024-04-25T02:08:43.093 INFO:tasks.workunit.client.0.smithi077.stdout:0/153: creat d2/d17/d1d/d34/f36 x:0 0 0 2024-04-25T02:08:43.093 INFO:tasks.workunit.client.0.smithi077.stdout:0/154: dread - d2/d27/f2b zero size 2024-04-25T02:08:43.093 INFO:tasks.workunit.client.0.smithi077.stdout:9/116: dwrite df/f12 [0,4194304] 0 2024-04-25T02:08:43.094 INFO:tasks.workunit.client.0.smithi077.stdout:7/105: fsync d4/fa 0 2024-04-25T02:08:43.094 INFO:tasks.workunit.client.0.smithi077.stdout:0/155: symlink d2/d27/d2d/l37 0 2024-04-25T02:08:43.094 INFO:tasks.workunit.client.0.smithi077.stdout:0/156: chown d2/l35 676553408 1 2024-04-25T02:08:43.094 INFO:tasks.workunit.client.0.smithi077.stdout:0/157: write d2/d17/d1d/f20 [4768069,18370] 0 2024-04-25T02:08:43.095 INFO:tasks.workunit.client.0.smithi077.stdout:2/163: dwrite d2/d9/d18/fa [0,4194304] 0 2024-04-25T02:08:43.096 INFO:tasks.workunit.client.0.smithi077.stdout:4/118: dwrite d0/f18 [0,4194304] 0 2024-04-25T02:08:43.097 INFO:tasks.workunit.client.0.smithi077.stdout:3/140: dwrite d0/d2/de/f1b [0,4194304] 0 2024-04-25T02:08:43.098 INFO:tasks.workunit.client.0.smithi077.stdout:3/141: read - d0/d7/f29 zero size 2024-04-25T02:08:43.098 INFO:tasks.workunit.client.0.smithi077.stdout:9/117: dread df/f1a [0,4194304] 0 2024-04-25T02:08:43.102 INFO:tasks.workunit.client.0.smithi077.stdout:0/158: mknod d2/d27/d2d/c38 0 2024-04-25T02:08:43.103 INFO:tasks.workunit.client.0.smithi077.stdout:5/166: write d0/d2/d3/d9/f2b [1713173,86005] 0 2024-04-25T02:08:43.111 INFO:tasks.workunit.client.0.smithi077.stdout:2/164: mknod d2/d9/d2f/c30 0 2024-04-25T02:08:43.112 INFO:tasks.workunit.client.0.smithi077.stdout:8/200: dwrite d3/fd [0,4194304] 0 2024-04-25T02:08:43.115 INFO:tasks.workunit.client.0.smithi077.stdout:4/119: symlink d0/d14/l24 0 2024-04-25T02:08:43.122 INFO:tasks.workunit.client.0.smithi077.stdout:3/142: rmdir d0/d7/d22/d2d 0 2024-04-25T02:08:43.122 INFO:tasks.workunit.client.0.smithi077.stdout:3/143: truncate d0/d7/d15/f2a 650431 0 2024-04-25T02:08:43.123 INFO:tasks.workunit.client.0.smithi077.stdout:9/118: symlink df/d1b/l24 0 2024-04-25T02:08:43.124 INFO:tasks.workunit.client.0.smithi077.stdout:0/159: link d2/c21 d2/d17/c39 0 2024-04-25T02:08:43.132 INFO:tasks.workunit.client.0.smithi077.stdout:2/165: truncate f0 2216693 0 2024-04-25T02:08:43.136 INFO:tasks.workunit.client.0.smithi077.stdout:8/201: mkdir d3/d34/d3d 0 2024-04-25T02:08:43.136 INFO:tasks.workunit.client.0.smithi077.stdout:4/120: getdents d0/d1/da 0 2024-04-25T02:08:43.137 INFO:tasks.workunit.client.0.smithi077.stdout:9/119: rename df/d1b/c1e to df/c25 0 2024-04-25T02:08:43.138 INFO:tasks.workunit.client.1.smithi112.stderr:++ readlink -f fsstress 2024-04-25T02:08:43.139 INFO:tasks.workunit.client.0.smithi077.stdout:0/160: mknod d2/d8/c3a 0 2024-04-25T02:08:43.139 INFO:tasks.workunit.client.1.smithi112.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-25T02:08:43.140 INFO:tasks.workunit.client.1.smithi112.stderr:+ popd 2024-04-25T02:08:43.140 INFO:tasks.workunit.client.1.smithi112.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-25T02:08:43.140 INFO:tasks.workunit.client.1.smithi112.stderr:+ popd 2024-04-25T02:08:43.140 INFO:tasks.workunit.client.1.smithi112.stdout:~/cephtest/mnt.1/client.1/tmp 2024-04-25T02:08:43.141 INFO:tasks.workunit.client.1.smithi112.stderr:++ mktemp -d -p . 2024-04-25T02:08:43.141 INFO:tasks.workunit.client.0.smithi077.stdout:5/167: mknod d0/d2/d3/d9/c37 0 2024-04-25T02:08:43.141 INFO:tasks.workunit.client.0.smithi077.stdout:5/168: fdatasync d0/d25/f30 0 2024-04-25T02:08:43.143 INFO:tasks.workunit.client.0.smithi077.stdout:3/144: dwrite d0/d2/f13 [4194304,4194304] 0 2024-04-25T02:08:43.143 INFO:tasks.workunit.client.0.smithi077.stdout:3/145: dread - d0/d7/d15/f25 zero size 2024-04-25T02:08:43.143 INFO:tasks.workunit.client.0.smithi077.stdout:8/202: mknod d3/c3e 0 2024-04-25T02:08:43.146 INFO:tasks.workunit.client.1.smithi112.stderr:+ T=./tmp.6sAGee91Vn 2024-04-25T02:08:43.146 INFO:tasks.workunit.client.1.smithi112.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.6sAGee91Vn -l 1 -n 1000 -p 10 -v 2024-04-25T02:08:43.147 INFO:tasks.workunit.client.0.smithi077.stdout:4/121: write d0/de/f11 [1639935,2701] 0 2024-04-25T02:08:43.148 INFO:tasks.workunit.client.0.smithi077.stdout:5/169: mkdir d0/d2/d1b/d38 0 2024-04-25T02:08:43.148 INFO:tasks.workunit.client.0.smithi077.stdout:5/170: dread - d0/d25/f36 zero size 2024-04-25T02:08:43.148 INFO:tasks.workunit.client.0.smithi077.stdout:5/171: fdatasync d0/d2/d1b/f26 0 2024-04-25T02:08:43.150 INFO:tasks.workunit.client.1.smithi112.stdout:seed = 1714130580 2024-04-25T02:08:43.152 INFO:tasks.workunit.client.0.smithi077.stdout:2/166: dread d2/f5 [0,4194304] 0 2024-04-25T02:08:43.152 INFO:tasks.workunit.client.0.smithi077.stdout:2/167: truncate d2/d9/d18/fa 4473470 0 2024-04-25T02:08:43.155 INFO:tasks.workunit.client.0.smithi077.stdout:3/146: rename d0/d7/d15/d24/l28 to d0/d2/de/l2e 0 2024-04-25T02:08:43.155 INFO:tasks.workunit.client.0.smithi077.stdout:0/161: dwrite d2/d27/d2d/f2f [0,4194304] 0 2024-04-25T02:08:43.155 INFO:tasks.workunit.client.0.smithi077.stdout:3/147: write d0/d7/d15/f25 [359382,105358] 0 2024-04-25T02:08:43.156 INFO:tasks.workunit.client.0.smithi077.stdout:8/203: creat d3/da/d27/f3f x:0 0 0 2024-04-25T02:08:43.159 INFO:tasks.workunit.client.0.smithi077.stdout:1/137: sync 2024-04-25T02:08:43.160 INFO:tasks.workunit.client.0.smithi077.stdout:9/120: rmdir df 39 2024-04-25T02:08:43.162 INFO:tasks.workunit.client.0.smithi077.stdout:4/122: mkdir d0/de/d25 0 2024-04-25T02:08:43.163 INFO:tasks.workunit.client.1.smithi112.stdout:0/0: mknod c0 0 2024-04-25T02:08:43.163 INFO:tasks.workunit.client.1.smithi112.stdout:0/1: dwrite - no filename 2024-04-25T02:08:43.163 INFO:tasks.workunit.client.1.smithi112.stdout:0/2: write - no filename 2024-04-25T02:08:43.167 INFO:tasks.workunit.client.0.smithi077.stdout:2/168: mkdir d2/d9/d18/d31 0 2024-04-25T02:08:43.167 INFO:tasks.workunit.client.1.smithi112.stdout:1/0: mknod c0 0 2024-04-25T02:08:43.168 INFO:tasks.workunit.client.0.smithi077.stdout:6/188: sync 2024-04-25T02:08:43.169 INFO:tasks.workunit.client.1.smithi112.stdout:0/3: creat f1 x:0 0 0 2024-04-25T02:08:43.169 INFO:tasks.workunit.client.1.smithi112.stdout:0/4: chown f1 68949 1 2024-04-25T02:08:43.171 INFO:tasks.workunit.client.1.smithi112.stdout:3/0: getdents . 0 2024-04-25T02:08:43.171 INFO:tasks.workunit.client.1.smithi112.stdout:3/1: truncate - no filename 2024-04-25T02:08:43.173 INFO:tasks.workunit.client.1.smithi112.stdout:2/0: creat f0 x:0 0 0 2024-04-25T02:08:43.175 INFO:tasks.workunit.client.1.smithi112.stdout:1/1: creat f1 x:0 0 0 2024-04-25T02:08:43.178 INFO:tasks.workunit.client.1.smithi112.stdout:0/5: unlink f1 0 2024-04-25T02:08:43.178 INFO:tasks.workunit.client.1.smithi112.stdout:0/6: dread - no filename 2024-04-25T02:08:43.178 INFO:tasks.workunit.client.1.smithi112.stdout:0/7: dwrite - no filename 2024-04-25T02:08:43.178 INFO:tasks.workunit.client.1.smithi112.stdout:0/8: readlink - no filename 2024-04-25T02:08:43.178 INFO:tasks.workunit.client.1.smithi112.stdout:0/9: chown c0 1 1 2024-04-25T02:08:43.178 INFO:tasks.workunit.client.1.smithi112.stdout:0/10: creat f2 x:0 0 0 2024-04-25T02:08:43.178 INFO:tasks.workunit.client.1.smithi112.stdout:0/11: rmdir - no directory 2024-04-25T02:08:43.178 INFO:tasks.workunit.client.1.smithi112.stdout:0/12: creat f3 x:0 0 0 2024-04-25T02:08:43.179 INFO:tasks.workunit.client.0.smithi077.stdout:0/162: rename d2/d9/ff to d2/d27/f3b 0 2024-04-25T02:08:43.179 INFO:tasks.workunit.client.1.smithi112.stdout:4/0: dread - no filename 2024-04-25T02:08:43.179 INFO:tasks.workunit.client.1.smithi112.stdout:4/1: write - no filename 2024-04-25T02:08:43.180 INFO:tasks.workunit.client.1.smithi112.stdout:4/2: dwrite - no filename 2024-04-25T02:08:43.180 INFO:tasks.workunit.client.1.smithi112.stdout:4/3: rmdir - no directory 2024-04-25T02:08:43.180 INFO:tasks.workunit.client.1.smithi112.stdout:4/4: truncate - no filename 2024-04-25T02:08:43.181 INFO:tasks.workunit.client.0.smithi077.stdout:8/204: creat d3/da/db/df/d30/f40 x:0 0 0 2024-04-25T02:08:43.181 INFO:tasks.workunit.client.0.smithi077.stdout:8/205: chown d3/d34 829627557 1 2024-04-25T02:08:43.181 INFO:tasks.workunit.client.1.smithi112.stdout:3/2: mknod c0 0 2024-04-25T02:08:43.182 INFO:tasks.workunit.client.0.smithi077.stdout:1/138: creat db/d26/f2f x:0 0 0 2024-04-25T02:08:43.183 INFO:tasks.workunit.client.1.smithi112.stdout:2/1: rename f0 to f1 0 2024-04-25T02:08:43.183 INFO:tasks.workunit.client.1.smithi112.stdout:2/2: dread - f1 zero size 2024-04-25T02:08:43.184 INFO:tasks.workunit.client.0.smithi077.stdout:9/121: creat df/f26 x:0 0 0 2024-04-25T02:08:43.184 INFO:tasks.workunit.client.0.smithi077.stdout:9/122: read fc [2893730,98147] 0 2024-04-25T02:08:43.184 INFO:tasks.workunit.client.0.smithi077.stdout:7/106: sync 2024-04-25T02:08:43.185 INFO:tasks.workunit.client.0.smithi077.stdout:7/107: fsync d4/f16 0 2024-04-25T02:08:43.185 INFO:tasks.workunit.client.1.smithi112.stdout:1/2: rename f1 to f2 0 2024-04-25T02:08:43.185 INFO:tasks.workunit.client.1.smithi112.stdout:1/3: chown c0 13603395 1 2024-04-25T02:08:43.187 INFO:tasks.workunit.client.0.smithi077.stdout:4/123: unlink d0/de/f11 0 2024-04-25T02:08:43.187 INFO:tasks.workunit.client.0.smithi077.stdout:4/124: creat d0/d14/d21/f26 x:0 0 0 2024-04-25T02:08:43.188 INFO:tasks.workunit.client.0.smithi077.stdout:5/172: mkdir d0/d2/d3/d9/d39 0 2024-04-25T02:08:43.189 INFO:tasks.workunit.client.0.smithi077.stdout:2/169: creat d2/d28/f32 x:0 0 0 2024-04-25T02:08:43.190 INFO:tasks.workunit.client.0.smithi077.stdout:6/189: mknod de/d12/d25/d38/c47 0 2024-04-25T02:08:43.192 INFO:tasks.workunit.client.0.smithi077.stdout:3/148: rename d0/d7/d15/d24 to d0/d2/d2f 0 2024-04-25T02:08:43.193 INFO:tasks.workunit.client.0.smithi077.stdout:3/149: chown d0/d17/f19 0 1 2024-04-25T02:08:43.193 INFO:tasks.workunit.client.1.smithi112.stdout:4/5: creat f0 x:0 0 0 2024-04-25T02:08:43.193 INFO:tasks.workunit.client.1.smithi112.stdout:4/6: chown f0 5830271 1 2024-04-25T02:08:43.193 INFO:tasks.workunit.client.1.smithi112.stdout:4/7: write f0 [503639,58379] 0 2024-04-25T02:08:43.194 INFO:tasks.workunit.client.0.smithi077.stdout:0/163: symlink d2/l3c 0 2024-04-25T02:08:43.194 INFO:tasks.workunit.client.0.smithi077.stdout:0/164: write d2/d27/f2b [973412,122917] 0 2024-04-25T02:08:43.194 INFO:tasks.workunit.client.0.smithi077.stdout:0/165: chown d2/d8/fe 92163 1 2024-04-25T02:08:43.195 INFO:tasks.workunit.client.0.smithi077.stdout:2/170: dread d2/f5 [0,4194304] 0 2024-04-25T02:08:43.195 INFO:tasks.workunit.client.0.smithi077.stdout:8/206: rmdir d3/da/d27/d16 39 2024-04-25T02:08:43.195 INFO:tasks.workunit.client.0.smithi077.stdout:8/207: write d3/f7 [2231133,6189] 0 2024-04-25T02:08:43.197 INFO:tasks.workunit.client.1.smithi112.stdout:2/3: mknod c2 0 2024-04-25T02:08:43.198 INFO:tasks.workunit.client.0.smithi077.stdout:9/123: mknod df/d1b/c27 0 2024-04-25T02:08:43.200 INFO:tasks.workunit.client.1.smithi112.stdout:1/4: rename c0 to c3 0 2024-04-25T02:08:43.200 INFO:tasks.workunit.client.1.smithi112.stdout:1/5: read - f2 zero size 2024-04-25T02:08:43.200 INFO:tasks.workunit.client.1.smithi112.stdout:1/6: creat f4 x:0 0 0 2024-04-25T02:08:43.200 INFO:tasks.workunit.client.1.smithi112.stdout:1/7: dread - f2 zero size 2024-04-25T02:08:43.204 INFO:tasks.workunit.client.0.smithi077.stdout:7/108: rename d4/d13/c19 to d4/d13/c1e 0 2024-04-25T02:08:43.204 INFO:tasks.workunit.client.0.smithi077.stdout:7/109: dread - d4/d13/f1b zero size 2024-04-25T02:08:43.206 INFO:tasks.workunit.client.1.smithi112.stdout:0/13: rename f3 to f4 0 2024-04-25T02:08:43.206 INFO:tasks.workunit.client.1.smithi112.stdout:0/14: stat f4 0 2024-04-25T02:08:43.206 INFO:tasks.workunit.client.1.smithi112.stdout:0/15: chown f2 699779 1 2024-04-25T02:08:43.210 INFO:tasks.workunit.client.1.smithi112.stdout:3/3: getdents . 0 2024-04-25T02:08:43.210 INFO:tasks.workunit.client.1.smithi112.stdout:3/4: truncate - no filename 2024-04-25T02:08:43.210 INFO:tasks.workunit.client.1.smithi112.stdout:3/5: write - no filename 2024-04-25T02:08:43.211 INFO:tasks.workunit.client.0.smithi077.stdout:4/125: getdents d0/d1/da/d12 0 2024-04-25T02:08:43.211 INFO:tasks.workunit.client.0.smithi077.stdout:4/126: chown d0/c23 38808516 1 2024-04-25T02:08:43.212 INFO:tasks.workunit.client.1.smithi112.stdout:5/0: creat f0 x:0 0 0 2024-04-25T02:08:43.212 INFO:tasks.workunit.client.1.smithi112.stdout:5/1: write f0 [741250,95845] 0 2024-04-25T02:08:43.215 INFO:tasks.workunit.client.0.smithi077.stdout:1/139: rename db/f2c to db/d11/f30 0 2024-04-25T02:08:43.215 INFO:tasks.workunit.client.0.smithi077.stdout:1/140: chown db 3874 1 2024-04-25T02:08:43.215 INFO:tasks.workunit.client.0.smithi077.stdout:1/141: chown db/d11/c2d 93 1 2024-04-25T02:08:43.216 INFO:tasks.workunit.client.1.smithi112.stdout:2/4: mkdir d3 0 2024-04-25T02:08:43.218 INFO:tasks.workunit.client.0.smithi077.stdout:0/166: creat d2/d17/d1d/f3d x:0 0 0 2024-04-25T02:08:43.221 INFO:tasks.workunit.client.0.smithi077.stdout:6/190: dwrite de/d12/f28 [4194304,4194304] 0 2024-04-25T02:08:43.222 INFO:tasks.workunit.client.0.smithi077.stdout:8/208: unlink d3/da/db/df/c13 0 2024-04-25T02:08:43.222 INFO:tasks.workunit.client.0.smithi077.stdout:8/209: read - d3/f2a zero size 2024-04-25T02:08:43.223 INFO:tasks.workunit.client.1.smithi112.stdout:7/0: write - no filename 2024-04-25T02:08:43.223 INFO:tasks.workunit.client.1.smithi112.stdout:7/1: fsync - no filename 2024-04-25T02:08:43.223 INFO:tasks.workunit.client.1.smithi112.stdout:7/2: rename - no filename 2024-04-25T02:08:43.224 INFO:tasks.workunit.client.1.smithi112.stdout:7/3: write - no filename 2024-04-25T02:08:43.224 INFO:tasks.workunit.client.1.smithi112.stdout:7/4: dwrite - no filename 2024-04-25T02:08:43.224 INFO:tasks.workunit.client.1.smithi112.stdout:7/5: chown . 26414877 1 2024-04-25T02:08:43.224 INFO:tasks.workunit.client.1.smithi112.stdout:7/6: link - no file 2024-04-25T02:08:43.224 INFO:tasks.workunit.client.1.smithi112.stdout:7/7: fdatasync - no filename 2024-04-25T02:08:43.224 INFO:tasks.workunit.client.1.smithi112.stdout:7/8: chown . 8 1 2024-04-25T02:08:43.225 INFO:tasks.workunit.client.0.smithi077.stdout:9/124: dwrite f5 [0,4194304] 0 2024-04-25T02:08:43.225 INFO:tasks.workunit.client.0.smithi077.stdout:5/173: dwrite d0/d2/d3/d9/f2a [0,4194304] 0 2024-04-25T02:08:43.225 INFO:tasks.workunit.client.0.smithi077.stdout:5/174: creat d0/d25/f3a x:0 0 0 2024-04-25T02:08:43.225 INFO:tasks.workunit.client.0.smithi077.stdout:7/110: stat d4/d13/c1c 0 2024-04-25T02:08:43.225 INFO:tasks.workunit.client.0.smithi077.stdout:7/111: getdents d4/d13/d18 0 2024-04-25T02:08:43.226 INFO:tasks.workunit.client.0.smithi077.stdout:9/125: write df/f14 [476783,15351] 0 2024-04-25T02:08:43.226 INFO:tasks.workunit.client.1.smithi112.stdout:1/8: dwrite f4 [0,4194304] 0 2024-04-25T02:08:43.227 INFO:tasks.workunit.client.1.smithi112.stdout:6/0: mkdir d0 0 2024-04-25T02:08:43.227 INFO:tasks.workunit.client.1.smithi112.stdout:6/1: truncate - no filename 2024-04-25T02:08:43.227 INFO:tasks.workunit.client.1.smithi112.stdout:6/2: fsync - no filename 2024-04-25T02:08:43.227 INFO:tasks.workunit.client.1.smithi112.stdout:6/3: dwrite - no filename 2024-04-25T02:08:43.227 INFO:tasks.workunit.client.1.smithi112.stdout:6/4: write - no filename 2024-04-25T02:08:43.231 INFO:tasks.workunit.client.1.smithi112.stdout:3/6: mknod c1 0 2024-04-25T02:08:43.231 INFO:tasks.workunit.client.1.smithi112.stdout:3/7: truncate - no filename 2024-04-25T02:08:43.231 INFO:tasks.workunit.client.1.smithi112.stdout:3/8: dread - no filename 2024-04-25T02:08:43.231 INFO:tasks.workunit.client.1.smithi112.stdout:3/9: rmdir - no directory 2024-04-25T02:08:43.234 INFO:tasks.workunit.client.0.smithi077.stdout:1/142: read db/df/d14/f1c [3520924,63026] 0 2024-04-25T02:08:43.235 INFO:tasks.workunit.client.0.smithi077.stdout:4/127: rename d0/d1/da/d12/l1b to d0/d1/da/df/l27 0 2024-04-25T02:08:43.237 INFO:tasks.workunit.client.1.smithi112.stdout:5/2: mkdir d1 0 2024-04-25T02:08:43.237 INFO:tasks.workunit.client.1.smithi112.stdout:5/3: getdents d1 0 2024-04-25T02:08:43.237 INFO:tasks.workunit.client.0.smithi077.stdout:8/210: dread d3/f8 [0,4194304] 0 2024-04-25T02:08:43.237 INFO:tasks.workunit.client.0.smithi077.stdout:8/211: readlink l2 0 2024-04-25T02:08:43.237 INFO:tasks.workunit.client.0.smithi077.stdout:8/212: chown d3/da/d27/d16/c2e 12565 1 2024-04-25T02:08:43.240 INFO:tasks.workunit.client.0.smithi077.stdout:0/167: unlink d2/d9/c32 0 2024-04-25T02:08:43.240 INFO:tasks.workunit.client.0.smithi077.stdout:0/168: dread - d2/d17/d1d/f3d zero size 2024-04-25T02:08:43.242 INFO:tasks.workunit.client.0.smithi077.stdout:7/112: dread d4/fe [0,4194304] 0 2024-04-25T02:08:43.242 INFO:tasks.workunit.client.0.smithi077.stdout:7/113: chown d4/d13/c1c 1261 1 2024-04-25T02:08:43.242 INFO:tasks.workunit.client.0.smithi077.stdout:7/114: creat d4/d13/f1f x:0 0 0 2024-04-25T02:08:43.243 INFO:tasks.workunit.client.1.smithi112.stdout:8/0: readlink - no filename 2024-04-25T02:08:43.243 INFO:tasks.workunit.client.1.smithi112.stdout:8/1: chown . 1 1 2024-04-25T02:08:43.243 INFO:tasks.workunit.client.1.smithi112.stdout:8/2: read - no filename 2024-04-25T02:08:43.246 INFO:tasks.workunit.client.0.smithi077.stdout:9/126: write f5 [715302,81631] 0 2024-04-25T02:08:43.248 INFO:tasks.workunit.client.1.smithi112.stdout:0/16: rename f4 to f5 0 2024-04-25T02:08:43.250 INFO:tasks.workunit.client.1.smithi112.stdout:7/9: mknod c0 0 2024-04-25T02:08:43.250 INFO:tasks.workunit.client.1.smithi112.stdout:7/10: write - no filename 2024-04-25T02:08:43.250 INFO:tasks.workunit.client.1.smithi112.stdout:7/11: dwrite - no filename 2024-04-25T02:08:43.264 INFO:tasks.workunit.client.0.smithi077.stdout:8/213: write d3/da/db/df/d30/f3c [3584300,77643] 0 2024-04-25T02:08:43.265 INFO:tasks.workunit.client.0.smithi077.stdout:6/191: fdatasync de/d12/d25/f29 0 2024-04-25T02:08:43.269 INFO:tasks.workunit.client.1.smithi112.stdout:6/5: creat d0/f1 x:0 0 0 2024-04-25T02:08:43.269 INFO:tasks.workunit.client.1.smithi112.stdout:6/6: dread - d0/f1 zero size 2024-04-25T02:08:43.269 INFO:tasks.workunit.client.1.smithi112.stdout:6/7: chown d0 38 1 2024-04-25T02:08:43.269 INFO:tasks.workunit.client.1.smithi112.stdout:6/8: readlink - no filename 2024-04-25T02:08:43.269 INFO:tasks.workunit.client.1.smithi112.stdout:6/9: write d0/f1 [96677,40878] 0 2024-04-25T02:08:43.271 INFO:tasks.workunit.client.1.smithi112.stdout:5/4: mkdir d1/d2 0 2024-04-25T02:08:43.274 INFO:tasks.workunit.client.1.smithi112.stdout:8/3: mknod c0 0 2024-04-25T02:08:43.274 INFO:tasks.workunit.client.1.smithi112.stdout:8/4: rmdir - no directory 2024-04-25T02:08:43.277 INFO:tasks.workunit.client.0.smithi077.stdout:5/175: mkdir d0/d2/d1b/d3b 0 2024-04-25T02:08:43.277 INFO:tasks.workunit.client.0.smithi077.stdout:5/176: chown d0/d2/d3/d9/d39 894145397 1 2024-04-25T02:08:43.278 INFO:tasks.workunit.client.0.smithi077.stdout:1/143: symlink db/d11/l31 0 2024-04-25T02:08:43.278 INFO:tasks.workunit.client.0.smithi077.stdout:1/144: truncate db/d11/f30 727977 0 2024-04-25T02:08:43.278 INFO:tasks.workunit.client.0.smithi077.stdout:1/145: fdatasync f8 0 2024-04-25T02:08:43.280 INFO:tasks.workunit.client.0.smithi077.stdout:4/128: link d0/d14/f1c d0/f28 0 2024-04-25T02:08:43.280 INFO:tasks.workunit.client.0.smithi077.stdout:4/129: chown d0/d1/l9 918065 1 2024-04-25T02:08:43.280 INFO:tasks.workunit.client.0.smithi077.stdout:4/130: write d0/d14/d21/f26 [144447,26259] 0 2024-04-25T02:08:43.281 INFO:tasks.workunit.client.0.smithi077.stdout:0/169: symlink d2/l3e 0 2024-04-25T02:08:43.281 INFO:tasks.workunit.client.0.smithi077.stdout:0/170: chown d2/d8/f26 32 1 2024-04-25T02:08:43.285 INFO:tasks.workunit.client.1.smithi112.stdout:6/10: mkdir d0/d2 0 2024-04-25T02:08:43.285 INFO:tasks.workunit.client.1.smithi112.stdout:8/5: creat f1 x:0 0 0 2024-04-25T02:08:43.286 INFO:tasks.workunit.client.0.smithi077.stdout:7/115: symlink d4/d13/d18/l20 0 2024-04-25T02:08:43.286 INFO:tasks.workunit.client.0.smithi077.stdout:2/171: dwrite d2/d9/fb [0,4194304] 0 2024-04-25T02:08:43.288 INFO:tasks.workunit.client.0.smithi077.stdout:9/127: mknod df/c28 0 2024-04-25T02:08:43.288 INFO:tasks.workunit.client.0.smithi077.stdout:9/128: read - df/f26 zero size 2024-04-25T02:08:43.289 INFO:tasks.workunit.client.0.smithi077.stdout:9/129: dread - df/d1b/f20 zero size 2024-04-25T02:08:43.289 INFO:tasks.workunit.client.0.smithi077.stdout:9/130: write df/d1b/f1f [5121015,86864] 0 2024-04-25T02:08:43.289 INFO:tasks.workunit.client.0.smithi077.stdout:9/131: creat df/f29 x:0 0 0 2024-04-25T02:08:43.289 INFO:tasks.workunit.client.0.smithi077.stdout:6/192: symlink de/d15/d36/l48 0 2024-04-25T02:08:43.290 INFO:tasks.workunit.client.0.smithi077.stdout:5/177: mkdir d0/d2/d3/d9/d39/d3c 0 2024-04-25T02:08:43.291 INFO:tasks.workunit.client.0.smithi077.stdout:1/146: mkdir db/d11/d32 0 2024-04-25T02:08:43.299 INFO:tasks.workunit.client.1.smithi112.stdout:2/5: dwrite f1 [0,4194304] 0 2024-04-25T02:08:43.320 INFO:tasks.workunit.client.0.smithi077.stdout:5/178: dread d0/d25/f1a [0,4194304] 0 2024-04-25T02:08:43.416 INFO:tasks.workunit.client.0.smithi077.stdout:9/132: unlink df/d1b/f1f 0 2024-04-25T02:08:43.421 INFO:tasks.workunit.client.0.smithi077.stdout:6/193: symlink de/d12/d25/d3a/l49 0 2024-04-25T02:08:43.423 INFO:tasks.workunit.client.0.smithi077.stdout:1/147: mkdir db/df/d14/d33 0 2024-04-25T02:08:43.425 INFO:tasks.workunit.client.0.smithi077.stdout:0/171: getdents d2/d1c 0 2024-04-25T02:08:43.429 INFO:tasks.workunit.client.0.smithi077.stdout:2/172: creat d2/d9/d19/d1c/f33 x:0 0 0 2024-04-25T02:08:43.429 INFO:tasks.workunit.client.0.smithi077.stdout:2/173: creat d2/d9/d19/f34 x:0 0 0 2024-04-25T02:08:43.437 INFO:tasks.workunit.client.1.smithi112.stdout:4/8: dwrite f0 [0,4194304] 0 2024-04-25T02:08:43.438 INFO:tasks.workunit.client.1.smithi112.stdout:2/6: creat d3/f4 x:0 0 0 2024-04-25T02:08:43.438 INFO:tasks.workunit.client.1.smithi112.stdout:2/7: fdatasync f1 0 2024-04-25T02:08:43.442 INFO:tasks.workunit.client.0.smithi077.stdout:6/194: write f7 [3996476,4634] 0 2024-04-25T02:08:43.447 INFO:tasks.workunit.client.0.smithi077.stdout:1/148: getdents db 0 2024-04-25T02:08:43.449 INFO:tasks.workunit.client.0.smithi077.stdout:0/172: getdents d2/d17/d1d 0 2024-04-25T02:08:43.451 INFO:tasks.workunit.client.0.smithi077.stdout:0/173: dread d2/d8/fe [0,4194304] 0 2024-04-25T02:08:43.458 INFO:tasks.workunit.client.0.smithi077.stdout:2/174: link d2/d9/df/l15 d2/d9/d2f/l35 0 2024-04-25T02:08:43.458 INFO:tasks.workunit.client.0.smithi077.stdout:2/175: write d2/d9/d18/f29 [816895,94229] 0 2024-04-25T02:08:43.463 INFO:tasks.workunit.client.0.smithi077.stdout:0/174: truncate d2/d8/f13 1357489 0 2024-04-25T02:08:43.463 INFO:tasks.workunit.client.0.smithi077.stdout:1/149: write db/df/d1b/f22 [3731922,10174] 0 2024-04-25T02:08:43.463 INFO:tasks.workunit.client.0.smithi077.stdout:0/175: creat d2/d17/d1d/d34/f3f x:0 0 0 2024-04-25T02:08:43.463 INFO:tasks.workunit.client.0.smithi077.stdout:0/176: chown d2/d8/fe 138241193 1 2024-04-25T02:08:43.463 INFO:tasks.workunit.client.0.smithi077.stdout:0/177: readlink d2/l7 0 2024-04-25T02:08:43.477 INFO:tasks.workunit.client.0.smithi077.stdout:0/178: creat d2/d17/d1d/f40 x:0 0 0 2024-04-25T02:08:43.477 INFO:tasks.workunit.client.0.smithi077.stdout:0/179: creat d2/d17/d1d/f41 x:0 0 0 2024-04-25T02:08:43.477 INFO:tasks.workunit.client.0.smithi077.stdout:0/180: chown d2/d1c/f24 61697236 1 2024-04-25T02:08:43.481 INFO:tasks.workunit.client.0.smithi077.stdout:2/176: rename d2/d9/f20 to d2/d9/d19/d2c/f36 0 2024-04-25T02:08:43.488 INFO:tasks.workunit.client.0.smithi077.stdout:2/177: rmdir d2/d28 39 2024-04-25T02:08:43.518 INFO:tasks.workunit.client.1.smithi112.stdout:4/9: mknod c1 0 2024-04-25T02:08:43.520 INFO:tasks.workunit.client.1.smithi112.stdout:2/8: mknod d3/c5 0 2024-04-25T02:08:43.520 INFO:tasks.workunit.client.1.smithi112.stdout:2/9: truncate d3/f4 15828 0 2024-04-25T02:08:43.520 INFO:tasks.workunit.client.1.smithi112.stdout:2/10: chown d3/c5 972023589 1 2024-04-25T02:08:43.530 INFO:tasks.workunit.client.1.smithi112.stdout:5/5: dread f0 [0,4194304] 0 2024-04-25T02:08:43.545 INFO:tasks.workunit.client.0.smithi077.stdout:4/131: fsync d0/d14/d21/f26 0 2024-04-25T02:08:43.554 INFO:tasks.workunit.client.0.smithi077.stdout:4/132: symlink d0/de/d25/l29 0 2024-04-25T02:08:43.555 INFO:tasks.workunit.client.0.smithi077.stdout:4/133: dread - d0/f20 zero size 2024-04-25T02:08:43.601 INFO:tasks.workunit.client.0.smithi077.stdout:9/133: dwrite df/f29 [0,4194304] 0 2024-04-25T02:08:43.608 INFO:tasks.workunit.client.0.smithi077.stdout:9/134: link l1 df/l2a 0 2024-04-25T02:08:43.612 INFO:tasks.workunit.client.0.smithi077.stdout:9/135: link l0 df/l2b 0 2024-04-25T02:08:43.617 INFO:tasks.workunit.client.1.smithi112.stdout:9/0: read - no filename 2024-04-25T02:08:43.617 INFO:tasks.workunit.client.1.smithi112.stdout:9/1: chown . 0 1 2024-04-25T02:08:43.685 INFO:tasks.workunit.client.0.smithi077.stdout:7/116: write d4/fe [2679033,19150] 0 2024-04-25T02:08:43.690 INFO:tasks.workunit.client.0.smithi077.stdout:7/117: link d4/f6 d4/f21 0 2024-04-25T02:08:43.693 INFO:tasks.workunit.client.0.smithi077.stdout:7/118: creat d4/d13/d18/f22 x:0 0 0 2024-04-25T02:08:43.697 INFO:tasks.workunit.client.0.smithi077.stdout:7/119: mknod d4/d13/d18/c23 0 2024-04-25T02:08:43.700 INFO:tasks.workunit.client.0.smithi077.stdout:7/120: mkdir d4/d13/d18/d24 0 2024-04-25T02:08:43.711 INFO:tasks.workunit.client.0.smithi077.stdout:9/136: fdatasync f5 0 2024-04-25T02:08:43.712 INFO:tasks.workunit.client.0.smithi077.stdout:9/137: dread - df/d1b/f22 zero size 2024-04-25T02:08:43.728 INFO:tasks.workunit.client.1.smithi112.stdout:0/17: getdents . 0 2024-04-25T02:08:43.729 INFO:tasks.workunit.client.1.smithi112.stdout:7/12: getdents . 0 2024-04-25T02:08:43.743 INFO:tasks.workunit.client.0.smithi077.stdout:9/138: dwrite fc [0,4194304] 0 2024-04-25T02:08:43.746 INFO:tasks.workunit.client.0.smithi077.stdout:9/139: symlink df/l2c 0 2024-04-25T02:08:43.746 INFO:tasks.workunit.client.0.smithi077.stdout:9/140: creat df/f2d x:0 0 0 2024-04-25T02:08:43.746 INFO:tasks.workunit.client.0.smithi077.stdout:9/141: fsync df/f1d 0 2024-04-25T02:08:43.751 INFO:tasks.workunit.client.0.smithi077.stdout:9/142: rename df/f1a to df/f2e 0 2024-04-25T02:08:43.751 INFO:tasks.workunit.client.0.smithi077.stdout:9/143: creat df/f2f x:0 0 0 2024-04-25T02:08:43.756 INFO:tasks.workunit.client.0.smithi077.stdout:9/144: creat df/d1b/f30 x:0 0 0 2024-04-25T02:08:43.758 INFO:tasks.workunit.client.0.smithi077.stdout:5/179: dwrite d0/d2/d3/f15 [0,4194304] 0 2024-04-25T02:08:43.758 INFO:tasks.workunit.client.0.smithi077.stdout:5/180: stat d0/d2/c16 0 2024-04-25T02:08:43.759 INFO:tasks.workunit.client.1.smithi112.stdout:0/18: dwrite f5 [0,4194304] 0 2024-04-25T02:08:43.765 INFO:tasks.workunit.client.0.smithi077.stdout:5/181: getdents d0/d2/d5 0 2024-04-25T02:08:43.774 INFO:tasks.workunit.client.0.smithi077.stdout:5/182: write d0/d2/ff [3561816,127853] 0 2024-04-25T02:08:43.778 INFO:tasks.workunit.client.1.smithi112.stdout:6/11: dread d0/f1 [0,4194304] 0 2024-04-25T02:08:43.780 INFO:tasks.workunit.client.1.smithi112.stdout:6/12: dread d0/f1 [0,4194304] 0 2024-04-25T02:08:43.797 INFO:tasks.workunit.client.1.smithi112.stdout:0/19: dwrite f5 [0,4194304] 0 2024-04-25T02:08:43.797 INFO:tasks.workunit.client.1.smithi112.stdout:0/20: readlink - no filename 2024-04-25T02:08:43.986 INFO:tasks.workunit.client.1.smithi112.stdout:0/21: dread f5 [0,4194304] 0 2024-04-25T02:08:43.986 INFO:tasks.workunit.client.1.smithi112.stdout:0/22: dread - f2 zero size 2024-04-25T02:08:43.992 INFO:tasks.workunit.client.1.smithi112.stdout:1/9: truncate f4 4184639 0 2024-04-25T02:08:43.992 INFO:tasks.workunit.client.1.smithi112.stdout:1/10: chown f2 0 1 2024-04-25T02:08:43.999 INFO:tasks.workunit.client.1.smithi112.stdout:6/13: dwrite d0/f1 [0,4194304] 0 2024-04-25T02:08:44.002 INFO:tasks.workunit.client.0.smithi077.stdout:9/145: dread df/f18 [0,4194304] 0 2024-04-25T02:08:44.002 INFO:tasks.workunit.client.0.smithi077.stdout:9/146: chown df/f10 1 1 2024-04-25T02:08:44.006 INFO:tasks.workunit.client.0.smithi077.stdout:9/147: read df/f2e [922008,29201] 0 2024-04-25T02:08:44.009 INFO:tasks.workunit.client.0.smithi077.stdout:9/148: dread df/f14 [0,4194304] 0 2024-04-25T02:08:44.009 INFO:tasks.workunit.client.0.smithi077.stdout:9/149: chown df/l2c 95 1 2024-04-25T02:08:44.016 INFO:tasks.workunit.client.0.smithi077.stdout:4/134: dwrite d0/d1/f6 [0,4194304] 0 2024-04-25T02:08:44.016 INFO:tasks.workunit.client.0.smithi077.stdout:4/135: creat d0/d14/d21/f2a x:0 0 0 2024-04-25T02:08:44.018 INFO:tasks.workunit.client.1.smithi112.stdout:4/10: mkdir d2 0 2024-04-25T02:08:44.018 INFO:tasks.workunit.client.1.smithi112.stdout:4/11: chown c1 850 1 2024-04-25T02:08:44.026 INFO:tasks.workunit.client.0.smithi077.stdout:4/136: creat d0/d1/da/df/f2b x:0 0 0 2024-04-25T02:08:44.026 INFO:tasks.workunit.client.0.smithi077.stdout:4/137: write d0/f7 [1386853,65333] 0 2024-04-25T02:08:44.032 INFO:tasks.workunit.client.0.smithi077.stdout:4/138: rename d0/f7 to d0/d1/d1d/f2c 0 2024-04-25T02:08:44.032 INFO:tasks.workunit.client.0.smithi077.stdout:4/139: write d0/d14/d21/f26 [1217154,78366] 0 2024-04-25T02:08:44.034 INFO:tasks.workunit.client.0.smithi077.stdout:3/150: sync 2024-04-25T02:08:44.037 INFO:tasks.workunit.client.0.smithi077.stdout:2/178: truncate d2/d9/fb 3588662 0 2024-04-25T02:08:44.041 INFO:tasks.workunit.client.0.smithi077.stdout:4/140: link d0/f16 d0/d1/da/f2d 0 2024-04-25T02:08:44.041 INFO:tasks.workunit.client.0.smithi077.stdout:4/141: fsync d0/f28 0 2024-04-25T02:08:44.041 INFO:tasks.workunit.client.0.smithi077.stdout:4/142: chown d0/d14/d21/f2a 830 1 2024-04-25T02:08:44.043 INFO:tasks.workunit.client.0.smithi077.stdout:3/151: rename d0/d7/d15/f25 to d0/d2/f30 0 2024-04-25T02:08:44.045 INFO:tasks.workunit.client.0.smithi077.stdout:2/179: mkdir d2/d9/d19/d1c/d37 0 2024-04-25T02:08:44.048 INFO:tasks.workunit.client.0.smithi077.stdout:3/152: dread d0/d2/f18 [0,4194304] 0 2024-04-25T02:08:44.048 INFO:tasks.workunit.client.0.smithi077.stdout:4/143: read d0/d1/da/f2d [2219769,10649] 0 2024-04-25T02:08:44.048 INFO:tasks.workunit.client.0.smithi077.stdout:4/144: dread - d0/d14/d21/f2a zero size 2024-04-25T02:08:44.051 INFO:tasks.workunit.client.1.smithi112.stdout:8/6: dwrite f1 [0,4194304] 0 2024-04-25T02:08:44.052 INFO:tasks.workunit.client.0.smithi077.stdout:7/121: dwrite d4/f6 [0,4194304] 0 2024-04-25T02:08:44.064 INFO:tasks.workunit.client.1.smithi112.stdout:2/11: mknod d3/c6 0 2024-04-25T02:08:44.068 INFO:tasks.workunit.client.0.smithi077.stdout:7/122: symlink d4/d13/l25 0 2024-04-25T02:08:44.070 INFO:tasks.workunit.client.0.smithi077.stdout:7/123: symlink d4/d13/l26 0 2024-04-25T02:08:44.074 INFO:tasks.workunit.client.0.smithi077.stdout:7/124: rename d4/l1a to d4/d13/d18/d24/l27 0 2024-04-25T02:08:44.074 INFO:tasks.workunit.client.0.smithi077.stdout:7/125: fsync d4/fb 0 2024-04-25T02:08:44.074 INFO:tasks.workunit.client.0.smithi077.stdout:3/153: dwrite d0/d17/f19 [0,4194304] 0 2024-04-25T02:08:44.074 INFO:tasks.workunit.client.0.smithi077.stdout:3/154: chown d0/d2/de 79493 1 2024-04-25T02:08:44.074 INFO:tasks.workunit.client.0.smithi077.stdout:4/145: dwrite d0/d1/da/fb [0,4194304] 0 2024-04-25T02:08:44.078 INFO:tasks.workunit.client.0.smithi077.stdout:3/155: mknod d0/d2/d2f/c31 0 2024-04-25T02:08:44.083 INFO:tasks.workunit.client.0.smithi077.stdout:4/146: mknod d0/de/c2e 0 2024-04-25T02:08:44.083 INFO:tasks.workunit.client.0.smithi077.stdout:4/147: dread - d0/de/f15 zero size 2024-04-25T02:08:44.084 INFO:tasks.workunit.client.0.smithi077.stdout:3/156: truncate d0/d2/de/f1b 1935018 0 2024-04-25T02:08:44.086 INFO:tasks.workunit.client.0.smithi077.stdout:4/148: link d0/d1/da/df/f2b d0/d14/d21/f2f 0 2024-04-25T02:08:44.086 INFO:tasks.workunit.client.0.smithi077.stdout:4/149: chown d0/d1/da/fb 5 1 2024-04-25T02:08:44.088 INFO:tasks.workunit.client.0.smithi077.stdout:3/157: creat d0/d2/d2f/f32 x:0 0 0 2024-04-25T02:08:44.094 INFO:tasks.workunit.client.0.smithi077.stdout:3/158: dread d0/f9 [0,4194304] 0 2024-04-25T02:08:44.113 INFO:tasks.workunit.client.0.smithi077.stdout:3/159: dwrite d0/d2/d2f/f32 [0,4194304] 0 2024-04-25T02:08:44.119 INFO:tasks.workunit.client.0.smithi077.stdout:3/160: unlink d0/d2/de/c11 0 2024-04-25T02:08:44.119 INFO:tasks.workunit.client.0.smithi077.stdout:3/161: readlink d0/d7/l6 0 2024-04-25T02:08:44.119 INFO:tasks.workunit.client.0.smithi077.stdout:3/162: fdatasync d0/d2/d2f/f32 0 2024-04-25T02:08:44.142 INFO:tasks.workunit.client.1.smithi112.stdout:5/6: mkdir d1/d3 0 2024-04-25T02:08:44.160 INFO:tasks.workunit.client.1.smithi112.stdout:5/7: dwrite f0 [0,4194304] 0 2024-04-25T02:08:44.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:43 smithi112 ceph-mon[33313]: pgmap v251: 65 pgs: 65 active+clean; 240 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 4.6 MiB/s rd, 13 MiB/s wr, 685 op/s 2024-04-25T02:08:44.281 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:43 smithi077 ceph-mon[26330]: pgmap v251: 65 pgs: 65 active+clean; 240 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 4.6 MiB/s rd, 13 MiB/s wr, 685 op/s 2024-04-25T02:08:44.471 INFO:tasks.workunit.client.0.smithi077.stdout:4/150: getdents d0 0 2024-04-25T02:08:44.489 INFO:tasks.workunit.client.0.smithi077.stdout:8/214: sync 2024-04-25T02:08:44.489 INFO:tasks.workunit.client.0.smithi077.stdout:0/181: sync 2024-04-25T02:08:44.489 INFO:tasks.workunit.client.0.smithi077.stdout:0/182: fsync d2/d17/d1d/f3d 0 2024-04-25T02:08:44.489 INFO:tasks.workunit.client.0.smithi077.stdout:1/150: sync 2024-04-25T02:08:44.489 INFO:tasks.workunit.client.0.smithi077.stdout:6/195: sync 2024-04-25T02:08:44.489 INFO:tasks.workunit.client.0.smithi077.stdout:6/196: fdatasync de/d12/f1c 0 2024-04-25T02:08:44.491 INFO:tasks.workunit.client.0.smithi077.stdout:0/183: dread d2/d27/f3b [0,4194304] 0 2024-04-25T02:08:44.491 INFO:tasks.workunit.client.0.smithi077.stdout:0/184: chown d2/l35 276245660 1 2024-04-25T02:08:44.492 INFO:tasks.workunit.client.0.smithi077.stdout:8/215: mknod d3/da/db/df/c41 0 2024-04-25T02:08:44.492 INFO:tasks.workunit.client.0.smithi077.stdout:5/183: sync 2024-04-25T02:08:44.492 INFO:tasks.workunit.client.0.smithi077.stdout:5/184: stat d0/d2/d3/d9/d39 0 2024-04-25T02:08:44.493 INFO:tasks.workunit.client.0.smithi077.stdout:6/197: creat de/d12/d25/f4a x:0 0 0 2024-04-25T02:08:44.496 INFO:tasks.workunit.client.0.smithi077.stdout:5/185: symlink d0/d2/d20/l3d 0 2024-04-25T02:08:44.497 INFO:tasks.workunit.client.0.smithi077.stdout:8/216: dread d3/da/db/df/d30/f3c [0,4194304] 0 2024-04-25T02:08:44.497 INFO:tasks.workunit.client.0.smithi077.stdout:8/217: dread - d3/da/db/df/d30/f40 zero size 2024-04-25T02:08:44.497 INFO:tasks.workunit.client.0.smithi077.stdout:8/218: readlink d3/da/d27/d16/l1a 0 2024-04-25T02:08:44.497 INFO:tasks.workunit.client.0.smithi077.stdout:8/219: write d3/f4 [2358884,7451] 0 2024-04-25T02:08:44.500 INFO:tasks.workunit.client.0.smithi077.stdout:8/220: creat d3/d34/d3d/f42 x:0 0 0 2024-04-25T02:08:44.501 INFO:tasks.workunit.client.0.smithi077.stdout:8/221: readlink d3/da/l14 0 2024-04-25T02:08:44.505 INFO:tasks.workunit.client.0.smithi077.stdout:8/222: mknod d3/da/db/df/c43 0 2024-04-25T02:08:44.505 INFO:tasks.workunit.client.0.smithi077.stdout:8/223: fdatasync d3/da/db/f28 0 2024-04-25T02:08:44.518 INFO:tasks.workunit.client.0.smithi077.stdout:0/185: dwrite d2/d8/f26 [0,4194304] 0 2024-04-25T02:08:44.519 INFO:tasks.workunit.client.0.smithi077.stdout:4/151: rename d0/d1/da/df to d0/d14/d30 0 2024-04-25T02:08:44.521 INFO:tasks.workunit.client.0.smithi077.stdout:0/186: symlink d2/d17/l42 0 2024-04-25T02:08:44.521 INFO:tasks.workunit.client.0.smithi077.stdout:0/187: fdatasync d2/d8/f26 0 2024-04-25T02:08:44.523 INFO:tasks.workunit.client.0.smithi077.stdout:9/150: sync 2024-04-25T02:08:44.523 INFO:tasks.workunit.client.0.smithi077.stdout:5/186: dwrite d0/d2/d3/d9/f2a [0,4194304] 0 2024-04-25T02:08:44.524 INFO:tasks.workunit.client.0.smithi077.stdout:1/151: dwrite db/f12 [0,4194304] 0 2024-04-25T02:08:44.525 INFO:tasks.workunit.client.0.smithi077.stdout:0/188: mknod d2/d27/c43 0 2024-04-25T02:08:44.525 INFO:tasks.workunit.client.0.smithi077.stdout:8/224: dwrite d3/fd [0,4194304] 0 2024-04-25T02:08:44.525 INFO:tasks.workunit.client.0.smithi077.stdout:4/152: dread d0/d14/f1c [0,4194304] 0 2024-04-25T02:08:44.531 INFO:tasks.workunit.client.0.smithi077.stdout:3/163: dread d0/d2/de/f1b [0,4194304] 0 2024-04-25T02:08:44.535 INFO:tasks.workunit.client.0.smithi077.stdout:1/152: mkdir db/df/d14/d33/d34 0 2024-04-25T02:08:44.538 INFO:tasks.workunit.client.0.smithi077.stdout:3/164: mknod d0/d2/de/d27/c33 0 2024-04-25T02:08:44.541 INFO:tasks.workunit.client.0.smithi077.stdout:1/153: symlink db/l35 0 2024-04-25T02:08:44.541 INFO:tasks.workunit.client.0.smithi077.stdout:1/154: write db/df/d1b/f22 [2268535,88849] 0 2024-04-25T02:08:44.541 INFO:tasks.workunit.client.0.smithi077.stdout:1/155: readlink db/df/d1b/l2a 0 2024-04-25T02:08:44.544 INFO:tasks.workunit.client.0.smithi077.stdout:3/165: creat d0/d2/f34 x:0 0 0 2024-04-25T02:08:44.544 INFO:tasks.workunit.client.0.smithi077.stdout:3/166: creat d0/d2/f35 x:0 0 0 2024-04-25T02:08:44.545 INFO:tasks.workunit.client.0.smithi077.stdout:3/167: write d0/d2/f34 [610451,102898] 0 2024-04-25T02:08:44.545 INFO:tasks.workunit.client.0.smithi077.stdout:3/168: chown d0/d2/f35 52 1 2024-04-25T02:08:44.546 INFO:tasks.workunit.client.0.smithi077.stdout:5/187: write d0/d2/d3/f2f [1101672,95930] 0 2024-04-25T02:08:44.547 INFO:tasks.workunit.client.0.smithi077.stdout:8/225: write d3/da/db/df/f10 [386111,12431] 0 2024-04-25T02:08:44.547 INFO:tasks.workunit.client.0.smithi077.stdout:8/226: readlink l0 0 2024-04-25T02:08:44.548 INFO:tasks.workunit.client.0.smithi077.stdout:1/156: unlink db/ce 0 2024-04-25T02:08:44.552 INFO:tasks.workunit.client.0.smithi077.stdout:3/169: dread d0/f9 [4194304,4194304] 0 2024-04-25T02:08:44.552 INFO:tasks.workunit.client.0.smithi077.stdout:8/227: mkdir d3/da/d27/d44 0 2024-04-25T02:08:44.552 INFO:tasks.workunit.client.0.smithi077.stdout:3/170: dread - d0/d7/d15/f2b zero size 2024-04-25T02:08:44.554 INFO:tasks.workunit.client.0.smithi077.stdout:1/157: creat db/df/d14/d33/d34/f36 x:0 0 0 2024-04-25T02:08:44.554 INFO:tasks.workunit.client.0.smithi077.stdout:5/188: write d0/d2/d3/d9/f2a [2657933,106183] 0 2024-04-25T02:08:44.555 INFO:tasks.workunit.client.0.smithi077.stdout:1/158: dread db/fd [0,4194304] 0 2024-04-25T02:08:44.556 INFO:tasks.workunit.client.0.smithi077.stdout:3/171: rename d0/d7/d22 to d0/d2/de/d36 0 2024-04-25T02:08:44.558 INFO:tasks.workunit.client.0.smithi077.stdout:8/228: creat d3/da/f45 x:0 0 0 2024-04-25T02:08:44.560 INFO:tasks.workunit.client.0.smithi077.stdout:3/172: rename d0/d2/f13 to d0/d17/f37 0 2024-04-25T02:08:44.560 INFO:tasks.workunit.client.0.smithi077.stdout:3/173: write d0/d2/f35 [549296,102307] 0 2024-04-25T02:08:44.560 INFO:tasks.workunit.client.0.smithi077.stdout:3/174: creat d0/d7/d15/f38 x:0 0 0 2024-04-25T02:08:44.560 INFO:tasks.workunit.client.0.smithi077.stdout:7/126: sync 2024-04-25T02:08:44.560 INFO:tasks.workunit.client.0.smithi077.stdout:2/180: sync 2024-04-25T02:08:44.563 INFO:tasks.workunit.client.0.smithi077.stdout:9/151: dwrite df/f12 [0,4194304] 0 2024-04-25T02:08:44.563 INFO:tasks.workunit.client.0.smithi077.stdout:9/152: stat df/f26 0 2024-04-25T02:08:44.564 INFO:tasks.workunit.client.0.smithi077.stdout:9/153: write df/f14 [257436,38142] 0 2024-04-25T02:08:44.564 INFO:tasks.workunit.client.0.smithi077.stdout:0/189: dwrite d2/d17/d1d/f41 [0,4194304] 0 2024-04-25T02:08:44.566 INFO:tasks.workunit.client.0.smithi077.stdout:4/153: dwrite d0/d14/d21/f22 [0,4194304] 0 2024-04-25T02:08:44.569 INFO:tasks.workunit.client.0.smithi077.stdout:2/181: readlink d2/d9/l21 0 2024-04-25T02:08:44.570 INFO:tasks.workunit.client.0.smithi077.stdout:7/127: mkdir d4/d13/d18/d28 0 2024-04-25T02:08:44.571 INFO:tasks.workunit.client.0.smithi077.stdout:5/189: write d0/d2/d1b/f26 [1381803,37636] 0 2024-04-25T02:08:44.572 INFO:tasks.workunit.client.0.smithi077.stdout:9/154: write df/f18 [798518,97266] 0 2024-04-25T02:08:44.572 INFO:tasks.workunit.client.0.smithi077.stdout:9/155: creat df/f31 x:0 0 0 2024-04-25T02:08:44.572 INFO:tasks.workunit.client.0.smithi077.stdout:9/156: dread - df/f26 zero size 2024-04-25T02:08:44.575 INFO:tasks.workunit.client.0.smithi077.stdout:1/159: write db/df/f20 [2203425,120137] 0 2024-04-25T02:08:44.576 INFO:tasks.workunit.client.0.smithi077.stdout:1/160: chown db/d11/f30 676 1 2024-04-25T02:08:44.576 INFO:tasks.workunit.client.0.smithi077.stdout:1/161: readlink l6 0 2024-04-25T02:08:44.576 INFO:tasks.workunit.client.0.smithi077.stdout:1/162: write db/d11/f15 [5025810,18346] 0 2024-04-25T02:08:44.580 INFO:tasks.workunit.client.0.smithi077.stdout:5/190: write d0/d2/d3/f15 [2649416,63434] 0 2024-04-25T02:08:44.584 INFO:tasks.workunit.client.0.smithi077.stdout:0/190: rmdir d2/d8 39 2024-04-25T02:08:44.591 INFO:tasks.workunit.client.0.smithi077.stdout:0/191: write d2/d8/d10/f18 [2886828,83937] 0 2024-04-25T02:08:44.591 INFO:tasks.workunit.client.0.smithi077.stdout:0/192: truncate d2/d17/d1d/f41 5165593 0 2024-04-25T02:08:44.591 INFO:tasks.workunit.client.0.smithi077.stdout:0/193: write d2/d17/d1d/f3d [84237,108571] 0 2024-04-25T02:08:44.596 INFO:tasks.workunit.client.0.smithi077.stdout:0/194: dread d2/d8/d10/f18 [0,4194304] 0 2024-04-25T02:08:44.596 INFO:tasks.workunit.client.0.smithi077.stdout:0/195: write d2/d8/f26 [3306976,3661] 0 2024-04-25T02:08:44.596 INFO:tasks.workunit.client.0.smithi077.stdout:0/196: chown d2/l3e 489 1 2024-04-25T02:08:44.603 INFO:tasks.workunit.client.0.smithi077.stdout:4/154: unlink d0/d1/f6 0 2024-04-25T02:08:44.605 INFO:tasks.workunit.client.0.smithi077.stdout:3/175: mkdir d0/d39 0 2024-04-25T02:08:44.607 INFO:tasks.workunit.client.0.smithi077.stdout:2/182: creat d2/d9/d2f/f38 x:0 0 0 2024-04-25T02:08:44.608 INFO:tasks.workunit.client.0.smithi077.stdout:2/183: chown d2/d9/d18/d1b/c26 0 1 2024-04-25T02:08:44.611 INFO:tasks.workunit.client.0.smithi077.stdout:7/128: rename d4/d13/f1b to d4/d13/d18/f29 0 2024-04-25T02:08:44.616 INFO:tasks.workunit.client.0.smithi077.stdout:9/157: mknod df/c32 0 2024-04-25T02:08:44.622 INFO:tasks.workunit.client.0.smithi077.stdout:3/176: dwrite d0/d2/de/f1b [0,4194304] 0 2024-04-25T02:08:44.625 INFO:tasks.workunit.client.0.smithi077.stdout:5/191: mkdir d0/d2/d3/d1d/d3e 0 2024-04-25T02:08:44.625 INFO:tasks.workunit.client.0.smithi077.stdout:5/192: creat d0/d2/d20/f3f x:0 0 0 2024-04-25T02:08:44.625 INFO:tasks.workunit.client.0.smithi077.stdout:5/193: readlink d0/d2/d3/d9/l18 0 2024-04-25T02:08:44.626 INFO:tasks.workunit.client.0.smithi077.stdout:0/197: symlink d2/d17/d1d/d34/l44 0 2024-04-25T02:08:44.626 INFO:tasks.workunit.client.0.smithi077.stdout:0/198: fdatasync d2/d27/f3b 0 2024-04-25T02:08:44.626 INFO:tasks.workunit.client.0.smithi077.stdout:0/199: readlink d2/l31 0 2024-04-25T02:08:44.627 INFO:tasks.workunit.client.0.smithi077.stdout:0/200: fdatasync d2/d17/d1d/f41 0 2024-04-25T02:08:44.627 INFO:tasks.workunit.client.0.smithi077.stdout:4/155: creat d0/de/d25/f31 x:0 0 0 2024-04-25T02:08:44.627 INFO:tasks.workunit.client.0.smithi077.stdout:4/156: write d0/d1/f2 [358593,99223] 0 2024-04-25T02:08:44.630 INFO:tasks.workunit.client.0.smithi077.stdout:2/184: unlink d2/d9/df/l22 0 2024-04-25T02:08:44.632 INFO:tasks.workunit.client.0.smithi077.stdout:1/163: rename db/df/d1b/l2a to db/df/d14/d33/l37 0 2024-04-25T02:08:44.639 INFO:tasks.workunit.client.0.smithi077.stdout:3/177: symlink d0/d39/l3a 0 2024-04-25T02:08:44.646 INFO:tasks.workunit.client.0.smithi077.stdout:5/194: dwrite d0/d2/d20/f3f [0,4194304] 0 2024-04-25T02:08:44.647 INFO:tasks.workunit.client.0.smithi077.stdout:0/201: unlink d2/d17/d1d/f41 0 2024-04-25T02:08:44.651 INFO:tasks.workunit.client.0.smithi077.stdout:4/157: unlink d0/d14/l17 0 2024-04-25T02:08:44.652 INFO:tasks.workunit.client.0.smithi077.stdout:4/158: write d0/d14/d21/f26 [342468,121414] 0 2024-04-25T02:08:44.652 INFO:tasks.workunit.client.0.smithi077.stdout:4/159: creat d0/d14/d21/f32 x:0 0 0 2024-04-25T02:08:44.654 INFO:tasks.workunit.client.0.smithi077.stdout:2/185: creat d2/d9/d18/d31/f39 x:0 0 0 2024-04-25T02:08:44.657 INFO:tasks.workunit.client.0.smithi077.stdout:7/129: rename d4/f5 to d4/d13/d18/d28/f2a 0 2024-04-25T02:08:44.660 INFO:tasks.workunit.client.0.smithi077.stdout:1/164: creat db/df/d14/d33/f38 x:0 0 0 2024-04-25T02:08:44.662 INFO:tasks.workunit.client.0.smithi077.stdout:3/178: rmdir d0/d39 39 2024-04-25T02:08:44.667 INFO:tasks.workunit.client.0.smithi077.stdout:0/202: dwrite d2/d27/f2b [0,4194304] 0 2024-04-25T02:08:44.667 INFO:tasks.workunit.client.0.smithi077.stdout:0/203: stat d2/d27/f3b 0 2024-04-25T02:08:44.668 INFO:tasks.workunit.client.0.smithi077.stdout:5/195: symlink d0/d2/d1b/d3b/l40 0 2024-04-25T02:08:44.674 INFO:tasks.workunit.client.0.smithi077.stdout:4/160: truncate d0/f16 1276984 0 2024-04-25T02:08:44.676 INFO:tasks.workunit.client.0.smithi077.stdout:2/186: symlink d2/d9/d18/d1b/l3a 0 2024-04-25T02:08:44.676 INFO:tasks.workunit.client.0.smithi077.stdout:2/187: creat d2/d9/d19/f3b x:0 0 0 2024-04-25T02:08:44.676 INFO:tasks.workunit.client.0.smithi077.stdout:2/188: stat d2/d9/d18/fa 0 2024-04-25T02:08:44.676 INFO:tasks.workunit.client.0.smithi077.stdout:2/189: chown d2/d9/d18/d1b 6485243 1 2024-04-25T02:08:44.685 INFO:tasks.workunit.client.0.smithi077.stdout:1/165: dwrite db/f12 [0,4194304] 0 2024-04-25T02:08:44.685 INFO:tasks.workunit.client.0.smithi077.stdout:5/196: dwrite d0/d2/d20/f21 [0,4194304] 0 2024-04-25T02:08:44.686 INFO:tasks.workunit.client.0.smithi077.stdout:0/204: creat d2/d8/d10/f45 x:0 0 0 2024-04-25T02:08:44.688 INFO:tasks.workunit.client.0.smithi077.stdout:4/161: creat d0/d14/f33 x:0 0 0 2024-04-25T02:08:44.688 INFO:tasks.workunit.client.0.smithi077.stdout:4/162: fsync d0/f28 0 2024-04-25T02:08:44.692 INFO:tasks.workunit.client.0.smithi077.stdout:2/190: mknod d2/d28/c3c 0 2024-04-25T02:08:44.692 INFO:tasks.workunit.client.0.smithi077.stdout:0/205: dread d2/d8/f26 [0,4194304] 0 2024-04-25T02:08:44.692 INFO:tasks.workunit.client.0.smithi077.stdout:0/206: stat d2/d27/d2d 0 2024-04-25T02:08:44.696 INFO:tasks.workunit.client.1.smithi112.stdout:9/2: creat f0 x:0 0 0 2024-04-25T02:08:44.697 INFO:tasks.workunit.client.0.smithi077.stdout:4/163: mkdir d0/de/d34 0 2024-04-25T02:08:44.697 INFO:tasks.workunit.client.0.smithi077.stdout:4/164: write d0/d14/d21/f2a [773643,125754] 0 2024-04-25T02:08:44.699 INFO:tasks.workunit.client.0.smithi077.stdout:1/166: dwrite db/fd [0,4194304] 0 2024-04-25T02:08:44.700 INFO:tasks.workunit.client.0.smithi077.stdout:2/191: symlink d2/d9/d18/l3d 0 2024-04-25T02:08:44.701 INFO:tasks.workunit.client.0.smithi077.stdout:2/192: fdatasync d2/d9/d19/f23 0 2024-04-25T02:08:44.706 INFO:tasks.workunit.client.0.smithi077.stdout:1/167: creat db/d11/f39 x:0 0 0 2024-04-25T02:08:44.712 INFO:tasks.workunit.client.0.smithi077.stdout:1/168: getdents db/df 0 2024-04-25T02:08:44.714 INFO:tasks.workunit.client.0.smithi077.stdout:2/193: dwrite d2/d28/f32 [0,4194304] 0 2024-04-25T02:08:45.012 INFO:tasks.workunit.client.0.smithi077.stdout:1/169: truncate db/df/d1b/f22 3543866 0 2024-04-25T02:08:45.019 INFO:tasks.workunit.client.0.smithi077.stdout:1/170: symlink db/d11/d32/l3a 0 2024-04-25T02:08:45.032 INFO:tasks.workunit.client.0.smithi077.stdout:3/179: creat d0/d7/f3b x:0 0 0 2024-04-25T02:08:45.033 INFO:tasks.workunit.client.0.smithi077.stdout:3/180: fdatasync d0/f23 0 2024-04-25T02:08:45.036 INFO:tasks.workunit.client.0.smithi077.stdout:8/229: rmdir d3/da 39 2024-04-25T02:08:45.039 INFO:tasks.workunit.client.0.smithi077.stdout:1/171: rmdir db/df/d14/d33/d34 39 2024-04-25T02:08:45.041 INFO:tasks.workunit.client.0.smithi077.stdout:8/230: mknod d3/da/c46 0 2024-04-25T02:08:45.044 INFO:tasks.workunit.client.0.smithi077.stdout:8/231: creat d3/da/d27/f47 x:0 0 0 2024-04-25T02:08:45.044 INFO:tasks.workunit.client.0.smithi077.stdout:8/232: write d3/f8 [3075747,4572] 0 2024-04-25T02:08:45.044 INFO:tasks.workunit.client.0.smithi077.stdout:8/233: read - d3/da/f35 zero size 2024-04-25T02:08:45.046 INFO:tasks.workunit.client.0.smithi077.stdout:8/234: link d3/da/db/df/d2b/f1d d3/d34/f48 0 2024-04-25T02:08:45.048 INFO:tasks.workunit.client.0.smithi077.stdout:8/235: rmdir d3/da/db 39 2024-04-25T02:08:45.048 INFO:tasks.workunit.client.0.smithi077.stdout:8/236: write d3/da/d27/f47 [370514,69520] 0 2024-04-25T02:08:45.061 INFO:tasks.workunit.client.0.smithi077.stdout:1/172: dwrite db/df/f1d [0,4194304] 0 2024-04-25T02:08:45.064 INFO:tasks.workunit.client.0.smithi077.stdout:1/173: unlink db/d11/l31 0 2024-04-25T02:08:45.065 INFO:tasks.workunit.client.0.smithi077.stdout:6/198: sync 2024-04-25T02:08:45.065 INFO:tasks.workunit.client.0.smithi077.stdout:6/199: dread - de/d12/d25/f29 zero size 2024-04-25T02:08:45.070 INFO:tasks.workunit.client.0.smithi077.stdout:6/200: mkdir de/d12/d25/d4b 0 2024-04-25T02:08:45.070 INFO:tasks.workunit.client.0.smithi077.stdout:6/201: truncate de/d12/f28 9363278 0 2024-04-25T02:08:45.070 INFO:tasks.workunit.client.0.smithi077.stdout:6/202: chown de/d12/f2a 750570 1 2024-04-25T02:08:45.075 INFO:tasks.workunit.client.0.smithi077.stdout:7/130: rename d4/d13/d18/f29 to d4/d13/d18/d28/f2b 0 2024-04-25T02:08:45.075 INFO:tasks.workunit.client.0.smithi077.stdout:7/131: truncate d4/d13/d18/d28/f2b 398849 0 2024-04-25T02:08:45.075 INFO:tasks.workunit.client.0.smithi077.stdout:7/132: chown d4/d13/d18/d24 6 1 2024-04-25T02:08:45.078 INFO:tasks.workunit.client.0.smithi077.stdout:0/207: rename d2/c21 to d2/d9/d2a/c46 0 2024-04-25T02:08:45.082 INFO:tasks.workunit.client.0.smithi077.stdout:8/237: rename l2 to d3/da/db/df/l49 0 2024-04-25T02:08:45.084 INFO:tasks.workunit.client.0.smithi077.stdout:0/208: mknod d2/d17/d1d/c47 0 2024-04-25T02:08:45.084 INFO:tasks.workunit.client.0.smithi077.stdout:0/209: chown d2/d17/d1d/c47 180413017 1 2024-04-25T02:08:45.105 INFO:tasks.workunit.client.0.smithi077.stdout:6/203: dwrite de/d12/f28 [4194304,4194304] 0 2024-04-25T02:08:45.105 INFO:tasks.workunit.client.0.smithi077.stdout:7/133: dwrite d4/d13/d18/f22 [0,4194304] 0 2024-04-25T02:08:45.105 INFO:tasks.workunit.client.0.smithi077.stdout:8/238: dwrite d3/da/d27/f21 [0,4194304] 0 2024-04-25T02:08:45.105 INFO:tasks.workunit.client.0.smithi077.stdout:6/204: dread de/d12/f30 [0,4194304] 0 2024-04-25T02:08:45.110 INFO:tasks.workunit.client.0.smithi077.stdout:8/239: dread d3/f7 [0,4194304] 0 2024-04-25T02:08:45.114 INFO:tasks.workunit.client.0.smithi077.stdout:7/134: write d4/f6 [3127812,45937] 0 2024-04-25T02:08:45.117 INFO:tasks.workunit.client.0.smithi077.stdout:6/205: link de/d12/d25/d3a/l49 de/d12/d25/d38/l4c 0 2024-04-25T02:08:45.118 INFO:tasks.workunit.client.0.smithi077.stdout:8/240: dread d3/f4 [0,4194304] 0 2024-04-25T02:08:45.118 INFO:tasks.workunit.client.0.smithi077.stdout:8/241: truncate d3/da/d27/f1e 908256 0 2024-04-25T02:08:45.120 INFO:tasks.workunit.client.0.smithi077.stdout:7/135: truncate d4/fa 2856846 0 2024-04-25T02:08:45.123 INFO:tasks.workunit.client.0.smithi077.stdout:6/206: mknod de/d15/d36/c4d 0 2024-04-25T02:08:45.123 INFO:tasks.workunit.client.0.smithi077.stdout:6/207: write de/d12/d25/f29 [798160,87409] 0 2024-04-25T02:08:45.126 INFO:tasks.workunit.client.0.smithi077.stdout:8/242: link d3/da/l14 d3/d34/d3d/l4a 0 2024-04-25T02:08:45.128 INFO:tasks.workunit.client.0.smithi077.stdout:6/208: write f5 [1118080,31135] 0 2024-04-25T02:08:45.128 INFO:tasks.workunit.client.0.smithi077.stdout:6/209: write de/d15/f22 [2261701,113391] 0 2024-04-25T02:08:45.134 INFO:tasks.workunit.client.0.smithi077.stdout:6/210: write f0 [507636,41292] 0 2024-04-25T02:08:45.134 INFO:tasks.workunit.client.0.smithi077.stdout:6/211: write de/d12/d25/f2d [162908,110104] 0 2024-04-25T02:08:45.139 INFO:tasks.workunit.client.0.smithi077.stdout:8/243: symlink d3/da/l4b 0 2024-04-25T02:08:45.141 INFO:tasks.workunit.client.0.smithi077.stdout:6/212: mkdir de/d4e 0 2024-04-25T02:08:45.143 INFO:tasks.workunit.client.0.smithi077.stdout:8/244: rename d3/da/db/f20 to d3/da/db/f4c 0 2024-04-25T02:08:45.143 INFO:tasks.workunit.client.0.smithi077.stdout:8/245: chown d3/d34/d3d/l4a 1601350 1 2024-04-25T02:08:45.153 INFO:tasks.workunit.client.0.smithi077.stdout:6/213: dread de/d15/f22 [0,4194304] 0 2024-04-25T02:08:45.153 INFO:tasks.workunit.client.0.smithi077.stdout:6/214: write de/d15/f22 [1985299,85281] 0 2024-04-25T02:08:45.158 INFO:tasks.workunit.client.0.smithi077.stdout:2/194: rmdir d2/d9/d18 39 2024-04-25T02:08:45.158 INFO:tasks.workunit.client.0.smithi077.stdout:2/195: readlink d2/d9/d2f/l35 0 2024-04-25T02:08:45.162 INFO:tasks.workunit.client.0.smithi077.stdout:2/196: symlink d2/d28/l3e 0 2024-04-25T02:08:45.164 INFO:tasks.workunit.client.0.smithi077.stdout:2/197: mkdir d2/d9/d19/d1c/d3f 0 2024-04-25T02:08:45.164 INFO:tasks.workunit.client.0.smithi077.stdout:2/198: chown d2/d9/d19/d1c/d37 3678 1 2024-04-25T02:08:45.167 INFO:tasks.workunit.client.0.smithi077.stdout:2/199: creat d2/d9/d19/d1c/d3f/f40 x:0 0 0 2024-04-25T02:08:45.168 INFO:tasks.workunit.client.0.smithi077.stdout:2/200: chown d2/d9/d19/d1c 28964 1 2024-04-25T02:08:45.169 INFO:tasks.workunit.client.0.smithi077.stdout:6/215: dwrite de/d12/f17 [0,4194304] 0 2024-04-25T02:08:45.170 INFO:tasks.workunit.client.0.smithi077.stdout:2/201: getdents d2/d9/d18/d1b 0 2024-04-25T02:08:45.170 INFO:tasks.workunit.client.0.smithi077.stdout:2/202: truncate d2/fd 4830479 0 2024-04-25T02:08:45.186 INFO:tasks.workunit.client.0.smithi077.stdout:6/216: dwrite de/d12/f28 [0,4194304] 0 2024-04-25T02:08:45.192 INFO:tasks.workunit.client.0.smithi077.stdout:6/217: symlink de/d15/d36/l4f 0 2024-04-25T02:08:45.192 INFO:tasks.workunit.client.0.smithi077.stdout:6/218: fsync de/d12/f2a 0 2024-04-25T02:08:45.283 INFO:tasks.workunit.client.1.smithi112.stdout:0/23: rename c0 to c6 0 2024-04-25T02:08:45.283 INFO:tasks.workunit.client.1.smithi112.stdout:0/24: stat f2 0 2024-04-25T02:08:45.283 INFO:tasks.workunit.client.1.smithi112.stdout:0/25: chown c6 41220868 1 2024-04-25T02:08:45.283 INFO:tasks.workunit.client.1.smithi112.stdout:0/26: fdatasync f2 0 2024-04-25T02:08:45.299 INFO:tasks.workunit.client.1.smithi112.stdout:0/27: dwrite f2 [0,4194304] 0 2024-04-25T02:08:45.300 INFO:tasks.workunit.client.1.smithi112.stdout:0/28: truncate f2 4660100 0 2024-04-25T02:08:45.300 INFO:tasks.workunit.client.1.smithi112.stdout:0/29: readlink - no filename 2024-04-25T02:08:45.328 INFO:tasks.workunit.client.1.smithi112.stdout:4/12: rename c1 to d2/c3 0 2024-04-25T02:08:45.343 INFO:tasks.workunit.client.1.smithi112.stdout:4/13: dwrite f0 [0,4194304] 0 2024-04-25T02:08:45.356 INFO:tasks.workunit.client.1.smithi112.stdout:9/3: mkdir d1 0 2024-04-25T02:08:45.356 INFO:tasks.workunit.client.1.smithi112.stdout:9/4: chown f0 174745929 1 2024-04-25T02:08:45.359 INFO:tasks.workunit.client.1.smithi112.stdout:1/11: truncate f4 822783 0 2024-04-25T02:08:45.359 INFO:tasks.workunit.client.1.smithi112.stdout:1/12: chown f4 2087494997 1 2024-04-25T02:08:45.361 INFO:tasks.workunit.client.1.smithi112.stdout:5/8: rename d1/d3 to d1/d2/d4 0 2024-04-25T02:08:45.361 INFO:tasks.workunit.client.1.smithi112.stdout:9/5: rename d1 to d1/d2 22 2024-04-25T02:08:45.361 INFO:tasks.workunit.client.1.smithi112.stdout:9/6: dread - f0 zero size 2024-04-25T02:08:45.362 INFO:tasks.workunit.client.1.smithi112.stdout:4/14: creat d2/f4 x:0 0 0 2024-04-25T02:08:45.362 INFO:tasks.workunit.client.1.smithi112.stdout:4/15: dread - d2/f4 zero size 2024-04-25T02:08:45.363 INFO:tasks.workunit.client.1.smithi112.stdout:8/7: getdents . 0 2024-04-25T02:08:45.364 INFO:tasks.workunit.client.1.smithi112.stdout:1/13: symlink l5 0 2024-04-25T02:08:45.365 INFO:tasks.workunit.client.1.smithi112.stdout:1/14: creat f6 x:0 0 0 2024-04-25T02:08:45.368 INFO:tasks.workunit.client.1.smithi112.stdout:9/7: link f0 d1/f3 0 2024-04-25T02:08:45.368 INFO:tasks.workunit.client.1.smithi112.stdout:9/8: chown d1/f3 48225774 1 2024-04-25T02:08:45.369 INFO:tasks.workunit.client.1.smithi112.stdout:4/16: unlink d2/f4 0 2024-04-25T02:08:45.378 INFO:tasks.workunit.client.1.smithi112.stdout:4/17: write f0 [2426621,109033] 0 2024-04-25T02:08:45.378 INFO:tasks.workunit.client.1.smithi112.stdout:4/18: read f0 [196190,15618] 0 2024-04-25T02:08:45.378 INFO:tasks.workunit.client.1.smithi112.stdout:4/19: write f0 [3600442,112028] 0 2024-04-25T02:08:45.383 INFO:tasks.workunit.client.1.smithi112.stdout:9/9: dwrite d1/f3 [0,4194304] 0 2024-04-25T02:08:45.387 INFO:tasks.workunit.client.1.smithi112.stdout:9/10: creat d1/f4 x:0 0 0 2024-04-25T02:08:45.421 INFO:tasks.workunit.client.0.smithi077.stdout:1/174: rename db/df/d14/f1c to db/f3b 0 2024-04-25T02:08:45.421 INFO:tasks.workunit.client.0.smithi077.stdout:1/175: creat db/d26/f3c x:0 0 0 2024-04-25T02:08:45.422 INFO:tasks.workunit.client.0.smithi077.stdout:1/176: chown db/d26/c2b 20500524 1 2024-04-25T02:08:45.425 INFO:tasks.workunit.client.0.smithi077.stdout:0/210: rename d2/d17/d1d/f40 to d2/d9/d2a/f48 0 2024-04-25T02:08:45.425 INFO:tasks.workunit.client.0.smithi077.stdout:0/211: truncate d2/d17/d1d/f3d 543890 0 2024-04-25T02:08:45.429 INFO:tasks.workunit.client.0.smithi077.stdout:2/203: rename d2/d9/d2f/c30 to d2/d9/d18/d31/c41 0 2024-04-25T02:08:45.429 INFO:tasks.workunit.client.0.smithi077.stdout:2/204: chown d2/d9/d19 3397467 1 2024-04-25T02:08:45.430 INFO:tasks.workunit.client.0.smithi077.stdout:3/181: write d0/d7/d15/f2b [115531,4890] 0 2024-04-25T02:08:45.432 INFO:tasks.workunit.client.0.smithi077.stdout:2/205: dread d2/d9/d18/f29 [0,4194304] 0 2024-04-25T02:08:45.432 INFO:tasks.workunit.client.0.smithi077.stdout:2/206: chown d2/l11 1112 1 2024-04-25T02:08:45.432 INFO:tasks.workunit.client.0.smithi077.stdout:2/207: write d2/d9/d19/d1c/f33 [383085,1761] 0 2024-04-25T02:08:45.433 INFO:tasks.workunit.client.0.smithi077.stdout:6/219: rename de/d12/f30 to de/d15/f50 0 2024-04-25T02:08:45.435 INFO:tasks.workunit.client.0.smithi077.stdout:1/177: dwrite db/d11/f30 [0,4194304] 0 2024-04-25T02:08:45.436 INFO:tasks.workunit.client.0.smithi077.stdout:0/212: write d2/d27/f2b [1562269,112911] 0 2024-04-25T02:08:45.437 INFO:tasks.workunit.client.0.smithi077.stdout:2/208: mknod d2/d9/d2f/c42 0 2024-04-25T02:08:45.438 INFO:tasks.workunit.client.0.smithi077.stdout:6/220: truncate f1 393811 0 2024-04-25T02:08:45.440 INFO:tasks.workunit.client.0.smithi077.stdout:3/182: link d0/d7/f3b d0/f3c 0 2024-04-25T02:08:45.440 INFO:tasks.workunit.client.0.smithi077.stdout:3/183: fsync d0/d2/f35 0 2024-04-25T02:08:45.442 INFO:tasks.workunit.client.0.smithi077.stdout:2/209: dread d2/f5 [0,4194304] 0 2024-04-25T02:08:45.442 INFO:tasks.workunit.client.0.smithi077.stdout:2/210: truncate d2/f5 4992262 0 2024-04-25T02:08:45.442 INFO:tasks.workunit.client.0.smithi077.stdout:1/178: chown db/df/d14/l19 0 1 2024-04-25T02:08:45.445 INFO:tasks.workunit.client.0.smithi077.stdout:0/213: mknod d2/d9/c49 0 2024-04-25T02:08:45.446 INFO:tasks.workunit.client.0.smithi077.stdout:6/221: symlink de/d15/d35/l51 0 2024-04-25T02:08:45.448 INFO:tasks.workunit.client.0.smithi077.stdout:3/184: truncate d0/d2/d2f/f32 2514702 0 2024-04-25T02:08:45.449 INFO:tasks.workunit.client.0.smithi077.stdout:1/179: mknod db/df/d14/d33/c3d 0 2024-04-25T02:08:45.449 INFO:tasks.workunit.client.0.smithi077.stdout:2/211: dread d2/d28/f32 [0,4194304] 0 2024-04-25T02:08:45.450 INFO:tasks.workunit.client.0.smithi077.stdout:6/222: creat de/d12/d25/f52 x:0 0 0 2024-04-25T02:08:45.450 INFO:tasks.workunit.client.0.smithi077.stdout:6/223: chown de/d12/f2a 125387006 1 2024-04-25T02:08:45.451 INFO:tasks.workunit.client.0.smithi077.stdout:3/185: creat d0/d7/f3d x:0 0 0 2024-04-25T02:08:45.453 INFO:tasks.workunit.client.0.smithi077.stdout:1/180: unlink f3 0 2024-04-25T02:08:45.455 INFO:tasks.workunit.client.0.smithi077.stdout:3/186: write d0/f23 [6643839,2886] 0 2024-04-25T02:08:45.458 INFO:tasks.workunit.client.0.smithi077.stdout:3/187: getdents d0/d2/de/d36 0 2024-04-25T02:08:45.458 INFO:tasks.workunit.client.0.smithi077.stdout:3/188: fdatasync d0/d17/f37 0 2024-04-25T02:08:45.464 INFO:tasks.workunit.client.0.smithi077.stdout:6/224: dwrite de/f46 [0,4194304] 0 2024-04-25T02:08:45.464 INFO:tasks.workunit.client.0.smithi077.stdout:6/225: chown de/l39 1488661 1 2024-04-25T02:08:45.467 INFO:tasks.workunit.client.0.smithi077.stdout:6/226: truncate fd 1531080 0 2024-04-25T02:08:45.469 INFO:tasks.workunit.client.0.smithi077.stdout:6/227: mkdir de/d53 0 2024-04-25T02:08:45.472 INFO:tasks.workunit.client.0.smithi077.stdout:5/197: sync 2024-04-25T02:08:45.472 INFO:tasks.workunit.client.0.smithi077.stdout:9/158: sync 2024-04-25T02:08:45.472 INFO:tasks.workunit.client.0.smithi077.stdout:4/165: sync 2024-04-25T02:08:45.472 INFO:tasks.workunit.client.0.smithi077.stdout:4/166: read - d0/de/d25/f31 zero size 2024-04-25T02:08:45.473 INFO:tasks.workunit.client.0.smithi077.stdout:9/159: mknod df/c33 0 2024-04-25T02:08:45.475 INFO:tasks.workunit.client.0.smithi077.stdout:4/167: dread d0/d14/d21/f2a [0,4194304] 0 2024-04-25T02:08:45.476 INFO:tasks.workunit.client.0.smithi077.stdout:4/168: mkdir d0/d1/da/d12/d35 0 2024-04-25T02:08:45.477 INFO:tasks.workunit.client.0.smithi077.stdout:4/169: write d0/de/d25/f31 [587804,69018] 0 2024-04-25T02:08:45.479 INFO:tasks.workunit.client.0.smithi077.stdout:4/170: link d0/d14/d21/f32 d0/d14/d30/f36 0 2024-04-25T02:08:45.479 INFO:tasks.workunit.client.0.smithi077.stdout:4/171: chown d0/f28 1118783039 1 2024-04-25T02:08:45.479 INFO:tasks.workunit.client.0.smithi077.stdout:4/172: fsync d0/d1/da/f2d 0 2024-04-25T02:08:45.480 INFO:tasks.workunit.client.0.smithi077.stdout:4/173: dread - d0/d14/d30/f36 zero size 2024-04-25T02:08:45.480 INFO:tasks.workunit.client.0.smithi077.stdout:4/174: write d0/d14/d30/f2b [272860,29535] 0 2024-04-25T02:08:45.498 INFO:tasks.workunit.client.0.smithi077.stdout:5/198: dwrite d0/d2/d3/d1d/f33 [0,4194304] 0 2024-04-25T02:08:45.498 INFO:tasks.workunit.client.0.smithi077.stdout:9/160: dwrite f3 [0,4194304] 0 2024-04-25T02:08:45.499 INFO:tasks.workunit.client.0.smithi077.stdout:4/175: dwrite d0/d1/d1d/f2c [0,4194304] 0 2024-04-25T02:08:45.499 INFO:tasks.workunit.client.0.smithi077.stdout:4/176: fsync d0/f28 0 2024-04-25T02:08:45.500 INFO:tasks.workunit.client.0.smithi077.stdout:4/177: write d0/de/f15 [536668,22580] 0 2024-04-25T02:08:45.502 INFO:tasks.workunit.client.0.smithi077.stdout:5/199: mkdir d0/d2/d20/d41 0 2024-04-25T02:08:45.503 INFO:tasks.workunit.client.0.smithi077.stdout:9/161: mknod df/d1b/c34 0 2024-04-25T02:08:45.505 INFO:tasks.workunit.client.0.smithi077.stdout:4/178: mknod d0/de/d25/c37 0 2024-04-25T02:08:45.506 INFO:tasks.workunit.client.0.smithi077.stdout:9/162: mknod df/c35 0 2024-04-25T02:08:45.508 INFO:tasks.workunit.client.0.smithi077.stdout:4/179: link d0/d14/d21/f26 d0/d14/d30/f38 0 2024-04-25T02:08:45.509 INFO:tasks.workunit.client.0.smithi077.stdout:4/180: truncate d0/d1/f2 2231276 0 2024-04-25T02:08:45.515 INFO:tasks.workunit.client.0.smithi077.stdout:9/163: dread df/f12 [0,4194304] 0 2024-04-25T02:08:45.518 INFO:tasks.workunit.client.0.smithi077.stdout:5/200: dwrite d0/d25/f36 [0,4194304] 0 2024-04-25T02:08:45.521 INFO:tasks.workunit.client.0.smithi077.stdout:5/201: rmdir d0/d2/d20/d23 39 2024-04-25T02:08:45.523 INFO:tasks.workunit.client.0.smithi077.stdout:4/181: write d0/d1/da/fb [2955395,57811] 0 2024-04-25T02:08:45.523 INFO:tasks.workunit.client.0.smithi077.stdout:5/202: write d0/d25/f1a [379998,20769] 0 2024-04-25T02:08:45.523 INFO:tasks.workunit.client.1.smithi112.stdout:0/30: write f5 [4390316,83473] 0 2024-04-25T02:08:45.526 INFO:tasks.workunit.client.0.smithi077.stdout:4/182: unlink d0/d14/d30/l27 0 2024-04-25T02:08:45.527 INFO:tasks.workunit.client.1.smithi112.stdout:0/31: unlink f5 0 2024-04-25T02:08:45.530 INFO:tasks.workunit.client.0.smithi077.stdout:5/203: dread d0/d2/d3/d1d/f1f [0,4194304] 0 2024-04-25T02:08:45.532 INFO:tasks.workunit.client.0.smithi077.stdout:9/164: dwrite df/d1b/f20 [0,4194304] 0 2024-04-25T02:08:45.536 INFO:tasks.workunit.client.0.smithi077.stdout:9/165: mknod df/c36 0 2024-04-25T02:08:45.536 INFO:tasks.workunit.client.0.smithi077.stdout:9/166: creat df/f37 x:0 0 0 2024-04-25T02:08:45.544 INFO:tasks.workunit.client.0.smithi077.stdout:5/204: dwrite d0/d2/d3/d1d/f33 [0,4194304] 0 2024-04-25T02:08:45.545 INFO:tasks.workunit.client.0.smithi077.stdout:5/205: dread - d0/d2/d3/d1d/f28 zero size 2024-04-25T02:08:45.545 INFO:tasks.workunit.client.0.smithi077.stdout:9/167: dread df/f10 [0,4194304] 0 2024-04-25T02:08:45.546 INFO:tasks.workunit.client.0.smithi077.stdout:9/168: creat df/f38 x:0 0 0 2024-04-25T02:08:45.546 INFO:tasks.workunit.client.0.smithi077.stdout:9/169: creat df/f39 x:0 0 0 2024-04-25T02:08:45.546 INFO:tasks.workunit.client.0.smithi077.stdout:9/170: chown df/d1b/f30 1121 1 2024-04-25T02:08:45.546 INFO:tasks.workunit.client.0.smithi077.stdout:5/206: fsync d0/d25/f1a 0 2024-04-25T02:08:45.551 INFO:tasks.workunit.client.0.smithi077.stdout:9/171: symlink df/l3a 0 2024-04-25T02:08:45.552 INFO:tasks.workunit.client.0.smithi077.stdout:5/207: mknod d0/d2/d1b/d35/c42 0 2024-04-25T02:08:45.552 INFO:tasks.workunit.client.0.smithi077.stdout:5/208: fsync d0/d2/d3/f15 0 2024-04-25T02:08:45.553 INFO:tasks.workunit.client.0.smithi077.stdout:9/172: mknod df/c3b 0 2024-04-25T02:08:45.584 INFO:tasks.workunit.client.0.smithi077.stdout:5/209: dwrite d0/d2/d5/f2c [4194304,4194304] 0 2024-04-25T02:08:45.584 INFO:tasks.workunit.client.0.smithi077.stdout:5/210: dread - d0/d2/d3/d1d/f28 zero size 2024-04-25T02:08:45.584 INFO:tasks.workunit.client.0.smithi077.stdout:9/173: dwrite df/f2f [0,4194304] 0 2024-04-25T02:08:45.587 INFO:tasks.workunit.client.0.smithi077.stdout:9/174: unlink df/c23 0 2024-04-25T02:08:45.588 INFO:tasks.workunit.client.0.smithi077.stdout:9/175: creat df/f3c x:0 0 0 2024-04-25T02:08:45.591 INFO:tasks.workunit.client.0.smithi077.stdout:5/211: dread d0/d2/d5/f2c [0,4194304] 0 2024-04-25T02:08:45.592 INFO:tasks.workunit.client.0.smithi077.stdout:5/212: mkdir d0/d2/d5/d43 0 2024-04-25T02:08:45.592 INFO:tasks.workunit.client.0.smithi077.stdout:5/213: dread - d0/d2/d3/d1d/f28 zero size 2024-04-25T02:08:45.592 INFO:tasks.workunit.client.0.smithi077.stdout:5/214: readlink d0/l11 0 2024-04-25T02:08:45.595 INFO:tasks.workunit.client.0.smithi077.stdout:5/215: mkdir d0/d2/d3/d9/d39/d44 0 2024-04-25T02:08:45.596 INFO:tasks.workunit.client.0.smithi077.stdout:5/216: creat d0/d2/d3/d9/d39/d44/f45 x:0 0 0 2024-04-25T02:08:45.597 INFO:tasks.workunit.client.0.smithi077.stdout:5/217: fsync d0/d2/d3/f17 0 2024-04-25T02:08:45.605 INFO:tasks.workunit.client.1.smithi112.stdout:4/20: link d2/c3 d2/c5 0 2024-04-25T02:08:45.605 INFO:tasks.workunit.client.1.smithi112.stdout:4/21: creat d2/f6 x:0 0 0 2024-04-25T02:08:45.608 INFO:tasks.workunit.client.1.smithi112.stdout:4/22: rename d2/c5 to d2/c7 0 2024-04-25T02:08:45.608 INFO:tasks.workunit.client.1.smithi112.stdout:4/23: creat d2/f8 x:0 0 0 2024-04-25T02:08:45.608 INFO:tasks.workunit.client.1.smithi112.stdout:4/24: creat d2/f9 x:0 0 0 2024-04-25T02:08:45.610 INFO:tasks.workunit.client.0.smithi077.stdout:9/176: dwrite df/f18 [0,4194304] 0 2024-04-25T02:08:45.610 INFO:tasks.workunit.client.0.smithi077.stdout:9/177: readlink l9 0 2024-04-25T02:08:45.610 INFO:tasks.workunit.client.0.smithi077.stdout:9/178: write df/f26 [352168,104795] 0 2024-04-25T02:08:45.619 INFO:tasks.workunit.client.1.smithi112.stdout:6/14: dwrite d0/f1 [4194304,4194304] 0 2024-04-25T02:08:45.620 INFO:tasks.workunit.client.1.smithi112.stdout:1/15: write f4 [1051564,117111] 0 2024-04-25T02:08:45.623 INFO:tasks.workunit.client.1.smithi112.stdout:1/16: mkdir d7 0 2024-04-25T02:08:45.623 INFO:tasks.workunit.client.1.smithi112.stdout:1/17: truncate f6 404016 0 2024-04-25T02:08:45.623 INFO:tasks.workunit.client.1.smithi112.stdout:1/18: write f2 [336513,6682] 0 2024-04-25T02:08:45.624 INFO:tasks.workunit.client.1.smithi112.stdout:1/19: mknod d7/c8 0 2024-04-25T02:08:45.624 INFO:tasks.workunit.client.1.smithi112.stdout:4/25: dread f0 [0,4194304] 0 2024-04-25T02:08:45.624 INFO:tasks.workunit.client.1.smithi112.stdout:4/26: read - d2/f9 zero size 2024-04-25T02:08:45.625 INFO:tasks.workunit.client.0.smithi077.stdout:9/179: write df/f18 [954696,18890] 0 2024-04-25T02:08:45.628 INFO:tasks.workunit.client.1.smithi112.stdout:5/9: truncate f0 706239 0 2024-04-25T02:08:45.631 INFO:tasks.workunit.client.1.smithi112.stdout:5/10: creat d1/f5 x:0 0 0 2024-04-25T02:08:45.631 INFO:tasks.workunit.client.1.smithi112.stdout:0/32: write f2 [4403546,104139] 0 2024-04-25T02:08:45.631 INFO:tasks.workunit.client.1.smithi112.stdout:1/20: dread f2 [0,4194304] 0 2024-04-25T02:08:45.631 INFO:tasks.workunit.client.1.smithi112.stdout:9/11: truncate d1/f3 2918014 0 2024-04-25T02:08:45.631 INFO:tasks.workunit.client.1.smithi112.stdout:9/12: chown d1/f3 95668 1 2024-04-25T02:08:45.632 INFO:tasks.workunit.client.1.smithi112.stdout:1/21: mkdir d7/d9 0 2024-04-25T02:08:45.638 INFO:tasks.workunit.client.1.smithi112.stdout:6/15: dread d0/f1 [4194304,4194304] 0 2024-04-25T02:08:45.639 INFO:tasks.workunit.client.0.smithi077.stdout:1/181: mkdir db/df/d14/d3e 0 2024-04-25T02:08:45.639 INFO:tasks.workunit.client.1.smithi112.stdout:1/22: link f4 d7/d9/fa 0 2024-04-25T02:08:45.639 INFO:tasks.workunit.client.1.smithi112.stdout:1/23: chown d7/d9/fa 79462 1 2024-04-25T02:08:45.639 INFO:tasks.workunit.client.1.smithi112.stdout:1/24: stat f4 0 2024-04-25T02:08:45.639 INFO:tasks.workunit.client.1.smithi112.stdout:1/25: readlink l5 0 2024-04-25T02:08:45.639 INFO:tasks.workunit.client.1.smithi112.stdout:1/26: read f6 [10525,123987] 0 2024-04-25T02:08:45.639 INFO:tasks.workunit.client.1.smithi112.stdout:1/27: write f6 [1361026,109776] 0 2024-04-25T02:08:45.641 INFO:tasks.workunit.client.1.smithi112.stdout:8/8: dwrite f1 [4194304,4194304] 0 2024-04-25T02:08:45.642 INFO:tasks.workunit.client.0.smithi077.stdout:7/136: sync 2024-04-25T02:08:45.642 INFO:tasks.workunit.client.0.smithi077.stdout:8/246: sync 2024-04-25T02:08:45.642 INFO:tasks.workunit.client.0.smithi077.stdout:8/247: dread - d3/da/db/f4c zero size 2024-04-25T02:08:45.644 INFO:tasks.workunit.client.1.smithi112.stdout:1/28: symlink d7/d9/lb 0 2024-04-25T02:08:45.644 INFO:tasks.workunit.client.1.smithi112.stdout:1/29: chown d7/c8 3983010 1 2024-04-25T02:08:45.645 INFO:tasks.workunit.client.1.smithi112.stdout:6/16: rmdir d0 39 2024-04-25T02:08:45.646 INFO:tasks.workunit.client.1.smithi112.stdout:0/33: write f2 [1704418,39266] 0 2024-04-25T02:08:45.647 INFO:tasks.workunit.client.0.smithi077.stdout:7/137: mkdir d4/d13/d2c 0 2024-04-25T02:08:45.651 INFO:tasks.workunit.client.0.smithi077.stdout:8/248: creat d3/da/db/df/d2b/d37/f4d x:0 0 0 2024-04-25T02:08:45.651 INFO:tasks.workunit.client.0.smithi077.stdout:9/180: dwrite df/d1b/f20 [0,4194304] 0 2024-04-25T02:08:45.652 INFO:tasks.workunit.client.0.smithi077.stdout:2/212: rmdir d2/d9/d2f 39 2024-04-25T02:08:45.653 INFO:tasks.workunit.client.1.smithi112.stdout:8/9: dread f1 [0,4194304] 0 2024-04-25T02:08:45.654 INFO:tasks.workunit.client.1.smithi112.stdout:1/30: mknod d7/d9/cc 0 2024-04-25T02:08:45.654 INFO:tasks.workunit.client.1.smithi112.stdout:1/31: write d7/d9/fa [1698748,68224] 0 2024-04-25T02:08:45.658 INFO:tasks.workunit.client.1.smithi112.stdout:6/17: creat d0/f3 x:0 0 0 2024-04-25T02:08:45.658 INFO:tasks.workunit.client.1.smithi112.stdout:6/18: dread - d0/f3 zero size 2024-04-25T02:08:45.659 INFO:tasks.workunit.client.0.smithi077.stdout:1/182: rmdir db/d11 39 2024-04-25T02:08:45.659 INFO:tasks.workunit.client.0.smithi077.stdout:1/183: write db/d26/f2f [553326,14739] 0 2024-04-25T02:08:45.659 INFO:tasks.workunit.client.0.smithi077.stdout:1/184: write db/d26/f2f [202067,74075] 0 2024-04-25T02:08:45.660 INFO:tasks.workunit.client.0.smithi077.stdout:1/185: fdatasync db/df/d14/d33/f38 0 2024-04-25T02:08:45.661 INFO:tasks.workunit.client.1.smithi112.stdout:8/10: unlink c0 0 2024-04-25T02:08:45.661 INFO:tasks.workunit.client.1.smithi112.stdout:8/11: chown f1 0 1 2024-04-25T02:08:45.662 INFO:tasks.workunit.client.0.smithi077.stdout:7/138: mkdir d4/d13/d18/d2d 0 2024-04-25T02:08:45.662 INFO:tasks.workunit.client.1.smithi112.stdout:1/32: rmdir d7/d9 39 2024-04-25T02:08:45.663 INFO:tasks.workunit.client.0.smithi077.stdout:6/228: rmdir de/d15 39 2024-04-25T02:08:45.664 INFO:tasks.workunit.client.1.smithi112.stdout:6/19: dread d0/f1 [4194304,4194304] 0 2024-04-25T02:08:45.665 INFO:tasks.workunit.client.1.smithi112.stdout:6/20: truncate d0/f1 8883216 0 2024-04-25T02:08:45.665 INFO:tasks.workunit.client.0.smithi077.stdout:8/249: symlink d3/da/db/df/d2b/l4e 0 2024-04-25T02:08:45.665 INFO:tasks.workunit.client.0.smithi077.stdout:8/250: write d3/da/f35 [93108,48075] 0 2024-04-25T02:08:45.665 INFO:tasks.workunit.client.0.smithi077.stdout:8/251: write d3/da/db/df/f10 [86665,70721] 0 2024-04-25T02:08:45.667 INFO:tasks.workunit.client.1.smithi112.stdout:8/12: link f1 f2 0 2024-04-25T02:08:45.670 INFO:tasks.workunit.client.1.smithi112.stdout:1/33: mkdir d7/dd 0 2024-04-25T02:08:45.672 INFO:tasks.workunit.client.0.smithi077.stdout:2/213: symlink d2/d9/d18/d31/l43 0 2024-04-25T02:08:45.672 INFO:tasks.workunit.client.0.smithi077.stdout:2/214: read d2/d9/d19/f1a [1636865,31895] 0 2024-04-25T02:08:45.672 INFO:tasks.workunit.client.0.smithi077.stdout:2/215: creat d2/d9/d19/d1c/f44 x:0 0 0 2024-04-25T02:08:45.672 INFO:tasks.workunit.client.0.smithi077.stdout:2/216: readlink d2/d9/df/l16 0 2024-04-25T02:08:45.673 INFO:tasks.workunit.client.1.smithi112.stdout:0/34: dwrite f2 [0,4194304] 0 2024-04-25T02:08:45.673 INFO:tasks.workunit.client.1.smithi112.stdout:6/21: mkdir d0/d2/d4 0 2024-04-25T02:08:45.681 INFO:tasks.workunit.client.1.smithi112.stdout:8/13: read f2 [5981189,60743] 0 2024-04-25T02:08:45.685 INFO:tasks.workunit.client.1.smithi112.stdout:0/35: dread f2 [0,4194304] 0 2024-04-25T02:08:45.685 INFO:tasks.workunit.client.1.smithi112.stdout:0/36: chown f2 797 1 2024-04-25T02:08:45.685 INFO:tasks.workunit.client.1.smithi112.stdout:0/37: chown f2 94244 1 2024-04-25T02:08:45.807 INFO:tasks.workunit.client.0.smithi077.stdout:8/252: dwrite d3/da/db/df/d2b/d37/f4d [0,4194304] 0 2024-04-25T02:08:45.808 INFO:tasks.workunit.client.1.smithi112.stdout:1/34: mkdir d7/dd/de 0 2024-04-25T02:08:45.808 INFO:tasks.workunit.client.1.smithi112.stdout:1/35: readlink d7/d9/lb 0 2024-04-25T02:08:45.809 INFO:tasks.workunit.client.0.smithi077.stdout:7/139: truncate d4/f21 1408874 0 2024-04-25T02:08:45.809 INFO:tasks.workunit.client.0.smithi077.stdout:7/140: dread - d4/f16 zero size 2024-04-25T02:08:45.810 INFO:tasks.workunit.client.1.smithi112.stdout:6/22: link d0/f3 d0/d2/d4/f5 0 2024-04-25T02:08:45.811 INFO:tasks.workunit.client.0.smithi077.stdout:3/189: truncate d0/f9 2548753 0 2024-04-25T02:08:45.811 INFO:tasks.workunit.client.0.smithi077.stdout:1/186: dread db/df/d14/f17 [0,4194304] 0 2024-04-25T02:08:45.811 INFO:tasks.workunit.client.0.smithi077.stdout:1/187: readlink l6 0 2024-04-25T02:08:45.815 INFO:tasks.workunit.client.0.smithi077.stdout:2/217: dwrite d2/d9/d18/fa [0,4194304] 0 2024-04-25T02:08:45.822 INFO:tasks.workunit.client.0.smithi077.stdout:7/141: dread d4/d13/d18/d28/f2a [4194304,4194304] 0 2024-04-25T02:08:45.822 INFO:tasks.workunit.client.0.smithi077.stdout:7/142: chown d4/f16 186 1 2024-04-25T02:08:45.828 INFO:tasks.workunit.client.0.smithi077.stdout:2/218: read d2/f5 [3711948,104525] 0 2024-04-25T02:08:45.835 INFO:tasks.workunit.client.1.smithi112.stdout:1/36: dwrite d7/d9/fa [0,4194304] 0 2024-04-25T02:08:45.843 INFO:tasks.workunit.client.0.smithi077.stdout:6/229: symlink de/d12/d25/d3a/l54 0 2024-04-25T02:08:45.843 INFO:tasks.workunit.client.0.smithi077.stdout:6/230: write f7 [3861687,47388] 0 2024-04-25T02:08:45.843 INFO:tasks.workunit.client.0.smithi077.stdout:6/231: fdatasync de/d12/f28 0 2024-04-25T02:08:45.844 INFO:tasks.workunit.client.1.smithi112.stdout:8/14: creat f3 x:0 0 0 2024-04-25T02:08:45.844 INFO:tasks.workunit.client.1.smithi112.stdout:8/15: creat f4 x:0 0 0 2024-04-25T02:08:45.844 INFO:tasks.workunit.client.1.smithi112.stdout:1/37: dread d7/d9/fa [0,4194304] 0 2024-04-25T02:08:45.845 INFO:tasks.workunit.client.0.smithi077.stdout:6/232: fdatasync f7 0 2024-04-25T02:08:45.845 INFO:tasks.workunit.client.0.smithi077.stdout:6/233: stat de/d15/d36/l4f 0 2024-04-25T02:08:45.847 INFO:tasks.workunit.client.1.smithi112.stdout:0/38: creat f7 x:0 0 0 2024-04-25T02:08:45.853 INFO:tasks.workunit.client.1.smithi112.stdout:6/23: unlink d0/f1 0 2024-04-25T02:08:45.853 INFO:tasks.workunit.client.1.smithi112.stdout:6/24: stat d0/f3 0 2024-04-25T02:08:45.853 INFO:tasks.workunit.client.1.smithi112.stdout:6/25: fdatasync d0/f3 0 2024-04-25T02:08:45.853 INFO:tasks.workunit.client.1.smithi112.stdout:6/26: write d0/f3 [748285,114817] 0 2024-04-25T02:08:45.858 INFO:tasks.workunit.client.0.smithi077.stdout:5/218: write d0/d2/d3/d1d/f33 [4146650,119363] 0 2024-04-25T02:08:45.858 INFO:tasks.workunit.client.0.smithi077.stdout:8/253: mknod d3/da/db/df/d2b/d37/c4f 0 2024-04-25T02:08:45.861 INFO:tasks.workunit.client.1.smithi112.stdout:1/38: unlink c3 0 2024-04-25T02:08:45.863 INFO:tasks.workunit.client.1.smithi112.stdout:0/39: mknod c8 0 2024-04-25T02:08:45.863 INFO:tasks.workunit.client.1.smithi112.stdout:0/40: readlink - no filename 2024-04-25T02:08:45.867 INFO:tasks.workunit.client.1.smithi112.stdout:0/41: symlink l9 0 2024-04-25T02:08:45.871 INFO:tasks.workunit.client.0.smithi077.stdout:6/234: mkdir de/d55 0 2024-04-25T02:08:45.872 INFO:tasks.workunit.client.0.smithi077.stdout:5/219: creat d0/d2/d20/d23/f46 x:0 0 0 2024-04-25T02:08:45.872 INFO:tasks.workunit.client.0.smithi077.stdout:5/220: creat d0/d25/f47 x:0 0 0 2024-04-25T02:08:45.873 INFO:tasks.workunit.client.0.smithi077.stdout:5/221: readlink d0/d2/d3/d1d/l27 0 2024-04-25T02:08:45.873 INFO:tasks.workunit.client.0.smithi077.stdout:5/222: write d0/d2/d3/d1d/f1f [4878552,30477] 0 2024-04-25T02:08:45.873 INFO:tasks.workunit.client.0.smithi077.stdout:5/223: write d0/f32 [2517363,93669] 0 2024-04-25T02:08:45.873 INFO:tasks.workunit.client.0.smithi077.stdout:5/224: creat d0/d2/d3/d9/d39/d44/f48 x:0 0 0 2024-04-25T02:08:45.873 INFO:tasks.workunit.client.1.smithi112.stdout:8/16: dwrite f1 [4194304,4194304] 0 2024-04-25T02:08:45.873 INFO:tasks.workunit.client.1.smithi112.stdout:0/42: dread f2 [0,4194304] 0 2024-04-25T02:08:45.874 INFO:tasks.workunit.client.1.smithi112.stdout:0/43: chown c8 2 1 2024-04-25T02:08:45.874 INFO:tasks.workunit.client.0.smithi077.stdout:8/254: symlink d3/da/d27/d44/l50 0 2024-04-25T02:08:45.877 INFO:tasks.workunit.client.0.smithi077.stdout:4/183: rename d0/d1 to d0/d14/d21/d39 0 2024-04-25T02:08:45.877 INFO:tasks.workunit.client.0.smithi077.stdout:4/184: chown d0/d14/d21/f22 147704959 1 2024-04-25T02:08:45.877 INFO:tasks.workunit.client.0.smithi077.stdout:4/185: readlink d0/d14/d21/d39/da/ld 0 2024-04-25T02:08:45.878 INFO:tasks.workunit.client.0.smithi077.stdout:3/190: rename d0/d39 to d0/d3e 0 2024-04-25T02:08:45.880 INFO:tasks.workunit.client.0.smithi077.stdout:2/219: write d2/d9/f17 [3145808,37104] 0 2024-04-25T02:08:45.881 INFO:tasks.workunit.client.0.smithi077.stdout:2/220: write d2/d9/d2f/f38 [925092,77377] 0 2024-04-25T02:08:45.881 INFO:tasks.workunit.client.0.smithi077.stdout:1/188: creat db/d11/d32/f3f x:0 0 0 2024-04-25T02:08:45.887 INFO:tasks.workunit.client.0.smithi077.stdout:8/255: mknod d3/da/d27/d16/c51 0 2024-04-25T02:08:45.889 INFO:tasks.workunit.client.1.smithi112.stdout:0/44: dread f2 [0,4194304] 0 2024-04-25T02:08:45.889 INFO:tasks.workunit.client.0.smithi077.stdout:7/143: rename d4/d13/d18/d28/f2a to d4/d13/d2c/f2e 0 2024-04-25T02:08:45.890 INFO:tasks.workunit.client.0.smithi077.stdout:4/186: mkdir d0/d14/d30/d3a 0 2024-04-25T02:08:45.891 INFO:tasks.workunit.client.1.smithi112.stdout:0/45: mkdir da 0 2024-04-25T02:08:45.893 INFO:tasks.workunit.client.0.smithi077.stdout:3/191: mknod d0/d2/d2f/c3f 0 2024-04-25T02:08:45.893 INFO:tasks.workunit.client.0.smithi077.stdout:3/192: read - d0/f3c zero size 2024-04-25T02:08:45.895 INFO:tasks.workunit.client.0.smithi077.stdout:2/221: stat d2/d9/df/l12 0 2024-04-25T02:08:45.895 INFO:tasks.workunit.client.0.smithi077.stdout:2/222: fsync f1 0 2024-04-25T02:08:45.896 INFO:tasks.workunit.client.0.smithi077.stdout:1/189: truncate db/d11/f39 911922 0 2024-04-25T02:08:45.898 INFO:tasks.workunit.client.1.smithi112.stdout:8/17: dread f2 [4194304,4194304] 0 2024-04-25T02:08:45.900 INFO:tasks.workunit.client.0.smithi077.stdout:8/256: truncate d3/da/d27/d16/f22 3275498 0 2024-04-25T02:08:45.902 INFO:tasks.workunit.client.0.smithi077.stdout:5/225: dwrite d0/d25/f1a [0,4194304] 0 2024-04-25T02:08:45.902 INFO:tasks.workunit.client.0.smithi077.stdout:5/226: chown d0/d2 2203024 1 2024-04-25T02:08:45.902 INFO:tasks.workunit.client.0.smithi077.stdout:5/227: chown d0/d2/d20 0 1 2024-04-25T02:08:45.905 INFO:tasks.workunit.client.1.smithi112.stdout:0/46: write f2 [3942392,116607] 0 2024-04-25T02:08:45.905 INFO:tasks.workunit.client.1.smithi112.stdout:0/47: truncate f7 254273 0 2024-04-25T02:08:45.905 INFO:tasks.workunit.client.1.smithi112.stdout:6/27: dwrite d0/f3 [0,4194304] 0 2024-04-25T02:08:45.905 INFO:tasks.workunit.client.0.smithi077.stdout:4/187: rmdir d0/d14/d21/d39/da/d12 39 2024-04-25T02:08:45.905 INFO:tasks.workunit.client.0.smithi077.stdout:4/188: chown d0/d14/d21/d39/d1d/f2c 24935352 1 2024-04-25T02:08:45.905 INFO:tasks.workunit.client.0.smithi077.stdout:4/189: write d0/d14/d21/d39/f2 [2716242,85325] 0 2024-04-25T02:08:45.906 INFO:tasks.workunit.client.1.smithi112.stdout:4/27: fsync d2/f9 0 2024-04-25T02:08:45.906 INFO:tasks.workunit.client.1.smithi112.stdout:4/28: rename d2 to d2/da 22 2024-04-25T02:08:45.906 INFO:tasks.workunit.client.1.smithi112.stdout:4/29: write f0 [307991,23057] 0 2024-04-25T02:08:45.906 INFO:tasks.workunit.client.1.smithi112.stdout:4/30: read - d2/f8 zero size 2024-04-25T02:08:45.909 INFO:tasks.workunit.client.1.smithi112.stdout:0/48: creat da/fb x:0 0 0 2024-04-25T02:08:45.909 INFO:tasks.workunit.client.1.smithi112.stdout:0/49: truncate f7 872890 0 2024-04-25T02:08:45.909 INFO:tasks.workunit.client.1.smithi112.stdout:0/50: truncate f7 1441493 0 2024-04-25T02:08:45.912 INFO:tasks.workunit.client.0.smithi077.stdout:1/190: write db/f12 [1166767,82308] 0 2024-04-25T02:08:45.914 INFO:tasks.workunit.client.0.smithi077.stdout:3/193: dwrite d0/d7/f3d [0,4194304] 0 2024-04-25T02:08:45.916 INFO:tasks.workunit.client.0.smithi077.stdout:5/228: dread d0/d2/d3/f17 [0,4194304] 0 2024-04-25T02:08:45.916 INFO:tasks.workunit.client.0.smithi077.stdout:5/229: chown d0/d2/d3/d1d/f1f 67 1 2024-04-25T02:08:45.916 INFO:tasks.workunit.client.0.smithi077.stdout:5/230: chown d0/d2/d3/f17 1 1 2024-04-25T02:08:45.916 INFO:tasks.workunit.client.0.smithi077.stdout:5/231: write d0/d2/d3/d9/d39/d44/f45 [25446,75552] 0 2024-04-25T02:08:45.918 INFO:tasks.workunit.client.0.smithi077.stdout:4/190: creat d0/d14/d21/d39/f3b x:0 0 0 2024-04-25T02:08:45.925 INFO:tasks.workunit.client.1.smithi112.stdout:9/13: rename d1/f3 to d1/f5 0 2024-04-25T02:08:45.928 INFO:tasks.workunit.client.1.smithi112.stdout:5/11: write f0 [695669,15792] 0 2024-04-25T02:08:45.928 INFO:tasks.workunit.client.1.smithi112.stdout:5/12: creat d1/f6 x:0 0 0 2024-04-25T02:08:45.929 INFO:tasks.workunit.client.0.smithi077.stdout:4/191: dread d0/f18 [0,4194304] 0 2024-04-25T02:08:45.931 INFO:tasks.workunit.client.1.smithi112.stdout:8/18: dwrite f1 [4194304,4194304] 0 2024-04-25T02:08:45.931 INFO:tasks.workunit.client.1.smithi112.stdout:8/19: chown f1 1171 1 2024-04-25T02:08:45.931 INFO:tasks.workunit.client.1.smithi112.stdout:0/51: dwrite da/fb [0,4194304] 0 2024-04-25T02:08:45.932 INFO:tasks.workunit.client.1.smithi112.stdout:0/52: dread f7 [0,4194304] 0 2024-04-25T02:08:45.935 INFO:tasks.workunit.client.1.smithi112.stdout:5/13: creat d1/d2/f7 x:0 0 0 2024-04-25T02:08:45.935 INFO:tasks.workunit.client.1.smithi112.stdout:5/14: creat d1/f8 x:0 0 0 2024-04-25T02:08:45.941 INFO:tasks.workunit.client.1.smithi112.stdout:8/20: write f2 [6908502,87481] 0 2024-04-25T02:08:45.942 INFO:tasks.workunit.client.0.smithi077.stdout:1/191: mkdir db/df/d1b/d40 0 2024-04-25T02:08:45.947 INFO:tasks.workunit.client.1.smithi112.stdout:0/53: read da/fb [1312963,14973] 0 2024-04-25T02:08:45.947 INFO:tasks.workunit.client.1.smithi112.stdout:9/14: dwrite d1/f5 [0,4194304] 0 2024-04-25T02:08:45.952 INFO:tasks.workunit.client.1.smithi112.stdout:8/21: unlink f4 0 2024-04-25T02:08:45.954 INFO:tasks.workunit.client.0.smithi077.stdout:4/192: mkdir d0/de/d3c 0 2024-04-25T02:08:45.955 INFO:tasks.workunit.client.1.smithi112.stdout:0/54: symlink da/lc 0 2024-04-25T02:08:45.958 INFO:tasks.workunit.client.1.smithi112.stdout:9/15: symlink d1/l6 0 2024-04-25T02:08:45.958 INFO:tasks.workunit.client.1.smithi112.stdout:9/16: truncate d1/f4 604348 0 2024-04-25T02:08:45.959 INFO:tasks.workunit.client.1.smithi112.stdout:9/17: chown f0 199931 1 2024-04-25T02:08:45.959 INFO:tasks.workunit.client.1.smithi112.stdout:9/18: stat d1/f5 0 2024-04-25T02:08:45.959 INFO:tasks.workunit.client.1.smithi112.stdout:9/19: stat d1 0 2024-04-25T02:08:45.960 INFO:tasks.workunit.client.0.smithi077.stdout:7/144: rename d4/f6 to d4/d13/f2f 0 2024-04-25T02:08:45.960 INFO:tasks.workunit.client.0.smithi077.stdout:5/232: rename d0/d25 to d0/d25/d49 22 2024-04-25T02:08:45.960 INFO:tasks.workunit.client.0.smithi077.stdout:5/233: chown d0/d2/d3/d9/d39/d3c 3394 1 2024-04-25T02:08:45.960 INFO:tasks.workunit.client.0.smithi077.stdout:5/234: write d0/d2/d3/f31 [931267,130441] 0 2024-04-25T02:08:45.960 INFO:tasks.workunit.client.0.smithi077.stdout:5/235: getdents d0/d2/d3/d1d/d3e 0 2024-04-25T02:08:45.960 INFO:tasks.workunit.client.1.smithi112.stdout:0/55: symlink da/ld 0 2024-04-25T02:08:45.961 INFO:tasks.workunit.client.1.smithi112.stdout:0/56: write f2 [103864,84539] 0 2024-04-25T02:08:45.961 INFO:tasks.workunit.client.0.smithi077.stdout:9/181: truncate df/f18 897403 0 2024-04-25T02:08:45.962 INFO:tasks.workunit.client.0.smithi077.stdout:4/193: creat d0/d14/d21/d39/da/d12/f3d x:0 0 0 2024-04-25T02:08:45.963 INFO:tasks.workunit.client.0.smithi077.stdout:4/194: truncate d0/d14/d21/d39/da/f2d 2184140 0 2024-04-25T02:08:45.963 INFO:tasks.workunit.client.0.smithi077.stdout:4/195: write d0/d14/d21/f2f [469986,31656] 0 2024-04-25T02:08:45.964 INFO:tasks.workunit.client.1.smithi112.stdout:9/20: mknod d1/c7 0 2024-04-25T02:08:45.964 INFO:tasks.workunit.client.1.smithi112.stdout:9/21: write d1/f4 [153137,93548] 0 2024-04-25T02:08:45.965 INFO:tasks.workunit.client.0.smithi077.stdout:9/182: mknod df/d1b/c3d 0 2024-04-25T02:08:45.968 INFO:tasks.workunit.client.0.smithi077.stdout:9/183: symlink df/d1b/l3e 0 2024-04-25T02:08:45.972 INFO:tasks.workunit.client.0.smithi077.stdout:5/236: write d0/d25/f1a [937674,41969] 0 2024-04-25T02:08:45.974 INFO:tasks.workunit.client.0.smithi077.stdout:5/237: mkdir d0/d2/d20/d23/d4a 0 2024-04-25T02:08:45.980 INFO:tasks.workunit.client.0.smithi077.stdout:4/196: rename d0/d14/d30 to d0/d14/d21/d39/da/d12/d35/d3e 0 2024-04-25T02:08:45.981 INFO:tasks.workunit.client.0.smithi077.stdout:0/214: sync 2024-04-25T02:08:45.981 INFO:tasks.workunit.client.0.smithi077.stdout:0/215: stat d2/d17/d1d/d34/l44 0 2024-04-25T02:08:45.981 INFO:tasks.workunit.client.0.smithi077.stdout:0/216: read d2/d8/d10/f18 [1830583,61066] 0 2024-04-25T02:08:45.981 INFO:tasks.workunit.client.0.smithi077.stdout:4/197: creat d0/d14/d21/d39/da/d12/d35/d3e/f3f x:0 0 0 2024-04-25T02:08:45.982 INFO:tasks.workunit.client.0.smithi077.stdout:3/194: dwrite d0/d7/d15/f2a [0,4194304] 0 2024-04-25T02:08:45.983 INFO:tasks.workunit.client.1.smithi112.stdout:5/15: dwrite f0 [0,4194304] 0 2024-04-25T02:08:45.983 INFO:tasks.workunit.client.1.smithi112.stdout:8/22: dwrite f3 [0,4194304] 0 2024-04-25T02:08:45.983 INFO:tasks.workunit.client.1.smithi112.stdout:9/22: fsync d1/f4 0 2024-04-25T02:08:45.983 INFO:tasks.workunit.client.1.smithi112.stdout:9/23: creat d1/f8 x:0 0 0 2024-04-25T02:08:45.983 INFO:tasks.workunit.client.1.smithi112.stdout:9/24: stat d1/l6 0 2024-04-25T02:08:45.984 INFO:tasks.workunit.client.0.smithi077.stdout:0/217: unlink d2/d17/d1d/d34/f3f 0 2024-04-25T02:08:45.985 INFO:tasks.workunit.client.0.smithi077.stdout:7/145: dread d4/f21 [0,4194304] 0 2024-04-25T02:08:45.985 INFO:tasks.workunit.client.0.smithi077.stdout:4/198: link d0/d14/d21/f2a d0/de/d25/f40 0 2024-04-25T02:08:45.987 INFO:tasks.workunit.client.1.smithi112.stdout:5/16: creat d1/d2/d4/f9 x:0 0 0 2024-04-25T02:08:45.987 INFO:tasks.workunit.client.0.smithi077.stdout:5/238: read d0/d2/d20/f3f [2120111,11135] 0 2024-04-25T02:08:45.994 INFO:tasks.workunit.client.1.smithi112.stdout:8/23: unlink f3 0 2024-04-25T02:08:45.995 INFO:tasks.workunit.client.0.smithi077.stdout:7/146: mkdir d4/d13/d18/d2d/d30 0 2024-04-25T02:08:46.000 INFO:tasks.workunit.client.1.smithi112.stdout:0/57: dread f2 [0,4194304] 0 2024-04-25T02:08:46.001 INFO:tasks.workunit.client.0.smithi077.stdout:5/239: rename d0/d2/d20/d23/f46 to d0/d2/d20/d41/f4b 0 2024-04-25T02:08:46.004 INFO:tasks.workunit.client.0.smithi077.stdout:7/147: mknod d4/d13/d18/d24/c31 0 2024-04-25T02:08:46.006 INFO:tasks.workunit.client.1.smithi112.stdout:9/25: rename d1/l6 to d1/l9 0 2024-04-25T02:08:46.007 INFO:tasks.workunit.client.0.smithi077.stdout:6/235: truncate f1 260095 0 2024-04-25T02:08:46.007 INFO:tasks.workunit.client.0.smithi077.stdout:6/236: truncate de/d12/d25/f2d 444886 0 2024-04-25T02:08:46.009 INFO:tasks.workunit.client.1.smithi112.stdout:8/24: rename f1 to f5 0 2024-04-25T02:08:46.011 INFO:tasks.workunit.client.1.smithi112.stdout:0/58: rename da/ld to da/le 0 2024-04-25T02:08:46.014 INFO:tasks.workunit.client.0.smithi077.stdout:5/240: link d0/d2/d20/f21 d0/d2/d3/d1d/f4c 0 2024-04-25T02:08:46.015 INFO:tasks.workunit.client.0.smithi077.stdout:7/148: mknod d4/d13/d18/c32 0 2024-04-25T02:08:46.016 INFO:tasks.workunit.client.0.smithi077.stdout:7/149: chown d4/d13/c1c 1 1 2024-04-25T02:08:46.017 INFO:tasks.workunit.client.0.smithi077.stdout:6/237: creat de/d15/d36/f56 x:0 0 0 2024-04-25T02:08:46.017 INFO:tasks.workunit.client.0.smithi077.stdout:6/238: stat de/d15/d36/l4f 0 2024-04-25T02:08:46.019 INFO:tasks.workunit.client.0.smithi077.stdout:5/241: symlink d0/d2/d20/l4d 0 2024-04-25T02:08:46.019 INFO:tasks.workunit.client.0.smithi077.stdout:5/242: stat d0/d2/d20/l3d 0 2024-04-25T02:08:46.023 INFO:tasks.workunit.client.0.smithi077.stdout:6/239: rename de/l11 to de/d12/d25/l57 0 2024-04-25T02:08:46.023 INFO:tasks.workunit.client.0.smithi077.stdout:6/240: creat de/d15/d36/f58 x:0 0 0 2024-04-25T02:08:46.028 INFO:tasks.workunit.client.0.smithi077.stdout:7/150: getdents d4 0 2024-04-25T02:08:46.029 INFO:tasks.workunit.client.0.smithi077.stdout:7/151: creat d4/f33 x:0 0 0 2024-04-25T02:08:46.030 INFO:tasks.workunit.client.0.smithi077.stdout:7/152: creat d4/d13/d18/d2d/d30/f34 x:0 0 0 2024-04-25T02:08:46.030 INFO:tasks.workunit.client.0.smithi077.stdout:7/153: readlink d4/lf 0 2024-04-25T02:08:46.030 INFO:tasks.workunit.client.0.smithi077.stdout:7/154: readlink d4/d13/d18/l20 0 2024-04-25T02:08:46.031 INFO:tasks.workunit.client.0.smithi077.stdout:6/241: dread de/d15/f22 [0,4194304] 0 2024-04-25T02:08:46.031 INFO:tasks.workunit.client.0.smithi077.stdout:7/155: symlink d4/d13/d18/d2d/d30/l35 0 2024-04-25T02:08:46.031 INFO:tasks.workunit.client.0.smithi077.stdout:7/156: creat d4/d13/d18/f36 x:0 0 0 2024-04-25T02:08:46.031 INFO:tasks.workunit.client.0.smithi077.stdout:7/157: write d4/d13/d18/d2d/d30/f34 [334423,79859] 0 2024-04-25T02:08:46.032 INFO:tasks.workunit.client.0.smithi077.stdout:6/242: creat de/d12/d25/d4b/f59 x:0 0 0 2024-04-25T02:08:46.032 INFO:tasks.workunit.client.0.smithi077.stdout:6/243: write de/d15/f22 [4348478,55859] 0 2024-04-25T02:08:46.034 INFO:tasks.workunit.client.0.smithi077.stdout:7/158: rmdir d4/d13/d18/d24 39 2024-04-25T02:08:46.034 INFO:tasks.workunit.client.0.smithi077.stdout:7/159: fsync d4/f16 0 2024-04-25T02:08:46.035 INFO:tasks.workunit.client.0.smithi077.stdout:6/244: truncate de/d12/f28 7842541 0 2024-04-25T02:08:46.035 INFO:tasks.workunit.client.0.smithi077.stdout:6/245: chown de/c16 0 1 2024-04-25T02:08:46.035 INFO:tasks.workunit.client.0.smithi077.stdout:6/246: creat de/f5a x:0 0 0 2024-04-25T02:08:46.035 INFO:tasks.workunit.client.0.smithi077.stdout:6/247: write de/d12/d25/f4a [159107,116501] 0 2024-04-25T02:08:46.038 INFO:tasks.workunit.client.0.smithi077.stdout:3/195: dwrite d0/d2/f30 [0,4194304] 0 2024-04-25T02:08:46.045 INFO:tasks.workunit.client.0.smithi077.stdout:6/248: dread f7 [0,4194304] 0 2024-04-25T02:08:46.045 INFO:tasks.workunit.client.0.smithi077.stdout:3/196: mkdir d0/d40 0 2024-04-25T02:08:46.046 INFO:tasks.workunit.client.1.smithi112.stdout:6/28: dwrite d0/d2/d4/f5 [4194304,4194304] 0 2024-04-25T02:08:46.046 INFO:tasks.workunit.client.1.smithi112.stdout:5/17: dwrite f0 [0,4194304] 0 2024-04-25T02:08:46.046 INFO:tasks.workunit.client.0.smithi077.stdout:3/197: link d0/d7/d15/f1d d0/d2/f41 0 2024-04-25T02:08:46.048 INFO:tasks.workunit.client.1.smithi112.stdout:5/18: symlink d1/d2/d4/la 0 2024-04-25T02:08:46.050 INFO:tasks.workunit.client.0.smithi077.stdout:6/249: dread de/d12/d25/f40 [0,4194304] 0 2024-04-25T02:08:46.064 INFO:tasks.workunit.client.1.smithi112.stdout:6/29: dread d0/f3 [0,4194304] 0 2024-04-25T02:08:46.069 INFO:tasks.workunit.client.1.smithi112.stdout:6/30: dread d0/f3 [0,4194304] 0 2024-04-25T02:08:46.070 INFO:tasks.workunit.client.1.smithi112.stdout:6/31: symlink d0/d2/l6 0 2024-04-25T02:08:46.070 INFO:tasks.workunit.client.1.smithi112.stdout:6/32: fdatasync d0/f3 0 2024-04-25T02:08:46.086 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:46 smithi112 ceph-mon[33313]: pgmap v252: 65 pgs: 65 active+clean; 376 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 16 MiB/s rd, 28 MiB/s wr, 415 op/s 2024-04-25T02:08:46.086 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:46 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:08:46.087 INFO:tasks.workunit.client.1.smithi112.stdout:6/33: dwrite d0/f3 [4194304,4194304] 0 2024-04-25T02:08:46.100 INFO:tasks.workunit.client.0.smithi077.stdout:0/218: dwrite d2/d8/d10/f45 [0,4194304] 0 2024-04-25T02:08:46.107 INFO:tasks.workunit.client.0.smithi077.stdout:0/219: write d2/d1c/f24 [486709,32700] 0 2024-04-25T02:08:46.107 INFO:tasks.workunit.client.0.smithi077.stdout:0/220: write d2/d17/d1d/f20 [5589173,16690] 0 2024-04-25T02:08:46.108 INFO:tasks.workunit.client.0.smithi077.stdout:8/257: dwrite d3/da/db/df/d30/f3c [0,4194304] 0 2024-04-25T02:08:46.108 INFO:tasks.workunit.client.0.smithi077.stdout:8/258: write d3/d34/d3d/f42 [991427,55025] 0 2024-04-25T02:08:46.108 INFO:tasks.workunit.client.0.smithi077.stdout:8/259: dread - d3/da/db/df/d30/f40 zero size 2024-04-25T02:08:46.108 INFO:tasks.workunit.client.0.smithi077.stdout:8/260: truncate d3/da/db/df/f10 1151450 0 2024-04-25T02:08:46.110 INFO:tasks.workunit.client.0.smithi077.stdout:0/221: link d2/d8/l1b d2/d8/d10/l4a 0 2024-04-25T02:08:46.110 INFO:tasks.workunit.client.0.smithi077.stdout:0/222: stat d2/d17/c25 0 2024-04-25T02:08:46.112 INFO:tasks.workunit.client.0.smithi077.stdout:8/261: rename d3/da/l14 to d3/da/l52 0 2024-04-25T02:08:46.113 INFO:tasks.workunit.client.0.smithi077.stdout:8/262: mknod d3/da/d27/d16/c53 0 2024-04-25T02:08:46.115 INFO:tasks.workunit.client.0.smithi077.stdout:8/263: unlink d3/da/db/df/d30/f3c 0 2024-04-25T02:08:46.115 INFO:tasks.workunit.client.0.smithi077.stdout:8/264: write d3/da/db/df/d2b/f1d [112034,104945] 0 2024-04-25T02:08:46.115 INFO:tasks.workunit.client.0.smithi077.stdout:4/199: dwrite d0/d14/d21/d39/da/d12/f3d [0,4194304] 0 2024-04-25T02:08:46.116 INFO:tasks.workunit.client.0.smithi077.stdout:8/265: truncate d3/da/d27/f47 410672 0 2024-04-25T02:08:46.122 INFO:tasks.workunit.client.0.smithi077.stdout:4/200: creat d0/de/d34/f41 x:0 0 0 2024-04-25T02:08:46.122 INFO:tasks.workunit.client.0.smithi077.stdout:4/201: fdatasync d0/d14/d21/d39/da/d12/d35/d3e/f3f 0 2024-04-25T02:08:46.122 INFO:tasks.workunit.client.0.smithi077.stdout:4/202: truncate d0/f20 1016693 0 2024-04-25T02:08:46.122 INFO:tasks.workunit.client.0.smithi077.stdout:4/203: write d0/d14/d21/d39/f3b [622061,52603] 0 2024-04-25T02:08:46.122 INFO:tasks.workunit.client.0.smithi077.stdout:8/266: mknod d3/da/db/c54 0 2024-04-25T02:08:46.123 INFO:tasks.workunit.client.0.smithi077.stdout:8/267: chown d3/da/db/df/d2b/f1d 26 1 2024-04-25T02:08:46.123 INFO:tasks.workunit.client.0.smithi077.stdout:8/268: fsync d3/da/d27/f2d 0 2024-04-25T02:08:46.123 INFO:tasks.workunit.client.0.smithi077.stdout:4/204: creat d0/d14/d21/d39/f42 x:0 0 0 2024-04-25T02:08:46.124 INFO:tasks.workunit.client.0.smithi077.stdout:5/243: dwrite d0/d2/d3/d9/d39/d44/f45 [0,4194304] 0 2024-04-25T02:08:46.125 INFO:tasks.workunit.client.0.smithi077.stdout:3/198: dwrite d0/d2/de/f1b [0,4194304] 0 2024-04-25T02:08:46.125 INFO:tasks.workunit.client.0.smithi077.stdout:6/250: dwrite de/d12/d25/f29 [0,4194304] 0 2024-04-25T02:08:46.125 INFO:tasks.workunit.client.1.smithi112.stdout:5/19: dwrite d1/d2/f7 [0,4194304] 0 2024-04-25T02:08:46.125 INFO:tasks.workunit.client.1.smithi112.stdout:5/20: creat d1/d2/fb x:0 0 0 2024-04-25T02:08:46.126 INFO:tasks.workunit.client.0.smithi077.stdout:8/269: getdents d3/da/d27 0 2024-04-25T02:08:46.126 INFO:tasks.workunit.client.0.smithi077.stdout:8/270: write d3/da/d27/f21 [4473118,6131] 0 2024-04-25T02:08:46.126 INFO:tasks.workunit.client.0.smithi077.stdout:8/271: write d3/da/d27/f2d [673247,120523] 0 2024-04-25T02:08:46.132 INFO:tasks.workunit.client.0.smithi077.stdout:6/251: mkdir de/d5b 0 2024-04-25T02:08:46.135 INFO:tasks.workunit.client.0.smithi077.stdout:8/272: creat d3/da/db/df/d30/f55 x:0 0 0 2024-04-25T02:08:46.136 INFO:tasks.workunit.client.0.smithi077.stdout:6/252: mknod de/d12/d25/d38/c5c 0 2024-04-25T02:08:46.139 INFO:tasks.workunit.client.0.smithi077.stdout:5/244: read d0/d2/d3/f15 [4292239,3336] 0 2024-04-25T02:08:46.139 INFO:tasks.workunit.client.0.smithi077.stdout:7/160: dwrite d4/fe [0,4194304] 0 2024-04-25T02:08:46.139 INFO:tasks.workunit.client.0.smithi077.stdout:7/161: truncate d4/d13/d18/d28/f2b 1022261 0 2024-04-25T02:08:46.139 INFO:tasks.workunit.client.1.smithi112.stdout:9/26: getdents d1 0 2024-04-25T02:08:46.140 INFO:tasks.workunit.client.1.smithi112.stdout:9/27: getdents d1 0 2024-04-25T02:08:46.140 INFO:tasks.workunit.client.0.smithi077.stdout:3/199: dread d0/d17/f19 [0,4194304] 0 2024-04-25T02:08:46.141 INFO:tasks.workunit.client.0.smithi077.stdout:6/253: unlink de/c3e 0 2024-04-25T02:08:46.142 INFO:tasks.workunit.client.0.smithi077.stdout:8/273: getdents d3/d34/d3d 0 2024-04-25T02:08:46.143 INFO:tasks.workunit.client.0.smithi077.stdout:8/274: readlink d3/da/l4b 0 2024-04-25T02:08:46.144 INFO:tasks.workunit.client.1.smithi112.stdout:8/25: rename f5 to f6 0 2024-04-25T02:08:46.144 INFO:tasks.workunit.client.1.smithi112.stdout:8/26: readlink - no filename 2024-04-25T02:08:46.146 INFO:tasks.workunit.client.1.smithi112.stdout:9/28: creat d1/fa x:0 0 0 2024-04-25T02:08:46.146 INFO:tasks.workunit.client.1.smithi112.stdout:9/29: write d1/fa [616248,56477] 0 2024-04-25T02:08:46.146 INFO:tasks.workunit.client.1.smithi112.stdout:0/59: rmdir da 39 2024-04-25T02:08:46.148 INFO:tasks.workunit.client.0.smithi077.stdout:0/223: dread d2/d17/d1d/f20 [0,4194304] 0 2024-04-25T02:08:46.148 INFO:tasks.workunit.client.0.smithi077.stdout:0/224: read d2/d8/d10/f18 [2463638,22101] 0 2024-04-25T02:08:46.148 INFO:tasks.workunit.client.0.smithi077.stdout:4/205: dwrite d0/d14/d21/d39/da/d12/f3d [0,4194304] 0 2024-04-25T02:08:46.149 INFO:tasks.workunit.client.1.smithi112.stdout:9/30: creat d1/fb x:0 0 0 2024-04-25T02:08:46.151 INFO:tasks.workunit.client.1.smithi112.stdout:5/21: dwrite d1/f6 [0,4194304] 0 2024-04-25T02:08:46.151 INFO:tasks.workunit.client.1.smithi112.stdout:0/60: unlink c8 0 2024-04-25T02:08:46.157 INFO:tasks.workunit.client.0.smithi077.stdout:6/254: read de/d12/f17 [192762,100593] 0 2024-04-25T02:08:46.157 INFO:tasks.workunit.client.0.smithi077.stdout:6/255: chown de/d12/f17 4640673 1 2024-04-25T02:08:46.158 INFO:tasks.workunit.client.0.smithi077.stdout:6/256: write fd [2026430,73797] 0 2024-04-25T02:08:46.159 INFO:tasks.workunit.client.1.smithi112.stdout:8/27: dread f2 [0,4194304] 0 2024-04-25T02:08:46.160 INFO:tasks.workunit.client.0.smithi077.stdout:5/245: mknod d0/d2/d3/d9/d39/d44/c4e 0 2024-04-25T02:08:46.165 INFO:tasks.workunit.client.0.smithi077.stdout:7/162: link d4/fa d4/f37 0 2024-04-25T02:08:46.165 INFO:tasks.workunit.client.0.smithi077.stdout:7/163: creat d4/d13/f38 x:0 0 0 2024-04-25T02:08:46.165 INFO:tasks.workunit.client.0.smithi077.stdout:7/164: stat d4/d13/d18/d2d 0 2024-04-25T02:08:46.166 INFO:tasks.workunit.client.1.smithi112.stdout:0/61: mknod da/cf 0 2024-04-25T02:08:46.166 INFO:tasks.workunit.client.1.smithi112.stdout:0/62: write da/fb [3303339,114566] 0 2024-04-25T02:08:46.166 INFO:tasks.workunit.client.1.smithi112.stdout:0/63: readlink da/lc 0 2024-04-25T02:08:46.168 INFO:tasks.workunit.client.0.smithi077.stdout:3/200: mkdir d0/d3e/d42 0 2024-04-25T02:08:46.168 INFO:tasks.workunit.client.0.smithi077.stdout:3/201: chown d0/d7/d15/f2b 4430782 1 2024-04-25T02:08:46.168 INFO:tasks.workunit.client.0.smithi077.stdout:3/202: creat d0/d7/d15/f43 x:0 0 0 2024-04-25T02:08:46.168 INFO:tasks.workunit.client.0.smithi077.stdout:3/203: write d0/d7/d15/f38 [827325,357] 0 2024-04-25T02:08:46.169 INFO:tasks.workunit.client.1.smithi112.stdout:9/31: mknod d1/cc 0 2024-04-25T02:08:46.171 INFO:tasks.workunit.client.0.smithi077.stdout:8/275: symlink d3/l56 0 2024-04-25T02:08:46.171 INFO:tasks.workunit.client.0.smithi077.stdout:8/276: write d3/f8 [3932779,120249] 0 2024-04-25T02:08:46.173 INFO:tasks.workunit.client.0.smithi077.stdout:5/246: creat d0/d2/d1b/d35/f4f x:0 0 0 2024-04-25T02:08:46.173 INFO:tasks.workunit.client.0.smithi077.stdout:5/247: write d0/d2/d3/f15 [3252420,80383] 0 2024-04-25T02:08:46.176 INFO:tasks.workunit.client.0.smithi077.stdout:4/206: dwrite d0/d14/d21/d39/da/d12/d35/d3e/f38 [0,4194304] 0 2024-04-25T02:08:46.176 INFO:tasks.workunit.client.0.smithi077.stdout:4/207: write d0/d14/d21/d39/da/f2d [914338,8558] 0 2024-04-25T02:08:46.176 INFO:tasks.workunit.client.0.smithi077.stdout:0/225: dwrite d2/d27/f2b [0,4194304] 0 2024-04-25T02:08:46.176 INFO:tasks.workunit.client.0.smithi077.stdout:0/226: chown d2/d27/d2d/f2f 2725673 1 2024-04-25T02:08:46.177 INFO:tasks.workunit.client.1.smithi112.stdout:0/64: rmdir da 39 2024-04-25T02:08:46.177 INFO:tasks.workunit.client.1.smithi112.stdout:0/65: read da/fb [372459,64193] 0 2024-04-25T02:08:46.180 INFO:tasks.workunit.client.0.smithi077.stdout:3/204: creat d0/d7/f44 x:0 0 0 2024-04-25T02:08:46.180 INFO:tasks.workunit.client.0.smithi077.stdout:3/205: fdatasync d0/f9 0 2024-04-25T02:08:46.180 INFO:tasks.workunit.client.1.smithi112.stdout:6/34: truncate d0/d2/d4/f5 2319922 0 2024-04-25T02:08:46.181 INFO:tasks.workunit.client.1.smithi112.stdout:6/35: creat d0/f7 x:0 0 0 2024-04-25T02:08:46.181 INFO:tasks.workunit.client.1.smithi112.stdout:0/66: creat da/f10 x:0 0 0 2024-04-25T02:08:46.182 INFO:tasks.workunit.client.0.smithi077.stdout:6/257: dwrite de/d12/f28 [4194304,4194304] 0 2024-04-25T02:08:46.183 INFO:tasks.workunit.client.0.smithi077.stdout:8/277: mkdir d3/da/d27/d16/d57 0 2024-04-25T02:08:46.183 INFO:tasks.workunit.client.0.smithi077.stdout:8/278: fsync d3/da/d27/f1e 0 2024-04-25T02:08:46.184 INFO:tasks.workunit.client.0.smithi077.stdout:8/279: stat d3/d34/f48 0 2024-04-25T02:08:46.184 INFO:tasks.workunit.client.0.smithi077.stdout:5/248: creat d0/f50 x:0 0 0 2024-04-25T02:08:46.184 INFO:tasks.workunit.client.0.smithi077.stdout:5/249: write d0/d2/d3/d1d/f28 [866768,114138] 0 2024-04-25T02:08:46.185 INFO:tasks.workunit.client.0.smithi077.stdout:5/250: stat d0/d2/d3/d9/f2a 0 2024-04-25T02:08:46.250 INFO:tasks.workunit.client.1.smithi112.stdout:0/67: mknod da/c11 0 2024-04-25T02:08:46.250 INFO:tasks.workunit.client.1.smithi112.stdout:0/68: chown da/le 2 1 2024-04-25T02:08:46.250 INFO:tasks.workunit.client.1.smithi112.stdout:0/69: truncate f7 2039972 0 2024-04-25T02:08:46.250 INFO:tasks.workunit.client.1.smithi112.stdout:0/70: write da/f10 [712730,10213] 0 2024-04-25T02:08:46.250 INFO:tasks.workunit.client.1.smithi112.stdout:0/71: fdatasync f2 0 2024-04-25T02:08:46.251 INFO:tasks.workunit.client.1.smithi112.stdout:0/72: fdatasync da/f10 0 2024-04-25T02:08:46.252 INFO:tasks.workunit.client.0.smithi077.stdout:4/208: symlink d0/d14/d21/l43 0 2024-04-25T02:08:46.253 INFO:tasks.workunit.client.0.smithi077.stdout:0/227: creat d2/f4b x:0 0 0 2024-04-25T02:08:46.253 INFO:tasks.workunit.client.0.smithi077.stdout:0/228: readlink d2/d17/d1d/d34/l44 0 2024-04-25T02:08:46.253 INFO:tasks.workunit.client.0.smithi077.stdout:0/229: chown d2 7 1 2024-04-25T02:08:46.255 INFO:tasks.workunit.client.0.smithi077.stdout:0/230: dread d2/d27/f3b [0,4194304] 0 2024-04-25T02:08:46.255 INFO:tasks.workunit.client.0.smithi077.stdout:3/206: unlink d0/d2/de/l2e 0 2024-04-25T02:08:46.256 INFO:tasks.workunit.client.0.smithi077.stdout:2/223: sync 2024-04-25T02:08:46.256 INFO:tasks.workunit.client.0.smithi077.stdout:6/258: rmdir de/d15 39 2024-04-25T02:08:46.257 INFO:tasks.workunit.client.0.smithi077.stdout:8/280: mknod d3/da/d27/d16/d57/c58 0 2024-04-25T02:08:46.258 INFO:tasks.workunit.client.0.smithi077.stdout:5/251: creat d0/f51 x:0 0 0 2024-04-25T02:08:46.258 INFO:tasks.workunit.client.0.smithi077.stdout:3/207: dread d0/d2/f34 [0,4194304] 0 2024-04-25T02:08:46.259 INFO:tasks.workunit.client.0.smithi077.stdout:4/209: creat d0/de/f44 x:0 0 0 2024-04-25T02:08:46.259 INFO:tasks.workunit.client.1.smithi112.stdout:0/73: dread f2 [0,4194304] 0 2024-04-25T02:08:46.259 INFO:tasks.workunit.client.1.smithi112.stdout:0/74: creat da/f12 x:0 0 0 2024-04-25T02:08:46.259 INFO:tasks.workunit.client.1.smithi112.stdout:0/75: dread - da/f12 zero size 2024-04-25T02:08:46.260 INFO:tasks.workunit.client.0.smithi077.stdout:0/231: truncate d2/f6 922254 0 2024-04-25T02:08:46.260 INFO:tasks.workunit.client.0.smithi077.stdout:0/232: read - d2/d17/d1d/d34/f36 zero size 2024-04-25T02:08:46.262 INFO:tasks.workunit.client.0.smithi077.stdout:6/259: truncate f9 1152964 0 2024-04-25T02:08:46.271 INFO:tasks.workunit.client.0.smithi077.stdout:0/233: unlink d2/l3e 0 2024-04-25T02:08:46.273 INFO:tasks.workunit.client.0.smithi077.stdout:5/252: getdents d0/d2/d20/d23 0 2024-04-25T02:08:46.273 INFO:tasks.workunit.client.0.smithi077.stdout:3/208: mknod d0/c45 0 2024-04-25T02:08:46.274 INFO:tasks.workunit.client.1.smithi112.stdout:5/22: rmdir d1 39 2024-04-25T02:08:46.276 INFO:tasks.workunit.client.0.smithi077.stdout:0/234: mkdir d2/d17/d1d/d34/d4c 0 2024-04-25T02:08:46.277 INFO:tasks.workunit.client.0.smithi077.stdout:2/224: dwrite d2/d9/d19/d1c/f44 [0,4194304] 0 2024-04-25T02:08:46.279 INFO:tasks.workunit.client.0.smithi077.stdout:3/209: link d0/d2/f30 d0/d2/d2f/f46 0 2024-04-25T02:08:46.279 INFO:tasks.workunit.client.0.smithi077.stdout:3/210: dread - d0/d7/f44 zero size 2024-04-25T02:08:46.280 INFO:tasks.workunit.client.0.smithi077.stdout:0/235: mknod d2/d27/d2d/c4d 0 2024-04-25T02:08:46.282 INFO:tasks.workunit.client.0.smithi077.stdout:5/253: mkdir d0/d2/d52 0 2024-04-25T02:08:46.282 INFO:tasks.workunit.client.0.smithi077.stdout:5/254: creat d0/d2/d3/d9/d39/d44/f53 x:0 0 0 2024-04-25T02:08:46.282 INFO:tasks.workunit.client.0.smithi077.stdout:5/255: chown d0/d2/d3/d9/c37 13539 1 2024-04-25T02:08:46.282 INFO:tasks.workunit.client.0.smithi077.stdout:5/256: creat d0/d2/d1b/f54 x:0 0 0 2024-04-25T02:08:46.282 INFO:tasks.workunit.client.0.smithi077.stdout:5/257: write d0/d2/d3/d1d/f28 [1983083,77531] 0 2024-04-25T02:08:46.282 INFO:tasks.workunit.client.0.smithi077.stdout:5/258: creat d0/d2/d3/f55 x:0 0 0 2024-04-25T02:08:46.282 INFO:tasks.workunit.client.0.smithi077.stdout:5/259: stat d0/d25/f47 0 2024-04-25T02:08:46.283 INFO:tasks.workunit.client.1.smithi112.stdout:8/28: link f6 f7 0 2024-04-25T02:08:46.286 INFO:tasks.workunit.client.0.smithi077.stdout:2/225: dread d2/d9/fb [0,4194304] 0 2024-04-25T02:08:46.287 INFO:tasks.workunit.client.1.smithi112.stdout:5/23: read f0 [1600025,114752] 0 2024-04-25T02:08:46.288 INFO:tasks.workunit.client.0.smithi077.stdout:9/184: sync 2024-04-25T02:08:46.288 INFO:tasks.workunit.client.0.smithi077.stdout:1/192: sync 2024-04-25T02:08:46.289 INFO:tasks.workunit.client.0.smithi077.stdout:1/193: write f8 [72563,88111] 0 2024-04-25T02:08:46.289 INFO:tasks.workunit.client.0.smithi077.stdout:1/194: write db/df/d14/d33/d34/f36 [104584,11861] 0 2024-04-25T02:08:46.289 INFO:tasks.workunit.client.0.smithi077.stdout:1/195: dread - db/d26/f3c zero size 2024-04-25T02:08:46.289 INFO:tasks.workunit.client.0.smithi077.stdout:3/211: write d0/d2/d2f/f46 [2661419,7990] 0 2024-04-25T02:08:46.289 INFO:tasks.workunit.client.0.smithi077.stdout:6/260: dwrite fd [0,4194304] 0 2024-04-25T02:08:46.289 INFO:tasks.workunit.client.0.smithi077.stdout:6/261: write de/d15/d36/f56 [600921,108365] 0 2024-04-25T02:08:46.289 INFO:tasks.workunit.client.1.smithi112.stdout:0/76: dwrite da/f12 [0,4194304] 0 2024-04-25T02:08:46.290 INFO:tasks.workunit.client.1.smithi112.stdout:5/24: rmdir d1/d2/d4 39 2024-04-25T02:08:46.290 INFO:tasks.workunit.client.1.smithi112.stdout:5/25: rename d1/d2/d4 to d1/d2/d4/dc 22 2024-04-25T02:08:46.290 INFO:tasks.workunit.client.1.smithi112.stdout:5/26: read - d1/f5 zero size 2024-04-25T02:08:46.291 INFO:tasks.workunit.client.0.smithi077.stdout:5/260: symlink d0/d2/d3/l56 0 2024-04-25T02:08:46.292 INFO:tasks.workunit.client.0.smithi077.stdout:7/165: truncate d4/fe 2229384 0 2024-04-25T02:08:46.295 INFO:tasks.workunit.client.1.smithi112.stdout:8/29: dread f2 [4194304,4194304] 0 2024-04-25T02:08:46.295 INFO:tasks.workunit.client.1.smithi112.stdout:8/30: fdatasync f2 0 2024-04-25T02:08:46.298 INFO:tasks.workunit.client.1.smithi112.stdout:5/27: dread f0 [0,4194304] 0 2024-04-25T02:08:46.298 INFO:tasks.workunit.client.1.smithi112.stdout:5/28: chown d1/f5 1236904365 1 2024-04-25T02:08:46.298 INFO:tasks.workunit.client.1.smithi112.stdout:5/29: dread - d1/f8 zero size 2024-04-25T02:08:46.298 INFO:tasks.workunit.client.1.smithi112.stdout:5/30: read f0 [3136046,66505] 0 2024-04-25T02:08:46.298 INFO:tasks.workunit.client.1.smithi112.stdout:0/77: mkdir da/d13 0 2024-04-25T02:08:46.300 INFO:tasks.workunit.client.1.smithi112.stdout:0/78: dread da/f10 [0,4194304] 0 2024-04-25T02:08:46.301 INFO:tasks.workunit.client.1.smithi112.stdout:9/32: getdents d1 0 2024-04-25T02:08:46.301 INFO:tasks.workunit.client.1.smithi112.stdout:8/31: dread f7 [4194304,4194304] 0 2024-04-25T02:08:46.302 INFO:tasks.workunit.client.0.smithi077.stdout:6/262: dread fd [0,4194304] 0 2024-04-25T02:08:46.303 INFO:tasks.workunit.client.1.smithi112.stdout:0/79: rename da/c11 to da/c14 0 2024-04-25T02:08:46.305 INFO:tasks.workunit.client.1.smithi112.stdout:9/33: creat d1/fd x:0 0 0 2024-04-25T02:08:46.305 INFO:tasks.workunit.client.1.smithi112.stdout:9/34: truncate d1/fd 784768 0 2024-04-25T02:08:46.306 INFO:tasks.workunit.client.1.smithi112.stdout:5/31: dread d1/d2/f7 [0,4194304] 0 2024-04-25T02:08:46.306 INFO:tasks.workunit.client.1.smithi112.stdout:8/32: write f7 [260754,17008] 0 2024-04-25T02:08:46.306 INFO:tasks.workunit.client.1.smithi112.stdout:8/33: write f2 [3774227,15754] 0 2024-04-25T02:08:46.306 INFO:tasks.workunit.client.1.smithi112.stdout:8/34: creat f8 x:0 0 0 2024-04-25T02:08:46.307 INFO:tasks.workunit.client.1.smithi112.stdout:0/80: creat da/d13/f15 x:0 0 0 2024-04-25T02:08:46.307 INFO:tasks.workunit.client.1.smithi112.stdout:0/81: write da/d13/f15 [941110,120841] 0 2024-04-25T02:08:46.307 INFO:tasks.workunit.client.1.smithi112.stdout:0/82: creat da/f16 x:0 0 0 2024-04-25T02:08:46.307 INFO:tasks.workunit.client.1.smithi112.stdout:0/83: creat da/d13/f17 x:0 0 0 2024-04-25T02:08:46.307 INFO:tasks.workunit.client.1.smithi112.stdout:0/84: truncate da/d13/f17 437763 0 2024-04-25T02:08:46.307 INFO:tasks.workunit.client.1.smithi112.stdout:0/85: chown l9 0 1 2024-04-25T02:08:46.308 INFO:tasks.workunit.client.1.smithi112.stdout:0/86: chown da/d13/f17 214702465 1 2024-04-25T02:08:46.311 INFO:tasks.workunit.client.1.smithi112.stdout:5/32: write d1/d2/f7 [750715,7140] 0 2024-04-25T02:08:46.311 INFO:tasks.workunit.client.1.smithi112.stdout:5/33: truncate d1/d2/d4/f9 431709 0 2024-04-25T02:08:46.312 INFO:tasks.workunit.client.0.smithi077.stdout:9/185: symlink df/l3f 0 2024-04-25T02:08:46.312 INFO:tasks.workunit.client.0.smithi077.stdout:9/186: creat df/d1b/f40 x:0 0 0 2024-04-25T02:08:46.313 INFO:tasks.workunit.client.1.smithi112.stdout:8/35: symlink l9 0 2024-04-25T02:08:46.313 INFO:tasks.workunit.client.1.smithi112.stdout:8/36: write f2 [1156414,4559] 0 2024-04-25T02:08:46.313 INFO:tasks.workunit.client.1.smithi112.stdout:8/37: creat fa x:0 0 0 2024-04-25T02:08:46.315 INFO:tasks.workunit.client.0.smithi077.stdout:3/212: unlink d0/d2/f30 0 2024-04-25T02:08:46.316 INFO:tasks.workunit.client.0.smithi077.stdout:0/236: truncate d2/d27/f2b 725029 0 2024-04-25T02:08:46.320 INFO:tasks.workunit.client.1.smithi112.stdout:0/87: rename f7 to da/f18 0 2024-04-25T02:08:46.320 INFO:tasks.workunit.client.1.smithi112.stdout:0/88: fdatasync da/f16 0 2024-04-25T02:08:46.322 INFO:tasks.workunit.client.0.smithi077.stdout:7/166: rename d4/d13/c1e to d4/d13/d18/d2d/d30/c39 0 2024-04-25T02:08:46.323 INFO:tasks.workunit.client.1.smithi112.stdout:9/35: symlink d1/le 0 2024-04-25T02:08:46.324 INFO:tasks.workunit.client.0.smithi077.stdout:2/226: rmdir d2/d9/d19/d1c/d3f 39 2024-04-25T02:08:46.324 INFO:tasks.workunit.client.0.smithi077.stdout:2/227: truncate d2/d9/d19/d1c/f33 1224970 0 2024-04-25T02:08:46.325 INFO:tasks.workunit.client.1.smithi112.stdout:5/34: mknod d1/d2/d4/cd 0 2024-04-25T02:08:46.327 INFO:tasks.workunit.client.0.smithi077.stdout:6/263: creat de/d12/d25/d44/f5d x:0 0 0 2024-04-25T02:08:46.331 INFO:tasks.workunit.client.1.smithi112.stdout:8/38: rename f2 to fb 0 2024-04-25T02:08:46.331 INFO:tasks.workunit.client.0.smithi077.stdout:2/228: write d2/d28/f32 [554646,3762] 0 2024-04-25T02:08:46.332 INFO:tasks.workunit.client.0.smithi077.stdout:1/196: mknod db/d11/c41 0 2024-04-25T02:08:46.333 INFO:tasks.workunit.client.0.smithi077.stdout:1/197: chown db/df/d14/l19 30504 1 2024-04-25T02:08:46.333 INFO:tasks.workunit.client.0.smithi077.stdout:1/198: readlink db/d11/d32/l3a 0 2024-04-25T02:08:46.334 INFO:tasks.workunit.client.1.smithi112.stdout:0/89: rename c6 to da/c19 0 2024-04-25T02:08:46.336 INFO:tasks.workunit.client.0.smithi077.stdout:3/213: mknod d0/d40/c47 0 2024-04-25T02:08:46.338 INFO:tasks.workunit.client.0.smithi077.stdout:5/261: rmdir d0/d25 39 2024-04-25T02:08:46.340 INFO:tasks.workunit.client.1.smithi112.stdout:0/90: symlink da/l1a 0 2024-04-25T02:08:46.342 INFO:tasks.workunit.client.0.smithi077.stdout:9/187: rename fd to df/f41 0 2024-04-25T02:08:46.343 INFO:tasks.workunit.client.1.smithi112.stdout:9/36: mkdir d1/df 0 2024-04-25T02:08:46.346 INFO:tasks.workunit.client.1.smithi112.stdout:8/39: dwrite fa [0,4194304] 0 2024-04-25T02:08:46.348 INFO:tasks.workunit.client.1.smithi112.stdout:0/91: rename da/le to da/l1b 0 2024-04-25T02:08:46.353 INFO:tasks.workunit.client.1.smithi112.stdout:5/35: dwrite d1/d2/f7 [0,4194304] 0 2024-04-25T02:08:46.357 INFO:tasks.workunit.client.0.smithi077.stdout:8/281: truncate d3/da/d27/f47 110047 0 2024-04-25T02:08:46.360 INFO:tasks.workunit.client.0.smithi077.stdout:2/229: mknod d2/d9/d18/d1b/c45 0 2024-04-25T02:08:46.360 INFO:tasks.workunit.client.0.smithi077.stdout:2/230: chown d2/d9 8023845 1 2024-04-25T02:08:46.362 INFO:tasks.workunit.client.0.smithi077.stdout:3/214: readlink d0/d7/l6 0 2024-04-25T02:08:46.363 INFO:tasks.workunit.client.1.smithi112.stdout:0/92: dwrite da/f10 [0,4194304] 0 2024-04-25T02:08:46.363 INFO:tasks.workunit.client.0.smithi077.stdout:5/262: mknod d0/d2/d52/c57 0 2024-04-25T02:08:46.364 INFO:tasks.workunit.client.0.smithi077.stdout:9/188: stat df/c25 0 2024-04-25T02:08:46.365 INFO:tasks.workunit.client.0.smithi077.stdout:1/199: mkdir db/d11/d42 0 2024-04-25T02:08:46.368 INFO:tasks.workunit.client.0.smithi077.stdout:5/263: rmdir d0/d2/d5/d43 0 2024-04-25T02:08:46.368 INFO:tasks.workunit.client.0.smithi077.stdout:5/264: readlink d0/l11 0 2024-04-25T02:08:46.368 INFO:tasks.workunit.client.1.smithi112.stdout:0/93: symlink da/l1c 0 2024-04-25T02:08:46.370 INFO:tasks.workunit.client.0.smithi077.stdout:9/189: link df/f10 df/d1b/f42 0 2024-04-25T02:08:46.371 INFO:tasks.workunit.client.0.smithi077.stdout:1/200: mkdir db/d11/d42/d43 0 2024-04-25T02:08:46.373 INFO:tasks.workunit.client.1.smithi112.stdout:0/94: mkdir da/d1d 0 2024-04-25T02:08:46.373 INFO:tasks.workunit.client.1.smithi112.stdout:0/95: truncate da/d13/f15 1792121 0 2024-04-25T02:08:46.373 INFO:tasks.workunit.client.0.smithi077.stdout:3/215: dread d0/d2/de/f1b [0,4194304] 0 2024-04-25T02:08:46.374 INFO:tasks.workunit.client.0.smithi077.stdout:3/216: write d0/d7/d15/f2b [463396,36043] 0 2024-04-25T02:08:46.374 INFO:tasks.workunit.client.0.smithi077.stdout:5/265: mknod d0/d2/d1b/c58 0 2024-04-25T02:08:46.375 INFO:tasks.workunit.client.0.smithi077.stdout:9/190: unlink df/l1c 0 2024-04-25T02:08:46.377 INFO:tasks.workunit.client.0.smithi077.stdout:1/201: truncate db/f18 3807355 0 2024-04-25T02:08:46.377 INFO:tasks.workunit.client.0.smithi077.stdout:1/202: dread - db/df/d14/d33/f38 zero size 2024-04-25T02:08:46.378 INFO:tasks.workunit.client.1.smithi112.stdout:0/96: fdatasync da/d13/f15 0 2024-04-25T02:08:46.378 INFO:tasks.workunit.client.1.smithi112.stdout:5/36: dwrite f0 [0,4194304] 0 2024-04-25T02:08:46.384 INFO:tasks.workunit.client.1.smithi112.stdout:5/37: creat d1/d2/d4/fe x:0 0 0 2024-04-25T02:08:46.384 INFO:tasks.workunit.client.1.smithi112.stdout:5/38: chown d1/d2/d4 105128544 1 2024-04-25T02:08:46.391 INFO:tasks.workunit.client.0.smithi077.stdout:0/237: read d2/d27/f2b [184720,106402] 0 2024-04-25T02:08:46.391 INFO:tasks.workunit.client.0.smithi077.stdout:0/238: stat d2/d17/d1d/f3d 0 2024-04-25T02:08:46.391 INFO:tasks.workunit.client.0.smithi077.stdout:0/239: stat d2/f4b 0 2024-04-25T02:08:46.391 INFO:tasks.workunit.client.1.smithi112.stdout:0/97: dread da/fb [0,4194304] 0 2024-04-25T02:08:46.392 INFO:tasks.workunit.client.0.smithi077.stdout:0/240: dread d2/d8/fe [0,4194304] 0 2024-04-25T02:08:46.393 INFO:tasks.workunit.client.0.smithi077.stdout:1/203: truncate db/d11/f15 151759 0 2024-04-25T02:08:46.393 INFO:tasks.workunit.client.0.smithi077.stdout:1/204: write f8 [719376,62721] 0 2024-04-25T02:08:46.393 INFO:tasks.workunit.client.0.smithi077.stdout:1/205: fdatasync db/df/d14/d33/d34/f36 0 2024-04-25T02:08:46.394 INFO:tasks.workunit.client.1.smithi112.stdout:0/98: mkdir da/d13/d1e 0 2024-04-25T02:08:46.395 INFO:tasks.workunit.client.1.smithi112.stdout:5/39: write d1/d2/f7 [618916,4303] 0 2024-04-25T02:08:46.395 INFO:tasks.workunit.client.1.smithi112.stdout:5/40: creat d1/d2/d4/ff x:0 0 0 2024-04-25T02:08:46.395 INFO:tasks.workunit.client.1.smithi112.stdout:5/41: chown d1/d2 1877 1 2024-04-25T02:08:46.397 INFO:tasks.workunit.client.0.smithi077.stdout:3/217: rename d0/d7 to d0/d2/de/d48 0 2024-04-25T02:08:46.398 INFO:tasks.workunit.client.1.smithi112.stdout:8/40: getdents . 0 2024-04-25T02:08:46.399 INFO:tasks.workunit.client.0.smithi077.stdout:5/266: dwrite d0/d25/f36 [0,4194304] 0 2024-04-25T02:08:46.400 INFO:tasks.workunit.client.0.smithi077.stdout:9/191: dwrite df/f17 [0,4194304] 0 2024-04-25T02:08:46.400 INFO:tasks.workunit.client.0.smithi077.stdout:9/192: fsync fc 0 2024-04-25T02:08:46.400 INFO:tasks.workunit.client.0.smithi077.stdout:9/193: creat df/f43 x:0 0 0 2024-04-25T02:08:46.402 INFO:tasks.workunit.client.0.smithi077.stdout:0/241: mkdir d2/d17/d4e 0 2024-04-25T02:08:46.402 INFO:tasks.workunit.client.1.smithi112.stdout:0/99: dread da/fb [0,4194304] 0 2024-04-25T02:08:46.402 INFO:tasks.workunit.client.1.smithi112.stdout:0/100: stat da/l1a 0 2024-04-25T02:08:46.402 INFO:tasks.workunit.client.1.smithi112.stdout:0/101: truncate da/f12 4914934 0 2024-04-25T02:08:46.404 INFO:tasks.workunit.client.1.smithi112.stdout:8/41: rename f8 to fc 0 2024-04-25T02:08:46.405 INFO:tasks.workunit.client.0.smithi077.stdout:3/218: write d0/d2/de/d48/d15/f2a [3730966,125612] 0 2024-04-25T02:08:46.405 INFO:tasks.workunit.client.0.smithi077.stdout:3/219: fdatasync d0/d2/f18 0 2024-04-25T02:08:46.406 INFO:tasks.workunit.client.0.smithi077.stdout:5/267: link d0/d2/d3/l56 d0/d2/d3/d9/d39/d3c/l59 0 2024-04-25T02:08:46.409 INFO:tasks.workunit.client.1.smithi112.stdout:9/37: rmdir d1 39 2024-04-25T02:08:46.410 INFO:tasks.workunit.client.1.smithi112.stdout:0/102: write da/f10 [336413,25365] 0 2024-04-25T02:08:46.410 INFO:tasks.workunit.client.1.smithi112.stdout:0/103: fdatasync f2 0 2024-04-25T02:08:46.411 INFO:tasks.workunit.client.1.smithi112.stdout:8/42: unlink l9 0 2024-04-25T02:08:46.413 INFO:tasks.workunit.client.1.smithi112.stdout:5/42: dwrite d1/d2/d4/ff [0,4194304] 0 2024-04-25T02:08:46.417 INFO:tasks.workunit.client.1.smithi112.stdout:0/104: dread da/f10 [0,4194304] 0 2024-04-25T02:08:46.418 INFO:tasks.workunit.client.0.smithi077.stdout:3/220: write d0/d2/f41 [311029,6985] 0 2024-04-25T02:08:46.418 INFO:tasks.workunit.client.0.smithi077.stdout:3/221: truncate d0/d2/de/d48/d15/f2a 4848034 0 2024-04-25T02:08:46.423 INFO:tasks.workunit.client.1.smithi112.stdout:5/43: mknod d1/d2/d4/c10 0 2024-04-25T02:08:46.423 INFO:tasks.workunit.client.1.smithi112.stdout:5/44: chown d1/d2/d4 2834 1 2024-04-25T02:08:46.423 INFO:tasks.workunit.client.1.smithi112.stdout:5/45: truncate d1/d2/fb 303549 0 2024-04-25T02:08:46.429 INFO:tasks.workunit.client.1.smithi112.stdout:0/105: symlink da/l1f 0 2024-04-25T02:08:46.430 INFO:tasks.workunit.client.0.smithi077.stdout:9/194: rename df/d1b/f42 to df/f44 0 2024-04-25T02:08:46.430 INFO:tasks.workunit.client.0.smithi077.stdout:9/195: chown df/c32 3687623 1 2024-04-25T02:08:46.431 INFO:tasks.workunit.client.1.smithi112.stdout:6/36: truncate d0/d2/d4/f5 1106313 0 2024-04-25T02:08:46.433 INFO:tasks.workunit.client.0.smithi077.stdout:0/242: link d2/f4b d2/d1c/f4f 0 2024-04-25T02:08:46.433 INFO:tasks.workunit.client.0.smithi077.stdout:0/243: chown d2/d9 0 1 2024-04-25T02:08:46.433 INFO:tasks.workunit.client.0.smithi077.stdout:0/244: creat d2/d17/d1d/d34/f50 x:0 0 0 2024-04-25T02:08:46.434 INFO:tasks.workunit.client.1.smithi112.stdout:5/46: link d1/d2/f7 d1/d2/f11 0 2024-04-25T02:08:46.436 INFO:tasks.workunit.client.1.smithi112.stdout:9/38: rename d1/f8 to d1/f10 0 2024-04-25T02:08:46.439 INFO:tasks.workunit.client.0.smithi077.stdout:0/245: dread d2/d8/f26 [0,4194304] 0 2024-04-25T02:08:46.439 INFO:tasks.workunit.client.0.smithi077.stdout:5/268: mkdir d0/d2/d5/d5a 0 2024-04-25T02:08:46.441 INFO:tasks.workunit.client.1.smithi112.stdout:0/106: mkdir da/d13/d20 0 2024-04-25T02:08:46.445 INFO:tasks.workunit.client.1.smithi112.stdout:6/37: mkdir d0/d2/d4/d8 0 2024-04-25T02:08:46.445 INFO:tasks.workunit.client.1.smithi112.stdout:6/38: write d0/f7 [405853,83946] 0 2024-04-25T02:08:46.445 INFO:tasks.workunit.client.1.smithi112.stdout:6/39: truncate d0/f7 1384062 0 2024-04-25T02:08:46.445 INFO:tasks.workunit.client.0.smithi077.stdout:1/206: fsync db/d11/f15 0 2024-04-25T02:08:46.446 INFO:tasks.workunit.client.0.smithi077.stdout:3/222: symlink d0/d40/l49 0 2024-04-25T02:08:46.447 INFO:tasks.workunit.client.1.smithi112.stdout:5/47: symlink d1/d2/d4/l12 0 2024-04-25T02:08:46.447 INFO:tasks.workunit.client.1.smithi112.stdout:5/48: creat d1/d2/d4/f13 x:0 0 0 2024-04-25T02:08:46.451 INFO:tasks.workunit.client.1.smithi112.stdout:9/39: creat d1/df/f11 x:0 0 0 2024-04-25T02:08:46.451 INFO:tasks.workunit.client.1.smithi112.stdout:9/40: chown d1/le 157804052 1 2024-04-25T02:08:46.454 INFO:tasks.workunit.client.1.smithi112.stdout:0/107: creat da/d13/d1e/f21 x:0 0 0 2024-04-25T02:08:46.454 INFO:tasks.workunit.client.1.smithi112.stdout:0/108: chown da/f12 32353017 1 2024-04-25T02:08:46.459 INFO:tasks.workunit.client.1.smithi112.stdout:5/49: symlink d1/l14 0 2024-04-25T02:08:46.461 INFO:tasks.workunit.client.0.smithi077.stdout:4/210: sync 2024-04-25T02:08:46.461 INFO:tasks.workunit.client.0.smithi077.stdout:4/211: stat d0/de 0 2024-04-25T02:08:46.461 INFO:tasks.workunit.client.0.smithi077.stdout:4/212: fdatasync d0/de/f44 0 2024-04-25T02:08:46.462 INFO:tasks.workunit.client.0.smithi077.stdout:9/196: mknod df/c45 0 2024-04-25T02:08:46.462 INFO:tasks.workunit.client.0.smithi077.stdout:9/197: chown df/f43 2071555 1 2024-04-25T02:08:46.462 INFO:tasks.workunit.client.0.smithi077.stdout:9/198: dread - df/f31 zero size 2024-04-25T02:08:46.462 INFO:tasks.workunit.client.0.smithi077.stdout:9/199: creat df/d1b/f46 x:0 0 0 2024-04-25T02:08:46.466 INFO:tasks.workunit.client.0.smithi077.stdout:0/246: mkdir d2/d8/d10/d51 0 2024-04-25T02:08:46.469 INFO:tasks.workunit.client.0.smithi077.stdout:5/269: truncate d0/fd 5525339 0 2024-04-25T02:08:46.469 INFO:tasks.workunit.client.0.smithi077.stdout:5/270: fsync d0/d2/d3/d1d/f4c 0 2024-04-25T02:08:46.471 INFO:tasks.workunit.client.1.smithi112.stdout:5/50: rename d1/d2/f7 to d1/f15 0 2024-04-25T02:08:46.472 INFO:tasks.workunit.client.1.smithi112.stdout:6/40: write d0/f3 [1938913,59836] 0 2024-04-25T02:08:46.476 INFO:tasks.workunit.client.0.smithi077.stdout:1/207: symlink db/df/l44 0 2024-04-25T02:08:46.479 INFO:tasks.workunit.client.0.smithi077.stdout:3/223: unlink d0/d2/cc 0 2024-04-25T02:08:46.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:46 smithi077 ceph-mon[26330]: pgmap v252: 65 pgs: 65 active+clean; 376 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 16 MiB/s rd, 28 MiB/s wr, 415 op/s 2024-04-25T02:08:46.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:46 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:08:46.481 INFO:tasks.workunit.client.0.smithi077.stdout:5/271: write d0/d2/d3/d1d/f4c [3327843,45400] 0 2024-04-25T02:08:46.482 INFO:tasks.workunit.client.0.smithi077.stdout:0/247: mknod d2/d8/d10/c52 0 2024-04-25T02:08:46.483 INFO:tasks.workunit.client.1.smithi112.stdout:8/43: truncate fb 7161080 0 2024-04-25T02:08:46.484 INFO:tasks.workunit.client.1.smithi112.stdout:9/41: dwrite d1/fb [0,4194304] 0 2024-04-25T02:08:46.485 INFO:tasks.workunit.client.0.smithi077.stdout:1/208: mknod db/d26/c45 0 2024-04-25T02:08:46.488 INFO:tasks.workunit.client.0.smithi077.stdout:4/213: dwrite d0/d14/d21/d39/f42 [0,4194304] 0 2024-04-25T02:08:46.488 INFO:tasks.workunit.client.0.smithi077.stdout:4/214: creat d0/de/d25/f45 x:0 0 0 2024-04-25T02:08:46.489 INFO:tasks.workunit.client.0.smithi077.stdout:4/215: creat d0/d14/f46 x:0 0 0 2024-04-25T02:08:46.489 INFO:tasks.workunit.client.0.smithi077.stdout:3/224: symlink d0/d2/de/d36/l4a 0 2024-04-25T02:08:46.490 INFO:tasks.workunit.client.0.smithi077.stdout:9/200: dwrite df/f44 [0,4194304] 0 2024-04-25T02:08:46.491 INFO:tasks.workunit.client.0.smithi077.stdout:5/272: mknod d0/d2/d3/d9/d39/d44/c5b 0 2024-04-25T02:08:46.492 INFO:tasks.workunit.client.0.smithi077.stdout:8/282: sync 2024-04-25T02:08:46.492 INFO:tasks.workunit.client.0.smithi077.stdout:2/231: sync 2024-04-25T02:08:46.493 INFO:tasks.workunit.client.0.smithi077.stdout:7/167: sync 2024-04-25T02:08:46.493 INFO:tasks.workunit.client.0.smithi077.stdout:6/264: sync 2024-04-25T02:08:46.493 INFO:tasks.workunit.client.0.smithi077.stdout:7/168: fdatasync d4/d13/d18/f22 0 2024-04-25T02:08:46.493 INFO:tasks.workunit.client.0.smithi077.stdout:2/232: chown d2/d9/d19/d1c/f44 61860204 1 2024-04-25T02:08:46.493 INFO:tasks.workunit.client.0.smithi077.stdout:8/283: write d3/da/f45 [860393,61302] 0 2024-04-25T02:08:46.495 INFO:tasks.workunit.client.1.smithi112.stdout:9/42: creat d1/f12 x:0 0 0 2024-04-25T02:08:46.500 INFO:tasks.workunit.client.1.smithi112.stdout:6/41: dread d0/f3 [0,4194304] 0 2024-04-25T02:08:46.500 INFO:tasks.workunit.client.0.smithi077.stdout:6/265: dread de/d15/f22 [0,4194304] 0 2024-04-25T02:08:46.500 INFO:tasks.workunit.client.0.smithi077.stdout:6/266: dread - de/d15/d36/f58 zero size 2024-04-25T02:08:46.501 INFO:tasks.workunit.client.0.smithi077.stdout:7/169: dread d4/fb [0,4194304] 0 2024-04-25T02:08:46.501 INFO:tasks.workunit.client.0.smithi077.stdout:3/225: write d0/d17/f37 [6602301,71089] 0 2024-04-25T02:08:46.501 INFO:tasks.workunit.client.0.smithi077.stdout:3/226: fdatasync d0/d2/de/d48/d15/f38 0 2024-04-25T02:08:46.504 INFO:tasks.workunit.client.0.smithi077.stdout:9/201: rename df/f17 to df/d1b/f47 0 2024-04-25T02:08:46.505 INFO:tasks.workunit.client.1.smithi112.stdout:6/42: truncate d0/f7 810431 0 2024-04-25T02:08:46.507 INFO:tasks.workunit.client.0.smithi077.stdout:5/273: getdents d0/d2/d3/d9/d39 0 2024-04-25T02:08:46.507 INFO:tasks.workunit.client.0.smithi077.stdout:5/274: truncate d0/d25/f3a 334055 0 2024-04-25T02:08:46.509 INFO:tasks.workunit.client.0.smithi077.stdout:2/233: mknod d2/d9/d19/d1c/c46 0 2024-04-25T02:08:46.510 INFO:tasks.workunit.client.1.smithi112.stdout:9/43: dread d1/fb [0,4194304] 0 2024-04-25T02:08:46.510 INFO:tasks.workunit.client.1.smithi112.stdout:5/51: getdents d1 0 2024-04-25T02:08:46.510 INFO:tasks.workunit.client.1.smithi112.stdout:5/52: readlink d1/d2/d4/l12 0 2024-04-25T02:08:46.510 INFO:tasks.workunit.client.0.smithi077.stdout:4/216: dwrite d0/d14/d21/d39/da/d12/d35/d3e/f36 [0,4194304] 0 2024-04-25T02:08:46.511 INFO:tasks.workunit.client.1.smithi112.stdout:6/43: dread d0/f3 [0,4194304] 0 2024-04-25T02:08:46.511 INFO:tasks.workunit.client.0.smithi077.stdout:8/284: mknod d3/da/c59 0 2024-04-25T02:08:46.512 INFO:tasks.workunit.client.0.smithi077.stdout:8/285: write d3/da/db/df/f10 [1965069,3381] 0 2024-04-25T02:08:46.513 INFO:tasks.workunit.client.1.smithi112.stdout:5/53: mkdir d1/d16 0 2024-04-25T02:08:46.514 INFO:tasks.workunit.client.0.smithi077.stdout:0/248: rmdir d2/d9 39 2024-04-25T02:08:46.514 INFO:tasks.workunit.client.0.smithi077.stdout:0/249: creat d2/d17/d1d/f53 x:0 0 0 2024-04-25T02:08:46.518 INFO:tasks.workunit.client.1.smithi112.stdout:8/44: fsync f7 0 2024-04-25T02:08:46.518 INFO:tasks.workunit.client.1.smithi112.stdout:8/45: readlink - no filename 2024-04-25T02:08:46.521 INFO:tasks.workunit.client.1.smithi112.stdout:5/54: write d1/d2/d4/f9 [340331,130824] 0 2024-04-25T02:08:46.521 INFO:tasks.workunit.client.0.smithi077.stdout:6/267: unlink de/d12/d25/d4b/f59 0 2024-04-25T02:08:46.522 INFO:tasks.workunit.client.1.smithi112.stdout:9/44: write f0 [1060533,70032] 0 2024-04-25T02:08:46.523 INFO:tasks.workunit.client.1.smithi112.stdout:8/46: creat fd x:0 0 0 2024-04-25T02:08:46.523 INFO:tasks.workunit.client.1.smithi112.stdout:8/47: chown f7 13781 1 2024-04-25T02:08:46.524 INFO:tasks.workunit.client.0.smithi077.stdout:7/170: link d4/f37 d4/d13/d18/d2d/f3a 0 2024-04-25T02:08:46.527 INFO:tasks.workunit.client.0.smithi077.stdout:3/227: mkdir d0/d17/d4b 0 2024-04-25T02:08:46.527 INFO:tasks.workunit.client.0.smithi077.stdout:3/228: dread - d0/d2/de/d48/f44 zero size 2024-04-25T02:08:46.530 INFO:tasks.workunit.client.0.smithi077.stdout:9/202: mkdir df/d1b/d48 0 2024-04-25T02:08:46.530 INFO:tasks.workunit.client.0.smithi077.stdout:9/203: write df/d1b/f30 [736505,44504] 0 2024-04-25T02:08:46.530 INFO:tasks.workunit.client.0.smithi077.stdout:9/204: creat df/f49 x:0 0 0 2024-04-25T02:08:46.531 INFO:tasks.workunit.client.0.smithi077.stdout:2/234: dwrite d2/d9/d19/f3b [0,4194304] 0 2024-04-25T02:08:46.533 INFO:tasks.workunit.client.1.smithi112.stdout:8/48: creat fe x:0 0 0 2024-04-25T02:08:46.534 INFO:tasks.workunit.client.1.smithi112.stdout:9/45: unlink d1/cc 0 2024-04-25T02:08:46.535 INFO:tasks.workunit.client.1.smithi112.stdout:9/46: chown d1/df/f11 7409 1 2024-04-25T02:08:46.535 INFO:tasks.workunit.client.1.smithi112.stdout:9/47: stat d1/fd 0 2024-04-25T02:08:46.535 INFO:tasks.workunit.client.0.smithi077.stdout:4/217: mknod d0/de/c47 0 2024-04-25T02:08:46.536 INFO:tasks.workunit.client.0.smithi077.stdout:5/275: dwrite d0/d2/d20/d41/f4b [0,4194304] 0 2024-04-25T02:08:46.538 INFO:tasks.workunit.client.0.smithi077.stdout:8/286: link d3/da/d27/f1e d3/da/db/df/d2b/d37/f5a 0 2024-04-25T02:08:46.539 INFO:tasks.workunit.client.0.smithi077.stdout:8/287: dread d3/da/d27/f47 [0,4194304] 0 2024-04-25T02:08:46.539 INFO:tasks.workunit.client.1.smithi112.stdout:9/48: truncate d1/f4 807289 0 2024-04-25T02:08:46.539 INFO:tasks.workunit.client.1.smithi112.stdout:5/55: dwrite d1/d2/fb [0,4194304] 0 2024-04-25T02:08:46.540 INFO:tasks.workunit.client.1.smithi112.stdout:6/44: dwrite d0/d2/d4/f5 [0,4194304] 0 2024-04-25T02:08:46.545 INFO:tasks.workunit.client.1.smithi112.stdout:8/49: symlink lf 0 2024-04-25T02:08:46.547 INFO:tasks.workunit.client.0.smithi077.stdout:0/250: symlink d2/d9/l54 0 2024-04-25T02:08:46.551 INFO:tasks.workunit.client.0.smithi077.stdout:6/268: mknod de/d12/d25/d4b/c5e 0 2024-04-25T02:08:46.551 INFO:tasks.workunit.client.0.smithi077.stdout:6/269: fsync f5 0 2024-04-25T02:08:46.551 INFO:tasks.workunit.client.0.smithi077.stdout:6/270: write de/f2c [90288,1698] 0 2024-04-25T02:08:46.551 INFO:tasks.workunit.client.0.smithi077.stdout:6/271: write de/d12/d25/d44/f5d [8431,11483] 0 2024-04-25T02:08:46.552 INFO:tasks.workunit.client.0.smithi077.stdout:6/272: dread de/d12/d25/f40 [0,4194304] 0 2024-04-25T02:08:46.552 INFO:tasks.workunit.client.0.smithi077.stdout:6/273: write de/d12/d25/f40 [687410,30810] 0 2024-04-25T02:08:46.552 INFO:tasks.workunit.client.0.smithi077.stdout:6/274: chown de/d15/d36/c4d 1 1 2024-04-25T02:08:46.553 INFO:tasks.workunit.client.1.smithi112.stdout:5/56: read d1/d2/fb [4177516,112635] 0 2024-04-25T02:08:46.553 INFO:tasks.workunit.client.1.smithi112.stdout:5/57: chown d1/d2/d4/f13 1 1 2024-04-25T02:08:46.553 INFO:tasks.workunit.client.0.smithi077.stdout:7/171: creat d4/d13/d18/d24/f3b x:0 0 0 2024-04-25T02:08:46.555 INFO:tasks.workunit.client.1.smithi112.stdout:8/50: creat f10 x:0 0 0 2024-04-25T02:08:46.556 INFO:tasks.workunit.client.0.smithi077.stdout:3/229: rmdir d0/d40 39 2024-04-25T02:08:46.557 INFO:tasks.workunit.client.1.smithi112.stdout:5/58: dread - d1/f5 zero size 2024-04-25T02:08:46.562 INFO:tasks.workunit.client.0.smithi077.stdout:9/205: symlink df/l4a 0 2024-04-25T02:08:46.562 INFO:tasks.workunit.client.0.smithi077.stdout:9/206: creat df/f4b x:0 0 0 2024-04-25T02:08:46.562 INFO:tasks.workunit.client.0.smithi077.stdout:9/207: chown df/f3c 648628 1 2024-04-25T02:08:46.564 INFO:tasks.workunit.client.0.smithi077.stdout:8/288: dwrite d3/da/db/df/d2b/f1d [0,4194304] 0 2024-04-25T02:08:46.564 INFO:tasks.workunit.client.0.smithi077.stdout:8/289: write d3/fd [4988017,98963] 0 2024-04-25T02:08:46.565 INFO:tasks.workunit.client.1.smithi112.stdout:9/49: dwrite d1/fb [4194304,4194304] 0 2024-04-25T02:08:46.565 INFO:tasks.workunit.client.1.smithi112.stdout:6/45: dwrite d0/f7 [0,4194304] 0 2024-04-25T02:08:46.569 INFO:tasks.workunit.client.0.smithi077.stdout:2/235: creat d2/d9/d19/d2c/f47 x:0 0 0 2024-04-25T02:08:46.575 INFO:tasks.workunit.client.0.smithi077.stdout:4/218: creat d0/de/d3c/f48 x:0 0 0 2024-04-25T02:08:46.580 INFO:tasks.workunit.client.0.smithi077.stdout:5/276: creat d0/d2/d20/d23/d4a/f5c x:0 0 0 2024-04-25T02:08:46.580 INFO:tasks.workunit.client.0.smithi077.stdout:5/277: creat d0/d2/d20/d23/d4a/f5d x:0 0 0 2024-04-25T02:08:46.600 INFO:tasks.workunit.client.1.smithi112.stdout:5/59: dread d1/f6 [0,4194304] 0 2024-04-25T02:08:46.600 INFO:tasks.workunit.client.1.smithi112.stdout:5/60: truncate d1/d2/d4/f13 124238 0 2024-04-25T02:08:46.601 INFO:tasks.workunit.client.0.smithi077.stdout:0/251: link d2/d17/d1d/f3d d2/d8/f55 0 2024-04-25T02:08:46.601 INFO:tasks.workunit.client.0.smithi077.stdout:0/252: write d2/d17/d1d/d34/f36 [864146,117717] 0 2024-04-25T02:08:46.603 INFO:tasks.workunit.client.0.smithi077.stdout:7/172: link d4/f16 d4/d13/f3c 0 2024-04-25T02:08:46.603 INFO:tasks.workunit.client.0.smithi077.stdout:6/275: dwrite de/d12/f2a [0,4194304] 0 2024-04-25T02:08:46.604 INFO:tasks.workunit.client.0.smithi077.stdout:3/230: mknod d0/d3e/d42/c4c 0 2024-04-25T02:08:46.609 INFO:tasks.workunit.client.0.smithi077.stdout:4/219: creat d0/d14/d21/d39/da/d12/d35/f49 x:0 0 0 2024-04-25T02:08:46.610 INFO:tasks.workunit.client.0.smithi077.stdout:4/220: chown d0/d14/d21/d39/da 22 1 2024-04-25T02:08:46.610 INFO:tasks.workunit.client.0.smithi077.stdout:4/221: write d0/de/d25/f45 [230691,11032] 0 2024-04-25T02:08:46.610 INFO:tasks.workunit.client.1.smithi112.stdout:8/51: dwrite fb [0,4194304] 0 2024-04-25T02:08:46.610 INFO:tasks.workunit.client.1.smithi112.stdout:8/52: chown f10 260880924 1 2024-04-25T02:08:46.610 INFO:tasks.workunit.client.1.smithi112.stdout:8/53: rmdir - no directory 2024-04-25T02:08:46.610 INFO:tasks.workunit.client.1.smithi112.stdout:8/54: dread - f10 zero size 2024-04-25T02:08:46.611 INFO:tasks.workunit.client.1.smithi112.stdout:9/50: dwrite d1/fd [0,4194304] 0 2024-04-25T02:08:46.612 INFO:tasks.workunit.client.0.smithi077.stdout:5/278: unlink d0/d2/d3/d1d/f4c 0 2024-04-25T02:08:46.612 INFO:tasks.workunit.client.0.smithi077.stdout:5/279: chown d0/d2/d3/c6 3823 1 2024-04-25T02:08:46.616 INFO:tasks.workunit.client.0.smithi077.stdout:7/173: rename d4/l1d to d4/d13/l3d 0 2024-04-25T02:08:46.622 INFO:tasks.workunit.client.0.smithi077.stdout:6/276: creat de/d12/d25/d3a/f5f x:0 0 0 2024-04-25T02:08:46.622 INFO:tasks.workunit.client.0.smithi077.stdout:9/208: dwrite fc [0,4194304] 0 2024-04-25T02:08:46.622 INFO:tasks.workunit.client.0.smithi077.stdout:9/209: creat df/f4c x:0 0 0 2024-04-25T02:08:46.623 INFO:tasks.workunit.client.0.smithi077.stdout:3/231: symlink d0/d17/l4d 0 2024-04-25T02:08:46.624 INFO:tasks.workunit.client.1.smithi112.stdout:9/51: mkdir d1/d13 0 2024-04-25T02:08:46.624 INFO:tasks.workunit.client.1.smithi112.stdout:6/46: dwrite d0/f3 [4194304,4194304] 0 2024-04-25T02:08:46.625 INFO:tasks.workunit.client.0.smithi077.stdout:2/236: getdents d2/d9/df 0 2024-04-25T02:08:46.628 INFO:tasks.workunit.client.0.smithi077.stdout:5/280: write d0/d2/d20/d41/f4b [247342,6889] 0 2024-04-25T02:08:46.628 INFO:tasks.workunit.client.0.smithi077.stdout:4/222: link d0/d14/d21/d39/da/d12/d35/d3e/f38 d0/de/f4a 0 2024-04-25T02:08:46.629 INFO:tasks.workunit.client.1.smithi112.stdout:9/52: creat d1/f14 x:0 0 0 2024-04-25T02:08:46.631 INFO:tasks.workunit.client.0.smithi077.stdout:0/253: rmdir d2/d17/d1d/d34 39 2024-04-25T02:08:46.632 INFO:tasks.workunit.client.1.smithi112.stdout:8/55: dwrite fc [0,4194304] 0 2024-04-25T02:08:46.632 INFO:tasks.workunit.client.0.smithi077.stdout:8/290: dwrite d3/da/db/df/f33 [0,4194304] 0 2024-04-25T02:08:46.633 INFO:tasks.workunit.client.1.smithi112.stdout:5/61: dwrite d1/d2/fb [4194304,4194304] 0 2024-04-25T02:08:46.633 INFO:tasks.workunit.client.0.smithi077.stdout:7/174: symlink d4/d13/d2c/l3e 0 2024-04-25T02:08:46.634 INFO:tasks.workunit.client.1.smithi112.stdout:6/47: rmdir d0 39 2024-04-25T02:08:46.640 INFO:tasks.workunit.client.0.smithi077.stdout:9/210: mknod df/c4d 0 2024-04-25T02:08:46.640 INFO:tasks.workunit.client.0.smithi077.stdout:9/211: dread - df/f39 zero size 2024-04-25T02:08:46.640 INFO:tasks.workunit.client.1.smithi112.stdout:5/62: dread d1/f6 [0,4194304] 0 2024-04-25T02:08:46.642 INFO:tasks.workunit.client.0.smithi077.stdout:3/232: mknod d0/d17/d4b/c4e 0 2024-04-25T02:08:46.642 INFO:tasks.workunit.client.0.smithi077.stdout:3/233: write d0/d17/f37 [8960610,2102] 0 2024-04-25T02:08:46.647 INFO:tasks.workunit.client.0.smithi077.stdout:5/281: creat d0/d2/d1b/d38/f5e x:0 0 0 2024-04-25T02:08:46.647 INFO:tasks.workunit.client.0.smithi077.stdout:5/282: stat d0/d2/ff 0 2024-04-25T02:08:46.649 INFO:tasks.workunit.client.0.smithi077.stdout:3/234: dread d0/d2/de/f1b [0,4194304] 0 2024-04-25T02:08:46.649 INFO:tasks.workunit.client.1.smithi112.stdout:5/63: fdatasync d1/f8 0 2024-04-25T02:08:46.651 INFO:tasks.workunit.client.0.smithi077.stdout:4/223: creat d0/d14/d21/d39/da/d12/d35/d3e/f4b x:0 0 0 2024-04-25T02:08:46.651 INFO:tasks.workunit.client.0.smithi077.stdout:4/224: creat d0/de/f4c x:0 0 0 2024-04-25T02:08:46.651 INFO:tasks.workunit.client.0.smithi077.stdout:4/225: chown d0/d14/d21/d39/da/d12/f3d 1806549995 1 2024-04-25T02:08:46.652 INFO:tasks.workunit.client.0.smithi077.stdout:0/254: mknod d2/d17/d1d/c56 0 2024-04-25T02:08:46.653 INFO:tasks.workunit.client.0.smithi077.stdout:4/226: dread d0/de/d25/f31 [0,4194304] 0 2024-04-25T02:08:46.655 INFO:tasks.workunit.client.1.smithi112.stdout:5/64: creat d1/d16/f17 x:0 0 0 2024-04-25T02:08:46.655 INFO:tasks.workunit.client.0.smithi077.stdout:4/227: write d0/f20 [59893,65235] 0 2024-04-25T02:08:46.655 INFO:tasks.workunit.client.0.smithi077.stdout:4/228: truncate d0/de/f4c 923487 0 2024-04-25T02:08:46.657 INFO:tasks.workunit.client.1.smithi112.stdout:5/65: creat d1/f18 x:0 0 0 2024-04-25T02:08:46.658 INFO:tasks.workunit.client.1.smithi112.stdout:8/56: write fa [3703869,63854] 0 2024-04-25T02:08:46.659 INFO:tasks.workunit.client.0.smithi077.stdout:6/277: dwrite f9 [0,4194304] 0 2024-04-25T02:08:46.659 INFO:tasks.workunit.client.1.smithi112.stdout:9/53: dwrite d1/f12 [0,4194304] 0 2024-04-25T02:08:46.659 INFO:tasks.workunit.client.1.smithi112.stdout:9/54: truncate d1/f10 894535 0 2024-04-25T02:08:46.659 INFO:tasks.workunit.client.1.smithi112.stdout:9/55: getdents d1/d13 0 2024-04-25T02:08:46.660 INFO:tasks.workunit.client.1.smithi112.stdout:5/66: rename f0 to d1/d16/f19 0 2024-04-25T02:08:46.660 INFO:tasks.workunit.client.1.smithi112.stdout:6/48: dwrite d0/f7 [4194304,4194304] 0 2024-04-25T02:08:46.662 INFO:tasks.workunit.client.1.smithi112.stdout:8/57: creat f11 x:0 0 0 2024-04-25T02:08:46.662 INFO:tasks.workunit.client.1.smithi112.stdout:8/58: dread - f11 zero size 2024-04-25T02:08:46.665 INFO:tasks.workunit.client.0.smithi077.stdout:6/278: write de/d12/f28 [6356429,43136] 0 2024-04-25T02:08:46.668 INFO:tasks.workunit.client.1.smithi112.stdout:9/56: unlink f0 0 2024-04-25T02:08:46.671 INFO:tasks.workunit.client.1.smithi112.stdout:5/67: symlink d1/d16/l1a 0 2024-04-25T02:08:46.675 INFO:tasks.workunit.client.1.smithi112.stdout:6/49: rmdir d0/d2/d4/d8 0 2024-04-25T02:08:46.675 INFO:tasks.workunit.client.1.smithi112.stdout:6/50: chown d0/d2/l6 3667574 1 2024-04-25T02:08:46.677 INFO:tasks.workunit.client.1.smithi112.stdout:8/59: creat f12 x:0 0 0 2024-04-25T02:08:46.680 INFO:tasks.workunit.client.1.smithi112.stdout:5/68: symlink d1/d16/l1b 0 2024-04-25T02:08:46.680 INFO:tasks.workunit.client.1.smithi112.stdout:5/69: chown d1/d2/d4/f9 51 1 2024-04-25T02:08:46.682 INFO:tasks.workunit.client.1.smithi112.stdout:6/51: mknod d0/d2/c9 0 2024-04-25T02:08:46.683 INFO:tasks.workunit.client.0.smithi077.stdout:8/291: mknod d3/c5b 0 2024-04-25T02:08:46.683 INFO:tasks.workunit.client.1.smithi112.stdout:8/60: fdatasync f6 0 2024-04-25T02:08:46.684 INFO:tasks.workunit.client.0.smithi077.stdout:7/175: mkdir d4/d13/d18/d24/d3f 0 2024-04-25T02:08:46.686 INFO:tasks.workunit.client.1.smithi112.stdout:9/57: dwrite d1/fb [4194304,4194304] 0 2024-04-25T02:08:46.686 INFO:tasks.workunit.client.1.smithi112.stdout:6/52: rename d0/d2/l6 to d0/d2/d4/la 0 2024-04-25T02:08:46.687 INFO:tasks.workunit.client.0.smithi077.stdout:9/212: mknod df/d1b/d48/c4e 0 2024-04-25T02:08:46.689 INFO:tasks.workunit.client.0.smithi077.stdout:2/237: getdents d2/d9/d19/d2c 0 2024-04-25T02:08:46.693 INFO:tasks.workunit.client.1.smithi112.stdout:6/53: creat d0/d2/d4/fb x:0 0 0 2024-04-25T02:08:46.712 INFO:tasks.workunit.client.1.smithi112.stdout:5/70: dwrite d1/f8 [0,4194304] 0 2024-04-25T02:08:46.712 INFO:tasks.workunit.client.1.smithi112.stdout:5/71: fsync d1/f5 0 2024-04-25T02:08:46.713 INFO:tasks.workunit.client.0.smithi077.stdout:8/292: dwrite d3/da/db/f28 [0,4194304] 0 2024-04-25T02:08:46.713 INFO:tasks.workunit.client.0.smithi077.stdout:2/238: dwrite d2/d28/f32 [0,4194304] 0 2024-04-25T02:08:46.714 INFO:tasks.workunit.client.1.smithi112.stdout:9/58: dread d1/f5 [0,4194304] 0 2024-04-25T02:08:46.723 INFO:tasks.workunit.client.0.smithi077.stdout:8/293: read d3/da/d27/d16/f1c [3761898,60653] 0 2024-04-25T02:08:46.745 INFO:tasks.workunit.client.0.smithi077.stdout:0/255: mknod d2/d17/d1d/d34/c57 0 2024-04-25T02:08:46.748 INFO:tasks.workunit.client.1.smithi112.stdout:6/54: rename d0/f3 to d0/d2/d4/fc 0 2024-04-25T02:08:46.756 INFO:tasks.workunit.client.0.smithi077.stdout:4/229: unlink d0/d14/d21/f32 0 2024-04-25T02:08:46.756 INFO:tasks.workunit.client.0.smithi077.stdout:0/256: write d2/d27/d2d/f2f [3095889,89985] 0 2024-04-25T02:08:46.757 INFO:tasks.workunit.client.1.smithi112.stdout:8/61: rename f11 to f13 0 2024-04-25T02:08:46.758 INFO:tasks.workunit.client.0.smithi077.stdout:1/209: sync 2024-04-25T02:08:46.765 INFO:tasks.workunit.client.1.smithi112.stdout:5/72: truncate d1/d2/f11 227041 0 2024-04-25T02:08:46.768 INFO:tasks.workunit.client.0.smithi077.stdout:7/176: truncate d4/f37 231505 0 2024-04-25T02:08:46.768 INFO:tasks.workunit.client.0.smithi077.stdout:7/177: creat d4/d13/d18/f40 x:0 0 0 2024-04-25T02:08:46.768 INFO:tasks.workunit.client.0.smithi077.stdout:7/178: chown d4/f37 121909706 1 2024-04-25T02:08:46.772 INFO:tasks.workunit.client.0.smithi077.stdout:9/213: link df/c32 df/c4f 0 2024-04-25T02:08:46.772 INFO:tasks.workunit.client.0.smithi077.stdout:9/214: creat df/f50 x:0 0 0 2024-04-25T02:08:46.772 INFO:tasks.workunit.client.0.smithi077.stdout:9/215: creat df/d1b/f51 x:0 0 0 2024-04-25T02:08:46.781 INFO:tasks.workunit.client.0.smithi077.stdout:0/257: dwrite d2/d17/d1d/f3d [0,4194304] 0 2024-04-25T02:08:46.783 INFO:tasks.workunit.client.0.smithi077.stdout:4/230: dwrite d0/d14/d21/d39/f2 [0,4194304] 0 2024-04-25T02:08:46.786 INFO:tasks.workunit.client.0.smithi077.stdout:4/231: dread d0/d14/d21/f2f [0,4194304] 0 2024-04-25T02:08:46.798 INFO:tasks.workunit.client.0.smithi077.stdout:2/239: symlink d2/d9/df/l48 0 2024-04-25T02:08:46.837 INFO:tasks.workunit.client.0.smithi077.stdout:8/294: mknod d3/da/d27/d44/c5c 0 2024-04-25T02:08:46.871 INFO:tasks.workunit.client.1.smithi112.stdout:6/55: mkdir d0/d2/d4/dd 0 2024-04-25T02:08:46.880 INFO:tasks.workunit.client.1.smithi112.stdout:6/56: read d0/d2/d4/f5 [4353864,101022] 0 2024-04-25T02:08:46.881 INFO:tasks.workunit.client.1.smithi112.stdout:5/73: rename d1/d2/d4/l12 to d1/d2/l1c 0 2024-04-25T02:08:46.955 INFO:tasks.workunit.client.1.smithi112.stdout:8/62: getdents . 0 2024-04-25T02:08:46.955 INFO:tasks.workunit.client.1.smithi112.stdout:6/57: symlink d0/le 0 2024-04-25T02:08:46.955 INFO:tasks.workunit.client.1.smithi112.stdout:5/74: mkdir d1/d2/d4/d1d 0 2024-04-25T02:08:46.955 INFO:tasks.workunit.client.1.smithi112.stdout:8/63: dread fc [0,4194304] 0 2024-04-25T02:08:46.956 INFO:tasks.workunit.client.1.smithi112.stdout:5/75: mkdir d1/d2/d1e 0 2024-04-25T02:08:46.956 INFO:tasks.workunit.client.1.smithi112.stdout:5/76: chown d1/d2/f11 23 1 2024-04-25T02:08:46.956 INFO:tasks.workunit.client.1.smithi112.stdout:8/64: creat f14 x:0 0 0 2024-04-25T02:08:46.956 INFO:tasks.workunit.client.1.smithi112.stdout:8/65: read - fd zero size 2024-04-25T02:08:46.956 INFO:tasks.workunit.client.1.smithi112.stdout:8/66: dread - fd zero size 2024-04-25T02:08:46.956 INFO:tasks.workunit.client.1.smithi112.stdout:5/77: symlink d1/d2/d4/d1d/l1f 0 2024-04-25T02:08:46.956 INFO:tasks.workunit.client.1.smithi112.stdout:5/78: creat d1/d16/f20 x:0 0 0 2024-04-25T02:08:46.956 INFO:tasks.workunit.client.1.smithi112.stdout:5/79: mknod d1/c21 0 2024-04-25T02:08:46.956 INFO:tasks.workunit.client.1.smithi112.stdout:5/80: mkdir d1/d16/d22 0 2024-04-25T02:08:46.956 INFO:tasks.workunit.client.1.smithi112.stdout:5/81: chown d1/f8 11 1 2024-04-25T02:08:46.956 INFO:tasks.workunit.client.1.smithi112.stdout:8/67: dwrite fd [0,4194304] 0 2024-04-25T02:08:46.956 INFO:tasks.workunit.client.1.smithi112.stdout:8/68: mkdir d15 0 2024-04-25T02:08:46.956 INFO:tasks.workunit.client.1.smithi112.stdout:8/69: stat f10 0 2024-04-25T02:08:46.956 INFO:tasks.workunit.client.1.smithi112.stdout:5/82: unlink d1/l14 0 2024-04-25T02:08:46.956 INFO:tasks.workunit.client.1.smithi112.stdout:8/70: link fb d15/f16 0 2024-04-25T02:08:46.956 INFO:tasks.workunit.client.1.smithi112.stdout:5/83: link d1/d2/d4/c10 d1/d2/c23 0 2024-04-25T02:08:46.957 INFO:tasks.workunit.client.1.smithi112.stdout:5/84: creat d1/d16/d22/f24 x:0 0 0 2024-04-25T02:08:46.957 INFO:tasks.workunit.client.1.smithi112.stdout:5/85: chown d1/d2/f11 387719859 1 2024-04-25T02:08:46.957 INFO:tasks.workunit.client.1.smithi112.stdout:5/86: stat d1/c21 0 2024-04-25T02:08:46.957 INFO:tasks.workunit.client.1.smithi112.stdout:5/87: readlink d1/d2/d4/d1d/l1f 0 2024-04-25T02:08:46.957 INFO:tasks.workunit.client.1.smithi112.stdout:5/88: fsync d1/d2/d4/f9 0 2024-04-25T02:08:46.957 INFO:tasks.workunit.client.1.smithi112.stdout:5/89: dread - d1/d16/f17 zero size 2024-04-25T02:08:46.957 INFO:tasks.workunit.client.1.smithi112.stdout:5/90: stat d1/d16 0 2024-04-25T02:08:46.958 INFO:tasks.workunit.client.0.smithi077.stdout:1/210: write db/d11/f30 [2329104,16616] 0 2024-04-25T02:08:46.958 INFO:tasks.workunit.client.0.smithi077.stdout:7/179: mknod d4/d13/d2c/c41 0 2024-04-25T02:08:46.958 INFO:tasks.workunit.client.0.smithi077.stdout:9/216: mknod df/d1b/d48/c52 0 2024-04-25T02:08:46.958 INFO:tasks.workunit.client.0.smithi077.stdout:0/258: creat d2/d9/d2a/f58 x:0 0 0 2024-04-25T02:08:46.958 INFO:tasks.workunit.client.0.smithi077.stdout:4/232: creat d0/d14/d21/d39/f4d x:0 0 0 2024-04-25T02:08:46.958 INFO:tasks.workunit.client.0.smithi077.stdout:4/233: write d0/d14/d21/f2f [886900,112949] 0 2024-04-25T02:08:46.959 INFO:tasks.workunit.client.0.smithi077.stdout:4/234: stat d0/d14/d21/d39/da/d12/d35 0 2024-04-25T02:08:46.959 INFO:tasks.workunit.client.0.smithi077.stdout:4/235: write d0/d14/d21/d39/f4d [764770,41993] 0 2024-04-25T02:08:46.959 INFO:tasks.workunit.client.0.smithi077.stdout:4/236: write d0/de/d25/f45 [652910,19340] 0 2024-04-25T02:08:46.959 INFO:tasks.workunit.client.0.smithi077.stdout:4/237: fsync d0/d14/d21/d39/da/d12/f3d 0 2024-04-25T02:08:46.959 INFO:tasks.workunit.client.0.smithi077.stdout:2/240: link d2/le d2/d9/d18/d31/l49 0 2024-04-25T02:08:46.959 INFO:tasks.workunit.client.0.smithi077.stdout:8/295: creat d3/da/db/df/f5d x:0 0 0 2024-04-25T02:08:46.959 INFO:tasks.workunit.client.0.smithi077.stdout:1/211: rmdir db/df/d1b/d40 0 2024-04-25T02:08:46.959 INFO:tasks.workunit.client.0.smithi077.stdout:1/212: truncate db/d26/f3c 88157 0 2024-04-25T02:08:46.959 INFO:tasks.workunit.client.0.smithi077.stdout:9/217: mknod df/d1b/c53 0 2024-04-25T02:08:46.959 INFO:tasks.workunit.client.0.smithi077.stdout:9/218: dread - df/f3c zero size 2024-04-25T02:08:46.959 INFO:tasks.workunit.client.0.smithi077.stdout:8/296: dwrite d3/da/d27/f21 [0,4194304] 0 2024-04-25T02:08:46.959 INFO:tasks.workunit.client.0.smithi077.stdout:8/297: dread - d3/da/db/f4c zero size 2024-04-25T02:08:46.959 INFO:tasks.workunit.client.0.smithi077.stdout:0/259: rename d2/d17/d1d/d34/f50 to d2/d8/d10/d51/f59 0 2024-04-25T02:08:46.959 INFO:tasks.workunit.client.0.smithi077.stdout:0/260: write d2/d9/d2a/f58 [849232,130382] 0 2024-04-25T02:08:46.959 INFO:tasks.workunit.client.0.smithi077.stdout:4/238: symlink d0/d14/d21/d39/d1d/l4e 0 2024-04-25T02:08:46.960 INFO:tasks.workunit.client.0.smithi077.stdout:2/241: symlink d2/l4a 0 2024-04-25T02:08:46.960 INFO:tasks.workunit.client.0.smithi077.stdout:1/213: mknod db/d26/c46 0 2024-04-25T02:08:46.960 INFO:tasks.workunit.client.0.smithi077.stdout:9/219: dwrite df/f12 [4194304,4194304] 0 2024-04-25T02:08:46.960 INFO:tasks.workunit.client.0.smithi077.stdout:7/180: truncate d4/fa 449691 0 2024-04-25T02:08:46.960 INFO:tasks.workunit.client.0.smithi077.stdout:7/181: fdatasync d4/d13/f1f 0 2024-04-25T02:08:46.960 INFO:tasks.workunit.client.0.smithi077.stdout:7/182: creat d4/d13/d18/d2d/d30/f42 x:0 0 0 2024-04-25T02:08:46.960 INFO:tasks.workunit.client.0.smithi077.stdout:4/239: getdents d0/d14/d21/d39/da/d12/d35/d3e/d3a 0 2024-04-25T02:08:46.960 INFO:tasks.workunit.client.0.smithi077.stdout:9/220: unlink df/c45 0 2024-04-25T02:08:46.960 INFO:tasks.workunit.client.0.smithi077.stdout:9/221: fdatasync df/f18 0 2024-04-25T02:08:46.961 INFO:tasks.workunit.client.0.smithi077.stdout:7/183: creat d4/d13/d18/d2d/f43 x:0 0 0 2024-04-25T02:08:46.963 INFO:tasks.workunit.client.0.smithi077.stdout:7/184: dread d4/d13/d18/d2d/d30/f34 [0,4194304] 0 2024-04-25T02:08:46.964 INFO:tasks.workunit.client.0.smithi077.stdout:1/214: dwrite db/f3b [4194304,4194304] 0 2024-04-25T02:08:46.965 INFO:tasks.workunit.client.0.smithi077.stdout:8/298: dwrite d3/da/d27/d16/f22 [0,4194304] 0 2024-04-25T02:08:46.965 INFO:tasks.workunit.client.0.smithi077.stdout:8/299: stat d3/l24 0 2024-04-25T02:08:46.965 INFO:tasks.workunit.client.0.smithi077.stdout:9/222: creat df/d1b/d48/f54 x:0 0 0 2024-04-25T02:08:46.966 INFO:tasks.workunit.client.0.smithi077.stdout:9/223: mknod df/c55 0 2024-04-25T02:08:46.969 INFO:tasks.workunit.client.0.smithi077.stdout:9/224: dread df/f14 [0,4194304] 0 2024-04-25T02:08:46.971 INFO:tasks.workunit.client.0.smithi077.stdout:9/225: mkdir df/d1b/d56 0 2024-04-25T02:08:46.971 INFO:tasks.workunit.client.0.smithi077.stdout:9/226: readlink df/d1b/l24 0 2024-04-25T02:08:46.972 INFO:tasks.workunit.client.0.smithi077.stdout:9/227: mknod df/d1b/c57 0 2024-04-25T02:08:46.972 INFO:tasks.workunit.client.0.smithi077.stdout:9/228: creat df/f58 x:0 0 0 2024-04-25T02:08:46.973 INFO:tasks.workunit.client.0.smithi077.stdout:8/300: write d3/da/db/df/d2b/f1d [1333670,67276] 0 2024-04-25T02:08:46.974 INFO:tasks.workunit.client.0.smithi077.stdout:9/229: creat df/d1b/d56/f59 x:0 0 0 2024-04-25T02:08:46.977 INFO:tasks.workunit.client.0.smithi077.stdout:8/301: mknod d3/da/db/df/d2b/c5e 0 2024-04-25T02:08:46.982 INFO:tasks.workunit.client.0.smithi077.stdout:1/215: dwrite db/df/f1d [4194304,4194304] 0 2024-04-25T02:08:46.982 INFO:tasks.workunit.client.0.smithi077.stdout:1/216: truncate db/f3b 9023150 0 2024-04-25T02:08:46.987 INFO:tasks.workunit.client.0.smithi077.stdout:9/230: write df/f44 [2648202,30039] 0 2024-04-25T02:08:47.004 INFO:tasks.workunit.client.0.smithi077.stdout:1/217: dwrite db/df/f1d [4194304,4194304] 0 2024-04-25T02:08:47.078 INFO:tasks.workunit.client.0.smithi077.stdout:1/218: symlink db/df/d14/d33/d34/l47 0 2024-04-25T02:08:47.078 INFO:tasks.workunit.client.0.smithi077.stdout:1/219: chown db/df/d14/d33 196019 1 2024-04-25T02:08:47.078 INFO:tasks.workunit.client.0.smithi077.stdout:1/220: chown db/df/d14/d33/l37 0 1 2024-04-25T02:08:47.081 INFO:tasks.workunit.client.1.smithi112.stdout:9/59: creat d1/f15 x:0 0 0 2024-04-25T02:08:47.084 INFO:tasks.workunit.client.0.smithi077.stdout:9/231: dwrite df/f29 [0,4194304] 0 2024-04-25T02:08:47.087 INFO:tasks.workunit.client.0.smithi077.stdout:1/221: dread db/d11/f15 [0,4194304] 0 2024-04-25T02:08:47.088 INFO:tasks.workunit.client.0.smithi077.stdout:1/222: dread db/d11/f15 [0,4194304] 0 2024-04-25T02:08:47.094 INFO:tasks.workunit.client.0.smithi077.stdout:3/235: symlink d0/l4f 0 2024-04-25T02:08:47.100 INFO:tasks.workunit.client.0.smithi077.stdout:9/232: rename df/d1b/c3d to df/c5a 0 2024-04-25T02:08:47.101 INFO:tasks.workunit.client.0.smithi077.stdout:3/236: mkdir d0/d2/d2f/d50 0 2024-04-25T02:08:47.102 INFO:tasks.workunit.client.0.smithi077.stdout:3/237: creat d0/d2/de/d27/f51 x:0 0 0 2024-04-25T02:08:47.102 INFO:tasks.workunit.client.0.smithi077.stdout:3/238: write d0/d2/f35 [1557904,46475] 0 2024-04-25T02:08:47.104 INFO:tasks.workunit.client.0.smithi077.stdout:3/239: rmdir d0 39 2024-04-25T02:08:47.106 INFO:tasks.workunit.client.0.smithi077.stdout:1/223: dwrite db/df/d14/d33/d34/f36 [0,4194304] 0 2024-04-25T02:08:47.106 INFO:tasks.workunit.client.0.smithi077.stdout:3/240: mknod d0/d2/de/c52 0 2024-04-25T02:08:47.106 INFO:tasks.workunit.client.0.smithi077.stdout:9/233: dread df/f18 [0,4194304] 0 2024-04-25T02:08:47.106 INFO:tasks.workunit.client.0.smithi077.stdout:9/234: write df/f4b [119349,50530] 0 2024-04-25T02:08:47.106 INFO:tasks.workunit.client.0.smithi077.stdout:1/224: write db/df/d14/d33/f38 [457843,48570] 0 2024-04-25T02:08:47.106 INFO:tasks.workunit.client.0.smithi077.stdout:9/235: chown df/f14 432873695 1 2024-04-25T02:08:47.106 INFO:tasks.workunit.client.0.smithi077.stdout:9/236: readlink df/l4a 0 2024-04-25T02:08:47.108 INFO:tasks.workunit.client.0.smithi077.stdout:0/261: truncate d2/d17/d1d/f3d 1214890 0 2024-04-25T02:08:47.108 INFO:tasks.workunit.client.0.smithi077.stdout:0/262: dread - d2/d17/d1d/f53 zero size 2024-04-25T02:08:47.109 INFO:tasks.workunit.client.1.smithi112.stdout:6/58: truncate d0/d2/d4/f5 8357012 0 2024-04-25T02:08:47.111 INFO:tasks.workunit.client.0.smithi077.stdout:3/241: write d0/d2/de/f1b [3198862,24483] 0 2024-04-25T02:08:47.111 INFO:tasks.workunit.client.0.smithi077.stdout:1/225: rmdir db/df/d14/d33/d34 39 2024-04-25T02:08:47.114 INFO:tasks.workunit.client.0.smithi077.stdout:1/226: rename db/d11/f15 to db/df/d14/d3e/f48 0 2024-04-25T02:08:47.119 INFO:tasks.workunit.client.0.smithi077.stdout:9/237: dwrite df/f2f [4194304,4194304] 0 2024-04-25T02:08:47.123 INFO:tasks.workunit.client.0.smithi077.stdout:1/227: rename db/df/l44 to db/d11/d32/l49 0 2024-04-25T02:08:47.127 INFO:tasks.workunit.client.0.smithi077.stdout:1/228: unlink db/d11/c41 0 2024-04-25T02:08:47.130 INFO:tasks.workunit.client.0.smithi077.stdout:9/238: rename df/c55 to df/d1b/d48/c5b 0 2024-04-25T02:08:47.130 INFO:tasks.workunit.client.0.smithi077.stdout:1/229: mkdir db/df/d14/d33/d4a 0 2024-04-25T02:08:47.134 INFO:tasks.workunit.client.0.smithi077.stdout:1/230: link db/d11/c24 db/df/d14/d33/c4b 0 2024-04-25T02:08:47.137 INFO:tasks.workunit.client.0.smithi077.stdout:4/240: rmdir d0/d14 39 2024-04-25T02:08:47.139 INFO:tasks.workunit.client.0.smithi077.stdout:4/241: symlink d0/d14/l4f 0 2024-04-25T02:08:47.139 INFO:tasks.workunit.client.0.smithi077.stdout:4/242: read - d0/d14/f33 zero size 2024-04-25T02:08:47.144 INFO:tasks.workunit.client.0.smithi077.stdout:4/243: link d0/de/f4a d0/d14/d21/d39/da/d12/d35/d3e/f50 0 2024-04-25T02:08:47.144 INFO:tasks.workunit.client.0.smithi077.stdout:4/244: fdatasync d0/d14/d21/d39/f10 0 2024-04-25T02:08:47.145 INFO:tasks.workunit.client.0.smithi077.stdout:4/245: fdatasync d0/d14/d21/d39/da/d12/d35/d3e/f2b 0 2024-04-25T02:08:47.145 INFO:tasks.workunit.client.0.smithi077.stdout:4/246: truncate d0/de/d3c/f48 165910 0 2024-04-25T02:08:47.146 INFO:tasks.workunit.client.1.smithi112.stdout:5/91: rmdir d1/d16 39 2024-04-25T02:08:47.146 INFO:tasks.workunit.client.1.smithi112.stdout:5/92: chown d1/f6 6119257 1 2024-04-25T02:08:47.149 INFO:tasks.workunit.client.1.smithi112.stdout:5/93: creat d1/d2/d4/d1d/f25 x:0 0 0 2024-04-25T02:08:47.149 INFO:tasks.workunit.client.0.smithi077.stdout:7/185: read d4/d13/f17 [283437,80838] 0 2024-04-25T02:08:47.150 INFO:tasks.workunit.client.1.smithi112.stdout:5/94: mknod d1/d2/d4/c26 0 2024-04-25T02:08:47.153 INFO:tasks.workunit.client.0.smithi077.stdout:7/186: rename d4/d13/d18/f22 to d4/d13/d18/d24/d3f/f44 0 2024-04-25T02:08:47.155 INFO:tasks.workunit.client.0.smithi077.stdout:7/187: symlink d4/d13/d18/d2d/d30/l45 0 2024-04-25T02:08:47.155 INFO:tasks.workunit.client.0.smithi077.stdout:7/188: creat d4/d13/d18/d2d/f46 x:0 0 0 2024-04-25T02:08:47.155 INFO:tasks.workunit.client.0.smithi077.stdout:7/189: fsync d4/d13/f17 0 2024-04-25T02:08:47.158 INFO:tasks.workunit.client.0.smithi077.stdout:7/190: rename d4/f21 to d4/d13/d18/d2d/f47 0 2024-04-25T02:08:47.159 INFO:tasks.workunit.client.0.smithi077.stdout:7/191: getdents d4/d13/d18/d28 0 2024-04-25T02:08:47.160 INFO:tasks.workunit.client.0.smithi077.stdout:7/192: dread d4/d13/d18/d28/f2b [0,4194304] 0 2024-04-25T02:08:47.160 INFO:tasks.workunit.client.0.smithi077.stdout:7/193: write d4/d13/f17 [1273170,11939] 0 2024-04-25T02:08:47.162 INFO:tasks.workunit.client.0.smithi077.stdout:7/194: dread d4/d13/d18/d2d/d30/f34 [0,4194304] 0 2024-04-25T02:08:47.162 INFO:tasks.workunit.client.0.smithi077.stdout:7/195: chown d4/d13/c1c 36845 1 2024-04-25T02:08:47.162 INFO:tasks.workunit.client.0.smithi077.stdout:7/196: creat d4/d13/f48 x:0 0 0 2024-04-25T02:08:47.162 INFO:tasks.workunit.client.0.smithi077.stdout:4/247: dwrite d0/de/d34/f41 [0,4194304] 0 2024-04-25T02:08:47.164 INFO:tasks.workunit.client.0.smithi077.stdout:7/197: rename d4/ld to d4/d13/d18/d2d/d30/l49 0 2024-04-25T02:08:47.167 INFO:tasks.workunit.client.0.smithi077.stdout:4/248: creat d0/d14/d21/d39/da/d12/d35/d3e/d3a/f51 x:0 0 0 2024-04-25T02:08:47.168 INFO:tasks.workunit.client.1.smithi112.stdout:5/95: dwrite d1/d2/d4/fe [0,4194304] 0 2024-04-25T02:08:47.169 INFO:tasks.workunit.client.0.smithi077.stdout:9/239: getdents df/d1b/d56 0 2024-04-25T02:08:47.170 INFO:tasks.workunit.client.0.smithi077.stdout:9/240: write df/f41 [5060268,44969] 0 2024-04-25T02:08:47.171 INFO:tasks.workunit.client.0.smithi077.stdout:8/302: getdents d3/da/db/df/d2b 0 2024-04-25T02:08:47.174 INFO:tasks.workunit.client.0.smithi077.stdout:9/241: mknod df/d1b/d56/c5c 0 2024-04-25T02:08:47.174 INFO:tasks.workunit.client.0.smithi077.stdout:9/242: write df/f14 [186704,113014] 0 2024-04-25T02:08:47.174 INFO:tasks.workunit.client.0.smithi077.stdout:9/243: read - df/f37 zero size 2024-04-25T02:08:47.177 INFO:tasks.workunit.client.0.smithi077.stdout:8/303: creat d3/d34/d3d/f5f x:0 0 0 2024-04-25T02:08:47.177 INFO:tasks.workunit.client.0.smithi077.stdout:8/304: stat d3/da/l4b 0 2024-04-25T02:08:47.179 INFO:tasks.workunit.client.0.smithi077.stdout:9/244: unlink l1 0 2024-04-25T02:08:47.181 INFO:tasks.workunit.client.0.smithi077.stdout:8/305: truncate d3/da/db/df/d2b/f1d 1948258 0 2024-04-25T02:08:47.184 INFO:tasks.workunit.client.0.smithi077.stdout:1/231: rmdir db/df 39 2024-04-25T02:08:47.185 INFO:tasks.workunit.client.0.smithi077.stdout:4/249: dwrite d0/de/d34/f41 [0,4194304] 0 2024-04-25T02:08:47.188 INFO:tasks.workunit.client.0.smithi077.stdout:6/279: sync 2024-04-25T02:08:47.188 INFO:tasks.workunit.client.0.smithi077.stdout:5/283: sync 2024-04-25T02:08:47.188 INFO:tasks.workunit.client.0.smithi077.stdout:5/284: chown d0/d2/d3/l56 322925 1 2024-04-25T02:08:47.188 INFO:tasks.workunit.client.0.smithi077.stdout:5/285: chown d0/d2/d3/d1d 599628 1 2024-04-25T02:08:47.189 INFO:tasks.workunit.client.0.smithi077.stdout:4/250: rmdir d0/d14 39 2024-04-25T02:08:47.190 INFO:tasks.workunit.client.0.smithi077.stdout:1/232: dread db/d26/f2f [0,4194304] 0 2024-04-25T02:08:47.190 INFO:tasks.workunit.client.1.smithi112.stdout:9/60: symlink d1/d13/l16 0 2024-04-25T02:08:47.193 INFO:tasks.workunit.client.0.smithi077.stdout:9/245: dwrite df/d1b/d48/f54 [0,4194304] 0 2024-04-25T02:08:47.193 INFO:tasks.workunit.client.0.smithi077.stdout:9/246: truncate df/f50 789803 0 2024-04-25T02:08:47.193 INFO:tasks.workunit.client.0.smithi077.stdout:9/247: read - df/d1b/d56/f59 zero size 2024-04-25T02:08:47.194 INFO:tasks.workunit.client.0.smithi077.stdout:5/286: mkdir d0/d2/d3/d9/d39/d44/d5f 0 2024-04-25T02:08:47.194 INFO:tasks.workunit.client.1.smithi112.stdout:9/61: creat d1/f17 x:0 0 0 2024-04-25T02:08:47.195 INFO:tasks.workunit.client.0.smithi077.stdout:2/242: sync 2024-04-25T02:08:47.197 INFO:tasks.workunit.client.0.smithi077.stdout:4/251: creat d0/d14/d21/d39/da/d12/d35/f52 x:0 0 0 2024-04-25T02:08:47.200 INFO:tasks.workunit.client.0.smithi077.stdout:1/233: chown db/d11/c2d 14215389 1 2024-04-25T02:08:47.200 INFO:tasks.workunit.client.0.smithi077.stdout:1/234: chown db/l35 187638 1 2024-04-25T02:08:47.200 INFO:tasks.workunit.client.0.smithi077.stdout:1/235: chown db/df/d14/d33 61085046 1 2024-04-25T02:08:47.200 INFO:tasks.workunit.client.0.smithi077.stdout:1/236: chown db/c2e 8870709 1 2024-04-25T02:08:47.202 INFO:tasks.workunit.client.1.smithi112.stdout:9/62: link d1/f14 d1/d13/f18 0 2024-04-25T02:08:47.203 INFO:tasks.workunit.client.0.smithi077.stdout:6/280: mkdir de/d12/d25/d60 0 2024-04-25T02:08:47.208 INFO:tasks.workunit.client.0.smithi077.stdout:5/287: unlink d0/d2/d5/l24 0 2024-04-25T02:08:47.210 INFO:tasks.workunit.client.1.smithi112.stdout:6/59: dread d0/d2/d4/fc [4194304,4194304] 0 2024-04-25T02:08:47.211 INFO:tasks.workunit.client.0.smithi077.stdout:2/243: creat d2/d9/d18/d31/f4b x:0 0 0 2024-04-25T02:08:47.211 INFO:tasks.workunit.client.0.smithi077.stdout:2/244: write d2/d9/d18/f29 [1822741,91389] 0 2024-04-25T02:08:47.213 INFO:tasks.workunit.client.0.smithi077.stdout:4/252: rename d0/de/f15 to d0/de/f53 0 2024-04-25T02:08:47.213 INFO:tasks.workunit.client.0.smithi077.stdout:5/288: write d0/fd [3860303,129818] 0 2024-04-25T02:08:47.213 INFO:tasks.workunit.client.0.smithi077.stdout:9/248: dwrite df/f43 [0,4194304] 0 2024-04-25T02:08:47.213 INFO:tasks.workunit.client.0.smithi077.stdout:9/249: truncate df/d1b/f46 448550 0 2024-04-25T02:08:47.213 INFO:tasks.workunit.client.0.smithi077.stdout:9/250: dread - df/d1b/f40 zero size 2024-04-25T02:08:47.214 INFO:tasks.workunit.client.0.smithi077.stdout:9/251: write df/f37 [505345,67383] 0 2024-04-25T02:08:47.214 INFO:tasks.workunit.client.0.smithi077.stdout:9/252: truncate df/f2d 557181 0 2024-04-25T02:08:47.215 INFO:tasks.workunit.client.0.smithi077.stdout:6/281: unlink de/d15/f33 0 2024-04-25T02:08:47.215 INFO:tasks.workunit.client.0.smithi077.stdout:6/282: truncate de/d15/d36/f56 901335 0 2024-04-25T02:08:47.216 INFO:tasks.workunit.client.1.smithi112.stdout:6/60: rename d0/le to d0/d2/d4/dd/lf 0 2024-04-25T02:08:47.217 INFO:tasks.workunit.client.0.smithi077.stdout:1/237: dwrite db/fd [0,4194304] 0 2024-04-25T02:08:47.218 INFO:tasks.workunit.client.0.smithi077.stdout:4/253: dread d0/d14/d21/d39/da/d12/d35/d3e/f2b [0,4194304] 0 2024-04-25T02:08:47.218 INFO:tasks.workunit.client.0.smithi077.stdout:4/254: truncate d0/d14/f33 865312 0 2024-04-25T02:08:47.218 INFO:tasks.workunit.client.0.smithi077.stdout:2/245: mkdir d2/d9/d19/d1c/d37/d4c 0 2024-04-25T02:08:47.219 INFO:tasks.workunit.client.0.smithi077.stdout:5/289: creat d0/d2/d3/d9/d39/d44/d5f/f60 x:0 0 0 2024-04-25T02:08:47.221 INFO:tasks.workunit.client.1.smithi112.stdout:6/61: rename d0/d2/d4/fc to d0/d2/f10 0 2024-04-25T02:08:47.221 INFO:tasks.workunit.client.1.smithi112.stdout:6/62: creat d0/d2/d4/f11 x:0 0 0 2024-04-25T02:08:47.227 INFO:tasks.workunit.client.0.smithi077.stdout:9/253: link df/d1b/f30 df/d1b/f5d 0 2024-04-25T02:08:47.227 INFO:tasks.workunit.client.0.smithi077.stdout:9/254: creat df/d1b/d48/f5e x:0 0 0 2024-04-25T02:08:47.229 INFO:tasks.workunit.client.0.smithi077.stdout:6/283: creat de/d53/f61 x:0 0 0 2024-04-25T02:08:47.229 INFO:tasks.workunit.client.0.smithi077.stdout:6/284: dread - de/d12/d25/f52 zero size 2024-04-25T02:08:47.231 INFO:tasks.workunit.client.1.smithi112.stdout:6/63: write d0/f7 [2079430,70805] 0 2024-04-25T02:08:47.233 INFO:tasks.workunit.client.0.smithi077.stdout:4/255: truncate d0/d14/d21/d39/f10 3013129 0 2024-04-25T02:08:47.237 INFO:tasks.workunit.client.0.smithi077.stdout:1/238: dwrite db/df/f1d [4194304,4194304] 0 2024-04-25T02:08:47.242 INFO:tasks.workunit.client.0.smithi077.stdout:9/255: mknod df/d1b/c5f 0 2024-04-25T02:08:47.242 INFO:tasks.workunit.client.0.smithi077.stdout:9/256: truncate df/d1b/f22 614638 0 2024-04-25T02:08:47.243 INFO:tasks.workunit.client.0.smithi077.stdout:4/256: mknod d0/de/c54 0 2024-04-25T02:08:47.244 INFO:tasks.workunit.client.0.smithi077.stdout:5/290: symlink d0/d2/d3/d9/l61 0 2024-04-25T02:08:47.244 INFO:tasks.workunit.client.0.smithi077.stdout:5/291: chown d0/d2/d3/d9/d39/d44/f53 40402081 1 2024-04-25T02:08:47.245 INFO:tasks.workunit.client.1.smithi112.stdout:5/96: truncate d1/d2/d4/fe 4053098 0 2024-04-25T02:08:47.245 INFO:tasks.workunit.client.1.smithi112.stdout:5/97: stat d1/d16 0 2024-04-25T02:08:47.247 INFO:tasks.workunit.client.0.smithi077.stdout:2/246: dwrite d2/d9/f17 [0,4194304] 0 2024-04-25T02:08:47.247 INFO:tasks.workunit.client.0.smithi077.stdout:2/247: fdatasync d2/d28/f32 0 2024-04-25T02:08:47.247 INFO:tasks.workunit.client.0.smithi077.stdout:1/239: mknod db/d11/d42/d43/c4c 0 2024-04-25T02:08:47.247 INFO:tasks.workunit.client.0.smithi077.stdout:1/240: truncate db/df/d14/d33/f38 894818 0 2024-04-25T02:08:47.248 INFO:tasks.workunit.client.0.smithi077.stdout:1/241: fsync db/d11/d32/f3f 0 2024-04-25T02:08:47.249 INFO:tasks.workunit.client.0.smithi077.stdout:6/285: dwrite de/d53/f61 [0,4194304] 0 2024-04-25T02:08:47.253 INFO:tasks.workunit.client.0.smithi077.stdout:6/286: dread de/d12/d25/f2d [0,4194304] 0 2024-04-25T02:08:47.253 INFO:tasks.workunit.client.0.smithi077.stdout:2/248: write f0 [1171684,28708] 0 2024-04-25T02:08:47.255 INFO:tasks.workunit.client.1.smithi112.stdout:9/63: fsync d1/f17 0 2024-04-25T02:08:47.257 INFO:tasks.workunit.client.0.smithi077.stdout:9/257: mkdir df/d60 0 2024-04-25T02:08:47.259 INFO:tasks.workunit.client.1.smithi112.stdout:9/64: chown d1/le 71745 1 2024-04-25T02:08:47.260 INFO:tasks.workunit.client.0.smithi077.stdout:6/287: dread de/d15/f3f [0,4194304] 0 2024-04-25T02:08:47.261 INFO:tasks.workunit.client.0.smithi077.stdout:6/288: fdatasync de/d15/d36/f58 0 2024-04-25T02:08:47.261 INFO:tasks.workunit.client.0.smithi077.stdout:4/257: truncate d0/f18 1006739 0 2024-04-25T02:08:47.262 INFO:tasks.workunit.client.0.smithi077.stdout:5/292: symlink d0/d2/d3/d9/d39/d44/d5f/l62 0 2024-04-25T02:08:47.262 INFO:tasks.workunit.client.0.smithi077.stdout:5/293: dread - d0/d2/d1b/d38/f5e zero size 2024-04-25T02:08:47.262 INFO:tasks.workunit.client.0.smithi077.stdout:5/294: dread - d0/f50 zero size 2024-04-25T02:08:47.262 INFO:tasks.workunit.client.0.smithi077.stdout:5/295: write d0/d2/d3/d9/d39/d44/f48 [356936,76288] 0 2024-04-25T02:08:47.263 INFO:tasks.workunit.client.1.smithi112.stdout:9/65: fdatasync d1/f12 0 2024-04-25T02:08:47.270 INFO:tasks.workunit.client.1.smithi112.stdout:5/98: dwrite d1/f8 [0,4194304] 0 2024-04-25T02:08:47.270 INFO:tasks.workunit.client.1.smithi112.stdout:5/99: dread - d1/d16/d22/f24 zero size 2024-04-25T02:08:47.272 INFO:tasks.workunit.client.1.smithi112.stdout:9/66: mknod d1/df/c19 0 2024-04-25T02:08:47.275 INFO:tasks.workunit.client.1.smithi112.stdout:5/100: unlink d1/f5 0 2024-04-25T02:08:47.277 INFO:tasks.workunit.client.1.smithi112.stdout:9/67: mknod d1/df/c1a 0 2024-04-25T02:08:47.279 INFO:tasks.workunit.client.1.smithi112.stdout:5/101: mkdir d1/d16/d27 0 2024-04-25T02:08:47.279 INFO:tasks.workunit.client.1.smithi112.stdout:5/102: dread - d1/d16/d22/f24 zero size 2024-04-25T02:08:47.281 INFO:tasks.workunit.client.1.smithi112.stdout:9/68: fsync d1/f4 0 2024-04-25T02:08:47.284 INFO:tasks.workunit.client.1.smithi112.stdout:5/103: rmdir d1/d16/d27 0 2024-04-25T02:08:47.287 INFO:tasks.workunit.client.0.smithi077.stdout:9/258: dwrite df/d1b/f40 [0,4194304] 0 2024-04-25T02:08:47.287 INFO:tasks.workunit.client.0.smithi077.stdout:9/259: truncate df/d1b/f30 1696498 0 2024-04-25T02:08:47.287 INFO:tasks.workunit.client.0.smithi077.stdout:2/249: rename d2/d9/d18/d31/l43 to d2/d9/d19/d1c/d37/d4c/l4d 0 2024-04-25T02:08:47.289 INFO:tasks.workunit.client.1.smithi112.stdout:6/64: truncate d0/f7 4175715 0 2024-04-25T02:08:47.290 INFO:tasks.workunit.client.0.smithi077.stdout:6/289: unlink de/d15/l34 0 2024-04-25T02:08:47.292 INFO:tasks.workunit.client.1.smithi112.stdout:5/104: mkdir d1/d2/d28 0 2024-04-25T02:08:47.293 INFO:tasks.workunit.client.0.smithi077.stdout:1/242: mkdir db/df/d14/d4d 0 2024-04-25T02:08:47.294 INFO:tasks.workunit.client.1.smithi112.stdout:6/65: link d0/d2/d4/la d0/d2/d4/l12 0 2024-04-25T02:08:47.294 INFO:tasks.workunit.client.1.smithi112.stdout:6/66: creat d0/d2/d4/f13 x:0 0 0 2024-04-25T02:08:47.295 INFO:tasks.workunit.client.0.smithi077.stdout:4/258: dwrite d0/d14/d21/d39/da/d12/d35/f49 [0,4194304] 0 2024-04-25T02:08:47.297 INFO:tasks.workunit.client.1.smithi112.stdout:5/105: fsync d1/d2/d4/fe 0 2024-04-25T02:08:47.298 INFO:tasks.workunit.client.1.smithi112.stdout:9/69: dwrite d1/f17 [0,4194304] 0 2024-04-25T02:08:47.300 INFO:tasks.workunit.client.1.smithi112.stdout:6/67: mknod d0/c14 0 2024-04-25T02:08:47.300 INFO:tasks.workunit.client.0.smithi077.stdout:6/290: write de/d53/f61 [963372,46362] 0 2024-04-25T02:08:47.300 INFO:tasks.workunit.client.0.smithi077.stdout:5/296: dwrite d0/d2/d3/f31 [0,4194304] 0 2024-04-25T02:08:47.301 INFO:tasks.workunit.client.0.smithi077.stdout:9/260: symlink df/d1b/d56/l61 0 2024-04-25T02:08:47.301 INFO:tasks.workunit.client.0.smithi077.stdout:1/243: dread db/df/d1b/f22 [0,4194304] 0 2024-04-25T02:08:47.302 INFO:tasks.workunit.client.0.smithi077.stdout:1/244: write f1 [3623078,63852] 0 2024-04-25T02:08:47.302 INFO:tasks.workunit.client.0.smithi077.stdout:1/245: truncate db/df/d1b/f22 3919952 0 2024-04-25T02:08:47.302 INFO:tasks.workunit.client.0.smithi077.stdout:1/246: fdatasync db/d11/d32/f3f 0 2024-04-25T02:08:47.302 INFO:tasks.workunit.client.0.smithi077.stdout:1/247: fdatasync db/df/f20 0 2024-04-25T02:08:47.302 INFO:tasks.workunit.client.0.smithi077.stdout:1/248: chown db/df/d14/d3e 61 1 2024-04-25T02:08:47.302 INFO:tasks.workunit.client.0.smithi077.stdout:1/249: fsync f8 0 2024-04-25T02:08:47.302 INFO:tasks.workunit.client.1.smithi112.stdout:5/106: creat d1/f29 x:0 0 0 2024-04-25T02:08:47.303 INFO:tasks.workunit.client.0.smithi077.stdout:2/250: unlink f0 0 2024-04-25T02:08:47.309 INFO:tasks.workunit.client.0.smithi077.stdout:5/297: dread d0/d25/f36 [0,4194304] 0 2024-04-25T02:08:47.310 INFO:tasks.workunit.client.1.smithi112.stdout:9/70: creat d1/d13/f1b x:0 0 0 2024-04-25T02:08:47.312 INFO:tasks.workunit.client.0.smithi077.stdout:4/259: symlink d0/d14/d21/d39/da/d12/d35/l55 0 2024-04-25T02:08:47.314 INFO:tasks.workunit.client.1.smithi112.stdout:6/68: creat d0/d2/f15 x:0 0 0 2024-04-25T02:08:47.314 INFO:tasks.workunit.client.0.smithi077.stdout:6/291: write de/d12/f2a [1437471,50160] 0 2024-04-25T02:08:47.322 INFO:tasks.workunit.client.1.smithi112.stdout:6/69: link d0/d2/d4/dd/lf d0/l16 0 2024-04-25T02:08:47.326 INFO:tasks.workunit.client.0.smithi077.stdout:9/261: dwrite df/f3c [0,4194304] 0 2024-04-25T02:08:47.327 INFO:tasks.workunit.client.1.smithi112.stdout:6/70: creat d0/f17 x:0 0 0 2024-04-25T02:08:47.327 INFO:tasks.workunit.client.0.smithi077.stdout:1/250: dwrite db/df/d14/d33/d34/f36 [0,4194304] 0 2024-04-25T02:08:47.328 INFO:tasks.workunit.client.0.smithi077.stdout:3/242: sync 2024-04-25T02:08:47.328 INFO:tasks.workunit.client.0.smithi077.stdout:0/263: sync 2024-04-25T02:08:47.328 INFO:tasks.workunit.client.0.smithi077.stdout:1/251: dread db/f3b [8388608,4194304] 0 2024-04-25T02:08:47.328 INFO:tasks.workunit.client.0.smithi077.stdout:0/264: truncate d2/d1c/f4f 136866 0 2024-04-25T02:08:47.331 INFO:tasks.workunit.client.1.smithi112.stdout:6/71: symlink d0/d2/d4/dd/l18 0 2024-04-25T02:08:47.331 INFO:tasks.workunit.client.1.smithi112.stdout:6/72: creat d0/d2/d4/f19 x:0 0 0 2024-04-25T02:08:47.337 INFO:tasks.workunit.client.0.smithi077.stdout:2/251: symlink d2/d9/d2f/l4e 0 2024-04-25T02:08:47.341 INFO:tasks.workunit.client.1.smithi112.stdout:5/107: dwrite d1/f15 [0,4194304] 0 2024-04-25T02:08:47.341 INFO:tasks.workunit.client.1.smithi112.stdout:5/108: fsync d1/f18 0 2024-04-25T02:08:47.341 INFO:tasks.workunit.client.1.smithi112.stdout:5/109: creat d1/d2/d4/d1d/f2a x:0 0 0 2024-04-25T02:08:47.341 INFO:tasks.workunit.client.1.smithi112.stdout:5/110: chown d1/f6 152 1 2024-04-25T02:08:47.341 INFO:tasks.workunit.client.1.smithi112.stdout:5/111: chown d1/d16 0 1 2024-04-25T02:08:47.342 INFO:tasks.workunit.client.0.smithi077.stdout:5/298: unlink d0/d2/d3/f17 0 2024-04-25T02:08:47.342 INFO:tasks.workunit.client.0.smithi077.stdout:5/299: write d0/fd [4575446,56385] 0 2024-04-25T02:08:47.342 INFO:tasks.workunit.client.0.smithi077.stdout:3/243: dread d0/d17/f19 [0,4194304] 0 2024-04-25T02:08:47.342 INFO:tasks.workunit.client.0.smithi077.stdout:4/260: write d0/d14/d21/d39/da/d12/d35/d3e/f4b [677579,103307] 0 2024-04-25T02:08:47.346 INFO:tasks.workunit.client.0.smithi077.stdout:6/292: truncate f1 97420 0 2024-04-25T02:08:47.346 INFO:tasks.workunit.client.0.smithi077.stdout:6/293: chown de/d15/d36/f56 9581 1 2024-04-25T02:08:47.346 INFO:tasks.workunit.client.0.smithi077.stdout:6/294: dread - de/d12/d25/d3a/f5f zero size 2024-04-25T02:08:47.348 INFO:tasks.workunit.client.1.smithi112.stdout:6/73: dread d0/d2/d4/f5 [0,4194304] 0 2024-04-25T02:08:47.348 INFO:tasks.workunit.client.1.smithi112.stdout:6/74: readlink d0/d2/d4/l12 0 2024-04-25T02:08:47.348 INFO:tasks.workunit.client.1.smithi112.stdout:6/75: creat d0/f1a x:0 0 0 2024-04-25T02:08:47.350 INFO:tasks.workunit.client.0.smithi077.stdout:9/262: dwrite df/f49 [0,4194304] 0 2024-04-25T02:08:47.350 INFO:tasks.workunit.client.0.smithi077.stdout:9/263: dread - df/f39 zero size 2024-04-25T02:08:47.350 INFO:tasks.workunit.client.0.smithi077.stdout:9/264: fdatasync df/f3c 0 2024-04-25T02:08:47.350 INFO:tasks.workunit.client.0.smithi077.stdout:1/252: mknod db/c4e 0 2024-04-25T02:08:47.351 INFO:tasks.workunit.client.0.smithi077.stdout:1/253: chown db/df/d14/d33/l37 35 1 2024-04-25T02:08:47.351 INFO:tasks.workunit.client.0.smithi077.stdout:3/244: dread d0/d17/f19 [0,4194304] 0 2024-04-25T02:08:47.351 INFO:tasks.workunit.client.0.smithi077.stdout:3/245: dread - d0/d2/de/d48/f3b zero size 2024-04-25T02:08:47.352 INFO:tasks.workunit.client.0.smithi077.stdout:0/265: unlink d2/d8/c3a 0 2024-04-25T02:08:47.353 INFO:tasks.workunit.client.0.smithi077.stdout:0/266: rename d2/d17/d1d/d34 to d2/d17/d1d/d34/d5a 22 2024-04-25T02:08:47.355 INFO:tasks.workunit.client.0.smithi077.stdout:5/300: symlink d0/d2/d3/l63 0 2024-04-25T02:08:47.355 INFO:tasks.workunit.client.0.smithi077.stdout:5/301: creat d0/d2/d1b/d38/f64 x:0 0 0 2024-04-25T02:08:47.355 INFO:tasks.workunit.client.0.smithi077.stdout:5/302: fsync d0/f50 0 2024-04-25T02:08:47.358 INFO:tasks.workunit.client.0.smithi077.stdout:4/261: link d0/de/l1e d0/d14/d21/d39/d1d/l56 0 2024-04-25T02:08:47.358 INFO:tasks.workunit.client.0.smithi077.stdout:4/262: fsync d0/f16 0 2024-04-25T02:08:47.360 INFO:tasks.workunit.client.0.smithi077.stdout:6/295: truncate de/f13 1315665 0 2024-04-25T02:08:47.360 INFO:tasks.workunit.client.0.smithi077.stdout:6/296: chown de/d12/d25/d4b/c5e 1001306 1 2024-04-25T02:08:47.360 INFO:tasks.workunit.client.1.smithi112.stdout:9/71: rmdir d1/d13 39 2024-04-25T02:08:47.362 INFO:tasks.workunit.client.0.smithi077.stdout:2/252: dwrite d2/d9/d19/f3b [0,4194304] 0 2024-04-25T02:08:47.362 INFO:tasks.workunit.client.0.smithi077.stdout:9/265: read f3 [7046742,79980] 0 2024-04-25T02:08:47.362 INFO:tasks.workunit.client.0.smithi077.stdout:9/266: write df/f18 [633895,2547] 0 2024-04-25T02:08:47.362 INFO:tasks.workunit.client.0.smithi077.stdout:9/267: truncate df/f37 1296535 0 2024-04-25T02:08:47.362 INFO:tasks.workunit.client.0.smithi077.stdout:9/268: getdents df/d60 0 2024-04-25T02:08:47.362 INFO:tasks.workunit.client.0.smithi077.stdout:9/269: creat df/f62 x:0 0 0 2024-04-25T02:08:47.365 INFO:tasks.workunit.client.0.smithi077.stdout:3/246: chown d0/d2/de/d48/cb 1 1 2024-04-25T02:08:47.365 INFO:tasks.workunit.client.0.smithi077.stdout:3/247: fsync d0/d2/de/d48/f3b 0 2024-04-25T02:08:47.365 INFO:tasks.workunit.client.0.smithi077.stdout:1/254: dwrite db/d11/d32/f3f [0,4194304] 0 2024-04-25T02:08:47.366 INFO:tasks.workunit.client.0.smithi077.stdout:0/267: symlink d2/d8/d10/d51/l5b 0 2024-04-25T02:08:47.369 INFO:tasks.workunit.client.0.smithi077.stdout:5/303: rename d0/d2/d20/d23/l2d to d0/d2/d52/l65 0 2024-04-25T02:08:47.375 INFO:tasks.workunit.client.0.smithi077.stdout:7/198: sync 2024-04-25T02:08:47.375 INFO:tasks.workunit.client.0.smithi077.stdout:8/306: sync 2024-04-25T02:08:47.375 INFO:tasks.workunit.client.0.smithi077.stdout:7/199: dread - d4/d13/d18/f36 zero size 2024-04-25T02:08:47.375 INFO:tasks.workunit.client.1.smithi112.stdout:9/72: dwrite d1/df/f11 [0,4194304] 0 2024-04-25T02:08:47.377 INFO:tasks.workunit.client.0.smithi077.stdout:2/253: fdatasync d2/d28/f32 0 2024-04-25T02:08:47.378 INFO:tasks.workunit.client.0.smithi077.stdout:8/307: dread d3/d34/f48 [0,4194304] 0 2024-04-25T02:08:47.378 INFO:tasks.workunit.client.0.smithi077.stdout:8/308: stat d3/d34/f48 0 2024-04-25T02:08:47.378 INFO:tasks.workunit.client.0.smithi077.stdout:8/309: fsync d3/da/db/df/d2b/d37/f4d 0 2024-04-25T02:08:47.379 INFO:tasks.workunit.client.0.smithi077.stdout:1/255: dread f1 [0,4194304] 0 2024-04-25T02:08:47.379 INFO:tasks.workunit.client.0.smithi077.stdout:1/256: truncate db/df/d14/f17 1615587 0 2024-04-25T02:08:47.379 INFO:tasks.workunit.client.0.smithi077.stdout:1/257: readlink db/df/d14/d33/l37 0 2024-04-25T02:08:47.383 INFO:tasks.workunit.client.0.smithi077.stdout:9/270: truncate f3 5167976 0 2024-04-25T02:08:47.383 INFO:tasks.workunit.client.0.smithi077.stdout:9/271: creat df/d1b/f63 x:0 0 0 2024-04-25T02:08:47.383 INFO:tasks.workunit.client.0.smithi077.stdout:9/272: fdatasync df/d1b/d56/f59 0 2024-04-25T02:08:47.383 INFO:tasks.workunit.client.0.smithi077.stdout:9/273: creat df/d1b/d48/f64 x:0 0 0 2024-04-25T02:08:47.383 INFO:tasks.workunit.client.1.smithi112.stdout:9/73: dread d1/f12 [0,4194304] 0 2024-04-25T02:08:47.384 INFO:tasks.workunit.client.1.smithi112.stdout:6/76: getdents d0/d2/d4 0 2024-04-25T02:08:47.384 INFO:tasks.workunit.client.1.smithi112.stdout:6/77: fdatasync d0/f7 0 2024-04-25T02:08:47.385 INFO:tasks.workunit.client.0.smithi077.stdout:3/248: unlink d0/d2/de/d48/d15/f43 0 2024-04-25T02:08:47.385 INFO:tasks.workunit.client.0.smithi077.stdout:3/249: chown d0/d2/de/d27 113053 1 2024-04-25T02:08:47.386 INFO:tasks.workunit.client.0.smithi077.stdout:3/250: chown d0/d2/de/f1b 89665 1 2024-04-25T02:08:47.387 INFO:tasks.workunit.client.1.smithi112.stdout:6/78: mknod d0/d2/c1b 0 2024-04-25T02:08:47.387 INFO:tasks.workunit.client.1.smithi112.stdout:6/79: stat d0/d2/d4/dd 0 2024-04-25T02:08:47.388 INFO:tasks.workunit.client.0.smithi077.stdout:0/268: dwrite d2/d27/d2d/f2f [0,4194304] 0 2024-04-25T02:08:47.388 INFO:tasks.workunit.client.0.smithi077.stdout:0/269: truncate d2/d8/fe 1676084 0 2024-04-25T02:08:47.391 INFO:tasks.workunit.client.1.smithi112.stdout:6/80: rename d0/d2/d4/dd/lf to d0/d2/d4/l1c 0 2024-04-25T02:08:47.393 INFO:tasks.workunit.client.0.smithi077.stdout:5/304: symlink d0/d2/d5/l66 0 2024-04-25T02:08:47.395 INFO:tasks.workunit.client.0.smithi077.stdout:4/263: link d0/d14/d21/f2a d0/d14/d21/d39/da/d12/d35/d3e/f57 0 2024-04-25T02:08:47.397 INFO:tasks.workunit.client.1.smithi112.stdout:6/81: creat d0/d2/d4/f1d x:0 0 0 2024-04-25T02:08:47.397 INFO:tasks.workunit.client.1.smithi112.stdout:6/82: dread - d0/d2/d4/f11 zero size 2024-04-25T02:08:47.397 INFO:tasks.workunit.client.0.smithi077.stdout:3/251: dread d0/d2/de/d48/d15/f1d [0,4194304] 0 2024-04-25T02:08:47.406 INFO:tasks.workunit.client.0.smithi077.stdout:6/297: symlink de/d12/d25/l62 0 2024-04-25T02:08:47.408 INFO:tasks.workunit.client.0.smithi077.stdout:2/254: symlink d2/d9/d19/l4f 0 2024-04-25T02:08:47.409 INFO:tasks.workunit.client.0.smithi077.stdout:8/310: mknod d3/da/db/df/d30/c60 0 2024-04-25T02:08:47.409 INFO:tasks.workunit.client.0.smithi077.stdout:8/311: chown d3/da/db/c19 4 1 2024-04-25T02:08:47.411 INFO:tasks.workunit.client.0.smithi077.stdout:1/258: mknod db/d11/d32/c4f 0 2024-04-25T02:08:47.413 INFO:tasks.workunit.client.0.smithi077.stdout:9/274: dwrite df/f41 [0,4194304] 0 2024-04-25T02:08:47.423 INFO:tasks.workunit.client.0.smithi077.stdout:5/305: creat d0/d2/d20/d23/f67 x:0 0 0 2024-04-25T02:08:47.423 INFO:tasks.workunit.client.0.smithi077.stdout:3/252: symlink d0/d2/l53 0 2024-04-25T02:08:47.426 INFO:tasks.workunit.client.1.smithi112.stdout:9/74: dwrite d1/f4 [0,4194304] 0 2024-04-25T02:08:47.426 INFO:tasks.workunit.client.1.smithi112.stdout:9/75: chown d1/df/c1a 1 1 2024-04-25T02:08:47.427 INFO:tasks.workunit.client.0.smithi077.stdout:7/200: rmdir d4/d13/d18 39 2024-04-25T02:08:47.428 INFO:tasks.workunit.client.0.smithi077.stdout:6/298: rename de/d15/d35 to de/d12/d25/d60/d63 0 2024-04-25T02:08:47.430 INFO:tasks.workunit.client.0.smithi077.stdout:2/255: creat d2/d9/df/f50 x:0 0 0 2024-04-25T02:08:47.430 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:47 smithi112 ceph-mon[33313]: pgmap v253: 65 pgs: 65 active+clean; 578 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 32 MiB/s rd, 52 MiB/s wr, 266 op/s 2024-04-25T02:08:47.431 INFO:tasks.workunit.client.0.smithi077.stdout:1/259: truncate db/f3b 4885591 0 2024-04-25T02:08:47.432 INFO:tasks.workunit.client.0.smithi077.stdout:9/275: rmdir df/d1b/d56 39 2024-04-25T02:08:47.432 INFO:tasks.workunit.client.0.smithi077.stdout:9/276: creat df/d1b/f65 x:0 0 0 2024-04-25T02:08:47.433 INFO:tasks.workunit.client.0.smithi077.stdout:9/277: write df/d1b/d48/f5e [305934,60283] 0 2024-04-25T02:08:47.433 INFO:tasks.workunit.client.0.smithi077.stdout:9/278: creat df/d1b/d48/f66 x:0 0 0 2024-04-25T02:08:47.434 INFO:tasks.workunit.client.0.smithi077.stdout:3/253: symlink d0/d2/l54 0 2024-04-25T02:08:47.434 INFO:tasks.workunit.client.0.smithi077.stdout:3/254: dread - d0/d2/de/d48/f44 zero size 2024-04-25T02:08:47.437 INFO:tasks.workunit.client.0.smithi077.stdout:0/270: dwrite d2/d17/d1d/d34/f36 [0,4194304] 0 2024-04-25T02:08:47.437 INFO:tasks.workunit.client.0.smithi077.stdout:4/264: dwrite d0/de/f53 [0,4194304] 0 2024-04-25T02:08:47.437 INFO:tasks.workunit.client.0.smithi077.stdout:0/271: write d2/d1c/f24 [814400,128865] 0 2024-04-25T02:08:47.437 INFO:tasks.workunit.client.1.smithi112.stdout:6/83: dwrite d0/d2/f15 [0,4194304] 0 2024-04-25T02:08:47.438 INFO:tasks.workunit.client.0.smithi077.stdout:8/312: dwrite d3/d34/d3d/f5f [0,4194304] 0 2024-04-25T02:08:47.438 INFO:tasks.workunit.client.0.smithi077.stdout:7/201: getdents d4/d13/d18/d24/d3f 0 2024-04-25T02:08:47.443 INFO:tasks.workunit.client.0.smithi077.stdout:2/256: getdents d2/d9/d2f 0 2024-04-25T02:08:47.443 INFO:tasks.workunit.client.0.smithi077.stdout:2/257: write d2/d9/d18/d31/f4b [79891,76946] 0 2024-04-25T02:08:47.449 INFO:tasks.workunit.client.1.smithi112.stdout:6/84: mknod d0/c1e 0 2024-04-25T02:08:47.449 INFO:tasks.workunit.client.0.smithi077.stdout:1/260: rmdir db/df/d14/d33/d34 39 2024-04-25T02:08:47.453 INFO:tasks.workunit.client.0.smithi077.stdout:4/265: dread d0/d14/d21/d39/da/d12/d35/f49 [0,4194304] 0 2024-04-25T02:08:47.453 INFO:tasks.workunit.client.0.smithi077.stdout:4/266: chown d0/d14/d21 0 1 2024-04-25T02:08:47.454 INFO:tasks.workunit.client.1.smithi112.stdout:6/85: mkdir d0/d2/d1f 0 2024-04-25T02:08:47.454 INFO:tasks.workunit.client.1.smithi112.stdout:9/76: dwrite d1/f15 [0,4194304] 0 2024-04-25T02:08:47.455 INFO:tasks.workunit.client.0.smithi077.stdout:8/313: dwrite d3/da/d27/f2d [0,4194304] 0 2024-04-25T02:08:47.455 INFO:tasks.workunit.client.0.smithi077.stdout:8/314: chown d3/da/db/df/d30/f55 195 1 2024-04-25T02:08:47.456 INFO:tasks.workunit.client.0.smithi077.stdout:9/279: mkdir df/d1b/d56/d67 0 2024-04-25T02:08:47.456 INFO:tasks.workunit.client.0.smithi077.stdout:5/306: mkdir d0/d2/d68 0 2024-04-25T02:08:47.457 INFO:tasks.workunit.client.1.smithi112.stdout:6/86: stat d0/d2/d4/la 0 2024-04-25T02:08:47.458 INFO:tasks.workunit.client.0.smithi077.stdout:3/255: chown d0/d2/d2f/f46 22 1 2024-04-25T02:08:47.463 INFO:tasks.workunit.client.0.smithi077.stdout:9/280: write fc [767733,86270] 0 2024-04-25T02:08:47.468 INFO:tasks.workunit.client.1.smithi112.stdout:6/87: truncate d0/f7 3492178 0 2024-04-25T02:08:47.472 INFO:tasks.workunit.client.0.smithi077.stdout:0/272: mknod d2/d8/d10/c5c 0 2024-04-25T02:08:47.476 INFO:tasks.workunit.client.1.smithi112.stdout:9/77: rename d1/fb to d1/f1c 0 2024-04-25T02:08:47.479 INFO:tasks.workunit.client.0.smithi077.stdout:7/202: mknod d4/d13/d18/d2d/d30/c4a 0 2024-04-25T02:08:47.479 INFO:tasks.workunit.client.0.smithi077.stdout:7/203: chown d4/d13/d18/c32 482009036 1 2024-04-25T02:08:47.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:47 smithi077 ceph-mon[26330]: pgmap v253: 65 pgs: 65 active+clean; 578 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 32 MiB/s rd, 52 MiB/s wr, 266 op/s 2024-04-25T02:08:47.480 INFO:tasks.workunit.client.0.smithi077.stdout:6/299: getdents de/d12/d25 0 2024-04-25T02:08:47.480 INFO:tasks.workunit.client.0.smithi077.stdout:6/300: write de/d12/d25/d3a/f5f [89844,88598] 0 2024-04-25T02:08:47.483 INFO:tasks.workunit.client.0.smithi077.stdout:8/315: dwrite d3/da/db/df/d2b/d37/f4d [0,4194304] 0 2024-04-25T02:08:47.484 INFO:tasks.workunit.client.0.smithi077.stdout:4/267: mknod d0/de/c58 0 2024-04-25T02:08:47.484 INFO:tasks.workunit.client.0.smithi077.stdout:4/268: write d0/d14/f33 [489812,62013] 0 2024-04-25T02:08:47.488 INFO:tasks.workunit.client.0.smithi077.stdout:8/316: dread d3/f8 [0,4194304] 0 2024-04-25T02:08:47.494 INFO:tasks.workunit.client.0.smithi077.stdout:0/273: dwrite d2/d8/f55 [0,4194304] 0 2024-04-25T02:08:47.497 INFO:tasks.workunit.client.1.smithi112.stdout:6/88: dread d0/f7 [0,4194304] 0 2024-04-25T02:08:47.500 INFO:tasks.workunit.client.0.smithi077.stdout:5/307: unlink d0/f51 0 2024-04-25T02:08:47.500 INFO:tasks.workunit.client.0.smithi077.stdout:5/308: dread - d0/d2/d3/f34 zero size 2024-04-25T02:08:47.501 INFO:tasks.workunit.client.0.smithi077.stdout:3/256: mknod d0/d3e/c55 0 2024-04-25T02:08:47.503 INFO:tasks.workunit.client.0.smithi077.stdout:0/274: write d2/d8/f55 [2193808,38004] 0 2024-04-25T02:08:47.505 INFO:tasks.workunit.client.0.smithi077.stdout:9/281: mkdir df/d1b/d56/d67/d68 0 2024-04-25T02:08:47.505 INFO:tasks.workunit.client.0.smithi077.stdout:9/282: creat df/d1b/f69 x:0 0 0 2024-04-25T02:08:47.505 INFO:tasks.workunit.client.0.smithi077.stdout:9/283: fdatasync df/f26 0 2024-04-25T02:08:47.509 INFO:tasks.workunit.client.0.smithi077.stdout:7/204: symlink d4/d13/d2c/l4b 0 2024-04-25T02:08:47.509 INFO:tasks.workunit.client.0.smithi077.stdout:3/257: dread d0/d2/de/d48/d15/f1d [0,4194304] 0 2024-04-25T02:08:47.509 INFO:tasks.workunit.client.0.smithi077.stdout:6/301: mknod de/d12/c64 0 2024-04-25T02:08:47.509 INFO:tasks.workunit.client.0.smithi077.stdout:1/261: mkdir db/df/d14/d50 0 2024-04-25T02:08:47.509 INFO:tasks.workunit.client.0.smithi077.stdout:7/205: write d4/fa [1375488,121199] 0 2024-04-25T02:08:47.509 INFO:tasks.workunit.client.0.smithi077.stdout:1/262: readlink db/l35 0 2024-04-25T02:08:47.509 INFO:tasks.workunit.client.0.smithi077.stdout:7/206: dread - d4/f33 zero size 2024-04-25T02:08:47.510 INFO:tasks.workunit.client.0.smithi077.stdout:4/269: symlink d0/d14/d21/d39/da/l59 0 2024-04-25T02:08:47.510 INFO:tasks.workunit.client.0.smithi077.stdout:8/317: mknod d3/da/db/df/d2b/d37/c61 0 2024-04-25T02:08:47.515 INFO:tasks.workunit.client.0.smithi077.stdout:5/309: rename d0/d2/d3/d1d/c22 to d0/d2/d1b/c69 0 2024-04-25T02:08:47.516 INFO:tasks.workunit.client.0.smithi077.stdout:0/275: mknod d2/d8/d10/c5d 0 2024-04-25T02:08:47.518 INFO:tasks.workunit.client.0.smithi077.stdout:9/284: symlink df/l6a 0 2024-04-25T02:08:47.519 INFO:tasks.workunit.client.0.smithi077.stdout:3/258: creat d0/d2/de/d48/d15/f56 x:0 0 0 2024-04-25T02:08:47.521 INFO:tasks.workunit.client.0.smithi077.stdout:6/302: link de/d12/d25/d4b/c5e de/d12/d25/d4b/c65 0 2024-04-25T02:08:47.521 INFO:tasks.workunit.client.0.smithi077.stdout:5/310: dread d0/d2/d3/d1d/f28 [0,4194304] 0 2024-04-25T02:08:47.522 INFO:tasks.workunit.client.1.smithi112.stdout:6/89: dwrite d0/d2/f10 [4194304,4194304] 0 2024-04-25T02:08:47.523 INFO:tasks.workunit.client.0.smithi077.stdout:7/207: unlink d4/d13/l26 0 2024-04-25T02:08:47.523 INFO:tasks.workunit.client.0.smithi077.stdout:1/263: dwrite db/fd [0,4194304] 0 2024-04-25T02:08:47.524 INFO:tasks.workunit.client.0.smithi077.stdout:4/270: truncate d0/d14/d21/d39/d1d/f2c 296792 0 2024-04-25T02:08:47.524 INFO:tasks.workunit.client.0.smithi077.stdout:4/271: truncate d0/de/d25/f45 1439095 0 2024-04-25T02:08:47.527 INFO:tasks.workunit.client.0.smithi077.stdout:8/318: link d3/da/db/c54 d3/da/db/df/d30/c62 0 2024-04-25T02:08:47.527 INFO:tasks.workunit.client.0.smithi077.stdout:8/319: chown d3/da/db/df/d2b/d37/c4f 4 1 2024-04-25T02:08:47.530 INFO:tasks.workunit.client.0.smithi077.stdout:0/276: mkdir d2/d17/d4e/d5e 0 2024-04-25T02:08:47.531 INFO:tasks.workunit.client.1.smithi112.stdout:6/90: mknod d0/d2/d4/dd/c20 0 2024-04-25T02:08:47.531 INFO:tasks.workunit.client.0.smithi077.stdout:3/259: rmdir d0/d17 39 2024-04-25T02:08:47.533 INFO:tasks.workunit.client.0.smithi077.stdout:5/311: creat d0/d2/d52/f6a x:0 0 0 2024-04-25T02:08:47.533 INFO:tasks.workunit.client.0.smithi077.stdout:6/303: dread f9 [0,4194304] 0 2024-04-25T02:08:47.534 INFO:tasks.workunit.client.0.smithi077.stdout:7/208: creat d4/d13/d18/d28/f4c x:0 0 0 2024-04-25T02:08:47.535 INFO:tasks.workunit.client.0.smithi077.stdout:1/264: mknod db/c51 0 2024-04-25T02:08:47.537 INFO:tasks.workunit.client.0.smithi077.stdout:2/258: sync 2024-04-25T02:08:47.537 INFO:tasks.workunit.client.0.smithi077.stdout:9/285: dwrite df/d1b/f5d [0,4194304] 0 2024-04-25T02:08:47.538 INFO:tasks.workunit.client.0.smithi077.stdout:4/272: rename d0/de/l1e to d0/de/d25/l5a 0 2024-04-25T02:08:47.539 INFO:tasks.workunit.client.0.smithi077.stdout:9/286: dread df/f37 [0,4194304] 0 2024-04-25T02:08:47.540 INFO:tasks.workunit.client.0.smithi077.stdout:9/287: creat df/f6b x:0 0 0 2024-04-25T02:08:47.540 INFO:tasks.workunit.client.0.smithi077.stdout:9/288: dread - df/f39 zero size 2024-04-25T02:08:47.541 INFO:tasks.workunit.client.0.smithi077.stdout:0/277: truncate d2/d1c/f24 140260 0 2024-04-25T02:08:47.541 INFO:tasks.workunit.client.1.smithi112.stdout:6/91: dread d0/d2/f15 [0,4194304] 0 2024-04-25T02:08:47.541 INFO:tasks.workunit.client.0.smithi077.stdout:7/209: write d4/fb [2741595,109798] 0 2024-04-25T02:08:47.542 INFO:tasks.workunit.client.0.smithi077.stdout:7/210: write d4/d13/d18/d2d/d30/f42 [973579,18716] 0 2024-04-25T02:08:47.542 INFO:tasks.workunit.client.0.smithi077.stdout:7/211: chown d4/d13/d18/d28/f4c 10 1 2024-04-25T02:08:47.542 INFO:tasks.workunit.client.0.smithi077.stdout:3/260: creat d0/d40/f57 x:0 0 0 2024-04-25T02:08:47.542 INFO:tasks.workunit.client.0.smithi077.stdout:3/261: dread - d0/d2/de/d48/d15/f56 zero size 2024-04-25T02:08:47.545 INFO:tasks.workunit.client.0.smithi077.stdout:1/265: dread db/d11/f30 [0,4194304] 0 2024-04-25T02:08:47.547 INFO:tasks.workunit.client.0.smithi077.stdout:2/259: mknod d2/d9/d18/c51 0 2024-04-25T02:08:47.547 INFO:tasks.workunit.client.0.smithi077.stdout:2/260: write d2/d9/d19/d1c/d3f/f40 [739368,44810] 0 2024-04-25T02:08:47.547 INFO:tasks.workunit.client.0.smithi077.stdout:2/261: truncate d2/d9/d2f/f38 1897305 0 2024-04-25T02:08:47.547 INFO:tasks.workunit.client.0.smithi077.stdout:2/262: dread - d2/d9/d19/f23 zero size 2024-04-25T02:08:47.556 INFO:tasks.workunit.client.0.smithi077.stdout:4/273: unlink d0/de/d3c/f48 0 2024-04-25T02:08:47.556 INFO:tasks.workunit.client.1.smithi112.stdout:6/92: write d0/d2/d4/f5 [6687939,30833] 0 2024-04-25T02:08:47.556 INFO:tasks.workunit.client.1.smithi112.stdout:6/93: dread - d0/d2/d4/f1d zero size 2024-04-25T02:08:47.557 INFO:tasks.workunit.client.0.smithi077.stdout:8/320: rmdir d3/da/db/df/d2b/d37 39 2024-04-25T02:08:47.557 INFO:tasks.workunit.client.0.smithi077.stdout:8/321: chown d3/da/d27/d16/c51 509941134 1 2024-04-25T02:08:47.560 INFO:tasks.workunit.client.1.smithi112.stdout:6/94: rename d0/d2/d4/dd/c20 to d0/d2/d4/dd/c21 0 2024-04-25T02:08:47.562 INFO:tasks.workunit.client.0.smithi077.stdout:9/289: rename df/f2d to df/d1b/d56/f6c 0 2024-04-25T02:08:47.563 INFO:tasks.workunit.client.0.smithi077.stdout:0/278: mkdir d2/d8/d5f 0 2024-04-25T02:08:47.563 INFO:tasks.workunit.client.0.smithi077.stdout:0/279: read d2/d1c/f4f [114419,93985] 0 2024-04-25T02:08:47.564 INFO:tasks.workunit.client.1.smithi112.stdout:6/95: dread d0/d2/f15 [0,4194304] 0 2024-04-25T02:08:47.564 INFO:tasks.workunit.client.1.smithi112.stdout:6/96: chown d0/f17 1443394 1 2024-04-25T02:08:47.564 INFO:tasks.workunit.client.0.smithi077.stdout:7/212: rmdir d4/d13/d18/d2d 39 2024-04-25T02:08:47.565 INFO:tasks.workunit.client.0.smithi077.stdout:2/263: creat d2/d9/f52 x:0 0 0 2024-04-25T02:08:47.565 INFO:tasks.workunit.client.0.smithi077.stdout:2/264: stat d2/d9/d19/d1c/d3f/f40 0 2024-04-25T02:08:47.566 INFO:tasks.workunit.client.1.smithi112.stdout:6/97: symlink d0/l22 0 2024-04-25T02:08:47.566 INFO:tasks.workunit.client.1.smithi112.stdout:6/98: dread - d0/d2/d4/f13 zero size 2024-04-25T02:08:47.567 INFO:tasks.workunit.client.0.smithi077.stdout:8/322: truncate d3/da/d27/d16/f22 1787180 0 2024-04-25T02:08:47.567 INFO:tasks.workunit.client.0.smithi077.stdout:8/323: chown d3/c31 12722421 1 2024-04-25T02:08:47.567 INFO:tasks.workunit.client.0.smithi077.stdout:6/304: write f1 [250977,58991] 0 2024-04-25T02:08:47.568 INFO:tasks.workunit.client.0.smithi077.stdout:9/290: mknod df/d1b/d56/d67/c6d 0 2024-04-25T02:08:47.568 INFO:tasks.workunit.client.0.smithi077.stdout:9/291: creat df/d1b/f6e x:0 0 0 2024-04-25T02:08:47.568 INFO:tasks.workunit.client.0.smithi077.stdout:9/292: chown df/f2f 3727 1 2024-04-25T02:08:47.570 INFO:tasks.workunit.client.0.smithi077.stdout:9/293: dread df/f37 [0,4194304] 0 2024-04-25T02:08:47.570 INFO:tasks.workunit.client.0.smithi077.stdout:9/294: creat df/d1b/d48/f6f x:0 0 0 2024-04-25T02:08:47.570 INFO:tasks.workunit.client.0.smithi077.stdout:7/213: truncate d4/f12 3453731 0 2024-04-25T02:08:47.571 INFO:tasks.workunit.client.0.smithi077.stdout:7/214: truncate d4/d13/d18/d2d/f46 522381 0 2024-04-25T02:08:47.577 INFO:tasks.workunit.client.0.smithi077.stdout:4/274: write d0/d14/d21/d39/f42 [2139177,56555] 0 2024-04-25T02:08:47.577 INFO:tasks.workunit.client.0.smithi077.stdout:3/262: dwrite d0/d2/de/d48/d15/f2b [0,4194304] 0 2024-04-25T02:08:47.577 INFO:tasks.workunit.client.0.smithi077.stdout:4/275: readlink d0/l3 0 2024-04-25T02:08:47.577 INFO:tasks.workunit.client.0.smithi077.stdout:3/263: write d0/d2/de/d48/f44 [970594,53964] 0 2024-04-25T02:08:47.577 INFO:tasks.workunit.client.0.smithi077.stdout:4/276: write d0/d14/d21/d39/da/d12/d35/d3e/f2b [2027665,124327] 0 2024-04-25T02:08:47.577 INFO:tasks.workunit.client.0.smithi077.stdout:3/264: write d0/d2/de/d48/d15/f1d [4987679,47844] 0 2024-04-25T02:08:47.578 INFO:tasks.workunit.client.0.smithi077.stdout:1/266: dwrite db/df/d14/d33/d34/f36 [4194304,4194304] 0 2024-04-25T02:08:47.584 INFO:tasks.workunit.client.0.smithi077.stdout:4/277: write d0/d14/d21/d39/da/d12/f3d [2514453,20593] 0 2024-04-25T02:08:47.588 INFO:tasks.workunit.client.0.smithi077.stdout:6/305: creat de/d12/d25/f66 x:0 0 0 2024-04-25T02:08:47.589 INFO:tasks.workunit.client.0.smithi077.stdout:0/280: getdents d2/d9/d2a 0 2024-04-25T02:08:47.594 INFO:tasks.workunit.client.0.smithi077.stdout:5/312: dwrite d0/d25/f36 [0,4194304] 0 2024-04-25T02:08:47.594 INFO:tasks.workunit.client.0.smithi077.stdout:9/295: mkdir df/d1b/d70 0 2024-04-25T02:08:47.594 INFO:tasks.workunit.client.0.smithi077.stdout:9/296: creat df/f71 x:0 0 0 2024-04-25T02:08:47.595 INFO:tasks.workunit.client.0.smithi077.stdout:8/324: getdents d3/da/db/df/d30 0 2024-04-25T02:08:47.595 INFO:tasks.workunit.client.0.smithi077.stdout:8/325: readlink d3/da/d27/d16/l23 0 2024-04-25T02:08:47.596 INFO:tasks.workunit.client.0.smithi077.stdout:7/215: link d4/d13/d18/c32 d4/d13/d2c/c4d 0 2024-04-25T02:08:47.597 INFO:tasks.workunit.client.0.smithi077.stdout:7/216: creat d4/d13/f4e x:0 0 0 2024-04-25T02:08:47.599 INFO:tasks.workunit.client.1.smithi112.stdout:6/99: dwrite d0/d2/d4/f13 [0,4194304] 0 2024-04-25T02:08:47.600 INFO:tasks.workunit.client.0.smithi077.stdout:2/265: dwrite d2/d9/d19/d1c/d3f/f40 [0,4194304] 0 2024-04-25T02:08:47.608 INFO:tasks.workunit.client.0.smithi077.stdout:3/265: mknod d0/d2/de/d48/d15/c58 0 2024-04-25T02:08:47.608 INFO:tasks.workunit.client.0.smithi077.stdout:3/266: read d0/d2/f34 [653240,106905] 0 2024-04-25T02:08:47.609 INFO:tasks.workunit.client.0.smithi077.stdout:2/266: dread d2/d9/d19/f1a [0,4194304] 0 2024-04-25T02:08:47.613 INFO:tasks.workunit.client.0.smithi077.stdout:1/267: unlink db/df/c10 0 2024-04-25T02:08:47.615 INFO:tasks.workunit.client.0.smithi077.stdout:0/281: dwrite d2/d8/d10/f45 [0,4194304] 0 2024-04-25T02:08:47.615 INFO:tasks.workunit.client.0.smithi077.stdout:3/267: dread d0/d2/f35 [0,4194304] 0 2024-04-25T02:08:47.616 INFO:tasks.workunit.client.0.smithi077.stdout:4/278: rename d0/d14/f46 to d0/d14/d21/d39/da/f5b 0 2024-04-25T02:08:47.616 INFO:tasks.workunit.client.0.smithi077.stdout:4/279: creat d0/de/d3c/f5c x:0 0 0 2024-04-25T02:08:47.618 INFO:tasks.workunit.client.0.smithi077.stdout:6/306: stat de/d12/c2f 0 2024-04-25T02:08:47.622 INFO:tasks.workunit.client.0.smithi077.stdout:9/297: symlink df/d60/l72 0 2024-04-25T02:08:47.622 INFO:tasks.workunit.client.0.smithi077.stdout:9/298: readlink df/l3a 0 2024-04-25T02:08:47.626 INFO:tasks.workunit.client.0.smithi077.stdout:2/267: mkdir d2/d9/d19/d1c/d3f/d53 0 2024-04-25T02:08:47.628 INFO:tasks.workunit.client.0.smithi077.stdout:0/282: link d2/d17/d1d/c30 d2/d8/d10/d51/c60 0 2024-04-25T02:08:47.629 INFO:tasks.workunit.client.0.smithi077.stdout:0/283: write d2/d27/f3b [239580,63339] 0 2024-04-25T02:08:47.631 INFO:tasks.workunit.client.0.smithi077.stdout:4/280: fdatasync d0/d14/d21/d39/da/d12/d35/d3e/f38 0 2024-04-25T02:08:47.632 INFO:tasks.workunit.client.0.smithi077.stdout:6/307: creat de/d12/d25/d38/f67 x:0 0 0 2024-04-25T02:08:47.633 INFO:tasks.workunit.client.0.smithi077.stdout:9/299: mknod df/d1b/d70/c73 0 2024-04-25T02:08:47.633 INFO:tasks.workunit.client.0.smithi077.stdout:2/268: stat f1 0 2024-04-25T02:08:47.633 INFO:tasks.workunit.client.0.smithi077.stdout:9/300: truncate df/d1b/d56/f59 725537 0 2024-04-25T02:08:47.634 INFO:tasks.workunit.client.0.smithi077.stdout:0/284: rename d2/d27/f2b to d2/d17/f61 0 2024-04-25T02:08:47.635 INFO:tasks.workunit.client.0.smithi077.stdout:9/301: mkdir df/d1b/d70/d74 0 2024-04-25T02:08:47.635 INFO:tasks.workunit.client.0.smithi077.stdout:9/302: chown df/d1b/d48/f54 9941849 1 2024-04-25T02:08:47.635 INFO:tasks.workunit.client.0.smithi077.stdout:9/303: write df/f13 [309348,103409] 0 2024-04-25T02:08:47.635 INFO:tasks.workunit.client.0.smithi077.stdout:0/285: write d2/d8/fe [1471358,61517] 0 2024-04-25T02:08:47.636 INFO:tasks.workunit.client.0.smithi077.stdout:9/304: rmdir df/d1b/d56/d67 39 2024-04-25T02:08:47.636 INFO:tasks.workunit.client.0.smithi077.stdout:9/305: read - df/f39 zero size 2024-04-25T02:08:47.641 INFO:tasks.workunit.client.0.smithi077.stdout:0/286: rename d2/d17/d1d/c56 to d2/d17/d4e/d5e/c62 0 2024-04-25T02:08:47.644 INFO:tasks.workunit.client.0.smithi077.stdout:6/308: dread f9 [0,4194304] 0 2024-04-25T02:08:47.644 INFO:tasks.workunit.client.0.smithi077.stdout:0/287: dread d2/d1c/f24 [0,4194304] 0 2024-04-25T02:08:47.644 INFO:tasks.workunit.client.0.smithi077.stdout:0/288: write d2/d17/d1d/f3d [78763,54504] 0 2024-04-25T02:08:47.646 INFO:tasks.workunit.client.0.smithi077.stdout:6/309: dread de/d12/d25/f2d [0,4194304] 0 2024-04-25T02:08:47.646 INFO:tasks.workunit.client.0.smithi077.stdout:0/289: truncate d2/d8/d10/f18 591536 0 2024-04-25T02:08:47.648 INFO:tasks.workunit.client.0.smithi077.stdout:6/310: creat de/d12/d25/d60/d63/f68 x:0 0 0 2024-04-25T02:08:47.648 INFO:tasks.workunit.client.0.smithi077.stdout:6/311: creat de/d53/f69 x:0 0 0 2024-04-25T02:08:47.652 INFO:tasks.workunit.client.0.smithi077.stdout:6/312: rmdir de/d12/d25/d4b 39 2024-04-25T02:08:47.662 INFO:tasks.workunit.client.1.smithi112.stdout:6/100: dwrite d0/f17 [0,4194304] 0 2024-04-25T02:08:47.663 INFO:tasks.workunit.client.0.smithi077.stdout:5/313: dwrite d0/d2/d1b/d35/f4f [0,4194304] 0 2024-04-25T02:08:47.663 INFO:tasks.workunit.client.0.smithi077.stdout:7/217: dwrite d4/d13/d18/d2d/f46 [0,4194304] 0 2024-04-25T02:08:47.663 INFO:tasks.workunit.client.0.smithi077.stdout:1/268: dwrite db/df/d14/d33/f38 [0,4194304] 0 2024-04-25T02:08:47.664 INFO:tasks.workunit.client.0.smithi077.stdout:3/268: dwrite d0/d2/de/d48/f3b [0,4194304] 0 2024-04-25T02:08:47.664 INFO:tasks.workunit.client.0.smithi077.stdout:2/269: dwrite d2/d9/f52 [0,4194304] 0 2024-04-25T02:08:47.664 INFO:tasks.workunit.client.0.smithi077.stdout:8/326: dwrite d3/da/f29 [0,4194304] 0 2024-04-25T02:08:47.665 INFO:tasks.workunit.client.0.smithi077.stdout:4/281: dwrite d0/de/d3c/f5c [0,4194304] 0 2024-04-25T02:08:47.665 INFO:tasks.workunit.client.0.smithi077.stdout:6/313: dread f1 [0,4194304] 0 2024-04-25T02:08:47.668 INFO:tasks.workunit.client.0.smithi077.stdout:1/269: dread f8 [0,4194304] 0 2024-04-25T02:08:47.668 INFO:tasks.workunit.client.0.smithi077.stdout:1/270: fsync f8 0 2024-04-25T02:08:47.668 INFO:tasks.workunit.client.0.smithi077.stdout:1/271: chown db/df/d14/d33/l37 18137 1 2024-04-25T02:08:47.668 INFO:tasks.workunit.client.0.smithi077.stdout:1/272: chown f8 8222 1 2024-04-25T02:08:47.668 INFO:tasks.workunit.client.0.smithi077.stdout:1/273: chown db/df/d1b 0 1 2024-04-25T02:08:47.669 INFO:tasks.workunit.client.1.smithi112.stdout:6/101: symlink d0/d2/d4/l23 0 2024-04-25T02:08:47.669 INFO:tasks.workunit.client.1.smithi112.stdout:6/102: dread - d0/d2/d4/fb zero size 2024-04-25T02:08:47.671 INFO:tasks.workunit.client.0.smithi077.stdout:5/314: creat d0/d2/d5/d5a/f6b x:0 0 0 2024-04-25T02:08:47.675 INFO:tasks.workunit.client.0.smithi077.stdout:5/315: dread d0/d2/d20/f3f [0,4194304] 0 2024-04-25T02:08:47.678 INFO:tasks.workunit.client.0.smithi077.stdout:7/218: unlink d4/d13/d18/d2d/d30/l35 0 2024-04-25T02:08:47.690 INFO:tasks.workunit.client.0.smithi077.stdout:3/269: mkdir d0/d17/d4b/d59 0 2024-04-25T02:08:47.690 INFO:tasks.workunit.client.0.smithi077.stdout:3/270: fdatasync d0/f9 0 2024-04-25T02:08:47.690 INFO:tasks.workunit.client.0.smithi077.stdout:5/316: read d0/d2/d3/d9/d39/d44/f45 [336823,128853] 0 2024-04-25T02:08:47.690 INFO:tasks.workunit.client.0.smithi077.stdout:0/290: read d2/d8/f26 [525229,32465] 0 2024-04-25T02:08:47.691 INFO:tasks.workunit.client.0.smithi077.stdout:8/327: dwrite d3/da/db/df/f5d [0,4194304] 0 2024-04-25T02:08:47.697 INFO:tasks.workunit.client.1.smithi112.stdout:6/103: dwrite d0/d2/d4/f5 [0,4194304] 0 2024-04-25T02:08:47.701 INFO:tasks.workunit.client.0.smithi077.stdout:4/282: symlink d0/de/d25/l5d 0 2024-04-25T02:08:47.701 INFO:tasks.workunit.client.0.smithi077.stdout:4/283: creat d0/de/d3c/f5e x:0 0 0 2024-04-25T02:08:47.701 INFO:tasks.workunit.client.0.smithi077.stdout:4/284: stat d0/d14/d21/d39/da/ld 0 2024-04-25T02:08:47.702 INFO:tasks.workunit.client.0.smithi077.stdout:6/314: mkdir de/d12/d25/d3a/d6a 0 2024-04-25T02:08:47.711 INFO:tasks.workunit.client.0.smithi077.stdout:1/274: symlink db/d11/d32/l52 0 2024-04-25T02:08:47.714 INFO:tasks.workunit.client.0.smithi077.stdout:7/219: mknod d4/d13/d18/d2d/d30/c4f 0 2024-04-25T02:08:47.714 INFO:tasks.workunit.client.0.smithi077.stdout:7/220: chown d4/f12 146 1 2024-04-25T02:08:47.716 INFO:tasks.workunit.client.0.smithi077.stdout:3/271: link d0/d2/l54 d0/d40/l5a 0 2024-04-25T02:08:47.718 INFO:tasks.workunit.client.0.smithi077.stdout:2/270: rename d2/d9/df/l12 to d2/d9/l54 0 2024-04-25T02:08:47.719 INFO:tasks.workunit.client.0.smithi077.stdout:5/317: symlink d0/d2/d1b/d35/l6c 0 2024-04-25T02:08:47.722 INFO:tasks.workunit.client.1.smithi112.stdout:6/104: dwrite d0/f1a [0,4194304] 0 2024-04-25T02:08:47.722 INFO:tasks.workunit.client.1.smithi112.stdout:6/105: dread - d0/d2/d4/f11 zero size 2024-04-25T02:08:47.722 INFO:tasks.workunit.client.1.smithi112.stdout:6/106: readlink d0/d2/d4/l12 0 2024-04-25T02:08:47.722 INFO:tasks.workunit.client.1.smithi112.stdout:6/107: fsync d0/f7 0 2024-04-25T02:08:47.722 INFO:tasks.workunit.client.1.smithi112.stdout:6/108: write d0/d2/d4/fb [766006,27720] 0 2024-04-25T02:08:47.724 INFO:tasks.workunit.client.0.smithi077.stdout:4/285: unlink d0/de/c2e 0 2024-04-25T02:08:47.726 INFO:tasks.workunit.client.0.smithi077.stdout:6/315: symlink de/d55/l6b 0 2024-04-25T02:08:47.726 INFO:tasks.workunit.client.0.smithi077.stdout:6/316: creat de/d12/d25/d60/d63/f6c x:0 0 0 2024-04-25T02:08:47.726 INFO:tasks.workunit.client.0.smithi077.stdout:6/317: fdatasync de/f5a 0 2024-04-25T02:08:47.726 INFO:tasks.workunit.client.0.smithi077.stdout:6/318: truncate de/d15/f50 432827 0 2024-04-25T02:08:47.728 INFO:tasks.workunit.client.1.smithi112.stdout:6/109: creat d0/d2/d4/dd/f24 x:0 0 0 2024-04-25T02:08:47.730 INFO:tasks.workunit.client.0.smithi077.stdout:0/291: rename d2/l3c to d2/d17/d1d/l63 0 2024-04-25T02:08:47.731 INFO:tasks.workunit.client.0.smithi077.stdout:2/271: truncate d2/fd 1375246 0 2024-04-25T02:08:47.732 INFO:tasks.workunit.client.0.smithi077.stdout:5/318: symlink d0/d2/d68/l6d 0 2024-04-25T02:08:47.732 INFO:tasks.workunit.client.0.smithi077.stdout:5/319: read - d0/d2/d52/f6a zero size 2024-04-25T02:08:47.736 INFO:tasks.workunit.client.0.smithi077.stdout:4/286: creat d0/f5f x:0 0 0 2024-04-25T02:08:47.739 INFO:tasks.workunit.client.1.smithi112.stdout:6/110: dread d0/d2/d4/fb [0,4194304] 0 2024-04-25T02:08:47.741 INFO:tasks.workunit.client.0.smithi077.stdout:4/287: dread d0/f28 [0,4194304] 0 2024-04-25T02:08:47.741 INFO:tasks.workunit.client.0.smithi077.stdout:8/328: rename d3/da/l52 to d3/da/d27/d16/d57/l63 0 2024-04-25T02:08:47.741 INFO:tasks.workunit.client.0.smithi077.stdout:2/272: link d2/d9/d2f/l4e d2/d9/d18/d1b/l55 0 2024-04-25T02:08:47.741 INFO:tasks.workunit.client.0.smithi077.stdout:2/273: write d2/f5 [1594852,77073] 0 2024-04-25T02:08:47.746 INFO:tasks.workunit.client.0.smithi077.stdout:5/320: mknod d0/d2/d20/d41/c6e 0 2024-04-25T02:08:47.747 INFO:tasks.workunit.client.0.smithi077.stdout:5/321: readlink d0/d2/d3/d9/l61 0 2024-04-25T02:08:47.747 INFO:tasks.workunit.client.0.smithi077.stdout:4/288: dread d0/d14/d21/d39/da/f2d [0,4194304] 0 2024-04-25T02:08:47.748 INFO:tasks.workunit.client.0.smithi077.stdout:7/221: rename d4/d13/d18/d28/f4c to d4/f50 0 2024-04-25T02:08:47.748 INFO:tasks.workunit.client.0.smithi077.stdout:7/222: creat d4/f51 x:0 0 0 2024-04-25T02:08:47.748 INFO:tasks.workunit.client.0.smithi077.stdout:7/223: fdatasync d4/d13/d18/d28/f2b 0 2024-04-25T02:08:47.748 INFO:tasks.workunit.client.0.smithi077.stdout:7/224: truncate d4/d13/d18/f40 574046 0 2024-04-25T02:08:47.748 INFO:tasks.workunit.client.0.smithi077.stdout:7/225: creat d4/d13/d18/d28/f52 x:0 0 0 2024-04-25T02:08:47.752 INFO:tasks.workunit.client.0.smithi077.stdout:9/306: sync 2024-04-25T02:08:47.752 INFO:tasks.workunit.client.0.smithi077.stdout:9/307: chown df/f31 2922713 1 2024-04-25T02:08:47.755 INFO:tasks.workunit.client.0.smithi077.stdout:2/274: dread d2/d9/d18/fa [0,4194304] 0 2024-04-25T02:08:47.755 INFO:tasks.workunit.client.0.smithi077.stdout:6/319: dwrite de/d15/f50 [0,4194304] 0 2024-04-25T02:08:47.755 INFO:tasks.workunit.client.0.smithi077.stdout:6/320: dread - de/d12/d25/d60/d63/f68 zero size 2024-04-25T02:08:47.758 INFO:tasks.workunit.client.0.smithi077.stdout:1/275: rename db/df/d1b/c28 to db/c53 0 2024-04-25T02:08:47.758 INFO:tasks.workunit.client.0.smithi077.stdout:1/276: write db/df/f20 [161945,111271] 0 2024-04-25T02:08:47.758 INFO:tasks.workunit.client.0.smithi077.stdout:1/277: readlink db/df/d14/d33/l37 0 2024-04-25T02:08:47.759 INFO:tasks.workunit.client.0.smithi077.stdout:4/289: dread d0/de/f53 [0,4194304] 0 2024-04-25T02:08:47.767 INFO:tasks.workunit.client.0.smithi077.stdout:2/275: mkdir d2/d9/d56 0 2024-04-25T02:08:47.767 INFO:tasks.workunit.client.0.smithi077.stdout:2/276: chown d2/d9/d19/d1c/d3f/d53 75 1 2024-04-25T02:08:47.768 INFO:tasks.workunit.client.1.smithi112.stdout:6/111: write d0/d2/f10 [4116074,78853] 0 2024-04-25T02:08:47.772 INFO:tasks.workunit.client.0.smithi077.stdout:6/321: link l6 de/d12/d25/d3a/d6a/l6d 0 2024-04-25T02:08:47.773 INFO:tasks.workunit.client.0.smithi077.stdout:2/277: mknod d2/d9/d18/c57 0 2024-04-25T02:08:47.775 INFO:tasks.workunit.client.1.smithi112.stdout:6/112: symlink d0/l25 0 2024-04-25T02:08:47.775 INFO:tasks.workunit.client.1.smithi112.stdout:6/113: creat d0/d2/d4/dd/f26 x:0 0 0 2024-04-25T02:08:47.775 INFO:tasks.workunit.client.1.smithi112.stdout:6/114: creat d0/f27 x:0 0 0 2024-04-25T02:08:47.775 INFO:tasks.workunit.client.0.smithi077.stdout:4/290: getdents d0/de/d3c 0 2024-04-25T02:08:47.775 INFO:tasks.workunit.client.0.smithi077.stdout:4/291: truncate d0/de/d25/f31 1264031 0 2024-04-25T02:08:47.775 INFO:tasks.workunit.client.0.smithi077.stdout:4/292: truncate d0/d14/d21/d39/da/d12/d35/f52 891076 0 2024-04-25T02:08:47.778 INFO:tasks.workunit.client.0.smithi077.stdout:6/322: truncate de/d12/d25/f31 792120 0 2024-04-25T02:08:47.780 INFO:tasks.workunit.client.0.smithi077.stdout:2/278: truncate f1 422344 0 2024-04-25T02:08:47.780 INFO:tasks.workunit.client.0.smithi077.stdout:2/279: dread - d2/d9/df/f50 zero size 2024-04-25T02:08:47.780 INFO:tasks.workunit.client.0.smithi077.stdout:3/272: dwrite d0/d2/d2f/f32 [0,4194304] 0 2024-04-25T02:08:47.781 INFO:tasks.workunit.client.1.smithi112.stdout:6/115: mkdir d0/d2/d4/d28 0 2024-04-25T02:08:47.781 INFO:tasks.workunit.client.1.smithi112.stdout:6/116: write d0/f27 [581004,48310] 0 2024-04-25T02:08:47.782 INFO:tasks.workunit.client.0.smithi077.stdout:4/293: mkdir d0/d14/d60 0 2024-04-25T02:08:47.782 INFO:tasks.workunit.client.0.smithi077.stdout:4/294: write d0/d14/d21/f2a [1034792,55044] 0 2024-04-25T02:08:47.783 INFO:tasks.workunit.client.1.smithi112.stdout:6/117: symlink d0/d2/l29 0 2024-04-25T02:08:47.783 INFO:tasks.workunit.client.1.smithi112.stdout:6/118: dread - d0/d2/d4/f19 zero size 2024-04-25T02:08:47.783 INFO:tasks.workunit.client.0.smithi077.stdout:6/323: symlink de/d12/d25/d60/l6e 0 2024-04-25T02:08:47.784 INFO:tasks.workunit.client.1.smithi112.stdout:6/119: mknod d0/d2/d4/c2a 0 2024-04-25T02:08:47.786 INFO:tasks.workunit.client.0.smithi077.stdout:3/273: rename d0/d17/d4b/c4e to d0/d40/c5b 0 2024-04-25T02:08:47.786 INFO:tasks.workunit.client.0.smithi077.stdout:3/274: truncate d0/d2/de/d48/d15/f38 1100079 0 2024-04-25T02:08:47.787 INFO:tasks.workunit.client.0.smithi077.stdout:4/295: creat d0/d14/d21/d39/f61 x:0 0 0 2024-04-25T02:08:47.787 INFO:tasks.workunit.client.1.smithi112.stdout:6/120: truncate d0/d2/f15 218622 0 2024-04-25T02:08:47.788 INFO:tasks.workunit.client.0.smithi077.stdout:6/324: mkdir de/d53/d6f 0 2024-04-25T02:08:47.789 INFO:tasks.workunit.client.0.smithi077.stdout:3/275: mkdir d0/d2/d2f/d50/d5c 0 2024-04-25T02:08:47.789 INFO:tasks.workunit.client.0.smithi077.stdout:3/276: chown d0/d2/de/c52 0 1 2024-04-25T02:08:47.789 INFO:tasks.workunit.client.1.smithi112.stdout:6/121: truncate d0/f17 818302 0 2024-04-25T02:08:47.790 INFO:tasks.workunit.client.0.smithi077.stdout:8/329: dwrite d3/d34/f48 [0,4194304] 0 2024-04-25T02:08:47.790 INFO:tasks.workunit.client.0.smithi077.stdout:8/330: stat d3/d34/d3d/f5f 0 2024-04-25T02:08:47.790 INFO:tasks.workunit.client.0.smithi077.stdout:8/331: fdatasync d3/d34/d3d/f5f 0 2024-04-25T02:08:47.792 INFO:tasks.workunit.client.0.smithi077.stdout:0/292: dwrite d2/d17/f61 [0,4194304] 0 2024-04-25T02:08:47.792 INFO:tasks.workunit.client.0.smithi077.stdout:3/277: creat d0/d17/f5d x:0 0 0 2024-04-25T02:08:47.793 INFO:tasks.workunit.client.0.smithi077.stdout:3/278: truncate d0/f1f 838183 0 2024-04-25T02:08:47.793 INFO:tasks.workunit.client.0.smithi077.stdout:9/308: dwrite df/f3c [0,4194304] 0 2024-04-25T02:08:47.793 INFO:tasks.workunit.client.0.smithi077.stdout:7/226: dwrite d4/d13/d18/d28/f2b [0,4194304] 0 2024-04-25T02:08:47.793 INFO:tasks.workunit.client.0.smithi077.stdout:7/227: write d4/d13/f38 [108790,37664] 0 2024-04-25T02:08:47.793 INFO:tasks.workunit.client.0.smithi077.stdout:1/278: fdatasync db/df/f20 0 2024-04-25T02:08:47.794 INFO:tasks.workunit.client.1.smithi112.stdout:6/122: link d0/d2/d4/f5 d0/f2b 0 2024-04-25T02:08:47.794 INFO:tasks.workunit.client.1.smithi112.stdout:6/123: stat d0/d2/d4/fb 0 2024-04-25T02:08:47.794 INFO:tasks.workunit.client.1.smithi112.stdout:6/124: readlink d0/d2/d4/dd/l18 0 2024-04-25T02:08:47.794 INFO:tasks.workunit.client.0.smithi077.stdout:7/228: dread d4/d13/d18/f40 [0,4194304] 0 2024-04-25T02:08:47.794 INFO:tasks.workunit.client.0.smithi077.stdout:7/229: fsync d4/d13/d18/d2d/d30/f42 0 2024-04-25T02:08:47.795 INFO:tasks.workunit.client.0.smithi077.stdout:8/332: rmdir d3/da/d27 39 2024-04-25T02:08:47.796 INFO:tasks.workunit.client.0.smithi077.stdout:9/309: mkdir df/d1b/d48/d75 0 2024-04-25T02:08:47.796 INFO:tasks.workunit.client.0.smithi077.stdout:9/310: dread - df/f58 zero size 2024-04-25T02:08:47.797 INFO:tasks.workunit.client.1.smithi112.stdout:6/125: mkdir d0/d2/d2c 0 2024-04-25T02:08:47.797 INFO:tasks.workunit.client.1.smithi112.stdout:6/126: chown d0/d2/d4/l23 665562564 1 2024-04-25T02:08:47.799 INFO:tasks.workunit.client.0.smithi077.stdout:8/333: dread d3/da/db/df/f10 [0,4194304] 0 2024-04-25T02:08:47.803 INFO:tasks.workunit.client.0.smithi077.stdout:5/322: dwrite d0/d2/d1b/d38/f5e [0,4194304] 0 2024-04-25T02:08:47.804 INFO:tasks.workunit.client.0.smithi077.stdout:0/293: write d2/d27/d2d/f2f [3618667,80768] 0 2024-04-25T02:08:47.804 INFO:tasks.workunit.client.0.smithi077.stdout:0/294: stat d2/d17/d1d/d34/c57 0 2024-04-25T02:08:47.804 INFO:tasks.workunit.client.0.smithi077.stdout:0/295: stat d2/d27/d2d/l37 0 2024-04-25T02:08:47.804 INFO:tasks.workunit.client.1.smithi112.stdout:6/127: rename d0/d2/d4/l1c to d0/d2/d2c/l2d 0 2024-04-25T02:08:47.804 INFO:tasks.workunit.client.1.smithi112.stdout:6/128: getdents d0/d2/d1f 0 2024-04-25T02:08:47.805 INFO:tasks.workunit.client.0.smithi077.stdout:1/279: rmdir db/df/d1b 39 2024-04-25T02:08:47.805 INFO:tasks.workunit.client.0.smithi077.stdout:0/296: dread d2/d8/d10/f18 [0,4194304] 0 2024-04-25T02:08:47.813 INFO:tasks.workunit.client.0.smithi077.stdout:9/311: link l0 df/l76 0 2024-04-25T02:08:47.814 INFO:tasks.workunit.client.0.smithi077.stdout:8/334: mknod d3/da/c64 0 2024-04-25T02:08:47.819 INFO:tasks.workunit.client.0.smithi077.stdout:4/296: dwrite d0/de/d3c/f5e [0,4194304] 0 2024-04-25T02:08:47.822 INFO:tasks.workunit.client.0.smithi077.stdout:5/323: link d0/d2/d5/l66 d0/d2/d1b/d3b/l6f 0 2024-04-25T02:08:47.824 INFO:tasks.workunit.client.0.smithi077.stdout:1/280: truncate db/df/f1d 5049248 0 2024-04-25T02:08:47.826 INFO:tasks.workunit.client.0.smithi077.stdout:0/297: mknod d2/d17/d1d/d34/d4c/c64 0 2024-04-25T02:08:47.826 INFO:tasks.workunit.client.0.smithi077.stdout:0/298: read d2/f4b [93591,26101] 0 2024-04-25T02:08:47.826 INFO:tasks.workunit.client.0.smithi077.stdout:0/299: write d2/d27/f3b [1170077,96773] 0 2024-04-25T02:08:47.826 INFO:tasks.workunit.client.0.smithi077.stdout:9/312: dread df/d1b/f5d [0,4194304] 0 2024-04-25T02:08:47.826 INFO:tasks.workunit.client.0.smithi077.stdout:9/313: stat f3 0 2024-04-25T02:08:47.831 INFO:tasks.workunit.client.0.smithi077.stdout:3/279: dwrite d0/f9 [0,4194304] 0 2024-04-25T02:08:47.833 INFO:tasks.workunit.client.1.smithi112.stdout:6/129: dwrite d0/d2/d4/fb [0,4194304] 0 2024-04-25T02:08:47.834 INFO:tasks.workunit.client.0.smithi077.stdout:8/335: dwrite d3/d34/f48 [0,4194304] 0 2024-04-25T02:08:47.834 INFO:tasks.workunit.client.0.smithi077.stdout:8/336: truncate d3/da/d27/d16/f1c 4613754 0 2024-04-25T02:08:47.834 INFO:tasks.workunit.client.0.smithi077.stdout:7/230: getdents d4 0 2024-04-25T02:08:47.840 INFO:tasks.workunit.client.1.smithi112.stdout:6/130: creat d0/d2/d2c/f2e x:0 0 0 2024-04-25T02:08:47.842 INFO:tasks.workunit.client.0.smithi077.stdout:4/297: mkdir d0/d14/d60/d62 0 2024-04-25T02:08:47.844 INFO:tasks.workunit.client.0.smithi077.stdout:1/281: creat db/df/d14/d3e/f54 x:0 0 0 2024-04-25T02:08:47.845 INFO:tasks.workunit.client.0.smithi077.stdout:0/300: truncate d2/d8/d10/f45 3035091 0 2024-04-25T02:08:47.845 INFO:tasks.workunit.client.0.smithi077.stdout:8/337: write d3/fd [3174170,108986] 0 2024-04-25T02:08:47.847 INFO:tasks.workunit.client.0.smithi077.stdout:9/314: mkdir df/d1b/d48/d75/d77 0 2024-04-25T02:08:47.849 INFO:tasks.workunit.client.0.smithi077.stdout:3/280: creat d0/d3e/d42/f5e x:0 0 0 2024-04-25T02:08:47.857 INFO:tasks.workunit.client.0.smithi077.stdout:7/231: creat d4/d13/d18/d24/f53 x:0 0 0 2024-04-25T02:08:47.857 INFO:tasks.workunit.client.0.smithi077.stdout:7/232: creat d4/d13/f54 x:0 0 0 2024-04-25T02:08:47.860 INFO:tasks.workunit.client.0.smithi077.stdout:1/282: creat db/df/d14/d33/d34/f55 x:0 0 0 2024-04-25T02:08:47.862 INFO:tasks.workunit.client.0.smithi077.stdout:0/301: creat d2/d9/f65 x:0 0 0 2024-04-25T02:08:47.862 INFO:tasks.workunit.client.0.smithi077.stdout:0/302: creat d2/d9/f66 x:0 0 0 2024-04-25T02:08:47.862 INFO:tasks.workunit.client.0.smithi077.stdout:0/303: creat d2/d8/d10/f67 x:0 0 0 2024-04-25T02:08:47.863 INFO:tasks.workunit.client.0.smithi077.stdout:8/338: mknod d3/da/db/df/c65 0 2024-04-25T02:08:47.864 INFO:tasks.workunit.client.0.smithi077.stdout:9/315: creat df/d1b/d56/d67/f78 x:0 0 0 2024-04-25T02:08:47.868 INFO:tasks.workunit.client.0.smithi077.stdout:7/233: creat d4/d13/d18/d2d/d30/f55 x:0 0 0 2024-04-25T02:08:47.869 INFO:tasks.workunit.client.0.smithi077.stdout:7/234: fsync d4/d13/f38 0 2024-04-25T02:08:47.869 INFO:tasks.workunit.client.0.smithi077.stdout:7/235: write d4/d13/f2f [2210640,29833] 0 2024-04-25T02:08:47.869 INFO:tasks.workunit.client.0.smithi077.stdout:1/283: chown db/d26/f2f 6512858 1 2024-04-25T02:08:47.869 INFO:tasks.workunit.client.0.smithi077.stdout:1/284: chown db/d26/c45 0 1 2024-04-25T02:08:47.872 INFO:tasks.workunit.client.0.smithi077.stdout:4/298: dwrite d0/d14/d21/d39/f10 [0,4194304] 0 2024-04-25T02:08:47.873 INFO:tasks.workunit.client.1.smithi112.stdout:6/131: dwrite d0/f1a [0,4194304] 0 2024-04-25T02:08:47.873 INFO:tasks.workunit.client.1.smithi112.stdout:6/132: dread - d0/d2/d4/dd/f24 zero size 2024-04-25T02:08:47.873 INFO:tasks.workunit.client.0.smithi077.stdout:0/304: mknod d2/d27/d2d/c68 0 2024-04-25T02:08:47.873 INFO:tasks.workunit.client.0.smithi077.stdout:0/305: creat d2/d17/f69 x:0 0 0 2024-04-25T02:08:47.874 INFO:tasks.workunit.client.0.smithi077.stdout:0/306: dread d2/f4b [0,4194304] 0 2024-04-25T02:08:47.874 INFO:tasks.workunit.client.0.smithi077.stdout:0/307: write d2/f4b [386700,36005] 0 2024-04-25T02:08:47.875 INFO:tasks.workunit.client.0.smithi077.stdout:8/339: creat d3/da/d27/d16/f66 x:0 0 0 2024-04-25T02:08:47.876 INFO:tasks.workunit.client.1.smithi112.stdout:6/133: mknod d0/c2f 0 2024-04-25T02:08:47.880 INFO:tasks.workunit.client.0.smithi077.stdout:3/281: mkdir d0/d2/d2f/d5f 0 2024-04-25T02:08:47.880 INFO:tasks.workunit.client.0.smithi077.stdout:3/282: creat d0/d3e/d42/f60 x:0 0 0 2024-04-25T02:08:47.881 INFO:tasks.workunit.client.0.smithi077.stdout:7/236: mkdir d4/d13/d18/d2d/d56 0 2024-04-25T02:08:47.884 INFO:tasks.workunit.client.0.smithi077.stdout:1/285: mkdir db/df/d56 0 2024-04-25T02:08:47.884 INFO:tasks.workunit.client.0.smithi077.stdout:1/286: truncate db/d26/f3c 529419 0 2024-04-25T02:08:47.887 INFO:tasks.workunit.client.0.smithi077.stdout:7/237: read d4/fe [149062,101300] 0 2024-04-25T02:08:47.888 INFO:tasks.workunit.client.0.smithi077.stdout:7/238: chown d4/d13/d2c 519578 1 2024-04-25T02:08:47.888 INFO:tasks.workunit.client.0.smithi077.stdout:7/239: fsync d4/d13/f48 0 2024-04-25T02:08:47.888 INFO:tasks.workunit.client.0.smithi077.stdout:7/240: creat d4/d13/d18/d24/f57 x:0 0 0 2024-04-25T02:08:47.888 INFO:tasks.workunit.client.0.smithi077.stdout:7/241: readlink d4/d13/d18/d2d/d30/l49 0 2024-04-25T02:08:47.892 INFO:tasks.workunit.client.0.smithi077.stdout:0/308: creat d2/d8/d10/d51/f6a x:0 0 0 2024-04-25T02:08:47.892 INFO:tasks.workunit.client.0.smithi077.stdout:0/309: write d2/d8/f26 [287988,1464] 0 2024-04-25T02:08:47.893 INFO:tasks.workunit.client.0.smithi077.stdout:8/340: unlink d3/da/cc 0 2024-04-25T02:08:47.897 INFO:tasks.workunit.client.0.smithi077.stdout:6/325: sync 2024-04-25T02:08:47.897 INFO:tasks.workunit.client.0.smithi077.stdout:2/280: sync 2024-04-25T02:08:47.897 INFO:tasks.workunit.client.0.smithi077.stdout:6/326: chown de/d12/d25/d3a/l54 253300110 1 2024-04-25T02:08:47.899 INFO:tasks.workunit.client.0.smithi077.stdout:4/299: getdents d0/d14/d21/d39/da/d12/d35 0 2024-04-25T02:08:47.900 INFO:tasks.workunit.client.0.smithi077.stdout:8/341: write d3/da/db/f28 [1589861,6759] 0 2024-04-25T02:08:47.900 INFO:tasks.workunit.client.0.smithi077.stdout:3/283: rmdir d0/d2/de/d48/d15 39 2024-04-25T02:08:47.900 INFO:tasks.workunit.client.0.smithi077.stdout:2/281: dread d2/fd [0,4194304] 0 2024-04-25T02:08:47.901 INFO:tasks.workunit.client.0.smithi077.stdout:1/287: symlink db/df/d14/l57 0 2024-04-25T02:08:47.902 INFO:tasks.workunit.client.0.smithi077.stdout:6/327: symlink de/d12/d25/d38/l70 0 2024-04-25T02:08:47.902 INFO:tasks.workunit.client.0.smithi077.stdout:6/328: fdatasync de/d12/d25/f52 0 2024-04-25T02:08:47.902 INFO:tasks.workunit.client.0.smithi077.stdout:6/329: write de/d12/f17 [1052503,99009] 0 2024-04-25T02:08:47.903 INFO:tasks.workunit.client.0.smithi077.stdout:6/330: creat de/d12/f71 x:0 0 0 2024-04-25T02:08:47.903 INFO:tasks.workunit.client.0.smithi077.stdout:2/282: dread d2/fd [0,4194304] 0 2024-04-25T02:08:47.903 INFO:tasks.workunit.client.0.smithi077.stdout:9/316: rmdir df/d1b/d56/d67 39 2024-04-25T02:08:47.905 INFO:tasks.workunit.client.0.smithi077.stdout:4/300: creat d0/d14/d21/d39/da/f63 x:0 0 0 2024-04-25T02:08:47.908 INFO:tasks.workunit.client.0.smithi077.stdout:8/342: unlink d3/da/c59 0 2024-04-25T02:08:47.911 INFO:tasks.workunit.client.0.smithi077.stdout:1/288: creat db/df/d56/f58 x:0 0 0 2024-04-25T02:08:47.915 INFO:tasks.workunit.client.0.smithi077.stdout:6/331: mknod de/d4e/c72 0 2024-04-25T02:08:47.917 INFO:tasks.workunit.client.0.smithi077.stdout:2/283: unlink d2/d9/df/l24 0 2024-04-25T02:08:47.917 INFO:tasks.workunit.client.0.smithi077.stdout:2/284: fsync d2/d9/d19/d1c/f33 0 2024-04-25T02:08:47.918 INFO:tasks.workunit.client.0.smithi077.stdout:8/343: dread d3/f7 [0,4194304] 0 2024-04-25T02:08:47.918 INFO:tasks.workunit.client.0.smithi077.stdout:9/317: truncate fc 991230 0 2024-04-25T02:08:47.920 INFO:tasks.workunit.client.0.smithi077.stdout:7/242: rename d4/d13/d18/d28 to d4/d13/d18/d24/d3f/d58 0 2024-04-25T02:08:47.925 INFO:tasks.workunit.client.0.smithi077.stdout:1/289: fsync db/d11/d32/f3f 0 2024-04-25T02:08:47.925 INFO:tasks.workunit.client.0.smithi077.stdout:1/290: chown db/d11/c24 7293616 1 2024-04-25T02:08:47.926 INFO:tasks.workunit.client.0.smithi077.stdout:6/332: symlink de/d12/d25/d60/l73 0 2024-04-25T02:08:47.926 INFO:tasks.workunit.client.0.smithi077.stdout:5/324: sync 2024-04-25T02:08:47.928 INFO:tasks.workunit.client.0.smithi077.stdout:9/318: truncate df/f41 919764 0 2024-04-25T02:08:47.928 INFO:tasks.workunit.client.0.smithi077.stdout:9/319: fdatasync df/f13 0 2024-04-25T02:08:47.928 INFO:tasks.workunit.client.0.smithi077.stdout:9/320: read df/f13 [101473,88100] 0 2024-04-25T02:08:47.929 INFO:tasks.workunit.client.0.smithi077.stdout:9/321: truncate df/f1d 196110 0 2024-04-25T02:08:47.929 INFO:tasks.workunit.client.0.smithi077.stdout:9/322: chown df/d1b 72485000 1 2024-04-25T02:08:47.929 INFO:tasks.workunit.client.0.smithi077.stdout:9/323: write df/d1b/d48/f6f [426582,53660] 0 2024-04-25T02:08:47.929 INFO:tasks.workunit.client.0.smithi077.stdout:0/310: rename d2/d17/d1d/l63 to d2/d17/d4e/l6b 0 2024-04-25T02:08:47.931 INFO:tasks.workunit.client.0.smithi077.stdout:7/243: mkdir d4/d13/d18/d24/d3f/d59 0 2024-04-25T02:08:47.931 INFO:tasks.workunit.client.0.smithi077.stdout:7/244: stat d4/d13/d18/d2d/d30/l45 0 2024-04-25T02:08:47.931 INFO:tasks.workunit.client.0.smithi077.stdout:7/245: getdents d4 0 2024-04-25T02:08:47.931 INFO:tasks.workunit.client.0.smithi077.stdout:4/301: rmdir d0/d14/d21/d39/da/d12/d35/d3e/d3a 39 2024-04-25T02:08:47.933 INFO:tasks.workunit.client.0.smithi077.stdout:5/325: write d0/d25/f36 [458730,59697] 0 2024-04-25T02:08:47.933 INFO:tasks.workunit.client.0.smithi077.stdout:1/291: creat db/f59 x:0 0 0 2024-04-25T02:08:47.934 INFO:tasks.workunit.client.0.smithi077.stdout:2/285: dwrite d2/f5 [0,4194304] 0 2024-04-25T02:08:47.936 INFO:tasks.workunit.client.0.smithi077.stdout:9/324: unlink df/f50 0 2024-04-25T02:08:47.938 INFO:tasks.workunit.client.0.smithi077.stdout:8/344: rename d3/d34/f48 to d3/da/db/df/d2b/d37/f67 0 2024-04-25T02:08:47.940 INFO:tasks.workunit.client.0.smithi077.stdout:0/311: creat d2/d8/d5f/f6c x:0 0 0 2024-04-25T02:08:47.940 INFO:tasks.workunit.client.0.smithi077.stdout:0/312: write d2/d8/d10/f67 [497979,106501] 0 2024-04-25T02:08:47.940 INFO:tasks.workunit.client.0.smithi077.stdout:0/313: fdatasync d2/d17/d1d/f53 0 2024-04-25T02:08:47.940 INFO:tasks.workunit.client.0.smithi077.stdout:5/326: dread d0/d2/d20/d41/f4b [0,4194304] 0 2024-04-25T02:08:47.940 INFO:tasks.workunit.client.0.smithi077.stdout:5/327: fdatasync d0/d2/d3/d9/d39/d44/f48 0 2024-04-25T02:08:47.940 INFO:tasks.workunit.client.0.smithi077.stdout:7/246: mknod d4/d13/c5a 0 2024-04-25T02:08:47.941 INFO:tasks.workunit.client.0.smithi077.stdout:1/292: write db/df/f1d [1540353,96656] 0 2024-04-25T02:08:47.942 INFO:tasks.workunit.client.0.smithi077.stdout:6/333: getdents de/d53 0 2024-04-25T02:08:47.944 INFO:tasks.workunit.client.0.smithi077.stdout:2/286: mknod d2/d9/d19/d1c/d37/c58 0 2024-04-25T02:08:47.944 INFO:tasks.workunit.client.0.smithi077.stdout:2/287: getdents d2/d9/d19/d1c/d3f/d53 0 2024-04-25T02:08:47.945 INFO:tasks.workunit.client.0.smithi077.stdout:9/325: stat df/c5a 0 2024-04-25T02:08:47.945 INFO:tasks.workunit.client.0.smithi077.stdout:9/326: write df/d1b/d56/f6c [1470775,95695] 0 2024-04-25T02:08:47.945 INFO:tasks.workunit.client.0.smithi077.stdout:9/327: write df/f26 [1409033,108638] 0 2024-04-25T02:08:47.945 INFO:tasks.workunit.client.0.smithi077.stdout:9/328: fsync df/f37 0 2024-04-25T02:08:47.945 INFO:tasks.workunit.client.0.smithi077.stdout:9/329: write df/f1d [987172,94601] 0 2024-04-25T02:08:47.946 INFO:tasks.workunit.client.0.smithi077.stdout:8/345: getdents d3 0 2024-04-25T02:08:47.947 INFO:tasks.workunit.client.0.smithi077.stdout:8/346: chown d3/da/d27/c32 16432824 1 2024-04-25T02:08:47.948 INFO:tasks.workunit.client.0.smithi077.stdout:0/314: link d2/d8/d10/d51/f6a d2/d27/d2d/f6d 0 2024-04-25T02:08:47.949 INFO:tasks.workunit.client.0.smithi077.stdout:0/315: stat d2/d8/d10/d51/f6a 0 2024-04-25T02:08:47.950 INFO:tasks.workunit.client.0.smithi077.stdout:0/316: dread d2/d1c/f24 [0,4194304] 0 2024-04-25T02:08:47.950 INFO:tasks.workunit.client.0.smithi077.stdout:5/328: unlink d0/d2/d52/f6a 0 2024-04-25T02:08:47.953 INFO:tasks.workunit.client.0.smithi077.stdout:7/247: mkdir d4/d13/d5b 0 2024-04-25T02:08:47.953 INFO:tasks.workunit.client.0.smithi077.stdout:7/248: write d4/f33 [172849,38999] 0 2024-04-25T02:08:47.955 INFO:tasks.workunit.client.0.smithi077.stdout:4/302: rmdir d0/d14/d21/d39/da 39 2024-04-25T02:08:47.956 INFO:tasks.workunit.client.0.smithi077.stdout:8/347: dread d3/da/db/f28 [0,4194304] 0 2024-04-25T02:08:47.957 INFO:tasks.workunit.client.0.smithi077.stdout:1/293: rmdir db/df/d14/d33/d4a 0 2024-04-25T02:08:47.962 INFO:tasks.workunit.client.0.smithi077.stdout:6/334: rename de/d12/c2f to de/d12/d25/c74 0 2024-04-25T02:08:47.967 INFO:tasks.workunit.client.0.smithi077.stdout:9/330: link df/c16 df/d1b/d48/d75/d77/c79 0 2024-04-25T02:08:47.968 INFO:tasks.workunit.client.0.smithi077.stdout:5/329: mknod d0/d2/d3/d9/d39/d3c/c70 0 2024-04-25T02:08:47.969 INFO:tasks.workunit.client.0.smithi077.stdout:3/284: dwrite d0/f1f [0,4194304] 0 2024-04-25T02:08:47.972 INFO:tasks.workunit.client.0.smithi077.stdout:8/348: truncate d3/da/d27/f2d 2949095 0 2024-04-25T02:08:47.972 INFO:tasks.workunit.client.0.smithi077.stdout:8/349: chown d3/d34/d3d/f5f 13199106 1 2024-04-25T02:08:47.979 INFO:tasks.workunit.client.0.smithi077.stdout:9/331: write df/d1b/f47 [3171155,71498] 0 2024-04-25T02:08:47.980 INFO:tasks.workunit.client.0.smithi077.stdout:9/332: dread df/d1b/d48/f6f [0,4194304] 0 2024-04-25T02:08:47.982 INFO:tasks.workunit.client.0.smithi077.stdout:6/335: getdents de/d12/d25/d60 0 2024-04-25T02:08:47.982 INFO:tasks.workunit.client.0.smithi077.stdout:6/336: write de/d53/f61 [2412337,49096] 0 2024-04-25T02:08:47.985 INFO:tasks.workunit.client.0.smithi077.stdout:5/330: creat d0/d2/d1b/d3b/f71 x:0 0 0 2024-04-25T02:08:47.985 INFO:tasks.workunit.client.0.smithi077.stdout:5/331: creat d0/d2/d1b/d3b/f72 x:0 0 0 2024-04-25T02:08:47.989 INFO:tasks.workunit.client.0.smithi077.stdout:6/337: dread de/d53/f61 [0,4194304] 0 2024-04-25T02:08:47.989 INFO:tasks.workunit.client.0.smithi077.stdout:1/294: dwrite db/df/f20 [4194304,4194304] 0 2024-04-25T02:08:47.989 INFO:tasks.workunit.client.0.smithi077.stdout:1/295: read - db/f59 zero size 2024-04-25T02:08:47.989 INFO:tasks.workunit.client.0.smithi077.stdout:1/296: fsync db/df/d56/f58 0 2024-04-25T02:08:47.990 INFO:tasks.workunit.client.0.smithi077.stdout:7/249: dwrite d4/d13/d18/f40 [0,4194304] 0 2024-04-25T02:08:47.990 INFO:tasks.workunit.client.0.smithi077.stdout:3/285: creat d0/d2/de/f61 x:0 0 0 2024-04-25T02:08:47.990 INFO:tasks.workunit.client.0.smithi077.stdout:2/288: getdents d2/d9/d19/d1c/d37 0 2024-04-25T02:08:47.990 INFO:tasks.workunit.client.0.smithi077.stdout:2/289: readlink d2/d9/l54 0 2024-04-25T02:08:47.991 INFO:tasks.workunit.client.0.smithi077.stdout:7/250: write d4/d13/d18/d2d/d30/f42 [556261,54253] 0 2024-04-25T02:08:47.991 INFO:tasks.workunit.client.0.smithi077.stdout:6/338: dread de/f2c [0,4194304] 0 2024-04-25T02:08:47.991 INFO:tasks.workunit.client.0.smithi077.stdout:6/339: creat de/d12/d25/d38/f75 x:0 0 0 2024-04-25T02:08:47.991 INFO:tasks.workunit.client.0.smithi077.stdout:6/340: readlink de/d12/d25/l27 0 2024-04-25T02:08:47.991 INFO:tasks.workunit.client.0.smithi077.stdout:2/290: write d2/d9/d18/f29 [435329,91156] 0 2024-04-25T02:08:47.991 INFO:tasks.workunit.client.0.smithi077.stdout:4/303: mkdir d0/d14/d21/d39/d64 0 2024-04-25T02:08:47.993 INFO:tasks.workunit.client.0.smithi077.stdout:6/341: read de/f13 [10870,100838] 0 2024-04-25T02:08:47.993 INFO:tasks.workunit.client.0.smithi077.stdout:8/350: mknod d3/da/db/df/d30/c68 0 2024-04-25T02:08:47.993 INFO:tasks.workunit.client.0.smithi077.stdout:6/342: dread - de/d15/d36/f58 zero size 2024-04-25T02:08:47.993 INFO:tasks.workunit.client.0.smithi077.stdout:8/351: chown d3/da/db/f4c 472471 1 2024-04-25T02:08:47.993 INFO:tasks.workunit.client.0.smithi077.stdout:6/343: chown de/d4e/c72 86254996 1 2024-04-25T02:08:47.996 INFO:tasks.workunit.client.0.smithi077.stdout:9/333: unlink df/l11 0 2024-04-25T02:08:47.996 INFO:tasks.workunit.client.0.smithi077.stdout:9/334: getdents df/d1b/d70/d74 0 2024-04-25T02:08:48.006 INFO:tasks.workunit.client.0.smithi077.stdout:3/286: mkdir d0/d3e/d62 0 2024-04-25T02:08:48.007 INFO:tasks.workunit.client.0.smithi077.stdout:8/352: dread d3/d34/d3d/f5f [0,4194304] 0 2024-04-25T02:08:48.007 INFO:tasks.workunit.client.0.smithi077.stdout:7/251: link d4/d13/d2c/c4d d4/d13/d18/d2d/c5c 0 2024-04-25T02:08:48.007 INFO:tasks.workunit.client.0.smithi077.stdout:7/252: truncate d4/f33 875752 0 2024-04-25T02:08:48.009 INFO:tasks.workunit.client.0.smithi077.stdout:2/291: mkdir d2/d59 0 2024-04-25T02:08:48.009 INFO:tasks.workunit.client.0.smithi077.stdout:2/292: creat d2/d9/d18/d31/f5a x:0 0 0 2024-04-25T02:08:48.010 INFO:tasks.workunit.client.0.smithi077.stdout:4/304: rename d0/d14/d21/d39/da/ld to d0/d14/d21/d39/da/d12/l65 0 2024-04-25T02:08:48.011 INFO:tasks.workunit.client.0.smithi077.stdout:9/335: unlink df/f4b 0 2024-04-25T02:08:48.013 INFO:tasks.workunit.client.0.smithi077.stdout:1/297: link db/c27 db/d11/d42/d43/c5a 0 2024-04-25T02:08:48.013 INFO:tasks.workunit.client.0.smithi077.stdout:3/287: rmdir d0/d2/d2f 39 2024-04-25T02:08:48.015 INFO:tasks.workunit.client.0.smithi077.stdout:8/353: link d3/da/d27/d16/f66 d3/da/db/df/d2b/d37/f69 0 2024-04-25T02:08:48.016 INFO:tasks.workunit.client.0.smithi077.stdout:6/344: dwrite de/d12/f2a [0,4194304] 0 2024-04-25T02:08:48.017 INFO:tasks.workunit.client.0.smithi077.stdout:5/332: dwrite d0/d2/d3/f15 [4194304,4194304] 0 2024-04-25T02:08:48.017 INFO:tasks.workunit.client.0.smithi077.stdout:5/333: write d0/d2/d1b/d3b/f71 [742534,14387] 0 2024-04-25T02:08:48.017 INFO:tasks.workunit.client.0.smithi077.stdout:5/334: read - d0/d2/d20/d23/d4a/f5c zero size 2024-04-25T02:08:48.017 INFO:tasks.workunit.client.0.smithi077.stdout:7/253: truncate d4/d13/d18/d2d/f47 442557 0 2024-04-25T02:08:48.018 INFO:tasks.workunit.client.0.smithi077.stdout:7/254: fsync d4/d13/d18/d2d/d30/f42 0 2024-04-25T02:08:48.021 INFO:tasks.workunit.client.0.smithi077.stdout:4/305: truncate d0/de/d25/f31 804520 0 2024-04-25T02:08:48.021 INFO:tasks.workunit.client.0.smithi077.stdout:2/293: dread d2/d9/f52 [0,4194304] 0 2024-04-25T02:08:48.022 INFO:tasks.workunit.client.0.smithi077.stdout:9/336: symlink df/d1b/d56/l7a 0 2024-04-25T02:08:48.022 INFO:tasks.workunit.client.0.smithi077.stdout:8/354: dread d3/da/d27/f2d [0,4194304] 0 2024-04-25T02:08:48.022 INFO:tasks.workunit.client.0.smithi077.stdout:9/337: write fc [178138,92232] 0 2024-04-25T02:08:48.024 INFO:tasks.workunit.client.0.smithi077.stdout:1/298: link db/df/d1b/f22 db/df/d14/d3e/f5b 0 2024-04-25T02:08:48.025 INFO:tasks.workunit.client.0.smithi077.stdout:6/345: mkdir de/d53/d76 0 2024-04-25T02:08:48.030 INFO:tasks.workunit.client.0.smithi077.stdout:8/355: dread d3/da/db/df/d2b/f1d [0,4194304] 0 2024-04-25T02:08:48.030 INFO:tasks.workunit.client.0.smithi077.stdout:8/356: dread - d3/f2a zero size 2024-04-25T02:08:48.039 INFO:tasks.workunit.client.0.smithi077.stdout:5/335: chown d0/d25/f47 176 1 2024-04-25T02:08:48.041 INFO:tasks.workunit.client.0.smithi077.stdout:7/255: rename d4/d13/f38 to d4/d13/d5b/f5d 0 2024-04-25T02:08:48.044 INFO:tasks.workunit.client.0.smithi077.stdout:4/306: stat d0/d14/d21/d39/da/d12/d35/d3e/f36 0 2024-04-25T02:08:48.047 INFO:tasks.workunit.client.0.smithi077.stdout:2/294: creat d2/d9/d19/d2c/f5b x:0 0 0 2024-04-25T02:08:48.050 INFO:tasks.workunit.client.0.smithi077.stdout:8/357: unlink d3/da/d27/d16/d57/c58 0 2024-04-25T02:08:48.050 INFO:tasks.workunit.client.0.smithi077.stdout:8/358: dread - d3/da/db/f4c zero size 2024-04-25T02:08:48.052 INFO:tasks.workunit.client.0.smithi077.stdout:9/338: dwrite df/d1b/d48/f5e [0,4194304] 0 2024-04-25T02:08:48.052 INFO:tasks.workunit.client.0.smithi077.stdout:9/339: fdatasync df/d1b/f20 0 2024-04-25T02:08:48.052 INFO:tasks.workunit.client.0.smithi077.stdout:9/340: chown df/d1b/d48 48200 1 2024-04-25T02:08:48.052 INFO:tasks.workunit.client.0.smithi077.stdout:9/341: chown df/f62 30047 1 2024-04-25T02:08:48.053 INFO:tasks.workunit.client.0.smithi077.stdout:6/346: dwrite de/d12/f17 [0,4194304] 0 2024-04-25T02:08:48.054 INFO:tasks.workunit.client.0.smithi077.stdout:7/256: mknod d4/d13/d18/d24/d3f/d59/c5e 0 2024-04-25T02:08:48.054 INFO:tasks.workunit.client.0.smithi077.stdout:8/359: dread d3/da/f45 [0,4194304] 0 2024-04-25T02:08:48.055 INFO:tasks.workunit.client.0.smithi077.stdout:2/295: mkdir d2/d9/d56/d5c 0 2024-04-25T02:08:48.057 INFO:tasks.workunit.client.0.smithi077.stdout:5/336: getdents d0 0 2024-04-25T02:08:48.062 INFO:tasks.workunit.client.0.smithi077.stdout:9/342: symlink df/d1b/d48/d75/d77/l7b 0 2024-04-25T02:08:48.065 INFO:tasks.workunit.client.0.smithi077.stdout:4/307: dwrite d0/d14/d21/d39/da/d12/d35/f52 [0,4194304] 0 2024-04-25T02:08:48.065 INFO:tasks.workunit.client.0.smithi077.stdout:4/308: write d0/de/d25/f40 [1991701,53077] 0 2024-04-25T02:08:48.065 INFO:tasks.workunit.client.0.smithi077.stdout:6/347: rename de/d12/d25/d38/l3c to de/d3b/l77 0 2024-04-25T02:08:48.066 INFO:tasks.workunit.client.0.smithi077.stdout:2/296: mknod d2/d9/d56/d5c/c5d 0 2024-04-25T02:08:48.066 INFO:tasks.workunit.client.0.smithi077.stdout:8/360: dread d3/da/db/df/f5d [0,4194304] 0 2024-04-25T02:08:48.067 INFO:tasks.workunit.client.0.smithi077.stdout:9/343: creat df/d1b/d56/d67/d68/f7c x:0 0 0 2024-04-25T02:08:48.067 INFO:tasks.workunit.client.0.smithi077.stdout:2/297: read d2/d9/d2f/f38 [1443220,2611] 0 2024-04-25T02:08:48.068 INFO:tasks.workunit.client.0.smithi077.stdout:2/298: getdents d2/d59 0 2024-04-25T02:08:48.068 INFO:tasks.workunit.client.0.smithi077.stdout:2/299: readlink d2/le 0 2024-04-25T02:08:48.069 INFO:tasks.workunit.client.0.smithi077.stdout:5/337: dread d0/d2/d3/f15 [0,4194304] 0 2024-04-25T02:08:48.069 INFO:tasks.workunit.client.0.smithi077.stdout:5/338: readlink d0/d2/d68/l6d 0 2024-04-25T02:08:48.069 INFO:tasks.workunit.client.0.smithi077.stdout:5/339: write d0/d2/d1b/f54 [820481,97324] 0 2024-04-25T02:08:48.070 INFO:tasks.workunit.client.0.smithi077.stdout:2/300: dread d2/d9/d19/d1c/f33 [0,4194304] 0 2024-04-25T02:08:48.074 INFO:tasks.workunit.client.0.smithi077.stdout:6/348: dread de/d12/d25/f29 [0,4194304] 0 2024-04-25T02:08:48.082 INFO:tasks.workunit.client.0.smithi077.stdout:9/344: mknod df/d1b/d48/c7d 0 2024-04-25T02:08:48.083 INFO:tasks.workunit.client.0.smithi077.stdout:0/317: sync 2024-04-25T02:08:48.084 INFO:tasks.workunit.client.0.smithi077.stdout:2/301: rename d2/d9/d2f/c42 to d2/d9/df/c5e 0 2024-04-25T02:08:48.084 INFO:tasks.workunit.client.0.smithi077.stdout:2/302: stat d2/d9/d18/d1b/c26 0 2024-04-25T02:08:48.087 INFO:tasks.workunit.client.0.smithi077.stdout:6/349: unlink ca 0 2024-04-25T02:08:48.088 INFO:tasks.workunit.client.0.smithi077.stdout:4/309: rmdir d0/de/d34 39 2024-04-25T02:08:48.088 INFO:tasks.workunit.client.0.smithi077.stdout:5/340: getdents d0/d2/d1b/d38 0 2024-04-25T02:08:48.090 INFO:tasks.workunit.client.0.smithi077.stdout:9/345: dread df/f49 [0,4194304] 0 2024-04-25T02:08:48.090 INFO:tasks.workunit.client.0.smithi077.stdout:7/257: dwrite d4/fb [0,4194304] 0 2024-04-25T02:08:48.090 INFO:tasks.workunit.client.0.smithi077.stdout:0/318: unlink d2/d17/d4e/d5e/c62 0 2024-04-25T02:08:48.093 INFO:tasks.workunit.client.0.smithi077.stdout:4/310: unlink d0/d14/d21/d39/f42 0 2024-04-25T02:08:48.093 INFO:tasks.workunit.client.0.smithi077.stdout:4/311: chown d0/d14/d21/d39 14 1 2024-04-25T02:08:48.094 INFO:tasks.workunit.client.0.smithi077.stdout:2/303: dread d2/d9/d19/d1c/d3f/f40 [0,4194304] 0 2024-04-25T02:08:48.094 INFO:tasks.workunit.client.0.smithi077.stdout:8/361: dwrite d3/da/db/df/d2b/f3b [0,4194304] 0 2024-04-25T02:08:48.094 INFO:tasks.workunit.client.0.smithi077.stdout:8/362: readlink d3/da/d27/d16/l23 0 2024-04-25T02:08:48.095 INFO:tasks.workunit.client.0.smithi077.stdout:7/258: creat d4/d13/d18/d24/d3f/d59/f5f x:0 0 0 2024-04-25T02:08:48.097 INFO:tasks.workunit.client.0.smithi077.stdout:0/319: mknod d2/d17/d1d/c6e 0 2024-04-25T02:08:48.097 INFO:tasks.workunit.client.0.smithi077.stdout:0/320: write d2/d8/d10/d51/f6a [551312,120319] 0 2024-04-25T02:08:48.097 INFO:tasks.workunit.client.0.smithi077.stdout:0/321: dread - d2/d8/d10/d51/f59 zero size 2024-04-25T02:08:48.097 INFO:tasks.workunit.client.0.smithi077.stdout:0/322: write d2/d9/d2a/f48 [308575,116757] 0 2024-04-25T02:08:48.097 INFO:tasks.workunit.client.0.smithi077.stdout:0/323: creat d2/d8/d10/f6f x:0 0 0 2024-04-25T02:08:48.097 INFO:tasks.workunit.client.0.smithi077.stdout:8/363: dread d3/da/d27/f2d [0,4194304] 0 2024-04-25T02:08:48.098 INFO:tasks.workunit.client.0.smithi077.stdout:4/312: link d0/de/d25/f31 d0/de/d3c/f66 0 2024-04-25T02:08:48.098 INFO:tasks.workunit.client.0.smithi077.stdout:5/341: rmdir d0/d2/d5/d5a 39 2024-04-25T02:08:48.100 INFO:tasks.workunit.client.0.smithi077.stdout:2/304: symlink d2/d9/d2f/l5f 0 2024-04-25T02:08:48.100 INFO:tasks.workunit.client.0.smithi077.stdout:2/305: write d2/fd [2106449,8947] 0 2024-04-25T02:08:48.100 INFO:tasks.workunit.client.0.smithi077.stdout:2/306: fdatasync d2/d9/d19/d2c/f5b 0 2024-04-25T02:08:48.100 INFO:tasks.workunit.client.0.smithi077.stdout:2/307: chown d2/d9/d18/d1b/l3a 120533044 1 2024-04-25T02:08:48.101 INFO:tasks.workunit.client.0.smithi077.stdout:8/364: mknod d3/d34/d3d/c6a 0 2024-04-25T02:08:48.102 INFO:tasks.workunit.client.0.smithi077.stdout:4/313: dread d0/d14/d21/d39/d1d/f2c [0,4194304] 0 2024-04-25T02:08:48.102 INFO:tasks.workunit.client.0.smithi077.stdout:8/365: getdents d3/d34 0 2024-04-25T02:08:48.109 INFO:tasks.workunit.client.0.smithi077.stdout:6/350: dwrite de/d53/f61 [0,4194304] 0 2024-04-25T02:08:48.109 INFO:tasks.workunit.client.0.smithi077.stdout:6/351: truncate de/d12/f1c 1991158 0 2024-04-25T02:08:48.110 INFO:tasks.workunit.client.0.smithi077.stdout:6/352: mkdir de/d53/d78 0 2024-04-25T02:08:48.113 INFO:tasks.workunit.client.0.smithi077.stdout:5/342: dread d0/d2/d20/f21 [0,4194304] 0 2024-04-25T02:08:48.113 INFO:tasks.workunit.client.0.smithi077.stdout:5/343: creat d0/d2/d3/d9/d39/d44/d5f/f73 x:0 0 0 2024-04-25T02:08:48.113 INFO:tasks.workunit.client.0.smithi077.stdout:5/344: readlink d0/d2/d5/l66 0 2024-04-25T02:08:48.113 INFO:tasks.workunit.client.0.smithi077.stdout:2/308: write d2/d9/f17 [2861372,215] 0 2024-04-25T02:08:48.114 INFO:tasks.workunit.client.0.smithi077.stdout:2/309: fdatasync d2/d9/f52 0 2024-04-25T02:08:48.114 INFO:tasks.workunit.client.0.smithi077.stdout:5/345: rmdir d0/d2/d20/d41 39 2024-04-25T02:08:48.114 INFO:tasks.workunit.client.0.smithi077.stdout:5/346: dread - d0/d2/d1b/d38/f64 zero size 2024-04-25T02:08:48.118 INFO:tasks.workunit.client.0.smithi077.stdout:2/310: write d2/d9/f52 [2257450,56521] 0 2024-04-25T02:08:48.118 INFO:tasks.workunit.client.0.smithi077.stdout:2/311: truncate d2/d9/df/f50 880176 0 2024-04-25T02:08:48.119 INFO:tasks.workunit.client.0.smithi077.stdout:2/312: fsync d2/d9/df/f50 0 2024-04-25T02:08:48.120 INFO:tasks.workunit.client.0.smithi077.stdout:2/313: getdents d2/d9/d18/d31 0 2024-04-25T02:08:48.121 INFO:tasks.workunit.client.0.smithi077.stdout:2/314: creat d2/d59/f60 x:0 0 0 2024-04-25T02:08:48.122 INFO:tasks.workunit.client.0.smithi077.stdout:6/353: dread f9 [0,4194304] 0 2024-04-25T02:08:48.122 INFO:tasks.workunit.client.0.smithi077.stdout:6/354: write de/d12/d25/d60/d63/f68 [366436,81405] 0 2024-04-25T02:08:48.122 INFO:tasks.workunit.client.0.smithi077.stdout:2/315: symlink d2/d59/l61 0 2024-04-25T02:08:48.123 INFO:tasks.workunit.client.0.smithi077.stdout:2/316: unlink d2/d9/df/l16 0 2024-04-25T02:08:48.123 INFO:tasks.workunit.client.0.smithi077.stdout:2/317: write d2/d9/d18/d31/f39 [624693,30475] 0 2024-04-25T02:08:48.124 INFO:tasks.workunit.client.0.smithi077.stdout:2/318: mknod d2/d59/c62 0 2024-04-25T02:08:48.125 INFO:tasks.workunit.client.0.smithi077.stdout:7/259: dwrite d4/d13/f4e [0,4194304] 0 2024-04-25T02:08:48.127 INFO:tasks.workunit.client.0.smithi077.stdout:7/260: mknod d4/d13/c60 0 2024-04-25T02:08:48.128 INFO:tasks.workunit.client.0.smithi077.stdout:7/261: mknod d4/d13/d18/d24/d3f/d59/c61 0 2024-04-25T02:08:48.128 INFO:tasks.workunit.client.0.smithi077.stdout:7/262: write d4/d13/d18/d24/d3f/d59/f5f [287586,125333] 0 2024-04-25T02:08:48.128 INFO:tasks.workunit.client.0.smithi077.stdout:7/263: dread - d4/d13/d18/d24/f3b zero size 2024-04-25T02:08:48.128 INFO:tasks.workunit.client.0.smithi077.stdout:7/264: dread - d4/d13/d18/d24/d3f/d58/f52 zero size 2024-04-25T02:08:48.164 INFO:tasks.workunit.client.0.smithi077.stdout:2/319: fsync d2/d9/f17 0 2024-04-25T02:08:48.165 INFO:tasks.workunit.client.0.smithi077.stdout:2/320: dread d2/d9/d19/d1c/f33 [0,4194304] 0 2024-04-25T02:08:48.167 INFO:tasks.workunit.client.0.smithi077.stdout:9/346: dread df/d1b/f30 [0,4194304] 0 2024-04-25T02:08:48.168 INFO:tasks.workunit.client.0.smithi077.stdout:2/321: creat d2/d9/d18/d31/f63 x:0 0 0 2024-04-25T02:08:48.168 INFO:tasks.workunit.client.0.smithi077.stdout:2/322: readlink d2/d9/d18/d1b/l55 0 2024-04-25T02:08:48.184 INFO:tasks.workunit.client.0.smithi077.stdout:0/324: getdents d2/d17/d4e/d5e 0 2024-04-25T02:08:48.193 INFO:tasks.workunit.client.0.smithi077.stdout:6/355: dwrite de/f46 [0,4194304] 0 2024-04-25T02:08:48.193 INFO:tasks.workunit.client.0.smithi077.stdout:6/356: stat de/d12/f1c 0 2024-04-25T02:08:48.193 INFO:tasks.workunit.client.0.smithi077.stdout:6/357: fsync f1 0 2024-04-25T02:08:48.194 INFO:tasks.workunit.client.0.smithi077.stdout:2/323: mknod d2/d9/d19/c64 0 2024-04-25T02:08:48.196 INFO:tasks.workunit.client.0.smithi077.stdout:0/325: mknod d2/d9/c70 0 2024-04-25T02:08:48.196 INFO:tasks.workunit.client.0.smithi077.stdout:0/326: chown d2/d8/d10/f67 80055 1 2024-04-25T02:08:48.196 INFO:tasks.workunit.client.0.smithi077.stdout:0/327: chown d2/d17/d4e 223 1 2024-04-25T02:08:48.200 INFO:tasks.workunit.client.0.smithi077.stdout:6/358: getdents de/d3b 0 2024-04-25T02:08:48.203 INFO:tasks.workunit.client.0.smithi077.stdout:2/324: rename d2/d9/d18/f29 to d2/d9/d56/d5c/f65 0 2024-04-25T02:08:48.204 INFO:tasks.workunit.client.0.smithi077.stdout:2/325: read d2/fd [2048266,30291] 0 2024-04-25T02:08:48.204 INFO:tasks.workunit.client.0.smithi077.stdout:2/326: chown d2/d9/d19/d2c/f47 3 1 2024-04-25T02:08:48.205 INFO:tasks.workunit.client.0.smithi077.stdout:0/328: mkdir d2/d9/d71 0 2024-04-25T02:08:48.205 INFO:tasks.workunit.client.0.smithi077.stdout:0/329: stat d2 0 2024-04-25T02:08:48.205 INFO:tasks.workunit.client.0.smithi077.stdout:0/330: write d2/d9/f66 [668069,126738] 0 2024-04-25T02:08:48.207 INFO:tasks.workunit.client.0.smithi077.stdout:8/366: dwrite d3/da/db/df/d2b/d37/f69 [0,4194304] 0 2024-04-25T02:08:48.208 INFO:tasks.workunit.client.0.smithi077.stdout:4/314: dwrite d0/de/d34/f41 [0,4194304] 0 2024-04-25T02:08:48.209 INFO:tasks.workunit.client.0.smithi077.stdout:2/327: creat d2/d9/d56/d5c/f66 x:0 0 0 2024-04-25T02:08:48.209 INFO:tasks.workunit.client.0.smithi077.stdout:2/328: chown d2/d9/d18 168000804 1 2024-04-25T02:08:48.209 INFO:tasks.workunit.client.0.smithi077.stdout:2/329: chown d2/d9/d19/d1c 61330 1 2024-04-25T02:08:48.211 INFO:tasks.workunit.client.0.smithi077.stdout:7/265: dwrite d4/d13/f1f [0,4194304] 0 2024-04-25T02:08:48.211 INFO:tasks.workunit.client.0.smithi077.stdout:5/347: dwrite d0/d2/d1b/f54 [0,4194304] 0 2024-04-25T02:08:48.211 INFO:tasks.workunit.client.0.smithi077.stdout:5/348: creat d0/d2/d20/d23/d4a/f74 x:0 0 0 2024-04-25T02:08:48.211 INFO:tasks.workunit.client.0.smithi077.stdout:0/331: creat d2/d17/d1d/d34/d4c/f72 x:0 0 0 2024-04-25T02:08:48.211 INFO:tasks.workunit.client.0.smithi077.stdout:0/332: readlink d2/d17/d1d/l33 0 2024-04-25T02:08:48.211 INFO:tasks.workunit.client.0.smithi077.stdout:0/333: fsync d2/f4b 0 2024-04-25T02:08:48.212 INFO:tasks.workunit.client.0.smithi077.stdout:6/359: creat de/d12/d25/d4b/f79 x:0 0 0 2024-04-25T02:08:48.212 INFO:tasks.workunit.client.0.smithi077.stdout:6/360: fsync de/f46 0 2024-04-25T02:08:48.213 INFO:tasks.workunit.client.0.smithi077.stdout:0/334: dread d2/d27/f3b [0,4194304] 0 2024-04-25T02:08:48.213 INFO:tasks.workunit.client.0.smithi077.stdout:0/335: dread - d2/d8/d10/f6f zero size 2024-04-25T02:08:48.214 INFO:tasks.workunit.client.0.smithi077.stdout:8/367: mkdir d3/da/d27/d16/d6b 0 2024-04-25T02:08:48.216 INFO:tasks.workunit.client.0.smithi077.stdout:4/315: mknod d0/d14/d21/d39/da/d12/c67 0 2024-04-25T02:08:48.216 INFO:tasks.workunit.client.0.smithi077.stdout:4/316: readlink d0/de/d25/l5d 0 2024-04-25T02:08:48.217 INFO:tasks.workunit.client.0.smithi077.stdout:2/330: dread d2/d9/f52 [0,4194304] 0 2024-04-25T02:08:48.217 INFO:tasks.workunit.client.0.smithi077.stdout:2/331: truncate d2/d59/f60 534583 0 2024-04-25T02:08:48.221 INFO:tasks.workunit.client.0.smithi077.stdout:7/266: rename d4/d13/l3d to d4/d13/l62 0 2024-04-25T02:08:48.221 INFO:tasks.workunit.client.0.smithi077.stdout:7/267: write d4/d13/d18/d2d/d30/f42 [927987,87826] 0 2024-04-25T02:08:48.224 INFO:tasks.workunit.client.0.smithi077.stdout:6/361: chown de/d12/d25/d60/d63/c43 1632 1 2024-04-25T02:08:48.224 INFO:tasks.workunit.client.0.smithi077.stdout:6/362: creat de/d12/f7a x:0 0 0 2024-04-25T02:08:48.230 INFO:tasks.workunit.client.0.smithi077.stdout:7/268: unlink d4/d13/d18/d24/f53 0 2024-04-25T02:08:48.230 INFO:tasks.workunit.client.0.smithi077.stdout:7/269: write d4/fa [166754,75344] 0 2024-04-25T02:08:48.230 INFO:tasks.workunit.client.0.smithi077.stdout:7/270: creat d4/d13/d18/d2d/d30/f63 x:0 0 0 2024-04-25T02:08:48.231 INFO:tasks.workunit.client.0.smithi077.stdout:6/363: dread de/d15/f22 [0,4194304] 0 2024-04-25T02:08:48.231 INFO:tasks.workunit.client.0.smithi077.stdout:6/364: truncate de/d12/f2a 4609560 0 2024-04-25T02:08:48.231 INFO:tasks.workunit.client.0.smithi077.stdout:5/349: mknod d0/d2/c75 0 2024-04-25T02:08:48.231 INFO:tasks.workunit.client.0.smithi077.stdout:5/350: creat d0/d2/d1b/f76 x:0 0 0 2024-04-25T02:08:48.232 INFO:tasks.workunit.client.0.smithi077.stdout:3/288: sync 2024-04-25T02:08:48.234 INFO:tasks.workunit.client.0.smithi077.stdout:7/271: dread d4/d13/d5b/f5d [0,4194304] 0 2024-04-25T02:08:48.234 INFO:tasks.workunit.client.0.smithi077.stdout:4/317: dwrite d0/de/f44 [0,4194304] 0 2024-04-25T02:08:48.240 INFO:tasks.workunit.client.0.smithi077.stdout:0/336: rmdir d2/d8 39 2024-04-25T02:08:48.242 INFO:tasks.workunit.client.0.smithi077.stdout:8/368: getdents d3/da 0 2024-04-25T02:08:48.242 INFO:tasks.workunit.client.0.smithi077.stdout:8/369: readlink d3/da/db/df/l49 0 2024-04-25T02:08:48.244 INFO:tasks.workunit.client.0.smithi077.stdout:2/332: rename d2/fd to d2/d9/f67 0 2024-04-25T02:08:48.244 INFO:tasks.workunit.client.0.smithi077.stdout:4/318: dread d0/d14/d21/d39/da/d12/d35/f49 [0,4194304] 0 2024-04-25T02:08:48.244 INFO:tasks.workunit.client.0.smithi077.stdout:4/319: fsync d0/de/d25/f31 0 2024-04-25T02:08:48.250 INFO:tasks.workunit.client.0.smithi077.stdout:5/351: symlink d0/d2/d5/d5a/l77 0 2024-04-25T02:08:48.251 INFO:tasks.workunit.client.0.smithi077.stdout:3/289: mknod d0/d17/c63 0 2024-04-25T02:08:48.251 INFO:tasks.workunit.client.0.smithi077.stdout:3/290: fdatasync d0/d17/f37 0 2024-04-25T02:08:48.254 INFO:tasks.workunit.client.0.smithi077.stdout:0/337: rmdir d2/d9/d2a 39 2024-04-25T02:08:48.256 INFO:tasks.workunit.client.0.smithi077.stdout:8/370: creat d3/da/d27/f6c x:0 0 0 2024-04-25T02:08:48.257 INFO:tasks.workunit.client.0.smithi077.stdout:4/320: creat d0/d14/d60/d62/f68 x:0 0 0 2024-04-25T02:08:48.257 INFO:tasks.workunit.client.0.smithi077.stdout:4/321: chown d0/d14/d21/d39/f61 336035 1 2024-04-25T02:08:48.257 INFO:tasks.workunit.client.0.smithi077.stdout:1/299: sync 2024-04-25T02:08:48.257 INFO:tasks.workunit.client.0.smithi077.stdout:6/365: dwrite f5 [0,4194304] 0 2024-04-25T02:08:48.258 INFO:tasks.workunit.client.0.smithi077.stdout:6/366: write de/d53/f69 [583783,114475] 0 2024-04-25T02:08:48.259 INFO:tasks.workunit.client.0.smithi077.stdout:3/291: mkdir d0/d3e/d42/d64 0 2024-04-25T02:08:48.260 INFO:tasks.workunit.client.0.smithi077.stdout:4/322: rename d0/f5f to d0/d14/d60/f69 0 2024-04-25T02:08:48.261 INFO:tasks.workunit.client.0.smithi077.stdout:7/272: dwrite d4/d13/d18/f40 [0,4194304] 0 2024-04-25T02:08:48.266 INFO:tasks.workunit.client.0.smithi077.stdout:6/367: creat de/d12/d25/f7b x:0 0 0 2024-04-25T02:08:48.267 INFO:tasks.workunit.client.0.smithi077.stdout:3/292: mknod d0/d17/d4b/c65 0 2024-04-25T02:08:48.267 INFO:tasks.workunit.client.0.smithi077.stdout:4/323: mknod d0/d14/d21/c6a 0 2024-04-25T02:08:48.268 INFO:tasks.workunit.client.0.smithi077.stdout:4/324: creat d0/f6b x:0 0 0 2024-04-25T02:08:48.269 INFO:tasks.workunit.client.0.smithi077.stdout:7/273: link d4/fe d4/d13/d5b/f64 0 2024-04-25T02:08:48.270 INFO:tasks.workunit.client.0.smithi077.stdout:6/368: creat de/d53/f7c x:0 0 0 2024-04-25T02:08:48.271 INFO:tasks.workunit.client.0.smithi077.stdout:6/369: write de/d12/f2a [5409364,58825] 0 2024-04-25T02:08:48.271 INFO:tasks.workunit.client.0.smithi077.stdout:5/352: dread d0/d25/f1a [0,4194304] 0 2024-04-25T02:08:48.271 INFO:tasks.workunit.client.0.smithi077.stdout:2/333: dwrite d2/d9/d19/f1a [0,4194304] 0 2024-04-25T02:08:48.271 INFO:tasks.workunit.client.0.smithi077.stdout:3/293: creat d0/d2/de/d48/d15/f66 x:0 0 0 2024-04-25T02:08:48.272 INFO:tasks.workunit.client.0.smithi077.stdout:6/370: dread de/f2c [0,4194304] 0 2024-04-25T02:08:48.274 INFO:tasks.workunit.client.0.smithi077.stdout:4/325: mknod d0/d14/d60/d62/c6c 0 2024-04-25T02:08:48.275 INFO:tasks.workunit.client.0.smithi077.stdout:4/326: chown d0/de/d25/f40 1019988175 1 2024-04-25T02:08:48.275 INFO:tasks.workunit.client.0.smithi077.stdout:4/327: write d0/f16 [2539744,93998] 0 2024-04-25T02:08:48.277 INFO:tasks.workunit.client.0.smithi077.stdout:2/334: stat d2/le 0 2024-04-25T02:08:48.277 INFO:tasks.workunit.client.0.smithi077.stdout:2/335: fsync d2/d9/df/f50 0 2024-04-25T02:08:48.277 INFO:tasks.workunit.client.0.smithi077.stdout:2/336: truncate d2/d9/d19/d2c/f47 611505 0 2024-04-25T02:08:48.277 INFO:tasks.workunit.client.0.smithi077.stdout:2/337: stat d2/d9/d19/l4f 0 2024-04-25T02:08:48.279 INFO:tasks.workunit.client.0.smithi077.stdout:6/371: symlink de/d15/l7d 0 2024-04-25T02:08:48.279 INFO:tasks.workunit.client.0.smithi077.stdout:9/347: sync 2024-04-25T02:08:48.281 INFO:tasks.workunit.client.0.smithi077.stdout:2/338: dread d2/d9/d19/d1c/d3f/f40 [0,4194304] 0 2024-04-25T02:08:48.288 INFO:tasks.workunit.client.0.smithi077.stdout:4/328: unlink d0/f20 0 2024-04-25T02:08:48.288 INFO:tasks.workunit.client.0.smithi077.stdout:4/329: fdatasync d0/d14/d21/d39/f4d 0 2024-04-25T02:08:48.288 INFO:tasks.workunit.client.0.smithi077.stdout:4/330: chown d0/d14/d21/d39/da/d12/d35 36066 1 2024-04-25T02:08:48.288 INFO:tasks.workunit.client.0.smithi077.stdout:4/331: fsync d0/d14/d21/d39/da/d12/d35/d3e/f4b 0 2024-04-25T02:08:48.294 INFO:tasks.workunit.client.0.smithi077.stdout:7/274: rmdir d4/d13 39 2024-04-25T02:08:48.295 INFO:tasks.workunit.client.0.smithi077.stdout:7/275: fsync d4/f12 0 2024-04-25T02:08:48.295 INFO:tasks.workunit.client.0.smithi077.stdout:8/371: dwrite d3/da/db/df/d30/f55 [0,4194304] 0 2024-04-25T02:08:48.295 INFO:tasks.workunit.client.0.smithi077.stdout:1/300: dwrite db/df/d14/d3e/f5b [0,4194304] 0 2024-04-25T02:08:48.295 INFO:tasks.workunit.client.0.smithi077.stdout:5/353: dwrite d0/d25/f1a [4194304,4194304] 0 2024-04-25T02:08:48.296 INFO:tasks.workunit.client.0.smithi077.stdout:3/294: mknod d0/d2/d2f/c67 0 2024-04-25T02:08:48.296 INFO:tasks.workunit.client.0.smithi077.stdout:3/295: chown d0/d2/de/d27/f51 901988 1 2024-04-25T02:08:48.296 INFO:tasks.workunit.client.0.smithi077.stdout:3/296: write d0/d2/f18 [4875698,50372] 0 2024-04-25T02:08:48.297 INFO:tasks.workunit.client.0.smithi077.stdout:9/348: link df/f41 df/d1b/d56/d67/f7e 0 2024-04-25T02:08:48.298 INFO:tasks.workunit.client.0.smithi077.stdout:4/332: unlink d0/d14/d21/d39/da/c1a 0 2024-04-25T02:08:48.299 INFO:tasks.workunit.client.0.smithi077.stdout:4/333: read - d0/d14/d60/d62/f68 zero size 2024-04-25T02:08:48.299 INFO:tasks.workunit.client.0.smithi077.stdout:7/276: creat d4/d13/d18/d2d/d30/f65 x:0 0 0 2024-04-25T02:08:48.299 INFO:tasks.workunit.client.0.smithi077.stdout:4/334: creat d0/de/f6d x:0 0 0 2024-04-25T02:08:48.299 INFO:tasks.workunit.client.0.smithi077.stdout:7/277: chown d4/d13/d18/d24/f3b 1201625 1 2024-04-25T02:08:48.302 INFO:tasks.workunit.client.0.smithi077.stdout:8/372: link d3/da/db/f4c d3/da/d27/d16/d57/f6d 0 2024-04-25T02:08:48.302 INFO:tasks.workunit.client.0.smithi077.stdout:8/373: chown d3/da/db/df/f10 3033 1 2024-04-25T02:08:48.303 INFO:tasks.workunit.client.0.smithi077.stdout:8/374: write d3/da/d27/f47 [1143612,77785] 0 2024-04-25T02:08:48.305 INFO:tasks.workunit.client.0.smithi077.stdout:5/354: symlink d0/d2/d20/l78 0 2024-04-25T02:08:48.307 INFO:tasks.workunit.client.0.smithi077.stdout:6/372: dwrite de/d12/f17 [0,4194304] 0 2024-04-25T02:08:48.307 INFO:tasks.workunit.client.0.smithi077.stdout:6/373: stat de/d15/d36 0 2024-04-25T02:08:48.307 INFO:tasks.workunit.client.0.smithi077.stdout:6/374: fsync de/d53/f61 0 2024-04-25T02:08:48.309 INFO:tasks.workunit.client.0.smithi077.stdout:2/339: dwrite d2/d9/d18/fa [0,4194304] 0 2024-04-25T02:08:48.310 INFO:tasks.workunit.client.0.smithi077.stdout:4/335: symlink d0/d14/d21/l6e 0 2024-04-25T02:08:48.312 INFO:tasks.workunit.client.0.smithi077.stdout:1/301: mkdir db/d11/d5c 0 2024-04-25T02:08:48.313 INFO:tasks.workunit.client.0.smithi077.stdout:7/278: dread d4/d13/d18/d2d/f46 [0,4194304] 0 2024-04-25T02:08:48.314 INFO:tasks.workunit.client.0.smithi077.stdout:5/355: creat d0/d2/f79 x:0 0 0 2024-04-25T02:08:48.314 INFO:tasks.workunit.client.0.smithi077.stdout:8/375: getdents d3/da/db/df 0 2024-04-25T02:08:48.315 INFO:tasks.workunit.client.0.smithi077.stdout:1/302: mkdir db/df/d56/d5d 0 2024-04-25T02:08:48.316 INFO:tasks.workunit.client.0.smithi077.stdout:7/279: mkdir d4/d13/d66 0 2024-04-25T02:08:48.317 INFO:tasks.workunit.client.0.smithi077.stdout:9/349: dwrite df/d1b/f40 [4194304,4194304] 0 2024-04-25T02:08:48.318 INFO:tasks.workunit.client.0.smithi077.stdout:4/336: dread d0/d14/d21/d39/f4d [0,4194304] 0 2024-04-25T02:08:48.318 INFO:tasks.workunit.client.0.smithi077.stdout:4/337: truncate d0/d14/d21/d39/da/f5b 682810 0 2024-04-25T02:08:48.318 INFO:tasks.workunit.client.0.smithi077.stdout:5/356: symlink d0/d2/d20/l7a 0 2024-04-25T02:08:48.320 INFO:tasks.workunit.client.0.smithi077.stdout:1/303: creat db/d11/d5c/f5e x:0 0 0 2024-04-25T02:08:48.321 INFO:tasks.workunit.client.0.smithi077.stdout:1/304: fsync db/df/d14/d3e/f5b 0 2024-04-25T02:08:48.324 INFO:tasks.workunit.client.0.smithi077.stdout:7/280: creat d4/d13/d18/d2d/d56/f67 x:0 0 0 2024-04-25T02:08:48.324 INFO:tasks.workunit.client.0.smithi077.stdout:7/281: stat d4/d13/d18/d24/d3f/d59 0 2024-04-25T02:08:48.324 INFO:tasks.workunit.client.0.smithi077.stdout:7/282: stat d4/d13/c60 0 2024-04-25T02:08:48.326 INFO:tasks.workunit.client.0.smithi077.stdout:8/376: read d3/da/db/df/d30/f55 [2739407,11925] 0 2024-04-25T02:08:48.333 INFO:tasks.workunit.client.0.smithi077.stdout:5/357: rename d0/d2/c16 to d0/d2/d3/d1d/d3e/c7b 0 2024-04-25T02:08:48.333 INFO:tasks.workunit.client.0.smithi077.stdout:5/358: readlink d0/d2/d3/l63 0 2024-04-25T02:08:48.333 INFO:tasks.workunit.client.0.smithi077.stdout:5/359: creat d0/d2/d20/d23/f7c x:0 0 0 2024-04-25T02:08:48.333 INFO:tasks.workunit.client.0.smithi077.stdout:1/305: mknod db/df/d14/d33/d34/c5f 0 2024-04-25T02:08:48.334 INFO:tasks.workunit.client.0.smithi077.stdout:7/283: mkdir d4/d13/d18/d2d/d56/d68 0 2024-04-25T02:08:48.335 INFO:tasks.workunit.client.0.smithi077.stdout:8/377: creat d3/da/d27/d16/d6b/f6e x:0 0 0 2024-04-25T02:08:48.337 INFO:tasks.workunit.client.0.smithi077.stdout:2/340: dwrite d2/d9/d19/d2c/f47 [0,4194304] 0 2024-04-25T02:08:48.338 INFO:tasks.workunit.client.0.smithi077.stdout:3/297: dwrite d0/d2/de/d48/f29 [0,4194304] 0 2024-04-25T02:08:48.338 INFO:tasks.workunit.client.0.smithi077.stdout:9/350: dwrite df/f43 [4194304,4194304] 0 2024-04-25T02:08:48.339 INFO:tasks.workunit.client.0.smithi077.stdout:5/360: creat d0/d2/d3/f7d x:0 0 0 2024-04-25T02:08:48.339 INFO:tasks.workunit.client.0.smithi077.stdout:5/361: chown d0/d25/f36 183749293 1 2024-04-25T02:08:48.339 INFO:tasks.workunit.client.0.smithi077.stdout:5/362: creat d0/d2/d20/d23/d4a/f7e x:0 0 0 2024-04-25T02:08:48.339 INFO:tasks.workunit.client.0.smithi077.stdout:5/363: truncate d0/d2/d20/d23/d4a/f7e 783139 0 2024-04-25T02:08:48.340 INFO:tasks.workunit.client.0.smithi077.stdout:4/338: getdents d0/de 0 2024-04-25T02:08:48.341 INFO:tasks.workunit.client.0.smithi077.stdout:1/306: mknod db/df/d1b/c60 0 2024-04-25T02:08:48.343 INFO:tasks.workunit.client.0.smithi077.stdout:7/284: link d4/d13/d18/d24/d3f/d59/c61 d4/d13/d18/d24/d3f/d58/c69 0 2024-04-25T02:08:48.348 INFO:tasks.workunit.client.0.smithi077.stdout:2/341: creat d2/d9/d19/d1c/d3f/d53/f68 x:0 0 0 2024-04-25T02:08:48.349 INFO:tasks.workunit.client.0.smithi077.stdout:2/342: write d2/d59/f60 [900702,120376] 0 2024-04-25T02:08:48.352 INFO:tasks.workunit.client.0.smithi077.stdout:3/298: rename d0/d2/de/d48/d15/f38 to d0/d3e/d62/f68 0 2024-04-25T02:08:48.353 INFO:tasks.workunit.client.0.smithi077.stdout:5/364: dwrite d0/d2/d3/d9/d39/d44/f48 [0,4194304] 0 2024-04-25T02:08:48.353 INFO:tasks.workunit.client.0.smithi077.stdout:5/365: write d0/d2/d3/d9/d39/d44/f53 [536356,78323] 0 2024-04-25T02:08:48.353 INFO:tasks.workunit.client.0.smithi077.stdout:5/366: read d0/fd [4590799,103671] 0 2024-04-25T02:08:48.353 INFO:tasks.workunit.client.0.smithi077.stdout:5/367: fdatasync d0/fd 0 2024-04-25T02:08:48.355 INFO:tasks.workunit.client.0.smithi077.stdout:9/351: creat df/d1b/d48/d75/d77/f7f x:0 0 0 2024-04-25T02:08:48.359 INFO:tasks.workunit.client.0.smithi077.stdout:3/299: dread d0/d2/de/f1b [0,4194304] 0 2024-04-25T02:08:48.359 INFO:tasks.workunit.client.0.smithi077.stdout:7/285: rename d4/l10 to d4/l6a 0 2024-04-25T02:08:48.359 INFO:tasks.workunit.client.0.smithi077.stdout:7/286: creat d4/d13/d18/d2d/d30/f6b x:0 0 0 2024-04-25T02:08:48.360 INFO:tasks.workunit.client.0.smithi077.stdout:8/378: rmdir d3/d34/d3d 39 2024-04-25T02:08:48.362 INFO:tasks.workunit.client.0.smithi077.stdout:5/368: read d0/d2/d1b/f54 [2717539,25322] 0 2024-04-25T02:08:48.365 INFO:tasks.workunit.client.0.smithi077.stdout:9/352: mkdir df/d80 0 2024-04-25T02:08:48.365 INFO:tasks.workunit.client.0.smithi077.stdout:9/353: readlink l0 0 2024-04-25T02:08:48.369 INFO:tasks.workunit.client.0.smithi077.stdout:4/339: symlink d0/d14/d21/d39/l6f 0 2024-04-25T02:08:48.371 INFO:tasks.workunit.client.0.smithi077.stdout:3/300: creat d0/f69 x:0 0 0 2024-04-25T02:08:48.373 INFO:tasks.workunit.client.0.smithi077.stdout:8/379: creat d3/f6f x:0 0 0 2024-04-25T02:08:48.375 INFO:tasks.workunit.client.0.smithi077.stdout:5/369: rename d0/d2/d20/l78 to d0/d2/d20/l7f 0 2024-04-25T02:08:48.376 INFO:tasks.workunit.client.0.smithi077.stdout:9/354: mknod df/d80/c81 0 2024-04-25T02:08:48.378 INFO:tasks.workunit.client.0.smithi077.stdout:4/340: unlink d0/d14/d21/d39/da/d12/l1f 0 2024-04-25T02:08:48.378 INFO:tasks.workunit.client.0.smithi077.stdout:4/341: chown d0/d14/d21/f2f 19457 1 2024-04-25T02:08:48.380 INFO:tasks.workunit.client.0.smithi077.stdout:3/301: mkdir d0/d3e/d62/d6a 0 2024-04-25T02:08:48.380 INFO:tasks.workunit.client.0.smithi077.stdout:3/302: dread - d0/d2/de/d48/d15/f66 zero size 2024-04-25T02:08:48.381 INFO:tasks.workunit.client.0.smithi077.stdout:8/380: mkdir d3/da/db/df/d2b/d70 0 2024-04-25T02:08:48.381 INFO:tasks.workunit.client.0.smithi077.stdout:8/381: write d3/da/d27/f6c [277532,126235] 0 2024-04-25T02:08:48.382 INFO:tasks.workunit.client.0.smithi077.stdout:5/370: mkdir d0/d2/d3/d9/d39/d44/d80 0 2024-04-25T02:08:48.385 INFO:tasks.workunit.client.0.smithi077.stdout:3/303: link d0/d2/d2f/c67 d0/d2/d2f/d5f/c6b 0 2024-04-25T02:08:48.386 INFO:tasks.workunit.client.0.smithi077.stdout:4/342: mknod d0/d14/d21/d39/da/d12/d35/d3e/d3a/c70 0 2024-04-25T02:08:48.389 INFO:tasks.workunit.client.0.smithi077.stdout:4/343: link d0/d14/d21/d39/da/d12/d35/d3e/f36 d0/d14/d21/d39/da/d12/d35/f71 0 2024-04-25T02:08:48.390 INFO:tasks.workunit.client.0.smithi077.stdout:4/344: fsync d0/d14/d21/d39/da/d12/d35/d3e/f2b 0 2024-04-25T02:08:48.390 INFO:tasks.workunit.client.0.smithi077.stdout:4/345: fsync d0/d14/d21/d39/da/f63 0 2024-04-25T02:08:48.390 INFO:tasks.workunit.client.0.smithi077.stdout:4/346: chown d0/de/f4a 15003 1 2024-04-25T02:08:48.390 INFO:tasks.workunit.client.0.smithi077.stdout:4/347: creat d0/f72 x:0 0 0 2024-04-25T02:08:48.390 INFO:tasks.workunit.client.0.smithi077.stdout:4/348: getdents d0/de 0 2024-04-25T02:08:48.390 INFO:tasks.workunit.client.0.smithi077.stdout:4/349: truncate d0/d14/d60/d62/f68 734629 0 2024-04-25T02:08:48.390 INFO:tasks.workunit.client.0.smithi077.stdout:4/350: dread - d0/d14/d60/f69 zero size 2024-04-25T02:08:48.399 INFO:tasks.workunit.client.0.smithi077.stdout:8/382: dwrite d3/da/db/df/d30/f55 [4194304,4194304] 0 2024-04-25T02:08:48.557 INFO:tasks.workunit.client.0.smithi077.stdout:3/304: dread d0/f1f [0,4194304] 0 2024-04-25T02:08:48.557 INFO:tasks.workunit.client.0.smithi077.stdout:3/305: fdatasync d0/d2/f41 0 2024-04-25T02:08:48.557 INFO:tasks.workunit.client.0.smithi077.stdout:8/383: link d3/da/c64 d3/da/d27/c71 0 2024-04-25T02:08:48.557 INFO:tasks.workunit.client.0.smithi077.stdout:8/384: fdatasync d3/da/db/df/d2b/d37/f69 0 2024-04-25T02:08:48.560 INFO:tasks.workunit.client.0.smithi077.stdout:9/355: dwrite df/f6b [0,4194304] 0 2024-04-25T02:08:48.566 INFO:tasks.workunit.client.0.smithi077.stdout:9/356: mknod df/d1b/d56/c82 0 2024-04-25T02:08:48.582 INFO:tasks.workunit.client.0.smithi077.stdout:9/357: dread df/f12 [0,4194304] 0 2024-04-25T02:08:48.583 INFO:tasks.workunit.client.0.smithi077.stdout:9/358: creat df/d60/f83 x:0 0 0 2024-04-25T02:08:48.583 INFO:tasks.workunit.client.0.smithi077.stdout:9/359: fdatasync df/d1b/f5d 0 2024-04-25T02:08:48.584 INFO:tasks.workunit.client.0.smithi077.stdout:9/360: mkdir df/d1b/d70/d84 0 2024-04-25T02:08:48.585 INFO:tasks.workunit.client.0.smithi077.stdout:9/361: mknod df/d1b/d48/c85 0 2024-04-25T02:08:48.585 INFO:tasks.workunit.client.0.smithi077.stdout:9/362: write df/f37 [2243937,125388] 0 2024-04-25T02:08:48.586 INFO:tasks.workunit.client.0.smithi077.stdout:9/363: mkdir df/d1b/d48/d86 0 2024-04-25T02:08:48.587 INFO:tasks.workunit.client.0.smithi077.stdout:9/364: mkdir df/d60/d87 0 2024-04-25T02:08:48.588 INFO:tasks.workunit.client.0.smithi077.stdout:5/371: dwrite d0/d2/d1b/f54 [0,4194304] 0 2024-04-25T02:08:48.588 INFO:tasks.workunit.client.0.smithi077.stdout:5/372: chown d0/d2/d5/l66 17252838 1 2024-04-25T02:08:48.588 INFO:tasks.workunit.client.0.smithi077.stdout:3/306: dwrite d0/f9 [0,4194304] 0 2024-04-25T02:08:48.590 INFO:tasks.workunit.client.0.smithi077.stdout:8/385: dwrite d3/d34/d3d/f5f [0,4194304] 0 2024-04-25T02:08:48.592 INFO:tasks.workunit.client.0.smithi077.stdout:9/365: read df/d1b/f30 [2979537,29827] 0 2024-04-25T02:08:48.592 INFO:tasks.workunit.client.0.smithi077.stdout:8/386: dread d3/d34/d3d/f42 [0,4194304] 0 2024-04-25T02:08:48.594 INFO:tasks.workunit.client.0.smithi077.stdout:3/307: creat d0/f6c x:0 0 0 2024-04-25T02:08:48.594 INFO:tasks.workunit.client.0.smithi077.stdout:3/308: truncate d0/d17/f5d 25375 0 2024-04-25T02:08:48.597 INFO:tasks.workunit.client.0.smithi077.stdout:9/366: creat df/d1b/d48/d75/f88 x:0 0 0 2024-04-25T02:08:48.598 INFO:tasks.workunit.client.0.smithi077.stdout:8/387: dread d3/da/d27/f47 [0,4194304] 0 2024-04-25T02:08:48.598 INFO:tasks.workunit.client.0.smithi077.stdout:3/309: symlink d0/d2/de/d36/l6d 0 2024-04-25T02:08:48.599 INFO:tasks.workunit.client.0.smithi077.stdout:9/367: truncate df/f12 4010881 0 2024-04-25T02:08:48.599 INFO:tasks.workunit.client.0.smithi077.stdout:9/368: fsync df/d1b/f65 0 2024-04-25T02:08:48.599 INFO:tasks.workunit.client.0.smithi077.stdout:9/369: write df/d1b/d48/f6f [1375938,73305] 0 2024-04-25T02:08:48.599 INFO:tasks.workunit.client.0.smithi077.stdout:9/370: chown df/d1b/l3e 92873 1 2024-04-25T02:08:48.600 INFO:tasks.workunit.client.0.smithi077.stdout:8/388: creat d3/da/db/df/d2b/f72 x:0 0 0 2024-04-25T02:08:48.601 INFO:tasks.workunit.client.0.smithi077.stdout:8/389: fdatasync d3/f6 0 2024-04-25T02:08:48.601 INFO:tasks.workunit.client.0.smithi077.stdout:6/375: sync 2024-04-25T02:08:48.601 INFO:tasks.workunit.client.0.smithi077.stdout:4/351: sync 2024-04-25T02:08:48.601 INFO:tasks.workunit.client.0.smithi077.stdout:0/338: sync 2024-04-25T02:08:48.601 INFO:tasks.workunit.client.0.smithi077.stdout:2/343: sync 2024-04-25T02:08:48.601 INFO:tasks.workunit.client.0.smithi077.stdout:1/307: sync 2024-04-25T02:08:48.601 INFO:tasks.workunit.client.0.smithi077.stdout:1/308: write f1 [1883219,44834] 0 2024-04-25T02:08:48.601 INFO:tasks.workunit.client.0.smithi077.stdout:7/287: sync 2024-04-25T02:08:48.601 INFO:tasks.workunit.client.0.smithi077.stdout:3/310: mkdir d0/d3e/d62/d6a/d6e 0 2024-04-25T02:08:48.602 INFO:tasks.workunit.client.0.smithi077.stdout:3/311: fdatasync d0/d2/de/d48/d15/f66 0 2024-04-25T02:08:48.603 INFO:tasks.workunit.client.0.smithi077.stdout:8/390: dread d3/da/db/df/f10 [0,4194304] 0 2024-04-25T02:08:48.603 INFO:tasks.workunit.client.0.smithi077.stdout:8/391: stat d3/f7 0 2024-04-25T02:08:48.604 INFO:tasks.workunit.client.0.smithi077.stdout:4/352: creat d0/d14/d21/d39/d1d/f73 x:0 0 0 2024-04-25T02:08:48.604 INFO:tasks.workunit.client.0.smithi077.stdout:4/353: chown d0/de/c47 11239739 1 2024-04-25T02:08:48.604 INFO:tasks.workunit.client.0.smithi077.stdout:0/339: symlink d2/d1c/l73 0 2024-04-25T02:08:48.605 INFO:tasks.workunit.client.0.smithi077.stdout:5/373: dwrite d0/d2/d3/f2f [4194304,4194304] 0 2024-04-25T02:08:48.605 INFO:tasks.workunit.client.0.smithi077.stdout:5/374: readlink d0/d2/d20/l7f 0 2024-04-25T02:08:48.606 INFO:tasks.workunit.client.0.smithi077.stdout:2/344: symlink d2/d9/d19/d1c/d3f/l69 0 2024-04-25T02:08:48.607 INFO:tasks.workunit.client.0.smithi077.stdout:7/288: getdents d4 0 2024-04-25T02:08:48.608 INFO:tasks.workunit.client.0.smithi077.stdout:7/289: write d4/d13/d18/d2d/f46 [4377114,24760] 0 2024-04-25T02:08:48.608 INFO:tasks.workunit.client.0.smithi077.stdout:7/290: dread - d4/d13/d18/d24/f57 zero size 2024-04-25T02:08:48.608 INFO:tasks.workunit.client.0.smithi077.stdout:0/340: dread d2/d9/f66 [0,4194304] 0 2024-04-25T02:08:48.610 INFO:tasks.workunit.client.0.smithi077.stdout:2/345: write d2/d9/d19/d1c/d3f/f40 [360912,64140] 0 2024-04-25T02:08:48.611 INFO:tasks.workunit.client.0.smithi077.stdout:3/312: mknod d0/d3e/d42/d64/c6f 0 2024-04-25T02:08:48.612 INFO:tasks.workunit.client.0.smithi077.stdout:9/371: rmdir df/d1b/d48 39 2024-04-25T02:08:48.613 INFO:tasks.workunit.client.0.smithi077.stdout:8/392: dread d3/d34/d3d/f5f [0,4194304] 0 2024-04-25T02:08:48.614 INFO:tasks.workunit.client.0.smithi077.stdout:6/376: creat de/d12/d25/d3a/d6a/f7e x:0 0 0 2024-04-25T02:08:48.614 INFO:tasks.workunit.client.0.smithi077.stdout:4/354: link d0/d14/d21/d39/da/l59 d0/d14/d21/l74 0 2024-04-25T02:08:48.616 INFO:tasks.workunit.client.0.smithi077.stdout:5/375: creat d0/d2/d3/d9/d39/f81 x:0 0 0 2024-04-25T02:08:48.616 INFO:tasks.workunit.client.0.smithi077.stdout:5/376: write d0/d25/f36 [2701270,18692] 0 2024-04-25T02:08:48.618 INFO:tasks.workunit.client.0.smithi077.stdout:7/291: mkdir d4/d13/d18/d24/d6c 0 2024-04-25T02:08:48.618 INFO:tasks.workunit.client.0.smithi077.stdout:1/309: dwrite db/df/d14/d3e/f54 [0,4194304] 0 2024-04-25T02:08:48.619 INFO:tasks.workunit.client.0.smithi077.stdout:0/341: mkdir d2/d9/d71/d74 0 2024-04-25T02:08:48.620 INFO:tasks.workunit.client.0.smithi077.stdout:1/310: dread db/df/d14/d3e/f48 [0,4194304] 0 2024-04-25T02:08:48.620 INFO:tasks.workunit.client.0.smithi077.stdout:2/346: creat d2/d9/f6a x:0 0 0 2024-04-25T02:08:48.621 INFO:tasks.workunit.client.0.smithi077.stdout:3/313: chown d0/d2/d2f/c31 6 1 2024-04-25T02:08:48.623 INFO:tasks.workunit.client.0.smithi077.stdout:9/372: creat df/d1b/d48/d86/f89 x:0 0 0 2024-04-25T02:08:48.623 INFO:tasks.workunit.client.0.smithi077.stdout:9/373: stat df/d1b/d48/c7d 0 2024-04-25T02:08:48.624 INFO:tasks.workunit.client.0.smithi077.stdout:8/393: symlink d3/da/d27/d16/d57/l73 0 2024-04-25T02:08:48.624 INFO:tasks.workunit.client.0.smithi077.stdout:8/394: fdatasync d3/f2a 0 2024-04-25T02:08:48.624 INFO:tasks.workunit.client.0.smithi077.stdout:8/395: stat d3/da/db/df/d30/c68 0 2024-04-25T02:08:48.624 INFO:tasks.workunit.client.0.smithi077.stdout:8/396: readlink d3/da/d27/d16/l1a 0 2024-04-25T02:08:48.625 INFO:tasks.workunit.client.0.smithi077.stdout:9/374: dread df/f18 [0,4194304] 0 2024-04-25T02:08:48.627 INFO:tasks.workunit.client.0.smithi077.stdout:4/355: symlink d0/d14/d60/d62/l75 0 2024-04-25T02:08:48.628 INFO:tasks.workunit.client.0.smithi077.stdout:7/292: rmdir d4/d13/d18/d24/d3f/d58 39 2024-04-25T02:08:48.628 INFO:tasks.workunit.client.0.smithi077.stdout:7/293: fsync d4/d13/d18/d24/f57 0 2024-04-25T02:08:48.629 INFO:tasks.workunit.client.0.smithi077.stdout:7/294: write d4/f12 [3994479,79576] 0 2024-04-25T02:08:48.629 INFO:tasks.workunit.client.0.smithi077.stdout:7/295: fsync d4/d13/d5b/f64 0 2024-04-25T02:08:48.631 INFO:tasks.workunit.client.0.smithi077.stdout:0/342: symlink d2/d1c/l75 0 2024-04-25T02:08:48.631 INFO:tasks.workunit.client.0.smithi077.stdout:1/311: chown db/f18 0 1 2024-04-25T02:08:48.633 INFO:tasks.workunit.client.0.smithi077.stdout:2/347: mknod d2/d9/d18/d1b/c6b 0 2024-04-25T02:08:48.633 INFO:tasks.workunit.client.0.smithi077.stdout:2/348: fdatasync d2/d9/fb 0 2024-04-25T02:08:48.633 INFO:tasks.workunit.client.0.smithi077.stdout:2/349: dread - d2/d9/d19/d1c/d3f/d53/f68 zero size 2024-04-25T02:08:48.633 INFO:tasks.workunit.client.0.smithi077.stdout:2/350: write d2/d9/f6a [346710,126670] 0 2024-04-25T02:08:48.633 INFO:tasks.workunit.client.0.smithi077.stdout:3/314: rename d0 to d0/d2/de/d48/d70 22 2024-04-25T02:08:48.635 INFO:tasks.workunit.client.0.smithi077.stdout:8/397: mkdir d3/da/d27/d44/d74 0 2024-04-25T02:08:48.636 INFO:tasks.workunit.client.0.smithi077.stdout:4/356: creat d0/d14/d21/d39/f76 x:0 0 0 2024-04-25T02:08:48.636 INFO:tasks.workunit.client.0.smithi077.stdout:4/357: creat d0/d14/d60/d62/f77 x:0 0 0 2024-04-25T02:08:48.638 INFO:tasks.workunit.client.0.smithi077.stdout:5/377: mkdir d0/d25/d82 0 2024-04-25T02:08:48.640 INFO:tasks.workunit.client.0.smithi077.stdout:1/312: unlink l6 0 2024-04-25T02:08:48.641 INFO:tasks.workunit.client.0.smithi077.stdout:1/313: fdatasync db/d11/d5c/f5e 0 2024-04-25T02:08:48.646 INFO:tasks.workunit.client.0.smithi077.stdout:2/351: mknod d2/d9/d19/c6c 0 2024-04-25T02:08:48.648 INFO:tasks.workunit.client.0.smithi077.stdout:0/343: dwrite d2/d27/d2d/f2f [0,4194304] 0 2024-04-25T02:08:48.651 INFO:tasks.workunit.client.0.smithi077.stdout:6/377: rename de/d12/d25/d38/l45 to de/d4e/l7f 0 2024-04-25T02:08:48.654 INFO:tasks.workunit.client.0.smithi077.stdout:5/378: mknod d0/d2/d3/d9/d39/c83 0 2024-04-25T02:08:48.655 INFO:tasks.workunit.client.0.smithi077.stdout:1/314: chown db/c51 23303728 1 2024-04-25T02:08:48.657 INFO:tasks.workunit.client.0.smithi077.stdout:2/352: rename d2/d9/d2f/l4e to d2/d9/d2f/l6d 0 2024-04-25T02:08:48.659 INFO:tasks.workunit.client.0.smithi077.stdout:9/375: rename df/d1b/d56/d67/c6d to df/d60/d87/c8a 0 2024-04-25T02:08:48.660 INFO:tasks.workunit.client.0.smithi077.stdout:6/378: symlink de/d3b/l80 0 2024-04-25T02:08:48.661 INFO:tasks.workunit.client.0.smithi077.stdout:3/315: rmdir d0/d2/de/d27 39 2024-04-25T02:08:48.662 INFO:tasks.workunit.client.0.smithi077.stdout:4/358: getdents d0/de/d25 0 2024-04-25T02:08:48.663 INFO:tasks.workunit.client.0.smithi077.stdout:5/379: symlink d0/d2/d20/d41/l84 0 2024-04-25T02:08:48.664 INFO:tasks.workunit.client.0.smithi077.stdout:2/353: getdents d2/d28 0 2024-04-25T02:08:48.666 INFO:tasks.workunit.client.0.smithi077.stdout:8/398: rename d3/da/d27/d16/d57/l63 to d3/da/db/df/d2b/d37/l75 0 2024-04-25T02:08:48.666 INFO:tasks.workunit.client.0.smithi077.stdout:8/399: stat d3/fd 0 2024-04-25T02:08:48.667 INFO:tasks.workunit.client.0.smithi077.stdout:6/379: mknod de/d15/d36/c81 0 2024-04-25T02:08:48.668 INFO:tasks.workunit.client.0.smithi077.stdout:3/316: symlink d0/d3e/d42/d64/l71 0 2024-04-25T02:08:48.670 INFO:tasks.workunit.client.0.smithi077.stdout:4/359: mkdir d0/d14/d60/d78 0 2024-04-25T02:08:48.670 INFO:tasks.workunit.client.0.smithi077.stdout:4/360: write d0/de/d3c/f66 [1754941,65410] 0 2024-04-25T02:08:48.671 INFO:tasks.workunit.client.0.smithi077.stdout:2/354: dread d2/d28/f32 [0,4194304] 0 2024-04-25T02:08:48.671 INFO:tasks.workunit.client.0.smithi077.stdout:5/380: rename d0/f32 to d0/f85 0 2024-04-25T02:08:48.673 INFO:tasks.workunit.client.0.smithi077.stdout:1/315: symlink db/d11/l61 0 2024-04-25T02:08:48.673 INFO:tasks.workunit.client.0.smithi077.stdout:1/316: readlink db/d11/d32/l49 0 2024-04-25T02:08:48.675 INFO:tasks.workunit.client.0.smithi077.stdout:8/400: rename d3/da/db/df/f5d to d3/da/d27/f76 0 2024-04-25T02:08:48.676 INFO:tasks.workunit.client.0.smithi077.stdout:6/380: creat de/d5b/f82 x:0 0 0 2024-04-25T02:08:48.679 INFO:tasks.workunit.client.0.smithi077.stdout:3/317: link d0/d3e/d42/f60 d0/d3e/d42/d64/f72 0 2024-04-25T02:08:48.679 INFO:tasks.workunit.client.0.smithi077.stdout:3/318: write d0/d2/de/d48/d15/f1d [5744365,98190] 0 2024-04-25T02:08:48.680 INFO:tasks.workunit.client.0.smithi077.stdout:4/361: mkdir d0/d14/d79 0 2024-04-25T02:08:48.682 INFO:tasks.workunit.client.0.smithi077.stdout:1/317: unlink db/c53 0 2024-04-25T02:08:48.683 INFO:tasks.workunit.client.0.smithi077.stdout:1/318: write f8 [438512,12842] 0 2024-04-25T02:08:48.683 INFO:tasks.workunit.client.0.smithi077.stdout:2/355: rename d2/d9/d18/d31/f39 to d2/d59/f6e 0 2024-04-25T02:08:48.684 INFO:tasks.workunit.client.0.smithi077.stdout:8/401: mknod d3/da/d27/c77 0 2024-04-25T02:08:48.685 INFO:tasks.workunit.client.0.smithi077.stdout:6/381: truncate de/d12/d25/d44/f5d 967864 0 2024-04-25T02:08:48.686 INFO:tasks.workunit.client.0.smithi077.stdout:3/319: mknod d0/d3e/d42/c73 0 2024-04-25T02:08:48.686 INFO:tasks.workunit.client.0.smithi077.stdout:4/362: symlink d0/d14/d21/d39/da/d12/l7a 0 2024-04-25T02:08:48.687 INFO:tasks.workunit.client.0.smithi077.stdout:1/319: mknod db/df/d14/d33/d34/c62 0 2024-04-25T02:08:48.689 INFO:tasks.workunit.client.0.smithi077.stdout:5/381: rename d0/d2/d3/d1d/f28 to d0/f86 0 2024-04-25T02:08:48.689 INFO:tasks.workunit.client.0.smithi077.stdout:5/382: fdatasync d0/d2/d3/d9/d39/d44/f45 0 2024-04-25T02:08:48.690 INFO:tasks.workunit.client.0.smithi077.stdout:2/356: mknod d2/d9/d56/d5c/c6f 0 2024-04-25T02:08:48.691 INFO:tasks.workunit.client.0.smithi077.stdout:6/382: creat de/d12/d25/f83 x:0 0 0 2024-04-25T02:08:48.692 INFO:tasks.workunit.client.0.smithi077.stdout:4/363: symlink d0/de/d3c/l7b 0 2024-04-25T02:08:48.693 INFO:tasks.workunit.client.0.smithi077.stdout:1/320: mknod db/df/d14/d50/c63 0 2024-04-25T02:08:48.694 INFO:tasks.workunit.client.0.smithi077.stdout:5/383: mkdir d0/d25/d82/d87 0 2024-04-25T02:08:48.694 INFO:tasks.workunit.client.0.smithi077.stdout:5/384: creat d0/d2/d3/d9/d39/d44/d5f/f88 x:0 0 0 2024-04-25T02:08:48.695 INFO:tasks.workunit.client.0.smithi077.stdout:2/357: creat d2/d28/f70 x:0 0 0 2024-04-25T02:08:48.696 INFO:tasks.workunit.client.0.smithi077.stdout:5/385: read d0/d2/d3/d9/d39/d44/f53 [284878,108287] 0 2024-04-25T02:08:48.696 INFO:tasks.workunit.client.0.smithi077.stdout:5/386: fdatasync d0/d2/d20/d23/d4a/f74 0 2024-04-25T02:08:48.696 INFO:tasks.workunit.client.0.smithi077.stdout:2/358: creat d2/d59/f71 x:0 0 0 2024-04-25T02:08:48.697 INFO:tasks.workunit.client.0.smithi077.stdout:6/383: write de/d12/d25/f2d [1106048,59676] 0 2024-04-25T02:08:48.697 INFO:tasks.workunit.client.0.smithi077.stdout:6/384: readlink de/l20 0 2024-04-25T02:08:48.698 INFO:tasks.workunit.client.0.smithi077.stdout:4/364: symlink d0/de/d34/l7c 0 2024-04-25T02:08:48.699 INFO:tasks.workunit.client.0.smithi077.stdout:1/321: rename db/df/d14/d3e/f48 to db/df/d14/d3e/f64 0 2024-04-25T02:08:48.702 INFO:tasks.workunit.client.0.smithi077.stdout:6/385: mknod de/d53/c84 0 2024-04-25T02:08:48.704 INFO:tasks.workunit.client.0.smithi077.stdout:4/365: creat d0/d14/d21/d39/da/d12/d35/d3e/d3a/f7d x:0 0 0 2024-04-25T02:08:48.704 INFO:tasks.workunit.client.0.smithi077.stdout:4/366: chown d0/d14/d21/d39/f4d 4 1 2024-04-25T02:08:48.704 INFO:tasks.workunit.client.0.smithi077.stdout:4/367: chown d0/de/d3c/f5e 1765 1 2024-04-25T02:08:48.707 INFO:tasks.workunit.client.0.smithi077.stdout:4/368: creat d0/de/d25/f7e x:0 0 0 2024-04-25T02:08:48.710 INFO:tasks.workunit.client.0.smithi077.stdout:8/402: dwrite d3/da/db/df/d2b/f3b [0,4194304] 0 2024-04-25T02:08:48.710 INFO:tasks.workunit.client.0.smithi077.stdout:8/403: write d3/da/f35 [143224,65921] 0 2024-04-25T02:08:48.712 INFO:tasks.workunit.client.0.smithi077.stdout:8/404: creat d3/da/f78 x:0 0 0 2024-04-25T02:08:48.718 INFO:tasks.workunit.client.0.smithi077.stdout:8/405: dread d3/fd [0,4194304] 0 2024-04-25T02:08:48.720 INFO:tasks.workunit.client.0.smithi077.stdout:8/406: dread d3/da/f45 [0,4194304] 0 2024-04-25T02:08:48.720 INFO:tasks.workunit.client.0.smithi077.stdout:8/407: dread - d3/da/d27/d16/d6b/f6e zero size 2024-04-25T02:08:48.723 INFO:tasks.workunit.client.0.smithi077.stdout:3/320: dwrite d0/d3e/d42/f5e [0,4194304] 0 2024-04-25T02:08:48.724 INFO:tasks.workunit.client.0.smithi077.stdout:3/321: write d0/d2/f41 [5379851,832] 0 2024-04-25T02:08:48.724 INFO:tasks.workunit.client.0.smithi077.stdout:2/359: dwrite d2/d9/d18/d31/f4b [0,4194304] 0 2024-04-25T02:08:48.724 INFO:tasks.workunit.client.0.smithi077.stdout:6/386: dwrite f7 [4194304,4194304] 0 2024-04-25T02:08:48.731 INFO:tasks.workunit.client.0.smithi077.stdout:6/387: dread de/d53/f61 [0,4194304] 0 2024-04-25T02:08:48.732 INFO:tasks.workunit.client.0.smithi077.stdout:3/322: rename d0/d2/de/d48/l6 to d0/d2/d2f/d5f/l74 0 2024-04-25T02:08:48.736 INFO:tasks.workunit.client.0.smithi077.stdout:2/360: mkdir d2/d9/d19/d2c/d72 0 2024-04-25T02:08:48.738 INFO:tasks.workunit.client.0.smithi077.stdout:6/388: symlink de/d53/d76/l85 0 2024-04-25T02:08:48.738 INFO:tasks.workunit.client.0.smithi077.stdout:2/361: mknod d2/d9/d19/d1c/d3f/c73 0 2024-04-25T02:08:48.740 INFO:tasks.workunit.client.0.smithi077.stdout:2/362: dread d2/d9/df/f50 [0,4194304] 0 2024-04-25T02:08:48.741 INFO:tasks.workunit.client.0.smithi077.stdout:2/363: mknod d2/d9/d19/d1c/d37/c74 0 2024-04-25T02:08:48.742 INFO:tasks.workunit.client.0.smithi077.stdout:2/364: readlink d2/le 0 2024-04-25T02:08:48.746 INFO:tasks.workunit.client.0.smithi077.stdout:1/322: rmdir db/df/d14/d33 39 2024-04-25T02:08:48.747 INFO:tasks.workunit.client.0.smithi077.stdout:3/323: dwrite d0/d2/de/d48/d15/f66 [0,4194304] 0 2024-04-25T02:08:48.753 INFO:tasks.workunit.client.0.smithi077.stdout:6/389: dwrite de/d12/f28 [0,4194304] 0 2024-04-25T02:08:48.753 INFO:tasks.workunit.client.0.smithi077.stdout:6/390: truncate de/d12/d25/d3a/f5f 829944 0 2024-04-25T02:08:48.756 INFO:tasks.workunit.client.0.smithi077.stdout:1/323: dread db/f18 [0,4194304] 0 2024-04-25T02:08:48.756 INFO:tasks.workunit.client.0.smithi077.stdout:1/324: chown db/d11/d32/l52 0 1 2024-04-25T02:08:48.757 INFO:tasks.workunit.client.0.smithi077.stdout:1/325: write db/df/d14/d33/d34/f55 [410772,19232] 0 2024-04-25T02:08:48.758 INFO:tasks.workunit.client.0.smithi077.stdout:7/296: sync 2024-04-25T02:08:48.758 INFO:tasks.workunit.client.0.smithi077.stdout:6/391: dread de/d12/d25/f4a [0,4194304] 0 2024-04-25T02:08:48.758 INFO:tasks.workunit.client.0.smithi077.stdout:6/392: stat de/d15/l2e 0 2024-04-25T02:08:48.758 INFO:tasks.workunit.client.0.smithi077.stdout:1/326: rename db/d11/d42/d43/c4c to db/d26/c65 0 2024-04-25T02:08:48.760 INFO:tasks.workunit.client.0.smithi077.stdout:7/297: link l3 d4/d13/d18/d2d/d56/d68/l6d 0 2024-04-25T02:08:48.761 INFO:tasks.workunit.client.0.smithi077.stdout:6/393: read de/d15/f3f [1982838,97502] 0 2024-04-25T02:08:48.761 INFO:tasks.workunit.client.0.smithi077.stdout:6/394: chown f9 479 1 2024-04-25T02:08:48.762 INFO:tasks.workunit.client.0.smithi077.stdout:6/395: symlink de/d12/d25/d44/l86 0 2024-04-25T02:08:48.764 INFO:tasks.workunit.client.0.smithi077.stdout:7/298: dread d4/f33 [0,4194304] 0 2024-04-25T02:08:48.764 INFO:tasks.workunit.client.0.smithi077.stdout:6/396: dread de/f13 [0,4194304] 0 2024-04-25T02:08:48.764 INFO:tasks.workunit.client.0.smithi077.stdout:2/365: getdents d2/d9/d19/d1c/d3f 0 2024-04-25T02:08:48.766 INFO:tasks.workunit.client.0.smithi077.stdout:7/299: mknod d4/d13/d18/d2d/d56/c6e 0 2024-04-25T02:08:48.766 INFO:tasks.workunit.client.0.smithi077.stdout:7/300: chown d4/d13/f1f 2 1 2024-04-25T02:08:48.766 INFO:tasks.workunit.client.0.smithi077.stdout:6/397: mknod de/c87 0 2024-04-25T02:08:48.767 INFO:tasks.workunit.client.0.smithi077.stdout:6/398: write de/d12/f7a [938543,125827] 0 2024-04-25T02:08:48.768 INFO:tasks.workunit.client.0.smithi077.stdout:2/366: mknod d2/d9/d19/d1c/c75 0 2024-04-25T02:08:48.770 INFO:tasks.workunit.client.0.smithi077.stdout:1/327: read db/df/d14/d3e/f54 [3498845,40228] 0 2024-04-25T02:08:48.770 INFO:tasks.workunit.client.0.smithi077.stdout:9/376: sync 2024-04-25T02:08:48.770 INFO:tasks.workunit.client.0.smithi077.stdout:0/344: sync 2024-04-25T02:08:48.770 INFO:tasks.workunit.client.0.smithi077.stdout:9/377: dread - df/d1b/d56/d67/d68/f7c zero size 2024-04-25T02:08:48.770 INFO:tasks.workunit.client.0.smithi077.stdout:9/378: chown df/d1b/f40 2428 1 2024-04-25T02:08:48.770 INFO:tasks.workunit.client.0.smithi077.stdout:0/345: write d2/d17/d1d/d34/d4c/f72 [8957,49683] 0 2024-04-25T02:08:48.771 INFO:tasks.workunit.client.0.smithi077.stdout:9/379: write df/d1b/d56/f59 [1589575,77767] 0 2024-04-25T02:08:48.771 INFO:tasks.workunit.client.0.smithi077.stdout:3/324: dwrite d0/d2/de/d48/d15/f2a [0,4194304] 0 2024-04-25T02:08:48.772 INFO:tasks.workunit.client.0.smithi077.stdout:1/328: mkdir db/df/d14/d33/d34/d66 0 2024-04-25T02:08:48.774 INFO:tasks.workunit.client.0.smithi077.stdout:3/325: mknod d0/d3e/d42/c75 0 2024-04-25T02:08:48.775 INFO:tasks.workunit.client.0.smithi077.stdout:7/301: getdents d4/d13/d18/d2d/d56 0 2024-04-25T02:08:48.777 INFO:tasks.workunit.client.0.smithi077.stdout:1/329: creat db/df/d14/f67 x:0 0 0 2024-04-25T02:08:48.777 INFO:tasks.workunit.client.0.smithi077.stdout:1/330: write db/df/d14/f67 [128416,85403] 0 2024-04-25T02:08:48.777 INFO:tasks.workunit.client.0.smithi077.stdout:1/331: chown db/df/d14/d33/d34/f36 0 1 2024-04-25T02:08:48.777 INFO:tasks.workunit.client.0.smithi077.stdout:1/332: fsync db/d11/d32/f3f 0 2024-04-25T02:08:48.777 INFO:tasks.workunit.client.0.smithi077.stdout:1/333: chown db/df/d14/d50/c63 331 1 2024-04-25T02:08:48.780 INFO:tasks.workunit.client.0.smithi077.stdout:7/302: link d4/d13/c60 d4/d13/d18/d2d/c6f 0 2024-04-25T02:08:48.780 INFO:tasks.workunit.client.0.smithi077.stdout:7/303: fsync d4/d13/d2c/f2e 0 2024-04-25T02:08:48.783 INFO:tasks.workunit.client.0.smithi077.stdout:7/304: rename d4/c7 to d4/d13/d18/d2d/c70 0 2024-04-25T02:08:48.785 INFO:tasks.workunit.client.0.smithi077.stdout:1/334: getdents db/df/d14/d3e 0 2024-04-25T02:08:48.785 INFO:tasks.workunit.client.0.smithi077.stdout:1/335: dread - db/d11/d5c/f5e zero size 2024-04-25T02:08:48.789 INFO:tasks.workunit.client.0.smithi077.stdout:3/326: write d0/d17/f37 [2414229,72489] 0 2024-04-25T02:08:48.789 INFO:tasks.workunit.client.0.smithi077.stdout:3/327: fdatasync d0/f6c 0 2024-04-25T02:08:48.804 INFO:tasks.workunit.client.0.smithi077.stdout:6/399: dwrite de/d12/f71 [0,4194304] 0 2024-04-25T02:08:48.808 INFO:tasks.workunit.client.0.smithi077.stdout:6/400: mkdir de/d55/d88 0 2024-04-25T02:08:48.811 INFO:tasks.workunit.client.0.smithi077.stdout:6/401: write de/d53/f61 [324810,76762] 0 2024-04-25T02:08:48.814 INFO:tasks.workunit.client.0.smithi077.stdout:0/346: dwrite d2/d1c/f4f [0,4194304] 0 2024-04-25T02:08:48.814 INFO:tasks.workunit.client.0.smithi077.stdout:2/367: dwrite d2/d9/d19/f1a [0,4194304] 0 2024-04-25T02:08:48.814 INFO:tasks.workunit.client.0.smithi077.stdout:2/368: dread - d2/d59/f71 zero size 2024-04-25T02:08:48.816 INFO:tasks.workunit.client.0.smithi077.stdout:0/347: creat d2/d8/d10/d51/f76 x:0 0 0 2024-04-25T02:08:48.816 INFO:tasks.workunit.client.0.smithi077.stdout:0/348: truncate d2/d1c/f24 433740 0 2024-04-25T02:08:48.816 INFO:tasks.workunit.client.0.smithi077.stdout:0/349: write d2/d17/f69 [995688,22726] 0 2024-04-25T02:08:48.817 INFO:tasks.workunit.client.0.smithi077.stdout:0/350: rename d2/d8/fe to d2/d27/d2d/f77 0 2024-04-25T02:08:48.817 INFO:tasks.workunit.client.0.smithi077.stdout:0/351: stat d2/l31 0 2024-04-25T02:08:48.818 INFO:tasks.workunit.client.0.smithi077.stdout:0/352: symlink d2/d27/l78 0 2024-04-25T02:08:48.818 INFO:tasks.workunit.client.0.smithi077.stdout:0/353: dread - d2/d17/d1d/f53 zero size 2024-04-25T02:08:48.819 INFO:tasks.workunit.client.0.smithi077.stdout:0/354: symlink d2/l79 0 2024-04-25T02:08:48.820 INFO:tasks.workunit.client.0.smithi077.stdout:0/355: link d2/d1c/l73 d2/d1c/l7a 0 2024-04-25T02:08:48.821 INFO:tasks.workunit.client.0.smithi077.stdout:0/356: link d2/d8/l2c d2/d9/d71/l7b 0 2024-04-25T02:08:48.821 INFO:tasks.workunit.client.0.smithi077.stdout:0/357: write d2/d8/f26 [134126,103382] 0 2024-04-25T02:08:48.821 INFO:tasks.workunit.client.0.smithi077.stdout:0/358: fdatasync d2/d9/f65 0 2024-04-25T02:08:48.821 INFO:tasks.workunit.client.0.smithi077.stdout:9/380: dwrite df/d1b/d48/f6f [0,4194304] 0 2024-04-25T02:08:48.821 INFO:tasks.workunit.client.0.smithi077.stdout:9/381: read df/f14 [477329,12112] 0 2024-04-25T02:08:48.822 INFO:tasks.workunit.client.0.smithi077.stdout:1/336: dwrite db/d11/f30 [4194304,4194304] 0 2024-04-25T02:08:48.824 INFO:tasks.workunit.client.0.smithi077.stdout:6/402: truncate de/d12/f71 3280055 0 2024-04-25T02:08:48.825 INFO:tasks.workunit.client.0.smithi077.stdout:6/403: fdatasync de/d12/f17 0 2024-04-25T02:08:48.825 INFO:tasks.workunit.client.0.smithi077.stdout:0/359: mknod d2/d17/d1d/d34/d4c/c7c 0 2024-04-25T02:08:48.826 INFO:tasks.workunit.client.0.smithi077.stdout:9/382: dread df/d1b/f30 [0,4194304] 0 2024-04-25T02:08:48.827 INFO:tasks.workunit.client.0.smithi077.stdout:2/369: dread d2/d9/d18/d31/f4b [0,4194304] 0 2024-04-25T02:08:48.827 INFO:tasks.workunit.client.0.smithi077.stdout:3/328: dwrite d0/d2/d2f/f32 [0,4194304] 0 2024-04-25T02:08:48.827 INFO:tasks.workunit.client.0.smithi077.stdout:7/305: dwrite d4/d13/d5b/f64 [0,4194304] 0 2024-04-25T02:08:48.828 INFO:tasks.workunit.client.0.smithi077.stdout:1/337: symlink db/df/d1b/l68 0 2024-04-25T02:08:48.828 INFO:tasks.workunit.client.0.smithi077.stdout:1/338: write db/df/d14/d33/f38 [4935721,79709] 0 2024-04-25T02:08:48.829 INFO:tasks.workunit.client.0.smithi077.stdout:6/404: mknod de/d12/d25/d44/c89 0 2024-04-25T02:08:48.830 INFO:tasks.workunit.client.0.smithi077.stdout:0/360: link d2/f6 d2/d9/d2a/f7d 0 2024-04-25T02:08:48.836 INFO:tasks.workunit.client.0.smithi077.stdout:2/370: link d2/d9/d19/d1c/d3f/c73 d2/d9/d18/c76 0 2024-04-25T02:08:48.837 INFO:tasks.workunit.client.0.smithi077.stdout:3/329: mknod d0/d2/d2f/d5f/c76 0 2024-04-25T02:08:48.840 INFO:tasks.workunit.client.0.smithi077.stdout:3/330: dread d0/d2/de/d48/f44 [0,4194304] 0 2024-04-25T02:08:48.849 INFO:tasks.workunit.client.0.smithi077.stdout:7/306: creat d4/d13/d18/f71 x:0 0 0 2024-04-25T02:08:48.849 INFO:tasks.workunit.client.0.smithi077.stdout:7/307: stat d4/d13/c5a 0 2024-04-25T02:08:48.849 INFO:tasks.workunit.client.0.smithi077.stdout:7/308: truncate d4/d13/d18/f71 695907 0 2024-04-25T02:08:48.850 INFO:tasks.workunit.client.0.smithi077.stdout:0/361: truncate d2/d9/d2a/f58 918684 0 2024-04-25T02:08:48.850 INFO:tasks.workunit.client.0.smithi077.stdout:0/362: truncate d2/d8/d5f/f6c 193127 0 2024-04-25T02:08:48.851 INFO:tasks.workunit.client.0.smithi077.stdout:9/383: getdents df/d1b/d56/d67/d68 0 2024-04-25T02:08:48.851 INFO:tasks.workunit.client.0.smithi077.stdout:9/384: fsync f5 0 2024-04-25T02:08:48.851 INFO:tasks.workunit.client.0.smithi077.stdout:6/405: dwrite de/d5b/f82 [0,4194304] 0 2024-04-25T02:08:48.851 INFO:tasks.workunit.client.0.smithi077.stdout:6/406: creat de/d12/f8a x:0 0 0 2024-04-25T02:08:48.851 INFO:tasks.workunit.client.0.smithi077.stdout:6/407: chown de/d12/d25/d3a/l49 38471 1 2024-04-25T02:08:48.855 INFO:tasks.workunit.client.0.smithi077.stdout:1/339: dwrite db/df/d14/f67 [0,4194304] 0 2024-04-25T02:08:48.855 INFO:tasks.workunit.client.0.smithi077.stdout:1/340: stat db/d11/d32/c4f 0 2024-04-25T02:08:48.857 INFO:tasks.workunit.client.0.smithi077.stdout:9/385: mknod df/d1b/d48/d75/c8b 0 2024-04-25T02:08:48.859 INFO:tasks.workunit.client.0.smithi077.stdout:7/309: dread d4/fb [0,4194304] 0 2024-04-25T02:08:48.859 INFO:tasks.workunit.client.0.smithi077.stdout:7/310: getdents d4/d13/d18/d2d/d56 0 2024-04-25T02:08:48.859 INFO:tasks.workunit.client.0.smithi077.stdout:2/371: rmdir d2/d9/d19/d1c/d3f/d53 39 2024-04-25T02:08:48.862 INFO:tasks.workunit.client.0.smithi077.stdout:6/408: read f5 [3179546,50431] 0 2024-04-25T02:08:48.863 INFO:tasks.workunit.client.0.smithi077.stdout:6/409: chown de/d15/d36/l4f 82 1 2024-04-25T02:08:48.864 INFO:tasks.workunit.client.0.smithi077.stdout:1/341: mkdir db/df/d14/d3e/d69 0 2024-04-25T02:08:48.864 INFO:tasks.workunit.client.0.smithi077.stdout:1/342: creat db/d11/d5c/f6a x:0 0 0 2024-04-25T02:08:48.865 INFO:tasks.workunit.client.0.smithi077.stdout:0/363: dwrite d2/d17/d1d/f3d [4194304,4194304] 0 2024-04-25T02:08:48.865 INFO:tasks.workunit.client.0.smithi077.stdout:0/364: read d2/d9/d2a/f7d [571429,80349] 0 2024-04-25T02:08:48.865 INFO:tasks.workunit.client.0.smithi077.stdout:0/365: fsync d2/d8/d10/d51/f76 0 2024-04-25T02:08:48.865 INFO:tasks.workunit.client.0.smithi077.stdout:0/366: chown d2/d17/d4e/l6b 293392 1 2024-04-25T02:08:48.866 INFO:tasks.workunit.client.0.smithi077.stdout:7/311: mkdir d4/d13/d18/d24/d3f/d72 0 2024-04-25T02:08:48.866 INFO:tasks.workunit.client.0.smithi077.stdout:7/312: chown d4/d13/d5b/f64 10561 1 2024-04-25T02:08:48.866 INFO:tasks.workunit.client.0.smithi077.stdout:8/408: sync 2024-04-25T02:08:48.867 INFO:tasks.workunit.client.0.smithi077.stdout:5/387: sync 2024-04-25T02:08:48.867 INFO:tasks.workunit.client.0.smithi077.stdout:4/369: sync 2024-04-25T02:08:48.867 INFO:tasks.workunit.client.0.smithi077.stdout:4/370: creat d0/de/d25/f7f x:0 0 0 2024-04-25T02:08:48.869 INFO:tasks.workunit.client.0.smithi077.stdout:2/372: dread d2/d9/d19/f3b [0,4194304] 0 2024-04-25T02:08:48.871 INFO:tasks.workunit.client.0.smithi077.stdout:1/343: mknod db/df/d1b/c6b 0 2024-04-25T02:08:48.871 INFO:tasks.workunit.client.0.smithi077.stdout:1/344: write f1 [145159,124936] 0 2024-04-25T02:08:48.873 INFO:tasks.workunit.client.0.smithi077.stdout:9/386: dwrite df/d1b/d48/f6f [0,4194304] 0 2024-04-25T02:08:48.873 INFO:tasks.workunit.client.0.smithi077.stdout:9/387: creat df/d1b/d48/d86/f8c x:0 0 0 2024-04-25T02:08:48.874 INFO:tasks.workunit.client.0.smithi077.stdout:7/313: creat d4/d13/d66/f73 x:0 0 0 2024-04-25T02:08:48.875 INFO:tasks.workunit.client.0.smithi077.stdout:5/388: mknod d0/c89 0 2024-04-25T02:08:48.875 INFO:tasks.workunit.client.0.smithi077.stdout:5/389: creat d0/d2/d1b/f8a x:0 0 0 2024-04-25T02:08:48.875 INFO:tasks.workunit.client.0.smithi077.stdout:5/390: dread - d0/f50 zero size 2024-04-25T02:08:48.876 INFO:tasks.workunit.client.0.smithi077.stdout:8/409: link d3/da/d27/f47 d3/da/db/df/d2b/f79 0 2024-04-25T02:08:48.876 INFO:tasks.workunit.client.0.smithi077.stdout:8/410: chown d3/da/db/df/d30/c68 1006 1 2024-04-25T02:08:48.876 INFO:tasks.workunit.client.0.smithi077.stdout:6/410: dread de/d12/f2a [0,4194304] 0 2024-04-25T02:08:48.877 INFO:tasks.workunit.client.0.smithi077.stdout:0/367: write d2/d27/d2d/f2f [714934,9416] 0 2024-04-25T02:08:48.878 INFO:tasks.workunit.client.0.smithi077.stdout:4/371: rename d0/de/d25/c37 to d0/de/d25/c80 0 2024-04-25T02:08:48.879 INFO:tasks.workunit.client.0.smithi077.stdout:4/372: dread - d0/de/d25/f7f zero size 2024-04-25T02:08:48.880 INFO:tasks.workunit.client.0.smithi077.stdout:2/373: rename d2/d9/d19/d1c/d37/d4c to d2/d77 0 2024-04-25T02:08:48.884 INFO:tasks.workunit.client.0.smithi077.stdout:1/345: mkdir db/df/d14/d33/d6c 0 2024-04-25T02:08:48.889 INFO:tasks.workunit.client.0.smithi077.stdout:7/314: creat d4/d13/d18/d24/d3f/d58/f74 x:0 0 0 2024-04-25T02:08:48.889 INFO:tasks.workunit.client.0.smithi077.stdout:7/315: write d4/d13/d18/d2d/d30/f63 [704137,74604] 0 2024-04-25T02:08:48.889 INFO:tasks.workunit.client.0.smithi077.stdout:7/316: truncate d4/d13/d18/d2d/d30/f63 1433517 0 2024-04-25T02:08:48.891 INFO:tasks.workunit.client.0.smithi077.stdout:5/391: stat d0/d2/d20/l7f 0 2024-04-25T02:08:48.895 INFO:tasks.workunit.client.0.smithi077.stdout:6/411: fsync de/d12/d25/f31 0 2024-04-25T02:08:48.895 INFO:tasks.workunit.client.0.smithi077.stdout:6/412: truncate de/f2c 1133666 0 2024-04-25T02:08:48.895 INFO:tasks.workunit.client.0.smithi077.stdout:6/413: write de/d53/f61 [4684751,48095] 0 2024-04-25T02:08:48.896 INFO:tasks.workunit.client.0.smithi077.stdout:4/373: creat d0/d14/f81 x:0 0 0 2024-04-25T02:08:48.897 INFO:tasks.workunit.client.0.smithi077.stdout:1/346: fdatasync db/f3b 0 2024-04-25T02:08:48.900 INFO:tasks.workunit.client.0.smithi077.stdout:7/317: creat d4/d13/d18/d2d/f75 x:0 0 0 2024-04-25T02:08:48.900 INFO:tasks.workunit.client.0.smithi077.stdout:7/318: dread - d4/d13/d18/f36 zero size 2024-04-25T02:08:48.906 INFO:tasks.workunit.client.0.smithi077.stdout:4/374: creat d0/d14/d21/d39/d64/f82 x:0 0 0 2024-04-25T02:08:48.906 INFO:tasks.workunit.client.0.smithi077.stdout:4/375: stat d0/de 0 2024-04-25T02:08:48.908 INFO:tasks.workunit.client.0.smithi077.stdout:7/319: rmdir d4/d13 39 2024-04-25T02:08:48.908 INFO:tasks.workunit.client.0.smithi077.stdout:7/320: write d4/d13/d18/d2d/d30/f65 [427700,92063] 0 2024-04-25T02:08:48.908 INFO:tasks.workunit.client.0.smithi077.stdout:7/321: write d4/d13/d18/d24/d3f/d59/f5f [961970,128780] 0 2024-04-25T02:08:48.908 INFO:tasks.workunit.client.0.smithi077.stdout:7/322: chown d4/d13/d66/f73 0 1 2024-04-25T02:08:48.908 INFO:tasks.workunit.client.0.smithi077.stdout:6/414: dread de/d12/d25/f29 [0,4194304] 0 2024-04-25T02:08:48.909 INFO:tasks.workunit.client.0.smithi077.stdout:7/323: mknod d4/d13/d18/c76 0 2024-04-25T02:08:48.911 INFO:tasks.workunit.client.0.smithi077.stdout:5/392: rename d0/d2/d5 to d0/d25/d82/d87/d8b 0 2024-04-25T02:08:48.911 INFO:tasks.workunit.client.0.smithi077.stdout:5/393: write d0/d2/d1b/f54 [4954889,52202] 0 2024-04-25T02:08:48.911 INFO:tasks.workunit.client.0.smithi077.stdout:5/394: truncate d0/d2/f79 1039873 0 2024-04-25T02:08:48.911 INFO:tasks.workunit.client.0.smithi077.stdout:6/415: getdents de/d12/d25/d38 0 2024-04-25T02:08:48.912 INFO:tasks.workunit.client.0.smithi077.stdout:6/416: dread - de/d12/d25/d4b/f79 zero size 2024-04-25T02:08:48.912 INFO:tasks.workunit.client.0.smithi077.stdout:5/395: creat d0/d25/f8c x:0 0 0 2024-04-25T02:08:48.912 INFO:tasks.workunit.client.0.smithi077.stdout:6/417: dread de/f2c [0,4194304] 0 2024-04-25T02:08:48.915 INFO:tasks.workunit.client.0.smithi077.stdout:6/418: dread de/d12/d25/d44/f5d [0,4194304] 0 2024-04-25T02:08:48.915 INFO:tasks.workunit.client.0.smithi077.stdout:6/419: readlink de/l10 0 2024-04-25T02:08:48.915 INFO:tasks.workunit.client.0.smithi077.stdout:6/420: write f0 [2795587,114812] 0 2024-04-25T02:08:48.915 INFO:tasks.workunit.client.0.smithi077.stdout:6/421: readlink de/d12/d25/d60/l6e 0 2024-04-25T02:08:48.915 INFO:tasks.workunit.client.0.smithi077.stdout:6/422: chown f5 4794108 1 2024-04-25T02:08:48.916 INFO:tasks.workunit.client.0.smithi077.stdout:9/388: dwrite df/d1b/d48/f64 [0,4194304] 0 2024-04-25T02:08:48.916 INFO:tasks.workunit.client.0.smithi077.stdout:9/389: truncate df/f31 733296 0 2024-04-25T02:08:48.916 INFO:tasks.workunit.client.0.smithi077.stdout:9/390: write df/d1b/f46 [656402,9202] 0 2024-04-25T02:08:48.916 INFO:tasks.workunit.client.0.smithi077.stdout:5/396: rmdir d0/d2/d3/d9 39 2024-04-25T02:08:48.917 INFO:tasks.workunit.client.0.smithi077.stdout:6/423: creat de/d55/d88/f8b x:0 0 0 2024-04-25T02:08:48.919 INFO:tasks.workunit.client.0.smithi077.stdout:9/391: creat df/d1b/d48/d75/f8d x:0 0 0 2024-04-25T02:08:48.919 INFO:tasks.workunit.client.0.smithi077.stdout:9/392: readlink df/l6a 0 2024-04-25T02:08:48.920 INFO:tasks.workunit.client.0.smithi077.stdout:5/397: mkdir d0/d25/d82/d8d 0 2024-04-25T02:08:48.925 INFO:tasks.workunit.client.0.smithi077.stdout:4/376: dwrite d0/d14/d21/d39/da/f2d [0,4194304] 0 2024-04-25T02:08:48.927 INFO:tasks.workunit.client.0.smithi077.stdout:4/377: mknod d0/d14/d21/d39/d64/c83 0 2024-04-25T02:08:48.927 INFO:tasks.workunit.client.0.smithi077.stdout:4/378: dread - d0/d14/d60/f69 zero size 2024-04-25T02:08:48.927 INFO:tasks.workunit.client.0.smithi077.stdout:7/324: write d4/fe [244760,32944] 0 2024-04-25T02:08:48.931 INFO:tasks.workunit.client.0.smithi077.stdout:7/325: mknod d4/d13/d18/d24/d3f/d58/c77 0 2024-04-25T02:08:48.933 INFO:tasks.workunit.client.0.smithi077.stdout:7/326: symlink d4/d13/d66/l78 0 2024-04-25T02:08:48.934 INFO:tasks.workunit.client.0.smithi077.stdout:7/327: mkdir d4/d13/d66/d79 0 2024-04-25T02:08:48.934 INFO:tasks.workunit.client.0.smithi077.stdout:7/328: readlink d4/d13/d2c/l3e 0 2024-04-25T02:08:48.936 INFO:tasks.workunit.client.0.smithi077.stdout:0/368: dwrite d2/d17/d1d/d34/d4c/f72 [0,4194304] 0 2024-04-25T02:08:48.939 INFO:tasks.workunit.client.0.smithi077.stdout:8/411: dwrite d3/da/db/df/d2b/f72 [0,4194304] 0 2024-04-25T02:08:48.939 INFO:tasks.workunit.client.0.smithi077.stdout:9/393: dread df/d1b/f20 [0,4194304] 0 2024-04-25T02:08:48.941 INFO:tasks.workunit.client.0.smithi077.stdout:4/379: read d0/de/d3c/f5c [3506186,100060] 0 2024-04-25T02:08:48.944 INFO:tasks.workunit.client.0.smithi077.stdout:0/369: dread d2/d17/d1d/d34/d4c/f72 [0,4194304] 0 2024-04-25T02:08:48.944 INFO:tasks.workunit.client.0.smithi077.stdout:1/347: dwrite db/f18 [0,4194304] 0 2024-04-25T02:08:48.944 INFO:tasks.workunit.client.0.smithi077.stdout:1/348: stat db/d11/d32/l52 0 2024-04-25T02:08:48.966 INFO:tasks.workunit.client.0.smithi077.stdout:0/370: dwrite d2/d8/f26 [0,4194304] 0 2024-04-25T02:08:49.031 INFO:tasks.workunit.client.0.smithi077.stdout:8/412: mkdir d3/d7a 0 2024-04-25T02:08:49.031 INFO:tasks.workunit.client.0.smithi077.stdout:8/413: write d3/f2a [500044,45163] 0 2024-04-25T02:08:49.031 INFO:tasks.workunit.client.0.smithi077.stdout:8/414: stat d3/da 0 2024-04-25T02:08:49.032 INFO:tasks.workunit.client.0.smithi077.stdout:2/374: dwrite f1 [0,4194304] 0 2024-04-25T02:08:49.033 INFO:tasks.workunit.client.0.smithi077.stdout:6/424: dwrite de/d12/f17 [4194304,4194304] 0 2024-04-25T02:08:49.034 INFO:tasks.workunit.client.0.smithi077.stdout:5/398: dwrite d0/d2/d3/d9/d39/d44/d5f/f73 [0,4194304] 0 2024-04-25T02:08:49.034 INFO:tasks.workunit.client.0.smithi077.stdout:5/399: stat d0/d2/d3/d9/d39/d44/d5f/f88 0 2024-04-25T02:08:49.034 INFO:tasks.workunit.client.0.smithi077.stdout:5/400: chown d0/d2/d3/d9/d39/d44/c5b 19537 1 2024-04-25T02:08:49.035 INFO:tasks.workunit.client.0.smithi077.stdout:4/380: link d0/d14/d21/l6e d0/d14/d21/d39/da/d12/l84 0 2024-04-25T02:08:49.035 INFO:tasks.workunit.client.0.smithi077.stdout:1/349: truncate db/d11/f30 1520159 0 2024-04-25T02:08:49.036 INFO:tasks.workunit.client.0.smithi077.stdout:1/350: fdatasync db/df/d14/d33/f38 0 2024-04-25T02:08:49.039 INFO:tasks.workunit.client.0.smithi077.stdout:0/371: truncate d2/d8/d5f/f6c 13543 0 2024-04-25T02:08:49.039 INFO:tasks.workunit.client.0.smithi077.stdout:0/372: chown d2/d8/d5f 528 1 2024-04-25T02:08:49.040 INFO:tasks.workunit.client.0.smithi077.stdout:2/375: read f1 [709556,32603] 0 2024-04-25T02:08:49.041 INFO:tasks.workunit.client.0.smithi077.stdout:8/415: mkdir d3/da/db/df/d2b/d7b 0 2024-04-25T02:08:49.041 INFO:tasks.workunit.client.0.smithi077.stdout:8/416: stat d3/da/d27/d16/d57/f6d 0 2024-04-25T02:08:49.048 INFO:tasks.workunit.client.0.smithi077.stdout:9/394: dwrite f5 [0,4194304] 0 2024-04-25T02:08:49.048 INFO:tasks.workunit.client.0.smithi077.stdout:9/395: chown df/l3f 75 1 2024-04-25T02:08:49.048 INFO:tasks.workunit.client.0.smithi077.stdout:9/396: stat df/d1b/d48/d75 0 2024-04-25T02:08:49.050 INFO:tasks.workunit.client.0.smithi077.stdout:7/329: dwrite d4/d13/f1f [0,4194304] 0 2024-04-25T02:08:49.050 INFO:tasks.workunit.client.0.smithi077.stdout:7/330: read - d4/f51 zero size 2024-04-25T02:08:49.050 INFO:tasks.workunit.client.0.smithi077.stdout:7/331: creat d4/d13/d18/d24/d3f/d58/f7a x:0 0 0 2024-04-25T02:08:49.060 INFO:tasks.workunit.client.0.smithi077.stdout:6/425: symlink de/l8c 0 2024-04-25T02:08:49.064 INFO:tasks.workunit.client.0.smithi077.stdout:4/381: creat d0/d14/d21/d39/da/f85 x:0 0 0 2024-04-25T02:08:49.064 INFO:tasks.workunit.client.0.smithi077.stdout:4/382: fsync d0/de/f44 0 2024-04-25T02:08:49.066 INFO:tasks.workunit.client.0.smithi077.stdout:1/351: link db/d11/d32/c4f db/df/d56/d5d/c6d 0 2024-04-25T02:08:49.067 INFO:tasks.workunit.client.0.smithi077.stdout:0/373: getdents d2/d17/d1d/d34 0 2024-04-25T02:08:49.068 INFO:tasks.workunit.client.0.smithi077.stdout:8/417: symlink d3/da/d27/l7c 0 2024-04-25T02:08:49.070 INFO:tasks.workunit.client.0.smithi077.stdout:7/332: symlink d4/d13/d18/d2d/d30/l7b 0 2024-04-25T02:08:49.070 INFO:tasks.workunit.client.0.smithi077.stdout:7/333: dread - d4/d13/d18/d24/f57 zero size 2024-04-25T02:08:49.073 INFO:tasks.workunit.client.0.smithi077.stdout:0/374: creat d2/d1c/f7e x:0 0 0 2024-04-25T02:08:49.073 INFO:tasks.workunit.client.0.smithi077.stdout:0/375: write d2/d8/d10/d51/f59 [477929,123720] 0 2024-04-25T02:08:49.073 INFO:tasks.workunit.client.0.smithi077.stdout:0/376: write d2/d27/d2d/f77 [2621252,43993] 0 2024-04-25T02:08:49.073 INFO:tasks.workunit.client.0.smithi077.stdout:8/418: mknod d3/da/db/df/d2b/c7d 0 2024-04-25T02:08:49.074 INFO:tasks.workunit.client.0.smithi077.stdout:4/383: write d0/d14/d21/f26 [51118,112717] 0 2024-04-25T02:08:49.074 INFO:tasks.workunit.client.0.smithi077.stdout:0/377: symlink d2/d8/d10/l7f 0 2024-04-25T02:08:49.076 INFO:tasks.workunit.client.0.smithi077.stdout:6/426: dread de/d12/f17 [4194304,4194304] 0 2024-04-25T02:08:49.076 INFO:tasks.workunit.client.0.smithi077.stdout:8/419: mkdir d3/d7a/d7e 0 2024-04-25T02:08:49.077 INFO:tasks.workunit.client.0.smithi077.stdout:5/401: dwrite d0/d2/d3/d9/d39/f81 [0,4194304] 0 2024-04-25T02:08:49.077 INFO:tasks.workunit.client.0.smithi077.stdout:5/402: stat d0/d2/d3/d9/d39/d44/d5f 0 2024-04-25T02:08:49.077 INFO:tasks.workunit.client.0.smithi077.stdout:5/403: readlink d0/d2/d20/l7f 0 2024-04-25T02:08:49.078 INFO:tasks.workunit.client.0.smithi077.stdout:5/404: dread - d0/d2/d20/d23/f67 zero size 2024-04-25T02:08:49.078 INFO:tasks.workunit.client.0.smithi077.stdout:1/352: write db/d11/f30 [1077594,48271] 0 2024-04-25T02:08:49.078 INFO:tasks.workunit.client.0.smithi077.stdout:1/353: fsync db/d11/f39 0 2024-04-25T02:08:49.078 INFO:tasks.workunit.client.0.smithi077.stdout:9/397: dwrite df/f26 [0,4194304] 0 2024-04-25T02:08:49.078 INFO:tasks.workunit.client.0.smithi077.stdout:9/398: chown df/f71 7477145 1 2024-04-25T02:08:49.078 INFO:tasks.workunit.client.0.smithi077.stdout:2/376: dwrite d2/d9/d19/d2c/f36 [0,4194304] 0 2024-04-25T02:08:49.081 INFO:tasks.workunit.client.0.smithi077.stdout:0/378: mknod d2/d17/d1d/c80 0 2024-04-25T02:08:49.081 INFO:tasks.workunit.client.0.smithi077.stdout:0/379: creat d2/d17/d1d/d34/d4c/f81 x:0 0 0 2024-04-25T02:08:49.082 INFO:tasks.workunit.client.0.smithi077.stdout:7/334: dread d4/d13/d18/d2d/d30/f63 [0,4194304] 0 2024-04-25T02:08:49.082 INFO:tasks.workunit.client.0.smithi077.stdout:7/335: stat d4 0 2024-04-25T02:08:49.082 INFO:tasks.workunit.client.0.smithi077.stdout:0/380: write d2/d8/d10/f6f [332298,110102] 0 2024-04-25T02:08:49.082 INFO:tasks.workunit.client.0.smithi077.stdout:0/381: write d2/d9/d2a/f58 [1725477,32642] 0 2024-04-25T02:08:49.082 INFO:tasks.workunit.client.0.smithi077.stdout:0/382: write d2/d8/d10/d51/f6a [1437329,111949] 0 2024-04-25T02:08:49.082 INFO:tasks.workunit.client.0.smithi077.stdout:6/427: symlink de/d53/d6f/l8d 0 2024-04-25T02:08:49.085 INFO:tasks.workunit.client.0.smithi077.stdout:5/405: creat d0/d25/d82/d87/d8b/f8e x:0 0 0 2024-04-25T02:08:49.086 INFO:tasks.workunit.client.0.smithi077.stdout:1/354: mknod db/df/d1b/c6e 0 2024-04-25T02:08:49.088 INFO:tasks.workunit.client.0.smithi077.stdout:8/420: dread d3/f7 [0,4194304] 0 2024-04-25T02:08:49.092 INFO:tasks.workunit.client.0.smithi077.stdout:9/399: creat df/d1b/d56/d67/f8e x:0 0 0 2024-04-25T02:08:49.093 INFO:tasks.workunit.client.0.smithi077.stdout:9/400: chown df/d1b/c53 35760397 1 2024-04-25T02:08:49.093 INFO:tasks.workunit.client.0.smithi077.stdout:9/401: fdatasync df/f62 0 2024-04-25T02:08:49.093 INFO:tasks.workunit.client.0.smithi077.stdout:9/402: stat df/d1b/f5d 0 2024-04-25T02:08:49.093 INFO:tasks.workunit.client.0.smithi077.stdout:8/421: write d3/da/db/df/d2b/f79 [361841,68873] 0 2024-04-25T02:08:49.093 INFO:tasks.workunit.client.0.smithi077.stdout:8/422: write d3/da/d27/f1e [968006,58834] 0 2024-04-25T02:08:49.097 INFO:tasks.workunit.client.0.smithi077.stdout:2/377: truncate d2/d9/d19/d1c/f44 3434260 0 2024-04-25T02:08:49.098 INFO:tasks.workunit.client.0.smithi077.stdout:4/384: rename d0/de to d0/d14/d60/d86 0 2024-04-25T02:08:49.100 INFO:tasks.workunit.client.0.smithi077.stdout:7/336: mkdir d4/d7c 0 2024-04-25T02:08:49.103 INFO:tasks.workunit.client.0.smithi077.stdout:8/423: rmdir d3/da/d27/d44/d74 0 2024-04-25T02:08:49.103 INFO:tasks.workunit.client.0.smithi077.stdout:8/424: write d3/da/f35 [933888,61282] 0 2024-04-25T02:08:49.104 INFO:tasks.workunit.client.0.smithi077.stdout:3/331: sync 2024-04-25T02:08:49.104 INFO:tasks.workunit.client.0.smithi077.stdout:2/378: rename d2/d77 to d2/d78 0 2024-04-25T02:08:49.105 INFO:tasks.workunit.client.0.smithi077.stdout:9/403: rename df/c3b to df/d1b/d70/c8f 0 2024-04-25T02:08:49.106 INFO:tasks.workunit.client.0.smithi077.stdout:9/404: chown df/l6a 5 1 2024-04-25T02:08:49.106 INFO:tasks.workunit.client.0.smithi077.stdout:2/379: dread d2/d59/f6e [0,4194304] 0 2024-04-25T02:08:49.106 INFO:tasks.workunit.client.0.smithi077.stdout:4/385: creat d0/d14/d21/f87 x:0 0 0 2024-04-25T02:08:49.107 INFO:tasks.workunit.client.0.smithi077.stdout:2/380: dread d2/d59/f6e [0,4194304] 0 2024-04-25T02:08:49.107 INFO:tasks.workunit.client.0.smithi077.stdout:2/381: readlink d2/d59/l61 0 2024-04-25T02:08:49.108 INFO:tasks.workunit.client.0.smithi077.stdout:7/337: mknod d4/d13/d5b/c7d 0 2024-04-25T02:08:49.109 INFO:tasks.workunit.client.0.smithi077.stdout:5/406: mknod d0/d2/c8f 0 2024-04-25T02:08:49.111 INFO:tasks.workunit.client.0.smithi077.stdout:4/386: dread d0/d14/d21/f2f [0,4194304] 0 2024-04-25T02:08:49.111 INFO:tasks.workunit.client.0.smithi077.stdout:8/425: mkdir d3/da/db/df/d2b/d70/d7f 0 2024-04-25T02:08:49.111 INFO:tasks.workunit.client.0.smithi077.stdout:6/428: dwrite de/d12/d25/d60/d63/f68 [0,4194304] 0 2024-04-25T02:08:49.112 INFO:tasks.workunit.client.0.smithi077.stdout:0/383: dwrite d2/d8/f26 [0,4194304] 0 2024-04-25T02:08:49.112 INFO:tasks.workunit.client.0.smithi077.stdout:3/332: symlink d0/d3e/l77 0 2024-04-25T02:08:49.112 INFO:tasks.workunit.client.0.smithi077.stdout:3/333: chown d0/d2/f18 115 1 2024-04-25T02:08:49.113 INFO:tasks.workunit.client.0.smithi077.stdout:9/405: mkdir df/d1b/d48/d75/d90 0 2024-04-25T02:08:49.113 INFO:tasks.workunit.client.0.smithi077.stdout:9/406: truncate df/d1b/d48/d86/f89 220964 0 2024-04-25T02:08:49.118 INFO:tasks.workunit.client.0.smithi077.stdout:8/426: read d3/da/d27/d16/f22 [412054,1983] 0 2024-04-25T02:08:49.119 INFO:tasks.workunit.client.0.smithi077.stdout:4/387: rename d0/d14/d21/d39/da/d12/l7a to d0/d14/d21/d39/da/l88 0 2024-04-25T02:08:49.124 INFO:tasks.workunit.client.0.smithi077.stdout:9/407: dread f5 [0,4194304] 0 2024-04-25T02:08:49.124 INFO:tasks.workunit.client.0.smithi077.stdout:9/408: dread - df/d1b/d48/d75/f8d zero size 2024-04-25T02:08:49.126 INFO:tasks.workunit.client.0.smithi077.stdout:6/429: link de/d15/l18 de/d12/d25/d60/d63/l8e 0 2024-04-25T02:08:49.126 INFO:tasks.workunit.client.0.smithi077.stdout:3/334: dwrite d0/d2/de/d27/f51 [0,4194304] 0 2024-04-25T02:08:49.126 INFO:tasks.workunit.client.0.smithi077.stdout:3/335: chown d0/d2/de/d48/d15/c58 1846270076 1 2024-04-25T02:08:49.127 INFO:tasks.workunit.client.0.smithi077.stdout:0/384: creat d2/f82 x:0 0 0 2024-04-25T02:08:49.132 INFO:tasks.workunit.client.0.smithi077.stdout:5/407: mkdir d0/d2/d3/d9/d90 0 2024-04-25T02:08:49.132 INFO:tasks.workunit.client.0.smithi077.stdout:5/408: fdatasync d0/d2/f79 0 2024-04-25T02:08:49.132 INFO:tasks.workunit.client.0.smithi077.stdout:8/427: getdents d3/da/db/df/d2b/d37 0 2024-04-25T02:08:49.137 INFO:tasks.workunit.client.0.smithi077.stdout:5/409: read d0/f85 [910573,79107] 0 2024-04-25T02:08:49.139 INFO:tasks.workunit.client.0.smithi077.stdout:0/385: truncate d2/d27/d2d/f2f 2602534 0 2024-04-25T02:08:49.139 INFO:tasks.workunit.client.0.smithi077.stdout:0/386: write d2/d8/d10/f67 [1220236,93152] 0 2024-04-25T02:08:49.141 INFO:tasks.workunit.client.0.smithi077.stdout:8/428: unlink d3/da/d27/d16/l1a 0 2024-04-25T02:08:49.141 INFO:tasks.workunit.client.0.smithi077.stdout:2/382: dread d2/d9/d19/d1c/f44 [0,4194304] 0 2024-04-25T02:08:49.144 INFO:tasks.workunit.client.0.smithi077.stdout:4/388: rename d0/d14/d21/d39/d1d/l56 to d0/d14/d21/d39/da/d12/d35/d3e/l89 0 2024-04-25T02:08:49.145 INFO:tasks.workunit.client.0.smithi077.stdout:4/389: write d0/f18 [947664,100733] 0 2024-04-25T02:08:49.146 INFO:tasks.workunit.client.0.smithi077.stdout:6/430: link de/d12/d25/f40 de/d55/f8f 0 2024-04-25T02:08:49.147 INFO:tasks.workunit.client.0.smithi077.stdout:3/336: mknod d0/d2/d2f/c78 0 2024-04-25T02:08:49.149 INFO:tasks.workunit.client.0.smithi077.stdout:8/429: write d3/da/db/df/d2b/d37/f4d [1048756,41654] 0 2024-04-25T02:08:49.149 INFO:tasks.workunit.client.0.smithi077.stdout:4/390: write d0/d14/d21/d39/da/d12/d35/d3e/f4b [576912,31999] 0 2024-04-25T02:08:49.151 INFO:tasks.workunit.client.0.smithi077.stdout:6/431: creat de/d53/d76/f90 x:0 0 0 2024-04-25T02:08:49.153 INFO:tasks.workunit.client.0.smithi077.stdout:3/337: rename d0/d2/de/f1b to d0/d3e/d42/d64/f79 0 2024-04-25T02:08:49.153 INFO:tasks.workunit.client.0.smithi077.stdout:3/338: readlink d0/d40/l49 0 2024-04-25T02:08:49.155 INFO:tasks.workunit.client.0.smithi077.stdout:2/383: getdents d2/d9 0 2024-04-25T02:08:49.157 INFO:tasks.workunit.client.0.smithi077.stdout:8/430: unlink d3/da/d27/l7c 0 2024-04-25T02:08:49.158 INFO:tasks.workunit.client.0.smithi077.stdout:8/431: creat d3/da/d27/d16/d6b/f80 x:0 0 0 2024-04-25T02:08:49.159 INFO:tasks.workunit.client.0.smithi077.stdout:4/391: link d0/l3 d0/d14/d60/d62/l8a 0 2024-04-25T02:08:49.161 INFO:tasks.workunit.client.0.smithi077.stdout:6/432: rename de/d53/d76/l85 to de/d12/d25/d60/d63/l91 0 2024-04-25T02:08:49.161 INFO:tasks.workunit.client.0.smithi077.stdout:6/433: write de/d55/d88/f8b [227396,65806] 0 2024-04-25T02:08:49.161 INFO:tasks.workunit.client.0.smithi077.stdout:6/434: chown de/d12/f2a 0 1 2024-04-25T02:08:49.161 INFO:tasks.workunit.client.0.smithi077.stdout:6/435: write de/d53/f61 [5621085,47994] 0 2024-04-25T02:08:49.163 INFO:tasks.workunit.client.0.smithi077.stdout:8/432: mkdir d3/d81 0 2024-04-25T02:08:49.165 INFO:tasks.workunit.client.0.smithi077.stdout:4/392: getdents d0/d14/d60/d86/d34 0 2024-04-25T02:08:49.167 INFO:tasks.workunit.client.0.smithi077.stdout:6/436: mknod de/d53/d78/c92 0 2024-04-25T02:08:49.168 INFO:tasks.workunit.client.0.smithi077.stdout:3/339: symlink d0/d2/d2f/l7a 0 2024-04-25T02:08:49.168 INFO:tasks.workunit.client.0.smithi077.stdout:0/387: truncate d2/d8/d10/f18 1563887 0 2024-04-25T02:08:49.169 INFO:tasks.workunit.client.0.smithi077.stdout:8/433: rmdir d3/da/db/df/d30 39 2024-04-25T02:08:49.171 INFO:tasks.workunit.client.0.smithi077.stdout:4/393: rename d0/d14/d21/d39/da/d12/d35/f49 to d0/d14/f8b 0 2024-04-25T02:08:49.173 INFO:tasks.workunit.client.0.smithi077.stdout:8/434: creat d3/da/db/df/d30/f82 x:0 0 0 2024-04-25T02:08:49.173 INFO:tasks.workunit.client.0.smithi077.stdout:8/435: stat d3/da/db/df/d2b/d37/f67 0 2024-04-25T02:08:49.175 INFO:tasks.workunit.client.0.smithi077.stdout:6/437: rename de/d12/d25/d4b/c5e to de/d15/d36/c93 0 2024-04-25T02:08:49.175 INFO:tasks.workunit.client.0.smithi077.stdout:6/438: read - de/d12/d25/d38/f67 zero size 2024-04-25T02:08:49.175 INFO:tasks.workunit.client.0.smithi077.stdout:6/439: fsync fd 0 2024-04-25T02:08:49.176 INFO:tasks.workunit.client.0.smithi077.stdout:4/394: symlink d0/d14/d79/l8c 0 2024-04-25T02:08:49.176 INFO:tasks.workunit.client.0.smithi077.stdout:4/395: truncate d0/d14/d21/d39/da/f63 135107 0 2024-04-25T02:08:49.176 INFO:tasks.workunit.client.0.smithi077.stdout:4/396: creat d0/d14/d60/d62/f8d x:0 0 0 2024-04-25T02:08:49.177 INFO:tasks.workunit.client.0.smithi077.stdout:6/440: symlink de/d53/d76/l94 0 2024-04-25T02:08:49.177 INFO:tasks.workunit.client.0.smithi077.stdout:6/441: readlink de/l8c 0 2024-04-25T02:08:49.177 INFO:tasks.workunit.client.0.smithi077.stdout:6/442: chown de/d53/f61 42 1 2024-04-25T02:08:49.178 INFO:tasks.workunit.client.0.smithi077.stdout:3/340: dread d0/d2/de/d27/f51 [0,4194304] 0 2024-04-25T02:08:49.178 INFO:tasks.workunit.client.0.smithi077.stdout:3/341: chown d0/d2/l53 316 1 2024-04-25T02:08:49.179 INFO:tasks.workunit.client.0.smithi077.stdout:4/397: link d0/d14/d21/d39/da/d12/l84 d0/d14/d21/d39/da/d12/d35/l8e 0 2024-04-25T02:08:49.180 INFO:tasks.workunit.client.0.smithi077.stdout:8/436: dread d3/da/d27/f21 [0,4194304] 0 2024-04-25T02:08:49.180 INFO:tasks.workunit.client.0.smithi077.stdout:4/398: write d0/d14/d21/d39/f4d [528763,2449] 0 2024-04-25T02:08:49.181 INFO:tasks.workunit.client.0.smithi077.stdout:6/443: truncate de/f46 2794073 0 2024-04-25T02:08:49.185 INFO:tasks.workunit.client.0.smithi077.stdout:3/342: creat d0/d2/d2f/f7b x:0 0 0 2024-04-25T02:08:49.187 INFO:tasks.workunit.client.0.smithi077.stdout:8/437: symlink d3/da/d27/d16/l83 0 2024-04-25T02:08:49.187 INFO:tasks.workunit.client.0.smithi077.stdout:8/438: write d3/da/db/df/d2b/f79 [388889,97905] 0 2024-04-25T02:08:49.188 INFO:tasks.workunit.client.0.smithi077.stdout:6/444: mkdir de/d95 0 2024-04-25T02:08:49.188 INFO:tasks.workunit.client.0.smithi077.stdout:6/445: getdents de/d12/d25/d60 0 2024-04-25T02:08:49.189 INFO:tasks.workunit.client.0.smithi077.stdout:3/343: mknod d0/d17/c7c 0 2024-04-25T02:08:49.193 INFO:tasks.workunit.client.0.smithi077.stdout:0/388: dwrite d2/f6 [0,4194304] 0 2024-04-25T02:08:49.194 INFO:tasks.workunit.client.0.smithi077.stdout:3/344: rename d0/d2/d2f/d5f/l74 to d0/d40/l7d 0 2024-04-25T02:08:49.196 INFO:tasks.workunit.client.0.smithi077.stdout:6/446: getdents de/d12/d25/d3a/d6a 0 2024-04-25T02:08:49.196 INFO:tasks.workunit.client.0.smithi077.stdout:6/447: fdatasync de/d12/d25/f29 0 2024-04-25T02:08:49.196 INFO:tasks.workunit.client.0.smithi077.stdout:6/448: dread - de/d12/d25/f83 zero size 2024-04-25T02:08:49.196 INFO:tasks.workunit.client.0.smithi077.stdout:6/449: chown de/d12/c64 1 1 2024-04-25T02:08:49.197 INFO:tasks.workunit.client.0.smithi077.stdout:0/389: mkdir d2/d17/d1d/d34/d83 0 2024-04-25T02:08:49.200 INFO:tasks.workunit.client.0.smithi077.stdout:3/345: rename d0/d2/de/d48/f3b to d0/d17/f7e 0 2024-04-25T02:08:49.201 INFO:tasks.workunit.client.0.smithi077.stdout:0/390: symlink d2/d17/d1d/d34/d4c/l84 0 2024-04-25T02:08:49.201 INFO:tasks.workunit.client.0.smithi077.stdout:6/450: dread de/d12/f7a [0,4194304] 0 2024-04-25T02:08:49.202 INFO:tasks.workunit.client.0.smithi077.stdout:3/346: symlink d0/d3e/d62/d6a/d6e/l7f 0 2024-04-25T02:08:49.202 INFO:tasks.workunit.client.0.smithi077.stdout:3/347: creat d0/d17/f80 x:0 0 0 2024-04-25T02:08:49.203 INFO:tasks.workunit.client.0.smithi077.stdout:8/439: dwrite d3/da/d27/f6c [0,4194304] 0 2024-04-25T02:08:49.204 INFO:tasks.workunit.client.0.smithi077.stdout:4/399: dwrite d0/d14/d21/d39/da/f85 [0,4194304] 0 2024-04-25T02:08:49.205 INFO:tasks.workunit.client.0.smithi077.stdout:3/348: mkdir d0/d17/d4b/d59/d81 0 2024-04-25T02:08:49.206 INFO:tasks.workunit.client.0.smithi077.stdout:6/451: link de/d12/d25/d44/c89 de/d12/d25/c96 0 2024-04-25T02:08:49.217 INFO:tasks.workunit.client.0.smithi077.stdout:4/400: creat d0/d14/d21/d39/da/d12/d35/d3e/f8f x:0 0 0 2024-04-25T02:08:49.219 INFO:tasks.workunit.client.0.smithi077.stdout:3/349: rename d0/d17/f19 to d0/d2/de/f82 0 2024-04-25T02:08:49.219 INFO:tasks.workunit.client.0.smithi077.stdout:6/452: mkdir de/d12/d25/d3a/d97 0 2024-04-25T02:08:49.221 INFO:tasks.workunit.client.0.smithi077.stdout:3/350: mkdir d0/d2/d83 0 2024-04-25T02:08:49.221 INFO:tasks.workunit.client.0.smithi077.stdout:3/351: dread - d0/d3e/d42/d64/f72 zero size 2024-04-25T02:08:49.228 INFO:tasks.workunit.client.0.smithi077.stdout:8/440: dwrite d3/da/f78 [0,4194304] 0 2024-04-25T02:08:49.228 INFO:tasks.workunit.client.0.smithi077.stdout:7/338: sync 2024-04-25T02:08:49.228 INFO:tasks.workunit.client.0.smithi077.stdout:1/355: sync 2024-04-25T02:08:49.234 INFO:tasks.workunit.client.0.smithi077.stdout:1/356: creat db/df/d1b/f6f x:0 0 0 2024-04-25T02:08:49.234 INFO:tasks.workunit.client.0.smithi077.stdout:1/357: dread - db/d11/d5c/f5e zero size 2024-04-25T02:08:49.237 INFO:tasks.workunit.client.0.smithi077.stdout:1/358: mknod db/c70 0 2024-04-25T02:08:49.237 INFO:tasks.workunit.client.0.smithi077.stdout:1/359: chown db/d11/d5c/f5e 38668 1 2024-04-25T02:08:49.238 INFO:tasks.workunit.client.0.smithi077.stdout:1/360: creat db/df/d14/d50/f71 x:0 0 0 2024-04-25T02:08:49.239 INFO:tasks.workunit.client.0.smithi077.stdout:1/361: symlink db/df/d14/d3e/d69/l72 0 2024-04-25T02:08:49.239 INFO:tasks.workunit.client.0.smithi077.stdout:1/362: creat db/d26/f73 x:0 0 0 2024-04-25T02:08:49.251 INFO:tasks.workunit.client.0.smithi077.stdout:4/401: dwrite d0/d14/d60/d86/d3c/f5c [0,4194304] 0 2024-04-25T02:08:49.251 INFO:tasks.workunit.client.0.smithi077.stdout:4/402: stat d0/d14/d21/f22 0 2024-04-25T02:08:49.252 INFO:tasks.workunit.client.0.smithi077.stdout:6/453: dwrite de/d12/d25/f2d [0,4194304] 0 2024-04-25T02:08:49.252 INFO:tasks.workunit.client.0.smithi077.stdout:6/454: chown f1 4535488 1 2024-04-25T02:08:49.252 INFO:tasks.workunit.client.0.smithi077.stdout:6/455: stat de/d15/d36/l4f 0 2024-04-25T02:08:49.252 INFO:tasks.workunit.client.0.smithi077.stdout:4/403: mknod d0/d14/d21/d39/da/d12/d35/d3e/d3a/c90 0 2024-04-25T02:08:49.255 INFO:tasks.workunit.client.0.smithi077.stdout:6/456: rename de/l8c to de/d95/l98 0 2024-04-25T02:08:49.255 INFO:tasks.workunit.client.0.smithi077.stdout:6/457: truncate de/d12/d25/d4b/f79 116485 0 2024-04-25T02:08:49.256 INFO:tasks.workunit.client.0.smithi077.stdout:6/458: mknod de/d53/d6f/c99 0 2024-04-25T02:08:49.260 INFO:tasks.workunit.client.0.smithi077.stdout:3/352: dwrite d0/d2/f18 [0,4194304] 0 2024-04-25T02:08:49.260 INFO:tasks.workunit.client.0.smithi077.stdout:1/363: dwrite db/df/d14/d3e/f5b [0,4194304] 0 2024-04-25T02:08:49.260 INFO:tasks.workunit.client.0.smithi077.stdout:1/364: chown db/df/d14/d33/f38 0 1 2024-04-25T02:08:49.263 INFO:tasks.workunit.client.0.smithi077.stdout:3/353: rename d0/d3e/d42/d64/c6f to d0/d17/c84 0 2024-04-25T02:08:49.265 INFO:tasks.workunit.client.0.smithi077.stdout:3/354: creat d0/d3e/d62/d6a/d6e/f85 x:0 0 0 2024-04-25T02:08:49.266 INFO:tasks.workunit.client.0.smithi077.stdout:1/365: mknod db/df/d14/c74 0 2024-04-25T02:08:49.268 INFO:tasks.workunit.client.0.smithi077.stdout:1/366: symlink db/df/d14/d33/l75 0 2024-04-25T02:08:49.276 INFO:tasks.workunit.client.0.smithi077.stdout:4/404: dwrite d0/d14/d21/d39/da/d12/d35/d3e/d3a/f7d [0,4194304] 0 2024-04-25T02:08:49.276 INFO:tasks.workunit.client.0.smithi077.stdout:4/405: chown d0/d14/d60/d86/d34/l7c 194040 1 2024-04-25T02:08:49.279 INFO:tasks.workunit.client.0.smithi077.stdout:4/406: symlink d0/d14/d21/d39/da/d12/d35/l91 0 2024-04-25T02:08:49.281 INFO:tasks.workunit.client.0.smithi077.stdout:1/367: read db/df/d14/d33/f38 [1532721,49177] 0 2024-04-25T02:08:49.283 INFO:tasks.workunit.client.0.smithi077.stdout:6/459: dwrite de/d15/f50 [4194304,4194304] 0 2024-04-25T02:08:49.284 INFO:tasks.workunit.client.0.smithi077.stdout:3/355: dwrite d0/f6c [0,4194304] 0 2024-04-25T02:08:49.284 INFO:tasks.workunit.client.0.smithi077.stdout:3/356: dread - d0/d3e/d42/f60 zero size 2024-04-25T02:08:49.292 INFO:tasks.workunit.client.0.smithi077.stdout:3/357: unlink d0/f6c 0 2024-04-25T02:08:49.292 INFO:tasks.workunit.client.0.smithi077.stdout:3/358: stat d0/d2/de/d36/l4a 0 2024-04-25T02:08:49.292 INFO:tasks.workunit.client.0.smithi077.stdout:6/460: dread de/d12/d25/d60/d63/f68 [0,4194304] 0 2024-04-25T02:08:49.292 INFO:tasks.workunit.client.0.smithi077.stdout:6/461: write f0 [2648173,32080] 0 2024-04-25T02:08:49.292 INFO:tasks.workunit.client.0.smithi077.stdout:6/462: readlink de/d12/d25/d60/l73 0 2024-04-25T02:08:49.292 INFO:tasks.workunit.client.0.smithi077.stdout:6/463: write de/d12/f8a [745520,46099] 0 2024-04-25T02:08:49.292 INFO:tasks.workunit.client.0.smithi077.stdout:6/464: chown de/d12/d25/d3a/d6a/f7e 2401 1 2024-04-25T02:08:49.293 INFO:tasks.workunit.client.0.smithi077.stdout:3/359: creat d0/d2/d83/f86 x:0 0 0 2024-04-25T02:08:49.293 INFO:tasks.workunit.client.0.smithi077.stdout:6/465: dread de/f2c [0,4194304] 0 2024-04-25T02:08:49.293 INFO:tasks.workunit.client.0.smithi077.stdout:0/391: sync 2024-04-25T02:08:49.293 INFO:tasks.workunit.client.0.smithi077.stdout:2/384: sync 2024-04-25T02:08:49.294 INFO:tasks.workunit.client.0.smithi077.stdout:5/410: sync 2024-04-25T02:08:49.294 INFO:tasks.workunit.client.0.smithi077.stdout:9/409: sync 2024-04-25T02:08:49.295 INFO:tasks.workunit.client.0.smithi077.stdout:9/410: unlink df/d1b/d56/d67/d68/f7c 0 2024-04-25T02:08:49.296 INFO:tasks.workunit.client.0.smithi077.stdout:2/385: mkdir d2/d59/d79 0 2024-04-25T02:08:49.296 INFO:tasks.workunit.client.0.smithi077.stdout:4/407: dwrite d0/d14/d21/d39/da/d12/d35/d3e/f4b [0,4194304] 0 2024-04-25T02:08:49.297 INFO:tasks.workunit.client.0.smithi077.stdout:4/408: read d0/d14/d21/f26 [2103699,49952] 0 2024-04-25T02:08:49.297 INFO:tasks.workunit.client.0.smithi077.stdout:0/392: creat d2/d17/d4e/f85 x:0 0 0 2024-04-25T02:08:49.298 INFO:tasks.workunit.client.0.smithi077.stdout:9/411: creat df/d60/d87/f91 x:0 0 0 2024-04-25T02:08:49.300 INFO:tasks.workunit.client.0.smithi077.stdout:6/466: dread de/f13 [0,4194304] 0 2024-04-25T02:08:49.300 INFO:tasks.workunit.client.0.smithi077.stdout:4/409: truncate d0/d14/d21/d39/da/d12/d35/d3e/f3f 206605 0 2024-04-25T02:08:49.300 INFO:tasks.workunit.client.0.smithi077.stdout:4/410: write d0/d14/d21/d39/da/d12/f3d [3643520,3722] 0 2024-04-25T02:08:49.305 INFO:tasks.workunit.client.0.smithi077.stdout:2/386: dread d2/d9/d19/d2c/f47 [0,4194304] 0 2024-04-25T02:08:49.305 INFO:tasks.workunit.client.0.smithi077.stdout:6/467: getdents de/d53/d76 0 2024-04-25T02:08:49.307 INFO:tasks.workunit.client.0.smithi077.stdout:4/411: getdents d0/d14/d21/d39/da/d12 0 2024-04-25T02:08:49.310 INFO:tasks.workunit.client.0.smithi077.stdout:2/387: creat d2/d78/f7a x:0 0 0 2024-04-25T02:08:49.311 INFO:tasks.workunit.client.0.smithi077.stdout:6/468: link de/d12/d25/f7b de/d55/f9a 0 2024-04-25T02:08:49.312 INFO:tasks.workunit.client.0.smithi077.stdout:6/469: creat de/d12/d25/d3a/f9b x:0 0 0 2024-04-25T02:08:49.312 INFO:tasks.workunit.client.0.smithi077.stdout:6/470: fdatasync de/d55/f9a 0 2024-04-25T02:08:49.314 INFO:tasks.workunit.client.0.smithi077.stdout:9/412: dread df/d1b/f47 [0,4194304] 0 2024-04-25T02:08:49.314 INFO:tasks.workunit.client.0.smithi077.stdout:6/471: symlink de/d12/d25/d44/l9c 0 2024-04-25T02:08:49.314 INFO:tasks.workunit.client.0.smithi077.stdout:9/413: write df/f62 [939610,8593] 0 2024-04-25T02:08:49.314 INFO:tasks.workunit.client.0.smithi077.stdout:9/414: write df/d1b/d48/d75/f8d [136961,35787] 0 2024-04-25T02:08:49.315 INFO:tasks.workunit.client.0.smithi077.stdout:6/472: rmdir de/d12/d25/d3a/d97 0 2024-04-25T02:08:49.315 INFO:tasks.workunit.client.0.smithi077.stdout:2/388: dread d2/d9/d18/d31/f4b [0,4194304] 0 2024-04-25T02:08:49.316 INFO:tasks.workunit.client.0.smithi077.stdout:9/415: symlink df/d1b/d70/d74/l92 0 2024-04-25T02:08:49.316 INFO:tasks.workunit.client.0.smithi077.stdout:9/416: write df/d1b/f65 [695642,113439] 0 2024-04-25T02:08:49.316 INFO:tasks.workunit.client.0.smithi077.stdout:9/417: chown df/d1b/c34 417521812 1 2024-04-25T02:08:49.317 INFO:tasks.workunit.client.0.smithi077.stdout:6/473: mknod de/d53/d6f/c9d 0 2024-04-25T02:08:49.317 INFO:tasks.workunit.client.0.smithi077.stdout:6/474: dread - de/d55/f9a zero size 2024-04-25T02:08:49.317 INFO:tasks.workunit.client.0.smithi077.stdout:2/389: mkdir d2/d9/d18/d1b/d7b 0 2024-04-25T02:08:49.318 INFO:tasks.workunit.client.0.smithi077.stdout:9/418: creat df/d1b/d56/f93 x:0 0 0 2024-04-25T02:08:49.318 INFO:tasks.workunit.client.0.smithi077.stdout:9/419: truncate df/f18 1409639 0 2024-04-25T02:08:49.318 INFO:tasks.workunit.client.0.smithi077.stdout:6/475: truncate de/d12/f2a 1549018 0 2024-04-25T02:08:49.319 INFO:tasks.workunit.client.0.smithi077.stdout:6/476: fsync de/d12/d25/d60/d63/f6c 0 2024-04-25T02:08:49.319 INFO:tasks.workunit.client.0.smithi077.stdout:2/390: mkdir d2/d9/d18/d31/d7c 0 2024-04-25T02:08:49.320 INFO:tasks.workunit.client.0.smithi077.stdout:2/391: write d2/d9/f67 [2744122,57764] 0 2024-04-25T02:08:49.320 INFO:tasks.workunit.client.0.smithi077.stdout:2/392: readlink d2/d9/d18/l1f 0 2024-04-25T02:08:49.320 INFO:tasks.workunit.client.0.smithi077.stdout:2/393: readlink d2/d9/d19/d1c/d3f/l69 0 2024-04-25T02:08:49.320 INFO:tasks.workunit.client.0.smithi077.stdout:3/360: dwrite d0/d2/de/d48/d15/f56 [0,4194304] 0 2024-04-25T02:08:49.320 INFO:tasks.workunit.client.0.smithi077.stdout:9/420: creat df/d1b/d56/d67/d68/f94 x:0 0 0 2024-04-25T02:08:49.321 INFO:tasks.workunit.client.0.smithi077.stdout:6/477: getdents de 0 2024-04-25T02:08:49.324 INFO:tasks.workunit.client.0.smithi077.stdout:2/394: getdents d2/d9/d56/d5c 0 2024-04-25T02:08:49.326 INFO:tasks.workunit.client.0.smithi077.stdout:4/412: dwrite d0/d14/d21/d39/da/d12/d35/f71 [4194304,4194304] 0 2024-04-25T02:08:49.326 INFO:tasks.workunit.client.0.smithi077.stdout:0/393: dwrite d2/d8/d10/f67 [0,4194304] 0 2024-04-25T02:08:49.326 INFO:tasks.workunit.client.0.smithi077.stdout:9/421: rmdir df/d60/d87 39 2024-04-25T02:08:49.329 INFO:tasks.workunit.client.0.smithi077.stdout:2/395: unlink d2/d9/df/f50 0 2024-04-25T02:08:49.335 INFO:tasks.workunit.client.0.smithi077.stdout:0/394: rename d2/d17/d1d/d34/c57 to d2/d17/d1d/d34/c86 0 2024-04-25T02:08:49.337 INFO:tasks.workunit.client.0.smithi077.stdout:9/422: rename df/f38 to df/d1b/d70/d74/f95 0 2024-04-25T02:08:49.337 INFO:tasks.workunit.client.0.smithi077.stdout:4/413: write d0/f16 [3319722,46106] 0 2024-04-25T02:08:49.341 INFO:tasks.workunit.client.0.smithi077.stdout:2/396: rename d2/d9/d18/d1b/c45 to d2/d9/d19/d2c/d72/c7d 0 2024-04-25T02:08:49.344 INFO:tasks.workunit.client.0.smithi077.stdout:6/478: dwrite de/d53/d76/f90 [0,4194304] 0 2024-04-25T02:08:49.349 INFO:tasks.workunit.client.0.smithi077.stdout:3/361: dwrite d0/d2/de/f61 [0,4194304] 0 2024-04-25T02:08:49.349 INFO:tasks.workunit.client.0.smithi077.stdout:3/362: write d0/d40/f57 [143140,68041] 0 2024-04-25T02:08:49.352 INFO:tasks.workunit.client.0.smithi077.stdout:9/423: write df/f6b [1959262,43428] 0 2024-04-25T02:08:49.352 INFO:tasks.workunit.client.0.smithi077.stdout:9/424: readlink df/l6a 0 2024-04-25T02:08:49.358 INFO:tasks.workunit.client.0.smithi077.stdout:2/397: getdents d2/d9/d19/d2c/d72 0 2024-04-25T02:08:49.360 INFO:tasks.workunit.client.0.smithi077.stdout:9/425: write df/f29 [3774765,65388] 0 2024-04-25T02:08:49.361 INFO:tasks.workunit.client.0.smithi077.stdout:3/363: rename d0/d3e/c55 to d0/d17/d4b/d59/c87 0 2024-04-25T02:08:49.362 INFO:tasks.workunit.client.0.smithi077.stdout:3/364: chown d0/d2/d2f/c78 23506 1 2024-04-25T02:08:49.363 INFO:tasks.workunit.client.0.smithi077.stdout:3/365: dread d0/d17/f5d [0,4194304] 0 2024-04-25T02:08:49.365 INFO:tasks.workunit.client.0.smithi077.stdout:2/398: dread d2/d59/f60 [0,4194304] 0 2024-04-25T02:08:49.365 INFO:tasks.workunit.client.0.smithi077.stdout:3/366: mkdir d0/d3e/d42/d64/d88 0 2024-04-25T02:08:49.365 INFO:tasks.workunit.client.0.smithi077.stdout:2/399: write d2/d9/d19/f1a [4947157,118937] 0 2024-04-25T02:08:49.366 INFO:tasks.workunit.client.0.smithi077.stdout:2/400: symlink d2/d9/d18/l7e 0 2024-04-25T02:08:49.368 INFO:tasks.workunit.client.0.smithi077.stdout:2/401: link d2/d9/d19/d1c/c75 d2/d9/c7f 0 2024-04-25T02:08:49.372 INFO:tasks.workunit.client.0.smithi077.stdout:0/395: dwrite d2/d9/d2a/f7d [0,4194304] 0 2024-04-25T02:08:49.373 INFO:tasks.workunit.client.0.smithi077.stdout:0/396: chown d2/d17/d1d/c80 2 1 2024-04-25T02:08:49.374 INFO:tasks.workunit.client.0.smithi077.stdout:0/397: getdents d2/d17/d1d 0 2024-04-25T02:08:49.375 INFO:tasks.workunit.client.0.smithi077.stdout:0/398: mknod d2/d17/d4e/d5e/c87 0 2024-04-25T02:08:49.402 INFO:tasks.workunit.client.0.smithi077.stdout:6/479: dwrite de/d12/d25/f4a [0,4194304] 0 2024-04-25T02:08:49.403 INFO:tasks.workunit.client.0.smithi077.stdout:8/441: sync 2024-04-25T02:08:49.403 INFO:tasks.workunit.client.0.smithi077.stdout:7/339: sync 2024-04-25T02:08:49.403 INFO:tasks.workunit.client.0.smithi077.stdout:8/442: fdatasync d3/da/d27/f47 0 2024-04-25T02:08:49.403 INFO:tasks.workunit.client.0.smithi077.stdout:4/414: dwrite d0/d14/d21/f22 [4194304,4194304] 0 2024-04-25T02:08:49.404 INFO:tasks.workunit.client.0.smithi077.stdout:9/426: dwrite df/d1b/f65 [0,4194304] 0 2024-04-25T02:08:49.404 INFO:tasks.workunit.client.0.smithi077.stdout:9/427: chown df/d1b/d56/d67/d68 109195490 1 2024-04-25T02:08:49.404 INFO:tasks.workunit.client.0.smithi077.stdout:9/428: creat df/d1b/f96 x:0 0 0 2024-04-25T02:08:49.404 INFO:tasks.workunit.client.0.smithi077.stdout:6/480: symlink de/d5b/l9e 0 2024-04-25T02:08:49.488 INFO:tasks.workunit.client.0.smithi077.stdout:7/340: rmdir d4/d13/d18/d24/d6c 0 2024-04-25T02:08:49.488 INFO:tasks.workunit.client.0.smithi077.stdout:7/341: write d4/d13/d18/d2d/d30/f42 [2018917,119236] 0 2024-04-25T02:08:49.489 INFO:tasks.workunit.client.0.smithi077.stdout:8/443: mknod d3/da/db/df/d2b/d37/c84 0 2024-04-25T02:08:49.489 INFO:tasks.workunit.client.0.smithi077.stdout:8/444: chown d3/da/db/c54 130527279 1 2024-04-25T02:08:49.491 INFO:tasks.workunit.client.0.smithi077.stdout:4/415: link d0/d14/d79/l8c d0/d14/d21/l92 0 2024-04-25T02:08:49.494 INFO:tasks.workunit.client.0.smithi077.stdout:3/367: dwrite d0/d2/f18 [0,4194304] 0 2024-04-25T02:08:49.494 INFO:tasks.workunit.client.0.smithi077.stdout:3/368: readlink d0/d3e/d42/d64/l71 0 2024-04-25T02:08:49.494 INFO:tasks.workunit.client.0.smithi077.stdout:0/399: dwrite d2/f4b [0,4194304] 0 2024-04-25T02:08:49.494 INFO:tasks.workunit.client.0.smithi077.stdout:0/400: creat d2/d17/d4e/f88 x:0 0 0 2024-04-25T02:08:49.495 INFO:tasks.workunit.client.0.smithi077.stdout:4/416: dread d0/d14/d21/d39/da/d12/d35/d3e/f38 [0,4194304] 0 2024-04-25T02:08:49.497 INFO:tasks.workunit.client.0.smithi077.stdout:6/481: stat de/d12/d25/l2b 0 2024-04-25T02:08:49.497 INFO:tasks.workunit.client.0.smithi077.stdout:6/482: chown de/d53/d6f/c99 6 1 2024-04-25T02:08:49.501 INFO:tasks.workunit.client.0.smithi077.stdout:7/342: unlink d4/f33 0 2024-04-25T02:08:49.503 INFO:tasks.workunit.client.0.smithi077.stdout:8/445: symlink d3/da/db/df/d2b/d70/l85 0 2024-04-25T02:08:49.507 INFO:tasks.workunit.client.0.smithi077.stdout:3/369: creat d0/d3e/d62/d6a/f89 x:0 0 0 2024-04-25T02:08:49.507 INFO:tasks.workunit.client.0.smithi077.stdout:3/370: dread - d0/f69 zero size 2024-04-25T02:08:49.509 INFO:tasks.workunit.client.0.smithi077.stdout:0/401: symlink d2/d8/d5f/l89 0 2024-04-25T02:08:49.509 INFO:tasks.workunit.client.0.smithi077.stdout:0/402: creat d2/d17/d4e/f8a x:0 0 0 2024-04-25T02:08:49.509 INFO:tasks.workunit.client.0.smithi077.stdout:9/429: rmdir df/d1b/d48/d86 39 2024-04-25T02:08:49.509 INFO:tasks.workunit.client.0.smithi077.stdout:9/430: write df/d1b/d48/d86/f89 [287308,130493] 0 2024-04-25T02:08:49.510 INFO:tasks.workunit.client.0.smithi077.stdout:6/483: creat de/d12/d25/f9f x:0 0 0 2024-04-25T02:08:49.510 INFO:tasks.workunit.client.0.smithi077.stdout:6/484: dread - de/d55/f9a zero size 2024-04-25T02:08:49.510 INFO:tasks.workunit.client.0.smithi077.stdout:0/403: dread d2/d9/f66 [0,4194304] 0 2024-04-25T02:08:49.511 INFO:tasks.workunit.client.0.smithi077.stdout:7/343: unlink d4/d13/d18/d2d/d56/c6e 0 2024-04-25T02:08:49.511 INFO:tasks.workunit.client.0.smithi077.stdout:7/344: write d4/d13/d18/d24/d3f/d58/f74 [346774,98135] 0 2024-04-25T02:08:49.511 INFO:tasks.workunit.client.0.smithi077.stdout:4/417: dwrite d0/d14/f1c [0,4194304] 0 2024-04-25T02:08:49.512 INFO:tasks.workunit.client.0.smithi077.stdout:8/446: mkdir d3/d81/d86 0 2024-04-25T02:08:49.513 INFO:tasks.workunit.client.0.smithi077.stdout:3/371: rename d0/d2/de/d27/c33 to d0/d2/de/c8a 0 2024-04-25T02:08:49.514 INFO:tasks.workunit.client.0.smithi077.stdout:3/372: dread d0/d17/f5d [0,4194304] 0 2024-04-25T02:08:49.515 INFO:tasks.workunit.client.0.smithi077.stdout:9/431: symlink df/d1b/l97 0 2024-04-25T02:08:49.517 INFO:tasks.workunit.client.0.smithi077.stdout:6/485: truncate de/d12/d25/f4a 3949024 0 2024-04-25T02:08:49.519 INFO:tasks.workunit.client.0.smithi077.stdout:7/345: truncate d4/d13/d18/d24/d3f/d58/f2b 565069 0 2024-04-25T02:08:49.519 INFO:tasks.workunit.client.0.smithi077.stdout:1/368: sync 2024-04-25T02:08:49.521 INFO:tasks.workunit.client.0.smithi077.stdout:7/346: dread d4/d13/d18/f71 [0,4194304] 0 2024-04-25T02:08:49.521 INFO:tasks.workunit.client.0.smithi077.stdout:7/347: truncate d4/d13/d18/d2d/f43 69535 0 2024-04-25T02:08:49.521 INFO:tasks.workunit.client.0.smithi077.stdout:2/402: sync 2024-04-25T02:08:49.521 INFO:tasks.workunit.client.0.smithi077.stdout:5/411: sync 2024-04-25T02:08:49.521 INFO:tasks.workunit.client.0.smithi077.stdout:2/403: getdents d2/d9/d18/d31/d7c 0 2024-04-25T02:08:49.522 INFO:tasks.workunit.client.0.smithi077.stdout:5/412: chown d0/d2/d3/d9/d39/d44/c4e 185 1 2024-04-25T02:08:49.522 INFO:tasks.workunit.client.0.smithi077.stdout:5/413: fsync d0/d25/f8c 0 2024-04-25T02:08:49.522 INFO:tasks.workunit.client.0.smithi077.stdout:2/404: write d2/d9/d19/d1c/d3f/d53/f68 [556614,81284] 0 2024-04-25T02:08:49.522 INFO:tasks.workunit.client.0.smithi077.stdout:2/405: chown d2/d9/d19/d2c 289 1 2024-04-25T02:08:49.523 INFO:tasks.workunit.client.0.smithi077.stdout:7/348: dread d4/d13/d18/d2d/f43 [0,4194304] 0 2024-04-25T02:08:49.523 INFO:tasks.workunit.client.0.smithi077.stdout:9/432: truncate df/d1b/f22 179393 0 2024-04-25T02:08:49.523 INFO:tasks.workunit.client.0.smithi077.stdout:9/433: readlink df/l2c 0 2024-04-25T02:08:49.523 INFO:tasks.workunit.client.0.smithi077.stdout:6/486: truncate de/f13 493817 0 2024-04-25T02:08:49.524 INFO:tasks.workunit.client.0.smithi077.stdout:1/369: mknod db/df/d14/d33/d6c/c76 0 2024-04-25T02:08:49.525 INFO:tasks.workunit.client.0.smithi077.stdout:5/414: write d0/d25/f30 [4851465,18561] 0 2024-04-25T02:08:49.526 INFO:tasks.workunit.client.0.smithi077.stdout:7/349: rmdir d4/d13/d66/d79 0 2024-04-25T02:08:49.527 INFO:tasks.workunit.client.0.smithi077.stdout:7/350: write d4/d13/d18/f71 [252786,64788] 0 2024-04-25T02:08:49.532 INFO:tasks.workunit.client.0.smithi077.stdout:9/434: rename df/f12 to df/d80/f98 0 2024-04-25T02:08:49.532 INFO:tasks.workunit.client.0.smithi077.stdout:9/435: write df/d60/d87/f91 [298740,107197] 0 2024-04-25T02:08:49.534 INFO:tasks.workunit.client.0.smithi077.stdout:7/351: getdents d4/d13/d18/d2d/d56/d68 0 2024-04-25T02:08:49.536 INFO:tasks.workunit.client.0.smithi077.stdout:7/352: rename d4/d13/d18/d2d/d30/l7b to d4/d13/d18/d24/l7e 0 2024-04-25T02:08:49.536 INFO:tasks.workunit.client.0.smithi077.stdout:7/353: fdatasync d4/d13/f2f 0 2024-04-25T02:08:49.536 INFO:tasks.workunit.client.0.smithi077.stdout:7/354: creat d4/d13/d18/d24/d3f/d58/f7f x:0 0 0 2024-04-25T02:08:49.541 INFO:tasks.workunit.client.0.smithi077.stdout:7/355: mknod d4/d13/d18/d2d/d30/c80 0 2024-04-25T02:08:49.542 INFO:tasks.workunit.client.0.smithi077.stdout:9/436: read df/f2f [7816711,130945] 0 2024-04-25T02:08:49.543 INFO:tasks.workunit.client.0.smithi077.stdout:7/356: mknod d4/d13/d18/d24/d3f/d72/c81 0 2024-04-25T02:08:49.543 INFO:tasks.workunit.client.0.smithi077.stdout:7/357: truncate d4/d13/d18/d2d/f43 1083231 0 2024-04-25T02:08:49.545 INFO:tasks.workunit.client.0.smithi077.stdout:7/358: dread d4/d13/d18/d2d/d30/f34 [0,4194304] 0 2024-04-25T02:08:49.546 INFO:tasks.workunit.client.0.smithi077.stdout:1/370: dread db/df/d14/f17 [0,4194304] 0 2024-04-25T02:08:49.547 INFO:tasks.workunit.client.0.smithi077.stdout:1/371: dread - db/df/d14/d50/f71 zero size 2024-04-25T02:08:49.549 INFO:tasks.workunit.client.0.smithi077.stdout:4/418: dwrite d0/d14/d21/d39/f61 [0,4194304] 0 2024-04-25T02:08:49.550 INFO:tasks.workunit.client.0.smithi077.stdout:1/372: mkdir db/df/d56/d5d/d77 0 2024-04-25T02:08:49.552 INFO:tasks.workunit.client.0.smithi077.stdout:1/373: mknod db/df/d14/d33/d34/d66/c78 0 2024-04-25T02:08:49.552 INFO:tasks.workunit.client.0.smithi077.stdout:1/374: write db/df/d1b/f6f [713402,127585] 0 2024-04-25T02:08:49.553 INFO:tasks.workunit.client.0.smithi077.stdout:1/375: mknod db/df/d56/d5d/d77/c79 0 2024-04-25T02:08:49.553 INFO:tasks.workunit.client.0.smithi077.stdout:1/376: fdatasync db/f18 0 2024-04-25T02:08:49.553 INFO:tasks.workunit.client.0.smithi077.stdout:9/437: dread df/f44 [0,4194304] 0 2024-04-25T02:08:49.553 INFO:tasks.workunit.client.0.smithi077.stdout:9/438: fdatasync df/d1b/f65 0 2024-04-25T02:08:49.555 INFO:tasks.workunit.client.0.smithi077.stdout:9/439: link df/d1b/l24 df/d1b/d48/d75/d90/l99 0 2024-04-25T02:08:49.556 INFO:tasks.workunit.client.0.smithi077.stdout:9/440: stat df/d60 0 2024-04-25T02:08:49.557 INFO:tasks.workunit.client.0.smithi077.stdout:1/377: link db/d11/f30 db/d11/f7a 0 2024-04-25T02:08:49.560 INFO:tasks.workunit.client.0.smithi077.stdout:1/378: truncate db/df/d14/d3e/f54 699643 0 2024-04-25T02:08:49.560 INFO:tasks.workunit.client.0.smithi077.stdout:6/487: write de/f13 [1179880,30439] 0 2024-04-25T02:08:49.563 INFO:tasks.workunit.client.0.smithi077.stdout:6/488: rmdir de 39 2024-04-25T02:08:49.567 INFO:tasks.workunit.client.0.smithi077.stdout:6/489: rename de/d12/d25/d4b/c65 to de/d15/ca0 0 2024-04-25T02:08:49.568 INFO:tasks.workunit.client.0.smithi077.stdout:6/490: getdents de/d95 0 2024-04-25T02:08:49.570 INFO:tasks.workunit.client.0.smithi077.stdout:6/491: mknod de/d5b/ca1 0 2024-04-25T02:08:49.570 INFO:tasks.workunit.client.0.smithi077.stdout:6/492: creat de/d15/d36/fa2 x:0 0 0 2024-04-25T02:08:49.572 INFO:tasks.workunit.client.0.smithi077.stdout:6/493: symlink de/d53/d6f/la3 0 2024-04-25T02:08:49.573 INFO:tasks.workunit.client.0.smithi077.stdout:6/494: readlink de/d12/d25/l57 0 2024-04-25T02:08:49.573 INFO:tasks.workunit.client.0.smithi077.stdout:6/495: truncate de/d12/d25/f9f 984914 0 2024-04-25T02:08:49.574 INFO:tasks.workunit.client.0.smithi077.stdout:6/496: write de/d12/d25/f66 [1039677,4917] 0 2024-04-25T02:08:49.575 INFO:tasks.workunit.client.0.smithi077.stdout:0/404: dwrite d2/d17/d1d/f3d [0,4194304] 0 2024-04-25T02:08:49.576 INFO:tasks.workunit.client.0.smithi077.stdout:5/415: dwrite d0/d2/d20/d23/d4a/f5c [0,4194304] 0 2024-04-25T02:08:49.576 INFO:tasks.workunit.client.0.smithi077.stdout:6/497: unlink de/d12/d25/f29 0 2024-04-25T02:08:49.576 INFO:tasks.workunit.client.0.smithi077.stdout:6/498: write de/d12/d25/f66 [1682376,27359] 0 2024-04-25T02:08:49.576 INFO:tasks.workunit.client.0.smithi077.stdout:6/499: chown de/d12/d25/d44 2 1 2024-04-25T02:08:49.576 INFO:tasks.workunit.client.0.smithi077.stdout:6/500: creat de/d15/d36/fa4 x:0 0 0 2024-04-25T02:08:49.576 INFO:tasks.workunit.client.0.smithi077.stdout:6/501: truncate de/d53/f7c 233034 0 2024-04-25T02:08:49.576 INFO:tasks.workunit.client.0.smithi077.stdout:0/405: symlink d2/d17/d1d/l8b 0 2024-04-25T02:08:49.579 INFO:tasks.workunit.client.0.smithi077.stdout:5/416: rmdir d0/d2/d20/d23 39 2024-04-25T02:08:49.580 INFO:tasks.workunit.client.0.smithi077.stdout:5/417: fdatasync d0/d2/d3/d1d/f1f 0 2024-04-25T02:08:49.580 INFO:tasks.workunit.client.0.smithi077.stdout:6/502: getdents de/d12/d25/d3a 0 2024-04-25T02:08:49.582 INFO:tasks.workunit.client.0.smithi077.stdout:6/503: rename de/d15/d36/l4f to de/d12/d25/la5 0 2024-04-25T02:08:49.583 INFO:tasks.workunit.client.0.smithi077.stdout:0/406: write d2/d8/d10/f18 [1095602,28265] 0 2024-04-25T02:08:49.584 INFO:tasks.workunit.client.0.smithi077.stdout:6/504: mkdir de/d5b/da6 0 2024-04-25T02:08:49.585 INFO:tasks.workunit.client.0.smithi077.stdout:5/418: dread d0/f85 [0,4194304] 0 2024-04-25T02:08:49.585 INFO:tasks.workunit.client.0.smithi077.stdout:6/505: stat de/d12/d25/d38/l4c 0 2024-04-25T02:08:49.585 INFO:tasks.workunit.client.0.smithi077.stdout:5/419: chown d0/d25/f8c 159667 1 2024-04-25T02:08:49.585 INFO:tasks.workunit.client.0.smithi077.stdout:6/506: truncate de/d12/d25/f9f 1286721 0 2024-04-25T02:08:49.585 INFO:tasks.workunit.client.0.smithi077.stdout:5/420: fdatasync d0/d2/d3/d9/d39/d44/d5f/f60 0 2024-04-25T02:08:49.589 INFO:tasks.workunit.client.0.smithi077.stdout:2/406: dwrite d2/d9/f17 [4194304,4194304] 0 2024-04-25T02:08:49.590 INFO:tasks.workunit.client.0.smithi077.stdout:3/373: dwrite d0/d2/de/d48/f2c [0,4194304] 0 2024-04-25T02:08:49.590 INFO:tasks.workunit.client.0.smithi077.stdout:3/374: stat d0/d3e/d42/c4c 0 2024-04-25T02:08:49.590 INFO:tasks.workunit.client.0.smithi077.stdout:9/441: dwrite df/f2e [0,4194304] 0 2024-04-25T02:08:49.590 INFO:tasks.workunit.client.0.smithi077.stdout:7/359: dwrite d4/d13/d18/d24/f3b [0,4194304] 0 2024-04-25T02:08:49.590 INFO:tasks.workunit.client.0.smithi077.stdout:4/419: dwrite d0/d14/d21/d39/f3b [0,4194304] 0 2024-04-25T02:08:49.590 INFO:tasks.workunit.client.0.smithi077.stdout:4/420: write d0/d14/d60/d62/f8d [483424,118179] 0 2024-04-25T02:08:49.590 INFO:tasks.workunit.client.0.smithi077.stdout:1/379: dwrite db/f12 [0,4194304] 0 2024-04-25T02:08:49.594 INFO:tasks.workunit.client.0.smithi077.stdout:2/407: symlink d2/d9/d19/d2c/d72/l80 0 2024-04-25T02:08:49.594 INFO:tasks.workunit.client.0.smithi077.stdout:2/408: creat d2/d9/d19/d1c/f81 x:0 0 0 2024-04-25T02:08:49.596 INFO:tasks.workunit.client.0.smithi077.stdout:9/442: symlink df/d60/d87/l9a 0 2024-04-25T02:08:49.598 INFO:tasks.workunit.client.0.smithi077.stdout:9/443: write df/d1b/d56/f59 [362363,5497] 0 2024-04-25T02:08:49.600 INFO:tasks.workunit.client.0.smithi077.stdout:7/360: truncate d4/d13/d18/d2d/d30/f63 249615 0 2024-04-25T02:08:49.600 INFO:tasks.workunit.client.0.smithi077.stdout:7/361: chown d4/f50 1168866059 1 2024-04-25T02:08:49.603 INFO:tasks.workunit.client.0.smithi077.stdout:4/421: write d0/d14/d21/d39/da/d12/d35/d3e/f36 [3929811,33731] 0 2024-04-25T02:08:49.605 INFO:tasks.workunit.client.0.smithi077.stdout:1/380: rename db/df/d14/d50/c63 to db/d11/d32/c7b 0 2024-04-25T02:08:49.605 INFO:tasks.workunit.client.0.smithi077.stdout:1/381: fdatasync db/d26/f73 0 2024-04-25T02:08:49.607 INFO:tasks.workunit.client.0.smithi077.stdout:2/409: mkdir d2/d9/d18/d1b/d82 0 2024-04-25T02:08:49.608 INFO:tasks.workunit.client.0.smithi077.stdout:9/444: symlink df/d1b/d48/l9b 0 2024-04-25T02:08:49.608 INFO:tasks.workunit.client.0.smithi077.stdout:9/445: truncate df/d1b/f69 686104 0 2024-04-25T02:08:49.609 INFO:tasks.workunit.client.0.smithi077.stdout:7/362: creat d4/d13/d5b/f82 x:0 0 0 2024-04-25T02:08:49.611 INFO:tasks.workunit.client.0.smithi077.stdout:1/382: rmdir db/df/d14/d33 39 2024-04-25T02:08:49.612 INFO:tasks.workunit.client.0.smithi077.stdout:9/446: symlink df/d1b/l9c 0 2024-04-25T02:08:49.613 INFO:tasks.workunit.client.0.smithi077.stdout:4/422: rename d0/d14/d21/d39/da/d12/l65 to d0/d14/d21/d39/l93 0 2024-04-25T02:08:49.615 INFO:tasks.workunit.client.0.smithi077.stdout:1/383: creat db/d11/d42/f7c x:0 0 0 2024-04-25T02:08:49.615 INFO:tasks.workunit.client.0.smithi077.stdout:1/384: dread - db/f59 zero size 2024-04-25T02:08:49.615 INFO:tasks.workunit.client.0.smithi077.stdout:2/410: write d2/d9/fb [3254202,13055] 0 2024-04-25T02:08:49.617 INFO:tasks.workunit.client.0.smithi077.stdout:9/447: rename le to df/d60/l9d 0 2024-04-25T02:08:49.619 INFO:tasks.workunit.client.0.smithi077.stdout:4/423: creat d0/d14/d79/f94 x:0 0 0 2024-04-25T02:08:49.619 INFO:tasks.workunit.client.0.smithi077.stdout:4/424: getdents d0/d14/d60/d86/d34 0 2024-04-25T02:08:49.619 INFO:tasks.workunit.client.0.smithi077.stdout:4/425: read - d0/d14/d79/f94 zero size 2024-04-25T02:08:49.620 INFO:tasks.workunit.client.0.smithi077.stdout:1/385: mknod db/d11/d32/c7d 0 2024-04-25T02:08:49.620 INFO:tasks.workunit.client.0.smithi077.stdout:1/386: stat db/df/d14/d3e/d69/l72 0 2024-04-25T02:08:49.621 INFO:tasks.workunit.client.0.smithi077.stdout:9/448: truncate df/f3c 2645712 0 2024-04-25T02:08:49.621 INFO:tasks.workunit.client.0.smithi077.stdout:6/507: dwrite f1 [0,4194304] 0 2024-04-25T02:08:49.622 INFO:tasks.workunit.client.0.smithi077.stdout:1/387: rmdir db/df/d56/d5d 39 2024-04-25T02:08:49.624 INFO:tasks.workunit.client.0.smithi077.stdout:9/449: creat df/d1b/d48/d86/f9e x:0 0 0 2024-04-25T02:08:49.624 INFO:tasks.workunit.client.0.smithi077.stdout:9/450: truncate df/d1b/f20 4321152 0 2024-04-25T02:08:49.628 INFO:tasks.workunit.client.0.smithi077.stdout:2/411: dread d2/f5 [0,4194304] 0 2024-04-25T02:08:49.628 INFO:tasks.workunit.client.0.smithi077.stdout:2/412: chown d2/d9/d19/d2c/d72 3 1 2024-04-25T02:08:49.628 INFO:tasks.workunit.client.0.smithi077.stdout:2/413: chown d2/d9/l21 1275377 1 2024-04-25T02:08:49.630 INFO:tasks.workunit.client.0.smithi077.stdout:1/388: link db/df/d14/d33/d34/d66/c78 db/df/d56/d5d/c7e 0 2024-04-25T02:08:49.631 INFO:tasks.workunit.client.0.smithi077.stdout:0/407: dwrite d2/d27/d2d/f2f [0,4194304] 0 2024-04-25T02:08:49.631 INFO:tasks.workunit.client.0.smithi077.stdout:0/408: rename d2 to d2/d17/d4e/d8c 22 2024-04-25T02:08:49.631 INFO:tasks.workunit.client.0.smithi077.stdout:0/409: fsync d2/d17/d1d/d34/d4c/f72 0 2024-04-25T02:08:49.631 INFO:tasks.workunit.client.0.smithi077.stdout:5/421: dwrite d0/f50 [0,4194304] 0 2024-04-25T02:08:49.633 INFO:tasks.workunit.client.0.smithi077.stdout:7/363: dwrite d4/f50 [0,4194304] 0 2024-04-25T02:08:49.633 INFO:tasks.workunit.client.0.smithi077.stdout:3/375: dwrite d0/d2/d83/f86 [0,4194304] 0 2024-04-25T02:08:49.633 INFO:tasks.workunit.client.0.smithi077.stdout:1/389: mknod db/df/d56/d5d/d77/c7f 0 2024-04-25T02:08:49.637 INFO:tasks.workunit.client.0.smithi077.stdout:0/410: creat d2/d17/d1d/d34/d83/f8d x:0 0 0 2024-04-25T02:08:49.637 INFO:tasks.workunit.client.0.smithi077.stdout:0/411: creat d2/d27/f8e x:0 0 0 2024-04-25T02:08:49.639 INFO:tasks.workunit.client.0.smithi077.stdout:6/508: dread f1 [0,4194304] 0 2024-04-25T02:08:49.644 INFO:tasks.workunit.client.0.smithi077.stdout:4/426: dwrite d0/f6b [0,4194304] 0 2024-04-25T02:08:49.662 INFO:tasks.workunit.client.0.smithi077.stdout:3/376: unlink d0/d3e/d42/d64/f79 0 2024-04-25T02:08:49.663 INFO:tasks.workunit.client.0.smithi077.stdout:1/390: mknod db/d11/d42/d43/c80 0 2024-04-25T02:08:49.664 INFO:tasks.workunit.client.0.smithi077.stdout:6/509: rmdir de/d3b 39 2024-04-25T02:08:49.667 INFO:tasks.workunit.client.0.smithi077.stdout:4/427: unlink d0/d14/d60/d86/d34/f41 0 2024-04-25T02:08:49.667 INFO:tasks.workunit.client.0.smithi077.stdout:9/451: dwrite df/d1b/d48/d86/f8c [0,4194304] 0 2024-04-25T02:08:49.670 INFO:tasks.workunit.client.0.smithi077.stdout:7/364: dwrite d4/f50 [0,4194304] 0 2024-04-25T02:08:49.670 INFO:tasks.workunit.client.0.smithi077.stdout:7/365: creat d4/d13/d66/f83 x:0 0 0 2024-04-25T02:08:49.671 INFO:tasks.workunit.client.0.smithi077.stdout:0/412: dwrite d2/d27/d2d/f2f [4194304,4194304] 0 2024-04-25T02:08:49.673 INFO:tasks.workunit.client.0.smithi077.stdout:2/414: dwrite d2/d9/d19/d2c/f5b [0,4194304] 0 2024-04-25T02:08:49.679 INFO:tasks.workunit.client.0.smithi077.stdout:6/510: write f9 [261928,2909] 0 2024-04-25T02:08:49.679 INFO:tasks.workunit.client.0.smithi077.stdout:6/511: creat de/d12/fa7 x:0 0 0 2024-04-25T02:08:49.680 INFO:tasks.workunit.client.0.smithi077.stdout:6/512: dread de/d12/d25/d4b/f79 [0,4194304] 0 2024-04-25T02:08:49.681 INFO:tasks.workunit.client.0.smithi077.stdout:2/415: mkdir d2/d9/d19/d1c/d3f/d53/d83 0 2024-04-25T02:08:49.684 INFO:tasks.workunit.client.0.smithi077.stdout:6/513: symlink de/d15/la8 0 2024-04-25T02:08:49.687 INFO:tasks.workunit.client.0.smithi077.stdout:6/514: mknod de/d95/ca9 0 2024-04-25T02:08:49.688 INFO:tasks.workunit.client.0.smithi077.stdout:6/515: truncate de/d12/d25/f52 690873 0 2024-04-25T02:08:49.688 INFO:tasks.workunit.client.0.smithi077.stdout:6/516: chown de/d15/la8 8138524 1 2024-04-25T02:08:49.688 INFO:tasks.workunit.client.0.smithi077.stdout:6/517: write de/d55/f8f [190776,58963] 0 2024-04-25T02:08:49.697 INFO:tasks.workunit.client.0.smithi077.stdout:8/447: sync 2024-04-25T02:08:49.703 INFO:tasks.workunit.client.0.smithi077.stdout:3/377: dwrite d0/d2/de/d48/d15/f56 [0,4194304] 0 2024-04-25T02:08:49.704 INFO:tasks.workunit.client.0.smithi077.stdout:3/378: write d0/d2/f41 [4904931,67249] 0 2024-04-25T02:08:49.705 INFO:tasks.workunit.client.0.smithi077.stdout:3/379: mknod d0/d3e/d62/d6a/c8b 0 2024-04-25T02:08:49.713 INFO:tasks.workunit.client.0.smithi077.stdout:4/428: dwrite d0/d14/d21/d39/da/d12/d35/f52 [0,4194304] 0 2024-04-25T02:08:49.715 INFO:tasks.workunit.client.0.smithi077.stdout:7/366: dwrite d4/d13/d18/d2d/f43 [0,4194304] 0 2024-04-25T02:08:49.716 INFO:tasks.workunit.client.0.smithi077.stdout:4/429: rename d0/d14/d60/d86/d25/l29 to d0/d14/d21/d39/da/d12/d35/l95 0 2024-04-25T02:08:49.718 INFO:tasks.workunit.client.0.smithi077.stdout:1/391: dwrite db/fd [4194304,4194304] 0 2024-04-25T02:08:49.718 INFO:tasks.workunit.client.0.smithi077.stdout:0/413: dwrite d2/d8/d10/f67 [0,4194304] 0 2024-04-25T02:08:49.718 INFO:tasks.workunit.client.0.smithi077.stdout:0/414: readlink d2/d8/d10/l7f 0 2024-04-25T02:08:49.719 INFO:tasks.workunit.client.0.smithi077.stdout:0/415: write d2/d17/d4e/f8a [678641,57630] 0 2024-04-25T02:08:49.719 INFO:tasks.workunit.client.0.smithi077.stdout:4/430: rename d0/d14/d60/d86/d3c to d0/d14/d60/d86/d96 0 2024-04-25T02:08:49.720 INFO:tasks.workunit.client.0.smithi077.stdout:4/431: chown d0/d14/d21/d39/da/d12/d35/l55 17 1 2024-04-25T02:08:49.721 INFO:tasks.workunit.client.0.smithi077.stdout:1/392: truncate f1 3726346 0 2024-04-25T02:08:49.722 INFO:tasks.workunit.client.0.smithi077.stdout:0/416: mknod d2/d9/d71/c8f 0 2024-04-25T02:08:49.723 INFO:tasks.workunit.client.0.smithi077.stdout:4/432: rename d0/d14/d21/d39/da/d12/f3d to d0/d14/d60/d86/d96/f97 0 2024-04-25T02:08:49.724 INFO:tasks.workunit.client.0.smithi077.stdout:1/393: mkdir db/d11/d5c/d81 0 2024-04-25T02:08:49.725 INFO:tasks.workunit.client.0.smithi077.stdout:0/417: mknod d2/d9/d71/c90 0 2024-04-25T02:08:49.726 INFO:tasks.workunit.client.0.smithi077.stdout:7/367: dread d4/d13/d18/d24/d3f/f44 [0,4194304] 0 2024-04-25T02:08:49.726 INFO:tasks.workunit.client.0.smithi077.stdout:0/418: creat d2/d9/d71/d74/f91 x:0 0 0 2024-04-25T02:08:49.728 INFO:tasks.workunit.client.0.smithi077.stdout:7/368: truncate d4/f50 1831487 0 2024-04-25T02:08:49.728 INFO:tasks.workunit.client.0.smithi077.stdout:7/369: readlink d4/d13/l25 0 2024-04-25T02:08:49.728 INFO:tasks.workunit.client.0.smithi077.stdout:7/370: getdents d4/d13/d2c 0 2024-04-25T02:08:49.729 INFO:tasks.workunit.client.0.smithi077.stdout:0/419: getdents d2/d27 0 2024-04-25T02:08:49.730 INFO:tasks.workunit.client.0.smithi077.stdout:7/371: creat d4/d7c/f84 x:0 0 0 2024-04-25T02:08:49.730 INFO:tasks.workunit.client.0.smithi077.stdout:2/416: dwrite d2/d9/d18/fa [0,4194304] 0 2024-04-25T02:08:49.732 INFO:tasks.workunit.client.0.smithi077.stdout:2/417: mkdir d2/d9/d2f/d84 0 2024-04-25T02:08:49.732 INFO:tasks.workunit.client.0.smithi077.stdout:8/448: dwrite d3/da/db/df/d2b/d37/f4d [0,4194304] 0 2024-04-25T02:08:49.732 INFO:tasks.workunit.client.0.smithi077.stdout:3/380: dwrite d0/f23 [0,4194304] 0 2024-04-25T02:08:49.732 INFO:tasks.workunit.client.0.smithi077.stdout:6/518: dwrite de/d12/d25/d44/f5d [0,4194304] 0 2024-04-25T02:08:49.733 INFO:tasks.workunit.client.0.smithi077.stdout:6/519: truncate de/d12/d25/f66 2433591 0 2024-04-25T02:08:49.733 INFO:tasks.workunit.client.0.smithi077.stdout:6/520: creat de/d12/d25/d44/faa x:0 0 0 2024-04-25T02:08:49.733 INFO:tasks.workunit.client.0.smithi077.stdout:2/418: rmdir d2/d9/d18/d1b/d82 0 2024-04-25T02:08:49.733 INFO:tasks.workunit.client.0.smithi077.stdout:2/419: fdatasync d2/d28/f32 0 2024-04-25T02:08:49.734 INFO:tasks.workunit.client.0.smithi077.stdout:8/449: symlink d3/d81/l87 0 2024-04-25T02:08:49.745 INFO:tasks.workunit.client.0.smithi077.stdout:3/381: symlink d0/d3e/d42/d64/d88/l8c 0 2024-04-25T02:08:49.750 INFO:tasks.workunit.client.0.smithi077.stdout:6/521: creat de/d95/fab x:0 0 0 2024-04-25T02:08:49.753 INFO:tasks.workunit.client.0.smithi077.stdout:2/420: mknod d2/d59/d79/c85 0 2024-04-25T02:08:49.754 INFO:tasks.workunit.client.0.smithi077.stdout:0/420: dwrite d2/d27/f8e [0,4194304] 0 2024-04-25T02:08:49.754 INFO:tasks.workunit.client.0.smithi077.stdout:7/372: dwrite d4/d13/f2f [0,4194304] 0 2024-04-25T02:08:49.756 INFO:tasks.workunit.client.0.smithi077.stdout:8/450: link d3/da/db/c19 d3/da/db/df/d2b/d70/d7f/c88 0 2024-04-25T02:08:49.757 INFO:tasks.workunit.client.0.smithi077.stdout:6/522: stat de/d12/d25/c96 0 2024-04-25T02:08:49.757 INFO:tasks.workunit.client.0.smithi077.stdout:6/523: fsync de/d12/f28 0 2024-04-25T02:08:49.759 INFO:tasks.workunit.client.0.smithi077.stdout:1/394: rename db/d11 to db/df/d14/d4d/d82 0 2024-04-25T02:08:49.760 INFO:tasks.workunit.client.0.smithi077.stdout:2/421: mkdir d2/d9/d19/d1c/d3f/d53/d86 0 2024-04-25T02:08:49.763 INFO:tasks.workunit.client.0.smithi077.stdout:0/421: truncate d2/d8/f26 281119 0 2024-04-25T02:08:49.764 INFO:tasks.workunit.client.0.smithi077.stdout:3/382: dwrite d0/d40/f57 [0,4194304] 0 2024-04-25T02:08:49.766 INFO:tasks.workunit.client.0.smithi077.stdout:8/451: link d3/da/d27/d16/d6b/f80 d3/da/db/df/d30/f89 0 2024-04-25T02:08:49.766 INFO:tasks.workunit.client.0.smithi077.stdout:8/452: write d3/da/d27/d16/f1c [3945920,53181] 0 2024-04-25T02:08:49.766 INFO:tasks.workunit.client.0.smithi077.stdout:8/453: dread - d3/da/d27/d16/d6b/f80 zero size 2024-04-25T02:08:49.766 INFO:tasks.workunit.client.0.smithi077.stdout:8/454: creat d3/da/f8a x:0 0 0 2024-04-25T02:08:49.766 INFO:tasks.workunit.client.0.smithi077.stdout:8/455: write d3/fd [564433,68288] 0 2024-04-25T02:08:49.766 INFO:tasks.workunit.client.0.smithi077.stdout:8/456: creat d3/da/db/df/d30/f8b x:0 0 0 2024-04-25T02:08:49.766 INFO:tasks.workunit.client.0.smithi077.stdout:8/457: read - d3/da/db/f4c zero size 2024-04-25T02:08:49.767 INFO:tasks.workunit.client.0.smithi077.stdout:6/524: symlink de/d55/lac 0 2024-04-25T02:08:49.770 INFO:tasks.workunit.client.0.smithi077.stdout:7/373: rename d4/d13/d18/d2d/d56/d68/l6d to d4/d13/d5b/l85 0 2024-04-25T02:08:49.771 INFO:tasks.workunit.client.0.smithi077.stdout:1/395: mknod db/df/c83 0 2024-04-25T02:08:49.772 INFO:tasks.workunit.client.0.smithi077.stdout:2/422: mknod d2/d9/d19/d1c/d3f/d53/d83/c87 0 2024-04-25T02:08:49.774 INFO:tasks.workunit.client.0.smithi077.stdout:3/383: dread d0/d17/f7e [0,4194304] 0 2024-04-25T02:08:49.777 INFO:tasks.workunit.client.0.smithi077.stdout:7/374: write d4/f12 [3715733,111784] 0 2024-04-25T02:08:49.778 INFO:tasks.workunit.client.0.smithi077.stdout:8/458: mkdir d3/da/d27/d16/d8c 0 2024-04-25T02:08:49.778 INFO:tasks.workunit.client.0.smithi077.stdout:8/459: chown d3/l38 20857 1 2024-04-25T02:08:49.779 INFO:tasks.workunit.client.0.smithi077.stdout:6/525: creat de/d5b/da6/fad x:0 0 0 2024-04-25T02:08:49.780 INFO:tasks.workunit.client.0.smithi077.stdout:0/422: dwrite d2/d9/d2a/f48 [0,4194304] 0 2024-04-25T02:08:49.780 INFO:tasks.workunit.client.0.smithi077.stdout:0/423: creat d2/d17/d1d/d34/d83/f92 x:0 0 0 2024-04-25T02:08:49.780 INFO:tasks.workunit.client.0.smithi077.stdout:0/424: readlink d2/d8/d10/l19 0 2024-04-25T02:08:49.781 INFO:tasks.workunit.client.0.smithi077.stdout:2/423: creat d2/f88 x:0 0 0 2024-04-25T02:08:49.783 INFO:tasks.workunit.client.0.smithi077.stdout:7/375: truncate d4/d13/d18/d2d/f43 2602192 0 2024-04-25T02:08:49.783 INFO:tasks.workunit.client.0.smithi077.stdout:7/376: creat d4/d13/d18/d2d/d30/f86 x:0 0 0 2024-04-25T02:08:49.783 INFO:tasks.workunit.client.0.smithi077.stdout:7/377: creat d4/d13/d18/d2d/f87 x:0 0 0 2024-04-25T02:08:49.784 INFO:tasks.workunit.client.0.smithi077.stdout:5/422: sync 2024-04-25T02:08:49.784 INFO:tasks.workunit.client.0.smithi077.stdout:5/423: fsync d0/d25/f30 0 2024-04-25T02:08:49.784 INFO:tasks.workunit.client.0.smithi077.stdout:5/424: chown d0/d2/d3/d9/f2a 8116 1 2024-04-25T02:08:49.785 INFO:tasks.workunit.client.0.smithi077.stdout:9/452: sync 2024-04-25T02:08:49.785 INFO:tasks.workunit.client.0.smithi077.stdout:9/453: readlink df/d60/d87/l9a 0 2024-04-25T02:08:49.785 INFO:tasks.workunit.client.0.smithi077.stdout:9/454: chown df/d1b/d56/f93 34 1 2024-04-25T02:08:49.785 INFO:tasks.workunit.client.0.smithi077.stdout:8/460: link d3/da/f78 d3/da/db/df/d2b/f8d 0 2024-04-25T02:08:49.789 INFO:tasks.workunit.client.0.smithi077.stdout:1/396: rename db/c51 to db/df/d14/d4d/d82/c84 0 2024-04-25T02:08:49.789 INFO:tasks.workunit.client.0.smithi077.stdout:1/397: chown db/df/d14/d4d/d82/d42/d43 125275599 1 2024-04-25T02:08:49.789 INFO:tasks.workunit.client.0.smithi077.stdout:1/398: fdatasync db/df/d14/d4d/d82/d42/f7c 0 2024-04-25T02:08:49.794 INFO:tasks.workunit.client.0.smithi077.stdout:0/425: dread d2/d17/d1d/d34/f36 [0,4194304] 0 2024-04-25T02:08:49.794 INFO:tasks.workunit.client.0.smithi077.stdout:0/426: creat d2/d9/d71/d74/f93 x:0 0 0 2024-04-25T02:08:49.794 INFO:tasks.workunit.client.0.smithi077.stdout:2/424: dread d2/d9/d19/d2c/f5b [0,4194304] 0 2024-04-25T02:08:49.795 INFO:tasks.workunit.client.0.smithi077.stdout:1/399: dread db/df/d1b/f6f [0,4194304] 0 2024-04-25T02:08:49.795 INFO:tasks.workunit.client.0.smithi077.stdout:7/378: mkdir d4/d13/d18/d2d/d56/d68/d88 0 2024-04-25T02:08:49.795 INFO:tasks.workunit.client.0.smithi077.stdout:7/379: readlink d4/d13/d18/d24/l7e 0 2024-04-25T02:08:49.797 INFO:tasks.workunit.client.0.smithi077.stdout:5/425: creat d0/d2/d3/d9/d39/d3c/f91 x:0 0 0 2024-04-25T02:08:49.797 INFO:tasks.workunit.client.0.smithi077.stdout:3/384: dwrite d0/d2/f35 [0,4194304] 0 2024-04-25T02:08:49.800 INFO:tasks.workunit.client.0.smithi077.stdout:2/425: mkdir d2/d9/d18/d31/d7c/d89 0 2024-04-25T02:08:49.801 INFO:tasks.workunit.client.0.smithi077.stdout:7/380: mknod d4/d13/d18/c89 0 2024-04-25T02:08:49.801 INFO:tasks.workunit.client.0.smithi077.stdout:7/381: chown d4/d13/d5b/f5d 7 1 2024-04-25T02:08:49.801 INFO:tasks.workunit.client.0.smithi077.stdout:7/382: creat d4/d13/d18/d2d/d30/f8a x:0 0 0 2024-04-25T02:08:49.801 INFO:tasks.workunit.client.0.smithi077.stdout:7/383: write d4/d13/d18/d2d/d30/f86 [42365,27669] 0 2024-04-25T02:08:49.805 INFO:tasks.workunit.client.0.smithi077.stdout:5/426: dread d0/d2/d3/d9/d39/d44/f53 [0,4194304] 0 2024-04-25T02:08:49.806 INFO:tasks.workunit.client.0.smithi077.stdout:3/385: rmdir d0/d17/d4b/d59 39 2024-04-25T02:08:49.811 INFO:tasks.workunit.client.0.smithi077.stdout:6/526: dwrite de/d5b/f82 [0,4194304] 0 2024-04-25T02:08:49.814 INFO:tasks.workunit.client.0.smithi077.stdout:7/384: dread d4/d13/f2f [0,4194304] 0 2024-04-25T02:08:49.814 INFO:tasks.workunit.client.0.smithi077.stdout:3/386: dread d0/d17/f5d [0,4194304] 0 2024-04-25T02:08:49.814 INFO:tasks.workunit.client.0.smithi077.stdout:7/385: write d4/d13/d18/d24/d3f/d58/f7a [421534,126341] 0 2024-04-25T02:08:49.815 INFO:tasks.workunit.client.0.smithi077.stdout:7/386: stat d4/d13/l25 0 2024-04-25T02:08:49.818 INFO:tasks.workunit.client.0.smithi077.stdout:3/387: creat d0/d3e/d62/f8d x:0 0 0 2024-04-25T02:08:49.819 INFO:tasks.workunit.client.0.smithi077.stdout:7/387: mkdir d4/d13/d5b/d8b 0 2024-04-25T02:08:49.819 INFO:tasks.workunit.client.0.smithi077.stdout:7/388: fsync d4/d13/d18/d2d/f47 0 2024-04-25T02:08:49.827 INFO:tasks.workunit.client.0.smithi077.stdout:9/455: dwrite df/d1b/f96 [0,4194304] 0 2024-04-25T02:08:49.827 INFO:tasks.workunit.client.0.smithi077.stdout:2/426: dwrite d2/d9/d19/d1c/d3f/f40 [0,4194304] 0 2024-04-25T02:08:49.827 INFO:tasks.workunit.client.0.smithi077.stdout:2/427: chown d2/d9/d56 3585 1 2024-04-25T02:08:49.827 INFO:tasks.workunit.client.0.smithi077.stdout:2/428: chown d2/d9/d19/l4f 2960333 1 2024-04-25T02:08:49.827 INFO:tasks.workunit.client.0.smithi077.stdout:2/429: getdents d2/d9/d2f/d84 0 2024-04-25T02:08:49.828 INFO:tasks.workunit.client.0.smithi077.stdout:1/400: dwrite f1 [0,4194304] 0 2024-04-25T02:08:49.830 INFO:tasks.workunit.client.0.smithi077.stdout:5/427: dwrite d0/d25/f1a [8388608,4194304] 0 2024-04-25T02:08:49.830 INFO:tasks.workunit.client.0.smithi077.stdout:8/461: truncate d3/fd 4163015 0 2024-04-25T02:08:49.830 INFO:tasks.workunit.client.0.smithi077.stdout:8/462: fsync d3/f6 0 2024-04-25T02:08:49.833 INFO:tasks.workunit.client.0.smithi077.stdout:2/430: unlink d2/d9/d19/c6c 0 2024-04-25T02:08:49.833 INFO:tasks.workunit.client.0.smithi077.stdout:2/431: write d2/d9/d18/d31/f5a [115059,122415] 0 2024-04-25T02:08:49.837 INFO:tasks.workunit.client.0.smithi077.stdout:2/432: link d2/f5 d2/d9/d19/d1c/d3f/d53/f8a 0 2024-04-25T02:08:49.839 INFO:tasks.workunit.client.0.smithi077.stdout:1/401: symlink db/l85 0 2024-04-25T02:08:49.841 INFO:tasks.workunit.client.0.smithi077.stdout:5/428: dread d0/d2/d20/d41/f4b [0,4194304] 0 2024-04-25T02:08:49.841 INFO:tasks.workunit.client.0.smithi077.stdout:5/429: write d0/d2/d20/d23/f67 [832121,112533] 0 2024-04-25T02:08:49.841 INFO:tasks.workunit.client.0.smithi077.stdout:1/402: creat db/df/d14/d4d/d82/d5c/d81/f86 x:0 0 0 2024-04-25T02:08:49.841 INFO:tasks.workunit.client.0.smithi077.stdout:1/403: truncate db/df/d14/d33/d34/f55 644959 0 2024-04-25T02:08:49.843 INFO:tasks.workunit.client.0.smithi077.stdout:5/430: mknod d0/d2/d3/d9/d39/d44/d5f/c92 0 2024-04-25T02:08:49.843 INFO:tasks.workunit.client.0.smithi077.stdout:5/431: getdents d0/d2/d1b/d38 0 2024-04-25T02:08:49.843 INFO:tasks.workunit.client.0.smithi077.stdout:5/432: write d0/d2/d3/f55 [373249,129210] 0 2024-04-25T02:08:49.843 INFO:tasks.workunit.client.0.smithi077.stdout:5/433: getdents d0/d25/d82/d87 0 2024-04-25T02:08:49.843 INFO:tasks.workunit.client.0.smithi077.stdout:5/434: creat d0/d2/d3/d9/d39/d3c/f93 x:0 0 0 2024-04-25T02:08:49.846 INFO:tasks.workunit.client.0.smithi077.stdout:4/433: sync 2024-04-25T02:08:49.846 INFO:tasks.workunit.client.0.smithi077.stdout:4/434: chown d0/d14/d60/d86/d96/f97 1044 1 2024-04-25T02:08:49.858 INFO:tasks.workunit.client.0.smithi077.stdout:9/456: dwrite df/f10 [0,4194304] 0 2024-04-25T02:08:49.858 INFO:tasks.workunit.client.0.smithi077.stdout:9/457: write df/d1b/f96 [4510664,63022] 0 2024-04-25T02:08:49.858 INFO:tasks.workunit.client.0.smithi077.stdout:2/433: dwrite d2/f5 [0,4194304] 0 2024-04-25T02:08:49.861 INFO:tasks.workunit.client.0.smithi077.stdout:8/463: dwrite d3/da/db/df/d2b/f3b [0,4194304] 0 2024-04-25T02:08:49.861 INFO:tasks.workunit.client.0.smithi077.stdout:8/464: getdents d3/da/db/df/d2b/d7b 0 2024-04-25T02:08:49.861 INFO:tasks.workunit.client.0.smithi077.stdout:8/465: write d3/f6f [872235,92747] 0 2024-04-25T02:08:49.861 INFO:tasks.workunit.client.0.smithi077.stdout:8/466: stat d3/da/db/c2c 0 2024-04-25T02:08:49.861 INFO:tasks.workunit.client.0.smithi077.stdout:2/434: link d2/d9/d56/d5c/c5d d2/d9/d18/d31/c8b 0 2024-04-25T02:08:49.862 INFO:tasks.workunit.client.0.smithi077.stdout:2/435: dread - d2/d9/d19/d1c/f81 zero size 2024-04-25T02:08:49.863 INFO:tasks.workunit.client.0.smithi077.stdout:8/467: mkdir d3/da/d27/d8e 0 2024-04-25T02:08:49.865 INFO:tasks.workunit.client.0.smithi077.stdout:2/436: rename d2/d9/d56/d5c/f65 to d2/d9/f8c 0 2024-04-25T02:08:49.866 INFO:tasks.workunit.client.0.smithi077.stdout:8/468: creat d3/da/db/df/d2b/d70/f8f x:0 0 0 2024-04-25T02:08:49.877 INFO:tasks.workunit.client.0.smithi077.stdout:2/437: write d2/d9/d18/fa [3512593,107797] 0 2024-04-25T02:08:49.879 INFO:tasks.workunit.client.0.smithi077.stdout:8/469: write d3/da/db/df/d2b/d37/f67 [2086169,74839] 0 2024-04-25T02:08:49.879 INFO:tasks.workunit.client.0.smithi077.stdout:8/470: truncate d3/da/d27/d16/d6b/f80 999411 0 2024-04-25T02:08:49.879 INFO:tasks.workunit.client.0.smithi077.stdout:8/471: dread - d3/da/db/df/d30/f8b zero size 2024-04-25T02:08:49.879 INFO:tasks.workunit.client.0.smithi077.stdout:8/472: rmdir d3/d34 39 2024-04-25T02:08:49.884 INFO:tasks.workunit.client.0.smithi077.stdout:1/404: dwrite f8 [0,4194304] 0 2024-04-25T02:08:49.884 INFO:tasks.workunit.client.0.smithi077.stdout:4/435: dwrite d0/f28 [0,4194304] 0 2024-04-25T02:08:49.886 INFO:tasks.workunit.client.0.smithi077.stdout:9/458: dwrite df/f3c [0,4194304] 0 2024-04-25T02:08:49.890 INFO:tasks.workunit.client.0.smithi077.stdout:2/438: write d2/d9/f17 [4868869,131021] 0 2024-04-25T02:08:49.890 INFO:tasks.workunit.client.0.smithi077.stdout:2/439: creat d2/d9/d18/d31/f8d x:0 0 0 2024-04-25T02:08:49.890 INFO:tasks.workunit.client.0.smithi077.stdout:2/440: chown d2/f5 6812 1 2024-04-25T02:08:49.892 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:49 smithi077 ceph-mon[26330]: pgmap v254: 65 pgs: 65 active+clean; 745 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 65 MiB/s rd, 85 MiB/s wr, 340 op/s 2024-04-25T02:08:49.892 INFO:tasks.workunit.client.0.smithi077.stdout:2/441: creat d2/d9/f8e x:0 0 0 2024-04-25T02:08:49.893 INFO:tasks.workunit.client.0.smithi077.stdout:2/442: symlink d2/d9/d19/d2c/d72/l8f 0 2024-04-25T02:08:49.894 INFO:tasks.workunit.client.0.smithi077.stdout:2/443: chown d2/d59/c62 0 1 2024-04-25T02:08:49.894 INFO:tasks.workunit.client.0.smithi077.stdout:2/444: fsync d2/d28/f32 0 2024-04-25T02:08:49.895 INFO:tasks.workunit.client.0.smithi077.stdout:4/436: write d0/d14/d60/d86/d96/f5c [2522793,70012] 0 2024-04-25T02:08:49.897 INFO:tasks.workunit.client.0.smithi077.stdout:8/473: dwrite d3/da/d27/d16/d6b/f6e [0,4194304] 0 2024-04-25T02:08:49.898 INFO:tasks.workunit.client.0.smithi077.stdout:4/437: mkdir d0/d14/d21/d39/d1d/d98 0 2024-04-25T02:08:49.899 INFO:tasks.workunit.client.0.smithi077.stdout:4/438: read d0/d14/d21/d39/f4d [267700,11778] 0 2024-04-25T02:08:49.899 INFO:tasks.workunit.client.0.smithi077.stdout:4/439: dread - d0/d14/d21/d39/d1d/f73 zero size 2024-04-25T02:08:49.901 INFO:tasks.workunit.client.0.smithi077.stdout:9/459: write df/d1b/d48/f6f [2825245,101078] 0 2024-04-25T02:08:49.904 INFO:tasks.workunit.client.0.smithi077.stdout:4/440: mknod d0/d14/d21/d39/d64/c99 0 2024-04-25T02:08:49.908 INFO:tasks.workunit.client.0.smithi077.stdout:4/441: mkdir d0/d14/d21/d39/d9a 0 2024-04-25T02:08:49.908 INFO:tasks.workunit.client.0.smithi077.stdout:4/442: fsync d0/f6b 0 2024-04-25T02:08:49.908 INFO:tasks.workunit.client.0.smithi077.stdout:4/443: stat d0/f16 0 2024-04-25T02:08:49.908 INFO:tasks.workunit.client.0.smithi077.stdout:4/444: readlink d0/d14/l4f 0 2024-04-25T02:08:49.908 INFO:tasks.workunit.client.0.smithi077.stdout:4/445: readlink d0/d14/d21/d39/da/l59 0 2024-04-25T02:08:49.912 INFO:tasks.workunit.client.0.smithi077.stdout:9/460: fdatasync df/d1b/d48/f6f 0 2024-04-25T02:08:49.912 INFO:tasks.workunit.client.0.smithi077.stdout:9/461: readlink df/d1b/d56/l61 0 2024-04-25T02:08:49.912 INFO:tasks.workunit.client.0.smithi077.stdout:2/445: dwrite d2/d28/f70 [0,4194304] 0 2024-04-25T02:08:49.914 INFO:tasks.workunit.client.0.smithi077.stdout:9/462: symlink df/d1b/d48/d75/l9f 0 2024-04-25T02:08:49.914 INFO:tasks.workunit.client.0.smithi077.stdout:9/463: fsync df/d1b/d56/d67/f78 0 2024-04-25T02:08:49.915 INFO:tasks.workunit.client.0.smithi077.stdout:2/446: mkdir d2/d9/d2f/d84/d90 0 2024-04-25T02:08:49.915 INFO:tasks.workunit.client.0.smithi077.stdout:2/447: stat d2/d9/f6a 0 2024-04-25T02:08:49.916 INFO:tasks.workunit.client.0.smithi077.stdout:9/464: rmdir df/d80 39 2024-04-25T02:08:49.917 INFO:tasks.workunit.client.0.smithi077.stdout:2/448: unlink d2/d9/d19/f3b 0 2024-04-25T02:08:49.918 INFO:tasks.workunit.client.0.smithi077.stdout:9/465: truncate df/f26 1772728 0 2024-04-25T02:08:49.924 INFO:tasks.workunit.client.0.smithi077.stdout:4/446: getdents d0/d14/d21/d39/d64 0 2024-04-25T02:08:49.924 INFO:tasks.workunit.client.0.smithi077.stdout:8/474: dwrite d3/f8 [0,4194304] 0 2024-04-25T02:08:49.925 INFO:tasks.workunit.client.0.smithi077.stdout:4/447: symlink d0/d14/d60/l9b 0 2024-04-25T02:08:49.926 INFO:tasks.workunit.client.0.smithi077.stdout:8/475: creat d3/da/db/df/d2b/d7b/f90 x:0 0 0 2024-04-25T02:08:49.929 INFO:tasks.workunit.client.0.smithi077.stdout:9/466: write df/f43 [2188838,107351] 0 2024-04-25T02:08:49.929 INFO:tasks.workunit.client.0.smithi077.stdout:9/467: write df/f39 [925419,62909] 0 2024-04-25T02:08:49.929 INFO:tasks.workunit.client.0.smithi077.stdout:9/468: write df/f37 [2570036,42246] 0 2024-04-25T02:08:49.929 INFO:tasks.workunit.client.0.smithi077.stdout:9/469: write df/f58 [728109,95856] 0 2024-04-25T02:08:49.929 INFO:tasks.workunit.client.0.smithi077.stdout:8/476: creat d3/d34/d3d/f91 x:0 0 0 2024-04-25T02:08:49.935 INFO:tasks.workunit.client.0.smithi077.stdout:2/449: dwrite d2/f88 [0,4194304] 0 2024-04-25T02:08:49.935 INFO:tasks.workunit.client.0.smithi077.stdout:2/450: write d2/d59/f71 [973609,116697] 0 2024-04-25T02:08:49.938 INFO:tasks.workunit.client.0.smithi077.stdout:8/477: truncate d3/da/d27/d16/f22 368729 0 2024-04-25T02:08:49.940 INFO:tasks.workunit.client.0.smithi077.stdout:0/427: sync 2024-04-25T02:08:49.941 INFO:tasks.workunit.client.0.smithi077.stdout:0/428: stat d2/d9/d2a/f7d 0 2024-04-25T02:08:49.941 INFO:tasks.workunit.client.0.smithi077.stdout:4/448: rmdir d0 39 2024-04-25T02:08:49.941 INFO:tasks.workunit.client.0.smithi077.stdout:4/449: chown d0/d14/d21/d39/d1d/d98 2885758 1 2024-04-25T02:08:49.941 INFO:tasks.workunit.client.0.smithi077.stdout:4/450: write d0/d14/d21/d39/f4d [745969,26630] 0 2024-04-25T02:08:49.943 INFO:tasks.workunit.client.0.smithi077.stdout:2/451: symlink d2/d59/d79/l91 0 2024-04-25T02:08:49.943 INFO:tasks.workunit.client.0.smithi077.stdout:2/452: chown d2/d9/d19/d2c 9 1 2024-04-25T02:08:49.944 INFO:tasks.workunit.client.0.smithi077.stdout:9/470: getdents df/d1b/d56/d67/d68 0 2024-04-25T02:08:49.944 INFO:tasks.workunit.client.0.smithi077.stdout:9/471: fdatasync df/f31 0 2024-04-25T02:08:49.945 INFO:tasks.workunit.client.0.smithi077.stdout:8/478: unlink d3/da/d27/d16/c53 0 2024-04-25T02:08:49.945 INFO:tasks.workunit.client.0.smithi077.stdout:8/479: write d3/da/db/df/d2b/d7b/f90 [454388,106760] 0 2024-04-25T02:08:49.946 INFO:tasks.workunit.client.0.smithi077.stdout:4/451: mknod d0/d14/d60/d62/c9c 0 2024-04-25T02:08:49.952 INFO:tasks.workunit.client.0.smithi077.stdout:4/452: rmdir d0/d14/d21/d39 39 2024-04-25T02:08:49.952 INFO:tasks.workunit.client.0.smithi077.stdout:4/453: write d0/d14/d60/d86/d25/f7e [299525,6188] 0 2024-04-25T02:08:49.954 INFO:tasks.workunit.client.0.smithi077.stdout:4/454: mkdir d0/d14/d21/d39/d9d 0 2024-04-25T02:08:49.954 INFO:tasks.workunit.client.0.smithi077.stdout:4/455: fdatasync d0/d14/d21/f26 0 2024-04-25T02:08:49.954 INFO:tasks.workunit.client.0.smithi077.stdout:4/456: fdatasync d0/d14/f81 0 2024-04-25T02:08:49.955 INFO:tasks.workunit.client.0.smithi077.stdout:4/457: creat d0/d14/d21/d39/d1d/d98/f9e x:0 0 0 2024-04-25T02:08:49.956 INFO:tasks.workunit.client.0.smithi077.stdout:4/458: mknod d0/d14/d60/d86/d25/c9f 0 2024-04-25T02:08:49.957 INFO:tasks.workunit.client.0.smithi077.stdout:4/459: chown d0/d14/d21/f2f 720173 1 2024-04-25T02:08:49.957 INFO:tasks.workunit.client.0.smithi077.stdout:4/460: creat d0/d14/d21/d39/d9a/fa0 x:0 0 0 2024-04-25T02:08:49.957 INFO:tasks.workunit.client.0.smithi077.stdout:4/461: chown d0/d14/d60/d62/c9c 15968 1 2024-04-25T02:08:49.957 INFO:tasks.workunit.client.0.smithi077.stdout:4/462: creat d0/d14/d21/d39/d1d/d98/fa1 x:0 0 0 2024-04-25T02:08:49.957 INFO:tasks.workunit.client.0.smithi077.stdout:4/463: readlink d0/d14/d21/l74 0 2024-04-25T02:08:49.957 INFO:tasks.workunit.client.0.smithi077.stdout:2/453: fsync d2/d59/f71 0 2024-04-25T02:08:49.958 INFO:tasks.workunit.client.0.smithi077.stdout:4/464: truncate d0/d14/d21/d39/da/d12/d35/f52 4166321 0 2024-04-25T02:08:49.959 INFO:tasks.workunit.client.0.smithi077.stdout:2/454: symlink d2/d9/d19/d2c/d72/l92 0 2024-04-25T02:08:49.959 INFO:tasks.workunit.client.0.smithi077.stdout:2/455: chown d2/d59/f71 2595 1 2024-04-25T02:08:49.960 INFO:tasks.workunit.client.0.smithi077.stdout:2/456: creat d2/d28/f93 x:0 0 0 2024-04-25T02:08:49.961 INFO:tasks.workunit.client.0.smithi077.stdout:2/457: dread d2/d59/f6e [0,4194304] 0 2024-04-25T02:08:49.963 INFO:tasks.workunit.client.0.smithi077.stdout:4/465: dread d0/d14/d21/d39/da/f2d [0,4194304] 0 2024-04-25T02:08:49.965 INFO:tasks.workunit.client.0.smithi077.stdout:4/466: unlink d0/d14/d60/d86/c58 0 2024-04-25T02:08:49.969 INFO:tasks.workunit.client.0.smithi077.stdout:4/467: dread d0/d14/d60/d62/f8d [0,4194304] 0 2024-04-25T02:08:49.970 INFO:tasks.workunit.client.0.smithi077.stdout:0/429: dwrite d2/d27/d2d/f6d [0,4194304] 0 2024-04-25T02:08:49.971 INFO:tasks.workunit.client.0.smithi077.stdout:0/430: fsync d2/d1c/f24 0 2024-04-25T02:08:49.971 INFO:tasks.workunit.client.0.smithi077.stdout:4/468: truncate d0/f18 531279 0 2024-04-25T02:08:49.971 INFO:tasks.workunit.client.0.smithi077.stdout:4/469: read - d0/d14/d60/d86/f6d zero size 2024-04-25T02:08:49.973 INFO:tasks.workunit.client.0.smithi077.stdout:0/431: symlink d2/d17/d1d/l94 0 2024-04-25T02:08:49.974 INFO:tasks.workunit.client.0.smithi077.stdout:4/470: symlink d0/d14/d21/d39/d9a/la2 0 2024-04-25T02:08:49.975 INFO:tasks.workunit.client.0.smithi077.stdout:0/432: rmdir d2/d27 39 2024-04-25T02:08:49.977 INFO:tasks.workunit.client.0.smithi077.stdout:9/472: dwrite df/d1b/f6e [0,4194304] 0 2024-04-25T02:08:49.977 INFO:tasks.workunit.client.0.smithi077.stdout:9/473: fdatasync df/d1b/d48/d75/f88 0 2024-04-25T02:08:49.977 INFO:tasks.workunit.client.0.smithi077.stdout:9/474: chown df/d60/l9d 1667347 1 2024-04-25T02:08:49.979 INFO:tasks.workunit.client.0.smithi077.stdout:4/471: dread d0/d14/d60/d86/d25/f45 [0,4194304] 0 2024-04-25T02:08:49.979 INFO:tasks.workunit.client.0.smithi077.stdout:2/458: dwrite d2/f88 [4194304,4194304] 0 2024-04-25T02:08:49.981 INFO:tasks.workunit.client.0.smithi077.stdout:4/472: mknod d0/d14/d21/d39/da/ca3 0 2024-04-25T02:08:49.982 INFO:tasks.workunit.client.0.smithi077.stdout:9/475: dread df/f14 [0,4194304] 0 2024-04-25T02:08:49.982 INFO:tasks.workunit.client.0.smithi077.stdout:9/476: chown df/d1b/d48/d86/f89 8016419 1 2024-04-25T02:08:49.982 INFO:tasks.workunit.client.0.smithi077.stdout:9/477: chown df/d1b/f6e 31349794 1 2024-04-25T02:08:49.983 INFO:tasks.workunit.client.0.smithi077.stdout:2/459: symlink d2/d9/d2f/l94 0 2024-04-25T02:08:49.985 INFO:tasks.workunit.client.0.smithi077.stdout:2/460: mkdir d2/d78/d95 0 2024-04-25T02:08:49.985 INFO:tasks.workunit.client.0.smithi077.stdout:0/433: dread d2/d1c/f4f [0,4194304] 0 2024-04-25T02:08:49.986 INFO:tasks.workunit.client.0.smithi077.stdout:8/480: dwrite d3/da/f45 [0,4194304] 0 2024-04-25T02:08:49.986 INFO:tasks.workunit.client.0.smithi077.stdout:2/461: creat d2/d9/d19/d1c/d3f/d53/d86/f96 x:0 0 0 2024-04-25T02:08:49.989 INFO:tasks.workunit.client.0.smithi077.stdout:9/478: dread df/f2e [0,4194304] 0 2024-04-25T02:08:49.989 INFO:tasks.workunit.client.0.smithi077.stdout:9/479: chown df/c4d 0 1 2024-04-25T02:08:49.993 INFO:tasks.workunit.client.0.smithi077.stdout:8/481: unlink d3/da/db/df/d2b/l4e 0 2024-04-25T02:08:49.993 INFO:tasks.workunit.client.0.smithi077.stdout:4/473: dread d0/d14/d60/d86/f4a [0,4194304] 0 2024-04-25T02:08:49.993 INFO:tasks.workunit.client.0.smithi077.stdout:4/474: dread - d0/d14/d21/d39/d1d/f73 zero size 2024-04-25T02:08:49.994 INFO:tasks.workunit.client.0.smithi077.stdout:2/462: getdents d2/d9/d19/d1c/d37 0 2024-04-25T02:08:49.994 INFO:tasks.workunit.client.0.smithi077.stdout:2/463: fdatasync d2/d78/f7a 0 2024-04-25T02:08:49.995 INFO:tasks.workunit.client.0.smithi077.stdout:4/475: mkdir d0/d14/d79/da4 0 2024-04-25T02:08:49.995 INFO:tasks.workunit.client.0.smithi077.stdout:4/476: getdents d0/d14/d79/da4 0 2024-04-25T02:08:49.995 INFO:tasks.workunit.client.0.smithi077.stdout:4/477: dread - d0/d14/d21/d39/da/d12/d35/d3e/f8f zero size 2024-04-25T02:08:49.998 INFO:tasks.workunit.client.0.smithi077.stdout:2/464: rename d2/d9/d18/d1b/d7b to d2/d9/d19/d1c/d3f/d53/d83/d97 0 2024-04-25T02:08:49.999 INFO:tasks.workunit.client.0.smithi077.stdout:6/527: sync 2024-04-25T02:08:50.001 INFO:tasks.workunit.client.0.smithi077.stdout:6/528: symlink de/lae 0 2024-04-25T02:08:50.001 INFO:tasks.workunit.client.0.smithi077.stdout:6/529: write de/d12/d25/d3a/f5f [96107,53631] 0 2024-04-25T02:08:50.001 INFO:tasks.workunit.client.0.smithi077.stdout:6/530: fdatasync de/d15/f3f 0 2024-04-25T02:08:50.002 INFO:tasks.workunit.client.0.smithi077.stdout:6/531: mknod de/d5b/caf 0 2024-04-25T02:08:50.002 INFO:tasks.workunit.client.0.smithi077.stdout:6/532: write de/f5a [986523,3298] 0 2024-04-25T02:08:50.004 INFO:tasks.workunit.client.0.smithi077.stdout:4/478: dread d0/d14/d21/d39/da/d12/d35/d3e/f36 [0,4194304] 0 2024-04-25T02:08:50.005 INFO:tasks.workunit.client.0.smithi077.stdout:3/388: sync 2024-04-25T02:08:50.005 INFO:tasks.workunit.client.0.smithi077.stdout:1/405: sync 2024-04-25T02:08:50.005 INFO:tasks.workunit.client.0.smithi077.stdout:5/435: sync 2024-04-25T02:08:50.005 INFO:tasks.workunit.client.0.smithi077.stdout:7/389: sync 2024-04-25T02:08:50.005 INFO:tasks.workunit.client.0.smithi077.stdout:1/406: chown db/df/d14/l57 274 1 2024-04-25T02:08:50.005 INFO:tasks.workunit.client.0.smithi077.stdout:1/407: stat db/fd 0 2024-04-25T02:08:50.005 INFO:tasks.workunit.client.0.smithi077.stdout:4/479: creat d0/d14/d60/d86/d25/fa5 x:0 0 0 2024-04-25T02:08:50.007 INFO:tasks.workunit.client.0.smithi077.stdout:5/436: creat d0/d2/d3/d9/d39/f94 x:0 0 0 2024-04-25T02:08:50.008 INFO:tasks.workunit.client.0.smithi077.stdout:5/437: write d0/d2/d20/f21 [1281795,130725] 0 2024-04-25T02:08:50.008 INFO:tasks.workunit.client.0.smithi077.stdout:5/438: readlink d0/d2/d3/d9/d39/d3c/l59 0 2024-04-25T02:08:50.008 INFO:tasks.workunit.client.0.smithi077.stdout:5/439: write d0/d2/d20/f21 [3289439,63976] 0 2024-04-25T02:08:50.008 INFO:tasks.workunit.client.0.smithi077.stdout:1/408: mknod db/df/d14/d4d/d82/d5c/d81/c87 0 2024-04-25T02:08:50.009 INFO:tasks.workunit.client.0.smithi077.stdout:3/389: dread d0/d2/de/d27/f51 [0,4194304] 0 2024-04-25T02:08:50.011 INFO:tasks.workunit.client.0.smithi077.stdout:4/480: unlink d0/d14/l24 0 2024-04-25T02:08:50.011 INFO:tasks.workunit.client.0.smithi077.stdout:4/481: write d0/d14/f33 [1263662,69735] 0 2024-04-25T02:08:50.011 INFO:tasks.workunit.client.0.smithi077.stdout:4/482: write d0/d14/d60/d86/f6d [889051,7743] 0 2024-04-25T02:08:50.012 INFO:tasks.workunit.client.0.smithi077.stdout:1/409: mknod db/df/c88 0 2024-04-25T02:08:50.013 INFO:tasks.workunit.client.0.smithi077.stdout:3/390: creat d0/d17/d4b/d59/f8e x:0 0 0 2024-04-25T02:08:50.015 INFO:tasks.workunit.client.0.smithi077.stdout:4/483: mkdir d0/d14/da6 0 2024-04-25T02:08:50.015 INFO:tasks.workunit.client.0.smithi077.stdout:4/484: write d0/d14/d21/d39/da/d12/d35/d3e/f50 [1152618,827] 0 2024-04-25T02:08:50.015 INFO:tasks.workunit.client.0.smithi077.stdout:4/485: write d0/d14/d21/d39/d1d/d98/fa1 [142625,112389] 0 2024-04-25T02:08:50.018 INFO:tasks.workunit.client.0.smithi077.stdout:1/410: rename db/df/d14/d4d/d82/c2d to db/df/d14/d4d/d82/c89 0 2024-04-25T02:08:50.018 INFO:tasks.workunit.client.0.smithi077.stdout:1/411: chown db/df/f1d 14 1 2024-04-25T02:08:50.018 INFO:tasks.workunit.client.0.smithi077.stdout:6/533: dread fd [0,4194304] 0 2024-04-25T02:08:50.020 INFO:tasks.workunit.client.0.smithi077.stdout:6/534: creat de/d53/d6f/fb0 x:0 0 0 2024-04-25T02:08:50.022 INFO:tasks.workunit.client.0.smithi077.stdout:6/535: creat de/d12/d25/d38/fb1 x:0 0 0 2024-04-25T02:08:50.022 INFO:tasks.workunit.client.0.smithi077.stdout:3/391: dread d0/d17/f37 [4194304,4194304] 0 2024-04-25T02:08:50.023 INFO:tasks.workunit.client.0.smithi077.stdout:6/536: fsync de/d12/d25/d44/faa 0 2024-04-25T02:08:50.025 INFO:tasks.workunit.client.0.smithi077.stdout:9/480: dwrite df/f44 [0,4194304] 0 2024-04-25T02:08:50.025 INFO:tasks.workunit.client.0.smithi077.stdout:9/481: fdatasync df/f44 0 2024-04-25T02:08:50.025 INFO:tasks.workunit.client.0.smithi077.stdout:5/440: dread d0/d2/d1b/d35/f4f [0,4194304] 0 2024-04-25T02:08:50.026 INFO:tasks.workunit.client.0.smithi077.stdout:6/537: rename de/d4e to de/d53/db2 0 2024-04-25T02:08:50.026 INFO:tasks.workunit.client.0.smithi077.stdout:6/538: creat de/d55/d88/fb3 x:0 0 0 2024-04-25T02:08:50.026 INFO:tasks.workunit.client.0.smithi077.stdout:6/539: write de/d12/d25/f7b [665753,78663] 0 2024-04-25T02:08:50.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:49 smithi112 ceph-mon[33313]: pgmap v254: 65 pgs: 65 active+clean; 745 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 65 MiB/s rd, 85 MiB/s wr, 340 op/s 2024-04-25T02:08:50.030 INFO:tasks.workunit.client.0.smithi077.stdout:6/540: mknod de/d55/cb4 0 2024-04-25T02:08:50.030 INFO:tasks.workunit.client.0.smithi077.stdout:6/541: read - de/d15/d36/f58 zero size 2024-04-25T02:08:50.030 INFO:tasks.workunit.client.0.smithi077.stdout:6/542: creat de/d55/d88/fb5 x:0 0 0 2024-04-25T02:08:50.031 INFO:tasks.workunit.client.0.smithi077.stdout:6/543: chown de/d12/d25/d44 3577 1 2024-04-25T02:08:50.031 INFO:tasks.workunit.client.0.smithi077.stdout:7/390: dwrite d4/fe [0,4194304] 0 2024-04-25T02:08:50.031 INFO:tasks.workunit.client.0.smithi077.stdout:2/465: dwrite d2/d9/d18/d31/f63 [0,4194304] 0 2024-04-25T02:08:50.032 INFO:tasks.workunit.client.0.smithi077.stdout:2/466: fdatasync d2/d9/d18/fa 0 2024-04-25T02:08:50.032 INFO:tasks.workunit.client.0.smithi077.stdout:2/467: chown d2/d9/d19/d1c/c46 0 1 2024-04-25T02:08:50.032 INFO:tasks.workunit.client.0.smithi077.stdout:9/482: dread df/f2e [0,4194304] 0 2024-04-25T02:08:50.032 INFO:tasks.workunit.client.0.smithi077.stdout:8/482: dwrite d3/d34/d3d/f5f [4194304,4194304] 0 2024-04-25T02:08:50.033 INFO:tasks.workunit.client.0.smithi077.stdout:6/544: creat de/d55/fb6 x:0 0 0 2024-04-25T02:08:50.033 INFO:tasks.workunit.client.0.smithi077.stdout:6/545: truncate de/d12/d25/f31 1743608 0 2024-04-25T02:08:50.037 INFO:tasks.workunit.client.0.smithi077.stdout:7/391: link d4/d13/f3c d4/d13/d18/d2d/d30/f8c 0 2024-04-25T02:08:50.038 INFO:tasks.workunit.client.0.smithi077.stdout:2/468: creat d2/d9/d18/d1b/f98 x:0 0 0 2024-04-25T02:08:50.038 INFO:tasks.workunit.client.0.smithi077.stdout:2/469: write d2/d9/f8c [2572034,10107] 0 2024-04-25T02:08:50.040 INFO:tasks.workunit.client.0.smithi077.stdout:9/483: rename df/d1b/d56/f93 to df/d1b/d48/d75/fa0 0 2024-04-25T02:08:50.042 INFO:tasks.workunit.client.0.smithi077.stdout:1/412: dwrite db/df/d14/d4d/d82/d32/f3f [0,4194304] 0 2024-04-25T02:08:50.042 INFO:tasks.workunit.client.0.smithi077.stdout:6/546: mkdir de/d55/db7 0 2024-04-25T02:08:50.042 INFO:tasks.workunit.client.0.smithi077.stdout:6/547: dread - de/d55/fb6 zero size 2024-04-25T02:08:50.043 INFO:tasks.workunit.client.0.smithi077.stdout:7/392: creat d4/d13/d18/d24/d3f/f8d x:0 0 0 2024-04-25T02:08:50.044 INFO:tasks.workunit.client.0.smithi077.stdout:3/392: dwrite d0/f3c [0,4194304] 0 2024-04-25T02:08:50.045 INFO:tasks.workunit.client.0.smithi077.stdout:3/393: stat d0/d2/de/d48/f44 0 2024-04-25T02:08:50.045 INFO:tasks.workunit.client.0.smithi077.stdout:8/483: rename d3/da/d27/f47 to d3/da/db/df/d30/f92 0 2024-04-25T02:08:50.045 INFO:tasks.workunit.client.0.smithi077.stdout:1/413: creat db/df/d14/d4d/d82/d42/d43/f8a x:0 0 0 2024-04-25T02:08:50.046 INFO:tasks.workunit.client.0.smithi077.stdout:1/414: chown db/df/d14/d4d/d82/d5c/d81/f86 0 1 2024-04-25T02:08:50.047 INFO:tasks.workunit.client.0.smithi077.stdout:9/484: dread df/d1b/d56/f6c [0,4194304] 0 2024-04-25T02:08:50.047 INFO:tasks.workunit.client.0.smithi077.stdout:6/548: rename de/d12/d25/d3a/l49 to de/d15/d36/lb8 0 2024-04-25T02:08:50.048 INFO:tasks.workunit.client.0.smithi077.stdout:2/470: read d2/d9/d18/d31/f4b [317185,70050] 0 2024-04-25T02:08:50.049 INFO:tasks.workunit.client.0.smithi077.stdout:8/484: creat d3/da/d27/d16/d8c/f93 x:0 0 0 2024-04-25T02:08:50.049 INFO:tasks.workunit.client.0.smithi077.stdout:8/485: fdatasync d3/f6f 0 2024-04-25T02:08:50.049 INFO:tasks.workunit.client.0.smithi077.stdout:8/486: stat d3/da/db/df/d2b/f1d 0 2024-04-25T02:08:50.051 INFO:tasks.workunit.client.0.smithi077.stdout:9/485: mknod df/d1b/d70/ca1 0 2024-04-25T02:08:50.052 INFO:tasks.workunit.client.0.smithi077.stdout:6/549: readlink de/d12/d25/l27 0 2024-04-25T02:08:50.053 INFO:tasks.workunit.client.0.smithi077.stdout:3/394: symlink d0/d2/de/d48/l8f 0 2024-04-25T02:08:50.055 INFO:tasks.workunit.client.0.smithi077.stdout:9/486: rename df/d1b/d48/f66 to df/fa2 0 2024-04-25T02:08:50.055 INFO:tasks.workunit.client.0.smithi077.stdout:9/487: chown df/d60/d87/c8a 4300226 1 2024-04-25T02:08:50.055 INFO:tasks.workunit.client.0.smithi077.stdout:9/488: chown df/d1b/d70/d74 5 1 2024-04-25T02:08:50.055 INFO:tasks.workunit.client.0.smithi077.stdout:1/415: read db/fd [2279920,58782] 0 2024-04-25T02:08:50.059 INFO:tasks.workunit.client.0.smithi077.stdout:6/550: link de/d12/d25/f52 de/d5b/da6/fb9 0 2024-04-25T02:08:50.060 INFO:tasks.workunit.client.0.smithi077.stdout:3/395: symlink d0/d2/d2f/d5f/l90 0 2024-04-25T02:08:50.061 INFO:tasks.workunit.client.0.smithi077.stdout:8/487: write d3/da/f78 [1977051,65481] 0 2024-04-25T02:08:50.061 INFO:tasks.workunit.client.0.smithi077.stdout:8/488: write d3/da/db/df/d2b/d37/f5a [1253716,45042] 0 2024-04-25T02:08:50.061 INFO:tasks.workunit.client.0.smithi077.stdout:1/416: chown db/c4e 0 1 2024-04-25T02:08:50.062 INFO:tasks.workunit.client.0.smithi077.stdout:3/396: truncate d0/d40/f57 3636233 0 2024-04-25T02:08:50.062 INFO:tasks.workunit.client.0.smithi077.stdout:3/397: truncate d0/f9 5044468 0 2024-04-25T02:08:50.064 INFO:tasks.workunit.client.0.smithi077.stdout:8/489: truncate d3/da/f29 2778098 0 2024-04-25T02:08:50.064 INFO:tasks.workunit.client.0.smithi077.stdout:8/490: write d3/da/d27/d16/f66 [4756640,59469] 0 2024-04-25T02:08:50.064 INFO:tasks.workunit.client.0.smithi077.stdout:6/551: dread de/d53/f61 [0,4194304] 0 2024-04-25T02:08:50.065 INFO:tasks.workunit.client.0.smithi077.stdout:1/417: chown db/df/d14/d4d/d82/c1e 297 1 2024-04-25T02:08:50.067 INFO:tasks.workunit.client.0.smithi077.stdout:6/552: mkdir de/d12/dba 0 2024-04-25T02:08:50.072 INFO:tasks.workunit.client.0.smithi077.stdout:3/398: write d0/d2/de/d27/f51 [1154273,102756] 0 2024-04-25T02:08:50.075 INFO:tasks.workunit.client.0.smithi077.stdout:3/399: mknod d0/d40/c91 0 2024-04-25T02:08:50.076 INFO:tasks.workunit.client.0.smithi077.stdout:3/400: write d0/d2/f35 [4923197,100186] 0 2024-04-25T02:08:50.076 INFO:tasks.workunit.client.0.smithi077.stdout:3/401: truncate d0/d3e/d42/d64/f72 347987 0 2024-04-25T02:08:50.076 INFO:tasks.workunit.client.0.smithi077.stdout:3/402: write d0/d2/de/d48/d15/f1d [5775084,93716] 0 2024-04-25T02:08:50.076 INFO:tasks.workunit.client.0.smithi077.stdout:3/403: chown d0/d2/d83 2 1 2024-04-25T02:08:50.077 INFO:tasks.workunit.client.0.smithi077.stdout:3/404: read d0/d3e/d62/f68 [106908,56584] 0 2024-04-25T02:08:50.079 INFO:tasks.workunit.client.0.smithi077.stdout:3/405: mknod d0/d2/d83/c92 0 2024-04-25T02:08:50.079 INFO:tasks.workunit.client.0.smithi077.stdout:3/406: chown d0/d3e/d42/c75 15 1 2024-04-25T02:08:50.080 INFO:tasks.workunit.client.0.smithi077.stdout:3/407: mkdir d0/d3e/d93 0 2024-04-25T02:08:50.081 INFO:tasks.workunit.client.0.smithi077.stdout:3/408: mknod d0/d2/de/d36/c94 0 2024-04-25T02:08:50.081 INFO:tasks.workunit.client.0.smithi077.stdout:3/409: write d0/d2/de/d48/f44 [1061887,92296] 0 2024-04-25T02:08:50.081 INFO:tasks.workunit.client.0.smithi077.stdout:6/553: dread de/d12/f17 [4194304,4194304] 0 2024-04-25T02:08:50.082 INFO:tasks.workunit.client.0.smithi077.stdout:6/554: mknod de/d5b/da6/cbb 0 2024-04-25T02:08:50.084 INFO:tasks.workunit.client.0.smithi077.stdout:7/393: dwrite d4/d13/d18/d24/f57 [0,4194304] 0 2024-04-25T02:08:50.084 INFO:tasks.workunit.client.0.smithi077.stdout:6/555: rename de/d55/fb6 to de/d12/fbc 0 2024-04-25T02:08:50.084 INFO:tasks.workunit.client.0.smithi077.stdout:6/556: dread - de/d55/d88/fb3 zero size 2024-04-25T02:08:50.086 INFO:tasks.workunit.client.0.smithi077.stdout:7/394: rmdir d4/d13/d66 39 2024-04-25T02:08:50.089 INFO:tasks.workunit.client.0.smithi077.stdout:9/489: dwrite df/d1b/d48/d86/f8c [0,4194304] 0 2024-04-25T02:08:50.089 INFO:tasks.workunit.client.0.smithi077.stdout:1/418: dwrite db/df/d14/d4d/d82/d5c/f5e [0,4194304] 0 2024-04-25T02:08:50.089 INFO:tasks.workunit.client.0.smithi077.stdout:8/491: dwrite d3/da/db/df/d30/f89 [0,4194304] 0 2024-04-25T02:08:50.101 INFO:tasks.workunit.client.0.smithi077.stdout:9/490: link df/d1b/d48/d75/d77/l7b df/d1b/d48/d75/d77/la3 0 2024-04-25T02:08:50.104 INFO:tasks.workunit.client.0.smithi077.stdout:3/410: dwrite d0/d2/de/d48/d15/f66 [0,4194304] 0 2024-04-25T02:08:50.104 INFO:tasks.workunit.client.0.smithi077.stdout:3/411: stat d0 0 2024-04-25T02:08:50.105 INFO:tasks.workunit.client.0.smithi077.stdout:7/395: dwrite d4/d13/d18/d24/d3f/d58/f7a [0,4194304] 0 2024-04-25T02:08:50.106 INFO:tasks.workunit.client.0.smithi077.stdout:8/492: creat d3/da/db/df/d2b/d37/f94 x:0 0 0 2024-04-25T02:08:50.106 INFO:tasks.workunit.client.0.smithi077.stdout:8/493: readlink d3/l12 0 2024-04-25T02:08:50.108 INFO:tasks.workunit.client.0.smithi077.stdout:9/491: rename df/c25 to df/d1b/d56/d67/d68/ca4 0 2024-04-25T02:08:50.108 INFO:tasks.workunit.client.0.smithi077.stdout:9/492: truncate df/f6b 4471807 0 2024-04-25T02:08:50.108 INFO:tasks.workunit.client.0.smithi077.stdout:9/493: fsync df/d1b/d48/d86/f89 0 2024-04-25T02:08:50.109 INFO:tasks.workunit.client.0.smithi077.stdout:3/412: creat d0/d17/d4b/d59/d81/f95 x:0 0 0 2024-04-25T02:08:50.110 INFO:tasks.workunit.client.0.smithi077.stdout:1/419: link db/df/d14/d33/d34/f36 db/df/d14/d4d/d82/f8b 0 2024-04-25T02:08:50.114 INFO:tasks.workunit.client.0.smithi077.stdout:7/396: symlink d4/d13/l8e 0 2024-04-25T02:08:50.116 INFO:tasks.workunit.client.0.smithi077.stdout:8/494: link d3/d34/d3d/f91 d3/da/db/df/d2b/f95 0 2024-04-25T02:08:50.116 INFO:tasks.workunit.client.0.smithi077.stdout:8/495: fdatasync d3/da/db/df/d30/f82 0 2024-04-25T02:08:50.118 INFO:tasks.workunit.client.0.smithi077.stdout:8/496: dread d3/d34/d3d/f42 [0,4194304] 0 2024-04-25T02:08:50.118 INFO:tasks.workunit.client.0.smithi077.stdout:8/497: chown d3/da/db 5 1 2024-04-25T02:08:50.119 INFO:tasks.workunit.client.0.smithi077.stdout:8/498: creat d3/da/d27/d16/d8c/f96 x:0 0 0 2024-04-25T02:08:50.119 INFO:tasks.workunit.client.0.smithi077.stdout:1/420: mknod db/df/d14/d4d/d82/d5c/d81/c8c 0 2024-04-25T02:08:50.119 INFO:tasks.workunit.client.0.smithi077.stdout:1/421: stat db/c4e 0 2024-04-25T02:08:50.121 INFO:tasks.workunit.client.0.smithi077.stdout:9/494: rmdir df/d1b/d48/d86 39 2024-04-25T02:08:50.121 INFO:tasks.workunit.client.0.smithi077.stdout:9/495: chown df/d1b/d48/d75/d90/l99 6154495 1 2024-04-25T02:08:50.122 INFO:tasks.workunit.client.0.smithi077.stdout:1/422: write db/df/f1d [4318429,107321] 0 2024-04-25T02:08:50.122 INFO:tasks.workunit.client.0.smithi077.stdout:1/423: write db/f59 [287009,19468] 0 2024-04-25T02:08:50.124 INFO:tasks.workunit.client.0.smithi077.stdout:8/499: truncate d3/da/db/df/d2b/d37/f67 889397 0 2024-04-25T02:08:50.125 INFO:tasks.workunit.client.0.smithi077.stdout:1/424: creat db/df/d56/d5d/d77/f8d x:0 0 0 2024-04-25T02:08:50.126 INFO:tasks.workunit.client.0.smithi077.stdout:8/500: mknod d3/da/db/df/d2b/d7b/c97 0 2024-04-25T02:08:50.128 INFO:tasks.workunit.client.0.smithi077.stdout:1/425: symlink db/df/l8e 0 2024-04-25T02:08:50.130 INFO:tasks.workunit.client.0.smithi077.stdout:1/426: mkdir db/df/d14/d4d/d82/d32/d8f 0 2024-04-25T02:08:50.141 INFO:tasks.workunit.client.0.smithi077.stdout:3/413: dwrite d0/d2/de/d48/f2c [0,4194304] 0 2024-04-25T02:08:50.141 INFO:tasks.workunit.client.0.smithi077.stdout:3/414: dread - d0/f69 zero size 2024-04-25T02:08:50.141 INFO:tasks.workunit.client.0.smithi077.stdout:1/427: read db/df/d14/d4d/d82/d32/f3f [468708,30676] 0 2024-04-25T02:08:50.144 INFO:tasks.workunit.client.0.smithi077.stdout:1/428: creat db/df/d14/d3e/d69/f90 x:0 0 0 2024-04-25T02:08:50.144 INFO:tasks.workunit.client.0.smithi077.stdout:1/429: chown db/df/d14/d4d/d82/c89 7043868 1 2024-04-25T02:08:50.149 INFO:tasks.workunit.client.0.smithi077.stdout:9/496: dwrite df/f14 [0,4194304] 0 2024-04-25T02:08:50.151 INFO:tasks.workunit.client.0.smithi077.stdout:8/501: dwrite d3/da/d27/d16/f66 [0,4194304] 0 2024-04-25T02:08:50.151 INFO:tasks.workunit.client.0.smithi077.stdout:7/397: dwrite d4/d13/d18/d2d/d30/f6b [0,4194304] 0 2024-04-25T02:08:50.151 INFO:tasks.workunit.client.0.smithi077.stdout:7/398: dread - d4/f51 zero size 2024-04-25T02:08:50.154 INFO:tasks.workunit.client.0.smithi077.stdout:8/502: truncate d3/fd 116316 0 2024-04-25T02:08:50.156 INFO:tasks.workunit.client.0.smithi077.stdout:7/399: dread d4/d13/f2f [0,4194304] 0 2024-04-25T02:08:50.156 INFO:tasks.workunit.client.0.smithi077.stdout:7/400: chown d4/d13/d18/d24/d3f/d59/c5e 15896 1 2024-04-25T02:08:50.158 INFO:tasks.workunit.client.0.smithi077.stdout:8/503: dread d3/f4 [0,4194304] 0 2024-04-25T02:08:50.160 INFO:tasks.workunit.client.0.smithi077.stdout:1/430: write db/df/d14/d33/d34/f36 [3474935,56615] 0 2024-04-25T02:08:50.160 INFO:tasks.workunit.client.0.smithi077.stdout:1/431: creat db/df/d56/d5d/d77/f91 x:0 0 0 2024-04-25T02:08:50.160 INFO:tasks.workunit.client.0.smithi077.stdout:9/497: rmdir df 39 2024-04-25T02:08:50.161 INFO:tasks.workunit.client.0.smithi077.stdout:8/504: mknod d3/da/db/df/d2b/d7b/c98 0 2024-04-25T02:08:50.162 INFO:tasks.workunit.client.0.smithi077.stdout:1/432: rename db/df/d14/d4d/d82/l61 to db/df/l92 0 2024-04-25T02:08:50.163 INFO:tasks.workunit.client.0.smithi077.stdout:9/498: creat df/d1b/d48/d75/fa5 x:0 0 0 2024-04-25T02:08:50.165 INFO:tasks.workunit.client.0.smithi077.stdout:3/415: dwrite d0/f23 [0,4194304] 0 2024-04-25T02:08:50.165 INFO:tasks.workunit.client.0.smithi077.stdout:1/433: dread db/df/d1b/f6f [0,4194304] 0 2024-04-25T02:08:50.165 INFO:tasks.workunit.client.0.smithi077.stdout:9/499: mknod df/d1b/d56/d67/d68/ca6 0 2024-04-25T02:08:50.165 INFO:tasks.workunit.client.0.smithi077.stdout:9/500: fsync df/d1b/f5d 0 2024-04-25T02:08:50.167 INFO:tasks.workunit.client.0.smithi077.stdout:8/505: rmdir d3/da/d27/d16/d6b 39 2024-04-25T02:08:50.170 INFO:tasks.workunit.client.0.smithi077.stdout:7/401: dread d4/d13/d18/d24/f57 [0,4194304] 0 2024-04-25T02:08:50.170 INFO:tasks.workunit.client.0.smithi077.stdout:7/402: chown d4/f37 55450955 1 2024-04-25T02:08:50.171 INFO:tasks.workunit.client.0.smithi077.stdout:1/434: rename db/df/d14/d33/d34/l47 to db/df/d14/d33/d34/l93 0 2024-04-25T02:08:50.171 INFO:tasks.workunit.client.0.smithi077.stdout:1/435: write db/df/d14/d4d/d82/f8b [3822398,106877] 0 2024-04-25T02:08:50.172 INFO:tasks.workunit.client.0.smithi077.stdout:3/416: getdents d0/d3e/d42/d64 0 2024-04-25T02:08:50.173 INFO:tasks.workunit.client.0.smithi077.stdout:8/506: dread d3/da/db/df/d2b/f8d [0,4194304] 0 2024-04-25T02:08:50.174 INFO:tasks.workunit.client.0.smithi077.stdout:7/403: link d4/d13/d18/d24/d3f/d58/f7a d4/d13/d66/f8f 0 2024-04-25T02:08:50.177 INFO:tasks.workunit.client.0.smithi077.stdout:3/417: unlink d0/f69 0 2024-04-25T02:08:50.178 INFO:tasks.workunit.client.0.smithi077.stdout:8/507: symlink d3/d81/d86/l99 0 2024-04-25T02:08:50.179 INFO:tasks.workunit.client.0.smithi077.stdout:7/404: write d4/d13/d18/d2d/f47 [1745102,96785] 0 2024-04-25T02:08:50.179 INFO:tasks.workunit.client.0.smithi077.stdout:7/405: creat d4/d13/d18/d2d/d30/f90 x:0 0 0 2024-04-25T02:08:50.180 INFO:tasks.workunit.client.0.smithi077.stdout:7/406: chown d4/d13/d2c/f2e 1 1 2024-04-25T02:08:50.181 INFO:tasks.workunit.client.0.smithi077.stdout:8/508: mknod d3/c9a 0 2024-04-25T02:08:50.181 INFO:tasks.workunit.client.0.smithi077.stdout:8/509: write d3/da/db/df/d2b/d7b/f90 [818006,97792] 0 2024-04-25T02:08:50.181 INFO:tasks.workunit.client.0.smithi077.stdout:2/471: sync 2024-04-25T02:08:50.181 INFO:tasks.workunit.client.0.smithi077.stdout:4/486: sync 2024-04-25T02:08:50.181 INFO:tasks.workunit.client.0.smithi077.stdout:5/441: sync 2024-04-25T02:08:50.181 INFO:tasks.workunit.client.0.smithi077.stdout:0/434: sync 2024-04-25T02:08:50.181 INFO:tasks.workunit.client.0.smithi077.stdout:2/472: dread - d2/d78/f7a zero size 2024-04-25T02:08:50.181 INFO:tasks.workunit.client.0.smithi077.stdout:0/435: creat d2/d17/d4e/f95 x:0 0 0 2024-04-25T02:08:50.181 INFO:tasks.workunit.client.0.smithi077.stdout:0/436: truncate d2/d17/f69 1264407 0 2024-04-25T02:08:50.183 INFO:tasks.workunit.client.0.smithi077.stdout:3/418: rmdir d0/d17/d4b/d59 39 2024-04-25T02:08:50.185 INFO:tasks.workunit.client.0.smithi077.stdout:8/510: rmdir d3/da/db/df/d2b/d70/d7f 39 2024-04-25T02:08:50.188 INFO:tasks.workunit.client.0.smithi077.stdout:4/487: creat d0/d14/d60/fa7 x:0 0 0 2024-04-25T02:08:50.191 INFO:tasks.workunit.client.0.smithi077.stdout:2/473: creat d2/d9/d19/d1c/d3f/d53/d83/f99 x:0 0 0 2024-04-25T02:08:50.192 INFO:tasks.workunit.client.0.smithi077.stdout:0/437: mknod d2/d9/d2a/c96 0 2024-04-25T02:08:50.192 INFO:tasks.workunit.client.0.smithi077.stdout:6/557: sync 2024-04-25T02:08:50.193 INFO:tasks.workunit.client.0.smithi077.stdout:8/511: symlink d3/da/db/df/d2b/d7b/l9b 0 2024-04-25T02:08:50.194 INFO:tasks.workunit.client.0.smithi077.stdout:7/407: write d4/d13/d18/d2d/f43 [2231866,10763] 0 2024-04-25T02:08:50.194 INFO:tasks.workunit.client.0.smithi077.stdout:0/438: creat d2/d8/f97 x:0 0 0 2024-04-25T02:08:50.196 INFO:tasks.workunit.client.0.smithi077.stdout:6/558: symlink de/d55/lbd 0 2024-04-25T02:08:50.197 INFO:tasks.workunit.client.0.smithi077.stdout:8/512: creat d3/da/d27/d16/d6b/f9c x:0 0 0 2024-04-25T02:08:50.197 INFO:tasks.workunit.client.0.smithi077.stdout:8/513: readlink d3/da/l4b 0 2024-04-25T02:08:50.197 INFO:tasks.workunit.client.0.smithi077.stdout:8/514: stat d3/f4 0 2024-04-25T02:08:50.199 INFO:tasks.workunit.client.0.smithi077.stdout:3/419: dread d0/d2/de/d48/f29 [0,4194304] 0 2024-04-25T02:08:50.199 INFO:tasks.workunit.client.0.smithi077.stdout:3/420: write d0/d2/de/d27/f51 [3105132,107095] 0 2024-04-25T02:08:50.200 INFO:tasks.workunit.client.0.smithi077.stdout:7/408: symlink d4/d13/d18/d24/d3f/d59/l91 0 2024-04-25T02:08:50.201 INFO:tasks.workunit.client.0.smithi077.stdout:0/439: mknod d2/d17/d1d/c98 0 2024-04-25T02:08:50.203 INFO:tasks.workunit.client.0.smithi077.stdout:8/515: mknod d3/da/db/df/d2b/d70/c9d 0 2024-04-25T02:08:50.203 INFO:tasks.workunit.client.0.smithi077.stdout:8/516: stat d3/da/db/c36 0 2024-04-25T02:08:50.203 INFO:tasks.workunit.client.0.smithi077.stdout:8/517: fdatasync d3/da/db/df/d2b/d37/f67 0 2024-04-25T02:08:50.206 INFO:tasks.workunit.client.0.smithi077.stdout:3/421: creat d0/d2/d2f/d50/f96 x:0 0 0 2024-04-25T02:08:50.207 INFO:tasks.workunit.client.0.smithi077.stdout:7/409: rmdir d4/d13/d66 39 2024-04-25T02:08:50.207 INFO:tasks.workunit.client.0.smithi077.stdout:7/410: chown d4/d13/d18/d2d/f75 43 1 2024-04-25T02:08:50.209 INFO:tasks.workunit.client.0.smithi077.stdout:5/442: dwrite d0/d2/f79 [0,4194304] 0 2024-04-25T02:08:50.209 INFO:tasks.workunit.client.0.smithi077.stdout:7/411: dread d4/d13/d18/d2d/d30/f34 [0,4194304] 0 2024-04-25T02:08:50.209 INFO:tasks.workunit.client.0.smithi077.stdout:0/440: creat d2/d9/d71/f99 x:0 0 0 2024-04-25T02:08:50.210 INFO:tasks.workunit.client.0.smithi077.stdout:8/518: getdents d3/d7a 0 2024-04-25T02:08:50.210 INFO:tasks.workunit.client.0.smithi077.stdout:8/519: readlink d3/l24 0 2024-04-25T02:08:50.214 INFO:tasks.workunit.client.0.smithi077.stdout:5/443: creat d0/d2/d3/d9/d39/d44/f95 x:0 0 0 2024-04-25T02:08:50.216 INFO:tasks.workunit.client.0.smithi077.stdout:0/441: rename d2/d27/d2d/f77 to d2/d17/d1d/d34/d4c/f9a 0 2024-04-25T02:08:50.216 INFO:tasks.workunit.client.0.smithi077.stdout:0/442: creat d2/d17/d4e/f9b x:0 0 0 2024-04-25T02:08:50.216 INFO:tasks.workunit.client.0.smithi077.stdout:0/443: fsync d2/d1c/f24 0 2024-04-25T02:08:50.217 INFO:tasks.workunit.client.0.smithi077.stdout:8/520: creat d3/da/db/df/f9e x:0 0 0 2024-04-25T02:08:50.219 INFO:tasks.workunit.client.0.smithi077.stdout:8/521: creat d3/da/d27/d44/f9f x:0 0 0 2024-04-25T02:08:50.222 INFO:tasks.workunit.client.0.smithi077.stdout:8/522: rename d3/d34/d3d/f42 to d3/fa0 0 2024-04-25T02:08:50.224 INFO:tasks.workunit.client.0.smithi077.stdout:7/412: dread d4/d13/f1f [0,4194304] 0 2024-04-25T02:08:50.225 INFO:tasks.workunit.client.0.smithi077.stdout:8/523: rename d3/f8 to d3/da/db/fa1 0 2024-04-25T02:08:50.230 INFO:tasks.workunit.client.0.smithi077.stdout:7/413: dread d4/d13/f17 [0,4194304] 0 2024-04-25T02:08:50.252 INFO:tasks.workunit.client.0.smithi077.stdout:7/414: dwrite d4/d13/d18/d2d/d30/f42 [0,4194304] 0 2024-04-25T02:08:50.253 INFO:tasks.workunit.client.0.smithi077.stdout:7/415: rmdir d4/d13/d18/d24/d3f/d59 39 2024-04-25T02:08:50.254 INFO:tasks.workunit.client.0.smithi077.stdout:7/416: creat d4/d13/d2c/f92 x:0 0 0 2024-04-25T02:08:50.255 INFO:tasks.workunit.client.0.smithi077.stdout:7/417: rename d4/d13/d18/d24/d3f/d59/l91 to d4/d13/d18/d2d/d56/d68/d88/l93 0 2024-04-25T02:08:50.358 INFO:tasks.workunit.client.0.smithi077.stdout:3/422: dwrite d0/d2/d2f/f7b [0,4194304] 0 2024-04-25T02:08:50.360 INFO:tasks.workunit.client.0.smithi077.stdout:6/559: dwrite de/d15/d36/fa4 [0,4194304] 0 2024-04-25T02:08:50.360 INFO:tasks.workunit.client.0.smithi077.stdout:6/560: creat de/d12/d25/d38/fbe x:0 0 0 2024-04-25T02:08:50.362 INFO:tasks.workunit.client.0.smithi077.stdout:5/444: write d0/d2/d1b/d38/f5e [879169,123] 0 2024-04-25T02:08:50.363 INFO:tasks.workunit.client.0.smithi077.stdout:5/445: creat d0/d2/d1b/d35/f96 x:0 0 0 2024-04-25T02:08:50.363 INFO:tasks.workunit.client.0.smithi077.stdout:5/446: creat d0/d2/d3/d1d/f97 x:0 0 0 2024-04-25T02:08:50.363 INFO:tasks.workunit.client.0.smithi077.stdout:5/447: readlink d0/d2/d1b/d35/l6c 0 2024-04-25T02:08:50.363 INFO:tasks.workunit.client.0.smithi077.stdout:5/448: read d0/d25/f30 [3061099,116224] 0 2024-04-25T02:08:50.363 INFO:tasks.workunit.client.0.smithi077.stdout:5/449: fsync d0/d2/d20/d23/f7c 0 2024-04-25T02:08:50.363 INFO:tasks.workunit.client.0.smithi077.stdout:5/450: fdatasync d0/d25/f30 0 2024-04-25T02:08:50.366 INFO:tasks.workunit.client.0.smithi077.stdout:6/561: rename de/d12/d25/d60/l6e to de/d12/d25/d60/lbf 0 2024-04-25T02:08:50.366 INFO:tasks.workunit.client.0.smithi077.stdout:6/562: creat de/d55/d88/fc0 x:0 0 0 2024-04-25T02:08:50.367 INFO:tasks.workunit.client.0.smithi077.stdout:3/423: rename d0/d3e/d42/f5e to d0/f97 0 2024-04-25T02:08:50.367 INFO:tasks.workunit.client.0.smithi077.stdout:0/444: dwrite d2/d27/d2d/f6d [0,4194304] 0 2024-04-25T02:08:50.372 INFO:tasks.workunit.client.0.smithi077.stdout:5/451: mknod d0/d2/d52/c98 0 2024-04-25T02:08:50.372 INFO:tasks.workunit.client.0.smithi077.stdout:8/524: dwrite d3/da/db/df/d2b/d7b/f90 [0,4194304] 0 2024-04-25T02:08:50.372 INFO:tasks.workunit.client.0.smithi077.stdout:8/525: chown d3/da/db/df/c43 632825112 1 2024-04-25T02:08:50.372 INFO:tasks.workunit.client.0.smithi077.stdout:8/526: dread - d3/da/d27/d16/d6b/f9c zero size 2024-04-25T02:08:50.372 INFO:tasks.workunit.client.0.smithi077.stdout:8/527: fsync d3/da/d27/d16/f22 0 2024-04-25T02:08:50.373 INFO:tasks.workunit.client.0.smithi077.stdout:8/528: stat l0 0 2024-04-25T02:08:50.376 INFO:tasks.workunit.client.0.smithi077.stdout:3/424: symlink d0/d2/de/d36/l98 0 2024-04-25T02:08:50.376 INFO:tasks.workunit.client.0.smithi077.stdout:3/425: chown d0/d2/de/f61 171 1 2024-04-25T02:08:50.376 INFO:tasks.workunit.client.0.smithi077.stdout:3/426: creat d0/d2/de/d48/d15/f99 x:0 0 0 2024-04-25T02:08:50.376 INFO:tasks.workunit.client.0.smithi077.stdout:3/427: write d0/d2/d2f/d50/f96 [860513,103476] 0 2024-04-25T02:08:50.377 INFO:tasks.workunit.client.0.smithi077.stdout:0/445: mknod d2/d17/d4e/d5e/c9c 0 2024-04-25T02:08:50.380 INFO:tasks.workunit.client.0.smithi077.stdout:6/563: dwrite de/d5b/f82 [0,4194304] 0 2024-04-25T02:08:50.380 INFO:tasks.workunit.client.0.smithi077.stdout:6/564: write de/d55/d88/fc0 [755626,102625] 0 2024-04-25T02:08:50.380 INFO:tasks.workunit.client.0.smithi077.stdout:6/565: chown de/d15/l18 7 1 2024-04-25T02:08:50.380 INFO:tasks.workunit.client.0.smithi077.stdout:6/566: write f5 [2313562,90917] 0 2024-04-25T02:08:50.381 INFO:tasks.workunit.client.0.smithi077.stdout:5/452: symlink d0/l99 0 2024-04-25T02:08:50.381 INFO:tasks.workunit.client.0.smithi077.stdout:5/453: write d0/d2/d3/d9/d39/d44/f45 [5224143,30894] 0 2024-04-25T02:08:50.382 INFO:tasks.workunit.client.0.smithi077.stdout:8/529: mknod d3/ca2 0 2024-04-25T02:08:50.382 INFO:tasks.workunit.client.0.smithi077.stdout:8/530: truncate d3/da/f8a 944403 0 2024-04-25T02:08:50.386 INFO:tasks.workunit.client.0.smithi077.stdout:7/418: rmdir d4/d13/d18/d24/d3f 39 2024-04-25T02:08:50.386 INFO:tasks.workunit.client.0.smithi077.stdout:7/419: creat d4/d13/d18/f94 x:0 0 0 2024-04-25T02:08:50.387 INFO:tasks.workunit.client.0.smithi077.stdout:0/446: write d2/d9/d2a/f7d [1506540,128778] 0 2024-04-25T02:08:50.387 INFO:tasks.workunit.client.0.smithi077.stdout:6/567: link de/d53/d6f/la3 de/d12/d25/d3a/d6a/lc1 0 2024-04-25T02:08:50.389 INFO:tasks.workunit.client.0.smithi077.stdout:5/454: creat d0/d2/d20/d41/f9a x:0 0 0 2024-04-25T02:08:50.389 INFO:tasks.workunit.client.0.smithi077.stdout:5/455: dread - d0/d2/d1b/d35/f96 zero size 2024-04-25T02:08:50.389 INFO:tasks.workunit.client.0.smithi077.stdout:5/456: chown d0/d2/d20/l7f 199459167 1 2024-04-25T02:08:50.390 INFO:tasks.workunit.client.0.smithi077.stdout:8/531: link d3/da/d27/d44/f9f d3/d7a/fa3 0 2024-04-25T02:08:50.390 INFO:tasks.workunit.client.0.smithi077.stdout:8/532: read d3/da/db/df/d2b/f8d [3886512,7313] 0 2024-04-25T02:08:50.392 INFO:tasks.workunit.client.0.smithi077.stdout:7/420: mknod d4/d13/d18/d24/d3f/d72/c95 0 2024-04-25T02:08:50.394 INFO:tasks.workunit.client.0.smithi077.stdout:0/447: rename d2/d8/d10/l1e to d2/d17/d1d/d34/d83/l9d 0 2024-04-25T02:08:50.394 INFO:tasks.workunit.client.0.smithi077.stdout:0/448: stat d2 0 2024-04-25T02:08:50.394 INFO:tasks.workunit.client.0.smithi077.stdout:0/449: fsync d2/d17/d4e/f9b 0 2024-04-25T02:08:50.395 INFO:tasks.workunit.client.0.smithi077.stdout:6/568: mkdir de/d55/dc2 0 2024-04-25T02:08:50.396 INFO:tasks.workunit.client.0.smithi077.stdout:5/457: mknod d0/d2/d3/d9/d39/d3c/c9b 0 2024-04-25T02:08:50.396 INFO:tasks.workunit.client.0.smithi077.stdout:8/533: stat d3/da/db/c19 0 2024-04-25T02:08:50.398 INFO:tasks.workunit.client.0.smithi077.stdout:7/421: link d4/d13/c60 d4/d13/d18/d2d/d30/c96 0 2024-04-25T02:08:50.398 INFO:tasks.workunit.client.0.smithi077.stdout:7/422: stat d4/d13/d18/d24/f3b 0 2024-04-25T02:08:50.399 INFO:tasks.workunit.client.0.smithi077.stdout:0/450: mkdir d2/d8/d10/d9e 0 2024-04-25T02:08:50.402 INFO:tasks.workunit.client.0.smithi077.stdout:5/458: link d0/d2/d3/d9/f2a d0/d25/d82/d87/f9c 0 2024-04-25T02:08:50.403 INFO:tasks.workunit.client.0.smithi077.stdout:0/451: mkdir d2/d8/d5f/d9f 0 2024-04-25T02:08:50.404 INFO:tasks.workunit.client.0.smithi077.stdout:9/501: sync 2024-04-25T02:08:50.404 INFO:tasks.workunit.client.0.smithi077.stdout:5/459: symlink d0/d25/d82/d87/d8b/l9d 0 2024-04-25T02:08:50.406 INFO:tasks.workunit.client.0.smithi077.stdout:6/569: write de/d12/d25/f2d [741964,81785] 0 2024-04-25T02:08:50.406 INFO:tasks.workunit.client.0.smithi077.stdout:6/570: write f0 [292321,114404] 0 2024-04-25T02:08:50.406 INFO:tasks.workunit.client.0.smithi077.stdout:6/571: fdatasync de/f46 0 2024-04-25T02:08:50.407 INFO:tasks.workunit.client.0.smithi077.stdout:0/452: rename d2/d9/d2a/f48 to d2/d17/d1d/d34/d4c/fa0 0 2024-04-25T02:08:50.407 INFO:tasks.workunit.client.0.smithi077.stdout:7/423: dread d4/f12 [0,4194304] 0 2024-04-25T02:08:50.407 INFO:tasks.workunit.client.0.smithi077.stdout:7/424: fdatasync d4/d13/d18/d24/d3f/f44 0 2024-04-25T02:08:50.408 INFO:tasks.workunit.client.0.smithi077.stdout:5/460: dread d0/d2/d1b/d3b/f71 [0,4194304] 0 2024-04-25T02:08:50.409 INFO:tasks.workunit.client.0.smithi077.stdout:6/572: creat de/d53/db2/fc3 x:0 0 0 2024-04-25T02:08:50.409 INFO:tasks.workunit.client.0.smithi077.stdout:3/428: rmdir d0/d2/de/d48/d15 39 2024-04-25T02:08:50.410 INFO:tasks.workunit.client.0.smithi077.stdout:2/474: sync 2024-04-25T02:08:50.410 INFO:tasks.workunit.client.0.smithi077.stdout:1/436: sync 2024-04-25T02:08:50.410 INFO:tasks.workunit.client.0.smithi077.stdout:4/488: sync 2024-04-25T02:08:50.410 INFO:tasks.workunit.client.0.smithi077.stdout:4/489: truncate d0/d14/d60/d86/d25/f45 1738002 0 2024-04-25T02:08:50.411 INFO:tasks.workunit.client.0.smithi077.stdout:7/425: symlink d4/d13/d18/l97 0 2024-04-25T02:08:50.411 INFO:tasks.workunit.client.0.smithi077.stdout:7/426: fdatasync d4/d13/d18/d2d/f3a 0 2024-04-25T02:08:50.412 INFO:tasks.workunit.client.0.smithi077.stdout:5/461: read d0/d25/f3a [58886,10218] 0 2024-04-25T02:08:50.413 INFO:tasks.workunit.client.0.smithi077.stdout:4/490: read d0/d14/d21/d39/d1d/f2c [269279,2968] 0 2024-04-25T02:08:50.413 INFO:tasks.workunit.client.0.smithi077.stdout:4/491: stat d0/d14/d21/d39/d64/c83 0 2024-04-25T02:08:50.414 INFO:tasks.workunit.client.0.smithi077.stdout:6/573: rename de/d12/d25/l62 to de/d55/d88/lc4 0 2024-04-25T02:08:50.415 INFO:tasks.workunit.client.0.smithi077.stdout:8/534: dwrite d3/da/d27/d16/f22 [0,4194304] 0 2024-04-25T02:08:50.416 INFO:tasks.workunit.client.0.smithi077.stdout:2/475: rename d2/d9/d2f/l6d to d2/d9/d18/d31/d7c/d89/l9a 0 2024-04-25T02:08:50.420 INFO:tasks.workunit.client.0.smithi077.stdout:2/476: mknod d2/d9/d19/d1c/d37/c9b 0 2024-04-25T02:08:50.420 INFO:tasks.workunit.client.0.smithi077.stdout:8/535: read d3/da/f35 [890892,1657] 0 2024-04-25T02:08:50.420 INFO:tasks.workunit.client.0.smithi077.stdout:2/477: chown d2/d28/f32 75272817 1 2024-04-25T02:08:50.421 INFO:tasks.workunit.client.0.smithi077.stdout:6/574: rmdir de/d12/d25/d44 39 2024-04-25T02:08:50.424 INFO:tasks.workunit.client.0.smithi077.stdout:1/437: rename db/df/d14/d4d/d82/d5c/d81/c87 to db/c94 0 2024-04-25T02:08:50.426 INFO:tasks.workunit.client.0.smithi077.stdout:2/478: unlink d2/d9/d2f/l94 0 2024-04-25T02:08:50.429 INFO:tasks.workunit.client.0.smithi077.stdout:0/453: dwrite d2/d8/d5f/f6c [0,4194304] 0 2024-04-25T02:08:50.429 INFO:tasks.workunit.client.0.smithi077.stdout:8/536: dread d3/da/d27/f21 [0,4194304] 0 2024-04-25T02:08:50.430 INFO:tasks.workunit.client.0.smithi077.stdout:1/438: symlink db/df/d14/d4d/d82/d42/d43/l95 0 2024-04-25T02:08:50.430 INFO:tasks.workunit.client.0.smithi077.stdout:7/427: dread d4/d13/d18/d2d/d30/f6b [0,4194304] 0 2024-04-25T02:08:50.432 INFO:tasks.workunit.client.0.smithi077.stdout:2/479: dread d2/d9/d18/d31/f5a [0,4194304] 0 2024-04-25T02:08:50.432 INFO:tasks.workunit.client.0.smithi077.stdout:2/480: chown d2/d9/d56 19 1 2024-04-25T02:08:50.432 INFO:tasks.workunit.client.0.smithi077.stdout:0/454: symlink d2/d17/d1d/la1 0 2024-04-25T02:08:50.432 INFO:tasks.workunit.client.0.smithi077.stdout:0/455: chown d2/d17/c25 115595891 1 2024-04-25T02:08:50.433 INFO:tasks.workunit.client.0.smithi077.stdout:8/537: symlink d3/da/db/la4 0 2024-04-25T02:08:50.433 INFO:tasks.workunit.client.0.smithi077.stdout:8/538: fdatasync d3/da/db/df/d30/f89 0 2024-04-25T02:08:50.435 INFO:tasks.workunit.client.0.smithi077.stdout:1/439: rename db/df/d1b/c6e to db/df/d14/d4d/d82/d32/c96 0 2024-04-25T02:08:50.437 INFO:tasks.workunit.client.0.smithi077.stdout:2/481: link d2/d9/df/c5e d2/d9/d18/d31/c9c 0 2024-04-25T02:08:50.438 INFO:tasks.workunit.client.0.smithi077.stdout:7/428: rename d4/d13/d18/l97 to d4/d13/l98 0 2024-04-25T02:08:50.439 INFO:tasks.workunit.client.0.smithi077.stdout:7/429: chown d4 921871714 1 2024-04-25T02:08:50.439 INFO:tasks.workunit.client.0.smithi077.stdout:1/440: creat db/df/d14/f97 x:0 0 0 2024-04-25T02:08:50.439 INFO:tasks.workunit.client.0.smithi077.stdout:1/441: fdatasync db/df/d14/d33/d34/f36 0 2024-04-25T02:08:50.439 INFO:tasks.workunit.client.0.smithi077.stdout:1/442: write db/df/d14/d33/d34/f36 [8596933,79394] 0 2024-04-25T02:08:50.441 INFO:tasks.workunit.client.0.smithi077.stdout:7/430: mknod d4/d13/d18/d24/d3f/d58/c99 0 2024-04-25T02:08:50.441 INFO:tasks.workunit.client.0.smithi077.stdout:7/431: chown d4/d13/f4e 863081556 1 2024-04-25T02:08:50.441 INFO:tasks.workunit.client.0.smithi077.stdout:7/432: truncate d4/d13/d18/d2d/d30/f8c 27533 0 2024-04-25T02:08:50.441 INFO:tasks.workunit.client.0.smithi077.stdout:7/433: chown d4/d13/d18/d2d/d56/d68/d88 1 1 2024-04-25T02:08:50.441 INFO:tasks.workunit.client.0.smithi077.stdout:7/434: readlink d4/d13/d5b/l85 0 2024-04-25T02:08:50.441 INFO:tasks.workunit.client.0.smithi077.stdout:7/435: chown d4/d13/d18/d24 383814 1 2024-04-25T02:08:50.442 INFO:tasks.workunit.client.0.smithi077.stdout:7/436: creat d4/d13/d18/d2d/d56/d68/f9a x:0 0 0 2024-04-25T02:08:50.443 INFO:tasks.workunit.client.0.smithi077.stdout:5/462: dwrite d0/d2/d20/d23/d4a/f5d [0,4194304] 0 2024-04-25T02:08:50.443 INFO:tasks.workunit.client.0.smithi077.stdout:5/463: chown d0/d2/d3/f15 130 1 2024-04-25T02:08:50.445 INFO:tasks.workunit.client.0.smithi077.stdout:4/492: dwrite d0/f18 [0,4194304] 0 2024-04-25T02:08:50.449 INFO:tasks.workunit.client.0.smithi077.stdout:8/539: write d3/da/db/df/d30/f89 [1566030,112434] 0 2024-04-25T02:08:50.449 INFO:tasks.workunit.client.0.smithi077.stdout:5/464: mknod d0/d2/d20/c9e 0 2024-04-25T02:08:50.453 INFO:tasks.workunit.client.0.smithi077.stdout:8/540: symlink d3/da/d27/d16/d8c/la5 0 2024-04-25T02:08:50.455 INFO:tasks.workunit.client.0.smithi077.stdout:5/465: truncate d0/d2/d20/f3f 4156303 0 2024-04-25T02:08:50.457 INFO:tasks.workunit.client.0.smithi077.stdout:8/541: symlink d3/da/db/df/d2b/la6 0 2024-04-25T02:08:50.459 INFO:tasks.workunit.client.0.smithi077.stdout:5/466: truncate d0/d2/d3/f2f 5663039 0 2024-04-25T02:08:50.461 INFO:tasks.workunit.client.0.smithi077.stdout:8/542: truncate d3/da/db/df/d2b/d7b/f90 1691624 0 2024-04-25T02:08:50.465 INFO:tasks.workunit.client.0.smithi077.stdout:2/482: dwrite d2/d9/d18/d1b/f98 [0,4194304] 0 2024-04-25T02:08:50.466 INFO:tasks.workunit.client.0.smithi077.stdout:0/456: rename d2/d8/d10 to d2/d17/d1d/d34/d4c/da2 0 2024-04-25T02:08:50.466 INFO:tasks.workunit.client.0.smithi077.stdout:0/457: fsync d2/d9/d2a/f7d 0 2024-04-25T02:08:50.472 INFO:tasks.workunit.client.0.smithi077.stdout:1/443: dwrite db/f18 [4194304,4194304] 0 2024-04-25T02:08:50.475 INFO:tasks.workunit.client.0.smithi077.stdout:7/437: dwrite d4/d13/d18/d24/d3f/d58/f7f [0,4194304] 0 2024-04-25T02:08:50.476 INFO:tasks.workunit.client.0.smithi077.stdout:1/444: mknod db/df/d14/d3e/c98 0 2024-04-25T02:08:50.476 INFO:tasks.workunit.client.0.smithi077.stdout:1/445: fsync db/df/d14/d4d/d82/f30 0 2024-04-25T02:08:50.477 INFO:tasks.workunit.client.0.smithi077.stdout:6/575: rmdir de/d55 39 2024-04-25T02:08:50.477 INFO:tasks.workunit.client.0.smithi077.stdout:6/576: read - de/d15/d36/fa2 zero size 2024-04-25T02:08:50.480 INFO:tasks.workunit.client.0.smithi077.stdout:7/438: creat d4/d13/d66/f9b x:0 0 0 2024-04-25T02:08:50.481 INFO:tasks.workunit.client.0.smithi077.stdout:7/439: chown d4/d13/d18/d24/d3f/d58/f2b 4422 1 2024-04-25T02:08:50.481 INFO:tasks.workunit.client.0.smithi077.stdout:7/440: dread - d4/d13/d18/f94 zero size 2024-04-25T02:08:50.481 INFO:tasks.workunit.client.0.smithi077.stdout:4/493: dwrite d0/d14/d60/d86/f4c [0,4194304] 0 2024-04-25T02:08:50.482 INFO:tasks.workunit.client.0.smithi077.stdout:7/441: dread d4/fa [0,4194304] 0 2024-04-25T02:08:50.482 INFO:tasks.workunit.client.0.smithi077.stdout:6/577: link de/l20 de/d12/lc5 0 2024-04-25T02:08:50.482 INFO:tasks.workunit.client.0.smithi077.stdout:6/578: rename de/d12 to de/d12/d25/d38/dc6 22 2024-04-25T02:08:50.487 INFO:tasks.workunit.client.0.smithi077.stdout:7/442: creat d4/d13/f9c x:0 0 0 2024-04-25T02:08:50.489 INFO:tasks.workunit.client.0.smithi077.stdout:6/579: creat de/d12/d25/d44/fc7 x:0 0 0 2024-04-25T02:08:50.490 INFO:tasks.workunit.client.0.smithi077.stdout:5/467: dwrite d0/d25/f47 [0,4194304] 0 2024-04-25T02:08:50.490 INFO:tasks.workunit.client.0.smithi077.stdout:5/468: write d0/d2/d3/d9/f2b [3446576,25517] 0 2024-04-25T02:08:50.490 INFO:tasks.workunit.client.0.smithi077.stdout:8/543: dwrite d3/da/d27/d16/d57/f6d [0,4194304] 0 2024-04-25T02:08:50.491 INFO:tasks.workunit.client.0.smithi077.stdout:6/580: link de/d12/d25/d44/faa de/d15/fc8 0 2024-04-25T02:08:50.494 INFO:tasks.workunit.client.0.smithi077.stdout:5/469: mknod d0/d25/d82/d8d/c9f 0 2024-04-25T02:08:50.494 INFO:tasks.workunit.client.0.smithi077.stdout:5/470: dread - d0/d2/d3/d9/d39/f94 zero size 2024-04-25T02:08:50.498 INFO:tasks.workunit.client.0.smithi077.stdout:5/471: dread d0/f85 [0,4194304] 0 2024-04-25T02:08:50.498 INFO:tasks.workunit.client.0.smithi077.stdout:6/581: truncate de/f13 624217 0 2024-04-25T02:08:50.500 INFO:tasks.workunit.client.0.smithi077.stdout:8/544: getdents d3 0 2024-04-25T02:08:50.500 INFO:tasks.workunit.client.0.smithi077.stdout:8/545: readlink d3/d81/d86/l99 0 2024-04-25T02:08:50.500 INFO:tasks.workunit.client.0.smithi077.stdout:2/483: getdents d2/d9/d18/d31 0 2024-04-25T02:08:50.501 INFO:tasks.workunit.client.0.smithi077.stdout:6/582: creat de/d12/d25/d3a/fc9 x:0 0 0 2024-04-25T02:08:50.502 INFO:tasks.workunit.client.0.smithi077.stdout:7/443: write d4/d13/d2c/f2e [7314277,22476] 0 2024-04-25T02:08:50.502 INFO:tasks.workunit.client.0.smithi077.stdout:8/546: symlink d3/da/d27/d16/la7 0 2024-04-25T02:08:50.504 INFO:tasks.workunit.client.0.smithi077.stdout:2/484: dread d2/d9/fb [0,4194304] 0 2024-04-25T02:08:50.504 INFO:tasks.workunit.client.0.smithi077.stdout:4/494: dwrite d0/d14/d21/d39/da/d12/d35/d3e/f2b [0,4194304] 0 2024-04-25T02:08:50.508 INFO:tasks.workunit.client.0.smithi077.stdout:0/458: dwrite d2/d17/d1d/f3d [4194304,4194304] 0 2024-04-25T02:08:50.508 INFO:tasks.workunit.client.0.smithi077.stdout:0/459: truncate d2/d17/d1d/d34/f36 4842655 0 2024-04-25T02:08:50.509 INFO:tasks.workunit.client.0.smithi077.stdout:2/485: dread d2/d28/f32 [0,4194304] 0 2024-04-25T02:08:50.510 INFO:tasks.workunit.client.0.smithi077.stdout:5/472: dread d0/d25/f30 [0,4194304] 0 2024-04-25T02:08:50.514 INFO:tasks.workunit.client.0.smithi077.stdout:8/547: truncate d3/da/db/df/d30/f89 1376172 0 2024-04-25T02:08:50.514 INFO:tasks.workunit.client.0.smithi077.stdout:8/548: readlink d3/da/l4b 0 2024-04-25T02:08:50.515 INFO:tasks.workunit.client.0.smithi077.stdout:0/460: write d2/d1c/f4f [2711443,126510] 0 2024-04-25T02:08:50.522 INFO:tasks.workunit.client.0.smithi077.stdout:2/486: mknod d2/d9/d19/d2c/c9d 0 2024-04-25T02:08:50.522 INFO:tasks.workunit.client.0.smithi077.stdout:2/487: fsync d2/d9/fb 0 2024-04-25T02:08:50.522 INFO:tasks.workunit.client.0.smithi077.stdout:2/488: chown d2/d9/d19/d1c/f81 18027 1 2024-04-25T02:08:50.522 INFO:tasks.workunit.client.0.smithi077.stdout:2/489: dread - d2/d28/f93 zero size 2024-04-25T02:08:50.523 INFO:tasks.workunit.client.0.smithi077.stdout:8/549: creat d3/d34/fa8 x:0 0 0 2024-04-25T02:08:50.526 INFO:tasks.workunit.client.0.smithi077.stdout:7/444: rmdir d4 39 2024-04-25T02:08:50.529 INFO:tasks.workunit.client.0.smithi077.stdout:8/550: write d3/da/d27/d16/d57/f6d [4877782,119910] 0 2024-04-25T02:08:50.529 INFO:tasks.workunit.client.0.smithi077.stdout:8/551: chown d3/d34/d3d 15739321 1 2024-04-25T02:08:50.530 INFO:tasks.workunit.client.0.smithi077.stdout:0/461: dread d2/d8/f55 [0,4194304] 0 2024-04-25T02:08:50.533 INFO:tasks.workunit.client.0.smithi077.stdout:4/495: dwrite d0/d14/d60/f69 [0,4194304] 0 2024-04-25T02:08:50.534 INFO:tasks.workunit.client.0.smithi077.stdout:0/462: rename d2/d27/f3b to d2/fa3 0 2024-04-25T02:08:50.534 INFO:tasks.workunit.client.0.smithi077.stdout:0/463: fdatasync d2/f4b 0 2024-04-25T02:08:50.536 INFO:tasks.workunit.client.0.smithi077.stdout:8/552: dread d3/da/d27/f1e [0,4194304] 0 2024-04-25T02:08:50.540 INFO:tasks.workunit.client.0.smithi077.stdout:0/464: mknod d2/d9/d2a/ca4 0 2024-04-25T02:08:50.542 INFO:tasks.workunit.client.0.smithi077.stdout:0/465: mknod d2/d17/d1d/d34/d4c/da2/d51/ca5 0 2024-04-25T02:08:50.545 INFO:tasks.workunit.client.0.smithi077.stdout:2/490: dwrite d2/d9/f67 [0,4194304] 0 2024-04-25T02:08:50.545 INFO:tasks.workunit.client.0.smithi077.stdout:2/491: write d2/d9/d19/d1c/d3f/d53/d86/f96 [475868,129099] 0 2024-04-25T02:08:50.545 INFO:tasks.workunit.client.0.smithi077.stdout:5/473: dwrite d0/d2/d3/f2f [0,4194304] 0 2024-04-25T02:08:50.548 INFO:tasks.workunit.client.0.smithi077.stdout:2/492: symlink d2/d9/d18/d31/d7c/d89/l9e 0 2024-04-25T02:08:50.549 INFO:tasks.workunit.client.0.smithi077.stdout:5/474: mknod d0/d2/d20/ca0 0 2024-04-25T02:08:50.569 INFO:tasks.workunit.client.0.smithi077.stdout:7/445: dwrite d4/d13/d18/d2d/d30/f42 [0,4194304] 0 2024-04-25T02:08:50.569 INFO:tasks.workunit.client.0.smithi077.stdout:7/446: stat d4/d13/d18/d24/d3f/d72/c81 0 2024-04-25T02:08:50.569 INFO:tasks.workunit.client.0.smithi077.stdout:7/447: chown d4/d13/d18/d2d/d30/f86 3 1 2024-04-25T02:08:50.570 INFO:tasks.workunit.client.0.smithi077.stdout:7/448: truncate d4/f37 1695945 0 2024-04-25T02:08:50.570 INFO:tasks.workunit.client.0.smithi077.stdout:7/449: rmdir d4/d13/d18/d24/d3f 39 2024-04-25T02:08:50.570 INFO:tasks.workunit.client.0.smithi077.stdout:7/450: chown d4/d13/d18/d24/d3f/d58/f74 438 1 2024-04-25T02:08:50.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.564+0000 7f453e49e700 1 -- 172.21.15.77:0/1230589519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45380fbcb0 msgr2=0x7f45380fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:50.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.564+0000 7f453e49e700 1 --2- 172.21.15.77:0/1230589519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45380fbcb0 0x7f45380fc0c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4528004940 tx=0x7f4528009e30 comp rx=0 tx=0).stop 2024-04-25T02:08:50.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.564+0000 7f453e49e700 1 -- 172.21.15.77:0/1230589519 shutdown_connections 2024-04-25T02:08:50.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.564+0000 7f453e49e700 1 --2- 172.21.15.77:0/1230589519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45380fcf60 0x7f45380fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:50.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.564+0000 7f453e49e700 1 --2- 172.21.15.77:0/1230589519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45380fbcb0 0x7f45380fc0c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:50.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.564+0000 7f453e49e700 1 -- 172.21.15.77:0/1230589519 >> 172.21.15.77:0/1230589519 conn(0x7f45380f7430 msgr2=0x7f45380f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:50.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.564+0000 7f453e49e700 1 -- 172.21.15.77:0/1230589519 shutdown_connections 2024-04-25T02:08:50.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.564+0000 7f453e49e700 1 -- 172.21.15.77:0/1230589519 wait complete. 2024-04-25T02:08:50.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.565+0000 7f453e49e700 1 Processor -- start 2024-04-25T02:08:50.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.565+0000 7f453e49e700 1 -- start start 2024-04-25T02:08:50.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.565+0000 7f453e49e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45380fbcb0 0x7f453810c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:50.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.565+0000 7f453e49e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45380fcf60 0x7f453810ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:50.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.565+0000 7f453e49e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453810d400 con 0x7f45380fcf60 2024-04-25T02:08:50.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.565+0000 7f453e49e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453810dc00 con 0x7f45380fbcb0 2024-04-25T02:08:50.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.566+0000 7f45377fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45380fcf60 0x7f453810ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:50.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.566+0000 7f45377fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45380fcf60 0x7f453810ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33348/0 (socket says 172.21.15.77:33348) 2024-04-25T02:08:50.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.566+0000 7f45377fe700 1 -- 172.21.15.77:0/1561242086 learned_addr learned my addr 172.21.15.77:0/1561242086 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:08:50.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.566+0000 7f4537fff700 1 --2- 172.21.15.77:0/1561242086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45380fbcb0 0x7f453810c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:50.574 INFO:tasks.workunit.client.0.smithi077.stdout:4/496: dwrite d0/f28 [0,4194304] 0 2024-04-25T02:08:50.574 INFO:tasks.workunit.client.0.smithi077.stdout:4/497: chown d0/d14/d21/d39/da/d12/d35/l95 832562836 1 2024-04-25T02:08:50.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.566+0000 7f4537fff700 1 -- 172.21.15.77:0/1561242086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45380fcf60 msgr2=0x7f453810ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:50.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.566+0000 7f4537fff700 1 --2- 172.21.15.77:0/1561242086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45380fcf60 0x7f453810ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:50.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.566+0000 7f4537fff700 1 -- 172.21.15.77:0/1561242086 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4528005040 con 0x7f45380fbcb0 2024-04-25T02:08:50.575 INFO:tasks.workunit.client.0.smithi077.stdout:8/553: dwrite d3/da/f45 [4194304,4194304] 0 2024-04-25T02:08:50.575 INFO:tasks.workunit.client.0.smithi077.stdout:8/554: readlink d3/da/db/df/d2b/d7b/l9b 0 2024-04-25T02:08:50.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.567+0000 7f4537fff700 1 --2- 172.21.15.77:0/1561242086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45380fbcb0 0x7f453810c8c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4528000c00 tx=0x7f4528009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:50.576 INFO:tasks.workunit.client.0.smithi077.stdout:3/429: sync 2024-04-25T02:08:50.576 INFO:tasks.workunit.client.0.smithi077.stdout:3/430: write d0/d2/de/d48/d15/f99 [12985,74998] 0 2024-04-25T02:08:50.576 INFO:tasks.workunit.client.0.smithi077.stdout:3/431: write d0/d40/f57 [3741065,9454] 0 2024-04-25T02:08:50.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.571+0000 7f4534ff9700 1 -- 172.21.15.77:0/1561242086 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f452800e070 con 0x7f45380fbcb0 2024-04-25T02:08:50.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.571+0000 7f4534ff9700 1 -- 172.21.15.77:0/1561242086 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f452801b460 con 0x7f45380fbcb0 2024-04-25T02:08:50.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.572+0000 7f4534ff9700 1 -- 172.21.15.77:0/1561242086 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4528023630 con 0x7f45380fbcb0 2024-04-25T02:08:50.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.572+0000 7f453e49e700 1 -- 172.21.15.77:0/1561242086 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f453810de80 con 0x7f45380fbcb0 2024-04-25T02:08:50.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.572+0000 7f453e49e700 1 -- 172.21.15.77:0/1561242086 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f453810e390 con 0x7f45380fbcb0 2024-04-25T02:08:50.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.573+0000 7f453e49e700 1 -- 172.21.15.77:0/1561242086 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f453805f5c0 con 0x7f45380fbcb0 2024-04-25T02:08:50.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.575+0000 7f4534ff9700 1 -- 172.21.15.77:0/1561242086 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f4528021020 con 0x7f45380fbcb0 2024-04-25T02:08:50.582 INFO:tasks.workunit.client.0.smithi077.stdout:2/493: dwrite d2/d9/d19/f1a [0,4194304] 0 2024-04-25T02:08:50.582 INFO:tasks.workunit.client.0.smithi077.stdout:5/475: dwrite d0/d2/d1b/d35/f4f [0,4194304] 0 2024-04-25T02:08:50.583 INFO:tasks.workunit.client.0.smithi077.stdout:2/494: write d2/d9/d18/fa [5459607,123115] 0 2024-04-25T02:08:50.583 INFO:tasks.workunit.client.0.smithi077.stdout:5/476: stat d0/d2/d20/d23/d4a/f5c 0 2024-04-25T02:08:50.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.576+0000 7f4534ff9700 1 --2- 172.21.15.77:0/1561242086 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f4520069150 0x7f452006b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:50.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.576+0000 7f4534ff9700 1 -- 172.21.15.77:0/1561242086 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f452808a2c0 con 0x7f45380fbcb0 2024-04-25T02:08:50.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.576+0000 7f45377fe700 1 --2- 172.21.15.77:0/1561242086 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f4520069150 0x7f452006b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:50.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.576+0000 7f45377fe700 1 --2- 172.21.15.77:0/1561242086 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f4520069150 0x7f452006b600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f452c008fd0 tx=0x7f452c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:50.588 INFO:tasks.workunit.client.0.smithi077.stdout:5/477: creat d0/d25/d82/fa1 x:0 0 0 2024-04-25T02:08:50.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.582+0000 7f4534ff9700 1 -- 172.21.15.77:0/1561242086 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f452805a010 con 0x7f45380fbcb0 2024-04-25T02:08:50.589 INFO:tasks.workunit.client.0.smithi077.stdout:9/502: sync 2024-04-25T02:08:50.594 INFO:tasks.workunit.client.0.smithi077.stdout:5/478: rename d0/d2/d3/d9/d39/d44/d5f/f88 to d0/d2/d1b/fa2 0 2024-04-25T02:08:50.594 INFO:tasks.workunit.client.0.smithi077.stdout:5/479: truncate d0/d2/d20/d23/f7c 892703 0 2024-04-25T02:08:50.595 INFO:tasks.workunit.client.0.smithi077.stdout:9/503: rmdir df/d1b/d56/d67/d68 39 2024-04-25T02:08:50.595 INFO:tasks.workunit.client.0.smithi077.stdout:9/504: chown df/d1b/d56/d67/f7e 202 1 2024-04-25T02:08:50.596 INFO:tasks.workunit.client.0.smithi077.stdout:0/466: dwrite d2/d9/d71/f99 [0,4194304] 0 2024-04-25T02:08:50.596 INFO:tasks.workunit.client.0.smithi077.stdout:7/451: dwrite d4/d13/d18/d2d/d30/f65 [0,4194304] 0 2024-04-25T02:08:50.597 INFO:tasks.workunit.client.0.smithi077.stdout:5/480: rmdir d0/d2/d20/d23 39 2024-04-25T02:08:50.604 INFO:tasks.workunit.client.0.smithi077.stdout:0/467: unlink d2/d9/d71/f99 0 2024-04-25T02:08:50.606 INFO:tasks.workunit.client.0.smithi077.stdout:5/481: symlink d0/d25/d82/d87/d8b/d5a/la3 0 2024-04-25T02:08:50.607 INFO:tasks.workunit.client.0.smithi077.stdout:5/482: rmdir d0/d25/d82/d8d 39 2024-04-25T02:08:50.607 INFO:tasks.workunit.client.0.smithi077.stdout:5/483: getdents d0 0 2024-04-25T02:08:50.616 INFO:tasks.workunit.client.0.smithi077.stdout:9/505: dread df/d80/f98 [0,4194304] 0 2024-04-25T02:08:50.616 INFO:tasks.workunit.client.0.smithi077.stdout:9/506: truncate df/d1b/d48/f5e 1495025 0 2024-04-25T02:08:50.618 INFO:tasks.workunit.client.0.smithi077.stdout:9/507: rename df/d1b/l9c to df/d1b/d56/d67/la7 0 2024-04-25T02:08:50.618 INFO:tasks.workunit.client.0.smithi077.stdout:9/508: fsync df/d1b/f30 0 2024-04-25T02:08:50.619 INFO:tasks.workunit.client.0.smithi077.stdout:9/509: chown df/l3a 6962320 1 2024-04-25T02:08:50.619 INFO:tasks.workunit.client.0.smithi077.stdout:9/510: truncate df/d80/f98 3615307 0 2024-04-25T02:08:50.619 INFO:tasks.workunit.client.0.smithi077.stdout:9/511: write df/f26 [2650047,42981] 0 2024-04-25T02:08:50.619 INFO:tasks.workunit.client.0.smithi077.stdout:9/512: readlink df/d1b/d56/l7a 0 2024-04-25T02:08:50.619 INFO:tasks.workunit.client.0.smithi077.stdout:9/513: truncate df/d1b/d48/d75/f88 920345 0 2024-04-25T02:08:50.620 INFO:tasks.workunit.client.0.smithi077.stdout:5/484: write d0/d2/d3/d9/f1c [3774918,114075] 0 2024-04-25T02:08:50.620 INFO:tasks.workunit.client.0.smithi077.stdout:9/514: creat df/d80/fa8 x:0 0 0 2024-04-25T02:08:50.621 INFO:tasks.workunit.client.0.smithi077.stdout:9/515: fsync df/f14 0 2024-04-25T02:08:50.621 INFO:tasks.workunit.client.0.smithi077.stdout:9/516: truncate df/d1b/d48/f54 4985753 0 2024-04-25T02:08:50.621 INFO:tasks.workunit.client.0.smithi077.stdout:9/517: chown df/d1b/d56/d67/f78 302188989 1 2024-04-25T02:08:50.621 INFO:tasks.workunit.client.0.smithi077.stdout:5/485: mkdir d0/d2/d3/d9/d39/d44/d5f/da4 0 2024-04-25T02:08:50.621 INFO:tasks.workunit.client.0.smithi077.stdout:5/486: fsync d0/d2/d1b/d3b/f72 0 2024-04-25T02:08:50.622 INFO:tasks.workunit.client.0.smithi077.stdout:9/518: getdents df/d1b/d70 0 2024-04-25T02:08:50.624 INFO:tasks.workunit.client.0.smithi077.stdout:8/555: dwrite d3/da/d27/d16/f22 [4194304,4194304] 0 2024-04-25T02:08:50.624 INFO:tasks.workunit.client.0.smithi077.stdout:8/556: creat d3/d34/fa9 x:0 0 0 2024-04-25T02:08:50.624 INFO:tasks.workunit.client.0.smithi077.stdout:8/557: creat d3/da/db/df/d2b/d37/faa x:0 0 0 2024-04-25T02:08:50.624 INFO:tasks.workunit.client.0.smithi077.stdout:3/432: dwrite d0/f1f [0,4194304] 0 2024-04-25T02:08:50.627 INFO:tasks.workunit.client.0.smithi077.stdout:2/495: dwrite d2/d9/d19/d2c/f36 [0,4194304] 0 2024-04-25T02:08:50.627 INFO:tasks.workunit.client.0.smithi077.stdout:8/558: mknod d3/da/db/df/d30/cab 0 2024-04-25T02:08:50.631 INFO:tasks.workunit.client.0.smithi077.stdout:7/452: dwrite d4/d13/f1f [0,4194304] 0 2024-04-25T02:08:50.631 INFO:tasks.workunit.client.0.smithi077.stdout:7/453: dread - d4/d13/d66/f73 zero size 2024-04-25T02:08:50.631 INFO:tasks.workunit.client.0.smithi077.stdout:3/433: link d0/d2/d83/f86 d0/d40/f9a 0 2024-04-25T02:08:50.632 INFO:tasks.workunit.client.0.smithi077.stdout:7/454: dread d4/d13/d18/d2d/d30/f8c [0,4194304] 0 2024-04-25T02:08:50.632 INFO:tasks.workunit.client.0.smithi077.stdout:7/455: getdents d4/d13/d5b/d8b 0 2024-04-25T02:08:50.634 INFO:tasks.workunit.client.0.smithi077.stdout:3/434: creat d0/d2/d2f/d5f/f9b x:0 0 0 2024-04-25T02:08:50.634 INFO:tasks.workunit.client.0.smithi077.stdout:4/498: dwrite d0/d14/d21/d39/da/d12/d35/d3e/f36 [4194304,4194304] 0 2024-04-25T02:08:50.634 INFO:tasks.workunit.client.0.smithi077.stdout:4/499: chown d0/d14/d21/d39/da/ca3 687464 1 2024-04-25T02:08:50.636 INFO:tasks.workunit.client.0.smithi077.stdout:0/468: dwrite d2/d17/d1d/d34/d4c/f81 [0,4194304] 0 2024-04-25T02:08:50.636 INFO:tasks.workunit.client.0.smithi077.stdout:0/469: chown d2/d17/d1d/f20 7686 1 2024-04-25T02:08:50.637 INFO:tasks.workunit.client.0.smithi077.stdout:7/456: symlink d4/d13/l9d 0 2024-04-25T02:08:50.637 INFO:tasks.workunit.client.0.smithi077.stdout:7/457: dread - d4/d13/d18/d24/d3f/f8d zero size 2024-04-25T02:08:50.637 INFO:tasks.workunit.client.0.smithi077.stdout:7/458: fdatasync d4/d13/f4e 0 2024-04-25T02:08:50.639 INFO:tasks.workunit.client.0.smithi077.stdout:3/435: mkdir d0/d3e/d42/d64/d88/d9c 0 2024-04-25T02:08:50.644 INFO:tasks.workunit.client.0.smithi077.stdout:6/583: sync 2024-04-25T02:08:50.644 INFO:tasks.workunit.client.0.smithi077.stdout:1/446: sync 2024-04-25T02:08:50.648 INFO:tasks.workunit.client.0.smithi077.stdout:7/459: truncate d4/d13/d18/f40 981826 0 2024-04-25T02:08:50.649 INFO:tasks.workunit.client.0.smithi077.stdout:7/460: write d4/f16 [887050,109899] 0 2024-04-25T02:08:50.653 INFO:tasks.workunit.client.0.smithi077.stdout:6/584: rename de/d12/d25/d44/f5d to de/d55/d88/fca 0 2024-04-25T02:08:50.653 INFO:tasks.workunit.client.0.smithi077.stdout:7/461: rmdir d4/d13/d2c 39 2024-04-25T02:08:50.653 INFO:tasks.workunit.client.0.smithi077.stdout:4/500: write d0/d14/d21/d39/f10 [774778,82631] 0 2024-04-25T02:08:50.654 INFO:tasks.workunit.client.0.smithi077.stdout:4/501: chown d0/d14/d60/d62/c6c 15511102 1 2024-04-25T02:08:50.654 INFO:tasks.workunit.client.0.smithi077.stdout:7/462: mknod d4/d13/d18/d24/d3f/d72/c9e 0 2024-04-25T02:08:50.656 INFO:tasks.workunit.client.0.smithi077.stdout:3/436: write d0/d2/de/d48/d15/f2b [657649,72712] 0 2024-04-25T02:08:50.656 INFO:tasks.workunit.client.0.smithi077.stdout:3/437: chown d0/d2 490666 1 2024-04-25T02:08:50.658 INFO:tasks.workunit.client.0.smithi077.stdout:5/487: dwrite d0/d25/f36 [0,4194304] 0 2024-04-25T02:08:50.660 INFO:tasks.workunit.client.0.smithi077.stdout:3/438: unlink d0/d3e/d62/d6a/d6e/l7f 0 2024-04-25T02:08:50.667 INFO:tasks.workunit.client.0.smithi077.stdout:8/559: dwrite d3/da/f35 [0,4194304] 0 2024-04-25T02:08:50.667 INFO:tasks.workunit.client.0.smithi077.stdout:8/560: getdents d3 0 2024-04-25T02:08:50.671 INFO:tasks.workunit.client.0.smithi077.stdout:8/561: link d3/c9 d3/d34/d3d/cac 0 2024-04-25T02:08:50.675 INFO:tasks.workunit.client.0.smithi077.stdout:5/488: write d0/d25/f47 [3374889,3547] 0 2024-04-25T02:08:50.675 INFO:tasks.workunit.client.0.smithi077.stdout:5/489: chown d0/d2/d3/d9/d90 9415929 1 2024-04-25T02:08:50.676 INFO:tasks.workunit.client.0.smithi077.stdout:5/490: mkdir d0/d25/d82/d87/d8b/da5 0 2024-04-25T02:08:50.677 INFO:tasks.workunit.client.0.smithi077.stdout:5/491: creat d0/d2/d20/d23/fa6 x:0 0 0 2024-04-25T02:08:50.679 INFO:tasks.workunit.client.0.smithi077.stdout:2/496: dwrite d2/d78/f7a [0,4194304] 0 2024-04-25T02:08:50.679 INFO:tasks.workunit.client.0.smithi077.stdout:0/470: dwrite d2/f82 [0,4194304] 0 2024-04-25T02:08:50.688 INFO:tasks.workunit.client.0.smithi077.stdout:8/562: write d3/da/d27/d16/f66 [236808,93287] 0 2024-04-25T02:08:50.688 INFO:tasks.workunit.client.0.smithi077.stdout:8/563: stat d3/da/db/df/d2b/d7b/c97 0 2024-04-25T02:08:50.689 INFO:tasks.workunit.client.0.smithi077.stdout:6/585: dwrite f0 [0,4194304] 0 2024-04-25T02:08:50.808 INFO:tasks.workunit.client.0.smithi077.stdout:2/497: creat d2/d59/d79/f9f x:0 0 0 2024-04-25T02:08:50.808 INFO:tasks.workunit.client.0.smithi077.stdout:7/463: dwrite d4/d13/d18/d2d/d30/f65 [0,4194304] 0 2024-04-25T02:08:50.809 INFO:tasks.workunit.client.0.smithi077.stdout:4/502: dwrite d0/d14/d60/d86/d25/f45 [0,4194304] 0 2024-04-25T02:08:50.811 INFO:tasks.workunit.client.0.smithi077.stdout:3/439: dwrite d0/d17/f80 [0,4194304] 0 2024-04-25T02:08:50.811 INFO:tasks.workunit.client.0.smithi077.stdout:3/440: read d0/d2/de/d48/d15/f2b [3768024,105752] 0 2024-04-25T02:08:50.812 INFO:tasks.workunit.client.0.smithi077.stdout:0/471: rename d2/d27/d2d/c68 to d2/d17/d1d/d34/d4c/ca6 0 2024-04-25T02:08:50.815 INFO:tasks.workunit.client.0.smithi077.stdout:5/492: dwrite d0/f85 [0,4194304] 0 2024-04-25T02:08:50.815 INFO:tasks.workunit.client.0.smithi077.stdout:8/564: link d3/da/db/df/d2b/d70/f8f d3/da/d27/d44/fad 0 2024-04-25T02:08:50.826 INFO:tasks.workunit.client.0.smithi077.stdout:3/441: truncate d0/d2/de/f82 1494976 0 2024-04-25T02:08:50.827 INFO:tasks.workunit.client.0.smithi077.stdout:0/472: write d2/d17/d1d/d34/d4c/fa0 [3054869,67183] 0 2024-04-25T02:08:50.827 INFO:tasks.workunit.client.0.smithi077.stdout:0/473: chown d2/d17/d1d/d34/d4c/da2/f45 0 1 2024-04-25T02:08:50.829 INFO:tasks.workunit.client.0.smithi077.stdout:7/464: rename d4/d13/d5b/f82 to d4/f9f 0 2024-04-25T02:08:50.829 INFO:tasks.workunit.client.0.smithi077.stdout:7/465: stat d4/d13/d18/c23 0 2024-04-25T02:08:50.829 INFO:tasks.workunit.client.0.smithi077.stdout:7/466: write d4/d13/d66/f9b [353280,69571] 0 2024-04-25T02:08:50.831 INFO:tasks.workunit.client.0.smithi077.stdout:5/493: mknod d0/d2/d68/ca7 0 2024-04-25T02:08:50.831 INFO:tasks.workunit.client.0.smithi077.stdout:0/474: dread d2/d17/d1d/d34/d4c/f9a [0,4194304] 0 2024-04-25T02:08:50.833 INFO:tasks.workunit.client.0.smithi077.stdout:8/565: link d3/da/d27/d16/f66 d3/d81/d86/fae 0 2024-04-25T02:08:50.833 INFO:tasks.workunit.client.0.smithi077.stdout:3/442: mknod d0/d2/d2f/d5f/c9d 0 2024-04-25T02:08:50.835 INFO:tasks.workunit.client.0.smithi077.stdout:8/566: dread d3/da/d27/f1e [0,4194304] 0 2024-04-25T02:08:50.836 INFO:tasks.workunit.client.0.smithi077.stdout:2/498: dwrite d2/d9/f17 [0,4194304] 0 2024-04-25T02:08:50.836 INFO:tasks.workunit.client.0.smithi077.stdout:2/499: write d2/d9/d19/f23 [192710,64577] 0 2024-04-25T02:08:50.836 INFO:tasks.workunit.client.0.smithi077.stdout:2/500: fsync d2/d9/fb 0 2024-04-25T02:08:50.836 INFO:tasks.workunit.client.0.smithi077.stdout:4/503: dwrite d0/d14/d21/d39/da/d12/d35/f71 [4194304,4194304] 0 2024-04-25T02:08:50.836 INFO:tasks.workunit.client.0.smithi077.stdout:7/467: symlink d4/d13/d5b/d8b/la0 0 2024-04-25T02:08:50.838 INFO:tasks.workunit.client.0.smithi077.stdout:5/494: unlink d0/d25/d82/d87/d8b/f2c 0 2024-04-25T02:08:50.839 INFO:tasks.workunit.client.0.smithi077.stdout:0/475: rmdir d2/d17/d1d/d34/d4c/da2 39 2024-04-25T02:08:50.840 INFO:tasks.workunit.client.0.smithi077.stdout:3/443: creat d0/d3e/d42/d64/d88/f9e x:0 0 0 2024-04-25T02:08:50.840 INFO:tasks.workunit.client.0.smithi077.stdout:3/444: write d0/d3e/d62/f68 [36358,18726] 0 2024-04-25T02:08:50.842 INFO:tasks.workunit.client.0.smithi077.stdout:2/501: mknod d2/d9/d19/d1c/d3f/d53/d86/ca0 0 2024-04-25T02:08:50.845 INFO:tasks.workunit.client.0.smithi077.stdout:8/567: write d3/da/f45 [5764740,126373] 0 2024-04-25T02:08:50.845 INFO:tasks.workunit.client.0.smithi077.stdout:7/468: mknod d4/d13/ca1 0 2024-04-25T02:08:50.846 INFO:tasks.workunit.client.0.smithi077.stdout:7/469: fsync d4/d13/d18/d2d/d30/f8c 0 2024-04-25T02:08:50.846 INFO:tasks.workunit.client.0.smithi077.stdout:5/495: dread d0/d2/d3/d9/f2a [0,4194304] 0 2024-04-25T02:08:50.847 INFO:tasks.workunit.client.0.smithi077.stdout:0/476: mkdir d2/d9/d71/d74/da7 0 2024-04-25T02:08:50.848 INFO:tasks.workunit.client.0.smithi077.stdout:3/445: mknod d0/d2/d83/c9f 0 2024-04-25T02:08:50.849 INFO:tasks.workunit.client.0.smithi077.stdout:2/502: creat d2/d9/d18/d31/d7c/fa1 x:0 0 0 2024-04-25T02:08:50.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.843+0000 7f453e49e700 1 -- 172.21.15.77:0/1561242086 --> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f453810e6c0 con 0x7f4520069150 2024-04-25T02:08:50.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.845+0000 7f4534ff9700 1 -- 172.21.15.77:0/1561242086 <== mgr.14208 v2:172.21.15.77:6800/310739264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f453810e6c0 con 0x7f4520069150 2024-04-25T02:08:50.852 INFO:tasks.workunit.client.0.smithi077.stdout:8/568: mknod d3/da/db/df/d2b/caf 0 2024-04-25T02:08:50.853 INFO:tasks.workunit.client.0.smithi077.stdout:7/470: creat d4/d13/d66/fa2 x:0 0 0 2024-04-25T02:08:50.853 INFO:tasks.workunit.client.0.smithi077.stdout:7/471: dread - d4/d13/d18/d24/d3f/d58/f52 zero size 2024-04-25T02:08:50.854 INFO:tasks.workunit.client.0.smithi077.stdout:8/569: mkdir d3/d7a/d7e/db0 0 2024-04-25T02:08:50.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.848+0000 7f453e49e700 1 -- 172.21.15.77:0/1561242086 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f4520069150 msgr2=0x7f452006b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:50.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.848+0000 7f453e49e700 1 --2- 172.21.15.77:0/1561242086 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f4520069150 0x7f452006b600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f452c008fd0 tx=0x7f452c00b040 comp rx=0 tx=0).stop 2024-04-25T02:08:50.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.848+0000 7f453e49e700 1 -- 172.21.15.77:0/1561242086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45380fbcb0 msgr2=0x7f453810c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:50.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.848+0000 7f453e49e700 1 --2- 172.21.15.77:0/1561242086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45380fbcb0 0x7f453810c8c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4528000c00 tx=0x7f4528009e30 comp rx=0 tx=0).stop 2024-04-25T02:08:50.855 INFO:tasks.workunit.client.0.smithi077.stdout:0/477: write d2/d8/d5f/f6c [3875876,43330] 0 2024-04-25T02:08:50.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.849+0000 7f453e49e700 1 -- 172.21.15.77:0/1561242086 shutdown_connections 2024-04-25T02:08:50.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.849+0000 7f453e49e700 1 --2- 172.21.15.77:0/1561242086 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f4520069150 0x7f452006b600 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:50.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.849+0000 7f453e49e700 1 --2- 172.21.15.77:0/1561242086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45380fbcb0 0x7f453810c8c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:50.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.849+0000 7f453e49e700 1 --2- 172.21.15.77:0/1561242086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45380fcf60 0x7f453810ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:50.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.849+0000 7f453e49e700 1 -- 172.21.15.77:0/1561242086 >> 172.21.15.77:0/1561242086 conn(0x7f45380f7430 msgr2=0x7f45380f8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:50.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.849+0000 7f453e49e700 1 -- 172.21.15.77:0/1561242086 shutdown_connections 2024-04-25T02:08:50.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:50.849+0000 7f453e49e700 1 -- 172.21.15.77:0/1561242086 wait complete. 2024-04-25T02:08:50.857 INFO:tasks.workunit.client.0.smithi077.stdout:7/472: mknod d4/d13/d18/d24/ca3 0 2024-04-25T02:08:50.857 INFO:tasks.workunit.client.0.smithi077.stdout:5/496: mkdir d0/d2/da8 0 2024-04-25T02:08:50.857 INFO:tasks.workunit.client.0.smithi077.stdout:7/473: fsync d4/fa 0 2024-04-25T02:08:50.857 INFO:tasks.workunit.client.0.smithi077.stdout:3/446: dread d0/d2/d83/f86 [0,4194304] 0 2024-04-25T02:08:50.859 INFO:tasks.workunit.client.0.smithi077.stdout:9/519: sync 2024-04-25T02:08:50.860 INFO:tasks.workunit.client.0.smithi077.stdout:5/497: symlink d0/d2/d20/la9 0 2024-04-25T02:08:50.860 INFO:tasks.workunit.client.0.smithi077.stdout:8/570: write d3/da/d27/f21 [3790289,13252] 0 2024-04-25T02:08:50.862 INFO:tasks.workunit.client.0.smithi077.stdout:9/520: rename df/d1b/d56/d67/d68/ca4 to df/d1b/d48/d75/ca9 0 2024-04-25T02:08:50.862 INFO:tasks.workunit.client.0.smithi077.stdout:7/474: dread d4/d13/d18/d24/d3f/d59/f5f [0,4194304] 0 2024-04-25T02:08:50.862 INFO:tasks.workunit.client.0.smithi077.stdout:9/521: chown df/f49 1049915175 1 2024-04-25T02:08:50.865 INFO:tasks.workunit.client.0.smithi077.stdout:9/522: dread df/f13 [0,4194304] 0 2024-04-25T02:08:50.865 INFO:tasks.workunit.client.0.smithi077.stdout:9/523: read - df/d60/f83 zero size 2024-04-25T02:08:50.865 INFO:tasks.workunit.client.0.smithi077.stdout:9/524: getdents df/d1b/d70/d84 0 2024-04-25T02:08:50.866 INFO:tasks.workunit.client.0.smithi077.stdout:8/571: truncate d3/da/db/df/d2b/d37/f69 1775809 0 2024-04-25T02:08:50.869 INFO:tasks.workunit.client.0.smithi077.stdout:9/525: mknod df/d60/d87/caa 0 2024-04-25T02:08:50.869 INFO:tasks.workunit.client.0.smithi077.stdout:7/475: symlink d4/d13/d18/d24/d3f/d58/la4 0 2024-04-25T02:08:50.869 INFO:tasks.workunit.client.0.smithi077.stdout:9/526: fsync df/d1b/d56/d67/f8e 0 2024-04-25T02:08:50.870 INFO:tasks.workunit.client.0.smithi077.stdout:3/447: write d0/d2/de/d48/f2c [3374707,40140] 0 2024-04-25T02:08:50.870 INFO:tasks.workunit.client.0.smithi077.stdout:7/476: write d4/d13/d18/d2d/d30/f63 [189383,31374] 0 2024-04-25T02:08:50.870 INFO:tasks.workunit.client.0.smithi077.stdout:7/477: read - d4/d13/d18/d24/d3f/f8d zero size 2024-04-25T02:08:50.871 INFO:tasks.workunit.client.0.smithi077.stdout:9/527: rmdir df/d60/d87 39 2024-04-25T02:08:50.871 INFO:tasks.workunit.client.0.smithi077.stdout:9/528: read - df/d1b/d48/d75/fa5 zero size 2024-04-25T02:08:50.874 INFO:tasks.workunit.client.0.smithi077.stdout:3/448: mkdir d0/d2/de/d36/da0 0 2024-04-25T02:08:50.874 INFO:tasks.workunit.client.0.smithi077.stdout:3/449: fdatasync d0/d2/de/d48/d15/f1d 0 2024-04-25T02:08:50.876 INFO:tasks.workunit.client.0.smithi077.stdout:7/478: dread d4/d13/d18/d24/f57 [0,4194304] 0 2024-04-25T02:08:50.876 INFO:tasks.workunit.client.0.smithi077.stdout:7/479: rename d4/d13/d18 to d4/d13/d18/da5 22 2024-04-25T02:08:50.876 INFO:tasks.workunit.client.0.smithi077.stdout:3/450: mkdir d0/d3e/da1 0 2024-04-25T02:08:50.876 INFO:tasks.workunit.client.0.smithi077.stdout:3/451: write d0/d17/d4b/d59/f8e [480560,14398] 0 2024-04-25T02:08:50.880 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-04-25T02:08:50.880 INFO:tasks.workunit.client.0.smithi077.stdout:3/452: link d0/d2/de/c52 d0/ca2 0 2024-04-25T02:08:50.882 INFO:tasks.workunit.client.0.smithi077.stdout:3/453: creat d0/d17/d4b/fa3 x:0 0 0 2024-04-25T02:08:50.883 INFO:tasks.workunit.client.0.smithi077.stdout:3/454: creat d0/d2/fa4 x:0 0 0 2024-04-25T02:08:50.890 INFO:tasks.workunit.client.0.smithi077.stdout:1/447: sync 2024-04-25T02:08:50.890 INFO:tasks.workunit.client.0.smithi077.stdout:6/586: sync 2024-04-25T02:08:50.890 INFO:tasks.workunit.client.0.smithi077.stdout:6/587: write de/d5b/da6/fb9 [1600832,8820] 0 2024-04-25T02:08:50.891 INFO:tasks.workunit.client.0.smithi077.stdout:5/498: dwrite d0/d2/d20/d23/d4a/f74 [0,4194304] 0 2024-04-25T02:08:50.891 INFO:tasks.workunit.client.0.smithi077.stdout:1/448: mknod db/df/d14/d4d/d82/d32/d8f/c99 0 2024-04-25T02:08:50.892 INFO:tasks.workunit.client.0.smithi077.stdout:8/572: dwrite d3/da/db/df/d2b/f3b [0,4194304] 0 2024-04-25T02:08:50.893 INFO:tasks.workunit.client.0.smithi077.stdout:0/478: dwrite d2/d8/f97 [0,4194304] 0 2024-04-25T02:08:50.893 INFO:tasks.workunit.client.0.smithi077.stdout:6/588: mknod de/ccb 0 2024-04-25T02:08:50.895 INFO:tasks.workunit.client.0.smithi077.stdout:9/529: getdents df/d60/d87 0 2024-04-25T02:08:50.897 INFO:tasks.workunit.client.0.smithi077.stdout:8/573: dread d3/f6f [0,4194304] 0 2024-04-25T02:08:50.897 INFO:tasks.workunit.client.0.smithi077.stdout:5/499: creat d0/d2/d3/d9/d39/d44/d80/faa x:0 0 0 2024-04-25T02:08:50.898 INFO:tasks.workunit.client.0.smithi077.stdout:5/500: stat d0/d2/d1b/d35 0 2024-04-25T02:08:50.899 INFO:tasks.workunit.client.0.smithi077.stdout:1/449: symlink db/df/d14/d4d/d82/d5c/d81/l9a 0 2024-04-25T02:08:50.901 INFO:tasks.workunit.client.0.smithi077.stdout:0/479: mkdir d2/d17/d1d/d34/d4c/da2/d9e/da8 0 2024-04-25T02:08:50.901 INFO:tasks.workunit.client.0.smithi077.stdout:0/480: chown d2/d17/d1d/c80 11 1 2024-04-25T02:08:50.901 INFO:tasks.workunit.client.0.smithi077.stdout:8/574: truncate d3/da/d27/d16/d6b/f6e 1224914 0 2024-04-25T02:08:50.901 INFO:tasks.workunit.client.0.smithi077.stdout:8/575: dread - d3/da/db/df/d30/f8b zero size 2024-04-25T02:08:50.901 INFO:tasks.workunit.client.0.smithi077.stdout:3/455: dwrite d0/f1f [0,4194304] 0 2024-04-25T02:08:50.902 INFO:tasks.workunit.client.0.smithi077.stdout:5/501: truncate d0/d25/f1a 6351554 0 2024-04-25T02:08:50.908 INFO:tasks.workunit.client.0.smithi077.stdout:5/502: truncate d0/d2/d3/d9/f2a 3718394 0 2024-04-25T02:08:50.909 INFO:tasks.workunit.client.0.smithi077.stdout:1/450: mknod db/c9b 0 2024-04-25T02:08:50.909 INFO:tasks.workunit.client.0.smithi077.stdout:1/451: readlink db/df/d14/d4d/d82/d32/l3a 0 2024-04-25T02:08:50.910 INFO:tasks.workunit.client.0.smithi077.stdout:8/576: rmdir d3/da/db/df/d2b/d7b 39 2024-04-25T02:08:50.913 INFO:tasks.workunit.client.0.smithi077.stdout:5/503: unlink d0/d2/d3/d9/d39/d44/c4e 0 2024-04-25T02:08:50.914 INFO:tasks.workunit.client.0.smithi077.stdout:5/504: write d0/d2/d20/f21 [3137768,115095] 0 2024-04-25T02:08:50.914 INFO:tasks.workunit.client.0.smithi077.stdout:5/505: write d0/d2/d3/d9/d39/d44/f53 [1577395,64515] 0 2024-04-25T02:08:50.914 INFO:tasks.workunit.client.0.smithi077.stdout:1/452: mknod db/df/d14/d4d/d82/d5c/c9c 0 2024-04-25T02:08:50.915 INFO:tasks.workunit.client.0.smithi077.stdout:8/577: mkdir d3/da/d27/d44/db1 0 2024-04-25T02:08:50.916 INFO:tasks.workunit.client.0.smithi077.stdout:1/453: dread db/df/d14/d4d/d82/f39 [0,4194304] 0 2024-04-25T02:08:50.918 INFO:tasks.workunit.client.0.smithi077.stdout:5/506: unlink d0/d2/d3/d9/d39/d44/f48 0 2024-04-25T02:08:50.918 INFO:tasks.workunit.client.0.smithi077.stdout:5/507: dread - d0/d2/d3/d9/d39/f94 zero size 2024-04-25T02:08:50.922 INFO:tasks.workunit.client.0.smithi077.stdout:0/481: getdents d2/d17/d1d/d34/d4c/da2/d9e 0 2024-04-25T02:08:50.923 INFO:tasks.workunit.client.0.smithi077.stdout:6/589: dwrite de/d12/d25/d38/fbe [0,4194304] 0 2024-04-25T02:08:50.924 INFO:tasks.workunit.client.0.smithi077.stdout:9/530: dwrite df/d1b/f30 [0,4194304] 0 2024-04-25T02:08:50.926 INFO:tasks.workunit.client.0.smithi077.stdout:3/456: dwrite d0/d2/de/d48/f29 [0,4194304] 0 2024-04-25T02:08:50.927 INFO:tasks.workunit.client.0.smithi077.stdout:3/457: truncate d0/d17/f5d 866493 0 2024-04-25T02:08:50.928 INFO:tasks.workunit.client.0.smithi077.stdout:9/531: link df/l4a df/d1b/d70/lab 0 2024-04-25T02:08:50.929 INFO:tasks.workunit.client.0.smithi077.stdout:8/578: dread d3/da/d27/d16/f22 [0,4194304] 0 2024-04-25T02:08:50.930 INFO:tasks.workunit.client.0.smithi077.stdout:3/458: link d0/f1f d0/d3e/d93/fa5 0 2024-04-25T02:08:50.932 INFO:tasks.workunit.client.0.smithi077.stdout:8/579: truncate d3/da/db/df/d30/f55 1921267 0 2024-04-25T02:08:50.934 INFO:tasks.workunit.client.0.smithi077.stdout:6/590: write de/d12/d25/d60/d63/f68 [912279,42447] 0 2024-04-25T02:08:50.934 INFO:tasks.workunit.client.0.smithi077.stdout:6/591: fsync de/d12/f7a 0 2024-04-25T02:08:50.934 INFO:tasks.workunit.client.0.smithi077.stdout:6/592: dread - de/d15/fc8 zero size 2024-04-25T02:08:50.934 INFO:tasks.workunit.client.0.smithi077.stdout:6/593: read - de/d12/d25/d38/fb1 zero size 2024-04-25T02:08:50.934 INFO:tasks.workunit.client.0.smithi077.stdout:8/580: symlink d3/d34/d3d/lb2 0 2024-04-25T02:08:50.934 INFO:tasks.workunit.client.0.smithi077.stdout:8/581: chown d3/da/db/df/d2b/d70/l85 100 1 2024-04-25T02:08:50.935 INFO:tasks.workunit.client.0.smithi077.stdout:8/582: stat d3/da 0 2024-04-25T02:08:50.938 INFO:tasks.workunit.client.0.smithi077.stdout:6/594: dread de/d15/d36/f56 [0,4194304] 0 2024-04-25T02:08:50.938 INFO:tasks.workunit.client.0.smithi077.stdout:6/595: readlink de/d12/d25/d60/d63/l8e 0 2024-04-25T02:08:50.940 INFO:tasks.workunit.client.0.smithi077.stdout:6/596: symlink de/d55/d88/lcc 0 2024-04-25T02:08:50.942 INFO:tasks.workunit.client.0.smithi077.stdout:9/532: dread df/d1b/f20 [0,4194304] 0 2024-04-25T02:08:50.942 INFO:tasks.workunit.client.0.smithi077.stdout:9/533: fsync df/d1b/d48/d86/f89 0 2024-04-25T02:08:50.943 INFO:tasks.workunit.client.0.smithi077.stdout:9/534: creat df/d1b/d56/d67/fac x:0 0 0 2024-04-25T02:08:50.944 INFO:tasks.workunit.client.0.smithi077.stdout:6/597: rename de/d15 to de/d12/d25/d3a/d6a/dcd 0 2024-04-25T02:08:50.944 INFO:tasks.workunit.client.0.smithi077.stdout:3/459: write d0/d2/de/f61 [356443,94203] 0 2024-04-25T02:08:50.945 INFO:tasks.workunit.client.0.smithi077.stdout:3/460: stat d0/d3e/d93 0 2024-04-25T02:08:50.945 INFO:tasks.workunit.client.0.smithi077.stdout:9/535: creat df/d1b/d70/d84/fad x:0 0 0 2024-04-25T02:08:50.945 INFO:tasks.workunit.client.0.smithi077.stdout:9/536: write df/f10 [4969383,59692] 0 2024-04-25T02:08:50.953 INFO:tasks.workunit.client.0.smithi077.stdout:1/454: dwrite db/f18 [0,4194304] 0 2024-04-25T02:08:50.953 INFO:tasks.workunit.client.0.smithi077.stdout:1/455: truncate db/df/d14/d4d/d82/f7a 2078400 0 2024-04-25T02:08:50.953 INFO:tasks.workunit.client.0.smithi077.stdout:5/508: dwrite d0/d2/d20/d41/f9a [0,4194304] 0 2024-04-25T02:08:50.953 INFO:tasks.workunit.client.0.smithi077.stdout:0/482: dwrite d2/d8/f13 [0,4194304] 0 2024-04-25T02:08:50.953 INFO:tasks.workunit.client.0.smithi077.stdout:5/509: dread - d0/d2/d3/f34 zero size 2024-04-25T02:08:50.953 INFO:tasks.workunit.client.0.smithi077.stdout:5/510: creat d0/d2/d1b/d35/fab x:0 0 0 2024-04-25T02:08:50.958 INFO:tasks.workunit.client.0.smithi077.stdout:1/456: link db/df/d14/d4d/d82/d32/l49 db/df/d14/d4d/d82/d5c/d81/l9d 0 2024-04-25T02:08:50.958 INFO:tasks.workunit.client.0.smithi077.stdout:1/457: creat db/df/d14/d3e/d69/f9e x:0 0 0 2024-04-25T02:08:50.958 INFO:tasks.workunit.client.0.smithi077.stdout:1/458: write db/df/d14/d4d/d82/d5c/f6a [96105,93138] 0 2024-04-25T02:08:50.958 INFO:tasks.workunit.client.0.smithi077.stdout:1/459: write db/df/d14/d3e/d69/f9e [568897,101119] 0 2024-04-25T02:08:50.959 INFO:tasks.workunit.client.0.smithi077.stdout:0/483: creat d2/d9/d2a/fa9 x:0 0 0 2024-04-25T02:08:50.959 INFO:tasks.workunit.client.0.smithi077.stdout:0/484: chown d2/d17/d4e 1623 1 2024-04-25T02:08:50.959 INFO:tasks.workunit.client.0.smithi077.stdout:0/485: chown d2/d17/d1d/d34/d4c/f81 38700366 1 2024-04-25T02:08:50.959 INFO:tasks.workunit.client.0.smithi077.stdout:0/486: truncate d2/d9/d2a/f58 1928528 0 2024-04-25T02:08:50.960 INFO:tasks.workunit.client.0.smithi077.stdout:6/598: dread de/d12/f17 [0,4194304] 0 2024-04-25T02:08:50.960 INFO:tasks.workunit.client.0.smithi077.stdout:6/599: chown de/f46 156 1 2024-04-25T02:08:50.960 INFO:tasks.workunit.client.0.smithi077.stdout:6/600: readlink de/l39 0 2024-04-25T02:08:50.961 INFO:tasks.workunit.client.0.smithi077.stdout:3/461: dwrite d0/d2/de/d48/f3d [0,4194304] 0 2024-04-25T02:08:50.961 INFO:tasks.workunit.client.0.smithi077.stdout:9/537: dread df/d1b/f47 [0,4194304] 0 2024-04-25T02:08:50.961 INFO:tasks.workunit.client.0.smithi077.stdout:5/511: rename d0/d2/d20/d41/f4b to d0/d2/d1b/d35/fac 0 2024-04-25T02:08:50.961 INFO:tasks.workunit.client.0.smithi077.stdout:5/512: chown d0/d2/d1b/c58 0 1 2024-04-25T02:08:50.963 INFO:tasks.workunit.client.0.smithi077.stdout:0/487: unlink d2/d9/d71/c8f 0 2024-04-25T02:08:50.963 INFO:tasks.workunit.client.0.smithi077.stdout:0/488: chown d2/d17/d1d/c80 653 1 2024-04-25T02:08:50.964 INFO:tasks.workunit.client.0.smithi077.stdout:6/601: unlink de/d12/f8a 0 2024-04-25T02:08:50.966 INFO:tasks.workunit.client.0.smithi077.stdout:9/538: creat df/d1b/d56/fae x:0 0 0 2024-04-25T02:08:50.966 INFO:tasks.workunit.client.0.smithi077.stdout:9/539: write df/f2f [5008783,98504] 0 2024-04-25T02:08:50.966 INFO:tasks.workunit.client.0.smithi077.stdout:9/540: stat df/d1b/f20 0 2024-04-25T02:08:50.967 INFO:tasks.workunit.client.0.smithi077.stdout:3/462: mkdir d0/d2/de/d36/da6 0 2024-04-25T02:08:50.967 INFO:tasks.workunit.client.0.smithi077.stdout:3/463: stat d0 0 2024-04-25T02:08:50.969 INFO:tasks.workunit.client.0.smithi077.stdout:1/460: rename db/df/d14/d33/d6c/c76 to db/df/d56/d5d/c9f 0 2024-04-25T02:08:50.969 INFO:tasks.workunit.client.0.smithi077.stdout:1/461: creat db/df/d14/d3e/d69/fa0 x:0 0 0 2024-04-25T02:08:50.969 INFO:tasks.workunit.client.0.smithi077.stdout:1/462: write db/df/d56/d5d/d77/f8d [374872,449] 0 2024-04-25T02:08:50.969 INFO:tasks.workunit.client.0.smithi077.stdout:1/463: write db/df/d56/f58 [641464,94201] 0 2024-04-25T02:08:50.969 INFO:tasks.workunit.client.0.smithi077.stdout:1/464: write db/df/d14/d4d/d82/d5c/f5e [4216731,69732] 0 2024-04-25T02:08:50.970 INFO:tasks.workunit.client.0.smithi077.stdout:5/513: truncate d0/f85 1742763 0 2024-04-25T02:08:50.970 INFO:tasks.workunit.client.0.smithi077.stdout:5/514: readlink d0/d25/d82/d87/d8b/d5a/la3 0 2024-04-25T02:08:50.970 INFO:tasks.workunit.client.0.smithi077.stdout:0/489: rmdir d2/d17/d1d/d34/d4c/da2/d51 39 2024-04-25T02:08:50.970 INFO:tasks.workunit.client.0.smithi077.stdout:0/490: dread - d2/d17/d1d/d34/d83/f8d zero size 2024-04-25T02:08:50.971 INFO:tasks.workunit.client.0.smithi077.stdout:6/602: creat de/d12/d25/fce x:0 0 0 2024-04-25T02:08:50.978 INFO:tasks.workunit.client.0.smithi077.stdout:9/541: mknod df/d1b/d48/d86/caf 0 2024-04-25T02:08:50.981 INFO:tasks.workunit.client.0.smithi077.stdout:1/465: rmdir db/df/d14/d3e 39 2024-04-25T02:08:50.983 INFO:tasks.workunit.client.0.smithi077.stdout:5/515: link d0/d2/d3/d9/d39/d44/d5f/f60 d0/d2/d20/d23/d4a/fad 0 2024-04-25T02:08:50.983 INFO:tasks.workunit.client.0.smithi077.stdout:5/516: fdatasync d0/d2/d20/d23/d4a/f74 0 2024-04-25T02:08:50.983 INFO:tasks.workunit.client.0.smithi077.stdout:5/517: fdatasync d0/d2/d1b/d35/fab 0 2024-04-25T02:08:50.983 INFO:tasks.workunit.client.0.smithi077.stdout:5/518: creat d0/d2/d3/d9/d39/fae x:0 0 0 2024-04-25T02:08:50.984 INFO:tasks.workunit.client.0.smithi077.stdout:0/491: symlink d2/d9/d71/d74/da7/laa 0 2024-04-25T02:08:50.984 INFO:tasks.workunit.client.0.smithi077.stdout:6/603: rmdir de/d12/d25/d3a/d6a 39 2024-04-25T02:08:50.985 INFO:tasks.workunit.client.0.smithi077.stdout:9/542: creat df/d1b/d48/d86/fb0 x:0 0 0 2024-04-25T02:08:50.987 INFO:tasks.workunit.client.0.smithi077.stdout:3/464: rename d0/d17/c7c to d0/d2/de/d48/ca7 0 2024-04-25T02:08:50.987 INFO:tasks.workunit.client.0.smithi077.stdout:3/465: stat d0/d2/de/d36 0 2024-04-25T02:08:50.987 INFO:tasks.workunit.client.0.smithi077.stdout:5/519: dread d0/d25/f1a [4194304,4194304] 0 2024-04-25T02:08:50.992 INFO:tasks.workunit.client.0.smithi077.stdout:0/492: rmdir d2/d17/d1d/d34/d4c/da2/d9e/da8 0 2024-04-25T02:08:50.992 INFO:tasks.workunit.client.0.smithi077.stdout:0/493: creat d2/d17/d1d/d34/d4c/fab x:0 0 0 2024-04-25T02:08:50.994 INFO:tasks.workunit.client.0.smithi077.stdout:9/543: mkdir df/d1b/d56/d67/d68/db1 0 2024-04-25T02:08:50.995 INFO:tasks.workunit.client.0.smithi077.stdout:3/466: mkdir d0/d2/de/d36/da0/da8 0 2024-04-25T02:08:50.996 INFO:tasks.workunit.client.0.smithi077.stdout:5/520: mkdir d0/d2/da8/daf 0 2024-04-25T02:08:51.007 INFO:tasks.workunit.client.0.smithi077.stdout:3/467: dread d0/d2/de/d48/d15/f56 [0,4194304] 0 2024-04-25T02:08:51.010 INFO:tasks.workunit.client.0.smithi077.stdout:4/504: sync 2024-04-25T02:08:51.011 INFO:tasks.workunit.client.0.smithi077.stdout:0/494: mknod d2/d8/d5f/d9f/cac 0 2024-04-25T02:08:51.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.005+0000 7fd7d37b6700 1 -- 172.21.15.77:0/3902116585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7cc064d50 msgr2=0x7fd7cc0fb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.005+0000 7fd7d37b6700 1 --2- 172.21.15.77:0/3902116585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7cc064d50 0x7fd7cc0fb390 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8004880 tx=0x7fd7c8009e30 comp rx=0 tx=0).stop 2024-04-25T02:08:51.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.005+0000 7fd7d37b6700 1 -- 172.21.15.77:0/3902116585 shutdown_connections 2024-04-25T02:08:51.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.005+0000 7fd7d37b6700 1 --2- 172.21.15.77:0/3902116585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7cc0651f0 0x7fd7cc0fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.005+0000 7fd7d37b6700 1 --2- 172.21.15.77:0/3902116585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7cc064d50 0x7fd7cc0fb390 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.005+0000 7fd7d37b6700 1 -- 172.21.15.77:0/3902116585 >> 172.21.15.77:0/3902116585 conn(0x7fd7cc0f6b80 msgr2=0x7fd7cc0f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:51.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.005+0000 7fd7d37b6700 1 -- 172.21.15.77:0/3902116585 shutdown_connections 2024-04-25T02:08:51.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.005+0000 7fd7d37b6700 1 -- 172.21.15.77:0/3902116585 wait complete. 2024-04-25T02:08:51.012 INFO:tasks.workunit.client.0.smithi077.stdout:6/604: rmdir de/d12/d25/d4b 39 2024-04-25T02:08:51.013 INFO:tasks.workunit.client.0.smithi077.stdout:6/605: creat de/d53/fcf x:0 0 0 2024-04-25T02:08:51.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.005+0000 7fd7d37b6700 1 Processor -- start 2024-04-25T02:08:51.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.005+0000 7fd7d37b6700 1 -- start start 2024-04-25T02:08:51.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.006+0000 7fd7d37b6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7cc064d50 0x7fd7cc10fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.006+0000 7fd7d37b6700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7cc0651f0 0x7fd7cc110130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.006+0000 7fd7d37b6700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc110730 con 0x7fd7cc0651f0 2024-04-25T02:08:51.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.006+0000 7fd7d37b6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc110f80 con 0x7fd7cc064d50 2024-04-25T02:08:51.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.006+0000 7fd7d0d51700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7cc0651f0 0x7fd7cc110130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.006+0000 7fd7d0d51700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7cc0651f0 0x7fd7cc110130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33372/0 (socket says 172.21.15.77:33372) 2024-04-25T02:08:51.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.006+0000 7fd7d0d51700 1 -- 172.21.15.77:0/3020790488 learned_addr learned my addr 172.21.15.77:0/3020790488 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:08:51.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.006+0000 7fd7d1552700 1 --2- 172.21.15.77:0/3020790488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7cc064d50 0x7fd7cc10fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.006+0000 7fd7d0d51700 1 -- 172.21.15.77:0/3020790488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7cc064d50 msgr2=0x7fd7cc10fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.006+0000 7fd7d0d51700 1 --2- 172.21.15.77:0/3020790488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7cc064d50 0x7fd7cc10fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.006+0000 7fd7d0d51700 1 -- 172.21.15.77:0/3020790488 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c8005040 con 0x7fd7cc0651f0 2024-04-25T02:08:51.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.006+0000 7fd7d1552700 1 --2- 172.21.15.77:0/3020790488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7cc064d50 0x7fd7cc10fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:51.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.006+0000 7fd7d0d51700 1 --2- 172.21.15.77:0/3020790488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7cc0651f0 0x7fd7cc110130 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0041d0 tx=0x7fd7bc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:51.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.007+0000 7fd7c1ffb700 1 -- 172.21.15.77:0/3020790488 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7bc007cc0 con 0x7fd7cc0651f0 2024-04-25T02:08:51.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.007+0000 7fd7c1ffb700 1 -- 172.21.15.77:0/3020790488 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd7bc00f040 con 0x7fd7cc0651f0 2024-04-25T02:08:51.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.007+0000 7fd7d37b6700 1 -- 172.21.15.77:0/3020790488 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7cc111200 con 0x7fd7cc0651f0 2024-04-25T02:08:51.016 INFO:tasks.workunit.client.0.smithi077.stdout:5/521: unlink d0/d25/d82/d87/d8b/d5a/f6b 0 2024-04-25T02:08:51.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.007+0000 7fd7c1ffb700 1 -- 172.21.15.77:0/3020790488 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7bc00ca50 con 0x7fd7cc0651f0 2024-04-25T02:08:51.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.007+0000 7fd7d37b6700 1 -- 172.21.15.77:0/3020790488 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7cc111740 con 0x7fd7cc0651f0 2024-04-25T02:08:51.017 INFO:tasks.workunit.client.0.smithi077.stdout:3/468: symlink d0/d40/la9 0 2024-04-25T02:08:51.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.009+0000 7fd7d37b6700 1 -- 172.21.15.77:0/3020790488 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7cc05f5c0 con 0x7fd7cc0651f0 2024-04-25T02:08:51.017 INFO:tasks.workunit.client.0.smithi077.stdout:4/505: creat d0/d14/d60/d62/fa8 x:0 0 0 2024-04-25T02:08:51.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.009+0000 7fd7c1ffb700 1 -- 172.21.15.77:0/3020790488 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fd7bc00cbb0 con 0x7fd7cc0651f0 2024-04-25T02:08:51.018 INFO:tasks.workunit.client.0.smithi077.stdout:1/466: rmdir db 39 2024-04-25T02:08:51.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.009+0000 7fd7c1ffb700 1 --2- 172.21.15.77:0/3020790488 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fd7b80692a0 0x7fd7b806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.009+0000 7fd7c1ffb700 1 -- 172.21.15.77:0/3020790488 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd7bc086ba0 con 0x7fd7cc0651f0 2024-04-25T02:08:51.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.010+0000 7fd7d1552700 1 --2- 172.21.15.77:0/3020790488 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fd7b80692a0 0x7fd7b806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.019 INFO:tasks.workunit.client.0.smithi077.stdout:1/467: read db/f59 [203602,96886] 0 2024-04-25T02:08:51.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.010+0000 7fd7d1552700 1 --2- 172.21.15.77:0/3020790488 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fd7b80692a0 0x7fd7b806b750 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8009fd0 tx=0x7fd7c8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:51.019 INFO:tasks.workunit.client.0.smithi077.stdout:0/495: unlink d2/d17/d1d/d34/d83/l9d 0 2024-04-25T02:08:51.020 INFO:tasks.workunit.client.0.smithi077.stdout:0/496: chown d2/d17/d1d/d34/d4c/f72 52756 1 2024-04-25T02:08:51.020 INFO:tasks.workunit.client.0.smithi077.stdout:0/497: truncate d2/d17/d1d/d34/d83/f92 859506 0 2024-04-25T02:08:51.020 INFO:tasks.workunit.client.0.smithi077.stdout:6/606: read f0 [2873487,89633] 0 2024-04-25T02:08:51.021 INFO:tasks.workunit.client.0.smithi077.stdout:9/544: dwrite df/d80/f98 [0,4194304] 0 2024-04-25T02:08:51.021 INFO:tasks.workunit.client.0.smithi077.stdout:9/545: dread - df/d1b/d48/d86/fb0 zero size 2024-04-25T02:08:51.021 INFO:tasks.workunit.client.0.smithi077.stdout:9/546: readlink l2 0 2024-04-25T02:08:51.022 INFO:tasks.workunit.client.0.smithi077.stdout:3/469: link d0/f3c d0/d17/d4b/d59/faa 0 2024-04-25T02:08:51.022 INFO:tasks.workunit.client.0.smithi077.stdout:3/470: fsync d0/d2/d2f/f7b 0 2024-04-25T02:08:51.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.016+0000 7fd7c1ffb700 1 -- 172.21.15.77:0/3020790488 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd7bc04e250 con 0x7fd7cc0651f0 2024-04-25T02:08:51.023 INFO:tasks.workunit.client.0.smithi077.stdout:4/506: creat d0/d14/d60/d86/d96/fa9 x:0 0 0 2024-04-25T02:08:51.024 INFO:tasks.workunit.client.0.smithi077.stdout:1/468: rmdir db 39 2024-04-25T02:08:51.024 INFO:tasks.workunit.client.0.smithi077.stdout:9/547: dread df/f41 [0,4194304] 0 2024-04-25T02:08:51.032 INFO:tasks.workunit.client.0.smithi077.stdout:5/522: dwrite d0/f50 [0,4194304] 0 2024-04-25T02:08:51.034 INFO:tasks.workunit.client.0.smithi077.stdout:3/471: rename d0/d2/d2f/f7b to d0/d17/d4b/fab 0 2024-04-25T02:08:51.034 INFO:tasks.workunit.client.0.smithi077.stdout:3/472: write d0/d2/d2f/f46 [2503591,66830] 0 2024-04-25T02:08:51.034 INFO:tasks.workunit.client.0.smithi077.stdout:4/507: getdents d0/d14/d60/d86/d34 0 2024-04-25T02:08:51.034 INFO:tasks.workunit.client.0.smithi077.stdout:4/508: write d0/d14/f33 [200230,111600] 0 2024-04-25T02:08:51.038 INFO:tasks.workunit.client.0.smithi077.stdout:6/607: creat de/d12/d25/d4b/fd0 x:0 0 0 2024-04-25T02:08:51.039 INFO:tasks.workunit.client.0.smithi077.stdout:0/498: dwrite d2/d17/f61 [0,4194304] 0 2024-04-25T02:08:51.039 INFO:tasks.workunit.client.0.smithi077.stdout:0/499: readlink d2/d9/d71/l7b 0 2024-04-25T02:08:51.040 INFO:tasks.workunit.client.0.smithi077.stdout:9/548: rename f3 to df/d1b/d48/d75/d90/fb2 0 2024-04-25T02:08:51.043 INFO:tasks.workunit.client.0.smithi077.stdout:6/608: mkdir de/d12/d25/d4b/dd1 0 2024-04-25T02:08:51.044 INFO:tasks.workunit.client.0.smithi077.stdout:0/500: unlink d2/d9/d2a/ca4 0 2024-04-25T02:08:51.048 INFO:tasks.workunit.client.0.smithi077.stdout:9/549: truncate df/d1b/f22 34571 0 2024-04-25T02:08:51.048 INFO:tasks.workunit.client.0.smithi077.stdout:9/550: chown df/d1b/d48/c5b 400 1 2024-04-25T02:08:51.050 INFO:tasks.workunit.client.0.smithi077.stdout:9/551: mkdir df/d1b/d56/d67/d68/db3 0 2024-04-25T02:08:51.050 INFO:tasks.workunit.client.0.smithi077.stdout:6/609: rename de/d12/d25/d60/d63 to de/d12/d25/d3a/d6a/dcd/d36/dd2 0 2024-04-25T02:08:51.051 INFO:tasks.workunit.client.0.smithi077.stdout:0/501: rmdir d2/d17/d1d/d34/d4c/da2/d9e 0 2024-04-25T02:08:51.051 INFO:tasks.workunit.client.0.smithi077.stdout:0/502: chown d2/d8 1 1 2024-04-25T02:08:51.052 INFO:tasks.workunit.client.0.smithi077.stdout:9/552: mkdir df/d1b/d48/d75/db4 0 2024-04-25T02:08:51.053 INFO:tasks.workunit.client.0.smithi077.stdout:6/610: creat de/d55/db7/fd3 x:0 0 0 2024-04-25T02:08:51.054 INFO:tasks.workunit.client.0.smithi077.stdout:9/553: rmdir df/d1b/d56/d67/d68/db1 0 2024-04-25T02:08:51.054 INFO:tasks.workunit.client.0.smithi077.stdout:9/554: truncate df/f13 614194 0 2024-04-25T02:08:51.055 INFO:tasks.workunit.client.0.smithi077.stdout:9/555: symlink df/d1b/lb5 0 2024-04-25T02:08:51.055 INFO:tasks.workunit.client.0.smithi077.stdout:9/556: fdatasync df/d1b/d48/f5e 0 2024-04-25T02:08:51.055 INFO:tasks.workunit.client.0.smithi077.stdout:9/557: chown df/d1b/c27 2 1 2024-04-25T02:08:51.060 INFO:tasks.workunit.client.0.smithi077.stdout:5/523: dwrite d0/d25/f1a [0,4194304] 0 2024-04-25T02:08:51.062 INFO:tasks.workunit.client.0.smithi077.stdout:0/503: write d2/f82 [759038,110981] 0 2024-04-25T02:08:51.062 INFO:tasks.workunit.client.0.smithi077.stdout:3/473: dwrite d0/d2/de/d48/d15/f66 [0,4194304] 0 2024-04-25T02:08:51.062 INFO:tasks.workunit.client.0.smithi077.stdout:5/524: creat d0/d25/d82/d87/fb0 x:0 0 0 2024-04-25T02:08:51.063 INFO:tasks.workunit.client.0.smithi077.stdout:4/509: rmdir d0/d14/d60/d62 39 2024-04-25T02:08:51.066 INFO:tasks.workunit.client.0.smithi077.stdout:6/611: read de/d53/d76/f90 [2756240,5826] 0 2024-04-25T02:08:51.069 INFO:tasks.workunit.client.0.smithi077.stdout:5/525: symlink d0/d2/d3/d9/d39/lb1 0 2024-04-25T02:08:51.070 INFO:tasks.workunit.client.0.smithi077.stdout:4/510: symlink d0/d14/laa 0 2024-04-25T02:08:51.071 INFO:tasks.workunit.client.0.smithi077.stdout:3/474: dread d0/d17/d4b/fab [0,4194304] 0 2024-04-25T02:08:51.071 INFO:tasks.workunit.client.0.smithi077.stdout:3/475: chown d0/d2/d2f/c78 249817 1 2024-04-25T02:08:51.072 INFO:tasks.workunit.client.0.smithi077.stdout:6/612: creat de/d12/d25/d60/fd4 x:0 0 0 2024-04-25T02:08:51.072 INFO:tasks.workunit.client.0.smithi077.stdout:6/613: chown de/d12/d25/d4b 0 1 2024-04-25T02:08:51.073 INFO:tasks.workunit.client.0.smithi077.stdout:3/476: mknod d0/d3e/da1/cac 0 2024-04-25T02:08:51.074 INFO:tasks.workunit.client.0.smithi077.stdout:3/477: fsync d0/d2/de/d48/d15/f2b 0 2024-04-25T02:08:51.077 INFO:tasks.workunit.client.0.smithi077.stdout:9/558: getdents df/d1b/d48/d75/d90 0 2024-04-25T02:08:51.077 INFO:tasks.workunit.client.0.smithi077.stdout:9/559: dread - df/d1b/d56/fae zero size 2024-04-25T02:08:51.077 INFO:tasks.workunit.client.0.smithi077.stdout:6/614: dread de/d55/f8f [0,4194304] 0 2024-04-25T02:08:51.077 INFO:tasks.workunit.client.0.smithi077.stdout:6/615: dread - de/d12/d25/d38/fb1 zero size 2024-04-25T02:08:51.079 INFO:tasks.workunit.client.0.smithi077.stdout:0/504: dwrite d2/d17/d1d/d34/d4c/da2/f18 [0,4194304] 0 2024-04-25T02:08:51.080 INFO:tasks.workunit.client.0.smithi077.stdout:3/478: rmdir d0/d3e/d62 39 2024-04-25T02:08:51.080 INFO:tasks.workunit.client.0.smithi077.stdout:3/479: write d0/d3e/d62/f68 [2007228,38644] 0 2024-04-25T02:08:51.082 INFO:tasks.workunit.client.0.smithi077.stdout:9/560: mkdir df/d1b/d48/db6 0 2024-04-25T02:08:51.082 INFO:tasks.workunit.client.0.smithi077.stdout:9/561: chown df/d1b/d56/d67/d68/db3 107547 1 2024-04-25T02:08:51.082 INFO:tasks.workunit.client.0.smithi077.stdout:9/562: truncate df/d60/d87/f91 1237732 0 2024-04-25T02:08:51.082 INFO:tasks.workunit.client.0.smithi077.stdout:5/526: dread d0/d2/d3/f15 [4194304,4194304] 0 2024-04-25T02:08:51.084 INFO:tasks.workunit.client.0.smithi077.stdout:0/505: mkdir d2/d8/dad 0 2024-04-25T02:08:51.086 INFO:tasks.workunit.client.0.smithi077.stdout:3/480: symlink d0/d2/de/d27/lad 0 2024-04-25T02:08:51.086 INFO:tasks.workunit.client.0.smithi077.stdout:3/481: readlink d0/d2/de/d36/l6d 0 2024-04-25T02:08:51.088 INFO:tasks.workunit.client.0.smithi077.stdout:9/563: rename df/d80/f98 to df/d60/d87/fb7 0 2024-04-25T02:08:51.091 INFO:tasks.workunit.client.0.smithi077.stdout:5/527: unlink d0/d2/d3/d9/d39/f94 0 2024-04-25T02:08:51.095 INFO:tasks.workunit.client.0.smithi077.stdout:0/506: mkdir d2/d17/d1d/d34/d4c/da2/dae 0 2024-04-25T02:08:51.095 INFO:tasks.workunit.client.0.smithi077.stdout:0/507: creat d2/d1c/faf x:0 0 0 2024-04-25T02:08:51.099 INFO:tasks.workunit.client.0.smithi077.stdout:9/564: creat df/d1b/d70/d74/fb8 x:0 0 0 2024-04-25T02:08:51.099 INFO:tasks.workunit.client.0.smithi077.stdout:9/565: creat df/d1b/d48/d75/fb9 x:0 0 0 2024-04-25T02:08:51.099 INFO:tasks.workunit.client.0.smithi077.stdout:9/566: dread - df/d1b/d70/d84/fad zero size 2024-04-25T02:08:51.101 INFO:tasks.workunit.client.0.smithi077.stdout:0/508: rename d2/d17/d4e/f88 to d2/d17/d4e/fb0 0 2024-04-25T02:08:51.101 INFO:tasks.workunit.client.0.smithi077.stdout:0/509: readlink d2/d9/d71/d74/da7/laa 0 2024-04-25T02:08:51.102 INFO:tasks.workunit.client.0.smithi077.stdout:0/510: mkdir d2/d17/d1d/db1 0 2024-04-25T02:08:51.102 INFO:tasks.workunit.client.0.smithi077.stdout:0/511: stat d2/d8/f26 0 2024-04-25T02:08:51.103 INFO:tasks.workunit.client.0.smithi077.stdout:0/512: getdents d2/d9/d71 0 2024-04-25T02:08:51.110 INFO:tasks.workunit.client.0.smithi077.stdout:2/503: sync 2024-04-25T02:08:51.110 INFO:tasks.workunit.client.0.smithi077.stdout:2/504: write d2/d9/d56/d5c/f66 [806873,72306] 0 2024-04-25T02:08:51.111 INFO:tasks.workunit.client.0.smithi077.stdout:2/505: read d2/d9/d19/d1c/f33 [372095,55700] 0 2024-04-25T02:08:51.111 INFO:tasks.workunit.client.0.smithi077.stdout:2/506: chown d2/d59/c62 19209598 1 2024-04-25T02:08:51.111 INFO:tasks.workunit.client.0.smithi077.stdout:2/507: chown d2/d9/d2f/d84/d90 149 1 2024-04-25T02:08:51.111 INFO:tasks.workunit.client.0.smithi077.stdout:2/508: write d2/d59/f71 [1480592,109872] 0 2024-04-25T02:08:51.177 INFO:tasks.workunit.client.0.smithi077.stdout:6/616: getdents de/d12/d25/d60 0 2024-04-25T02:08:51.182 INFO:tasks.workunit.client.0.smithi077.stdout:9/567: write df/d1b/f40 [951736,101627] 0 2024-04-25T02:08:51.182 INFO:tasks.workunit.client.0.smithi077.stdout:9/568: rename df/d1b to df/d1b/d48/d75/dba 22 2024-04-25T02:08:51.183 INFO:tasks.workunit.client.0.smithi077.stdout:9/569: truncate df/d60/d87/fb7 1792270 0 2024-04-25T02:08:51.183 INFO:tasks.workunit.client.0.smithi077.stdout:9/570: fsync df/f29 0 2024-04-25T02:08:51.200 INFO:tasks.workunit.client.0.smithi077.stdout:9/571: write df/f14 [1603344,112825] 0 2024-04-25T02:08:51.201 INFO:tasks.workunit.client.0.smithi077.stdout:4/511: dwrite d0/d14/d60/d86/f4a [4194304,4194304] 0 2024-04-25T02:08:51.201 INFO:tasks.workunit.client.0.smithi077.stdout:5/528: dwrite d0/d2/d20/d23/f7c [0,4194304] 0 2024-04-25T02:08:51.202 INFO:tasks.workunit.client.0.smithi077.stdout:0/513: dwrite d2/d17/d1d/d34/d4c/fa0 [0,4194304] 0 2024-04-25T02:08:51.203 INFO:tasks.workunit.client.0.smithi077.stdout:2/509: dwrite d2/d9/d18/d31/f4b [0,4194304] 0 2024-04-25T02:08:51.203 INFO:tasks.workunit.client.0.smithi077.stdout:2/510: chown d2/l11 0 1 2024-04-25T02:08:51.203 INFO:tasks.workunit.client.0.smithi077.stdout:3/482: dwrite d0/d2/de/f82 [0,4194304] 0 2024-04-25T02:08:51.205 INFO:tasks.workunit.client.0.smithi077.stdout:4/512: unlink d0/d14/d21/d39/f2 0 2024-04-25T02:08:51.208 INFO:tasks.workunit.client.0.smithi077.stdout:5/529: symlink d0/d25/d82/d8d/lb2 0 2024-04-25T02:08:51.208 INFO:tasks.workunit.client.0.smithi077.stdout:5/530: fdatasync d0/d2/d3/f31 0 2024-04-25T02:08:51.213 INFO:tasks.workunit.client.0.smithi077.stdout:0/514: write d2/d8/f26 [362893,89853] 0 2024-04-25T02:08:51.216 INFO:tasks.workunit.client.0.smithi077.stdout:3/483: mkdir d0/d3e/d93/dae 0 2024-04-25T02:08:51.219 INFO:tasks.workunit.client.0.smithi077.stdout:4/513: creat d0/d14/d21/d39/da/fab x:0 0 0 2024-04-25T02:08:51.222 INFO:tasks.workunit.client.0.smithi077.stdout:0/515: mkdir d2/d9/d2a/db2 0 2024-04-25T02:08:51.222 INFO:tasks.workunit.client.0.smithi077.stdout:0/516: truncate d2/d1c/f7e 884448 0 2024-04-25T02:08:51.223 INFO:tasks.workunit.client.0.smithi077.stdout:3/484: write d0/d2/d83/f86 [1332816,129312] 0 2024-04-25T02:08:51.224 INFO:tasks.workunit.client.0.smithi077.stdout:4/514: mkdir d0/d14/d79/da4/dac 0 2024-04-25T02:08:51.226 INFO:tasks.workunit.client.0.smithi077.stdout:5/531: rmdir d0/d2/d1b 39 2024-04-25T02:08:51.226 INFO:tasks.workunit.client.0.smithi077.stdout:5/532: write d0/d2/d3/d9/f2a [1480828,47415] 0 2024-04-25T02:08:51.226 INFO:tasks.workunit.client.0.smithi077.stdout:5/533: stat d0/d25/d82/d87/d8b 0 2024-04-25T02:08:51.226 INFO:tasks.workunit.client.0.smithi077.stdout:5/534: write d0/d2/d1b/d38/f64 [751570,7115] 0 2024-04-25T02:08:51.226 INFO:tasks.workunit.client.0.smithi077.stdout:5/535: write d0/d2/d3/f7d [1038196,96268] 0 2024-04-25T02:08:51.228 INFO:tasks.workunit.client.0.smithi077.stdout:3/485: creat d0/d3e/d62/faf x:0 0 0 2024-04-25T02:08:51.230 INFO:tasks.workunit.client.0.smithi077.stdout:2/511: dwrite d2/d9/f52 [4194304,4194304] 0 2024-04-25T02:08:51.232 INFO:tasks.workunit.client.0.smithi077.stdout:4/515: unlink d0/d14/d21/d39/da/d12/d35/f52 0 2024-04-25T02:08:51.235 INFO:tasks.workunit.client.0.smithi077.stdout:0/517: rmdir d2/d17 39 2024-04-25T02:08:51.237 INFO:tasks.workunit.client.0.smithi077.stdout:5/536: write d0/d2/d20/d23/d4a/f5d [1490436,10625] 0 2024-04-25T02:08:51.240 INFO:tasks.workunit.client.0.smithi077.stdout:4/516: truncate d0/d14/f33 199893 0 2024-04-25T02:08:51.240 INFO:tasks.workunit.client.0.smithi077.stdout:4/517: write d0/d14/d21/d39/d1d/f2c [1024621,107099] 0 2024-04-25T02:08:51.240 INFO:tasks.workunit.client.0.smithi077.stdout:4/518: fsync d0/d14/d60/d62/f8d 0 2024-04-25T02:08:51.240 INFO:tasks.workunit.client.0.smithi077.stdout:4/519: truncate d0/d14/d60/d62/f77 178434 0 2024-04-25T02:08:51.240 INFO:tasks.workunit.client.0.smithi077.stdout:4/520: fsync d0/d14/d21/d39/da/f2d 0 2024-04-25T02:08:51.240 INFO:tasks.workunit.client.0.smithi077.stdout:4/521: getdents d0/d14/d21/d39/d64 0 2024-04-25T02:08:51.243 INFO:tasks.workunit.client.0.smithi077.stdout:5/537: symlink d0/d2/d20/d23/lb3 0 2024-04-25T02:08:51.247 INFO:tasks.workunit.client.0.smithi077.stdout:8/583: sync 2024-04-25T02:08:51.247 INFO:tasks.workunit.client.0.smithi077.stdout:1/469: sync 2024-04-25T02:08:51.247 INFO:tasks.workunit.client.0.smithi077.stdout:8/584: fdatasync d3/da/d27/d44/f9f 0 2024-04-25T02:08:51.248 INFO:tasks.workunit.client.0.smithi077.stdout:1/470: read - db/df/d14/d4d/d82/d5c/d81/f86 zero size 2024-04-25T02:08:51.248 INFO:tasks.workunit.client.0.smithi077.stdout:7/480: sync 2024-04-25T02:08:51.248 INFO:tasks.workunit.client.0.smithi077.stdout:1/471: readlink db/df/d14/d4d/d82/d5c/d81/l9a 0 2024-04-25T02:08:51.248 INFO:tasks.workunit.client.0.smithi077.stdout:7/481: dread - d4/d13/d18/d24/d3f/f8d zero size 2024-04-25T02:08:51.250 INFO:tasks.workunit.client.0.smithi077.stdout:7/482: link d4/d13/d2c/c41 d4/d13/d5b/d8b/ca6 0 2024-04-25T02:08:51.250 INFO:tasks.workunit.client.0.smithi077.stdout:7/483: chown d4/d13/d18/d2d/c6f 604 1 2024-04-25T02:08:51.251 INFO:tasks.workunit.client.0.smithi077.stdout:7/484: fsync d4/d13/d18/d2d/d30/f65 0 2024-04-25T02:08:51.253 INFO:tasks.workunit.client.0.smithi077.stdout:5/538: read d0/d2/d3/f2f [300104,35313] 0 2024-04-25T02:08:51.253 INFO:tasks.workunit.client.0.smithi077.stdout:5/539: write d0/d2/d3/d9/f1c [2996458,128845] 0 2024-04-25T02:08:51.253 INFO:tasks.workunit.client.0.smithi077.stdout:5/540: chown d0/c89 225465198 1 2024-04-25T02:08:51.253 INFO:tasks.workunit.client.0.smithi077.stdout:1/472: link db/df/d14/d33/f38 db/df/d56/fa1 0 2024-04-25T02:08:51.254 INFO:tasks.workunit.client.0.smithi077.stdout:1/473: fdatasync db/df/d56/d5d/d77/f91 0 2024-04-25T02:08:51.254 INFO:tasks.workunit.client.0.smithi077.stdout:7/485: rmdir d4/d13 39 2024-04-25T02:08:51.256 INFO:tasks.workunit.client.0.smithi077.stdout:1/474: link db/df/d14/f17 db/df/d14/d4d/d82/d32/fa2 0 2024-04-25T02:08:51.256 INFO:tasks.workunit.client.0.smithi077.stdout:1/475: write db/df/d14/f97 [677598,103305] 0 2024-04-25T02:08:51.260 INFO:tasks.workunit.client.0.smithi077.stdout:7/486: link d4/l6a d4/d13/d66/la7 0 2024-04-25T02:08:51.262 INFO:tasks.workunit.client.0.smithi077.stdout:1/476: rmdir db/df/d14/d4d/d82/d32/d8f 39 2024-04-25T02:08:51.265 INFO:tasks.workunit.client.0.smithi077.stdout:7/487: rename d4/d13/d18/d2d/c70 to d4/d13/d18/d2d/d56/ca8 0 2024-04-25T02:08:51.265 INFO:tasks.workunit.client.0.smithi077.stdout:7/488: dread - d4/d13/d18/d24/d3f/f8d zero size 2024-04-25T02:08:51.268 INFO:tasks.workunit.client.0.smithi077.stdout:2/512: dwrite d2/d9/d19/d1c/f33 [0,4194304] 0 2024-04-25T02:08:51.268 INFO:tasks.workunit.client.0.smithi077.stdout:2/513: write d2/d9/d19/d1c/f44 [3896468,87849] 0 2024-04-25T02:08:51.271 INFO:tasks.workunit.client.0.smithi077.stdout:2/514: getdents d2/d9/d18/d1b 0 2024-04-25T02:08:51.271 INFO:tasks.workunit.client.0.smithi077.stdout:1/477: write db/df/d14/d4d/d82/f8b [5257143,23045] 0 2024-04-25T02:08:51.271 INFO:tasks.workunit.client.0.smithi077.stdout:1/478: write db/df/d14/d3e/f64 [603216,110614] 0 2024-04-25T02:08:51.272 INFO:tasks.workunit.client.0.smithi077.stdout:2/515: mknod d2/d9/ca2 0 2024-04-25T02:08:51.274 INFO:tasks.workunit.client.0.smithi077.stdout:1/479: creat db/d26/fa3 x:0 0 0 2024-04-25T02:08:51.276 INFO:tasks.workunit.client.0.smithi077.stdout:2/516: creat d2/d9/d19/d1c/d3f/d53/fa3 x:0 0 0 2024-04-25T02:08:51.277 INFO:tasks.workunit.client.0.smithi077.stdout:2/517: mknod d2/ca4 0 2024-04-25T02:08:51.279 INFO:tasks.workunit.client.0.smithi077.stdout:1/480: mknod db/df/d14/d4d/d82/ca4 0 2024-04-25T02:08:51.279 INFO:tasks.workunit.client.0.smithi077.stdout:1/481: dread - db/df/d14/d4d/d82/d5c/d81/f86 zero size 2024-04-25T02:08:51.279 INFO:tasks.workunit.client.0.smithi077.stdout:1/482: chown db/df/d1b/c60 13 1 2024-04-25T02:08:51.281 INFO:tasks.workunit.client.0.smithi077.stdout:1/483: dread db/df/d1b/f6f [0,4194304] 0 2024-04-25T02:08:51.281 INFO:tasks.workunit.client.0.smithi077.stdout:1/484: write db/df/d14/d3e/d69/f90 [447759,57047] 0 2024-04-25T02:08:51.281 INFO:tasks.workunit.client.0.smithi077.stdout:1/485: mknod db/df/d14/d3e/ca5 0 2024-04-25T02:08:51.282 INFO:tasks.workunit.client.0.smithi077.stdout:1/486: creat db/fa6 x:0 0 0 2024-04-25T02:08:51.284 INFO:tasks.workunit.client.0.smithi077.stdout:8/585: dwrite d3/fd [0,4194304] 0 2024-04-25T02:08:51.285 INFO:tasks.workunit.client.0.smithi077.stdout:4/522: dwrite d0/d14/d21/d39/da/d12/d35/f71 [0,4194304] 0 2024-04-25T02:08:51.285 INFO:tasks.workunit.client.0.smithi077.stdout:4/523: chown d0/d14/d60/d86/d25/l5d 507426905 1 2024-04-25T02:08:51.285 INFO:tasks.workunit.client.0.smithi077.stdout:0/518: dwrite d2/d9/f66 [0,4194304] 0 2024-04-25T02:08:51.285 INFO:tasks.workunit.client.0.smithi077.stdout:7/489: dwrite d4/d13/d18/d24/f3b [0,4194304] 0 2024-04-25T02:08:51.286 INFO:tasks.workunit.client.0.smithi077.stdout:8/586: mkdir d3/da/d27/d16/db3 0 2024-04-25T02:08:51.286 INFO:tasks.workunit.client.0.smithi077.stdout:8/587: stat d3/da/db/df/d2b/f79 0 2024-04-25T02:08:51.286 INFO:tasks.workunit.client.0.smithi077.stdout:8/588: fsync d3/da/db/df/f10 0 2024-04-25T02:08:51.288 INFO:tasks.workunit.client.0.smithi077.stdout:4/524: mknod d0/d14/d21/d39/d64/cad 0 2024-04-25T02:08:51.289 INFO:tasks.workunit.client.0.smithi077.stdout:1/487: dread db/df/f1d [0,4194304] 0 2024-04-25T02:08:51.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.285+0000 7fd7d37b6700 1 -- 172.21.15.77:0/3020790488 --> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7cc111ac0 con 0x7fd7b80692a0 2024-04-25T02:08:51.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.287+0000 7fd7c1ffb700 1 -- 172.21.15.77:0/3020790488 <== mgr.14208 v2:172.21.15.77:6800/310739264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7fd7cc111ac0 con 0x7fd7b80692a0 2024-04-25T02:08:51.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.289+0000 7fd7d37b6700 1 -- 172.21.15.77:0/3020790488 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fd7b80692a0 msgr2=0x7fd7b806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.289+0000 7fd7d37b6700 1 --2- 172.21.15.77:0/3020790488 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fd7b80692a0 0x7fd7b806b750 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8009fd0 tx=0x7fd7c8009e30 comp rx=0 tx=0).stop 2024-04-25T02:08:51.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.289+0000 7fd7d37b6700 1 -- 172.21.15.77:0/3020790488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7cc0651f0 msgr2=0x7fd7cc110130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.289+0000 7fd7d37b6700 1 --2- 172.21.15.77:0/3020790488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7cc0651f0 0x7fd7cc110130 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0041d0 tx=0x7fd7bc00b040 comp rx=0 tx=0).stop 2024-04-25T02:08:51.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.289+0000 7fd7d37b6700 1 -- 172.21.15.77:0/3020790488 shutdown_connections 2024-04-25T02:08:51.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.289+0000 7fd7d37b6700 1 --2- 172.21.15.77:0/3020790488 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fd7b80692a0 0x7fd7b806b750 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.289+0000 7fd7d37b6700 1 --2- 172.21.15.77:0/3020790488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7cc064d50 0x7fd7cc10fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.289+0000 7fd7d37b6700 1 --2- 172.21.15.77:0/3020790488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7cc0651f0 0x7fd7cc110130 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.289+0000 7fd7d37b6700 1 -- 172.21.15.77:0/3020790488 >> 172.21.15.77:0/3020790488 conn(0x7fd7cc0f6b80 msgr2=0x7fd7cc0f8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:51.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.290+0000 7fd7d37b6700 1 -- 172.21.15.77:0/3020790488 shutdown_connections 2024-04-25T02:08:51.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.290+0000 7fd7d37b6700 1 -- 172.21.15.77:0/3020790488 wait complete. 2024-04-25T02:08:51.298 INFO:tasks.workunit.client.0.smithi077.stdout:0/519: dread d2/d8/f97 [0,4194304] 0 2024-04-25T02:08:51.299 INFO:tasks.workunit.client.0.smithi077.stdout:0/520: stat d2/d17/d1d/d34/d4c/da2/c5d 0 2024-04-25T02:08:51.299 INFO:tasks.workunit.client.0.smithi077.stdout:0/521: read - d2/d1c/faf zero size 2024-04-25T02:08:51.299 INFO:tasks.workunit.client.0.smithi077.stdout:0/522: fsync d2/d17/f61 0 2024-04-25T02:08:51.300 INFO:tasks.workunit.client.0.smithi077.stdout:8/589: dread d3/da/db/f4c [0,4194304] 0 2024-04-25T02:08:51.300 INFO:tasks.workunit.client.0.smithi077.stdout:8/590: fsync d3/d7a/fa3 0 2024-04-25T02:08:51.300 INFO:tasks.workunit.client.0.smithi077.stdout:7/490: unlink d4/d13/d18/d2d/f43 0 2024-04-25T02:08:51.302 INFO:tasks.workunit.client.0.smithi077.stdout:1/488: unlink db/df/d14/d4d/d82/d32/l52 0 2024-04-25T02:08:51.304 INFO:tasks.workunit.client.0.smithi077.stdout:0/523: unlink d2/d8/cc 0 2024-04-25T02:08:51.305 INFO:tasks.workunit.client.0.smithi077.stdout:7/491: rename d4/d13/d18/d24/d3f/d72 to d4/d13/da9 0 2024-04-25T02:08:51.306 INFO:tasks.workunit.client.0.smithi077.stdout:4/525: mknod d0/d14/d21/d39/da/d12/d35/d3e/cae 0 2024-04-25T02:08:51.308 INFO:tasks.workunit.client.0.smithi077.stdout:0/524: symlink d2/d17/d1d/d34/d4c/da2/d51/lb3 0 2024-04-25T02:08:51.308 INFO:tasks.workunit.client.0.smithi077.stdout:0/525: fsync d2/d17/d1d/d34/d4c/da2/d51/f59 0 2024-04-25T02:08:51.317 INFO:tasks.workunit.client.0.smithi077.stdout:4/526: creat d0/d14/d79/da4/faf x:0 0 0 2024-04-25T02:08:51.317 INFO:tasks.workunit.client.0.smithi077.stdout:7/492: mknod d4/d13/da9/caa 0 2024-04-25T02:08:51.317 INFO:tasks.workunit.client.0.smithi077.stdout:0/526: creat d2/d8/d5f/fb4 x:0 0 0 2024-04-25T02:08:51.317 INFO:tasks.workunit.client.0.smithi077.stdout:0/527: chown d2/d17/l2e 310392080 1 2024-04-25T02:08:51.317 INFO:tasks.workunit.client.0.smithi077.stdout:1/489: truncate db/df/d14/d3e/d69/f90 500490 0 2024-04-25T02:08:51.318 INFO:tasks.workunit.client.0.smithi077.stdout:0/528: rmdir d2/d17/d1d/d34 39 2024-04-25T02:08:51.319 INFO:tasks.workunit.client.0.smithi077.stdout:1/490: symlink db/df/d14/d4d/d82/d5c/la7 0 2024-04-25T02:08:51.321 INFO:tasks.workunit.client.0.smithi077.stdout:4/527: mknod d0/d14/d21/d39/da/d12/d35/d3e/cb0 0 2024-04-25T02:08:51.321 INFO:tasks.workunit.client.0.smithi077.stdout:4/528: stat d0/d14/d60/d86/d96/f97 0 2024-04-25T02:08:51.322 INFO:tasks.workunit.client.0.smithi077.stdout:0/529: mkdir d2/d9/d2a/db5 0 2024-04-25T02:08:51.322 INFO:tasks.workunit.client.0.smithi077.stdout:0/530: fsync d2/d17/d1d/d34/d83/f92 0 2024-04-25T02:08:51.323 INFO:tasks.workunit.client.0.smithi077.stdout:1/491: symlink db/df/d14/d33/d34/d66/la8 0 2024-04-25T02:08:51.323 INFO:tasks.workunit.client.0.smithi077.stdout:6/617: sync 2024-04-25T02:08:51.325 INFO:tasks.workunit.client.0.smithi077.stdout:4/529: unlink d0/d14/d21/d39/d1d/d98/f9e 0 2024-04-25T02:08:51.325 INFO:tasks.workunit.client.0.smithi077.stdout:1/492: rmdir db/df/d56/d5d 39 2024-04-25T02:08:51.327 INFO:tasks.workunit.client.0.smithi077.stdout:6/618: rename de/d53/c84 to de/d12/d25/d4b/cd5 0 2024-04-25T02:08:51.328 INFO:tasks.workunit.client.0.smithi077.stdout:4/530: mknod d0/d14/d21/d39/d1d/cb1 0 2024-04-25T02:08:51.330 INFO:tasks.workunit.client.0.smithi077.stdout:6/619: rename de/d12/d25/d3a/d6a/dcd/d36/dd2/c43 to de/d12/d25/d3a/d6a/dcd/cd6 0 2024-04-25T02:08:51.332 INFO:tasks.workunit.client.0.smithi077.stdout:0/531: write d2/d27/d2d/f2f [4719176,35808] 0 2024-04-25T02:08:51.332 INFO:tasks.workunit.client.0.smithi077.stdout:6/620: symlink de/d12/d25/d4b/ld7 0 2024-04-25T02:08:51.332 INFO:tasks.workunit.client.0.smithi077.stdout:6/621: creat de/d5b/da6/fd8 x:0 0 0 2024-04-25T02:08:51.332 INFO:tasks.workunit.client.0.smithi077.stdout:6/622: dread - de/d5b/da6/fad zero size 2024-04-25T02:08:51.332 INFO:tasks.workunit.client.0.smithi077.stdout:6/623: fsync de/d12/d25/d3a/fc9 0 2024-04-25T02:08:51.334 INFO:tasks.workunit.client.0.smithi077.stdout:4/531: rename d0/f28 to d0/d14/d21/d39/da/d12/d35/d3e/fb2 0 2024-04-25T02:08:51.334 INFO:tasks.workunit.client.0.smithi077.stdout:4/532: fsync d0/d14/d21/f26 0 2024-04-25T02:08:51.334 INFO:tasks.workunit.client.0.smithi077.stdout:4/533: write d0/d14/d21/d39/f76 [770420,66282] 0 2024-04-25T02:08:51.335 INFO:tasks.workunit.client.0.smithi077.stdout:6/624: dread de/d12/d25/f7b [0,4194304] 0 2024-04-25T02:08:51.335 INFO:tasks.workunit.client.0.smithi077.stdout:6/625: chown de/f13 14484741 1 2024-04-25T02:08:51.336 INFO:tasks.workunit.client.0.smithi077.stdout:4/534: symlink d0/d14/d60/d86/d25/lb3 0 2024-04-25T02:08:51.338 INFO:tasks.workunit.client.0.smithi077.stdout:4/535: mknod d0/d14/cb4 0 2024-04-25T02:08:51.338 INFO:tasks.workunit.client.0.smithi077.stdout:7/493: dwrite d4/d13/d18/d24/d3f/f8d [0,4194304] 0 2024-04-25T02:08:51.341 INFO:tasks.workunit.client.0.smithi077.stdout:4/536: rename d0/d14/d21/d39/d64/c83 to d0/d14/d21/d39/da/cb5 0 2024-04-25T02:08:51.341 INFO:tasks.workunit.client.0.smithi077.stdout:4/537: chown d0/d14/d21/d39/d64/f82 1716753 1 2024-04-25T02:08:51.362 INFO:tasks.workunit.client.0.smithi077.stdout:0/532: dwrite d2/d17/d1d/d34/d4c/f81 [0,4194304] 0 2024-04-25T02:08:51.362 INFO:tasks.workunit.client.0.smithi077.stdout:0/533: chown d2/d9/d2a/fa9 116 1 2024-04-25T02:08:51.362 INFO:tasks.workunit.client.0.smithi077.stdout:0/534: dread - d2/d17/d4e/f85 zero size 2024-04-25T02:08:51.364 INFO:tasks.workunit.client.0.smithi077.stdout:6/626: dwrite de/d12/d25/d3a/d6a/dcd/fc8 [0,4194304] 0 2024-04-25T02:08:51.364 INFO:tasks.workunit.client.0.smithi077.stdout:7/494: dwrite d4/d13/d66/f8f [0,4194304] 0 2024-04-25T02:08:51.365 INFO:tasks.workunit.client.0.smithi077.stdout:0/535: rename d2/d9/d71 to d2/d8/db6 0 2024-04-25T02:08:51.366 INFO:tasks.workunit.client.0.smithi077.stdout:4/538: dwrite d0/d14/d60/d62/f8d [0,4194304] 0 2024-04-25T02:08:51.366 INFO:tasks.workunit.client.0.smithi077.stdout:4/539: truncate d0/d14/d60/fa7 297936 0 2024-04-25T02:08:51.366 INFO:tasks.workunit.client.0.smithi077.stdout:7/495: mkdir d4/d13/d18/d2d/d30/dab 0 2024-04-25T02:08:51.376 INFO:tasks.workunit.client.0.smithi077.stdout:4/540: dread d0/d14/d21/d39/f61 [0,4194304] 0 2024-04-25T02:08:51.376 INFO:tasks.workunit.client.0.smithi077.stdout:4/541: chown d0/d14/d21/c6a 25727123 1 2024-04-25T02:08:51.396 INFO:tasks.workunit.client.0.smithi077.stdout:6/627: dwrite de/d12/d25/d38/f67 [0,4194304] 0 2024-04-25T02:08:51.397 INFO:tasks.workunit.client.0.smithi077.stdout:6/628: dread de/d53/f7c [0,4194304] 0 2024-04-25T02:08:51.398 INFO:tasks.workunit.client.0.smithi077.stdout:0/536: link d2/d17/d1d/d34/d4c/da2/f67 d2/d17/d4e/d5e/fb7 0 2024-04-25T02:08:51.401 INFO:tasks.workunit.client.0.smithi077.stdout:7/496: creat d4/d13/d18/d2d/fac x:0 0 0 2024-04-25T02:08:51.403 INFO:tasks.workunit.client.0.smithi077.stdout:4/542: creat d0/d14/d79/fb6 x:0 0 0 2024-04-25T02:08:51.404 INFO:tasks.workunit.client.0.smithi077.stdout:4/543: write d0/d14/f8b [4568977,111869] 0 2024-04-25T02:08:51.404 INFO:tasks.workunit.client.0.smithi077.stdout:4/544: getdents d0/d14/d79/da4/dac 0 2024-04-25T02:08:51.410 INFO:tasks.workunit.client.0.smithi077.stdout:0/537: link d2/d1c/l75 d2/d17/d1d/d34/lb8 0 2024-04-25T02:08:51.412 INFO:tasks.workunit.client.0.smithi077.stdout:7/497: creat d4/d13/da9/fad x:0 0 0 2024-04-25T02:08:51.412 INFO:tasks.workunit.client.0.smithi077.stdout:7/498: truncate d4/f51 610710 0 2024-04-25T02:08:51.412 INFO:tasks.workunit.client.0.smithi077.stdout:7/499: creat d4/d13/d18/d2d/fae x:0 0 0 2024-04-25T02:08:51.412 INFO:tasks.workunit.client.0.smithi077.stdout:7/500: chown d4/d13/d5b/l85 319670 1 2024-04-25T02:08:51.412 INFO:tasks.workunit.client.0.smithi077.stdout:7/501: fdatasync d4/d13/d18/d2d/fae 0 2024-04-25T02:08:51.412 INFO:tasks.workunit.client.0.smithi077.stdout:7/502: dread - d4/d13/d2c/f92 zero size 2024-04-25T02:08:51.413 INFO:tasks.workunit.client.0.smithi077.stdout:4/545: link d0/d14/d21/d39/da/d12/d35/d3e/l89 d0/d14/d21/d39/d64/lb7 0 2024-04-25T02:08:51.415 INFO:tasks.workunit.client.0.smithi077.stdout:6/629: mknod de/d12/d25/cd9 0 2024-04-25T02:08:51.417 INFO:tasks.workunit.client.0.smithi077.stdout:0/538: unlink d2/d17/d1d/d34/d4c/l84 0 2024-04-25T02:08:51.420 INFO:tasks.workunit.client.0.smithi077.stdout:0/539: symlink d2/d17/d1d/d34/lb9 0 2024-04-25T02:08:51.422 INFO:tasks.workunit.client.0.smithi077.stdout:0/540: creat d2/d8/dad/fba x:0 0 0 2024-04-25T02:08:51.425 INFO:tasks.workunit.client.0.smithi077.stdout:9/572: sync 2024-04-25T02:08:51.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.419+0000 7f40ab90f700 1 -- 172.21.15.77:0/1685699442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a40fbcb0 msgr2=0x7f40a40fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.419+0000 7f40ab90f700 1 --2- 172.21.15.77:0/1685699442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a40fbcb0 0x7f40a40fc0c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f409c009ce0 tx=0x7f409c004d10 comp rx=0 tx=0).stop 2024-04-25T02:08:51.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.419+0000 7f40ab90f700 1 -- 172.21.15.77:0/1685699442 shutdown_connections 2024-04-25T02:08:51.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.419+0000 7f40ab90f700 1 --2- 172.21.15.77:0/1685699442 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40a40fcf60 0x7f40a40fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.419+0000 7f40ab90f700 1 --2- 172.21.15.77:0/1685699442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a40fbcb0 0x7f40a40fc0c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.419+0000 7f40ab90f700 1 -- 172.21.15.77:0/1685699442 >> 172.21.15.77:0/1685699442 conn(0x7f40a40f7430 msgr2=0x7f40a40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:51.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.419+0000 7f40ab90f700 1 -- 172.21.15.77:0/1685699442 shutdown_connections 2024-04-25T02:08:51.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.419+0000 7f40ab90f700 1 -- 172.21.15.77:0/1685699442 wait complete. 2024-04-25T02:08:51.427 INFO:tasks.workunit.client.0.smithi077.stdout:3/486: sync 2024-04-25T02:08:51.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.420+0000 7f40ab90f700 1 Processor -- start 2024-04-25T02:08:51.427 INFO:tasks.workunit.client.0.smithi077.stdout:9/573: dread df/d1b/f46 [0,4194304] 0 2024-04-25T02:08:51.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.420+0000 7f40ab90f700 1 -- start start 2024-04-25T02:08:51.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.420+0000 7f40ab90f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a40fbcb0 0x7f40a4066c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.420+0000 7f40ab90f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40a40fcf60 0x7f40a4112810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.420+0000 7f40ab90f700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a4112d50 con 0x7f40a40fbcb0 2024-04-25T02:08:51.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.420+0000 7f40ab90f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a4112ec0 con 0x7f40a40fcf60 2024-04-25T02:08:51.428 INFO:tasks.workunit.client.0.smithi077.stdout:3/487: symlink d0/d17/d4b/lb0 0 2024-04-25T02:08:51.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.420+0000 7f40a96ab700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a40fbcb0 0x7f40a4066c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.421+0000 7f40a96ab700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a40fbcb0 0x7f40a4066c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33392/0 (socket says 172.21.15.77:33392) 2024-04-25T02:08:51.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.421+0000 7f40a96ab700 1 -- 172.21.15.77:0/945632623 learned_addr learned my addr 172.21.15.77:0/945632623 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:08:51.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.421+0000 7f40a8eaa700 1 --2- 172.21.15.77:0/945632623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40a40fcf60 0x7f40a4112810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.421+0000 7f40a96ab700 1 -- 172.21.15.77:0/945632623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40a40fcf60 msgr2=0x7f40a4112810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.421+0000 7f40a96ab700 1 --2- 172.21.15.77:0/945632623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40a40fcf60 0x7f40a4112810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.421+0000 7f40a96ab700 1 -- 172.21.15.77:0/945632623 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409c009940 con 0x7f40a40fbcb0 2024-04-25T02:08:51.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.421+0000 7f40a96ab700 1 --2- 172.21.15.77:0/945632623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a40fbcb0 0x7f40a4066c50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f409c009fd0 tx=0x7f409c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:51.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.421+0000 7f40a1ffb700 1 -- 172.21.15.77:0/945632623 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f409c00e050 con 0x7f40a40fbcb0 2024-04-25T02:08:51.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.421+0000 7f40ab90f700 1 -- 172.21.15.77:0/945632623 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a4113140 con 0x7f40a40fbcb0 2024-04-25T02:08:51.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.421+0000 7f40a1ffb700 1 -- 172.21.15.77:0/945632623 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f409c01d910 con 0x7f40a40fbcb0 2024-04-25T02:08:51.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.421+0000 7f40a1ffb700 1 -- 172.21.15.77:0/945632623 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f409c012850 con 0x7f40a40fbcb0 2024-04-25T02:08:51.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.421+0000 7f40ab90f700 1 -- 172.21.15.77:0/945632623 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a4113700 con 0x7f40a40fbcb0 2024-04-25T02:08:51.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.422+0000 7f40ab90f700 1 -- 172.21.15.77:0/945632623 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a404c710 con 0x7f40a40fbcb0 2024-04-25T02:08:51.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.423+0000 7f40a1ffb700 1 -- 172.21.15.77:0/945632623 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f409c019040 con 0x7f40a40fbcb0 2024-04-25T02:08:51.431 INFO:tasks.workunit.client.0.smithi077.stdout:3/488: link d0/d2/d2f/d5f/c6b d0/d17/d4b/d59/cb1 0 2024-04-25T02:08:51.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.423+0000 7f40a1ffb700 1 --2- 172.21.15.77:0/945632623 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f408c0692a0 0x7f408c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.424+0000 7f40a8eaa700 1 --2- 172.21.15.77:0/945632623 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f408c0692a0 0x7f408c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.424+0000 7f40a1ffb700 1 -- 172.21.15.77:0/945632623 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f409c088d40 con 0x7f40a40fbcb0 2024-04-25T02:08:51.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.424+0000 7f40a8eaa700 1 --2- 172.21.15.77:0/945632623 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f408c0692a0 0x7f408c06b750 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4094006fd0 tx=0x7f40940090f0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:51.436 INFO:tasks.workunit.client.0.smithi077.stdout:0/541: write d2/d17/d4e/d5e/fb7 [3184426,121129] 0 2024-04-25T02:08:51.436 INFO:tasks.workunit.client.0.smithi077.stdout:9/574: read df/f18 [1335185,31895] 0 2024-04-25T02:08:51.436 INFO:tasks.workunit.client.0.smithi077.stdout:9/575: write df/d1b/f63 [113690,80422] 0 2024-04-25T02:08:51.436 INFO:tasks.workunit.client.0.smithi077.stdout:9/576: chown df/d80 34 1 2024-04-25T02:08:51.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.430+0000 7f40a1ffb700 1 -- 172.21.15.77:0/945632623 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f409c058ab0 con 0x7f40a40fbcb0 2024-04-25T02:08:51.437 INFO:tasks.workunit.client.0.smithi077.stdout:9/577: dread df/f31 [0,4194304] 0 2024-04-25T02:08:51.438 INFO:tasks.workunit.client.0.smithi077.stdout:4/546: dwrite d0/d14/d60/d86/d25/f45 [4194304,4194304] 0 2024-04-25T02:08:51.438 INFO:tasks.workunit.client.0.smithi077.stdout:4/547: fsync d0/d14/d60/d86/f44 0 2024-04-25T02:08:51.438 INFO:tasks.workunit.client.0.smithi077.stdout:4/548: chown d0/d14/d21/d39/f76 11 1 2024-04-25T02:08:51.440 INFO:tasks.workunit.client.0.smithi077.stdout:0/542: unlink d2/d17/f69 0 2024-04-25T02:08:51.440 INFO:tasks.workunit.client.0.smithi077.stdout:7/503: dwrite d4/d13/d5b/f5d [0,4194304] 0 2024-04-25T02:08:51.440 INFO:tasks.workunit.client.0.smithi077.stdout:6/630: dwrite de/d12/d25/d3a/d6a/dcd/d36/f56 [0,4194304] 0 2024-04-25T02:08:51.441 INFO:tasks.workunit.client.0.smithi077.stdout:4/549: creat d0/d14/d21/d39/da/d12/fb8 x:0 0 0 2024-04-25T02:08:51.441 INFO:tasks.workunit.client.0.smithi077.stdout:4/550: creat d0/d14/d21/d39/d9a/fb9 x:0 0 0 2024-04-25T02:08:51.441 INFO:tasks.workunit.client.0.smithi077.stdout:4/551: read d0/d14/d21/d39/da/d12/d35/d3e/f3f [22490,122234] 0 2024-04-25T02:08:51.442 INFO:tasks.workunit.client.0.smithi077.stdout:4/552: write d0/d14/d21/d39/d64/f82 [954458,71636] 0 2024-04-25T02:08:51.442 INFO:tasks.workunit.client.0.smithi077.stdout:4/553: getdents d0/d14/da6 0 2024-04-25T02:08:51.442 INFO:tasks.workunit.client.0.smithi077.stdout:4/554: readlink d0/d14/d60/d62/l8a 0 2024-04-25T02:08:51.445 INFO:tasks.workunit.client.0.smithi077.stdout:0/543: dread d2/d9/d2a/f58 [0,4194304] 0 2024-04-25T02:08:51.445 INFO:tasks.workunit.client.0.smithi077.stdout:0/544: readlink d2/d17/d1d/l23 0 2024-04-25T02:08:51.445 INFO:tasks.workunit.client.0.smithi077.stdout:0/545: chown d2/d17/d1d/d34/d4c/da2/l7f 29 1 2024-04-25T02:08:51.446 INFO:tasks.workunit.client.0.smithi077.stdout:0/546: dread d2/d1c/f24 [0,4194304] 0 2024-04-25T02:08:51.446 INFO:tasks.workunit.client.0.smithi077.stdout:4/555: truncate d0/d14/d21/d39/da/fb 1784166 0 2024-04-25T02:08:51.450 INFO:tasks.workunit.client.0.smithi077.stdout:6/631: dread de/f46 [0,4194304] 0 2024-04-25T02:08:51.455 INFO:tasks.workunit.client.0.smithi077.stdout:3/489: dwrite d0/d2/de/d48/f3d [0,4194304] 0 2024-04-25T02:08:51.455 INFO:tasks.workunit.client.0.smithi077.stdout:7/504: dread d4/d13/d2c/f2e [4194304,4194304] 0 2024-04-25T02:08:51.455 INFO:tasks.workunit.client.0.smithi077.stdout:3/490: rmdir d0/d2/de/d36 39 2024-04-25T02:08:51.457 INFO:tasks.workunit.client.0.smithi077.stdout:7/505: rename d4/d7c/f84 to d4/d13/d18/d2d/faf 0 2024-04-25T02:08:51.457 INFO:tasks.workunit.client.0.smithi077.stdout:9/578: dwrite df/f1d [0,4194304] 0 2024-04-25T02:08:51.457 INFO:tasks.workunit.client.0.smithi077.stdout:9/579: creat df/d1b/d70/d74/fbb x:0 0 0 2024-04-25T02:08:51.458 INFO:tasks.workunit.client.0.smithi077.stdout:7/506: symlink d4/lb0 0 2024-04-25T02:08:51.466 INFO:tasks.workunit.client.0.smithi077.stdout:9/580: mknod df/d1b/d70/cbc 0 2024-04-25T02:08:51.468 INFO:tasks.workunit.client.0.smithi077.stdout:7/507: mknod d4/cb1 0 2024-04-25T02:08:51.468 INFO:tasks.workunit.client.0.smithi077.stdout:7/508: write d4/d13/d66/f83 [235923,122529] 0 2024-04-25T02:08:51.468 INFO:tasks.workunit.client.0.smithi077.stdout:7/509: fsync d4/d13/d18/d24/d3f/f44 0 2024-04-25T02:08:51.470 INFO:tasks.workunit.client.0.smithi077.stdout:7/510: truncate d4/d13/d18/d24/d3f/f44 3520304 0 2024-04-25T02:08:51.471 INFO:tasks.workunit.client.0.smithi077.stdout:7/511: chown d4/d13/d18/d2d/d30 241765 1 2024-04-25T02:08:51.471 INFO:tasks.workunit.client.0.smithi077.stdout:7/512: readlink d4/d13/l9d 0 2024-04-25T02:08:51.471 INFO:tasks.workunit.client.0.smithi077.stdout:7/513: fsync d4/f37 0 2024-04-25T02:08:51.473 INFO:tasks.workunit.client.0.smithi077.stdout:0/547: truncate d2/d17/d1d/d34/d4c/da2/f67 2874608 0 2024-04-25T02:08:51.474 INFO:tasks.workunit.client.0.smithi077.stdout:7/514: mkdir d4/d13/d5b/d8b/db2 0 2024-04-25T02:08:51.475 INFO:tasks.workunit.client.0.smithi077.stdout:7/515: mkdir d4/d13/d18/d2d/d56/d68/db3 0 2024-04-25T02:08:51.475 INFO:tasks.workunit.client.0.smithi077.stdout:7/516: write d4/d13/d18/d2d/fac [163840,119660] 0 2024-04-25T02:08:51.476 INFO:tasks.workunit.client.0.smithi077.stdout:3/491: dwrite d0/d2/de/d48/f29 [4194304,4194304] 0 2024-04-25T02:08:51.476 INFO:tasks.workunit.client.0.smithi077.stdout:3/492: write d0/d2/de/f61 [110946,66865] 0 2024-04-25T02:08:51.476 INFO:tasks.workunit.client.0.smithi077.stdout:3/493: chown d0/d17/d4b/fa3 7040 1 2024-04-25T02:08:51.477 INFO:tasks.workunit.client.0.smithi077.stdout:1/493: sync 2024-04-25T02:08:51.477 INFO:tasks.workunit.client.0.smithi077.stdout:8/591: sync 2024-04-25T02:08:51.477 INFO:tasks.workunit.client.0.smithi077.stdout:1/494: chown db/df/d56/fa1 229986681 1 2024-04-25T02:08:51.477 INFO:tasks.workunit.client.0.smithi077.stdout:8/592: readlink d3/da/db/df/d2b/d37/l75 0 2024-04-25T02:08:51.477 INFO:tasks.workunit.client.0.smithi077.stdout:3/494: write d0/d2/d2f/d50/f96 [94690,29181] 0 2024-04-25T02:08:51.478 INFO:tasks.workunit.client.0.smithi077.stdout:1/495: mkdir db/df/d14/d4d/da9 0 2024-04-25T02:08:51.479 INFO:tasks.workunit.client.0.smithi077.stdout:5/541: sync 2024-04-25T02:08:51.480 INFO:tasks.workunit.client.0.smithi077.stdout:2/518: sync 2024-04-25T02:08:51.480 INFO:tasks.workunit.client.0.smithi077.stdout:2/519: chown d2/d9/d19/d1c/d37 0 1 2024-04-25T02:08:51.482 INFO:tasks.workunit.client.0.smithi077.stdout:8/593: creat d3/d7a/d7e/fb4 x:0 0 0 2024-04-25T02:08:51.482 INFO:tasks.workunit.client.0.smithi077.stdout:8/594: chown d3/da/db/df/d2b/d37/c84 311821532 1 2024-04-25T02:08:51.482 INFO:tasks.workunit.client.0.smithi077.stdout:8/595: stat d3/l38 0 2024-04-25T02:08:51.482 INFO:tasks.workunit.client.0.smithi077.stdout:1/496: rmdir db/df/d14/d4d 39 2024-04-25T02:08:51.485 INFO:tasks.workunit.client.0.smithi077.stdout:3/495: rename d0/d17/f7e to d0/d2/de/d48/fb2 0 2024-04-25T02:08:51.486 INFO:tasks.workunit.client.0.smithi077.stdout:8/596: write d3/da/db/f4c [3205320,46847] 0 2024-04-25T02:08:51.486 INFO:tasks.workunit.client.0.smithi077.stdout:1/497: mkdir db/df/d14/d3e/daa 0 2024-04-25T02:08:51.489 INFO:tasks.workunit.client.0.smithi077.stdout:3/496: mknod d0/d2/de/d27/cb3 0 2024-04-25T02:08:51.489 INFO:tasks.workunit.client.0.smithi077.stdout:3/497: chown d0/d2/de/d36/da6 2762269 1 2024-04-25T02:08:51.490 INFO:tasks.workunit.client.0.smithi077.stdout:8/597: dread d3/da/db/df/d2b/d37/f69 [0,4194304] 0 2024-04-25T02:08:51.492 INFO:tasks.workunit.client.0.smithi077.stdout:1/498: creat db/df/d14/d4d/d82/fab x:0 0 0 2024-04-25T02:08:51.492 INFO:tasks.workunit.client.0.smithi077.stdout:1/499: chown db/df/d14/d4d/d82/d42/d43/f8a 14429259 1 2024-04-25T02:08:51.493 INFO:tasks.workunit.client.0.smithi077.stdout:3/498: truncate d0/d2/d2f/f46 2130258 0 2024-04-25T02:08:51.494 INFO:tasks.workunit.client.0.smithi077.stdout:3/499: truncate d0/d3e/d62/f68 2226624 0 2024-04-25T02:08:51.494 INFO:tasks.workunit.client.0.smithi077.stdout:8/598: mknod d3/da/cb5 0 2024-04-25T02:08:51.496 INFO:tasks.workunit.client.0.smithi077.stdout:8/599: symlink d3/da/d27/d44/db1/lb6 0 2024-04-25T02:08:51.496 INFO:tasks.workunit.client.0.smithi077.stdout:8/600: readlink d3/d34/d3d/l4a 0 2024-04-25T02:08:51.497 INFO:tasks.workunit.client.0.smithi077.stdout:3/500: mkdir d0/d2/d2f/db4 0 2024-04-25T02:08:51.504 INFO:tasks.workunit.client.0.smithi077.stdout:8/601: write d3/da/d27/d16/d6b/f6e [737448,63198] 0 2024-04-25T02:08:51.504 INFO:tasks.workunit.client.0.smithi077.stdout:8/602: write d3/da/db/df/d2b/d7b/f90 [2719857,25640] 0 2024-04-25T02:08:51.506 INFO:tasks.workunit.client.0.smithi077.stdout:8/603: write d3/da/d27/f1e [544055,116905] 0 2024-04-25T02:08:51.506 INFO:tasks.workunit.client.0.smithi077.stdout:1/500: dread f1 [0,4194304] 0 2024-04-25T02:08:51.506 INFO:tasks.workunit.client.0.smithi077.stdout:7/517: dwrite d4/d13/d18/d24/d3f/d58/f7a [0,4194304] 0 2024-04-25T02:08:51.507 INFO:tasks.workunit.client.0.smithi077.stdout:2/520: dwrite d2/d59/f6e [0,4194304] 0 2024-04-25T02:08:51.507 INFO:tasks.workunit.client.0.smithi077.stdout:5/542: dwrite d0/d2/d3/d9/d39/d44/f95 [0,4194304] 0 2024-04-25T02:08:51.516 INFO:tasks.workunit.client.0.smithi077.stdout:1/501: rename db/d26/c65 to db/df/d14/d33/d34/cac 0 2024-04-25T02:08:51.516 INFO:tasks.workunit.client.0.smithi077.stdout:2/521: rename d2 to d2/d9/d19/da5 22 2024-04-25T02:08:51.517 INFO:tasks.workunit.client.0.smithi077.stdout:2/522: chown d2/d9/df/l15 1 1 2024-04-25T02:08:51.517 INFO:tasks.workunit.client.0.smithi077.stdout:1/502: fdatasync db/df/d14/d4d/d82/d5c/d81/f86 0 2024-04-25T02:08:51.517 INFO:tasks.workunit.client.0.smithi077.stdout:2/523: truncate d2/d9/d19/d1c/f81 532769 0 2024-04-25T02:08:51.517 INFO:tasks.workunit.client.0.smithi077.stdout:1/503: write db/df/d14/d3e/f54 [610832,67233] 0 2024-04-25T02:08:51.524 INFO:tasks.workunit.client.0.smithi077.stdout:1/504: mkdir db/df/d14/d3e/d69/dad 0 2024-04-25T02:08:51.527 INFO:tasks.workunit.client.0.smithi077.stdout:1/505: mknod db/df/d14/d4d/d82/d42/cae 0 2024-04-25T02:08:51.527 INFO:tasks.workunit.client.0.smithi077.stdout:1/506: stat db/df/d14/d33/d6c 0 2024-04-25T02:08:51.527 INFO:tasks.workunit.client.0.smithi077.stdout:1/507: chown db/df/d14/d4d/d82/d32/d8f/c99 24375 1 2024-04-25T02:08:51.527 INFO:tasks.workunit.client.0.smithi077.stdout:1/508: fsync db/f12 0 2024-04-25T02:08:51.530 INFO:tasks.workunit.client.0.smithi077.stdout:3/501: dwrite d0/d2/f18 [0,4194304] 0 2024-04-25T02:08:51.530 INFO:tasks.workunit.client.0.smithi077.stdout:3/502: truncate d0/d3e/d62/d6a/f89 1025768 0 2024-04-25T02:08:51.530 INFO:tasks.workunit.client.0.smithi077.stdout:3/503: fsync d0/d17/f80 0 2024-04-25T02:08:51.530 INFO:tasks.workunit.client.0.smithi077.stdout:3/504: creat d0/d3e/d42/fb5 x:0 0 0 2024-04-25T02:08:51.530 INFO:tasks.workunit.client.0.smithi077.stdout:3/505: stat d0/d40/la9 0 2024-04-25T02:08:51.531 INFO:tasks.workunit.client.0.smithi077.stdout:2/524: dread d2/d59/f6e [0,4194304] 0 2024-04-25T02:08:51.531 INFO:tasks.workunit.client.0.smithi077.stdout:2/525: fsync d2/d9/d19/d1c/d3f/d53/f8a 0 2024-04-25T02:08:51.541 INFO:tasks.workunit.client.0.smithi077.stdout:5/543: dwrite d0/d2/d3/d9/d39/d44/f53 [0,4194304] 0 2024-04-25T02:08:51.542 INFO:tasks.workunit.client.0.smithi077.stdout:5/544: write d0/d2/d1b/f76 [470834,10772] 0 2024-04-25T02:08:51.546 INFO:tasks.workunit.client.0.smithi077.stdout:3/506: read d0/f97 [2506946,109025] 0 2024-04-25T02:08:51.546 INFO:tasks.workunit.client.0.smithi077.stdout:3/507: write d0/d2/f34 [617029,49683] 0 2024-04-25T02:08:51.548 INFO:tasks.workunit.client.0.smithi077.stdout:0/548: truncate d2/d17/d4e/d5e/fb7 2725327 0 2024-04-25T02:08:51.548 INFO:tasks.workunit.client.0.smithi077.stdout:0/549: stat d2/d9 0 2024-04-25T02:08:51.549 INFO:tasks.workunit.client.0.smithi077.stdout:5/545: rmdir d0/d2/d20/d41 39 2024-04-25T02:08:51.549 INFO:tasks.workunit.client.0.smithi077.stdout:5/546: write d0/d25/f1a [6384689,45665] 0 2024-04-25T02:08:51.552 INFO:tasks.workunit.client.0.smithi077.stdout:0/550: link d2/d17/d1d/d34/d4c/da2/d51/ca5 d2/d8/d5f/d9f/cbb 0 2024-04-25T02:08:51.552 INFO:tasks.workunit.client.0.smithi077.stdout:0/551: chown d2/d17/d1d/d34/f36 95973312 1 2024-04-25T02:08:51.555 INFO:tasks.workunit.client.0.smithi077.stdout:7/518: dwrite d4/d13/d18/d2d/d30/f8c [0,4194304] 0 2024-04-25T02:08:51.555 INFO:tasks.workunit.client.0.smithi077.stdout:3/508: dread d0/f3c [0,4194304] 0 2024-04-25T02:08:51.556 INFO:tasks.workunit.client.0.smithi077.stdout:1/509: dwrite db/f12 [0,4194304] 0 2024-04-25T02:08:51.558 INFO:tasks.workunit.client.0.smithi077.stdout:7/519: truncate d4/d13/d18/d2d/d30/f6b 343132 0 2024-04-25T02:08:51.558 INFO:tasks.workunit.client.0.smithi077.stdout:7/520: chown d4/d13/d18/d24/f57 1 1 2024-04-25T02:08:51.559 INFO:tasks.workunit.client.0.smithi077.stdout:1/510: unlink db/df/d14/d4d/d82/f8b 0 2024-04-25T02:08:51.560 INFO:tasks.workunit.client.0.smithi077.stdout:3/509: dread d0/d2/d83/f86 [0,4194304] 0 2024-04-25T02:08:51.560 INFO:tasks.workunit.client.0.smithi077.stdout:3/510: fdatasync d0/d17/f5d 0 2024-04-25T02:08:51.561 INFO:tasks.workunit.client.0.smithi077.stdout:7/521: unlink d4/d13/d18/d24/d3f/f8d 0 2024-04-25T02:08:51.567 INFO:tasks.workunit.client.0.smithi077.stdout:1/511: dread db/df/d14/d3e/f5b [0,4194304] 0 2024-04-25T02:08:51.568 INFO:tasks.workunit.client.0.smithi077.stdout:1/512: unlink db/df/d1b/c60 0 2024-04-25T02:08:51.568 INFO:tasks.workunit.client.0.smithi077.stdout:1/513: dread - db/df/d14/d4d/d82/d42/d43/f8a zero size 2024-04-25T02:08:51.568 INFO:tasks.workunit.client.0.smithi077.stdout:1/514: read - db/df/d56/d5d/d77/f91 zero size 2024-04-25T02:08:51.569 INFO:tasks.workunit.client.0.smithi077.stdout:1/515: creat db/df/d14/d3e/d69/faf x:0 0 0 2024-04-25T02:08:51.570 INFO:tasks.workunit.client.0.smithi077.stdout:1/516: creat db/fb0 x:0 0 0 2024-04-25T02:08:51.571 INFO:tasks.workunit.client.0.smithi077.stdout:1/517: creat db/df/d14/d4d/d82/d42/fb1 x:0 0 0 2024-04-25T02:08:51.591 INFO:tasks.workunit.client.0.smithi077.stdout:3/511: dwrite d0/d2/d2f/d50/f96 [0,4194304] 0 2024-04-25T02:08:51.608 INFO:tasks.workunit.client.0.smithi077.stdout:2/526: dwrite d2/d59/f6e [0,4194304] 0 2024-04-25T02:08:51.612 INFO:tasks.workunit.client.0.smithi077.stdout:5/547: write d0/d2/d1b/f54 [3516884,62918] 0 2024-04-25T02:08:51.614 INFO:tasks.workunit.client.0.smithi077.stdout:2/527: mkdir d2/d9/d2f/d84/da6 0 2024-04-25T02:08:51.615 INFO:tasks.workunit.client.0.smithi077.stdout:3/512: getdents d0/d40 0 2024-04-25T02:08:51.617 INFO:tasks.workunit.client.0.smithi077.stdout:1/518: dwrite f1 [0,4194304] 0 2024-04-25T02:08:51.624 INFO:tasks.workunit.client.0.smithi077.stdout:3/513: write d0/d2/de/d48/f3d [1790295,119745] 0 2024-04-25T02:08:51.626 INFO:tasks.workunit.client.0.smithi077.stdout:4/556: sync 2024-04-25T02:08:51.627 INFO:tasks.workunit.client.0.smithi077.stdout:6/632: sync 2024-04-25T02:08:51.627 INFO:tasks.workunit.client.0.smithi077.stdout:6/633: dread - de/d55/d88/fb3 zero size 2024-04-25T02:08:51.630 INFO:tasks.workunit.client.0.smithi077.stdout:6/634: unlink de/d12/d25/c74 0 2024-04-25T02:08:51.631 INFO:tasks.workunit.client.0.smithi077.stdout:6/635: unlink de/d12/d25/d3a/fc9 0 2024-04-25T02:08:51.632 INFO:tasks.workunit.client.0.smithi077.stdout:6/636: stat de/d95/fab 0 2024-04-25T02:08:51.633 INFO:tasks.workunit.client.0.smithi077.stdout:6/637: creat de/d12/d25/d3a/d6a/dcd/fda x:0 0 0 2024-04-25T02:08:51.635 INFO:tasks.workunit.client.0.smithi077.stdout:6/638: rename de/d55/cb4 to de/d55/db7/cdb 0 2024-04-25T02:08:51.636 INFO:tasks.workunit.client.0.smithi077.stdout:5/548: dwrite d0/d2/d3/d9/f2a [0,4194304] 0 2024-04-25T02:08:51.640 INFO:tasks.workunit.client.0.smithi077.stdout:5/549: unlink d0/d2/d20/l4d 0 2024-04-25T02:08:51.640 INFO:tasks.workunit.client.0.smithi077.stdout:1/519: dwrite db/df/d14/d4d/d82/d42/fb1 [0,4194304] 0 2024-04-25T02:08:51.643 INFO:tasks.workunit.client.0.smithi077.stdout:5/550: unlink d0/d2/d3/d9/d39/d44/d5f/l62 0 2024-04-25T02:08:51.645 INFO:tasks.workunit.client.0.smithi077.stdout:5/551: mkdir d0/d25/d82/d87/d8b/d5a/db4 0 2024-04-25T02:08:51.649 INFO:tasks.workunit.client.0.smithi077.stdout:1/520: dread db/fd [0,4194304] 0 2024-04-25T02:08:51.653 INFO:tasks.workunit.client.0.smithi077.stdout:1/521: dread db/df/d14/d3e/f5b [0,4194304] 0 2024-04-25T02:08:51.653 INFO:tasks.workunit.client.0.smithi077.stdout:1/522: chown db/df/d14/d33/d34/d66 2 1 2024-04-25T02:08:51.653 INFO:tasks.workunit.client.0.smithi077.stdout:1/523: chown db/df/d56/d5d 39405992 1 2024-04-25T02:08:51.653 INFO:tasks.workunit.client.0.smithi077.stdout:3/514: dwrite d0/d3e/d62/f8d [0,4194304] 0 2024-04-25T02:08:51.653 INFO:tasks.workunit.client.0.smithi077.stdout:6/639: dwrite de/d12/f7a [0,4194304] 0 2024-04-25T02:08:51.653 INFO:tasks.workunit.client.0.smithi077.stdout:6/640: read de/d12/f1c [815409,90792] 0 2024-04-25T02:08:51.654 INFO:tasks.workunit.client.0.smithi077.stdout:1/524: creat db/df/d14/d4d/d82/d42/d43/fb2 x:0 0 0 2024-04-25T02:08:51.655 INFO:tasks.workunit.client.0.smithi077.stdout:5/552: write d0/d2/d20/d41/f9a [1880434,32775] 0 2024-04-25T02:08:51.658 INFO:tasks.workunit.client.0.smithi077.stdout:3/515: mkdir d0/d2/d2f/db4/db6 0 2024-04-25T02:08:51.661 INFO:tasks.workunit.client.0.smithi077.stdout:6/641: link l6 de/d12/d25/d3a/d6a/dcd/ldc 0 2024-04-25T02:08:51.662 INFO:tasks.workunit.client.0.smithi077.stdout:1/525: mkdir db/df/d56/d5d/d77/db3 0 2024-04-25T02:08:51.664 INFO:tasks.workunit.client.0.smithi077.stdout:3/516: link d0/d2/de/d48/d15/f2b d0/d2/de/d36/fb7 0 2024-04-25T02:08:51.665 INFO:tasks.workunit.client.0.smithi077.stdout:9/581: sync 2024-04-25T02:08:51.665 INFO:tasks.workunit.client.0.smithi077.stdout:6/642: link de/d55/lac de/d53/ldd 0 2024-04-25T02:08:51.666 INFO:tasks.workunit.client.0.smithi077.stdout:5/553: getdents d0/d25/d82/d87/d8b/d5a 0 2024-04-25T02:08:51.667 INFO:tasks.workunit.client.0.smithi077.stdout:5/554: write d0/d2/d3/d9/d39/fae [48764,67521] 0 2024-04-25T02:08:51.667 INFO:tasks.workunit.client.0.smithi077.stdout:5/555: fsync d0/d2/d1b/d35/f4f 0 2024-04-25T02:08:51.667 INFO:tasks.workunit.client.0.smithi077.stdout:6/643: dread de/d12/d25/f31 [0,4194304] 0 2024-04-25T02:08:51.668 INFO:tasks.workunit.client.0.smithi077.stdout:9/582: rename df/d1b/d48/d75/db4 to df/d1b/d56/dbd 0 2024-04-25T02:08:51.669 INFO:tasks.workunit.client.0.smithi077.stdout:5/556: creat d0/d2/d1b/fb5 x:0 0 0 2024-04-25T02:08:51.670 INFO:tasks.workunit.client.0.smithi077.stdout:1/526: dread f1 [0,4194304] 0 2024-04-25T02:08:51.670 INFO:tasks.workunit.client.0.smithi077.stdout:6/644: symlink de/d12/d25/d4b/dd1/lde 0 2024-04-25T02:08:51.671 INFO:tasks.workunit.client.0.smithi077.stdout:9/583: mknod df/d1b/d56/dbd/cbe 0 2024-04-25T02:08:51.672 INFO:tasks.workunit.client.0.smithi077.stdout:3/517: getdents d0/d2/de/d36 0 2024-04-25T02:08:51.673 INFO:tasks.workunit.client.0.smithi077.stdout:6/645: mkdir de/d3b/ddf 0 2024-04-25T02:08:51.674 INFO:tasks.workunit.client.0.smithi077.stdout:9/584: creat df/d1b/d48/d75/d77/fbf x:0 0 0 2024-04-25T02:08:51.675 INFO:tasks.workunit.client.0.smithi077.stdout:3/518: creat d0/d2/de/d36/fb8 x:0 0 0 2024-04-25T02:08:51.675 INFO:tasks.workunit.client.0.smithi077.stdout:9/585: mknod df/d1b/d48/db6/cc0 0 2024-04-25T02:08:51.677 INFO:tasks.workunit.client.0.smithi077.stdout:3/519: truncate d0/f1f 558761 0 2024-04-25T02:08:51.677 INFO:tasks.workunit.client.0.smithi077.stdout:3/520: stat d0/d3e/d93 0 2024-04-25T02:08:51.677 INFO:tasks.workunit.client.0.smithi077.stdout:5/557: dread d0/d2/d3/d9/f2a [0,4194304] 0 2024-04-25T02:08:51.678 INFO:tasks.workunit.client.0.smithi077.stdout:9/586: getdents df/d1b 0 2024-04-25T02:08:51.678 INFO:tasks.workunit.client.0.smithi077.stdout:5/558: mkdir d0/d2/d3/db6 0 2024-04-25T02:08:51.682 INFO:tasks.workunit.client.0.smithi077.stdout:1/527: dread db/f18 [0,4194304] 0 2024-04-25T02:08:51.683 INFO:tasks.workunit.client.0.smithi077.stdout:9/587: dread df/d1b/f47 [0,4194304] 0 2024-04-25T02:08:51.683 INFO:tasks.workunit.client.0.smithi077.stdout:9/588: chown df/d1b/f47 37512 1 2024-04-25T02:08:51.683 INFO:tasks.workunit.client.0.smithi077.stdout:5/559: fdatasync d0/d2/d3/d9/d39/fae 0 2024-04-25T02:08:51.684 INFO:tasks.workunit.client.0.smithi077.stdout:1/528: mkdir db/df/d14/d33/d34/db4 0 2024-04-25T02:08:51.687 INFO:tasks.workunit.client.0.smithi077.stdout:5/560: rename d0/d25/d82/d87/fb0 to d0/d2/d20/d23/fb7 0 2024-04-25T02:08:51.688 INFO:tasks.workunit.client.0.smithi077.stdout:3/521: dread d0/d3e/d62/f8d [0,4194304] 0 2024-04-25T02:08:51.688 INFO:tasks.workunit.client.0.smithi077.stdout:5/561: read d0/d2/d3/f55 [328259,21214] 0 2024-04-25T02:08:51.690 INFO:tasks.workunit.client.0.smithi077.stdout:3/522: mkdir d0/d3e/d62/d6a/db9 0 2024-04-25T02:08:51.692 INFO:tasks.workunit.client.0.smithi077.stdout:5/562: mkdir d0/d2/d68/db8 0 2024-04-25T02:08:51.692 INFO:tasks.workunit.client.0.smithi077.stdout:5/563: creat d0/d2/d1b/fb9 x:0 0 0 2024-04-25T02:08:51.692 INFO:tasks.workunit.client.0.smithi077.stdout:5/564: stat d0/d2/d1b/d3b/l40 0 2024-04-25T02:08:51.693 INFO:tasks.workunit.client.0.smithi077.stdout:3/523: mkdir d0/d3e/d62/dba 0 2024-04-25T02:08:51.694 INFO:tasks.workunit.client.0.smithi077.stdout:5/565: mkdir d0/d2/d20/d23/dba 0 2024-04-25T02:08:51.695 INFO:tasks.workunit.client.0.smithi077.stdout:3/524: symlink d0/d3e/d93/dae/lbb 0 2024-04-25T02:08:51.696 INFO:tasks.workunit.client.0.smithi077.stdout:5/566: creat d0/d25/d82/d8d/fbb x:0 0 0 2024-04-25T02:08:51.697 INFO:tasks.workunit.client.0.smithi077.stdout:5/567: mknod d0/d2/d52/cbc 0 2024-04-25T02:08:51.699 INFO:tasks.workunit.client.0.smithi077.stdout:3/525: rename d0/d17/l4d to d0/d2/de/d36/da0/da8/lbc 0 2024-04-25T02:08:51.699 INFO:tasks.workunit.client.0.smithi077.stdout:5/568: rename d0 to d0/d2/d3/d9/d39/d44/d5f/dbd 22 2024-04-25T02:08:51.699 INFO:tasks.workunit.client.0.smithi077.stdout:3/526: write d0/d2/de/f61 [2832730,117213] 0 2024-04-25T02:08:51.699 INFO:tasks.workunit.client.0.smithi077.stdout:3/527: dread - d0/d3e/d42/fb5 zero size 2024-04-25T02:08:51.699 INFO:tasks.workunit.client.0.smithi077.stdout:3/528: write d0/d2/de/d48/f3d [2606133,98239] 0 2024-04-25T02:08:51.699 INFO:tasks.workunit.client.0.smithi077.stdout:3/529: fdatasync d0/d2/de/d48/f2c 0 2024-04-25T02:08:51.699 INFO:tasks.workunit.client.0.smithi077.stdout:3/530: creat d0/d3e/d42/d64/d88/fbd x:0 0 0 2024-04-25T02:08:51.699 INFO:tasks.workunit.client.0.smithi077.stdout:3/531: fdatasync d0/d2/d83/f86 0 2024-04-25T02:08:51.703 INFO:tasks.workunit.client.0.smithi077.stdout:1/529: dread db/df/d14/f67 [0,4194304] 0 2024-04-25T02:08:51.705 INFO:tasks.workunit.client.0.smithi077.stdout:9/589: dwrite df/d1b/f63 [0,4194304] 0 2024-04-25T02:08:51.705 INFO:tasks.workunit.client.0.smithi077.stdout:9/590: write df/d1b/d48/d75/fa5 [684171,118816] 0 2024-04-25T02:08:51.705 INFO:tasks.workunit.client.0.smithi077.stdout:6/646: dwrite de/d12/d25/f9f [0,4194304] 0 2024-04-25T02:08:51.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.709+0000 7f40ab90f700 1 -- 172.21.15.77:0/945632623 --> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f40a41012c0 con 0x7f408c0692a0 2024-04-25T02:08:51.722 INFO:tasks.workunit.client.0.smithi077.stdout:5/569: rename d0/d2/d52/l65 to d0/d2/d3/d1d/lbe 0 2024-04-25T02:08:51.725 INFO:tasks.workunit.client.0.smithi077.stdout:6/647: dwrite de/d95/fab [0,4194304] 0 2024-04-25T02:08:51.730 INFO:tasks.workunit.client.0.smithi077.stdout:3/532: mknod d0/d2/de/d27/cbe 0 2024-04-25T02:08:51.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.724+0000 7f40a1ffb700 1 -- 172.21.15.77:0/945632623 <== mgr.14208 v2:172.21.15.77:6800/310739264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3344 (secure 0 0 0) 0x7f40a41012c0 con 0x7f408c0692a0 2024-04-25T02:08:51.731 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T02:08:51.731 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (6m) 2m ago 7m 24.4M - 0.25.0 c8568f914cd2 54c6f8f4d32d 2024-04-25T02:08:51.731 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (8m) 2m ago 8m 6665k - 17.2.7-902-gc61472c8 0de407c1b3af 2ad2e3d2b09e 2024-04-25T02:08:51.731 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi112 smithi112 running (7m) 2m ago 7m 6660k - 17.2.7-902-gc61472c8 0de407c1b3af 9235dc5eb15d 2024-04-25T02:08:51.731 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (6m) 2m ago 7m 85.0M - 9.4.7 954c08fa6188 d3b9c1566a82 2024-04-25T02:08:51.732 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.gcfygj smithi077 running (2m) 2m ago 2m 12.1M - 17.2.7-902-gc61472c8 0de407c1b3af 382dd7abf674 2024-04-25T02:08:51.732 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.oadrkb smithi077 running (2m) 2m ago 2m 10.4M - 17.2.7-902-gc61472c8 0de407c1b3af 6992064a4b2a 2024-04-25T02:08:51.732 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.dvwudt smithi112 running (2m) 2m ago 2m 16.6M - 17.2.7-902-gc61472c8 0de407c1b3af 0792e451abfd 2024-04-25T02:08:51.732 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.fjnadi smithi112 running (2m) 2m ago 2m 11.8M - 17.2.7-902-gc61472c8 0de407c1b3af c8093f622f6b 2024-04-25T02:08:51.732 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.zpflzp smithi077 *:9283 running (9m) 2m ago 9m 481M - 17.2.7-902-gc61472c8 0de407c1b3af 8c5e41dfcae2 2024-04-25T02:08:51.732 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi112.cswrxs smithi112 *:8443,9283 running (7m) 2m ago 7m 434M - 17.2.7-902-gc61472c8 0de407c1b3af afbb948e9239 2024-04-25T02:08:51.732 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (9m) 2m ago 9m 42.5M 2048M 17.2.7-902-gc61472c8 0de407c1b3af adb57965a306 2024-04-25T02:08:51.732 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi112 smithi112 running (6m) 2m ago 6m 32.2M 2048M 17.2.7-902-gc61472c8 0de407c1b3af db2fb9b09789 2024-04-25T02:08:51.732 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (8m) 2m ago 8m 15.3M - 1.5.0 0da6a335fe13 ec91684b7e6d 2024-04-25T02:08:51.732 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi112 smithi112 *:9100 running (7m) 2m ago 7m 16.4M - 1.5.0 0da6a335fe13 3a7c783c933b 2024-04-25T02:08:51.732 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (6m) 2m ago 6m 44.9M 4288M 17.2.7-902-gc61472c8 0de407c1b3af c741abec3b94 2024-04-25T02:08:51.732 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (5m) 2m ago 5m 44.7M 4288M 17.2.7-902-gc61472c8 0de407c1b3af 256ff3ced322 2024-04-25T02:08:51.732 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (5m) 2m ago 5m 47.4M 4288M 17.2.7-902-gc61472c8 0de407c1b3af c5d7d8c993f4 2024-04-25T02:08:51.732 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi112 running (4m) 2m ago 4m 44.4M 5312M 17.2.7-902-gc61472c8 0de407c1b3af 68429d0dbf88 2024-04-25T02:08:51.733 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi112 running (4m) 2m ago 4m 44.0M 5312M 17.2.7-902-gc61472c8 0de407c1b3af 66eb71201444 2024-04-25T02:08:51.733 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi112 running (4m) 2m ago 4m 41.6M 5312M 17.2.7-902-gc61472c8 0de407c1b3af 963e700d6aea 2024-04-25T02:08:51.733 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (6m) 2m ago 7m 51.4M - 2.43.0 a07b618ecd1d 85f5766c90c7 2024-04-25T02:08:51.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.727+0000 7f40ab90f700 1 -- 172.21.15.77:0/945632623 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f408c0692a0 msgr2=0x7f408c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.727+0000 7f40ab90f700 1 --2- 172.21.15.77:0/945632623 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f408c0692a0 0x7f408c06b750 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4094006fd0 tx=0x7f40940090f0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.727+0000 7f40ab90f700 1 -- 172.21.15.77:0/945632623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a40fbcb0 msgr2=0x7f40a4066c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.727+0000 7f40ab90f700 1 --2- 172.21.15.77:0/945632623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a40fbcb0 0x7f40a4066c50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f409c009fd0 tx=0x7f409c004d10 comp rx=0 tx=0).stop 2024-04-25T02:08:51.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.727+0000 7f40ab90f700 1 -- 172.21.15.77:0/945632623 shutdown_connections 2024-04-25T02:08:51.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.727+0000 7f40ab90f700 1 --2- 172.21.15.77:0/945632623 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f408c0692a0 0x7f408c06b750 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.727+0000 7f40ab90f700 1 --2- 172.21.15.77:0/945632623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a40fbcb0 0x7f40a4066c50 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.727+0000 7f40ab90f700 1 --2- 172.21.15.77:0/945632623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40a40fcf60 0x7f40a4112810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.727+0000 7f40ab90f700 1 -- 172.21.15.77:0/945632623 >> 172.21.15.77:0/945632623 conn(0x7f40a40f7430 msgr2=0x7f40a40f8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:51.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.727+0000 7f40ab90f700 1 -- 172.21.15.77:0/945632623 shutdown_connections 2024-04-25T02:08:51.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.727+0000 7f40ab90f700 1 -- 172.21.15.77:0/945632623 wait complete. 2024-04-25T02:08:51.748 INFO:tasks.workunit.client.0.smithi077.stdout:6/648: dwrite de/f2c [0,4194304] 0 2024-04-25T02:08:51.748 INFO:tasks.workunit.client.0.smithi077.stdout:6/649: creat de/d12/d25/d3a/fe0 x:0 0 0 2024-04-25T02:08:51.749 INFO:tasks.workunit.client.0.smithi077.stdout:6/650: chown de/d12/d25/l27 97306450 1 2024-04-25T02:08:51.750 INFO:tasks.workunit.client.0.smithi077.stdout:1/530: creat db/df/d14/d4d/d82/d5c/fb5 x:0 0 0 2024-04-25T02:08:51.763 INFO:tasks.workunit.client.0.smithi077.stdout:9/591: mknod df/d1b/d70/d74/cc1 0 2024-04-25T02:08:51.766 INFO:tasks.workunit.client.0.smithi077.stdout:6/651: dwrite de/d53/f7c [0,4194304] 0 2024-04-25T02:08:51.781 INFO:tasks.workunit.client.0.smithi077.stdout:9/592: dwrite df/d1b/d56/d67/f8e [0,4194304] 0 2024-04-25T02:08:51.781 INFO:tasks.workunit.client.0.smithi077.stdout:9/593: stat df/f13 0 2024-04-25T02:08:51.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.847+0000 7f204a51e700 1 -- 172.21.15.77:0/1549936273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2044070830 msgr2=0x7f2044070ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.847+0000 7f204a51e700 1 --2- 172.21.15.77:0/1549936273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2044070830 0x7f2044070ca0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2034004940 tx=0x7f2034009e30 comp rx=0 tx=0).stop 2024-04-25T02:08:51.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.847+0000 7f204a51e700 1 -- 172.21.15.77:0/1549936273 shutdown_connections 2024-04-25T02:08:51.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.847+0000 7f204a51e700 1 --2- 172.21.15.77:0/1549936273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2044070830 0x7f2044070ca0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.847+0000 7f204a51e700 1 --2- 172.21.15.77:0/1549936273 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2044071de0 0x7f20440702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.847+0000 7f204a51e700 1 -- 172.21.15.77:0/1549936273 >> 172.21.15.77:0/1549936273 conn(0x7f20440f8540 msgr2=0x7f20440fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:51.856 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:51 smithi077 ceph-mon[26330]: pgmap v255: 65 pgs: 65 active+clean; 962 MiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 89 MiB/s rd, 116 MiB/s wr, 369 op/s 2024-04-25T02:08:51.856 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:51 smithi077 ceph-mon[26330]: from='client.24345 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:08:51.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.847+0000 7f204a51e700 1 -- 172.21.15.77:0/1549936273 shutdown_connections 2024-04-25T02:08:51.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.847+0000 7f204a51e700 1 -- 172.21.15.77:0/1549936273 wait complete. 2024-04-25T02:08:51.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.848+0000 7f204a51e700 1 Processor -- start 2024-04-25T02:08:51.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.848+0000 7f204a51e700 1 -- start start 2024-04-25T02:08:51.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.848+0000 7f204a51e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2044070830 0x7f204410fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.848+0000 7f204a51e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2044071de0 0x7f2044110050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.848+0000 7f204a51e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2044110650 con 0x7f2044070830 2024-04-25T02:08:51.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.848+0000 7f204a51e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20441107c0 con 0x7f2044071de0 2024-04-25T02:08:51.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.848+0000 7f2043fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2044070830 0x7f204410fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.849+0000 7f2043fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2044070830 0x7f204410fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33420/0 (socket says 172.21.15.77:33420) 2024-04-25T02:08:51.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.849+0000 7f2043fff700 1 -- 172.21.15.77:0/3549139199 learned_addr learned my addr 172.21.15.77:0/3549139199 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:08:51.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.849+0000 7f20437fe700 1 --2- 172.21.15.77:0/3549139199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2044071de0 0x7f2044110050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.849+0000 7f2043fff700 1 -- 172.21.15.77:0/3549139199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2044071de0 msgr2=0x7f2044110050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:51.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.849+0000 7f2043fff700 1 --2- 172.21.15.77:0/3549139199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2044071de0 0x7f2044110050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:51.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.849+0000 7f2043fff700 1 -- 172.21.15.77:0/3549139199 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2034005040 con 0x7f2044070830 2024-04-25T02:08:51.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.849+0000 7f2043fff700 1 --2- 172.21.15.77:0/3549139199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2044070830 0x7f204410fb10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2038002a80 tx=0x7f2038004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:51.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.849+0000 7f2040ff9700 1 -- 172.21.15.77:0/3549139199 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2038007cc0 con 0x7f2044070830 2024-04-25T02:08:51.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.849+0000 7f204a51e700 1 -- 172.21.15.77:0/3549139199 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2044115220 con 0x7f2044070830 2024-04-25T02:08:51.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.849+0000 7f2040ff9700 1 -- 172.21.15.77:0/3549139199 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f203800f040 con 0x7f2044070830 2024-04-25T02:08:51.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.849+0000 7f204a51e700 1 -- 172.21.15.77:0/3549139199 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20441157e0 con 0x7f2044070830 2024-04-25T02:08:51.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.849+0000 7f2040ff9700 1 -- 172.21.15.77:0/3549139199 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f203800da30 con 0x7f2044070830 2024-04-25T02:08:51.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.850+0000 7f204a51e700 1 -- 172.21.15.77:0/3549139199 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f204404c710 con 0x7f2044070830 2024-04-25T02:08:51.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.851+0000 7f2040ff9700 1 -- 172.21.15.77:0/3549139199 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f203800db90 con 0x7f2044070830 2024-04-25T02:08:51.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.851+0000 7f2040ff9700 1 --2- 172.21.15.77:0/3549139199 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f202c0692a0 0x7f202c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:51.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.851+0000 7f2040ff9700 1 -- 172.21.15.77:0/3549139199 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f2038086f80 con 0x7f2044070830 2024-04-25T02:08:51.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.851+0000 7f20437fe700 1 --2- 172.21.15.77:0/3549139199 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f202c0692a0 0x7f202c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:51.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.852+0000 7f20437fe700 1 --2- 172.21.15.77:0/3549139199 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f202c0692a0 0x7f202c06b750 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f203400b970 tx=0x7f2034009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:51.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:51.856+0000 7f2040ff9700 1 -- 172.21.15.77:0/3549139199 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2038056c70 con 0x7f2044070830 2024-04-25T02:08:51.877 INFO:tasks.workunit.client.0.smithi077.stdout:6/652: symlink de/d12/d25/d3a/le1 0 2024-04-25T02:08:51.882 INFO:tasks.workunit.client.0.smithi077.stdout:3/533: getdents d0/d2/de/d36 0 2024-04-25T02:08:51.885 INFO:tasks.workunit.client.0.smithi077.stdout:9/594: creat df/d1b/fc2 x:0 0 0 2024-04-25T02:08:51.886 INFO:tasks.workunit.client.0.smithi077.stdout:9/595: mknod df/d1b/d56/cc3 0 2024-04-25T02:08:51.887 INFO:tasks.workunit.client.0.smithi077.stdout:9/596: mknod df/d1b/cc4 0 2024-04-25T02:08:51.889 INFO:tasks.workunit.client.0.smithi077.stdout:9/597: truncate df/f41 201778 0 2024-04-25T02:08:51.889 INFO:tasks.workunit.client.0.smithi077.stdout:9/598: creat df/d1b/d56/d67/fc5 x:0 0 0 2024-04-25T02:08:51.897 INFO:tasks.workunit.client.0.smithi077.stdout:6/653: dwrite de/d12/fa7 [0,4194304] 0 2024-04-25T02:08:51.899 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:51 smithi112 ceph-mon[33313]: pgmap v255: 65 pgs: 65 active+clean; 962 MiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 89 MiB/s rd, 116 MiB/s wr, 369 op/s 2024-04-25T02:08:51.899 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:51 smithi112 ceph-mon[33313]: from='client.24345 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:08:51.910 INFO:tasks.workunit.client.0.smithi077.stdout:8/604: sync 2024-04-25T02:08:51.910 INFO:tasks.workunit.client.0.smithi077.stdout:0/552: sync 2024-04-25T02:08:51.911 INFO:tasks.workunit.client.0.smithi077.stdout:7/522: sync 2024-04-25T02:08:51.911 INFO:tasks.workunit.client.0.smithi077.stdout:2/528: sync 2024-04-25T02:08:51.911 INFO:tasks.workunit.client.0.smithi077.stdout:4/557: sync 2024-04-25T02:08:51.911 INFO:tasks.workunit.client.0.smithi077.stdout:2/529: chown d2/l4a 1614 1 2024-04-25T02:08:51.911 INFO:tasks.workunit.client.0.smithi077.stdout:7/523: write d4/d13/d66/f83 [163927,81394] 0 2024-04-25T02:08:51.911 INFO:tasks.workunit.client.0.smithi077.stdout:7/524: readlink d4/d13/l62 0 2024-04-25T02:08:51.911 INFO:tasks.workunit.client.0.smithi077.stdout:7/525: chown d4/d13/da9/c95 22 1 2024-04-25T02:08:51.912 INFO:tasks.workunit.client.0.smithi077.stdout:0/553: creat d2/d9/d2a/db5/fbc x:0 0 0 2024-04-25T02:08:51.912 INFO:tasks.workunit.client.0.smithi077.stdout:4/558: mknod d0/d14/d60/d86/d34/cba 0 2024-04-25T02:08:51.912 INFO:tasks.workunit.client.0.smithi077.stdout:4/559: readlink d0/d14/d60/d86/d96/l7b 0 2024-04-25T02:08:51.914 INFO:tasks.workunit.client.0.smithi077.stdout:7/526: unlink d4/c9 0 2024-04-25T02:08:51.915 INFO:tasks.workunit.client.0.smithi077.stdout:7/527: creat d4/d13/d18/d2d/d56/fb4 x:0 0 0 2024-04-25T02:08:51.918 INFO:tasks.workunit.client.0.smithi077.stdout:9/599: dwrite df/d1b/d48/f5e [0,4194304] 0 2024-04-25T02:08:51.919 INFO:tasks.workunit.client.0.smithi077.stdout:9/600: read df/d1b/f69 [666914,109779] 0 2024-04-25T02:08:51.919 INFO:tasks.workunit.client.0.smithi077.stdout:6/654: dwrite de/d12/f1c [0,4194304] 0 2024-04-25T02:08:51.920 INFO:tasks.workunit.client.0.smithi077.stdout:5/570: rename d0/d2/d20/l3d to d0/d2/d3/d9/lbf 0 2024-04-25T02:08:51.924 INFO:tasks.workunit.client.0.smithi077.stdout:3/534: rename d0/d2/d2f/d5f/c76 to d0/d17/d4b/d59/d81/cbf 0 2024-04-25T02:08:51.924 INFO:tasks.workunit.client.0.smithi077.stdout:3/535: creat d0/d2/d83/fc0 x:0 0 0 2024-04-25T02:08:51.925 INFO:tasks.workunit.client.0.smithi077.stdout:5/571: symlink d0/d2/da8/lc0 0 2024-04-25T02:08:51.925 INFO:tasks.workunit.client.0.smithi077.stdout:5/572: chown d0/d2/d52/c57 10654810 1 2024-04-25T02:08:51.925 INFO:tasks.workunit.client.0.smithi077.stdout:4/560: dread d0/d14/d21/d39/da/d12/d35/d3e/f50 [0,4194304] 0 2024-04-25T02:08:51.926 INFO:tasks.workunit.client.0.smithi077.stdout:6/655: getdents de/d12/d25/d44 0 2024-04-25T02:08:51.930 INFO:tasks.workunit.client.0.smithi077.stdout:7/528: dread d4/d13/f1f [0,4194304] 0 2024-04-25T02:08:51.930 INFO:tasks.workunit.client.0.smithi077.stdout:8/605: rename d3/da/db/df/f9e to d3/da/db/df/d30/fb7 0 2024-04-25T02:08:51.932 INFO:tasks.workunit.client.0.smithi077.stdout:5/573: dread d0/d2/d1b/d35/fac [0,4194304] 0 2024-04-25T02:08:51.933 INFO:tasks.workunit.client.0.smithi077.stdout:0/554: dwrite d2/d27/d2d/f6d [0,4194304] 0 2024-04-25T02:08:51.933 INFO:tasks.workunit.client.0.smithi077.stdout:4/561: link d0/d14/d21/d39/da/d12/d35/d3e/fb2 d0/d14/d79/fbb 0 2024-04-25T02:08:51.937 INFO:tasks.workunit.client.0.smithi077.stdout:6/656: link de/d5b/da6/fad de/d12/d25/d3a/fe2 0 2024-04-25T02:08:51.937 INFO:tasks.workunit.client.0.smithi077.stdout:3/536: dread d0/d2/de/d48/d15/f2a [0,4194304] 0 2024-04-25T02:08:51.937 INFO:tasks.workunit.client.0.smithi077.stdout:7/529: stat d4/d13/d18/d2d/d30/c39 0 2024-04-25T02:08:51.938 INFO:tasks.workunit.client.0.smithi077.stdout:7/530: truncate d4/d13/d18/d2d/d30/f6b 856061 0 2024-04-25T02:08:51.939 INFO:tasks.workunit.client.0.smithi077.stdout:9/601: dwrite df/d1b/d48/d86/f89 [0,4194304] 0 2024-04-25T02:08:51.939 INFO:tasks.workunit.client.0.smithi077.stdout:8/606: unlink d3/l38 0 2024-04-25T02:08:51.942 INFO:tasks.workunit.client.0.smithi077.stdout:2/530: rename d2/d9/d56/d5c/c6f to d2/d9/d19/d1c/d3f/ca7 0 2024-04-25T02:08:51.944 INFO:tasks.workunit.client.0.smithi077.stdout:1/531: rmdir db/df/d14/d4d/d82/d5c 39 2024-04-25T02:08:51.944 INFO:tasks.workunit.client.0.smithi077.stdout:1/532: chown db/df/d14/l19 8 1 2024-04-25T02:08:51.947 INFO:tasks.workunit.client.0.smithi077.stdout:4/562: mkdir d0/d14/d79/da4/dbc 0 2024-04-25T02:08:51.949 INFO:tasks.workunit.client.0.smithi077.stdout:6/657: creat de/d3b/ddf/fe3 x:0 0 0 2024-04-25T02:08:51.949 INFO:tasks.workunit.client.0.smithi077.stdout:6/658: dread - de/d12/d25/d3a/f9b zero size 2024-04-25T02:08:51.949 INFO:tasks.workunit.client.0.smithi077.stdout:6/659: read de/d53/f69 [615615,64534] 0 2024-04-25T02:08:51.951 INFO:tasks.workunit.client.0.smithi077.stdout:7/531: creat d4/d13/d5b/d8b/fb5 x:0 0 0 2024-04-25T02:08:51.954 INFO:tasks.workunit.client.0.smithi077.stdout:9/602: symlink df/d1b/d70/d74/lc6 0 2024-04-25T02:08:51.954 INFO:tasks.workunit.client.0.smithi077.stdout:9/603: chown df/d1b/d48/f54 18 1 2024-04-25T02:08:51.955 INFO:tasks.workunit.client.0.smithi077.stdout:8/607: link d3/da/d27/d16/f1c d3/d7a/fb8 0 2024-04-25T02:08:51.957 INFO:tasks.workunit.client.0.smithi077.stdout:2/531: rename d2/d9/d18/l3d to d2/d9/d19/d1c/d3f/d53/d86/la8 0 2024-04-25T02:08:51.959 INFO:tasks.workunit.client.0.smithi077.stdout:1/533: creat db/df/d14/d3e/daa/fb6 x:0 0 0 2024-04-25T02:08:51.961 INFO:tasks.workunit.client.0.smithi077.stdout:4/563: creat d0/d14/fbd x:0 0 0 2024-04-25T02:08:51.963 INFO:tasks.workunit.client.0.smithi077.stdout:6/660: rmdir de/d12/d25/d4b/dd1 39 2024-04-25T02:08:51.963 INFO:tasks.workunit.client.0.smithi077.stdout:3/537: dwrite d0/d2/de/d48/d15/f2b [4194304,4194304] 0 2024-04-25T02:08:51.965 INFO:tasks.workunit.client.0.smithi077.stdout:7/532: creat d4/d13/d18/fb6 x:0 0 0 2024-04-25T02:08:51.965 INFO:tasks.workunit.client.0.smithi077.stdout:9/604: mknod df/d1b/d48/cc7 0 2024-04-25T02:08:51.966 INFO:tasks.workunit.client.0.smithi077.stdout:8/608: mkdir d3/da/db/df/d30/db9 0 2024-04-25T02:08:51.967 INFO:tasks.workunit.client.0.smithi077.stdout:5/574: dwrite d0/d25/f30 [0,4194304] 0 2024-04-25T02:08:51.967 INFO:tasks.workunit.client.0.smithi077.stdout:2/532: mknod d2/d9/d2f/d84/d90/ca9 0 2024-04-25T02:08:51.968 INFO:tasks.workunit.client.0.smithi077.stdout:4/564: getdents d0 0 2024-04-25T02:08:51.969 INFO:tasks.workunit.client.0.smithi077.stdout:5/575: read d0/d2/d1b/d3b/f71 [44872,96701] 0 2024-04-25T02:08:51.972 INFO:tasks.workunit.client.0.smithi077.stdout:7/533: creat d4/d13/d18/d2d/d56/d68/d88/fb7 x:0 0 0 2024-04-25T02:08:51.973 INFO:tasks.workunit.client.0.smithi077.stdout:2/533: getdents d2/d9/d19/d1c/d37 0 2024-04-25T02:08:51.974 INFO:tasks.workunit.client.0.smithi077.stdout:5/576: dread d0/d2/d1b/d38/f64 [0,4194304] 0 2024-04-25T02:08:51.974 INFO:tasks.workunit.client.0.smithi077.stdout:5/577: chown d0/d2/d20/c9e 92 1 2024-04-25T02:08:51.974 INFO:tasks.workunit.client.0.smithi077.stdout:5/578: creat d0/d2/d3/fc1 x:0 0 0 2024-04-25T02:08:51.974 INFO:tasks.workunit.client.0.smithi077.stdout:5/579: fsync d0/d2/d1b/fb5 0 2024-04-25T02:08:51.974 INFO:tasks.workunit.client.0.smithi077.stdout:4/565: creat d0/d14/d60/d86/d34/fbe x:0 0 0 2024-04-25T02:08:51.975 INFO:tasks.workunit.client.0.smithi077.stdout:4/566: chown d0/d14/d21/d39/da/d12/d35 0 1 2024-04-25T02:08:51.976 INFO:tasks.workunit.client.0.smithi077.stdout:7/534: rename d4/d13/d18/d2d/d30/c4a to d4/d13/d18/d2d/cb8 0 2024-04-25T02:08:51.976 INFO:tasks.workunit.client.0.smithi077.stdout:7/535: chown d4/d13/da9/fad 27 1 2024-04-25T02:08:51.980 INFO:tasks.workunit.client.0.smithi077.stdout:5/580: truncate d0/d2/d3/d9/f2a 2889695 0 2024-04-25T02:08:51.980 INFO:tasks.workunit.client.0.smithi077.stdout:4/567: creat d0/d14/d21/d39/d1d/fbf x:0 0 0 2024-04-25T02:08:51.980 INFO:tasks.workunit.client.0.smithi077.stdout:5/581: read - d0/d2/d3/fc1 zero size 2024-04-25T02:08:51.980 INFO:tasks.workunit.client.0.smithi077.stdout:4/568: chown d0/d14/d60/d86/d96 3893497 1 2024-04-25T02:08:51.980 INFO:tasks.workunit.client.0.smithi077.stdout:5/582: fdatasync d0/d2/d3/f15 0 2024-04-25T02:08:51.980 INFO:tasks.workunit.client.0.smithi077.stdout:5/583: read - d0/d2/d1b/fb9 zero size 2024-04-25T02:08:51.981 INFO:tasks.workunit.client.0.smithi077.stdout:4/569: read d0/d14/d21/d39/da/d12/d35/d3e/f38 [294189,19835] 0 2024-04-25T02:08:51.981 INFO:tasks.workunit.client.0.smithi077.stdout:4/570: chown d0/d14/d21/d39/da/d12/d35/d3e/d3a/f7d 17 1 2024-04-25T02:08:51.981 INFO:tasks.workunit.client.0.smithi077.stdout:4/571: read - d0/d14/d60/d86/d34/fbe zero size 2024-04-25T02:08:51.981 INFO:tasks.workunit.client.0.smithi077.stdout:2/534: rename d2/d9/d19/d1c/d3f/c73 to d2/d9/d2f/d84/d90/caa 0 2024-04-25T02:08:51.981 INFO:tasks.workunit.client.0.smithi077.stdout:2/535: write d2/d28/f32 [4811219,107689] 0 2024-04-25T02:08:51.981 INFO:tasks.workunit.client.0.smithi077.stdout:5/584: symlink d0/d2/d3/d1d/d3e/lc2 0 2024-04-25T02:08:51.982 INFO:tasks.workunit.client.0.smithi077.stdout:9/605: read df/d1b/d56/d67/f8e [365400,57523] 0 2024-04-25T02:08:51.983 INFO:tasks.workunit.client.0.smithi077.stdout:2/536: rename d2/d9/d19/d1c/d3f/d53/d83/d97 to d2/d9/d18/d31/d7c/dab 0 2024-04-25T02:08:51.985 INFO:tasks.workunit.client.0.smithi077.stdout:5/585: creat d0/d25/d82/d87/d8b/da5/fc3 x:0 0 0 2024-04-25T02:08:51.990 INFO:tasks.workunit.client.0.smithi077.stdout:9/606: dread df/f14 [0,4194304] 0 2024-04-25T02:08:51.993 INFO:tasks.workunit.client.0.smithi077.stdout:9/607: getdents df/d1b/d48/d75 0 2024-04-25T02:08:51.995 INFO:tasks.workunit.client.0.smithi077.stdout:9/608: rename cb to df/d80/cc8 0 2024-04-25T02:08:51.999 INFO:tasks.workunit.client.0.smithi077.stdout:4/572: dread d0/d14/d21/d39/da/f85 [0,4194304] 0 2024-04-25T02:08:52.000 INFO:tasks.workunit.client.0.smithi077.stdout:4/573: dread d0/d14/d60/fa7 [0,4194304] 0 2024-04-25T02:08:52.000 INFO:tasks.workunit.client.0.smithi077.stdout:1/534: dwrite db/df/d56/f58 [0,4194304] 0 2024-04-25T02:08:52.003 INFO:tasks.workunit.client.0.smithi077.stdout:0/555: dwrite d2/d9/f66 [0,4194304] 0 2024-04-25T02:08:52.003 INFO:tasks.workunit.client.0.smithi077.stdout:2/537: write d2/d9/f17 [3239867,9291] 0 2024-04-25T02:08:52.003 INFO:tasks.workunit.client.0.smithi077.stdout:4/574: rename d0/d14/d60/d86/d25/l5a to d0/d14/d21/d39/d9d/lc0 0 2024-04-25T02:08:52.009 INFO:tasks.workunit.client.0.smithi077.stdout:1/535: truncate db/df/d14/d4d/d82/d5c/f5e 314244 0 2024-04-25T02:08:52.011 INFO:tasks.workunit.client.0.smithi077.stdout:1/536: read db/df/d14/f97 [24315,114324] 0 2024-04-25T02:08:52.013 INFO:tasks.workunit.client.0.smithi077.stdout:4/575: dread d0/f18 [0,4194304] 0 2024-04-25T02:08:52.014 INFO:tasks.workunit.client.0.smithi077.stdout:0/556: mknod d2/d17/d1d/d34/d4c/da2/d51/cbd 0 2024-04-25T02:08:52.015 INFO:tasks.workunit.client.0.smithi077.stdout:1/537: mknod db/df/d14/d4d/d82/d32/d8f/cb7 0 2024-04-25T02:08:52.017 INFO:tasks.workunit.client.0.smithi077.stdout:0/557: symlink d2/d27/d2d/lbe 0 2024-04-25T02:08:52.017 INFO:tasks.workunit.client.0.smithi077.stdout:1/538: stat db/df/d14/d4d/d82/c84 0 2024-04-25T02:08:52.018 INFO:tasks.workunit.client.0.smithi077.stdout:1/539: mknod db/df/d1b/cb8 0 2024-04-25T02:08:52.019 INFO:tasks.workunit.client.0.smithi077.stdout:4/576: rmdir d0/d14/da6 0 2024-04-25T02:08:52.019 INFO:tasks.workunit.client.0.smithi077.stdout:4/577: dread - d0/d14/d60/d86/d25/fa5 zero size 2024-04-25T02:08:52.019 INFO:tasks.workunit.client.0.smithi077.stdout:4/578: chown d0/d14/d21/l74 31992 1 2024-04-25T02:08:52.019 INFO:tasks.workunit.client.0.smithi077.stdout:4/579: truncate d0/d14/d79/fb6 334359 0 2024-04-25T02:08:52.020 INFO:tasks.workunit.client.0.smithi077.stdout:4/580: creat d0/d14/d21/d39/d1d/d98/fc1 x:0 0 0 2024-04-25T02:08:52.020 INFO:tasks.workunit.client.0.smithi077.stdout:4/581: write d0/d14/d60/d86/d25/f7e [305843,66641] 0 2024-04-25T02:08:52.020 INFO:tasks.workunit.client.0.smithi077.stdout:1/540: chown db/df/d14/c29 0 1 2024-04-25T02:08:52.020 INFO:tasks.workunit.client.0.smithi077.stdout:1/541: write db/f59 [1125759,105458] 0 2024-04-25T02:08:52.020 INFO:tasks.workunit.client.0.smithi077.stdout:1/542: read db/f59 [1203021,24079] 0 2024-04-25T02:08:52.020 INFO:tasks.workunit.client.0.smithi077.stdout:1/543: chown db/df/d56/d5d/d77/f8d 322 1 2024-04-25T02:08:52.025 INFO:tasks.workunit.client.0.smithi077.stdout:6/661: dwrite de/d55/d88/fb3 [0,4194304] 0 2024-04-25T02:08:52.031 INFO:tasks.workunit.client.0.smithi077.stdout:6/662: getdents de/d53/db2 0 2024-04-25T02:08:52.031 INFO:tasks.workunit.client.0.smithi077.stdout:6/663: chown de/d53/ldd 1221270 1 2024-04-25T02:08:52.031 INFO:tasks.workunit.client.0.smithi077.stdout:6/664: truncate de/d53/db2/fc3 251255 0 2024-04-25T02:08:52.031 INFO:tasks.workunit.client.0.smithi077.stdout:7/536: dwrite d4/d13/d18/d24/f3b [0,4194304] 0 2024-04-25T02:08:52.031 INFO:tasks.workunit.client.0.smithi077.stdout:7/537: fdatasync d4/d13/d2c/f92 0 2024-04-25T02:08:52.031 INFO:tasks.workunit.client.0.smithi077.stdout:7/538: write d4/d13/d18/f94 [354004,33650] 0 2024-04-25T02:08:52.032 INFO:tasks.workunit.client.0.smithi077.stdout:5/586: dwrite d0/d2/d3/d9/d39/d44/d80/faa [0,4194304] 0 2024-04-25T02:08:52.033 INFO:tasks.workunit.client.0.smithi077.stdout:0/558: read d2/d8/f13 [3934502,3415] 0 2024-04-25T02:08:52.037 INFO:tasks.workunit.client.0.smithi077.stdout:5/587: rename d0/d2/d20 to d0/d25/d82/d87/d8b/da5/dc4 0 2024-04-25T02:08:52.038 INFO:tasks.workunit.client.0.smithi077.stdout:0/559: creat d2/d17/d1d/fbf x:0 0 0 2024-04-25T02:08:52.039 INFO:tasks.workunit.client.0.smithi077.stdout:8/609: dwrite d3/f2a [0,4194304] 0 2024-04-25T02:08:52.039 INFO:tasks.workunit.client.0.smithi077.stdout:0/560: symlink d2/d17/d1d/db1/lc0 0 2024-04-25T02:08:52.042 INFO:tasks.workunit.client.0.smithi077.stdout:8/610: mknod d3/da/d27/d16/d57/cba 0 2024-04-25T02:08:52.044 INFO:tasks.workunit.client.0.smithi077.stdout:9/609: dwrite df/d1b/d56/d67/f78 [0,4194304] 0 2024-04-25T02:08:52.046 INFO:tasks.workunit.client.0.smithi077.stdout:6/665: dread de/d12/f1c [0,4194304] 0 2024-04-25T02:08:52.047 INFO:tasks.workunit.client.0.smithi077.stdout:6/666: readlink de/d12/d25/d3a/d6a/l6d 0 2024-04-25T02:08:52.047 INFO:tasks.workunit.client.0.smithi077.stdout:6/667: fsync de/d55/d88/fca 0 2024-04-25T02:08:52.047 INFO:tasks.workunit.client.0.smithi077.stdout:6/668: dread - de/d12/d25/d44/fc7 zero size 2024-04-25T02:08:52.047 INFO:tasks.workunit.client.0.smithi077.stdout:6/669: stat de/d95/l98 0 2024-04-25T02:08:52.048 INFO:tasks.workunit.client.0.smithi077.stdout:2/538: dwrite d2/d9/f8c [0,4194304] 0 2024-04-25T02:08:52.048 INFO:tasks.workunit.client.0.smithi077.stdout:2/539: creat d2/d78/fac x:0 0 0 2024-04-25T02:08:52.048 INFO:tasks.workunit.client.0.smithi077.stdout:0/561: symlink d2/d17/d1d/d34/d4c/da2/dae/lc1 0 2024-04-25T02:08:52.048 INFO:tasks.workunit.client.0.smithi077.stdout:0/562: creat d2/d8/d5f/fc2 x:0 0 0 2024-04-25T02:08:52.049 INFO:tasks.workunit.client.0.smithi077.stdout:8/611: creat d3/d7a/fbb x:0 0 0 2024-04-25T02:08:52.052 INFO:tasks.workunit.client.0.smithi077.stdout:1/544: dwrite db/df/d14/d3e/d69/fa0 [0,4194304] 0 2024-04-25T02:08:52.052 INFO:tasks.workunit.client.0.smithi077.stdout:7/539: dread d4/d13/d5b/f64 [0,4194304] 0 2024-04-25T02:08:52.053 INFO:tasks.workunit.client.0.smithi077.stdout:4/582: dwrite d0/d14/d21/f22 [4194304,4194304] 0 2024-04-25T02:08:52.053 INFO:tasks.workunit.client.0.smithi077.stdout:9/610: mkdir df/d1b/d70/dc9 0 2024-04-25T02:08:52.056 INFO:tasks.workunit.client.0.smithi077.stdout:7/540: write d4/d13/d18/d24/d3f/d58/f2b [7631,15380] 0 2024-04-25T02:08:52.056 INFO:tasks.workunit.client.0.smithi077.stdout:7/541: write d4/d13/f2f [2008931,42724] 0 2024-04-25T02:08:52.056 INFO:tasks.workunit.client.0.smithi077.stdout:7/542: write d4/d13/d5b/d8b/fb5 [845806,4011] 0 2024-04-25T02:08:52.056 INFO:tasks.workunit.client.0.smithi077.stdout:7/543: creat d4/d13/d5b/d8b/fb9 x:0 0 0 2024-04-25T02:08:52.056 INFO:tasks.workunit.client.0.smithi077.stdout:7/544: chown d4/d13/d66 85215039 1 2024-04-25T02:08:52.056 INFO:tasks.workunit.client.0.smithi077.stdout:2/540: mkdir d2/d9/d18/d31/d7c/d89/dad 0 2024-04-25T02:08:52.056 INFO:tasks.workunit.client.0.smithi077.stdout:2/541: truncate d2/d28/f93 377297 0 2024-04-25T02:08:52.057 INFO:tasks.workunit.client.0.smithi077.stdout:1/545: dread db/df/d1b/f22 [0,4194304] 0 2024-04-25T02:08:52.060 INFO:tasks.workunit.client.0.smithi077.stdout:0/563: getdents d2/d17/d1d/d34/d4c/da2 0 2024-04-25T02:08:52.062 INFO:tasks.workunit.client.0.smithi077.stdout:8/612: getdents d3/da/db/df 0 2024-04-25T02:08:52.067 INFO:tasks.workunit.client.0.smithi077.stdout:4/583: unlink d0/d14/f1c 0 2024-04-25T02:08:52.069 INFO:tasks.workunit.client.0.smithi077.stdout:6/670: dwrite de/d55/d88/fca [0,4194304] 0 2024-04-25T02:08:52.069 INFO:tasks.workunit.client.0.smithi077.stdout:6/671: creat de/d12/d25/d4b/fe4 x:0 0 0 2024-04-25T02:08:52.069 INFO:tasks.workunit.client.0.smithi077.stdout:9/611: mkdir df/d60/d87/dca 0 2024-04-25T02:08:52.070 INFO:tasks.workunit.client.0.smithi077.stdout:9/612: chown df/d1b/d70/c8f 1911806626 1 2024-04-25T02:08:52.070 INFO:tasks.workunit.client.0.smithi077.stdout:5/588: dwrite d0/d2/d3/d1d/f33 [4194304,4194304] 0 2024-04-25T02:08:52.074 INFO:tasks.workunit.client.0.smithi077.stdout:2/542: creat d2/d9/d19/d1c/d3f/fae x:0 0 0 2024-04-25T02:08:52.075 INFO:tasks.workunit.client.0.smithi077.stdout:2/543: fdatasync d2/d9/d19/f34 0 2024-04-25T02:08:52.078 INFO:tasks.workunit.client.0.smithi077.stdout:1/546: rename db/df/d14/d3e/c98 to db/df/d56/d5d/d77/cb9 0 2024-04-25T02:08:52.083 INFO:tasks.workunit.client.0.smithi077.stdout:6/672: mknod de/d12/d25/d3a/ce5 0 2024-04-25T02:08:52.083 INFO:tasks.workunit.client.0.smithi077.stdout:6/673: chown de/d3b/l80 17 1 2024-04-25T02:08:52.084 INFO:tasks.workunit.client.0.smithi077.stdout:9/613: mknod df/d1b/d48/ccb 0 2024-04-25T02:08:52.087 INFO:tasks.workunit.client.0.smithi077.stdout:2/544: creat d2/faf x:0 0 0 2024-04-25T02:08:52.087 INFO:tasks.workunit.client.0.smithi077.stdout:1/547: stat db/df/d14/d33/d34/l93 0 2024-04-25T02:08:52.090 INFO:tasks.workunit.client.0.smithi077.stdout:6/674: rename de/d12/d25/d3a/fe2 to de/d55/db7/fe6 0 2024-04-25T02:08:52.090 INFO:tasks.workunit.client.0.smithi077.stdout:0/564: dwrite d2/d17/d1d/d34/d4c/fa0 [0,4194304] 0 2024-04-25T02:08:52.091 INFO:tasks.workunit.client.0.smithi077.stdout:9/614: symlink df/d60/d87/lcc 0 2024-04-25T02:08:52.091 INFO:tasks.workunit.client.0.smithi077.stdout:9/615: write df/f2f [5739953,33191] 0 2024-04-25T02:08:52.100 INFO:tasks.workunit.client.0.smithi077.stdout:5/589: dwrite d0/d2/d3/d1d/f1f [0,4194304] 0 2024-04-25T02:08:52.100 INFO:tasks.workunit.client.0.smithi077.stdout:5/590: truncate d0/d2/d3/d9/d39/d3c/f91 395748 0 2024-04-25T02:08:52.100 INFO:tasks.workunit.client.0.smithi077.stdout:4/584: dwrite d0/d14/f8b [0,4194304] 0 2024-04-25T02:08:52.100 INFO:tasks.workunit.client.0.smithi077.stdout:4/585: chown d0/d14/d21/f26 318931530 1 2024-04-25T02:08:52.100 INFO:tasks.workunit.client.0.smithi077.stdout:8/613: dwrite d3/da/d27/d16/d6b/f9c [0,4194304] 0 2024-04-25T02:08:52.100 INFO:tasks.workunit.client.0.smithi077.stdout:6/675: creat de/d12/d25/d3a/d6a/dcd/fe7 x:0 0 0 2024-04-25T02:08:52.101 INFO:tasks.workunit.client.0.smithi077.stdout:6/676: fdatasync de/d12/d25/d44/fc7 0 2024-04-25T02:08:52.103 INFO:tasks.workunit.client.0.smithi077.stdout:0/565: symlink d2/d17/d1d/d34/d83/lc3 0 2024-04-25T02:08:52.103 INFO:tasks.workunit.client.0.smithi077.stdout:0/566: chown d2/d8/db6/d74 603778 1 2024-04-25T02:08:52.112 INFO:tasks.workunit.client.0.smithi077.stdout:6/677: mkdir de/d3b/de8 0 2024-04-25T02:08:52.112 INFO:tasks.workunit.client.0.smithi077.stdout:6/678: chown de/d55/d88/lcc 10611 1 2024-04-25T02:08:52.116 INFO:tasks.workunit.client.0.smithi077.stdout:0/567: rename d2/d17/d1d/d34/lb9 to d2/d17/d4e/d5e/lc4 0 2024-04-25T02:08:52.116 INFO:tasks.workunit.client.0.smithi077.stdout:0/568: stat d2/l35 0 2024-04-25T02:08:52.116 INFO:tasks.workunit.client.0.smithi077.stdout:0/569: fdatasync d2/d8/f26 0 2024-04-25T02:08:52.116 INFO:tasks.workunit.client.0.smithi077.stdout:0/570: truncate d2/d9/d2a/f7d 5013367 0 2024-04-25T02:08:52.118 INFO:tasks.workunit.client.0.smithi077.stdout:0/571: symlink d2/d17/d1d/d34/lc5 0 2024-04-25T02:08:52.118 INFO:tasks.workunit.client.0.smithi077.stdout:0/572: chown d2/d17/d1d/f3d 193895663 1 2024-04-25T02:08:52.119 INFO:tasks.workunit.client.0.smithi077.stdout:0/573: readlink d2/d17/d1d/l94 0 2024-04-25T02:08:52.119 INFO:tasks.workunit.client.0.smithi077.stdout:8/614: rename d3/da/d27/d16/d57 to d3/da/d27/d16/dbc 0 2024-04-25T02:08:52.121 INFO:tasks.workunit.client.0.smithi077.stdout:0/574: creat d2/d17/d1d/db1/fc6 x:0 0 0 2024-04-25T02:08:52.123 INFO:tasks.workunit.client.0.smithi077.stdout:2/545: dwrite d2/d9/d19/d1c/d3f/d53/f68 [0,4194304] 0 2024-04-25T02:08:52.123 INFO:tasks.workunit.client.0.smithi077.stdout:2/546: chown d2/d59/l61 559 1 2024-04-25T02:08:52.123 INFO:tasks.workunit.client.0.smithi077.stdout:2/547: stat d2/d59/d79 0 2024-04-25T02:08:52.123 INFO:tasks.workunit.client.0.smithi077.stdout:2/548: write d2/d9/f52 [2782997,126688] 0 2024-04-25T02:08:52.124 INFO:tasks.workunit.client.0.smithi077.stdout:8/615: creat d3/da/d27/fbd x:0 0 0 2024-04-25T02:08:52.124 INFO:tasks.workunit.client.0.smithi077.stdout:8/616: creat d3/da/d27/fbe x:0 0 0 2024-04-25T02:08:52.127 INFO:tasks.workunit.client.0.smithi077.stdout:1/548: dwrite db/df/d14/f97 [0,4194304] 0 2024-04-25T02:08:52.127 INFO:tasks.workunit.client.0.smithi077.stdout:1/549: fsync db/df/d14/f97 0 2024-04-25T02:08:52.132 INFO:tasks.workunit.client.0.smithi077.stdout:0/575: dread d2/d17/d1d/f3d [4194304,4194304] 0 2024-04-25T02:08:52.132 INFO:tasks.workunit.client.0.smithi077.stdout:0/576: fsync d2/d17/d1d/d34/d83/f8d 0 2024-04-25T02:08:52.136 INFO:tasks.workunit.client.0.smithi077.stdout:2/549: read d2/f5 [2413123,67553] 0 2024-04-25T02:08:52.137 INFO:tasks.workunit.client.0.smithi077.stdout:2/550: dread - d2/d9/d19/f34 zero size 2024-04-25T02:08:52.137 INFO:tasks.workunit.client.0.smithi077.stdout:1/550: mknod db/df/d14/d33/d34/db4/cba 0 2024-04-25T02:08:52.137 INFO:tasks.workunit.client.0.smithi077.stdout:1/551: fdatasync db/fb0 0 2024-04-25T02:08:52.137 INFO:tasks.workunit.client.0.smithi077.stdout:4/586: dwrite d0/d14/d21/d39/f4d [0,4194304] 0 2024-04-25T02:08:52.137 INFO:tasks.workunit.client.0.smithi077.stdout:5/591: dwrite d0/d25/d82/fa1 [0,4194304] 0 2024-04-25T02:08:52.143 INFO:tasks.workunit.client.0.smithi077.stdout:5/592: truncate d0/d2/d3/d9/d39/d44/f53 1672510 0 2024-04-25T02:08:52.143 INFO:tasks.workunit.client.0.smithi077.stdout:5/593: write d0/d2/d1b/d35/fac [2269837,108203] 0 2024-04-25T02:08:52.145 INFO:tasks.workunit.client.0.smithi077.stdout:6/679: dwrite de/d53/fcf [0,4194304] 0 2024-04-25T02:08:52.145 INFO:tasks.workunit.client.0.smithi077.stdout:6/680: write de/d12/d25/d44/fc7 [634013,126259] 0 2024-04-25T02:08:52.151 INFO:tasks.workunit.client.0.smithi077.stdout:6/681: mkdir de/d12/d25/de9 0 2024-04-25T02:08:52.153 INFO:tasks.workunit.client.0.smithi077.stdout:6/682: rename de/d12/d25/d60/lbf to de/d12/d25/d4b/lea 0 2024-04-25T02:08:52.156 INFO:tasks.workunit.client.0.smithi077.stdout:6/683: rename de/d12/d25/d3a/d6a/dcd/ldc to de/d53/d76/leb 0 2024-04-25T02:08:52.159 INFO:tasks.workunit.client.0.smithi077.stdout:5/594: dread d0/d25/d82/d87/d8b/da5/dc4/d41/f9a [0,4194304] 0 2024-04-25T02:08:52.159 INFO:tasks.workunit.client.0.smithi077.stdout:5/595: write d0/d25/d82/d87/d8b/f8e [600985,58344] 0 2024-04-25T02:08:52.162 INFO:tasks.workunit.client.0.smithi077.stdout:0/577: dwrite d2/d8/f13 [0,4194304] 0 2024-04-25T02:08:52.162 INFO:tasks.workunit.client.0.smithi077.stdout:0/578: dread - d2/d17/d4e/f9b zero size 2024-04-25T02:08:52.167 INFO:tasks.workunit.client.0.smithi077.stdout:1/552: dwrite db/df/d14/d3e/d69/f9e [0,4194304] 0 2024-04-25T02:08:52.170 INFO:tasks.workunit.client.0.smithi077.stdout:1/553: creat db/fbb x:0 0 0 2024-04-25T02:08:52.170 INFO:tasks.workunit.client.0.smithi077.stdout:1/554: chown db/df/d14/d4d/d82/d32/d8f 1 1 2024-04-25T02:08:52.171 INFO:tasks.workunit.client.0.smithi077.stdout:2/551: dwrite d2/d9/f67 [0,4194304] 0 2024-04-25T02:08:52.171 INFO:tasks.workunit.client.0.smithi077.stdout:1/555: creat db/df/d14/d4d/d82/d32/d8f/fbc x:0 0 0 2024-04-25T02:08:52.174 INFO:tasks.workunit.client.0.smithi077.stdout:2/552: mknod d2/d9/cb0 0 2024-04-25T02:08:52.174 INFO:tasks.workunit.client.0.smithi077.stdout:2/553: readlink d2/d9/d19/l2d 0 2024-04-25T02:08:52.174 INFO:tasks.workunit.client.0.smithi077.stdout:2/554: chown d2/d78 111817717 1 2024-04-25T02:08:52.176 INFO:tasks.workunit.client.0.smithi077.stdout:2/555: symlink d2/d9/d19/lb1 0 2024-04-25T02:08:52.178 INFO:tasks.workunit.client.0.smithi077.stdout:2/556: creat d2/d9/d18/d31/d7c/dab/fb2 x:0 0 0 2024-04-25T02:08:52.180 INFO:tasks.workunit.client.0.smithi077.stdout:2/557: mkdir d2/d9/d19/d1c/d3f/d53/d86/db3 0 2024-04-25T02:08:52.181 INFO:tasks.workunit.client.0.smithi077.stdout:3/538: sync 2024-04-25T02:08:52.181 INFO:tasks.workunit.client.0.smithi077.stdout:2/558: mkdir d2/d59/d79/db4 0 2024-04-25T02:08:52.183 INFO:tasks.workunit.client.0.smithi077.stdout:3/539: mknod d0/d17/cc1 0 2024-04-25T02:08:52.185 INFO:tasks.workunit.client.0.smithi077.stdout:9/616: dwrite df/d1b/f22 [0,4194304] 0 2024-04-25T02:08:52.185 INFO:tasks.workunit.client.0.smithi077.stdout:2/559: unlink d2/d9/f52 0 2024-04-25T02:08:52.188 INFO:tasks.workunit.client.0.smithi077.stdout:9/617: truncate df/f6b 3070865 0 2024-04-25T02:08:52.188 INFO:tasks.workunit.client.0.smithi077.stdout:9/618: dread - df/d1b/d70/d74/f95 zero size 2024-04-25T02:08:52.189 INFO:tasks.workunit.client.0.smithi077.stdout:0/579: dwrite d2/d17/d4e/fb0 [0,4194304] 0 2024-04-25T02:08:52.190 INFO:tasks.workunit.client.0.smithi077.stdout:6/684: dwrite de/d12/d25/f83 [0,4194304] 0 2024-04-25T02:08:52.190 INFO:tasks.workunit.client.0.smithi077.stdout:6/685: truncate de/d12/d25/f40 1095458 0 2024-04-25T02:08:52.195 INFO:tasks.workunit.client.0.smithi077.stdout:2/560: write d2/d9/d18/d31/f4b [3678469,1039] 0 2024-04-25T02:08:52.195 INFO:tasks.workunit.client.0.smithi077.stdout:2/561: write d2/d9/d18/d31/f4b [625408,35165] 0 2024-04-25T02:08:52.198 INFO:tasks.workunit.client.0.smithi077.stdout:0/580: mknod d2/d8/d5f/cc7 0 2024-04-25T02:08:52.200 INFO:tasks.workunit.client.0.smithi077.stdout:1/556: truncate db/df/d14/d3e/d69/f9e 2629154 0 2024-04-25T02:08:52.201 INFO:tasks.workunit.client.0.smithi077.stdout:6/686: symlink de/d12/d25/d3a/lec 0 2024-04-25T02:08:52.203 INFO:tasks.workunit.client.0.smithi077.stdout:2/562: unlink d2/d28/f32 0 2024-04-25T02:08:52.204 INFO:tasks.workunit.client.0.smithi077.stdout:0/581: symlink d2/d27/d2d/lc8 0 2024-04-25T02:08:52.204 INFO:tasks.workunit.client.0.smithi077.stdout:0/582: write d2/f4b [2833971,89583] 0 2024-04-25T02:08:52.204 INFO:tasks.workunit.client.0.smithi077.stdout:0/583: getdents d2/d17/d1d/d34/d4c/da2 0 2024-04-25T02:08:52.205 INFO:tasks.workunit.client.0.smithi077.stdout:1/557: link db/df/d14/d4d/d82/ca4 db/df/d56/d5d/d77/db3/cbd 0 2024-04-25T02:08:52.208 INFO:tasks.workunit.client.0.smithi077.stdout:3/540: dwrite d0/f1f [0,4194304] 0 2024-04-25T02:08:52.208 INFO:tasks.workunit.client.0.smithi077.stdout:2/563: truncate d2/d9/f8c 924379 0 2024-04-25T02:08:52.208 INFO:tasks.workunit.client.0.smithi077.stdout:9/619: dwrite df/d1b/d56/d67/f8e [4194304,4194304] 0 2024-04-25T02:08:52.209 INFO:tasks.workunit.client.0.smithi077.stdout:0/584: rename d2/d17/d1d/c47 to d2/d17/d1d/db1/cc9 0 2024-04-25T02:08:52.209 INFO:tasks.workunit.client.0.smithi077.stdout:0/585: chown d2/d17/c25 962688909 1 2024-04-25T02:08:52.213 INFO:tasks.workunit.client.0.smithi077.stdout:1/558: symlink db/df/d14/d50/lbe 0 2024-04-25T02:08:52.213 INFO:tasks.workunit.client.0.smithi077.stdout:1/559: write db/df/d14/d4d/d82/f7a [2269760,124726] 0 2024-04-25T02:08:52.213 INFO:tasks.workunit.client.0.smithi077.stdout:1/560: stat db/df/d14/f67 0 2024-04-25T02:08:52.213 INFO:tasks.workunit.client.0.smithi077.stdout:1/561: dread - db/d26/f73 zero size 2024-04-25T02:08:52.214 INFO:tasks.workunit.client.0.smithi077.stdout:1/562: truncate db/df/d14/d3e/d69/faf 1006999 0 2024-04-25T02:08:52.214 INFO:tasks.workunit.client.0.smithi077.stdout:6/687: rmdir de/d5b 39 2024-04-25T02:08:52.214 INFO:tasks.workunit.client.0.smithi077.stdout:6/688: stat de/d5b/da6/fad 0 2024-04-25T02:08:52.214 INFO:tasks.workunit.client.0.smithi077.stdout:6/689: readlink de/d12/d25/d3a/d6a/dcd/l18 0 2024-04-25T02:08:52.214 INFO:tasks.workunit.client.0.smithi077.stdout:6/690: write de/d12/d25/f2d [3374550,9067] 0 2024-04-25T02:08:52.215 INFO:tasks.workunit.client.0.smithi077.stdout:3/541: mkdir d0/d17/d4b/d59/dc2 0 2024-04-25T02:08:52.215 INFO:tasks.workunit.client.0.smithi077.stdout:3/542: fsync d0/d2/d2f/d50/f96 0 2024-04-25T02:08:52.215 INFO:tasks.workunit.client.0.smithi077.stdout:1/563: dread db/f18 [0,4194304] 0 2024-04-25T02:08:52.215 INFO:tasks.workunit.client.0.smithi077.stdout:1/564: truncate db/df/d14/d4d/d82/d5c/f5e 1182517 0 2024-04-25T02:08:52.217 INFO:tasks.workunit.client.0.smithi077.stdout:2/564: link d2/d9/d18/d31/l49 d2/d9/d56/d5c/lb5 0 2024-04-25T02:08:52.218 INFO:tasks.workunit.client.0.smithi077.stdout:2/565: chown d2/d9/df/c5e 370 1 2024-04-25T02:08:52.219 INFO:tasks.workunit.client.0.smithi077.stdout:6/691: dread de/f5a [0,4194304] 0 2024-04-25T02:08:52.219 INFO:tasks.workunit.client.0.smithi077.stdout:6/692: write de/d12/f2a [2447399,13072] 0 2024-04-25T02:08:52.219 INFO:tasks.workunit.client.0.smithi077.stdout:6/693: creat de/d12/d25/d3a/d6a/dcd/fed x:0 0 0 2024-04-25T02:08:52.219 INFO:tasks.workunit.client.0.smithi077.stdout:6/694: truncate de/d55/db7/fd3 588530 0 2024-04-25T02:08:52.220 INFO:tasks.workunit.client.0.smithi077.stdout:6/695: dread - de/d12/d25/d38/f75 zero size 2024-04-25T02:08:52.220 INFO:tasks.workunit.client.0.smithi077.stdout:6/696: chown de/d12/dba 240238853 1 2024-04-25T02:08:52.220 INFO:tasks.workunit.client.0.smithi077.stdout:6/697: chown de/d12/d25/d3a/d6a/dcd/d36/dd2/l8e 9997 1 2024-04-25T02:08:52.221 INFO:tasks.workunit.client.0.smithi077.stdout:2/566: dread d2/d9/d56/d5c/f66 [0,4194304] 0 2024-04-25T02:08:52.223 INFO:tasks.workunit.client.0.smithi077.stdout:3/543: mkdir d0/d3e/dc3 0 2024-04-25T02:08:52.224 INFO:tasks.workunit.client.0.smithi077.stdout:1/565: symlink db/df/d56/d5d/d77/lbf 0 2024-04-25T02:08:52.228 INFO:tasks.workunit.client.0.smithi077.stdout:3/544: mknod d0/d2/de/d48/cc4 0 2024-04-25T02:08:52.230 INFO:tasks.workunit.client.0.smithi077.stdout:1/566: dread db/df/d1b/f22 [0,4194304] 0 2024-04-25T02:08:52.231 INFO:tasks.workunit.client.0.smithi077.stdout:3/545: mkdir d0/dc5 0 2024-04-25T02:08:52.231 INFO:tasks.workunit.client.0.smithi077.stdout:3/546: chown d0/d17/d4b/d59/cb1 126 1 2024-04-25T02:08:52.234 INFO:tasks.workunit.client.0.smithi077.stdout:3/547: dread d0/d17/d4b/d59/f8e [0,4194304] 0 2024-04-25T02:08:52.234 INFO:tasks.workunit.client.0.smithi077.stdout:3/548: chown d0/d3e/d42/d64/d88/f9e 4408399 1 2024-04-25T02:08:52.235 INFO:tasks.workunit.client.0.smithi077.stdout:1/567: rename db/c9b to db/df/d14/cc0 0 2024-04-25T02:08:52.235 INFO:tasks.workunit.client.0.smithi077.stdout:1/568: dread - db/fbb zero size 2024-04-25T02:08:52.237 INFO:tasks.workunit.client.0.smithi077.stdout:3/549: creat d0/d2/de/d36/da6/fc6 x:0 0 0 2024-04-25T02:08:52.241 INFO:tasks.workunit.client.0.smithi077.stdout:3/550: rename d0/d2/de/d48/f3d to d0/d2/de/fc7 0 2024-04-25T02:08:52.241 INFO:tasks.workunit.client.0.smithi077.stdout:3/551: read - d0/d3e/d62/faf zero size 2024-04-25T02:08:52.241 INFO:tasks.workunit.client.0.smithi077.stdout:3/552: readlink d0/d2/de/d36/l98 0 2024-04-25T02:08:52.243 INFO:tasks.workunit.client.0.smithi077.stdout:1/569: unlink db/df/d14/c1f 0 2024-04-25T02:08:52.243 INFO:tasks.workunit.client.0.smithi077.stdout:1/570: chown db/df/d14/d4d/d82/f39 3 1 2024-04-25T02:08:52.243 INFO:tasks.workunit.client.0.smithi077.stdout:1/571: stat db/c4e 0 2024-04-25T02:08:52.243 INFO:tasks.workunit.client.0.smithi077.stdout:1/572: fdatasync db/df/d14/d4d/d82/d5c/f6a 0 2024-04-25T02:08:52.245 INFO:tasks.workunit.client.0.smithi077.stdout:3/553: rename d0/d3e/d42/d64/f72 to d0/d2/fc8 0 2024-04-25T02:08:52.247 INFO:tasks.workunit.client.0.smithi077.stdout:1/573: rename db/df/d14/d4d/d82/d42/d43/l95 to db/df/d14/d3e/daa/lc1 0 2024-04-25T02:08:52.247 INFO:tasks.workunit.client.0.smithi077.stdout:1/574: fsync db/df/d14/d3e/f54 0 2024-04-25T02:08:52.247 INFO:tasks.workunit.client.0.smithi077.stdout:2/567: dwrite d2/d9/d19/d1c/d3f/d53/fa3 [0,4194304] 0 2024-04-25T02:08:52.247 INFO:tasks.workunit.client.0.smithi077.stdout:0/586: dwrite d2/d8/dad/fba [0,4194304] 0 2024-04-25T02:08:52.247 INFO:tasks.workunit.client.0.smithi077.stdout:6/698: dwrite de/d12/d25/d38/f75 [0,4194304] 0 2024-04-25T02:08:52.249 INFO:tasks.workunit.client.0.smithi077.stdout:3/554: unlink d0/d2/d2f/d50/f96 0 2024-04-25T02:08:52.249 INFO:tasks.workunit.client.0.smithi077.stdout:6/699: dread de/d55/d88/f8b [0,4194304] 0 2024-04-25T02:08:52.250 INFO:tasks.workunit.client.0.smithi077.stdout:1/575: symlink db/df/d14/d33/d6c/lc2 0 2024-04-25T02:08:52.254 INFO:tasks.workunit.client.0.smithi077.stdout:0/587: link d2/d17/d4e/fb0 d2/d27/d2d/fca 0 2024-04-25T02:08:52.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.250+0000 7f204a51e700 1 -- 172.21.15.77:0/3549139199 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2044107ac0 con 0x7f2044070830 2024-04-25T02:08:52.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.251+0000 7f2040ff9700 1 -- 172.21.15.77:0/3549139199 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f2038056800 con 0x7f2044070830 2024-04-25T02:08:52.258 INFO:tasks.workunit.client.0.smithi077.stdout:6/700: write f1 [3476679,47976] 0 2024-04-25T02:08:52.259 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:08:52.259 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-04-25T02:08:52.259 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2 2024-04-25T02:08:52.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:08:52.259 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-04-25T02:08:52.259 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2 2024-04-25T02:08:52.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:08:52.259 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-04-25T02:08:52.259 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 6 2024-04-25T02:08:52.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:08:52.259 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-04-25T02:08:52.259 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T02:08:52.260 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:08:52.260 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-04-25T02:08:52.260 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 14 2024-04-25T02:08:52.260 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-25T02:08:52.260 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:08:52.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.255+0000 7f204a51e700 1 -- 172.21.15.77:0/3549139199 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f202c0692a0 msgr2=0x7f202c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:52.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.255+0000 7f204a51e700 1 --2- 172.21.15.77:0/3549139199 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f202c0692a0 0x7f202c06b750 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f203400b970 tx=0x7f2034009e30 comp rx=0 tx=0).stop 2024-04-25T02:08:52.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.255+0000 7f204a51e700 1 -- 172.21.15.77:0/3549139199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2044070830 msgr2=0x7f204410fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:52.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.255+0000 7f204a51e700 1 --2- 172.21.15.77:0/3549139199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2044070830 0x7f204410fb10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2038002a80 tx=0x7f2038004600 comp rx=0 tx=0).stop 2024-04-25T02:08:52.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.255+0000 7f204a51e700 1 -- 172.21.15.77:0/3549139199 shutdown_connections 2024-04-25T02:08:52.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.255+0000 7f204a51e700 1 --2- 172.21.15.77:0/3549139199 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7f202c0692a0 0x7f202c06b750 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.255+0000 7f204a51e700 1 --2- 172.21.15.77:0/3549139199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2044070830 0x7f204410fb10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.255+0000 7f204a51e700 1 --2- 172.21.15.77:0/3549139199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2044071de0 0x7f2044110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.255+0000 7f204a51e700 1 -- 172.21.15.77:0/3549139199 >> 172.21.15.77:0/3549139199 conn(0x7f20440f8540 msgr2=0x7f20440f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:52.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.255+0000 7f204a51e700 1 -- 172.21.15.77:0/3549139199 shutdown_connections 2024-04-25T02:08:52.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.255+0000 7f204a51e700 1 -- 172.21.15.77:0/3549139199 wait complete. 2024-04-25T02:08:52.265 INFO:tasks.workunit.client.0.smithi077.stdout:1/576: mkdir db/df/d56/dc3 0 2024-04-25T02:08:52.265 INFO:tasks.workunit.client.0.smithi077.stdout:1/577: write db/df/d14/d4d/d82/d42/f7c [531757,45295] 0 2024-04-25T02:08:52.266 INFO:tasks.workunit.client.0.smithi077.stdout:3/555: creat d0/d2/de/d27/fc9 x:0 0 0 2024-04-25T02:08:52.268 INFO:tasks.workunit.client.0.smithi077.stdout:0/588: symlink d2/lcb 0 2024-04-25T02:08:52.270 INFO:tasks.workunit.client.0.smithi077.stdout:6/701: rmdir de/d53/db2 39 2024-04-25T02:08:52.273 INFO:tasks.workunit.client.0.smithi077.stdout:1/578: rename db/df/d14/d4d/d82/d32/l49 to db/df/d56/d5d/d77/db3/lc4 0 2024-04-25T02:08:52.273 INFO:tasks.workunit.client.0.smithi077.stdout:1/579: dread - db/d26/f73 zero size 2024-04-25T02:08:52.274 INFO:tasks.workunit.client.0.smithi077.stdout:3/556: truncate d0/d2/de/d48/d15/f2a 3758914 0 2024-04-25T02:08:52.275 INFO:tasks.workunit.client.0.smithi077.stdout:2/568: dwrite d2/d9/d19/f1a [4194304,4194304] 0 2024-04-25T02:08:52.276 INFO:tasks.workunit.client.0.smithi077.stdout:6/702: rename de/d12/d25/d3a/d6a/dcd/fe7 to de/d12/d25/d4b/fee 0 2024-04-25T02:08:52.277 INFO:tasks.workunit.client.0.smithi077.stdout:1/580: creat db/df/d14/d4d/d82/d5c/fc5 x:0 0 0 2024-04-25T02:08:52.279 INFO:tasks.workunit.client.0.smithi077.stdout:0/589: read d2/d8/f13 [571574,127982] 0 2024-04-25T02:08:52.280 INFO:tasks.workunit.client.0.smithi077.stdout:6/703: creat de/d12/d25/d3a/d6a/fef x:0 0 0 2024-04-25T02:08:52.280 INFO:tasks.workunit.client.0.smithi077.stdout:6/704: fsync de/d53/d76/f90 0 2024-04-25T02:08:52.280 INFO:tasks.workunit.client.0.smithi077.stdout:6/705: write de/d55/d88/fc0 [1712171,75001] 0 2024-04-25T02:08:52.280 INFO:tasks.workunit.client.0.smithi077.stdout:6/706: read de/f13 [588343,36990] 0 2024-04-25T02:08:52.284 INFO:tasks.workunit.client.0.smithi077.stdout:0/590: creat d2/d17/d1d/d34/fcc x:0 0 0 2024-04-25T02:08:52.285 INFO:tasks.workunit.client.0.smithi077.stdout:6/707: mknod de/d12/d25/d38/cf0 0 2024-04-25T02:08:52.285 INFO:tasks.workunit.client.0.smithi077.stdout:6/708: chown de/d12/d25/d3a/d6a/dcd/l7d 1662088 1 2024-04-25T02:08:52.297 INFO:tasks.workunit.client.0.smithi077.stdout:0/591: dread d2/d17/d1d/d34/d4c/da2/f45 [0,4194304] 0 2024-04-25T02:08:52.299 INFO:tasks.workunit.client.0.smithi077.stdout:0/592: rmdir d2/d9/d2a/db2 0 2024-04-25T02:08:52.299 INFO:tasks.workunit.client.0.smithi077.stdout:0/593: truncate d2/d17/f61 5171144 0 2024-04-25T02:08:52.299 INFO:tasks.workunit.client.0.smithi077.stdout:0/594: chown d2/d17/d4e/d5e/lc4 88 1 2024-04-25T02:08:52.299 INFO:tasks.workunit.client.0.smithi077.stdout:0/595: fdatasync d2/f82 0 2024-04-25T02:08:52.299 INFO:tasks.workunit.client.0.smithi077.stdout:0/596: mknod d2/d17/d1d/d34/d4c/da2/ccd 0 2024-04-25T02:08:52.300 INFO:tasks.workunit.client.0.smithi077.stdout:0/597: mkdir d2/d27/d2d/dce 0 2024-04-25T02:08:52.300 INFO:tasks.workunit.client.0.smithi077.stdout:0/598: chown d2/d17/d1d/d34/d4c/da2/c5d 0 1 2024-04-25T02:08:52.301 INFO:tasks.workunit.client.0.smithi077.stdout:0/599: unlink d2/d17/d1d/d34/d4c/da2/d51/f6a 0 2024-04-25T02:08:52.302 INFO:tasks.workunit.client.0.smithi077.stdout:0/600: rmdir d2/d17/d4e/d5e 39 2024-04-25T02:08:52.302 INFO:tasks.workunit.client.0.smithi077.stdout:0/601: dread - d2/d17/d4e/f9b zero size 2024-04-25T02:08:52.302 INFO:tasks.workunit.client.0.smithi077.stdout:0/602: write d2/d17/d4e/f9b [24502,126057] 0 2024-04-25T02:08:52.303 INFO:tasks.workunit.client.0.smithi077.stdout:7/545: sync 2024-04-25T02:08:52.303 INFO:tasks.workunit.client.0.smithi077.stdout:7/546: creat d4/d13/da9/fba x:0 0 0 2024-04-25T02:08:52.303 INFO:tasks.workunit.client.0.smithi077.stdout:7/547: chown d4/d13/d18/d2d/d30/f55 20396 1 2024-04-25T02:08:52.305 INFO:tasks.workunit.client.0.smithi077.stdout:0/603: read d2/d17/d1d/d34/d4c/da2/f45 [7328,61215] 0 2024-04-25T02:08:52.305 INFO:tasks.workunit.client.0.smithi077.stdout:0/604: chown d2/d8/db6/d74/f91 879427 1 2024-04-25T02:08:52.312 INFO:tasks.workunit.client.0.smithi077.stdout:6/709: dwrite de/d12/f71 [0,4194304] 0 2024-04-25T02:08:52.315 INFO:tasks.workunit.client.0.smithi077.stdout:3/557: dwrite d0/d3e/d93/fa5 [0,4194304] 0 2024-04-25T02:08:52.316 INFO:tasks.workunit.client.0.smithi077.stdout:3/558: write d0/d2/de/d36/da6/fc6 [98884,68367] 0 2024-04-25T02:08:52.318 INFO:tasks.workunit.client.0.smithi077.stdout:3/559: dread d0/d2/f34 [0,4194304] 0 2024-04-25T02:08:52.318 INFO:tasks.workunit.client.0.smithi077.stdout:2/569: dwrite d2/d59/d79/f9f [0,4194304] 0 2024-04-25T02:08:52.319 INFO:tasks.workunit.client.0.smithi077.stdout:1/581: dwrite db/df/d14/d4d/d82/f39 [0,4194304] 0 2024-04-25T02:08:52.321 INFO:tasks.workunit.client.0.smithi077.stdout:2/570: link d2/d9/d19/d2c/d72/l92 d2/d9/d2f/d84/da6/lb6 0 2024-04-25T02:08:52.323 INFO:tasks.workunit.client.0.smithi077.stdout:3/560: dread d0/d2/de/d48/f44 [0,4194304] 0 2024-04-25T02:08:52.324 INFO:tasks.workunit.client.0.smithi077.stdout:1/582: creat db/df/d56/dc3/fc6 x:0 0 0 2024-04-25T02:08:52.326 INFO:tasks.workunit.client.0.smithi077.stdout:0/605: dwrite d2/d17/d1d/d34/d4c/f9a [0,4194304] 0 2024-04-25T02:08:52.326 INFO:tasks.workunit.client.0.smithi077.stdout:2/571: unlink d2/d59/f60 0 2024-04-25T02:08:52.326 INFO:tasks.workunit.client.0.smithi077.stdout:6/710: write de/d95/fab [2217110,28085] 0 2024-04-25T02:08:52.326 INFO:tasks.workunit.client.0.smithi077.stdout:6/711: truncate de/d12/d25/f31 2468450 0 2024-04-25T02:08:52.326 INFO:tasks.workunit.client.0.smithi077.stdout:6/712: readlink de/d53/d76/l94 0 2024-04-25T02:08:52.328 INFO:tasks.workunit.client.0.smithi077.stdout:3/561: creat d0/d2/de/d48/fca x:0 0 0 2024-04-25T02:08:52.329 INFO:tasks.workunit.client.0.smithi077.stdout:1/583: symlink db/df/d14/d33/d34/db4/lc7 0 2024-04-25T02:08:52.331 INFO:tasks.workunit.client.0.smithi077.stdout:0/606: creat d2/d17/d1d/d34/d4c/da2/d51/fcf x:0 0 0 2024-04-25T02:08:52.334 INFO:tasks.workunit.client.0.smithi077.stdout:6/713: mknod de/d12/d25/d3a/d6a/dcd/cf1 0 2024-04-25T02:08:52.335 INFO:tasks.workunit.client.0.smithi077.stdout:3/562: rename d0/d2/de/d36/l98 to d0/d17/d4b/d59/dc2/lcb 0 2024-04-25T02:08:52.338 INFO:tasks.workunit.client.0.smithi077.stdout:1/584: symlink db/df/d14/d3e/daa/lc8 0 2024-04-25T02:08:52.339 INFO:tasks.workunit.client.0.smithi077.stdout:0/607: creat d2/d8/fd0 x:0 0 0 2024-04-25T02:08:52.341 INFO:tasks.workunit.client.0.smithi077.stdout:6/714: link de/d12/d25/d3a/d6a/dcd/d36/c93 de/d12/d25/d4b/cf2 0 2024-04-25T02:08:52.341 INFO:tasks.workunit.client.0.smithi077.stdout:6/715: fdatasync de/d12/d25/d3a/d6a/dcd/d36/f56 0 2024-04-25T02:08:52.343 INFO:tasks.workunit.client.0.smithi077.stdout:3/563: truncate d0/d2/de/d48/f2c 2140326 0 2024-04-25T02:08:52.347 INFO:tasks.workunit.client.0.smithi077.stdout:2/572: dwrite d2/d9/f17 [0,4194304] 0 2024-04-25T02:08:52.347 INFO:tasks.workunit.client.0.smithi077.stdout:0/608: symlink d2/d9/ld1 0 2024-04-25T02:08:52.349 INFO:tasks.workunit.client.0.smithi077.stdout:6/716: rename de/f5a to de/d53/d78/ff3 0 2024-04-25T02:08:52.350 INFO:tasks.workunit.client.0.smithi077.stdout:3/564: symlink d0/d2/d83/lcc 0 2024-04-25T02:08:52.351 INFO:tasks.workunit.client.0.smithi077.stdout:1/585: dread db/df/d14/d4d/d82/d32/f3f [0,4194304] 0 2024-04-25T02:08:52.351 INFO:tasks.workunit.client.0.smithi077.stdout:1/586: truncate db/df/d14/d50/f71 467684 0 2024-04-25T02:08:52.352 INFO:tasks.workunit.client.0.smithi077.stdout:2/573: symlink d2/d9/d19/lb7 0 2024-04-25T02:08:52.353 INFO:tasks.workunit.client.0.smithi077.stdout:0/609: truncate d2/d17/d1d/d34/f36 3364994 0 2024-04-25T02:08:52.354 INFO:tasks.workunit.client.0.smithi077.stdout:6/717: mkdir de/df4 0 2024-04-25T02:08:52.355 INFO:tasks.workunit.client.0.smithi077.stdout:6/718: write de/d12/d25/d3a/d6a/dcd/d36/fa2 [1023393,84388] 0 2024-04-25T02:08:52.356 INFO:tasks.workunit.client.0.smithi077.stdout:1/587: readlink db/l35 0 2024-04-25T02:08:52.356 INFO:tasks.workunit.client.0.smithi077.stdout:1/588: chown db/d26 15 1 2024-04-25T02:08:52.359 INFO:tasks.workunit.client.0.smithi077.stdout:2/574: link d2/d9/d19/d1c/d3f/d53/d86/la8 d2/d78/lb8 0 2024-04-25T02:08:52.361 INFO:tasks.workunit.client.0.smithi077.stdout:1/589: mknod db/df/d14/d3e/daa/cc9 0 2024-04-25T02:08:52.365 INFO:tasks.workunit.client.0.smithi077.stdout:2/575: link d2/d9/d19/d1c/d3f/d53/f8a d2/d9/d18/fb9 0 2024-04-25T02:08:52.367 INFO:tasks.workunit.client.0.smithi077.stdout:3/565: dwrite d0/d40/f57 [0,4194304] 0 2024-04-25T02:08:52.367 INFO:tasks.workunit.client.0.smithi077.stdout:3/566: getdents d0/d2/d2f/d50/d5c 0 2024-04-25T02:08:52.368 INFO:tasks.workunit.client.0.smithi077.stdout:2/576: creat d2/d9/d18/d31/d7c/d89/dad/fba x:0 0 0 2024-04-25T02:08:52.371 INFO:tasks.workunit.client.0.smithi077.stdout:1/590: symlink db/df/d14/lca 0 2024-04-25T02:08:52.372 INFO:tasks.workunit.client.0.smithi077.stdout:8/617: sync 2024-04-25T02:08:52.372 INFO:tasks.workunit.client.0.smithi077.stdout:8/618: fdatasync d3/da/f35 0 2024-04-25T02:08:52.373 INFO:tasks.workunit.client.0.smithi077.stdout:4/587: sync 2024-04-25T02:08:52.373 INFO:tasks.workunit.client.0.smithi077.stdout:1/591: dread db/df/d56/d5d/d77/f8d [0,4194304] 0 2024-04-25T02:08:52.375 INFO:tasks.workunit.client.0.smithi077.stdout:2/577: mkdir d2/d9/d18/d31/d7c/d89/dbb 0 2024-04-25T02:08:52.375 INFO:tasks.workunit.client.0.smithi077.stdout:8/619: symlink d3/da/db/df/d2b/lbf 0 2024-04-25T02:08:52.378 INFO:tasks.workunit.client.0.smithi077.stdout:6/719: dwrite de/d12/f7a [0,4194304] 0 2024-04-25T02:08:52.386 INFO:tasks.workunit.client.0.smithi077.stdout:2/578: dread d2/d9/f6a [0,4194304] 0 2024-04-25T02:08:52.387 INFO:tasks.workunit.client.0.smithi077.stdout:2/579: write d2/f5 [1351317,80102] 0 2024-04-25T02:08:52.405 INFO:tasks.workunit.client.0.smithi077.stdout:2/580: dread d2/d9/d19/d1c/d3f/f40 [0,4194304] 0 2024-04-25T02:08:52.406 INFO:tasks.workunit.client.0.smithi077.stdout:2/581: link d2/d9/d19/d1c/d3f/d53/f68 d2/d9/d2f/d84/da6/fbc 0 2024-04-25T02:08:52.406 INFO:tasks.workunit.client.0.smithi077.stdout:2/582: dread - d2/d9/d18/d31/f8d zero size 2024-04-25T02:08:52.406 INFO:tasks.workunit.client.0.smithi077.stdout:2/583: dread - d2/d9/d18/d31/d7c/fa1 zero size 2024-04-25T02:08:52.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.403+0000 7fa432b2b700 1 -- 172.21.15.77:0/1880289152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa42c102340 msgr2=0x7fa42c104720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:52.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.403+0000 7fa432b2b700 1 --2- 172.21.15.77:0/1880289152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa42c102340 0x7fa42c104720 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa418004940 tx=0x7fa418009e30 comp rx=0 tx=0).stop 2024-04-25T02:08:52.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.403+0000 7fa432b2b700 1 -- 172.21.15.77:0/1880289152 shutdown_connections 2024-04-25T02:08:52.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.403+0000 7fa432b2b700 1 --2- 172.21.15.77:0/1880289152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa42c102340 0x7fa42c104720 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.403+0000 7fa432b2b700 1 --2- 172.21.15.77:0/1880289152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa42c066260 0x7fa42c101e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.403+0000 7fa432b2b700 1 -- 172.21.15.77:0/1880289152 >> 172.21.15.77:0/1880289152 conn(0x7fa42c0f7430 msgr2=0x7fa42c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:52.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.403+0000 7fa432b2b700 1 -- 172.21.15.77:0/1880289152 shutdown_connections 2024-04-25T02:08:52.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.404+0000 7fa432b2b700 1 -- 172.21.15.77:0/1880289152 wait complete. 2024-04-25T02:08:52.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.404+0000 7fa432b2b700 1 Processor -- start 2024-04-25T02:08:52.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.404+0000 7fa432b2b700 1 -- start start 2024-04-25T02:08:52.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.404+0000 7fa432b2b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa42c066260 0x7fa42c10fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:52.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.404+0000 7fa432b2b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa42c102340 0x7fa42c110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:52.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.404+0000 7fa432b2b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c110700 con 0x7fa42c102340 2024-04-25T02:08:52.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.404+0000 7fa432b2b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c110f00 con 0x7fa42c066260 2024-04-25T02:08:52.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.404+0000 7fa42bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa42c102340 0x7fa42c110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:52.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.405+0000 7fa42bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa42c102340 0x7fa42c110100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33434/0 (socket says 172.21.15.77:33434) 2024-04-25T02:08:52.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.405+0000 7fa42bfff700 1 -- 172.21.15.77:0/2684289795 learned_addr learned my addr 172.21.15.77:0/2684289795 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:08:52.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.405+0000 7fa4308c7700 1 --2- 172.21.15.77:0/2684289795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa42c066260 0x7fa42c10fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:52.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.405+0000 7fa42bfff700 1 -- 172.21.15.77:0/2684289795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa42c066260 msgr2=0x7fa42c10fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:52.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.405+0000 7fa42bfff700 1 --2- 172.21.15.77:0/2684289795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa42c066260 0x7fa42c10fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.405+0000 7fa42bfff700 1 -- 172.21.15.77:0/2684289795 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa418005040 con 0x7fa42c102340 2024-04-25T02:08:52.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.405+0000 7fa42bfff700 1 --2- 172.21.15.77:0/2684289795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa42c102340 0x7fa42c110100 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa418013870 tx=0x7fa418009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:52.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.405+0000 7fa4297fa700 1 -- 172.21.15.77:0/2684289795 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa418021070 con 0x7fa42c102340 2024-04-25T02:08:52.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.405+0000 7fa432b2b700 1 -- 172.21.15.77:0/2684289795 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42c111180 con 0x7fa42c102340 2024-04-25T02:08:52.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.405+0000 7fa4297fa700 1 -- 172.21.15.77:0/2684289795 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa418009430 con 0x7fa42c102340 2024-04-25T02:08:52.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.405+0000 7fa432b2b700 1 -- 172.21.15.77:0/2684289795 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42c1116c0 con 0x7fa42c102340 2024-04-25T02:08:52.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.405+0000 7fa4297fa700 1 -- 172.21.15.77:0/2684289795 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa41800e070 con 0x7fa42c102340 2024-04-25T02:08:52.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.406+0000 7fa432b2b700 1 -- 172.21.15.77:0/2684289795 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4100052e0 con 0x7fa42c102340 2024-04-25T02:08:52.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.407+0000 7fa4297fa700 1 -- 172.21.15.77:0/2684289795 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fa418013af0 con 0x7fa42c102340 2024-04-25T02:08:52.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.407+0000 7fa4297fa700 1 --2- 172.21.15.77:0/2684289795 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fa41c069230 0x7fa41c06b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:52.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.408+0000 7fa4308c7700 1 --2- 172.21.15.77:0/2684289795 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fa41c069230 0x7fa41c06b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:52.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.408+0000 7fa4297fa700 1 -- 172.21.15.77:0/2684289795 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa4180883e0 con 0x7fa42c102340 2024-04-25T02:08:52.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.408+0000 7fa4308c7700 1 --2- 172.21.15.77:0/2684289795 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fa41c069230 0x7fa41c06b6e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa420009b80 tx=0x7fa42000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:52.416 INFO:tasks.workunit.client.0.smithi077.stdout:3/567: dwrite d0/d40/f57 [0,4194304] 0 2024-04-25T02:08:52.416 INFO:tasks.workunit.client.0.smithi077.stdout:3/568: getdents d0/dc5 0 2024-04-25T02:08:52.416 INFO:tasks.workunit.client.0.smithi077.stdout:4/588: dwrite d0/d14/d21/d39/d1d/f2c [0,4194304] 0 2024-04-25T02:08:52.417 INFO:tasks.workunit.client.0.smithi077.stdout:1/592: dwrite db/df/d14/d3e/daa/fb6 [0,4194304] 0 2024-04-25T02:08:52.417 INFO:tasks.workunit.client.0.smithi077.stdout:6/720: dwrite de/d12/d25/f9f [0,4194304] 0 2024-04-25T02:08:52.417 INFO:tasks.workunit.client.0.smithi077.stdout:8/620: dwrite d3/da/d27/f2d [0,4194304] 0 2024-04-25T02:08:52.417 INFO:tasks.workunit.client.0.smithi077.stdout:8/621: stat d3/f6f 0 2024-04-25T02:08:52.417 INFO:tasks.workunit.client.0.smithi077.stdout:8/622: fsync d3/d7a/fa3 0 2024-04-25T02:08:52.418 INFO:tasks.workunit.client.0.smithi077.stdout:2/584: fdatasync d2/f5 0 2024-04-25T02:08:52.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.415+0000 7fa4297fa700 1 -- 172.21.15.77:0/2684289795 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa418058150 con 0x7fa42c102340 2024-04-25T02:08:52.425 INFO:tasks.workunit.client.0.smithi077.stdout:8/623: creat d3/da/d27/d16/dbc/fc0 x:0 0 0 2024-04-25T02:08:52.425 INFO:tasks.workunit.client.0.smithi077.stdout:8/624: chown d3/da/d27/d8e 9203 1 2024-04-25T02:08:52.426 INFO:tasks.workunit.client.0.smithi077.stdout:3/569: write d0/d2/de/d48/d15/f56 [1699934,31762] 0 2024-04-25T02:08:52.427 INFO:tasks.workunit.client.0.smithi077.stdout:3/570: read d0/d17/d4b/d59/f8e [20307,56064] 0 2024-04-25T02:08:52.427 INFO:tasks.workunit.client.0.smithi077.stdout:3/571: fdatasync d0/d2/f35 0 2024-04-25T02:08:52.427 INFO:tasks.workunit.client.0.smithi077.stdout:3/572: chown d0/d2/de/d27/cbe 96 1 2024-04-25T02:08:52.428 INFO:tasks.workunit.client.0.smithi077.stdout:2/585: rename d2/d28/f70 to d2/d9/d2f/d84/fbd 0 2024-04-25T02:08:52.428 INFO:tasks.workunit.client.0.smithi077.stdout:2/586: stat d2/d9/d19/d1c/f44 0 2024-04-25T02:08:52.428 INFO:tasks.workunit.client.0.smithi077.stdout:6/721: dread de/d12/f71 [0,4194304] 0 2024-04-25T02:08:52.429 INFO:tasks.workunit.client.0.smithi077.stdout:1/593: mknod db/df/d14/ccb 0 2024-04-25T02:08:52.429 INFO:tasks.workunit.client.0.smithi077.stdout:1/594: chown db/df/d14/d33/d34/d66/la8 36772404 1 2024-04-25T02:08:52.430 INFO:tasks.workunit.client.0.smithi077.stdout:8/625: mkdir d3/da/d27/d44/db1/dc1 0 2024-04-25T02:08:52.433 INFO:tasks.workunit.client.0.smithi077.stdout:3/573: symlink d0/d3e/d93/dae/lcd 0 2024-04-25T02:08:52.434 INFO:tasks.workunit.client.0.smithi077.stdout:2/587: creat d2/d9/d19/fbe x:0 0 0 2024-04-25T02:08:52.435 INFO:tasks.workunit.client.0.smithi077.stdout:4/589: dwrite d0/d14/d21/d39/da/d12/d35/d3e/f4b [0,4194304] 0 2024-04-25T02:08:52.436 INFO:tasks.workunit.client.0.smithi077.stdout:1/595: creat db/df/d1b/fcc x:0 0 0 2024-04-25T02:08:52.437 INFO:tasks.workunit.client.0.smithi077.stdout:2/588: unlink d2/d9/ca2 0 2024-04-25T02:08:52.439 INFO:tasks.workunit.client.0.smithi077.stdout:4/590: creat d0/d14/d21/d39/d9d/fc2 x:0 0 0 2024-04-25T02:08:52.442 INFO:tasks.workunit.client.0.smithi077.stdout:2/589: link d2/d28/c3c d2/d9/d18/d31/d7c/d89/dbb/cbf 0 2024-04-25T02:08:52.442 INFO:tasks.workunit.client.0.smithi077.stdout:2/590: fdatasync d2/d9/d2f/d84/da6/fbc 0 2024-04-25T02:08:52.443 INFO:tasks.workunit.client.0.smithi077.stdout:1/596: getdents db/df/d14/d4d/d82/d42 0 2024-04-25T02:08:52.445 INFO:tasks.workunit.client.0.smithi077.stdout:3/574: write d0/f9 [4097614,23565] 0 2024-04-25T02:08:52.445 INFO:tasks.workunit.client.0.smithi077.stdout:3/575: read d0/d2/de/d36/da6/fc6 [160762,30835] 0 2024-04-25T02:08:52.445 INFO:tasks.workunit.client.0.smithi077.stdout:2/591: creat d2/d9/d18/d31/d7c/d89/fc0 x:0 0 0 2024-04-25T02:08:52.445 INFO:tasks.workunit.client.0.smithi077.stdout:2/592: fdatasync d2/d78/fac 0 2024-04-25T02:08:52.448 INFO:tasks.workunit.client.0.smithi077.stdout:3/576: link d0/d2/de/d27/cb3 d0/d17/d4b/d59/d81/cce 0 2024-04-25T02:08:52.448 INFO:tasks.workunit.client.0.smithi077.stdout:9/620: sync 2024-04-25T02:08:52.450 INFO:tasks.workunit.client.0.smithi077.stdout:2/593: mkdir d2/d59/d79/dc1 0 2024-04-25T02:08:52.451 INFO:tasks.workunit.client.0.smithi077.stdout:3/577: unlink d0/d2/d83/c9f 0 2024-04-25T02:08:52.451 INFO:tasks.workunit.client.0.smithi077.stdout:4/591: dread d0/d14/d21/d39/f61 [0,4194304] 0 2024-04-25T02:08:52.451 INFO:tasks.workunit.client.0.smithi077.stdout:4/592: dread - d0/d14/d60/d62/fa8 zero size 2024-04-25T02:08:52.452 INFO:tasks.workunit.client.0.smithi077.stdout:9/621: symlink df/d1b/d48/d86/lcd 0 2024-04-25T02:08:52.454 INFO:tasks.workunit.client.0.smithi077.stdout:4/593: mknod d0/d14/d21/d39/d9a/cc3 0 2024-04-25T02:08:52.454 INFO:tasks.workunit.client.0.smithi077.stdout:4/594: read - d0/d14/d21/d39/d9d/fc2 zero size 2024-04-25T02:08:52.455 INFO:tasks.workunit.client.0.smithi077.stdout:4/595: truncate d0/d14/d60/d86/d25/f45 7936077 0 2024-04-25T02:08:52.455 INFO:tasks.workunit.client.0.smithi077.stdout:4/596: chown d0/d14/d60/fa7 1900 1 2024-04-25T02:08:52.457 INFO:tasks.workunit.client.0.smithi077.stdout:5/596: sync 2024-04-25T02:08:52.457 INFO:tasks.workunit.client.0.smithi077.stdout:5/597: write d0/d2/d1b/f76 [812483,53691] 0 2024-04-25T02:08:52.459 INFO:tasks.workunit.client.0.smithi077.stdout:5/598: creat d0/d2/fc5 x:0 0 0 2024-04-25T02:08:52.460 INFO:tasks.workunit.client.0.smithi077.stdout:5/599: mkdir d0/d2/d3/d9/d39/d3c/dc6 0 2024-04-25T02:08:52.462 INFO:tasks.workunit.client.0.smithi077.stdout:2/594: read d2/d9/d19/f1a [1517638,65343] 0 2024-04-25T02:08:52.463 INFO:tasks.workunit.client.0.smithi077.stdout:2/595: write f1 [4125443,93202] 0 2024-04-25T02:08:52.463 INFO:tasks.workunit.client.0.smithi077.stdout:2/596: chown d2/d9/d19/c64 195 1 2024-04-25T02:08:52.463 INFO:tasks.workunit.client.0.smithi077.stdout:5/600: unlink d0/d2/d3/d1d/f33 0 2024-04-25T02:08:52.464 INFO:tasks.workunit.client.0.smithi077.stdout:2/597: mkdir d2/d9/d19/dc2 0 2024-04-25T02:08:52.466 INFO:tasks.workunit.client.0.smithi077.stdout:2/598: mknod d2/d9/d2f/d84/cc3 0 2024-04-25T02:08:52.469 INFO:tasks.workunit.client.0.smithi077.stdout:2/599: rename d2/d9/d56/d5c to d2/d9/d18/d31/d7c/d89/dc4 0 2024-04-25T02:08:52.470 INFO:tasks.workunit.client.0.smithi077.stdout:2/600: mkdir d2/d9/d18/d31/d7c/d89/dc5 0 2024-04-25T02:08:52.472 INFO:tasks.workunit.client.0.smithi077.stdout:2/601: mknod d2/d9/d18/d1b/cc6 0 2024-04-25T02:08:52.474 INFO:tasks.workunit.client.0.smithi077.stdout:8/626: dwrite d3/f6f [0,4194304] 0 2024-04-25T02:08:52.474 INFO:tasks.workunit.client.0.smithi077.stdout:2/602: link d2/d9/d18/d1b/l55 d2/d9/d18/lc7 0 2024-04-25T02:08:52.476 INFO:tasks.workunit.client.0.smithi077.stdout:5/601: write d0/d25/d82/d87/d8b/da5/dc4/d23/d4a/f74 [1609789,67757] 0 2024-04-25T02:08:52.476 INFO:tasks.workunit.client.0.smithi077.stdout:6/722: dwrite de/d12/d25/d3a/d6a/dcd/d36/dd2/f6c [0,4194304] 0 2024-04-25T02:08:52.478 INFO:tasks.workunit.client.0.smithi077.stdout:2/603: mkdir d2/d9/d18/d31/d7c/dab/dc8 0 2024-04-25T02:08:52.478 INFO:tasks.workunit.client.0.smithi077.stdout:2/604: write d2/d9/d19/d1c/f81 [953608,46278] 0 2024-04-25T02:08:52.478 INFO:tasks.workunit.client.0.smithi077.stdout:2/605: chown d2/d9/d2f/d84/cc3 770534 1 2024-04-25T02:08:52.479 INFO:tasks.workunit.client.0.smithi077.stdout:1/597: dwrite db/df/d14/d4d/d82/f39 [0,4194304] 0 2024-04-25T02:08:52.479 INFO:tasks.workunit.client.0.smithi077.stdout:1/598: stat db/f12 0 2024-04-25T02:08:52.480 INFO:tasks.workunit.client.0.smithi077.stdout:8/627: dread d3/da/db/df/d2b/d37/f5a [0,4194304] 0 2024-04-25T02:08:52.482 INFO:tasks.workunit.client.0.smithi077.stdout:4/597: dwrite d0/d14/d60/d86/d96/f5c [4194304,4194304] 0 2024-04-25T02:08:52.483 INFO:tasks.workunit.client.0.smithi077.stdout:1/599: dread db/df/d14/d3e/d69/f90 [0,4194304] 0 2024-04-25T02:08:52.483 INFO:tasks.workunit.client.0.smithi077.stdout:9/622: dwrite df/d1b/d48/d75/fa0 [0,4194304] 0 2024-04-25T02:08:52.483 INFO:tasks.workunit.client.0.smithi077.stdout:9/623: stat df/f2f 0 2024-04-25T02:08:52.483 INFO:tasks.workunit.client.0.smithi077.stdout:9/624: write df/f13 [1536643,8224] 0 2024-04-25T02:08:52.483 INFO:tasks.workunit.client.0.smithi077.stdout:9/625: dread - df/d1b/d56/fae zero size 2024-04-25T02:08:52.486 INFO:tasks.workunit.client.0.smithi077.stdout:2/606: mknod d2/d9/d2f/d84/da6/cc9 0 2024-04-25T02:08:52.493 INFO:tasks.workunit.client.0.smithi077.stdout:4/598: write d0/d14/d21/d39/d1d/f2c [2210135,8455] 0 2024-04-25T02:08:52.493 INFO:tasks.workunit.client.0.smithi077.stdout:4/599: write d0/d14/f33 [1007590,46689] 0 2024-04-25T02:08:52.493 INFO:tasks.workunit.client.0.smithi077.stdout:4/600: creat d0/d14/d60/fc4 x:0 0 0 2024-04-25T02:08:52.493 INFO:tasks.workunit.client.0.smithi077.stdout:4/601: dread - d0/d14/d21/d39/d9a/fa0 zero size 2024-04-25T02:08:52.494 INFO:tasks.workunit.client.0.smithi077.stdout:5/602: dwrite d0/d2/d3/d9/d39/d44/d5f/f60 [0,4194304] 0 2024-04-25T02:08:52.495 INFO:tasks.workunit.client.0.smithi077.stdout:1/600: getdents db/df/d56/d5d/d77 0 2024-04-25T02:08:52.500 INFO:tasks.workunit.client.0.smithi077.stdout:9/626: mkdir df/d1b/d70/d74/dce 0 2024-04-25T02:08:52.503 INFO:tasks.workunit.client.0.smithi077.stdout:4/602: link d0/d14/d21/l92 d0/d14/d21/d39/da/d12/d35/lc5 0 2024-04-25T02:08:52.504 INFO:tasks.workunit.client.0.smithi077.stdout:4/603: readlink d0/d14/d21/l92 0 2024-04-25T02:08:52.510 INFO:tasks.workunit.client.0.smithi077.stdout:9/627: dread df/d1b/f40 [4194304,4194304] 0 2024-04-25T02:08:52.510 INFO:tasks.workunit.client.0.smithi077.stdout:9/628: write df/f58 [944377,112939] 0 2024-04-25T02:08:52.510 INFO:tasks.workunit.client.0.smithi077.stdout:1/601: mkdir db/df/d56/dc3/dcd 0 2024-04-25T02:08:52.510 INFO:tasks.workunit.client.0.smithi077.stdout:1/602: chown db/df/d14/d4d/d82/d32/c7b 1307127948 1 2024-04-25T02:08:52.512 INFO:tasks.workunit.client.0.smithi077.stdout:6/723: rename de/d3b/ddf to de/d12/d25/d44/df5 0 2024-04-25T02:08:52.513 INFO:tasks.workunit.client.0.smithi077.stdout:6/724: dread de/d55/f9a [0,4194304] 0 2024-04-25T02:08:52.514 INFO:tasks.workunit.client.0.smithi077.stdout:5/603: mkdir d0/d25/dc7 0 2024-04-25T02:08:52.516 INFO:tasks.workunit.client.0.smithi077.stdout:9/629: creat df/d60/d87/fcf x:0 0 0 2024-04-25T02:08:52.516 INFO:tasks.workunit.client.0.smithi077.stdout:9/630: fdatasync df/f26 0 2024-04-25T02:08:52.516 INFO:tasks.workunit.client.0.smithi077.stdout:9/631: chown df/d1b/d48/f54 31413241 1 2024-04-25T02:08:52.517 INFO:tasks.workunit.client.0.smithi077.stdout:1/603: symlink db/df/d14/d4d/d82/d32/lce 0 2024-04-25T02:08:52.519 INFO:tasks.workunit.client.0.smithi077.stdout:8/628: rename d3/da/db/df/d2b/d37/faa to d3/da/db/df/d2b/d70/fc2 0 2024-04-25T02:08:52.520 INFO:tasks.workunit.client.0.smithi077.stdout:8/629: read - d3/d34/fa8 zero size 2024-04-25T02:08:52.521 INFO:tasks.workunit.client.0.smithi077.stdout:5/604: creat d0/d2/fc8 x:0 0 0 2024-04-25T02:08:52.521 INFO:tasks.workunit.client.0.smithi077.stdout:5/605: chown d0/d25/d82/d87/d8b/da5/dc4/d23/fa6 964 1 2024-04-25T02:08:52.522 INFO:tasks.workunit.client.0.smithi077.stdout:9/632: unlink df/f58 0 2024-04-25T02:08:52.525 INFO:tasks.workunit.client.0.smithi077.stdout:1/604: link db/df/d14/d4d/d82/c84 db/df/d14/d33/ccf 0 2024-04-25T02:08:52.525 INFO:tasks.workunit.client.0.smithi077.stdout:1/605: readlink db/df/d14/d33/l37 0 2024-04-25T02:08:52.527 INFO:tasks.workunit.client.0.smithi077.stdout:8/630: mknod d3/da/d27/d16/dbc/cc3 0 2024-04-25T02:08:52.527 INFO:tasks.workunit.client.0.smithi077.stdout:8/631: stat d3/da/db/la4 0 2024-04-25T02:08:52.529 INFO:tasks.workunit.client.0.smithi077.stdout:5/606: mknod d0/d25/d82/d87/d8b/da5/dc4/d23/cc9 0 2024-04-25T02:08:52.529 INFO:tasks.workunit.client.0.smithi077.stdout:1/606: mkdir db/df/d56/dd0 0 2024-04-25T02:08:52.531 INFO:tasks.workunit.client.0.smithi077.stdout:9/633: dread df/f3c [0,4194304] 0 2024-04-25T02:08:52.534 INFO:tasks.workunit.client.0.smithi077.stdout:1/607: rmdir db/df/d56/dd0 0 2024-04-25T02:08:52.536 INFO:tasks.workunit.client.0.smithi077.stdout:2/607: rename d2/d9/df to d2/d9/d19/d1c/d3f/d53/d86/dca 0 2024-04-25T02:08:52.537 INFO:tasks.workunit.client.0.smithi077.stdout:9/634: creat df/d1b/d48/db6/fd0 x:0 0 0 2024-04-25T02:08:52.542 INFO:tasks.workunit.client.0.smithi077.stdout:4/604: rename d0/d14/d21/c6a to d0/d14/d21/d39/da/d12/d35/d3e/cc6 0 2024-04-25T02:08:52.545 INFO:tasks.workunit.client.0.smithi077.stdout:7/548: sync 2024-04-25T02:08:52.546 INFO:tasks.workunit.client.0.smithi077.stdout:8/632: dwrite d3/da/d27/fbe [0,4194304] 0 2024-04-25T02:08:52.547 INFO:tasks.workunit.client.0.smithi077.stdout:6/725: rename de/d12/d25/d3a/d6a/dcd/cf1 to de/d12/cf6 0 2024-04-25T02:08:52.547 INFO:tasks.workunit.client.0.smithi077.stdout:6/726: stat de/d55/db7 0 2024-04-25T02:08:52.548 INFO:tasks.workunit.client.0.smithi077.stdout:4/605: getdents d0/d14/d60/d86/d96 0 2024-04-25T02:08:52.548 INFO:tasks.workunit.client.0.smithi077.stdout:4/606: creat d0/d14/d60/fc7 x:0 0 0 2024-04-25T02:08:52.552 INFO:tasks.workunit.client.0.smithi077.stdout:7/549: unlink d4/d13/d18/d24/d3f/d58/f7a 0 2024-04-25T02:08:52.555 INFO:tasks.workunit.client.0.smithi077.stdout:8/633: dread d3/da/db/df/d2b/d37/f69 [0,4194304] 0 2024-04-25T02:08:52.563 INFO:tasks.workunit.client.0.smithi077.stdout:4/607: truncate d0/d14/d21/d39/da/d12/d35/d3e/f38 7033678 0 2024-04-25T02:08:52.563 INFO:tasks.workunit.client.0.smithi077.stdout:4/608: write d0/d14/d21/d39/da/f2d [1587020,103898] 0 2024-04-25T02:08:52.564 INFO:tasks.workunit.client.0.smithi077.stdout:7/550: mknod d4/d13/d18/d24/d3f/cbb 0 2024-04-25T02:08:52.564 INFO:tasks.workunit.client.0.smithi077.stdout:8/634: truncate d3/da/db/fa1 662601 0 2024-04-25T02:08:52.565 INFO:tasks.workunit.client.0.smithi077.stdout:2/608: dwrite d2/d9/d19/d1c/d3f/d53/f68 [0,4194304] 0 2024-04-25T02:08:52.567 INFO:tasks.workunit.client.0.smithi077.stdout:4/609: symlink d0/d14/d21/d39/da/d12/d35/lc8 0 2024-04-25T02:08:52.567 INFO:tasks.workunit.client.0.smithi077.stdout:4/610: readlink d0/d14/d60/d62/l8a 0 2024-04-25T02:08:52.567 INFO:tasks.workunit.client.0.smithi077.stdout:4/611: fdatasync d0/d14/d21/d39/f4d 0 2024-04-25T02:08:52.568 INFO:tasks.workunit.client.0.smithi077.stdout:2/609: mkdir d2/d9/d19/d1c/d37/dcb 0 2024-04-25T02:08:52.568 INFO:tasks.workunit.client.0.smithi077.stdout:5/607: rename d0/d2/d3/d1d to d0/d25/dc7/dca 0 2024-04-25T02:08:52.568 INFO:tasks.workunit.client.0.smithi077.stdout:5/608: truncate d0/d25/d82/d87/d8b/da5/fc3 351326 0 2024-04-25T02:08:52.570 INFO:tasks.workunit.client.0.smithi077.stdout:2/610: symlink d2/d9/d19/d2c/d72/lcc 0 2024-04-25T02:08:52.573 INFO:tasks.workunit.client.0.smithi077.stdout:1/608: rename db/df/d14/d33/d34/cac to db/df/d14/d4d/d82/d5c/cd1 0 2024-04-25T02:08:52.575 INFO:tasks.workunit.client.0.smithi077.stdout:6/727: dwrite de/d12/d25/d3a/d6a/fef [0,4194304] 0 2024-04-25T02:08:52.575 INFO:tasks.workunit.client.0.smithi077.stdout:6/728: stat de/d12/d25/d60/fd4 0 2024-04-25T02:08:52.575 INFO:tasks.workunit.client.0.smithi077.stdout:6/729: readlink de/d12/d25/d3a/lec 0 2024-04-25T02:08:52.575 INFO:tasks.workunit.client.0.smithi077.stdout:9/635: dwrite df/d1b/d56/fae [0,4194304] 0 2024-04-25T02:08:52.575 INFO:tasks.workunit.client.0.smithi077.stdout:1/609: mkdir db/df/d14/d3e/d69/dd2 0 2024-04-25T02:08:52.580 INFO:tasks.workunit.client.0.smithi077.stdout:6/730: creat de/d12/d25/d44/df5/ff7 x:0 0 0 2024-04-25T02:08:52.580 INFO:tasks.workunit.client.0.smithi077.stdout:8/635: write d3/da/f35 [1092470,111023] 0 2024-04-25T02:08:52.584 INFO:tasks.workunit.client.0.smithi077.stdout:6/731: dread de/d12/f71 [0,4194304] 0 2024-04-25T02:08:52.584 INFO:tasks.workunit.client.0.smithi077.stdout:6/732: chown de/d12/d25/d38 3 1 2024-04-25T02:08:52.585 INFO:tasks.workunit.client.0.smithi077.stdout:9/636: rmdir df/d1b/d48/d75 39 2024-04-25T02:08:52.586 INFO:tasks.workunit.client.0.smithi077.stdout:1/610: symlink db/df/d14/d33/d6c/ld3 0 2024-04-25T02:08:52.587 INFO:tasks.workunit.client.0.smithi077.stdout:5/609: dwrite d0/d25/f30 [4194304,4194304] 0 2024-04-25T02:08:52.589 INFO:tasks.workunit.client.0.smithi077.stdout:5/610: dread d0/d2/d1b/d3b/f71 [0,4194304] 0 2024-04-25T02:08:52.589 INFO:tasks.workunit.client.0.smithi077.stdout:8/636: unlink d3/da/d27/l2f 0 2024-04-25T02:08:52.590 INFO:tasks.workunit.client.0.smithi077.stdout:2/611: dwrite d2/d9/d19/d2c/f5b [0,4194304] 0 2024-04-25T02:08:52.590 INFO:tasks.workunit.client.0.smithi077.stdout:2/612: chown d2/d9/d18/d1b/c26 35271026 1 2024-04-25T02:08:52.591 INFO:tasks.workunit.client.0.smithi077.stdout:9/637: symlink df/d1b/d56/d67/d68/db3/ld1 0 2024-04-25T02:08:52.591 INFO:tasks.workunit.client.0.smithi077.stdout:9/638: write df/d1b/d56/d67/f8e [3008217,56656] 0 2024-04-25T02:08:52.593 INFO:tasks.workunit.client.0.smithi077.stdout:1/611: dread db/df/d14/f17 [0,4194304] 0 2024-04-25T02:08:52.595 INFO:tasks.workunit.client.0.smithi077.stdout:5/611: creat d0/d2/d3/d9/d39/d3c/dc6/fcb x:0 0 0 2024-04-25T02:08:52.596 INFO:tasks.workunit.client.0.smithi077.stdout:0/610: sync 2024-04-25T02:08:52.597 INFO:tasks.workunit.client.0.smithi077.stdout:8/637: dread d3/da/db/df/d2b/f8d [0,4194304] 0 2024-04-25T02:08:52.597 INFO:tasks.workunit.client.0.smithi077.stdout:8/638: truncate d3/da/d27/d16/d6b/f6e 1937143 0 2024-04-25T02:08:52.597 INFO:tasks.workunit.client.0.smithi077.stdout:8/639: creat d3/da/db/df/d2b/d37/fc4 x:0 0 0 2024-04-25T02:08:52.599 INFO:tasks.workunit.client.0.smithi077.stdout:2/613: link d2/d9/d18/d31/d7c/d89/dc4/c5d d2/d78/d95/ccd 0 2024-04-25T02:08:52.599 INFO:tasks.workunit.client.0.smithi077.stdout:6/733: dread de/d53/f7c [0,4194304] 0 2024-04-25T02:08:52.603 INFO:tasks.workunit.client.0.smithi077.stdout:9/639: rename df/d1b/d48/d75/c8b to df/d1b/d56/dbd/cd2 0 2024-04-25T02:08:52.605 INFO:tasks.workunit.client.0.smithi077.stdout:1/612: link db/df/d14/d4d/d82/c24 db/df/d14/d3e/d69/dad/cd4 0 2024-04-25T02:08:52.605 INFO:tasks.workunit.client.0.smithi077.stdout:1/613: truncate db/df/d56/d5d/d77/f8d 773976 0 2024-04-25T02:08:52.606 INFO:tasks.workunit.client.0.smithi077.stdout:5/612: unlink d0/d25/d82/d8d/fbb 0 2024-04-25T02:08:52.613 INFO:tasks.workunit.client.0.smithi077.stdout:0/611: link d2/d17/d1d/f20 d2/d8/db6/fd2 0 2024-04-25T02:08:52.614 INFO:tasks.workunit.client.0.smithi077.stdout:5/613: dread d0/d2/d1b/d38/f5e [0,4194304] 0 2024-04-25T02:08:52.617 INFO:tasks.workunit.client.0.smithi077.stdout:8/640: mknod d3/da/db/df/d30/cc5 0 2024-04-25T02:08:52.617 INFO:tasks.workunit.client.0.smithi077.stdout:8/641: chown d3/da/d27/fbe 7 1 2024-04-25T02:08:52.617 INFO:tasks.workunit.client.0.smithi077.stdout:8/642: stat d3/da/db/df/d30/f55 0 2024-04-25T02:08:52.619 INFO:tasks.workunit.client.0.smithi077.stdout:2/614: mkdir d2/d59/d79/dc1/dce 0 2024-04-25T02:08:52.619 INFO:tasks.workunit.client.0.smithi077.stdout:2/615: chown d2/d78/d95/ccd 519559508 1 2024-04-25T02:08:52.621 INFO:tasks.workunit.client.0.smithi077.stdout:6/734: mknod de/d12/d25/d44/cf8 0 2024-04-25T02:08:52.621 INFO:tasks.workunit.client.0.smithi077.stdout:6/735: chown de/d12/f2a 395 1 2024-04-25T02:08:52.621 INFO:tasks.workunit.client.0.smithi077.stdout:6/736: truncate de/d55/d88/f8b 882139 0 2024-04-25T02:08:52.624 INFO:tasks.workunit.client.0.smithi077.stdout:9/640: rename df/d60/d87/caa to df/d1b/d48/d86/cd3 0 2024-04-25T02:08:52.625 INFO:tasks.workunit.client.0.smithi077.stdout:4/612: link d0/d14/d21/f26 d0/d14/d60/d86/d25/fc9 0 2024-04-25T02:08:52.632 INFO:tasks.workunit.client.0.smithi077.stdout:0/612: creat d2/d17/d1d/d34/d4c/fd3 x:0 0 0 2024-04-25T02:08:52.634 INFO:tasks.workunit.client.0.smithi077.stdout:5/614: link d0/d25/d82/d8d/c9f d0/d2/d3/ccc 0 2024-04-25T02:08:52.634 INFO:tasks.workunit.client.0.smithi077.stdout:9/641: dread f5 [0,4194304] 0 2024-04-25T02:08:52.635 INFO:tasks.workunit.client.0.smithi077.stdout:8/643: unlink d3/da/d27/d44/db1/lb6 0 2024-04-25T02:08:52.641 INFO:tasks.workunit.client.0.smithi077.stdout:6/737: dwrite de/d53/d78/ff3 [0,4194304] 0 2024-04-25T02:08:52.643 INFO:tasks.workunit.client.0.smithi077.stdout:4/613: rename d0/d14/d21/d39/d1d/l4e to d0/d14/d21/d39/d1d/lca 0 2024-04-25T02:08:52.643 INFO:tasks.workunit.client.0.smithi077.stdout:4/614: write d0/d14/d60/d62/fa8 [757298,22848] 0 2024-04-25T02:08:52.644 INFO:tasks.workunit.client.0.smithi077.stdout:1/614: rmdir db/df/d56/dc3 39 2024-04-25T02:08:52.646 INFO:tasks.workunit.client.0.smithi077.stdout:0/613: truncate d2/d17/d1d/f3d 143153 0 2024-04-25T02:08:52.648 INFO:tasks.workunit.client.0.smithi077.stdout:5/615: symlink d0/d25/d82/d87/d8b/d5a/db4/lcd 0 2024-04-25T02:08:52.648 INFO:tasks.workunit.client.0.smithi077.stdout:5/616: fsync d0/d25/dc7/dca/f1f 0 2024-04-25T02:08:52.648 INFO:tasks.workunit.client.0.smithi077.stdout:8/644: dread d3/da/db/df/f33 [0,4194304] 0 2024-04-25T02:08:52.650 INFO:tasks.workunit.client.0.smithi077.stdout:9/642: symlink df/d1b/d56/d67/d68/ld4 0 2024-04-25T02:08:52.650 INFO:tasks.workunit.client.0.smithi077.stdout:9/643: readlink df/l2b 0 2024-04-25T02:08:52.657 INFO:tasks.workunit.client.0.smithi077.stdout:6/738: rename de/d12/d25/l57 to de/d55/db7/lf9 0 2024-04-25T02:08:52.658 INFO:tasks.workunit.client.0.smithi077.stdout:4/615: stat d0/d14/d21/d39/da/d12/d35/l95 0 2024-04-25T02:08:52.663 INFO:tasks.workunit.client.0.smithi077.stdout:5/617: rmdir d0/d25/dc7 39 2024-04-25T02:08:52.663 INFO:tasks.workunit.client.0.smithi077.stdout:5/618: write d0/d2/d1b/f54 [3832267,83503] 0 2024-04-25T02:08:52.663 INFO:tasks.workunit.client.0.smithi077.stdout:5/619: chown d0/d2/d1b/fb9 7029421 1 2024-04-25T02:08:52.666 INFO:tasks.workunit.client.0.smithi077.stdout:8/645: symlink d3/da/db/df/lc6 0 2024-04-25T02:08:52.666 INFO:tasks.workunit.client.0.smithi077.stdout:8/646: fdatasync d3/da/db/df/d30/f82 0 2024-04-25T02:08:52.666 INFO:tasks.workunit.client.0.smithi077.stdout:8/647: write d3/da/db/df/d2b/d37/f94 [597132,39583] 0 2024-04-25T02:08:52.666 INFO:tasks.workunit.client.0.smithi077.stdout:8/648: chown d3/d34/d3d/lb2 27797969 1 2024-04-25T02:08:52.666 INFO:tasks.workunit.client.0.smithi077.stdout:9/644: stat df/d1b/d48/d75/d77/la3 0 2024-04-25T02:08:52.667 INFO:tasks.workunit.client.0.smithi077.stdout:9/645: creat df/d1b/d70/d84/fd5 x:0 0 0 2024-04-25T02:08:52.667 INFO:tasks.workunit.client.0.smithi077.stdout:4/616: dread d0/d14/d60/d86/d96/f5c [4194304,4194304] 0 2024-04-25T02:08:52.667 INFO:tasks.workunit.client.0.smithi077.stdout:4/617: fsync d0/d14/d21/d39/da/d12/d35/f71 0 2024-04-25T02:08:52.667 INFO:tasks.workunit.client.0.smithi077.stdout:4/618: rename d0/d14/d21/d39 to d0/d14/d21/d39/d1d/dcb 22 2024-04-25T02:08:52.668 INFO:tasks.workunit.client.0.smithi077.stdout:0/614: mknod d2/d27/d2d/dce/cd4 0 2024-04-25T02:08:52.668 INFO:tasks.workunit.client.0.smithi077.stdout:0/615: creat d2/d8/dad/fd5 x:0 0 0 2024-04-25T02:08:52.672 INFO:tasks.workunit.client.0.smithi077.stdout:3/578: sync 2024-04-25T02:08:52.672 INFO:tasks.workunit.client.0.smithi077.stdout:6/739: dwrite de/d55/f8f [0,4194304] 0 2024-04-25T02:08:52.673 INFO:tasks.workunit.client.0.smithi077.stdout:4/619: mknod d0/d14/d21/d39/d9d/ccc 0 2024-04-25T02:08:52.675 INFO:tasks.workunit.client.0.smithi077.stdout:0/616: rename d2/d17/d1d/l94 to d2/d27/ld6 0 2024-04-25T02:08:52.677 INFO:tasks.workunit.client.0.smithi077.stdout:8/649: truncate d3/da/d27/d16/d6b/f6e 732031 0 2024-04-25T02:08:52.677 INFO:tasks.workunit.client.0.smithi077.stdout:8/650: write d3/da/db/df/d30/f92 [2227993,114251] 0 2024-04-25T02:08:52.677 INFO:tasks.workunit.client.0.smithi077.stdout:8/651: stat d3/d7a/fb8 0 2024-04-25T02:08:52.683 INFO:tasks.workunit.client.0.smithi077.stdout:3/579: dread d0/d2/de/f82 [0,4194304] 0 2024-04-25T02:08:52.683 INFO:tasks.workunit.client.0.smithi077.stdout:4/620: read d0/d14/d60/d86/d25/f40 [207136,110532] 0 2024-04-25T02:08:52.683 INFO:tasks.workunit.client.0.smithi077.stdout:4/621: truncate d0/d14/d21/f2a 2783065 0 2024-04-25T02:08:52.689 INFO:tasks.workunit.client.0.smithi077.stdout:5/620: dwrite d0/d25/d82/d87/d8b/da5/dc4/d23/d4a/f74 [0,4194304] 0 2024-04-25T02:08:52.689 INFO:tasks.workunit.client.0.smithi077.stdout:5/621: fdatasync d0/d25/d82/d87/d8b/da5/dc4/d23/fb7 0 2024-04-25T02:08:52.689 INFO:tasks.workunit.client.0.smithi077.stdout:5/622: fsync d0/d2/d3/d9/d39/d44/d80/faa 0 2024-04-25T02:08:52.691 INFO:tasks.workunit.client.0.smithi077.stdout:6/740: mknod de/d53/d6f/cfa 0 2024-04-25T02:08:52.692 INFO:tasks.workunit.client.0.smithi077.stdout:0/617: mkdir d2/d8/db6/dd7 0 2024-04-25T02:08:52.692 INFO:tasks.workunit.client.0.smithi077.stdout:9/646: rmdir df/d1b 39 2024-04-25T02:08:52.693 INFO:tasks.workunit.client.0.smithi077.stdout:9/647: chown df/d1b/d48/db6 130 1 2024-04-25T02:08:52.694 INFO:tasks.workunit.client.0.smithi077.stdout:8/652: rename d3/da/d27/d16/d8c/f96 to d3/fc7 0 2024-04-25T02:08:52.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.690+0000 7fa432b2b700 1 -- 172.21.15.77:0/2684289795 --> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa410000bf0 con 0x7fa41c069230 2024-04-25T02:08:52.696 INFO:tasks.workunit.client.0.smithi077.stdout:3/580: symlink d0/d3e/d62/lcf 0 2024-04-25T02:08:52.697 INFO:tasks.workunit.client.0.smithi077.stdout:4/622: getdents d0/d14/d21/d39/da/d12/d35/d3e/d3a 0 2024-04-25T02:08:52.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.691+0000 7fa4297fa700 1 -- 172.21.15.77:0/2684289795 <== mgr.14208 v2:172.21.15.77:6800/310739264 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7fa410000bf0 con 0x7fa41c069230 2024-04-25T02:08:52.698 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:08:52.698 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901", 2024-04-25T02:08:52.698 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-04-25T02:08:52.698 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-25T02:08:52.698 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [], 2024-04-25T02:08:52.698 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "", 2024-04-25T02:08:52.698 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading mgr daemons", 2024-04-25T02:08:52.698 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-04-25T02:08:52.698 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:08:52.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.694+0000 7fa432b2b700 1 -- 172.21.15.77:0/2684289795 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fa41c069230 msgr2=0x7fa41c06b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:52.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.694+0000 7fa432b2b700 1 --2- 172.21.15.77:0/2684289795 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fa41c069230 0x7fa41c06b6e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa420009b80 tx=0x7fa42000b040 comp rx=0 tx=0).stop 2024-04-25T02:08:52.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.694+0000 7fa432b2b700 1 -- 172.21.15.77:0/2684289795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa42c102340 msgr2=0x7fa42c110100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:52.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.694+0000 7fa432b2b700 1 --2- 172.21.15.77:0/2684289795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa42c102340 0x7fa42c110100 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa418013870 tx=0x7fa418009e30 comp rx=0 tx=0).stop 2024-04-25T02:08:52.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.695+0000 7fa432b2b700 1 -- 172.21.15.77:0/2684289795 shutdown_connections 2024-04-25T02:08:52.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.695+0000 7fa432b2b700 1 --2- 172.21.15.77:0/2684289795 >> [v2:172.21.15.77:6800/310739264,v1:172.21.15.77:6801/310739264] conn(0x7fa41c069230 0x7fa41c06b6e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.695+0000 7fa432b2b700 1 --2- 172.21.15.77:0/2684289795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa42c066260 0x7fa42c10fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.695+0000 7fa432b2b700 1 --2- 172.21.15.77:0/2684289795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa42c102340 0x7fa42c110100 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:52.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.695+0000 7fa432b2b700 1 -- 172.21.15.77:0/2684289795 >> 172.21.15.77:0/2684289795 conn(0x7fa42c0f7430 msgr2=0x7fa42c0f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:52.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.695+0000 7fa432b2b700 1 -- 172.21.15.77:0/2684289795 shutdown_connections 2024-04-25T02:08:52.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:08:52.695+0000 7fa432b2b700 1 -- 172.21.15.77:0/2684289795 wait complete. 2024-04-25T02:08:52.703 INFO:tasks.workunit.client.0.smithi077.stdout:6/741: truncate de/d53/d78/ff3 3354397 0 2024-04-25T02:08:52.703 INFO:tasks.workunit.client.0.smithi077.stdout:8/653: dread d3/da/d27/f6c [0,4194304] 0 2024-04-25T02:08:52.705 INFO:tasks.workunit.client.0.smithi077.stdout:3/581: rename d0/d2/l53 to d0/d2/d2f/d5f/ld0 0 2024-04-25T02:08:52.707 INFO:tasks.workunit.client.0.smithi077.stdout:4/623: read d0/d14/d79/fb6 [8460,27249] 0 2024-04-25T02:08:52.714 INFO:tasks.workunit.client.0.smithi077.stdout:0/618: rmdir d2/d17/d1d 39 2024-04-25T02:08:52.717 INFO:tasks.workunit.client.0.smithi077.stdout:3/582: creat d0/d2/de/d36/da0/fd1 x:0 0 0 2024-04-25T02:08:52.718 INFO:tasks.workunit.client.0.smithi077.stdout:0/619: chown d2/d27/d2d/f6d 258 1 2024-04-25T02:08:52.718 INFO:tasks.workunit.client.0.smithi077.stdout:0/620: fsync d2/d8/dad/fba 0 2024-04-25T02:08:52.718 INFO:tasks.workunit.client.0.smithi077.stdout:0/621: readlink d2/d1c/l75 0 2024-04-25T02:08:52.718 INFO:tasks.workunit.client.0.smithi077.stdout:0/622: chown d2/d17/d1d/d34/d4c/da2/ccd 13329018 1 2024-04-25T02:08:52.719 INFO:tasks.workunit.client.0.smithi077.stdout:3/583: mkdir d0/d17/d4b/d59/dd2 0 2024-04-25T02:08:52.720 INFO:tasks.workunit.client.0.smithi077.stdout:0/623: creat d2/d17/d1d/d34/d83/fd8 x:0 0 0 2024-04-25T02:08:52.721 INFO:tasks.workunit.client.0.smithi077.stdout:3/584: mkdir d0/dd3 0 2024-04-25T02:08:52.722 INFO:tasks.workunit.client.0.smithi077.stdout:3/585: dread d0/d3e/d42/f60 [0,4194304] 0 2024-04-25T02:08:52.724 INFO:tasks.workunit.client.0.smithi077.stdout:3/586: mkdir d0/d17/dd4 0 2024-04-25T02:08:52.724 INFO:tasks.workunit.client.0.smithi077.stdout:3/587: dread - d0/d3e/d62/d6a/d6e/f85 zero size 2024-04-25T02:08:52.724 INFO:tasks.workunit.client.0.smithi077.stdout:3/588: chown d0/d2/d2f 1187 1 2024-04-25T02:08:52.724 INFO:tasks.workunit.client.0.smithi077.stdout:6/742: dwrite de/d5b/da6/fd8 [0,4194304] 0 2024-04-25T02:08:52.725 INFO:tasks.workunit.client.0.smithi077.stdout:3/589: mknod d0/d3e/d42/cd5 0 2024-04-25T02:08:52.726 INFO:tasks.workunit.client.0.smithi077.stdout:3/590: write d0/d2/de/f61 [3205578,77057] 0 2024-04-25T02:08:52.726 INFO:tasks.workunit.client.0.smithi077.stdout:3/591: chown d0/d2/de/d36/l4a 56493 1 2024-04-25T02:08:52.735 INFO:tasks.workunit.client.0.smithi077.stdout:3/592: dread d0/d2/de/d48/d15/f2a [0,4194304] 0 2024-04-25T02:08:52.736 INFO:tasks.workunit.client.0.smithi077.stdout:3/593: creat d0/d2/d2f/fd6 x:0 0 0 2024-04-25T02:08:52.739 INFO:tasks.workunit.client.0.smithi077.stdout:4/624: write d0/d14/d79/fbb [2263330,26260] 0 2024-04-25T02:08:52.739 INFO:tasks.workunit.client.0.smithi077.stdout:4/625: chown d0/d14/d21/d39/f61 85 1 2024-04-25T02:08:52.739 INFO:tasks.workunit.client.0.smithi077.stdout:4/626: dread - d0/d14/d21/d39/d1d/d98/fc1 zero size 2024-04-25T02:08:52.740 INFO:tasks.workunit.client.0.smithi077.stdout:6/743: dread de/d12/d25/f2d [0,4194304] 0 2024-04-25T02:08:52.740 INFO:tasks.workunit.client.0.smithi077.stdout:8/654: dwrite d3/da/d27/f1e [0,4194304] 0 2024-04-25T02:08:52.740 INFO:tasks.workunit.client.0.smithi077.stdout:4/627: getdents d0/d14/d79/da4/dbc 0 2024-04-25T02:08:52.745 INFO:tasks.workunit.client.0.smithi077.stdout:8/655: unlink d3/da/db/df/d2b/c5e 0 2024-04-25T02:08:52.745 INFO:tasks.workunit.client.0.smithi077.stdout:3/594: write d0/d2/d2f/f32 [2863212,8108] 0 2024-04-25T02:08:52.745 INFO:tasks.workunit.client.0.smithi077.stdout:3/595: chown d0/d2/de/d27/cb3 180 1 2024-04-25T02:08:52.745 INFO:tasks.workunit.client.0.smithi077.stdout:3/596: dread - d0/d2/d2f/d5f/f9b zero size 2024-04-25T02:08:52.745 INFO:tasks.workunit.client.0.smithi077.stdout:3/597: truncate d0/f9 5493832 0 2024-04-25T02:08:52.745 INFO:tasks.workunit.client.0.smithi077.stdout:4/628: truncate d0/d14/d21/d39/da/f2d 4144182 0 2024-04-25T02:08:52.745 INFO:tasks.workunit.client.0.smithi077.stdout:6/744: dread de/d55/f9a [0,4194304] 0 2024-04-25T02:08:52.745 INFO:tasks.workunit.client.0.smithi077.stdout:6/745: write de/f2c [4376278,74201] 0 2024-04-25T02:08:52.745 INFO:tasks.workunit.client.0.smithi077.stdout:6/746: write de/d12/d25/d4b/fe4 [951860,48636] 0 2024-04-25T02:08:52.745 INFO:tasks.workunit.client.0.smithi077.stdout:8/656: symlink d3/lc8 0 2024-04-25T02:08:52.749 INFO:tasks.workunit.client.0.smithi077.stdout:0/624: dwrite d2/d8/d5f/fb4 [0,4194304] 0 2024-04-25T02:08:52.749 INFO:tasks.workunit.client.0.smithi077.stdout:3/598: link d0/d3e/d42/c73 d0/d2/cd7 0 2024-04-25T02:08:52.749 INFO:tasks.workunit.client.0.smithi077.stdout:3/599: chown d0/d3e/d42/d64/d88/d9c 4249612 1 2024-04-25T02:08:52.751 INFO:tasks.workunit.client.0.smithi077.stdout:6/747: symlink de/lfb 0 2024-04-25T02:08:52.754 INFO:tasks.workunit.client.0.smithi077.stdout:6/748: dread de/d53/f69 [0,4194304] 0 2024-04-25T02:08:52.754 INFO:tasks.workunit.client.0.smithi077.stdout:0/625: symlink d2/d8/db6/ld9 0 2024-04-25T02:08:52.754 INFO:tasks.workunit.client.0.smithi077.stdout:0/626: read - d2/d17/d4e/f85 zero size 2024-04-25T02:08:52.757 INFO:tasks.workunit.client.0.smithi077.stdout:3/600: creat d0/d3e/da1/fd8 x:0 0 0 2024-04-25T02:08:52.757 INFO:tasks.workunit.client.0.smithi077.stdout:3/601: chown d0/d40/l49 0 1 2024-04-25T02:08:52.758 INFO:tasks.workunit.client.0.smithi077.stdout:8/657: getdents d3/da/db/df/d2b 0 2024-04-25T02:08:52.760 INFO:tasks.workunit.client.0.smithi077.stdout:6/749: mkdir de/d53/d78/dfc 0 2024-04-25T02:08:52.761 INFO:tasks.workunit.client.0.smithi077.stdout:4/629: dwrite d0/d14/d60/d86/d25/f31 [0,4194304] 0 2024-04-25T02:08:52.762 INFO:tasks.workunit.client.0.smithi077.stdout:0/627: rmdir d2/d17/d1d/d34/d4c/da2 39 2024-04-25T02:08:52.768 INFO:tasks.workunit.client.0.smithi077.stdout:8/658: mkdir d3/d34/dc9 0 2024-04-25T02:08:52.775 INFO:tasks.workunit.client.0.smithi077.stdout:8/659: dread d3/da/d27/f21 [0,4194304] 0 2024-04-25T02:08:52.775 INFO:tasks.workunit.client.0.smithi077.stdout:8/660: chown d3/da/db/df/c65 22556 1 2024-04-25T02:08:52.775 INFO:tasks.workunit.client.0.smithi077.stdout:8/661: stat d3/da/d27/d44/fad 0 2024-04-25T02:08:52.776 INFO:tasks.workunit.client.0.smithi077.stdout:7/551: sync 2024-04-25T02:08:52.776 INFO:tasks.workunit.client.0.smithi077.stdout:4/630: creat d0/d14/d21/d39/da/d12/d35/d3e/d3a/fcd x:0 0 0 2024-04-25T02:08:52.776 INFO:tasks.workunit.client.0.smithi077.stdout:4/631: readlink d0/d14/d21/d39/da/d12/l84 0 2024-04-25T02:08:52.777 INFO:tasks.workunit.client.0.smithi077.stdout:4/632: dread d0/d14/d60/fa7 [0,4194304] 0 2024-04-25T02:08:52.780 INFO:tasks.workunit.client.0.smithi077.stdout:3/602: symlink d0/d2/d2f/ld9 0 2024-04-25T02:08:52.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:52 smithi112 ceph-mon[33313]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:08:52.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:52 smithi112 ceph-mon[33313]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:08:52.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:52 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/3549139199' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:08:52.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:52 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:08:52.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:52 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:08:52.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:52 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:08:52.782 INFO:tasks.workunit.client.0.smithi077.stdout:8/662: dread d3/f7 [0,4194304] 0 2024-04-25T02:08:52.782 INFO:tasks.workunit.client.0.smithi077.stdout:8/663: write d3/d34/d3d/f91 [842314,36198] 0 2024-04-25T02:08:52.782 INFO:tasks.workunit.client.0.smithi077.stdout:8/664: mkdir d3/d81/dca 0 2024-04-25T02:08:52.782 INFO:tasks.workunit.client.0.smithi077.stdout:8/665: write d3/da/db/df/d30/f89 [1997585,100803] 0 2024-04-25T02:08:52.782 INFO:tasks.workunit.client.0.smithi077.stdout:8/666: chown d3/da/c26 14 1 2024-04-25T02:08:52.784 INFO:tasks.workunit.client.0.smithi077.stdout:3/603: rmdir d0/d2/d2f/d50/d5c 0 2024-04-25T02:08:52.785 INFO:tasks.workunit.client.0.smithi077.stdout:8/667: write d3/da/db/df/f10 [1373448,50582] 0 2024-04-25T02:08:52.785 INFO:tasks.workunit.client.0.smithi077.stdout:3/604: dread d0/d17/f5d [0,4194304] 0 2024-04-25T02:08:52.785 INFO:tasks.workunit.client.0.smithi077.stdout:3/605: chown d0/d3e/d42/c4c 4 1 2024-04-25T02:08:52.787 INFO:tasks.workunit.client.0.smithi077.stdout:4/633: write d0/d14/d21/d39/da/d12/d35/f71 [7956273,33152] 0 2024-04-25T02:08:52.789 INFO:tasks.workunit.client.0.smithi077.stdout:8/668: rename d3/da/d27/d8e to d3/d34/dc9/dcb 0 2024-04-25T02:08:52.789 INFO:tasks.workunit.client.0.smithi077.stdout:8/669: creat d3/d7a/d7e/fcc x:0 0 0 2024-04-25T02:08:52.789 INFO:tasks.workunit.client.0.smithi077.stdout:8/670: chown d3/da/d27/d44/c5c 77980 1 2024-04-25T02:08:52.789 INFO:tasks.workunit.client.0.smithi077.stdout:8/671: readlink d3/da/d27/d16/d8c/la5 0 2024-04-25T02:08:52.790 INFO:tasks.workunit.client.0.smithi077.stdout:4/634: mkdir d0/d14/d60/d78/dce 0 2024-04-25T02:08:52.792 INFO:tasks.workunit.client.0.smithi077.stdout:3/606: dread d0/d2/de/d36/fb7 [0,4194304] 0 2024-04-25T02:08:52.793 INFO:tasks.workunit.client.0.smithi077.stdout:8/672: link d3/da/db/df/c43 d3/da/ccd 0 2024-04-25T02:08:52.796 INFO:tasks.workunit.client.0.smithi077.stdout:0/628: dwrite d2/d8/d5f/fc2 [0,4194304] 0 2024-04-25T02:08:52.796 INFO:tasks.workunit.client.0.smithi077.stdout:0/629: write d2/fa3 [131095,718] 0 2024-04-25T02:08:52.796 INFO:tasks.workunit.client.0.smithi077.stdout:6/750: dwrite de/d55/d88/fb3 [0,4194304] 0 2024-04-25T02:08:52.796 INFO:tasks.workunit.client.0.smithi077.stdout:7/552: dwrite d4/f50 [0,4194304] 0 2024-04-25T02:08:52.797 INFO:tasks.workunit.client.0.smithi077.stdout:3/607: link d0/d3e/d93/dae/lbb d0/d3e/d42/d64/lda 0 2024-04-25T02:08:52.798 INFO:tasks.workunit.client.0.smithi077.stdout:8/673: mknod d3/d7a/cce 0 2024-04-25T02:08:52.799 INFO:tasks.workunit.client.0.smithi077.stdout:4/635: getdents d0/d14/d60 0 2024-04-25T02:08:52.815 INFO:tasks.workunit.client.0.smithi077.stdout:6/751: creat de/d12/d25/ffd x:0 0 0 2024-04-25T02:08:52.815 INFO:tasks.workunit.client.0.smithi077.stdout:6/752: readlink de/d55/d88/lcc 0 2024-04-25T02:08:52.815 INFO:tasks.workunit.client.0.smithi077.stdout:6/753: chown de/d12/d25/d3a/d6a/dcd/d36/c93 26 1 2024-04-25T02:08:52.816 INFO:tasks.workunit.client.0.smithi077.stdout:8/674: symlink d3/da/d27/d16/d6b/lcf 0 2024-04-25T02:08:52.818 INFO:tasks.workunit.client.0.smithi077.stdout:4/636: creat d0/d14/d60/d86/d96/fcf x:0 0 0 2024-04-25T02:08:52.819 INFO:tasks.workunit.client.0.smithi077.stdout:6/754: truncate de/d12/d25/f2d 1077832 0 2024-04-25T02:08:52.819 INFO:tasks.workunit.client.0.smithi077.stdout:6/755: chown de/d53/d76/leb 11466876 1 2024-04-25T02:08:52.819 INFO:tasks.workunit.client.0.smithi077.stdout:6/756: fsync de/d53/f61 0 2024-04-25T02:08:52.820 INFO:tasks.workunit.client.0.smithi077.stdout:8/675: truncate d3/da/db/df/d2b/f8d 2716740 0 2024-04-25T02:08:52.820 INFO:tasks.workunit.client.0.smithi077.stdout:8/676: write d3/d34/fa9 [49538,109906] 0 2024-04-25T02:08:52.821 INFO:tasks.workunit.client.0.smithi077.stdout:4/637: creat d0/d14/d21/d39/da/fd0 x:0 0 0 2024-04-25T02:08:52.822 INFO:tasks.workunit.client.0.smithi077.stdout:8/677: creat d3/fd0 x:0 0 0 2024-04-25T02:08:52.825 INFO:tasks.workunit.client.0.smithi077.stdout:8/678: symlink d3/d81/d86/ld1 0 2024-04-25T02:08:52.825 INFO:tasks.workunit.client.0.smithi077.stdout:8/679: read - d3/da/d27/d16/d8c/f93 zero size 2024-04-25T02:08:52.825 INFO:tasks.workunit.client.0.smithi077.stdout:8/680: write d3/da/db/df/d30/f92 [323685,13140] 0 2024-04-25T02:08:52.825 INFO:tasks.workunit.client.0.smithi077.stdout:8/681: chown d3/d34/d3d/f91 4478 1 2024-04-25T02:08:52.826 INFO:tasks.workunit.client.0.smithi077.stdout:8/682: chown d3/da/db/df/d2b/d37/f94 1 1 2024-04-25T02:08:52.826 INFO:tasks.workunit.client.0.smithi077.stdout:8/683: write d3/d7a/d7e/fcc [659630,54323] 0 2024-04-25T02:08:52.826 INFO:tasks.workunit.client.0.smithi077.stdout:8/684: write d3/da/f35 [817789,25806] 0 2024-04-25T02:08:52.828 INFO:tasks.workunit.client.0.smithi077.stdout:7/553: dwrite d4/d13/d18/d2d/f75 [0,4194304] 0 2024-04-25T02:08:52.831 INFO:tasks.workunit.client.0.smithi077.stdout:1/615: sync 2024-04-25T02:08:52.831 INFO:tasks.workunit.client.0.smithi077.stdout:2/616: sync 2024-04-25T02:08:52.831 INFO:tasks.workunit.client.0.smithi077.stdout:1/616: truncate db/d26/f3c 1280200 0 2024-04-25T02:08:52.831 INFO:tasks.workunit.client.0.smithi077.stdout:1/617: write db/fd [555089,121411] 0 2024-04-25T02:08:52.831 INFO:tasks.workunit.client.0.smithi077.stdout:7/554: unlink d4/d13/da9/c81 0 2024-04-25T02:08:52.831 INFO:tasks.workunit.client.0.smithi077.stdout:7/555: chown d4/d13/d18/d2d/d30/l49 7923106 1 2024-04-25T02:08:52.832 INFO:tasks.workunit.client.0.smithi077.stdout:8/685: dread d3/da/d27/d16/f66 [0,4194304] 0 2024-04-25T02:08:52.832 INFO:tasks.workunit.client.0.smithi077.stdout:6/757: dread de/d5b/da6/fd8 [0,4194304] 0 2024-04-25T02:08:52.832 INFO:tasks.workunit.client.0.smithi077.stdout:0/630: dwrite d2/d17/d4e/f95 [0,4194304] 0 2024-04-25T02:08:52.832 INFO:tasks.workunit.client.0.smithi077.stdout:0/631: write d2/d17/d4e/f9b [1051843,8242] 0 2024-04-25T02:08:52.836 INFO:tasks.workunit.client.0.smithi077.stdout:4/638: dwrite d0/d14/d21/d39/d64/f82 [0,4194304] 0 2024-04-25T02:08:52.836 INFO:tasks.workunit.client.0.smithi077.stdout:4/639: fsync d0/d14/f33 0 2024-04-25T02:08:52.836 INFO:tasks.workunit.client.0.smithi077.stdout:4/640: dread - d0/d14/d21/d39/d1d/f73 zero size 2024-04-25T02:08:52.836 INFO:tasks.workunit.client.0.smithi077.stdout:1/618: write db/df/d14/f67 [806401,111964] 0 2024-04-25T02:08:52.836 INFO:tasks.workunit.client.0.smithi077.stdout:1/619: stat db/df/d14/d4d/d82/f39 0 2024-04-25T02:08:52.836 INFO:tasks.workunit.client.0.smithi077.stdout:1/620: fdatasync db/df/d14/d3e/d69/fa0 0 2024-04-25T02:08:52.837 INFO:tasks.workunit.client.0.smithi077.stdout:1/621: write db/df/d14/d3e/d69/faf [1408518,31089] 0 2024-04-25T02:08:52.838 INFO:tasks.workunit.client.0.smithi077.stdout:6/758: mknod de/d53/d6f/cfe 0 2024-04-25T02:08:52.840 INFO:tasks.workunit.client.0.smithi077.stdout:0/632: rename d2/d17/d1d/d34/fcc to d2/d8/db6/dd7/fda 0 2024-04-25T02:08:52.854 INFO:tasks.workunit.client.0.smithi077.stdout:7/556: rmdir d4 39 2024-04-25T02:08:52.854 INFO:tasks.workunit.client.0.smithi077.stdout:7/557: truncate d4/f51 1359102 0 2024-04-25T02:08:52.856 INFO:tasks.workunit.client.0.smithi077.stdout:6/759: dwrite de/d12/d25/d3a/f5f [0,4194304] 0 2024-04-25T02:08:52.857 INFO:tasks.workunit.client.0.smithi077.stdout:4/641: truncate d0/f16 3167086 0 2024-04-25T02:08:52.859 INFO:tasks.workunit.client.0.smithi077.stdout:1/622: link db/df/d14/d3e/daa/lc8 db/df/d56/dc3/dcd/ld5 0 2024-04-25T02:08:52.863 INFO:tasks.workunit.client.0.smithi077.stdout:8/686: truncate d3/da/db/df/d30/f92 63281 0 2024-04-25T02:08:52.863 INFO:tasks.workunit.client.0.smithi077.stdout:8/687: getdents d3/da/d27/d44/db1/dc1 0 2024-04-25T02:08:52.863 INFO:tasks.workunit.client.0.smithi077.stdout:8/688: chown d3/c3e 26 1 2024-04-25T02:08:52.864 INFO:tasks.workunit.client.0.smithi077.stdout:0/633: fsync d2/d27/d2d/f2f 0 2024-04-25T02:08:52.865 INFO:tasks.workunit.client.0.smithi077.stdout:7/558: rename d4/d13/d18/f71 to d4/d13/d5b/fbc 0 2024-04-25T02:08:52.869 INFO:tasks.workunit.client.0.smithi077.stdout:6/760: creat de/d55/dc2/fff x:0 0 0 2024-04-25T02:08:52.869 INFO:tasks.workunit.client.0.smithi077.stdout:6/761: write de/d12/f2a [3155609,128378] 0 2024-04-25T02:08:52.871 INFO:tasks.workunit.client.0.smithi077.stdout:4/642: symlink d0/d14/d21/d39/da/d12/d35/ld1 0 2024-04-25T02:08:52.871 INFO:tasks.workunit.client.0.smithi077.stdout:4/643: write d0/d14/d21/d39/d9a/fa0 [713216,98614] 0 2024-04-25T02:08:52.877 INFO:tasks.workunit.client.0.smithi077.stdout:7/559: dread - d4/d13/d66/f73 zero size 2024-04-25T02:08:52.878 INFO:tasks.workunit.client.0.smithi077.stdout:8/689: dwrite d3/da/db/df/d2b/d37/f67 [0,4194304] 0 2024-04-25T02:08:52.880 INFO:tasks.workunit.client.0.smithi077.stdout:6/762: symlink de/d12/d25/d60/l100 0 2024-04-25T02:08:52.882 INFO:tasks.workunit.client.0.smithi077.stdout:4/644: link d0/d14/d21/d39/f76 d0/d14/d21/d39/d64/fd2 0 2024-04-25T02:08:52.883 INFO:tasks.workunit.client.0.smithi077.stdout:0/634: truncate d2/d27/d2d/fca 2346153 0 2024-04-25T02:08:52.883 INFO:tasks.workunit.client.0.smithi077.stdout:0/635: write d2/d8/d5f/f6c [1424682,96189] 0 2024-04-25T02:08:52.884 INFO:tasks.workunit.client.0.smithi077.stdout:7/560: mknod d4/d13/d18/d24/d3f/d58/cbd 0 2024-04-25T02:08:52.887 INFO:tasks.workunit.client.0.smithi077.stdout:0/636: symlink d2/d8/db6/d74/ldb 0 2024-04-25T02:08:52.887 INFO:tasks.workunit.client.0.smithi077.stdout:0/637: write d2/d17/d4e/d5e/fb7 [370241,18335] 0 2024-04-25T02:08:52.889 INFO:tasks.workunit.client.0.smithi077.stdout:7/561: creat d4/d13/d18/d2d/d56/d68/fbe x:0 0 0 2024-04-25T02:08:52.889 INFO:tasks.workunit.client.0.smithi077.stdout:7/562: write d4/d13/d5b/fbc [1618204,11051] 0 2024-04-25T02:08:52.889 INFO:tasks.workunit.client.0.smithi077.stdout:7/563: readlink d4/d13/d18/d2d/d30/l45 0 2024-04-25T02:08:52.889 INFO:tasks.workunit.client.0.smithi077.stdout:7/564: write d4/d13/da9/fad [303179,41919] 0 2024-04-25T02:08:52.890 INFO:tasks.workunit.client.0.smithi077.stdout:8/690: read d3/da/db/df/d2b/d37/f67 [2321897,117519] 0 2024-04-25T02:08:52.892 INFO:tasks.workunit.client.0.smithi077.stdout:6/763: dread de/d5b/f82 [0,4194304] 0 2024-04-25T02:08:52.894 INFO:tasks.workunit.client.0.smithi077.stdout:0/638: symlink d2/d17/d4e/d5e/ldc 0 2024-04-25T02:08:52.894 INFO:tasks.workunit.client.0.smithi077.stdout:0/639: write d2/d27/f8e [4615227,114402] 0 2024-04-25T02:08:52.898 INFO:tasks.workunit.client.0.smithi077.stdout:7/565: creat d4/d13/d18/d24/fbf x:0 0 0 2024-04-25T02:08:52.911 INFO:tasks.workunit.client.0.smithi077.stdout:4/645: dwrite d0/d14/d21/d39/f3b [0,4194304] 0 2024-04-25T02:08:52.911 INFO:tasks.workunit.client.0.smithi077.stdout:4/646: write d0/d14/d60/d86/d96/f97 [1335238,31270] 0 2024-04-25T02:08:52.912 INFO:tasks.workunit.client.0.smithi077.stdout:4/647: write d0/d14/d60/d62/f68 [1683828,69604] 0 2024-04-25T02:08:52.914 INFO:tasks.workunit.client.0.smithi077.stdout:6/764: dread de/d12/d25/f83 [0,4194304] 0 2024-04-25T02:08:52.916 INFO:tasks.workunit.client.0.smithi077.stdout:8/691: dwrite d3/fc7 [0,4194304] 0 2024-04-25T02:08:52.916 INFO:tasks.workunit.client.0.smithi077.stdout:4/648: symlink d0/d14/d21/d39/d9a/ld3 0 2024-04-25T02:08:52.917 INFO:tasks.workunit.client.0.smithi077.stdout:6/765: unlink de/lfb 0 2024-04-25T02:08:52.920 INFO:tasks.workunit.client.0.smithi077.stdout:8/692: rename d3/d81/dca to d3/da/d27/d16/dd2 0 2024-04-25T02:08:52.922 INFO:tasks.workunit.client.0.smithi077.stdout:8/693: mknod d3/da/db/df/cd3 0 2024-04-25T02:08:52.922 INFO:tasks.workunit.client.0.smithi077.stdout:8/694: fdatasync d3/f7 0 2024-04-25T02:08:52.923 INFO:tasks.workunit.client.0.smithi077.stdout:4/649: rmdir d0/d14/d21/d39/da 39 2024-04-25T02:08:52.923 INFO:tasks.workunit.client.0.smithi077.stdout:4/650: stat d0/d14/d21/d39/d9a/la2 0 2024-04-25T02:08:52.924 INFO:tasks.workunit.client.0.smithi077.stdout:8/695: mknod d3/da/db/df/d30/cd4 0 2024-04-25T02:08:52.924 INFO:tasks.workunit.client.0.smithi077.stdout:4/651: rmdir d0/d14/d60 39 2024-04-25T02:08:52.926 INFO:tasks.workunit.client.0.smithi077.stdout:0/640: dwrite d2/d17/d1d/d34/d4c/f72 [0,4194304] 0 2024-04-25T02:08:52.926 INFO:tasks.workunit.client.0.smithi077.stdout:0/641: stat d2/d27/d2d/dce 0 2024-04-25T02:08:52.926 INFO:tasks.workunit.client.0.smithi077.stdout:0/642: dread - d2/d9/f65 zero size 2024-04-25T02:08:52.927 INFO:tasks.workunit.client.0.smithi077.stdout:7/566: dwrite d4/d13/d66/fa2 [0,4194304] 0 2024-04-25T02:08:52.927 INFO:tasks.workunit.client.0.smithi077.stdout:8/696: rename d3/da/f29 to d3/da/d27/d16/dbc/fd5 0 2024-04-25T02:08:52.929 INFO:tasks.workunit.client.0.smithi077.stdout:4/652: mkdir d0/d14/d79/da4/dac/dd4 0 2024-04-25T02:08:52.929 INFO:tasks.workunit.client.0.smithi077.stdout:4/653: write d0/f72 [621607,1669] 0 2024-04-25T02:08:52.931 INFO:tasks.workunit.client.0.smithi077.stdout:0/643: link d2/d8/db6/d74/ldb d2/d9/d2a/ldd 0 2024-04-25T02:08:52.934 INFO:tasks.workunit.client.0.smithi077.stdout:7/567: rename d4/d13/f4e to d4/d13/d5b/d8b/fc0 0 2024-04-25T02:08:52.936 INFO:tasks.workunit.client.0.smithi077.stdout:8/697: rename d3/da/d27/d16/l83 to d3/da/db/ld6 0 2024-04-25T02:08:52.938 INFO:tasks.workunit.client.0.smithi077.stdout:6/766: dwrite de/d12/d25/d3a/d6a/f7e [0,4194304] 0 2024-04-25T02:08:52.939 INFO:tasks.workunit.client.0.smithi077.stdout:6/767: fdatasync de/d55/dc2/fff 0 2024-04-25T02:08:52.940 INFO:tasks.workunit.client.0.smithi077.stdout:8/698: rename d3/da/db/df/c41 to d3/da/db/cd7 0 2024-04-25T02:08:52.940 INFO:tasks.workunit.client.0.smithi077.stdout:8/699: getdents d3/da/db/df/d30/db9 0 2024-04-25T02:08:52.944 INFO:tasks.workunit.client.0.smithi077.stdout:4/654: write d0/d14/d60/d86/d25/f45 [4007483,73664] 0 2024-04-25T02:08:52.946 INFO:tasks.workunit.client.0.smithi077.stdout:6/768: unlink de/d53/fcf 0 2024-04-25T02:08:52.946 INFO:tasks.workunit.client.0.smithi077.stdout:0/644: dread d2/d17/d4e/fb0 [0,4194304] 0 2024-04-25T02:08:52.949 INFO:tasks.workunit.client.0.smithi077.stdout:7/568: dwrite d4/d13/f9c [0,4194304] 0 2024-04-25T02:08:52.949 INFO:tasks.workunit.client.0.smithi077.stdout:7/569: chown d4/d13/d18/d2d/f75 131277798 1 2024-04-25T02:08:52.952 INFO:tasks.workunit.client.0.smithi077.stdout:0/645: rename d2/d17/d1d/c6e to d2/d8/db6/d74/da7/cde 0 2024-04-25T02:08:52.952 INFO:tasks.workunit.client.0.smithi077.stdout:0/646: fdatasync d2/d1c/faf 0 2024-04-25T02:08:52.956 INFO:tasks.workunit.client.0.smithi077.stdout:9/648: sync 2024-04-25T02:08:52.956 INFO:tasks.workunit.client.0.smithi077.stdout:5/623: sync 2024-04-25T02:08:52.956 INFO:tasks.workunit.client.0.smithi077.stdout:5/624: chown d0/d25/d82/d87/d8b/da5/dc4/f21 4762659 1 2024-04-25T02:08:52.956 INFO:tasks.workunit.client.0.smithi077.stdout:5/625: chown d0/d2/ff 1089067 1 2024-04-25T02:08:52.960 INFO:tasks.workunit.client.0.smithi077.stdout:6/769: dread de/f2c [0,4194304] 0 2024-04-25T02:08:52.962 INFO:tasks.workunit.client.0.smithi077.stdout:7/570: write d4/d13/d18/d24/f3b [3082407,57318] 0 2024-04-25T02:08:52.962 INFO:tasks.workunit.client.0.smithi077.stdout:4/655: dwrite d0/d14/d21/f22 [0,4194304] 0 2024-04-25T02:08:52.962 INFO:tasks.workunit.client.0.smithi077.stdout:7/571: fdatasync d4/f16 0 2024-04-25T02:08:52.964 INFO:tasks.workunit.client.0.smithi077.stdout:8/700: getdents d3/da/d27/d16/dbc 0 2024-04-25T02:08:52.968 INFO:tasks.workunit.client.0.smithi077.stdout:0/647: mkdir d2/d8/db6/d74/da7/ddf 0 2024-04-25T02:08:52.969 INFO:tasks.workunit.client.0.smithi077.stdout:9/649: symlink df/d1b/d48/ld6 0 2024-04-25T02:08:52.970 INFO:tasks.workunit.client.0.smithi077.stdout:6/770: symlink de/d53/db2/l101 0 2024-04-25T02:08:52.973 INFO:tasks.workunit.client.0.smithi077.stdout:7/572: creat d4/d13/d66/fc1 x:0 0 0 2024-04-25T02:08:52.973 INFO:tasks.workunit.client.0.smithi077.stdout:7/573: write d4/d13/d66/f73 [345606,67592] 0 2024-04-25T02:08:52.973 INFO:tasks.workunit.client.0.smithi077.stdout:7/574: readlink d4/d13/l62 0 2024-04-25T02:08:52.974 INFO:tasks.workunit.client.0.smithi077.stdout:4/656: symlink d0/d14/d79/da4/dac/dd4/ld5 0 2024-04-25T02:08:52.975 INFO:tasks.workunit.client.0.smithi077.stdout:8/701: creat d3/d34/dc9/fd8 x:0 0 0 2024-04-25T02:08:52.976 INFO:tasks.workunit.client.0.smithi077.stdout:0/648: mkdir d2/d8/db6/dd7/de0 0 2024-04-25T02:08:52.979 INFO:tasks.workunit.client.0.smithi077.stdout:9/650: creat df/d1b/fd7 x:0 0 0 2024-04-25T02:08:52.979 INFO:tasks.workunit.client.0.smithi077.stdout:9/651: chown df/d1b/d70 18262 1 2024-04-25T02:08:52.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:52 smithi077 ceph-mon[26330]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:08:52.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:52 smithi077 ceph-mon[26330]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:08:52.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:52 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/3549139199' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:08:52.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:52 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:08:52.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:52 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:08:52.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:52 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:08:52.980 INFO:tasks.workunit.client.0.smithi077.stdout:5/626: dwrite d0/d2/d3/d9/d39/d3c/f93 [0,4194304] 0 2024-04-25T02:08:52.982 INFO:tasks.workunit.client.0.smithi077.stdout:6/771: mkdir de/d53/d76/d102 0 2024-04-25T02:08:52.983 INFO:tasks.workunit.client.0.smithi077.stdout:7/575: mknod d4/d13/d18/d2d/d30/dab/cc2 0 2024-04-25T02:08:52.985 INFO:tasks.workunit.client.0.smithi077.stdout:4/657: link d0/d14/d21/f2a d0/d14/d60/d78/dce/fd6 0 2024-04-25T02:08:52.985 INFO:tasks.workunit.client.0.smithi077.stdout:4/658: chown d0/d14/d60/d86/d34/fbe 55 1 2024-04-25T02:08:52.985 INFO:tasks.workunit.client.0.smithi077.stdout:4/659: creat d0/d14/d21/d39/d1d/d98/fd7 x:0 0 0 2024-04-25T02:08:52.986 INFO:tasks.workunit.client.0.smithi077.stdout:8/702: symlink d3/d7a/d7e/ld9 0 2024-04-25T02:08:52.986 INFO:tasks.workunit.client.0.smithi077.stdout:8/703: creat d3/da/fda x:0 0 0 2024-04-25T02:08:52.988 INFO:tasks.workunit.client.0.smithi077.stdout:9/652: link df/f49 df/fd8 0 2024-04-25T02:08:52.989 INFO:tasks.workunit.client.0.smithi077.stdout:2/617: sync 2024-04-25T02:08:52.989 INFO:tasks.workunit.client.0.smithi077.stdout:1/623: sync 2024-04-25T02:08:52.989 INFO:tasks.workunit.client.0.smithi077.stdout:3/608: sync 2024-04-25T02:08:52.989 INFO:tasks.workunit.client.0.smithi077.stdout:2/618: fdatasync d2/d9/d19/f1a 0 2024-04-25T02:08:52.989 INFO:tasks.workunit.client.0.smithi077.stdout:1/624: dread - db/df/d56/d5d/d77/f91 zero size 2024-04-25T02:08:52.993 INFO:tasks.workunit.client.0.smithi077.stdout:6/772: write de/d12/f7a [980003,44392] 0 2024-04-25T02:08:52.993 INFO:tasks.workunit.client.0.smithi077.stdout:5/627: rename d0/d2/d3/fc1 to d0/d2/d3/d9/d90/fce 0 2024-04-25T02:08:52.993 INFO:tasks.workunit.client.0.smithi077.stdout:5/628: fsync d0/f85 0 2024-04-25T02:08:52.996 INFO:tasks.workunit.client.0.smithi077.stdout:6/773: dread de/d5b/f82 [0,4194304] 0 2024-04-25T02:08:52.997 INFO:tasks.workunit.client.0.smithi077.stdout:7/576: symlink d4/d13/da9/lc3 0 2024-04-25T02:08:53.003 INFO:tasks.workunit.client.0.smithi077.stdout:3/609: getdents d0/d3e/d62/d6a 0 2024-04-25T02:08:53.003 INFO:tasks.workunit.client.0.smithi077.stdout:3/610: chown d0/d2/d2f/d5f/ld0 2 1 2024-04-25T02:08:53.005 INFO:tasks.workunit.client.0.smithi077.stdout:2/619: creat d2/d9/d2f/d84/da6/fcf x:0 0 0 2024-04-25T02:08:53.009 INFO:tasks.workunit.client.0.smithi077.stdout:8/704: rename d3/da/db/df/f33 to d3/d7a/d7e/fdb 0 2024-04-25T02:08:53.010 INFO:tasks.workunit.client.0.smithi077.stdout:8/705: fdatasync d3/da/db/fa1 0 2024-04-25T02:08:53.012 INFO:tasks.workunit.client.0.smithi077.stdout:7/577: mkdir d4/d13/d18/d2d/d30/dc4 0 2024-04-25T02:08:53.015 INFO:tasks.workunit.client.0.smithi077.stdout:4/660: link d0/d14/d21/d39/da/fab d0/d14/d79/fd8 0 2024-04-25T02:08:53.016 INFO:tasks.workunit.client.0.smithi077.stdout:3/611: symlink d0/d17/d4b/d59/dc2/ldb 0 2024-04-25T02:08:53.018 INFO:tasks.workunit.client.0.smithi077.stdout:2/620: creat d2/d9/fd0 x:0 0 0 2024-04-25T02:08:53.021 INFO:tasks.workunit.client.0.smithi077.stdout:9/653: rename f5 to df/d60/d87/dca/fd9 0 2024-04-25T02:08:53.021 INFO:tasks.workunit.client.0.smithi077.stdout:9/654: stat df/d1b/d70/d74/fbb 0 2024-04-25T02:08:53.021 INFO:tasks.workunit.client.0.smithi077.stdout:6/774: rmdir de/d95 39 2024-04-25T02:08:53.023 INFO:tasks.workunit.client.0.smithi077.stdout:3/612: link d0/d3e/d42/d64/lda d0/d3e/d62/d6a/db9/ldc 0 2024-04-25T02:08:53.024 INFO:tasks.workunit.client.0.smithi077.stdout:3/613: fsync d0/d2/f34 0 2024-04-25T02:08:53.025 INFO:tasks.workunit.client.0.smithi077.stdout:2/621: getdents d2/d9/d19/d1c/d3f/d53/d86/dca 0 2024-04-25T02:08:53.025 INFO:tasks.workunit.client.0.smithi077.stdout:2/622: creat d2/d59/d79/fd1 x:0 0 0 2024-04-25T02:08:53.025 INFO:tasks.workunit.client.0.smithi077.stdout:2/623: chown d2/d9/d18/d31/c41 12754268 1 2024-04-25T02:08:53.025 INFO:tasks.workunit.client.0.smithi077.stdout:2/624: readlink d2/d9/d19/d1c/d3f/d53/d86/la8 0 2024-04-25T02:08:53.028 INFO:tasks.workunit.client.0.smithi077.stdout:1/625: rename db/f3b to db/df/d56/d5d/fd6 0 2024-04-25T02:08:53.029 INFO:tasks.workunit.client.0.smithi077.stdout:9/655: creat df/d1b/d70/d84/fda x:0 0 0 2024-04-25T02:08:53.031 INFO:tasks.workunit.client.0.smithi077.stdout:6/775: creat de/d53/db2/f103 x:0 0 0 2024-04-25T02:08:53.031 INFO:tasks.workunit.client.0.smithi077.stdout:6/776: write de/d12/d25/f9f [4469065,48140] 0 2024-04-25T02:08:53.031 INFO:tasks.workunit.client.0.smithi077.stdout:3/614: mkdir d0/d2/de/d36/da0/ddd 0 2024-04-25T02:08:53.031 INFO:tasks.workunit.client.0.smithi077.stdout:3/615: stat d0/d2/de/d48 0 2024-04-25T02:08:53.033 INFO:tasks.workunit.client.0.smithi077.stdout:5/629: rename d0/d25/dc7/dca/f97 to d0/d25/d82/d87/d8b/d5a/db4/fcf 0 2024-04-25T02:08:53.035 INFO:tasks.workunit.client.0.smithi077.stdout:9/656: dread df/f49 [0,4194304] 0 2024-04-25T02:08:53.036 INFO:tasks.workunit.client.0.smithi077.stdout:3/616: mkdir d0/d3e/d62/d6a/db9/dde 0 2024-04-25T02:08:53.036 INFO:tasks.workunit.client.0.smithi077.stdout:3/617: chown d0/d17/d4b/d59/faa 2 1 2024-04-25T02:08:53.037 INFO:tasks.workunit.client.0.smithi077.stdout:5/630: dread d0/f86 [0,4194304] 0 2024-04-25T02:08:53.038 INFO:tasks.workunit.client.0.smithi077.stdout:8/706: rename d3/da/db/df/d30/db9 to d3/da/db/df/ddc 0 2024-04-25T02:08:53.041 INFO:tasks.workunit.client.0.smithi077.stdout:6/777: symlink de/d12/d25/l104 0 2024-04-25T02:08:53.043 INFO:tasks.workunit.client.0.smithi077.stdout:9/657: mknod df/d80/cdb 0 2024-04-25T02:08:53.044 INFO:tasks.workunit.client.0.smithi077.stdout:3/618: mknod d0/d40/cdf 0 2024-04-25T02:08:53.044 INFO:tasks.workunit.client.0.smithi077.stdout:3/619: chown d0/d3e/d42/cd5 35 1 2024-04-25T02:08:53.048 INFO:tasks.workunit.client.0.smithi077.stdout:6/778: dread de/d53/d76/f90 [0,4194304] 0 2024-04-25T02:08:53.049 INFO:tasks.workunit.client.0.smithi077.stdout:5/631: unlink d0/d2/d1b/fa2 0 2024-04-25T02:08:53.049 INFO:tasks.workunit.client.0.smithi077.stdout:5/632: write d0/d2/d3/f34 [510001,119839] 0 2024-04-25T02:08:53.052 INFO:tasks.workunit.client.0.smithi077.stdout:2/625: rename d2/d9/d18/d31/d7c/d89/fc0 to d2/d59/fd2 0 2024-04-25T02:08:53.053 INFO:tasks.workunit.client.0.smithi077.stdout:8/707: mknod d3/da/d27/d16/dd2/cdd 0 2024-04-25T02:08:53.055 INFO:tasks.workunit.client.0.smithi077.stdout:3/620: creat d0/d2/de/d48/fe0 x:0 0 0 2024-04-25T02:08:53.059 INFO:tasks.workunit.client.0.smithi077.stdout:5/633: rename d0/d2/d1b/fb5 to d0/d25/d82/d8d/fd0 0 2024-04-25T02:08:53.059 INFO:tasks.workunit.client.0.smithi077.stdout:5/634: truncate d0/d2/d3/d9/d39/d3c/f91 990902 0 2024-04-25T02:08:53.059 INFO:tasks.workunit.client.0.smithi077.stdout:5/635: stat d0/d2/d1b/f76 0 2024-04-25T02:08:53.061 INFO:tasks.workunit.client.0.smithi077.stdout:2/626: unlink d2/d9/d18/d31/f5a 0 2024-04-25T02:08:53.061 INFO:tasks.workunit.client.0.smithi077.stdout:5/636: read d0/d25/d82/d87/f9c [2619174,70866] 0 2024-04-25T02:08:53.061 INFO:tasks.workunit.client.0.smithi077.stdout:5/637: chown d0/d2/d3/db6 227632 1 2024-04-25T02:08:53.062 INFO:tasks.workunit.client.0.smithi077.stdout:5/638: chown d0/d2/d3/l63 40967944 1 2024-04-25T02:08:53.063 INFO:tasks.workunit.client.0.smithi077.stdout:8/708: rename d3/da/db/df/lc6 to d3/d81/lde 0 2024-04-25T02:08:53.064 INFO:tasks.workunit.client.0.smithi077.stdout:3/621: write d0/d2/de/d48/d15/f66 [1811724,46553] 0 2024-04-25T02:08:53.065 INFO:tasks.workunit.client.0.smithi077.stdout:5/639: creat d0/d2/d1b/d3b/fd1 x:0 0 0 2024-04-25T02:08:53.067 INFO:tasks.workunit.client.0.smithi077.stdout:2/627: rename d2/d9/d18/l7e to d2/d9/d19/d1c/ld3 0 2024-04-25T02:08:53.069 INFO:tasks.workunit.client.0.smithi077.stdout:8/709: mkdir d3/da/db/df/ddc/ddf 0 2024-04-25T02:08:53.071 INFO:tasks.workunit.client.0.smithi077.stdout:3/622: creat d0/d3e/d62/d6a/fe1 x:0 0 0 2024-04-25T02:08:53.071 INFO:tasks.workunit.client.0.smithi077.stdout:3/623: fdatasync d0/d2/d2f/f32 0 2024-04-25T02:08:53.071 INFO:tasks.workunit.client.0.smithi077.stdout:3/624: chown d0/d17/d4b/fa3 0 1 2024-04-25T02:08:53.071 INFO:tasks.workunit.client.0.smithi077.stdout:3/625: chown d0/d2/l1c 952284142 1 2024-04-25T02:08:53.071 INFO:tasks.workunit.client.0.smithi077.stdout:3/626: chown d0/d2/de/d27/fc9 482 1 2024-04-25T02:08:53.071 INFO:tasks.workunit.client.0.smithi077.stdout:3/627: readlink d0/d3e/d42/d64/d88/l8c 0 2024-04-25T02:08:53.071 INFO:tasks.workunit.client.0.smithi077.stdout:3/628: chown d0/d3e/d62/lcf 29 1 2024-04-25T02:08:53.071 INFO:tasks.workunit.client.0.smithi077.stdout:5/640: getdents d0/d2/d3/d9/d39 0 2024-04-25T02:08:53.072 INFO:tasks.workunit.client.0.smithi077.stdout:6/779: dwrite de/d12/d25/d4b/f79 [0,4194304] 0 2024-04-25T02:08:53.072 INFO:tasks.workunit.client.0.smithi077.stdout:6/780: write de/d12/d25/d3a/fe0 [559951,125259] 0 2024-04-25T02:08:53.072 INFO:tasks.workunit.client.0.smithi077.stdout:2/628: mkdir d2/d9/d2f/d84/d90/dd4 0 2024-04-25T02:08:53.073 INFO:tasks.workunit.client.0.smithi077.stdout:8/710: creat d3/da/db/df/fe0 x:0 0 0 2024-04-25T02:08:53.075 INFO:tasks.workunit.client.0.smithi077.stdout:3/629: mknod d0/d17/d4b/d59/dd2/ce2 0 2024-04-25T02:08:53.075 INFO:tasks.workunit.client.0.smithi077.stdout:3/630: write d0/d3e/d42/fb5 [163560,1973] 0 2024-04-25T02:08:53.075 INFO:tasks.workunit.client.0.smithi077.stdout:3/631: creat d0/d2/d2f/d50/fe3 x:0 0 0 2024-04-25T02:08:53.077 INFO:tasks.workunit.client.0.smithi077.stdout:5/641: rename d0/d25/d82/d87/d8b/d5a/db4/fcf to d0/d25/d82/d87/d8b/da5/dc4/d23/fd2 0 2024-04-25T02:08:53.078 INFO:tasks.workunit.client.0.smithi077.stdout:1/626: dwrite db/d26/f3c [0,4194304] 0 2024-04-25T02:08:53.080 INFO:tasks.workunit.client.0.smithi077.stdout:8/711: dread d3/da/db/df/d30/f89 [0,4194304] 0 2024-04-25T02:08:53.080 INFO:tasks.workunit.client.0.smithi077.stdout:8/712: write d3/da/f35 [4219184,55697] 0 2024-04-25T02:08:53.080 INFO:tasks.workunit.client.0.smithi077.stdout:2/629: symlink d2/d59/d79/ld5 0 2024-04-25T02:08:53.083 INFO:tasks.workunit.client.0.smithi077.stdout:6/781: read f7 [7514357,77919] 0 2024-04-25T02:08:53.083 INFO:tasks.workunit.client.0.smithi077.stdout:3/632: symlink d0/d3e/d42/le4 0 2024-04-25T02:08:53.083 INFO:tasks.workunit.client.0.smithi077.stdout:6/782: fsync de/d55/d88/fca 0 2024-04-25T02:08:53.083 INFO:tasks.workunit.client.0.smithi077.stdout:6/783: truncate de/d12/d25/d60/fd4 974259 0 2024-04-25T02:08:53.085 INFO:tasks.workunit.client.0.smithi077.stdout:1/627: creat db/df/d56/dc3/fd7 x:0 0 0 2024-04-25T02:08:53.087 INFO:tasks.workunit.client.0.smithi077.stdout:8/713: symlink d3/da/db/df/ddc/le1 0 2024-04-25T02:08:53.087 INFO:tasks.workunit.client.0.smithi077.stdout:8/714: dread - d3/fd0 zero size 2024-04-25T02:08:53.089 INFO:tasks.workunit.client.0.smithi077.stdout:2/630: mknod d2/d9/d56/cd6 0 2024-04-25T02:08:53.092 INFO:tasks.workunit.client.0.smithi077.stdout:3/633: truncate d0/d17/f5d 802964 0 2024-04-25T02:08:53.093 INFO:tasks.workunit.client.0.smithi077.stdout:6/784: creat de/d12/d25/f105 x:0 0 0 2024-04-25T02:08:53.094 INFO:tasks.workunit.client.0.smithi077.stdout:8/715: creat d3/da/db/df/d2b/d7b/fe2 x:0 0 0 2024-04-25T02:08:53.096 INFO:tasks.workunit.client.0.smithi077.stdout:2/631: truncate d2/d9/d18/d1b/f98 504167 0 2024-04-25T02:08:53.106 INFO:tasks.workunit.client.0.smithi077.stdout:6/785: dread f1 [0,4194304] 0 2024-04-25T02:08:53.114 INFO:tasks.workunit.client.0.smithi077.stdout:8/716: write d3/da/db/df/d2b/f3b [4048384,100504] 0 2024-04-25T02:08:53.119 INFO:tasks.workunit.client.0.smithi077.stdout:8/717: dread d3/d81/d86/fae [0,4194304] 0 2024-04-25T02:08:53.119 INFO:tasks.workunit.client.0.smithi077.stdout:1/628: dwrite db/df/f1d [0,4194304] 0 2024-04-25T02:08:53.122 INFO:tasks.workunit.client.0.smithi077.stdout:8/718: creat d3/da/db/df/ddc/ddf/fe3 x:0 0 0 2024-04-25T02:08:53.122 INFO:tasks.workunit.client.0.smithi077.stdout:8/719: truncate d3/da/d27/d44/fad 100256 0 2024-04-25T02:08:53.123 INFO:tasks.workunit.client.0.smithi077.stdout:8/720: symlink d3/da/db/df/ddc/ddf/le4 0 2024-04-25T02:08:53.124 INFO:tasks.workunit.client.0.smithi077.stdout:8/721: fdatasync d3/da/d27/f6c 0 2024-04-25T02:08:53.125 INFO:tasks.workunit.client.0.smithi077.stdout:3/634: dwrite d0/d2/f34 [0,4194304] 0 2024-04-25T02:08:53.125 INFO:tasks.workunit.client.0.smithi077.stdout:5/642: dwrite d0/d2/d3/d9/d39/d44/d5f/f73 [0,4194304] 0 2024-04-25T02:08:53.126 INFO:tasks.workunit.client.0.smithi077.stdout:6/786: dwrite de/d12/d25/d4b/fe4 [0,4194304] 0 2024-04-25T02:08:53.126 INFO:tasks.workunit.client.0.smithi077.stdout:6/787: truncate de/d53/db2/f103 500076 0 2024-04-25T02:08:53.127 INFO:tasks.workunit.client.0.smithi077.stdout:8/722: mkdir d3/d7a/de5 0 2024-04-25T02:08:53.134 INFO:tasks.workunit.client.0.smithi077.stdout:3/635: rename d0/d2/d2f/d5f/l90 to d0/d2/de/d36/da0/da8/le5 0 2024-04-25T02:08:53.137 INFO:tasks.workunit.client.0.smithi077.stdout:5/643: creat d0/d2/d3/d9/d39/fd3 x:0 0 0 2024-04-25T02:08:53.137 INFO:tasks.workunit.client.0.smithi077.stdout:5/644: creat d0/d25/d82/d87/d8b/da5/fd4 x:0 0 0 2024-04-25T02:08:53.140 INFO:tasks.workunit.client.0.smithi077.stdout:8/723: link d3/c3e d3/da/d27/ce6 0 2024-04-25T02:08:53.141 INFO:tasks.workunit.client.0.smithi077.stdout:3/636: creat d0/d17/d4b/d59/fe6 x:0 0 0 2024-04-25T02:08:53.143 INFO:tasks.workunit.client.0.smithi077.stdout:3/637: creat d0/dd3/fe7 x:0 0 0 2024-04-25T02:08:53.144 INFO:tasks.workunit.client.0.smithi077.stdout:8/724: getdents d3/da/db/df/d2b/d70 0 2024-04-25T02:08:53.145 INFO:tasks.workunit.client.0.smithi077.stdout:6/788: dwrite de/d12/d25/d38/fbe [0,4194304] 0 2024-04-25T02:08:53.146 INFO:tasks.workunit.client.0.smithi077.stdout:6/789: stat de/d12/d25/d3a/l54 0 2024-04-25T02:08:53.147 INFO:tasks.workunit.client.0.smithi077.stdout:8/725: link d3/da/d27/d16/f66 d3/d34/dc9/dcb/fe7 0 2024-04-25T02:08:53.149 INFO:tasks.workunit.client.0.smithi077.stdout:5/645: dread d0/d25/d82/d87/d8b/da5/dc4/f21 [0,4194304] 0 2024-04-25T02:08:53.149 INFO:tasks.workunit.client.0.smithi077.stdout:1/629: dwrite db/df/d14/d4d/d82/f30 [0,4194304] 0 2024-04-25T02:08:53.149 INFO:tasks.workunit.client.0.smithi077.stdout:1/630: creat db/d26/fd8 x:0 0 0 2024-04-25T02:08:53.149 INFO:tasks.workunit.client.0.smithi077.stdout:1/631: fdatasync db/df/d14/d4d/d82/d32/d8f/fbc 0 2024-04-25T02:08:53.154 INFO:tasks.workunit.client.0.smithi077.stdout:3/638: write d0/d40/f57 [181107,76873] 0 2024-04-25T02:08:53.155 INFO:tasks.workunit.client.0.smithi077.stdout:3/639: fdatasync d0/d17/f80 0 2024-04-25T02:08:53.156 INFO:tasks.workunit.client.0.smithi077.stdout:8/726: creat d3/da/db/fe8 x:0 0 0 2024-04-25T02:08:53.163 INFO:tasks.workunit.client.0.smithi077.stdout:1/632: truncate db/df/d14/d3e/d69/f9e 1629910 0 2024-04-25T02:08:53.163 INFO:tasks.workunit.client.0.smithi077.stdout:1/633: chown db/df/d56/dc3/fd7 599539 1 2024-04-25T02:08:53.163 INFO:tasks.workunit.client.0.smithi077.stdout:1/634: fdatasync db/f12 0 2024-04-25T02:08:53.163 INFO:tasks.workunit.client.0.smithi077.stdout:1/635: chown db/df/d14/d4d/d82/d5c/d81/f86 576076887 1 2024-04-25T02:08:53.163 INFO:tasks.workunit.client.0.smithi077.stdout:5/646: read d0/d25/d82/d87/d8b/da5/dc4/d23/d4a/f74 [3785537,24029] 0 2024-04-25T02:08:53.170 INFO:tasks.workunit.client.0.smithi077.stdout:6/790: dwrite de/f2c [0,4194304] 0 2024-04-25T02:08:53.171 INFO:tasks.workunit.client.0.smithi077.stdout:3/640: mknod d0/dd3/ce8 0 2024-04-25T02:08:53.172 INFO:tasks.workunit.client.0.smithi077.stdout:8/727: mknod d3/ce9 0 2024-04-25T02:08:53.172 INFO:tasks.workunit.client.0.smithi077.stdout:8/728: truncate d3/da/db/df/d30/f82 902023 0 2024-04-25T02:08:53.173 INFO:tasks.workunit.client.0.smithi077.stdout:8/729: write d3/da/d27/d16/d8c/f93 [843887,59277] 0 2024-04-25T02:08:53.175 INFO:tasks.workunit.client.0.smithi077.stdout:1/636: rmdir db/df/d14/d3e/d69/dd2 0 2024-04-25T02:08:53.175 INFO:tasks.workunit.client.0.smithi077.stdout:1/637: dread - db/fb0 zero size 2024-04-25T02:08:53.176 INFO:tasks.workunit.client.0.smithi077.stdout:5/647: creat d0/d2/d1b/d35/fd5 x:0 0 0 2024-04-25T02:08:53.176 INFO:tasks.workunit.client.0.smithi077.stdout:5/648: dread - d0/d2/fc5 zero size 2024-04-25T02:08:53.177 INFO:tasks.workunit.client.0.smithi077.stdout:5/649: fsync d0/d25/f36 0 2024-04-25T02:08:53.177 INFO:tasks.workunit.client.0.smithi077.stdout:5/650: write d0/d25/d82/d87/d8b/da5/dc4/d23/fd2 [176215,73133] 0 2024-04-25T02:08:53.177 INFO:tasks.workunit.client.0.smithi077.stdout:8/730: write d3/da/d27/f6c [2196396,32801] 0 2024-04-25T02:08:53.185 INFO:tasks.workunit.client.0.smithi077.stdout:8/731: write d3/da/f45 [368929,2870] 0 2024-04-25T02:08:53.185 INFO:tasks.workunit.client.0.smithi077.stdout:8/732: creat d3/da/db/df/d2b/d37/fea x:0 0 0 2024-04-25T02:08:53.228 INFO:tasks.workunit.client.0.smithi077.stdout:6/791: symlink de/d12/d25/d4b/dd1/l106 0 2024-04-25T02:08:53.229 INFO:tasks.workunit.client.0.smithi077.stdout:6/792: readlink de/d12/d25/d3a/d6a/dcd/d36/lb8 0 2024-04-25T02:08:53.229 INFO:tasks.workunit.client.0.smithi077.stdout:1/638: truncate db/df/d14/f17 1085015 0 2024-04-25T02:08:53.233 INFO:tasks.workunit.client.0.smithi077.stdout:8/733: creat d3/da/d27/d16/feb x:0 0 0 2024-04-25T02:08:53.233 INFO:tasks.workunit.client.0.smithi077.stdout:8/734: stat d3/da/db/df/d2b/d37/c4f 0 2024-04-25T02:08:53.234 INFO:tasks.workunit.client.0.smithi077.stdout:5/651: dwrite d0/d2/d3/d9/d39/fae [0,4194304] 0 2024-04-25T02:08:53.234 INFO:tasks.workunit.client.0.smithi077.stdout:5/652: fdatasync d0/d25/f30 0 2024-04-25T02:08:53.234 INFO:tasks.workunit.client.0.smithi077.stdout:5/653: write d0/d2/d1b/d38/f5e [1302457,61651] 0 2024-04-25T02:08:53.234 INFO:tasks.workunit.client.0.smithi077.stdout:5/654: write d0/d2/d1b/f76 [1149415,37953] 0 2024-04-25T02:08:53.234 INFO:tasks.workunit.client.0.smithi077.stdout:3/641: dwrite d0/d3e/d62/d6a/d6e/f85 [0,4194304] 0 2024-04-25T02:08:53.234 INFO:tasks.workunit.client.0.smithi077.stdout:0/649: sync 2024-04-25T02:08:53.234 INFO:tasks.workunit.client.0.smithi077.stdout:0/650: write d2/d17/d1d/d34/d4c/da2/d51/fcf [924849,79291] 0 2024-04-25T02:08:53.235 INFO:tasks.workunit.client.0.smithi077.stdout:8/735: symlink d3/da/db/df/d2b/d70/lec 0 2024-04-25T02:08:53.247 INFO:tasks.workunit.client.0.smithi077.stdout:6/793: dwrite de/d12/d25/d3a/d6a/dcd/fda [0,4194304] 0 2024-04-25T02:08:53.251 INFO:tasks.workunit.client.0.smithi077.stdout:0/651: creat d2/d8/d5f/d9f/fe1 x:0 0 0 2024-04-25T02:08:53.252 INFO:tasks.workunit.client.0.smithi077.stdout:0/652: chown d2/d17/d4e/f85 221 1 2024-04-25T02:08:53.253 INFO:tasks.workunit.client.0.smithi077.stdout:1/639: dread db/df/d14/d3e/d69/f9e [0,4194304] 0 2024-04-25T02:08:53.253 INFO:tasks.workunit.client.0.smithi077.stdout:1/640: fsync db/df/d14/d3e/d69/f9e 0 2024-04-25T02:08:53.254 INFO:tasks.workunit.client.0.smithi077.stdout:6/794: mkdir de/d53/d78/dfc/d107 0 2024-04-25T02:08:53.257 INFO:tasks.workunit.client.0.smithi077.stdout:3/642: rmdir d0/d2/d2f/d50 39 2024-04-25T02:08:53.257 INFO:tasks.workunit.client.0.smithi077.stdout:3/643: fsync d0/d3e/d42/d64/d88/fbd 0 2024-04-25T02:08:53.257 INFO:tasks.workunit.client.0.smithi077.stdout:0/653: mkdir d2/d17/d1d/d34/d4c/da2/de2 0 2024-04-25T02:08:53.257 INFO:tasks.workunit.client.0.smithi077.stdout:6/795: truncate de/d12/d25/f40 2172123 0 2024-04-25T02:08:53.257 INFO:tasks.workunit.client.0.smithi077.stdout:6/796: write de/d12/d25/d3a/d6a/dcd/fed [193370,57524] 0 2024-04-25T02:08:53.257 INFO:tasks.workunit.client.0.smithi077.stdout:6/797: readlink de/d55/d88/lcc 0 2024-04-25T02:08:53.257 INFO:tasks.workunit.client.0.smithi077.stdout:3/644: rename d0/d2/de/d36/da0/da8/lbc to d0/d2/de/d48/d15/le9 0 2024-04-25T02:08:53.258 INFO:tasks.workunit.client.0.smithi077.stdout:0/654: symlink d2/d17/le3 0 2024-04-25T02:08:53.259 INFO:tasks.workunit.client.0.smithi077.stdout:0/655: creat d2/d17/d1d/db1/fe4 x:0 0 0 2024-04-25T02:08:53.261 INFO:tasks.workunit.client.0.smithi077.stdout:0/656: creat d2/d8/db6/d74/da7/fe5 x:0 0 0 2024-04-25T02:08:53.262 INFO:tasks.workunit.client.0.smithi077.stdout:0/657: chown d2/d27/d2d/c4d 192800 1 2024-04-25T02:08:53.262 INFO:tasks.workunit.client.0.smithi077.stdout:0/658: dread - d2/d17/d1d/d34/d4c/fab zero size 2024-04-25T02:08:53.262 INFO:tasks.workunit.client.0.smithi077.stdout:0/659: chown d2/d17/d4e/fb0 201 1 2024-04-25T02:08:53.263 INFO:tasks.workunit.client.0.smithi077.stdout:3/645: dread d0/d17/d4b/fab [0,4194304] 0 2024-04-25T02:08:53.263 INFO:tasks.workunit.client.0.smithi077.stdout:3/646: chown d0/d3e/d42 108362703 1 2024-04-25T02:08:53.266 INFO:tasks.workunit.client.0.smithi077.stdout:1/641: dread db/df/d14/d4d/d82/f30 [0,4194304] 0 2024-04-25T02:08:53.267 INFO:tasks.workunit.client.0.smithi077.stdout:1/642: truncate db/df/d56/d5d/fd6 537520 0 2024-04-25T02:08:53.270 INFO:tasks.workunit.client.0.smithi077.stdout:1/643: link db/df/d14/d4d/d82/d32/f3f db/df/d56/d5d/d77/db3/fd9 0 2024-04-25T02:08:53.273 INFO:tasks.workunit.client.0.smithi077.stdout:2/632: sync 2024-04-25T02:08:53.273 INFO:tasks.workunit.client.0.smithi077.stdout:4/661: sync 2024-04-25T02:08:53.273 INFO:tasks.workunit.client.0.smithi077.stdout:7/578: sync 2024-04-25T02:08:53.273 INFO:tasks.workunit.client.0.smithi077.stdout:7/579: read - d4/d13/d18/d2d/d56/d68/d88/fb7 zero size 2024-04-25T02:08:53.273 INFO:tasks.workunit.client.0.smithi077.stdout:7/580: chown d4/d13/d18/d2d/f87 686 1 2024-04-25T02:08:53.273 INFO:tasks.workunit.client.0.smithi077.stdout:4/662: write d0/d14/d21/d39/f10 [4134443,107963] 0 2024-04-25T02:08:53.273 INFO:tasks.workunit.client.0.smithi077.stdout:4/663: read d0/d14/d60/d86/d25/fc9 [2406962,67465] 0 2024-04-25T02:08:53.273 INFO:tasks.workunit.client.0.smithi077.stdout:4/664: write d0/d14/d60/d86/d25/f45 [3781110,122079] 0 2024-04-25T02:08:53.274 INFO:tasks.workunit.client.0.smithi077.stdout:2/633: rename d2/d9/fd0 to d2/d9/d18/d1b/fd7 0 2024-04-25T02:08:53.274 INFO:tasks.workunit.client.0.smithi077.stdout:2/634: creat d2/d28/fd8 x:0 0 0 2024-04-25T02:08:53.274 INFO:tasks.workunit.client.0.smithi077.stdout:2/635: dread - d2/d9/d19/d1c/d3f/fae zero size 2024-04-25T02:08:53.275 INFO:tasks.workunit.client.0.smithi077.stdout:4/665: creat d0/d14/d21/d39/fd9 x:0 0 0 2024-04-25T02:08:53.276 INFO:tasks.workunit.client.0.smithi077.stdout:4/666: truncate d0/d14/d21/d39/f10 4304821 0 2024-04-25T02:08:53.276 INFO:tasks.workunit.client.0.smithi077.stdout:4/667: truncate d0/d14/d21/d39/d1d/d98/fd7 58594 0 2024-04-25T02:08:53.278 INFO:tasks.workunit.client.0.smithi077.stdout:5/655: dwrite d0/d25/d82/d87/d8b/da5/dc4/d23/fa6 [0,4194304] 0 2024-04-25T02:08:53.279 INFO:tasks.workunit.client.0.smithi077.stdout:6/798: dwrite de/d5b/da6/fb9 [0,4194304] 0 2024-04-25T02:08:53.280 INFO:tasks.workunit.client.0.smithi077.stdout:8/736: dwrite d3/f6 [0,4194304] 0 2024-04-25T02:08:53.283 INFO:tasks.workunit.client.0.smithi077.stdout:9/658: sync 2024-04-25T02:08:53.285 INFO:tasks.workunit.client.0.smithi077.stdout:7/581: dread d4/f16 [0,4194304] 0 2024-04-25T02:08:53.285 INFO:tasks.workunit.client.0.smithi077.stdout:7/582: dread - d4/d13/d18/d2d/d30/f8a zero size 2024-04-25T02:08:53.285 INFO:tasks.workunit.client.0.smithi077.stdout:7/583: fsync d4/d13/d18/d24/d3f/d58/f52 0 2024-04-25T02:08:53.285 INFO:tasks.workunit.client.0.smithi077.stdout:1/644: dread db/df/d14/d4d/d82/d42/fb1 [0,4194304] 0 2024-04-25T02:08:53.285 INFO:tasks.workunit.client.0.smithi077.stdout:1/645: write db/fbb [234431,124445] 0 2024-04-25T02:08:53.286 INFO:tasks.workunit.client.0.smithi077.stdout:3/647: dwrite d0/d2/de/d48/d15/f2a [0,4194304] 0 2024-04-25T02:08:53.289 INFO:tasks.workunit.client.0.smithi077.stdout:6/799: creat de/d3b/de8/f108 x:0 0 0 2024-04-25T02:08:53.290 INFO:tasks.workunit.client.0.smithi077.stdout:8/737: creat d3/da/d27/d16/db3/fed x:0 0 0 2024-04-25T02:08:53.293 INFO:tasks.workunit.client.0.smithi077.stdout:7/584: dread d4/d13/d18/d2d/f46 [0,4194304] 0 2024-04-25T02:08:53.296 INFO:tasks.workunit.client.0.smithi077.stdout:9/659: mknod df/d1b/d56/d67/d68/cdc 0 2024-04-25T02:08:53.297 INFO:tasks.workunit.client.0.smithi077.stdout:1/646: rmdir db/df/d14/d4d/d82/d42 39 2024-04-25T02:08:53.297 INFO:tasks.workunit.client.0.smithi077.stdout:1/647: write db/fb0 [717786,70368] 0 2024-04-25T02:08:53.299 INFO:tasks.workunit.client.0.smithi077.stdout:3/648: rename d0/d40/l7d to d0/dd3/lea 0 2024-04-25T02:08:53.299 INFO:tasks.workunit.client.0.smithi077.stdout:3/649: write d0/d17/d4b/d59/f8e [662223,79520] 0 2024-04-25T02:08:53.299 INFO:tasks.workunit.client.0.smithi077.stdout:3/650: write d0/d17/d4b/fa3 [63167,25167] 0 2024-04-25T02:08:53.300 INFO:tasks.workunit.client.0.smithi077.stdout:7/585: creat d4/d13/d18/d24/d3f/fc5 x:0 0 0 2024-04-25T02:08:53.300 INFO:tasks.workunit.client.0.smithi077.stdout:7/586: read d4/d13/d18/d2d/f47 [232952,119984] 0 2024-04-25T02:08:53.303 INFO:tasks.workunit.client.0.smithi077.stdout:9/660: creat df/d1b/d48/d75/d90/fdd x:0 0 0 2024-04-25T02:08:53.307 INFO:tasks.workunit.client.0.smithi077.stdout:6/800: rename de/d53/d76/f90 to de/d12/f109 0 2024-04-25T02:08:53.308 INFO:tasks.workunit.client.0.smithi077.stdout:3/651: creat d0/d3e/d93/dae/feb x:0 0 0 2024-04-25T02:08:53.309 INFO:tasks.workunit.client.0.smithi077.stdout:1/648: dread db/f12 [0,4194304] 0 2024-04-25T02:08:53.309 INFO:tasks.workunit.client.0.smithi077.stdout:1/649: creat db/df/d14/d4d/d82/d32/d8f/fda x:0 0 0 2024-04-25T02:08:53.310 INFO:tasks.workunit.client.0.smithi077.stdout:8/738: rename d3/da/db/df/d30/f92 to d3/d7a/d7e/db0/fee 0 2024-04-25T02:08:53.310 INFO:tasks.workunit.client.0.smithi077.stdout:4/668: dwrite d0/d14/d79/f94 [0,4194304] 0 2024-04-25T02:08:53.310 INFO:tasks.workunit.client.0.smithi077.stdout:4/669: readlink d0/d14/d21/d39/da/d12/d35/l55 0 2024-04-25T02:08:53.310 INFO:tasks.workunit.client.0.smithi077.stdout:2/636: dwrite d2/d9/d18/d31/d7c/dab/fb2 [0,4194304] 0 2024-04-25T02:08:53.311 INFO:tasks.workunit.client.0.smithi077.stdout:6/801: truncate de/d12/d25/d3a/d6a/dcd/d36/f56 3017384 0 2024-04-25T02:08:53.313 INFO:tasks.workunit.client.0.smithi077.stdout:3/652: symlink d0/d2/de/d36/da0/lec 0 2024-04-25T02:08:53.313 INFO:tasks.workunit.client.0.smithi077.stdout:3/653: write d0/d2/fa4 [441034,116451] 0 2024-04-25T02:08:53.315 INFO:tasks.workunit.client.0.smithi077.stdout:1/650: symlink db/df/d14/d4d/d82/d42/d43/ldb 0 2024-04-25T02:08:53.315 INFO:tasks.workunit.client.0.smithi077.stdout:8/739: dread d3/d81/d86/fae [0,4194304] 0 2024-04-25T02:08:53.315 INFO:tasks.workunit.client.0.smithi077.stdout:8/740: write d3/da/db/f28 [4791562,9708] 0 2024-04-25T02:08:53.319 INFO:tasks.workunit.client.0.smithi077.stdout:9/661: dwrite df/f1d [0,4194304] 0 2024-04-25T02:08:53.322 INFO:tasks.workunit.client.0.smithi077.stdout:6/802: dread de/d12/d25/d3a/d6a/fef [0,4194304] 0 2024-04-25T02:08:53.322 INFO:tasks.workunit.client.0.smithi077.stdout:4/670: getdents d0/d14/d60/d62 0 2024-04-25T02:08:53.322 INFO:tasks.workunit.client.0.smithi077.stdout:1/651: write db/df/d14/d4d/d82/d5c/f5e [587685,7608] 0 2024-04-25T02:08:53.322 INFO:tasks.workunit.client.0.smithi077.stdout:1/652: fsync db/df/d56/d5d/d77/db3/fd9 0 2024-04-25T02:08:53.322 INFO:tasks.workunit.client.0.smithi077.stdout:1/653: chown db/df/d14/d4d/d82/d42/d43 63493 1 2024-04-25T02:08:53.324 INFO:tasks.workunit.client.0.smithi077.stdout:2/637: mknod d2/d9/d18/d31/d7c/d89/dad/cd9 0 2024-04-25T02:08:53.326 INFO:tasks.workunit.client.0.smithi077.stdout:3/654: link d0/d3e/l3a d0/d2/de/d27/led 0 2024-04-25T02:08:53.328 INFO:tasks.workunit.client.0.smithi077.stdout:6/803: mkdir de/d53/d76/d10a 0 2024-04-25T02:08:53.328 INFO:tasks.workunit.client.0.smithi077.stdout:8/741: dread d3/da/d27/f2d [0,4194304] 0 2024-04-25T02:08:53.328 INFO:tasks.workunit.client.0.smithi077.stdout:8/742: dread - d3/da/db/df/d2b/d37/fea zero size 2024-04-25T02:08:53.329 INFO:tasks.workunit.client.0.smithi077.stdout:1/654: rmdir db/df/d14/d33/d6c 39 2024-04-25T02:08:53.333 INFO:tasks.workunit.client.0.smithi077.stdout:3/655: symlink d0/d2/lee 0 2024-04-25T02:08:53.334 INFO:tasks.workunit.client.0.smithi077.stdout:8/743: symlink d3/da/d27/d16/d8c/lef 0 2024-04-25T02:08:53.337 INFO:tasks.workunit.client.0.smithi077.stdout:1/655: creat db/df/d14/d3e/d69/dad/fdc x:0 0 0 2024-04-25T02:08:53.340 INFO:tasks.workunit.client.0.smithi077.stdout:3/656: link d0/d2/f35 d0/dd3/fef 0 2024-04-25T02:08:53.343 INFO:tasks.workunit.client.0.smithi077.stdout:1/656: rename db/df/d14/d33/l37 to db/df/d14/d4d/d82/d42/d43/ldd 0 2024-04-25T02:08:53.343 INFO:tasks.workunit.client.0.smithi077.stdout:8/744: write d3/d34/d3d/f5f [7197465,67872] 0 2024-04-25T02:08:53.345 INFO:tasks.workunit.client.0.smithi077.stdout:3/657: mknod d0/d2/d2f/d5f/cf0 0 2024-04-25T02:08:53.345 INFO:tasks.workunit.client.0.smithi077.stdout:3/658: creat d0/d2/d83/ff1 x:0 0 0 2024-04-25T02:08:53.345 INFO:tasks.workunit.client.0.smithi077.stdout:4/671: dwrite d0/d14/d60/d86/d25/fa5 [0,4194304] 0 2024-04-25T02:08:53.345 INFO:tasks.workunit.client.0.smithi077.stdout:1/657: getdents db/df/d56 0 2024-04-25T02:08:53.347 INFO:tasks.workunit.client.0.smithi077.stdout:8/745: symlink d3/da/d27/d44/lf0 0 2024-04-25T02:08:53.347 INFO:tasks.workunit.client.0.smithi077.stdout:8/746: creat d3/da/d27/d44/ff1 x:0 0 0 2024-04-25T02:08:53.350 INFO:tasks.workunit.client.0.smithi077.stdout:3/659: mknod d0/d2/de/d36/da6/cf2 0 2024-04-25T02:08:53.353 INFO:tasks.workunit.client.0.smithi077.stdout:2/638: dwrite d2/d9/d18/d31/f8d [0,4194304] 0 2024-04-25T02:08:53.354 INFO:tasks.workunit.client.0.smithi077.stdout:8/747: creat d3/da/d27/d44/db1/ff2 x:0 0 0 2024-04-25T02:08:53.354 INFO:tasks.workunit.client.0.smithi077.stdout:8/748: read d3/da/db/df/d30/f89 [1188677,34440] 0 2024-04-25T02:08:53.354 INFO:tasks.workunit.client.0.smithi077.stdout:1/658: rmdir db/df/d56/dc3 39 2024-04-25T02:08:53.355 INFO:tasks.workunit.client.0.smithi077.stdout:4/672: dread d0/d14/d60/d86/d25/f31 [0,4194304] 0 2024-04-25T02:08:53.359 INFO:tasks.workunit.client.0.smithi077.stdout:2/639: link d2/d9/d19/l4f d2/d9/d2f/lda 0 2024-04-25T02:08:53.359 INFO:tasks.workunit.client.0.smithi077.stdout:2/640: readlink d2/d78/l4d 0 2024-04-25T02:08:53.359 INFO:tasks.workunit.client.0.smithi077.stdout:2/641: creat d2/fdb x:0 0 0 2024-04-25T02:08:53.360 INFO:tasks.workunit.client.0.smithi077.stdout:6/804: dwrite de/d12/d25/f4a [0,4194304] 0 2024-04-25T02:08:53.361 INFO:tasks.workunit.client.0.smithi077.stdout:8/749: link d3/d81/d86/ld1 d3/da/db/df/d2b/d7b/lf3 0 2024-04-25T02:08:53.361 INFO:tasks.workunit.client.0.smithi077.stdout:8/750: creat d3/da/db/df/d2b/d37/ff4 x:0 0 0 2024-04-25T02:08:53.361 INFO:tasks.workunit.client.0.smithi077.stdout:1/659: creat db/df/d14/fde x:0 0 0 2024-04-25T02:08:53.363 INFO:tasks.workunit.client.0.smithi077.stdout:3/660: write d0/d2/de/d48/d15/f2b [7921959,63091] 0 2024-04-25T02:08:53.363 INFO:tasks.workunit.client.0.smithi077.stdout:3/661: write d0/f23 [1256924,86981] 0 2024-04-25T02:08:53.363 INFO:tasks.workunit.client.0.smithi077.stdout:3/662: read d0/d2/de/fc7 [1042600,32974] 0 2024-04-25T02:08:53.365 INFO:tasks.workunit.client.0.smithi077.stdout:2/642: rmdir d2/d9/d2f/d84 39 2024-04-25T02:08:53.370 INFO:tasks.workunit.client.0.smithi077.stdout:4/673: read d0/d14/d60/d86/f4c [2246491,60577] 0 2024-04-25T02:08:53.370 INFO:tasks.workunit.client.0.smithi077.stdout:4/674: stat d0/d14/d21/d39/d9a/fa0 0 2024-04-25T02:08:53.370 INFO:tasks.workunit.client.0.smithi077.stdout:4/675: chown d0/d14/d21/d39/da/d12/d35/f71 12078 1 2024-04-25T02:08:53.370 INFO:tasks.workunit.client.0.smithi077.stdout:4/676: write d0/d14/d21/d39/d1d/f73 [651118,99328] 0 2024-04-25T02:08:53.370 INFO:tasks.workunit.client.0.smithi077.stdout:8/751: getdents d3/d34/dc9/dcb 0 2024-04-25T02:08:53.371 INFO:tasks.workunit.client.0.smithi077.stdout:3/663: symlink d0/d17/d4b/d59/d81/lf3 0 2024-04-25T02:08:53.378 INFO:tasks.workunit.client.0.smithi077.stdout:4/677: symlink d0/d14/d79/da4/dbc/lda 0 2024-04-25T02:08:53.381 INFO:tasks.workunit.client.0.smithi077.stdout:3/664: read d0/d3e/d93/fa5 [576492,127745] 0 2024-04-25T02:08:53.382 INFO:tasks.workunit.client.0.smithi077.stdout:2/643: rename d2/d9/d18/d31/d7c/d89 to d2/d9/ddc 0 2024-04-25T02:08:53.382 INFO:tasks.workunit.client.0.smithi077.stdout:2/644: creat d2/d9/d19/d1c/d3f/fdd x:0 0 0 2024-04-25T02:08:53.382 INFO:tasks.workunit.client.0.smithi077.stdout:2/645: dread - d2/d9/d19/d1c/d3f/fae zero size 2024-04-25T02:08:53.382 INFO:tasks.workunit.client.0.smithi077.stdout:2/646: creat d2/d28/fde x:0 0 0 2024-04-25T02:08:53.383 INFO:tasks.workunit.client.0.smithi077.stdout:3/665: symlink d0/d17/d4b/lf4 0 2024-04-25T02:08:53.388 INFO:tasks.workunit.client.0.smithi077.stdout:2/647: getdents d2/d9/d18/d31/d7c/dab 0 2024-04-25T02:08:53.388 INFO:tasks.workunit.client.0.smithi077.stdout:2/648: chown d2/d9/d18/d31/c41 0 1 2024-04-25T02:08:53.389 INFO:tasks.workunit.client.0.smithi077.stdout:2/649: creat d2/d9/d18/d31/d7c/fdf x:0 0 0 2024-04-25T02:08:53.389 INFO:tasks.workunit.client.0.smithi077.stdout:2/650: read d2/d9/f17 [6584842,3097] 0 2024-04-25T02:08:53.391 INFO:tasks.workunit.client.0.smithi077.stdout:4/678: write d0/d14/d21/f2f [3067021,35125] 0 2024-04-25T02:08:53.391 INFO:tasks.workunit.client.0.smithi077.stdout:4/679: write d0/d14/d79/fd8 [968880,62251] 0 2024-04-25T02:08:53.394 INFO:tasks.workunit.client.0.smithi077.stdout:3/666: dread d0/d3e/d62/d6a/d6e/f85 [0,4194304] 0 2024-04-25T02:08:53.394 INFO:tasks.workunit.client.0.smithi077.stdout:3/667: write d0/d3e/d42/d64/d88/fbd [128388,110463] 0 2024-04-25T02:08:53.395 INFO:tasks.workunit.client.0.smithi077.stdout:0/660: sync 2024-04-25T02:08:53.395 INFO:tasks.workunit.client.0.smithi077.stdout:0/661: dread - d2/d8/dad/fd5 zero size 2024-04-25T02:08:53.395 INFO:tasks.workunit.client.0.smithi077.stdout:0/662: dread - d2/d17/d1d/d34/d83/f8d zero size 2024-04-25T02:08:53.395 INFO:tasks.workunit.client.0.smithi077.stdout:0/663: rename d2/d17/d1d/d34/d4c/da2/d51 to d2/d17/d1d/d34/d4c/da2/d51/de6 22 2024-04-25T02:08:53.396 INFO:tasks.workunit.client.0.smithi077.stdout:8/752: dwrite d3/da/db/df/d2b/d37/ff4 [0,4194304] 0 2024-04-25T02:08:53.396 INFO:tasks.workunit.client.0.smithi077.stdout:1/660: dwrite db/df/d14/d4d/d82/d5c/f5e [0,4194304] 0 2024-04-25T02:08:53.400 INFO:tasks.workunit.client.0.smithi077.stdout:0/664: dread d2/fa3 [0,4194304] 0 2024-04-25T02:08:53.400 INFO:tasks.workunit.client.0.smithi077.stdout:6/805: dwrite de/d55/f9a [0,4194304] 0 2024-04-25T02:08:53.400 INFO:tasks.workunit.client.0.smithi077.stdout:6/806: creat de/d55/db7/f10b x:0 0 0 2024-04-25T02:08:53.401 INFO:tasks.workunit.client.0.smithi077.stdout:8/753: mknod d3/da/d27/d44/db1/cf5 0 2024-04-25T02:08:53.402 INFO:tasks.workunit.client.0.smithi077.stdout:1/661: fdatasync db/df/d56/d5d/fd6 0 2024-04-25T02:08:53.406 INFO:tasks.workunit.client.0.smithi077.stdout:4/680: dread d0/d14/d21/d39/da/d12/d35/d3e/f2b [0,4194304] 0 2024-04-25T02:08:53.408 INFO:tasks.workunit.client.0.smithi077.stdout:6/807: write de/d55/f9a [2819369,128139] 0 2024-04-25T02:08:53.415 INFO:tasks.workunit.client.0.smithi077.stdout:3/668: dwrite d0/d2/de/d27/f51 [0,4194304] 0 2024-04-25T02:08:53.416 INFO:tasks.workunit.client.0.smithi077.stdout:8/754: creat d3/d7a/d7e/db0/ff6 x:0 0 0 2024-04-25T02:08:53.416 INFO:tasks.workunit.client.0.smithi077.stdout:8/755: stat d3/da/d27/d16/dbc/l73 0 2024-04-25T02:08:53.418 INFO:tasks.workunit.client.0.smithi077.stdout:0/665: rename d2/d8/db6/d74 to d2/d27/d2d/dce/de7 0 2024-04-25T02:08:53.420 INFO:tasks.workunit.client.0.smithi077.stdout:2/651: dwrite d2/f5 [0,4194304] 0 2024-04-25T02:08:53.420 INFO:tasks.workunit.client.0.smithi077.stdout:2/652: write d2/d78/fac [639848,96167] 0 2024-04-25T02:08:53.421 INFO:tasks.workunit.client.0.smithi077.stdout:1/662: rmdir db/df/d14/d3e/d69 39 2024-04-25T02:08:53.421 INFO:tasks.workunit.client.0.smithi077.stdout:1/663: write db/df/d14/d50/f71 [1342868,15354] 0 2024-04-25T02:08:53.423 INFO:tasks.workunit.client.0.smithi077.stdout:0/666: mkdir d2/d17/d1d/d34/d4c/da2/d51/de8 0 2024-04-25T02:08:53.427 INFO:tasks.workunit.client.0.smithi077.stdout:2/653: unlink d2/d9/d18/d1b/c26 0 2024-04-25T02:08:53.427 INFO:tasks.workunit.client.0.smithi077.stdout:2/654: readlink d2/d9/ddc/dc4/lb5 0 2024-04-25T02:08:53.428 INFO:tasks.workunit.client.0.smithi077.stdout:8/756: dread d3/da/f45 [4194304,4194304] 0 2024-04-25T02:08:53.429 INFO:tasks.workunit.client.0.smithi077.stdout:0/667: symlink d2/d9/d2a/le9 0 2024-04-25T02:08:53.430 INFO:tasks.workunit.client.0.smithi077.stdout:0/668: chown d2/d17/d1d/d34/d4c/da2/dae 89237393 1 2024-04-25T02:08:53.431 INFO:tasks.workunit.client.0.smithi077.stdout:2/655: creat d2/d9/d2f/d84/d90/dd4/fe0 x:0 0 0 2024-04-25T02:08:53.432 INFO:tasks.workunit.client.0.smithi077.stdout:1/664: rmdir db/df/d56/dc3/dcd 39 2024-04-25T02:08:53.432 INFO:tasks.workunit.client.0.smithi077.stdout:1/665: write db/df/d14/d4d/d82/f7a [4833220,129152] 0 2024-04-25T02:08:53.434 INFO:tasks.workunit.client.0.smithi077.stdout:8/757: rename d3/da/db/df/f10 to d3/ff7 0 2024-04-25T02:08:53.435 INFO:tasks.workunit.client.0.smithi077.stdout:2/656: rmdir d2/d9/d19/d1c/d37 39 2024-04-25T02:08:53.435 INFO:tasks.workunit.client.0.smithi077.stdout:2/657: stat d2/f88 0 2024-04-25T02:08:53.435 INFO:tasks.workunit.client.0.smithi077.stdout:4/681: dwrite d0/d14/d79/f94 [4194304,4194304] 0 2024-04-25T02:08:53.435 INFO:tasks.workunit.client.0.smithi077.stdout:4/682: fdatasync d0/d14/d60/d86/d96/f5c 0 2024-04-25T02:08:53.436 INFO:tasks.workunit.client.0.smithi077.stdout:6/808: dwrite de/d53/f61 [0,4194304] 0 2024-04-25T02:08:53.437 INFO:tasks.workunit.client.0.smithi077.stdout:1/666: rename db/df/d14/d4d/d82/d32/d8f/fbc to db/df/d14/d33/d34/db4/fdf 0 2024-04-25T02:08:53.439 INFO:tasks.workunit.client.0.smithi077.stdout:2/658: mknod d2/d59/d79/db4/ce1 0 2024-04-25T02:08:53.439 INFO:tasks.workunit.client.0.smithi077.stdout:8/758: dread d3/d7a/d7e/fcc [0,4194304] 0 2024-04-25T02:08:53.439 INFO:tasks.workunit.client.0.smithi077.stdout:2/659: write d2/d9/d18/d31/d7c/fdf [488068,68303] 0 2024-04-25T02:08:53.444 INFO:tasks.workunit.client.0.smithi077.stdout:6/809: creat de/d12/d25/d4b/dd1/f10c x:0 0 0 2024-04-25T02:08:53.445 INFO:tasks.workunit.client.0.smithi077.stdout:3/669: dwrite d0/d2/de/d27/f51 [4194304,4194304] 0 2024-04-25T02:08:53.445 INFO:tasks.workunit.client.0.smithi077.stdout:1/667: unlink db/df/d14/d33/d34/c5f 0 2024-04-25T02:08:53.453 INFO:tasks.workunit.client.0.smithi077.stdout:3/670: mkdir d0/d2/d2f/db4/db6/df5 0 2024-04-25T02:08:53.453 INFO:tasks.workunit.client.0.smithi077.stdout:6/810: creat de/d95/f10d x:0 0 0 2024-04-25T02:08:53.453 INFO:tasks.workunit.client.0.smithi077.stdout:3/671: creat d0/dd3/ff6 x:0 0 0 2024-04-25T02:08:53.454 INFO:tasks.workunit.client.0.smithi077.stdout:0/669: dwrite d2/d17/d4e/d5e/fb7 [0,4194304] 0 2024-04-25T02:08:53.456 INFO:tasks.workunit.client.0.smithi077.stdout:5/656: sync 2024-04-25T02:08:53.456 INFO:tasks.workunit.client.0.smithi077.stdout:9/662: sync 2024-04-25T02:08:53.456 INFO:tasks.workunit.client.0.smithi077.stdout:7/587: sync 2024-04-25T02:08:53.456 INFO:tasks.workunit.client.0.smithi077.stdout:9/663: readlink df/d60/l9d 0 2024-04-25T02:08:53.456 INFO:tasks.workunit.client.0.smithi077.stdout:5/657: creat d0/d25/d82/fd6 x:0 0 0 2024-04-25T02:08:53.456 INFO:tasks.workunit.client.0.smithi077.stdout:5/658: chown d0/d2/d1b/f26 133471898 1 2024-04-25T02:08:53.467 INFO:tasks.workunit.client.0.smithi077.stdout:8/759: rmdir d3 39 2024-04-25T02:08:53.468 INFO:tasks.workunit.client.0.smithi077.stdout:6/811: rmdir de/d12/d25/d60 39 2024-04-25T02:08:53.469 INFO:tasks.workunit.client.0.smithi077.stdout:2/660: dwrite d2/d9/f67 [0,4194304] 0 2024-04-25T02:08:53.471 INFO:tasks.workunit.client.0.smithi077.stdout:3/672: dwrite d0/d2/de/d48/fca [0,4194304] 0 2024-04-25T02:08:53.471 INFO:tasks.workunit.client.0.smithi077.stdout:3/673: stat d0/d17/dd4 0 2024-04-25T02:08:53.471 INFO:tasks.workunit.client.0.smithi077.stdout:0/670: unlink d2/d17/c25 0 2024-04-25T02:08:53.472 INFO:tasks.workunit.client.0.smithi077.stdout:0/671: dread - d2/d9/f65 zero size 2024-04-25T02:08:53.473 INFO:tasks.workunit.client.0.smithi077.stdout:7/588: unlink d4/lf 0 2024-04-25T02:08:53.473 INFO:tasks.workunit.client.0.smithi077.stdout:7/589: creat d4/d13/d18/d24/fc6 x:0 0 0 2024-04-25T02:08:53.474 INFO:tasks.workunit.client.0.smithi077.stdout:9/664: rename df/d1b/d48/d86 to df/d1b/d70/d84/dde 0 2024-04-25T02:08:53.475 INFO:tasks.workunit.client.0.smithi077.stdout:5/659: creat d0/d25/dc7/dca/fd7 x:0 0 0 2024-04-25T02:08:53.475 INFO:tasks.workunit.client.0.smithi077.stdout:5/660: fdatasync d0/d25/d82/d87/d8b/da5/dc4/f21 0 2024-04-25T02:08:53.476 INFO:tasks.workunit.client.0.smithi077.stdout:8/760: dread d3/da/db/df/d2b/d37/ff4 [0,4194304] 0 2024-04-25T02:08:53.477 INFO:tasks.workunit.client.0.smithi077.stdout:2/661: stat d2/d9/c7f 0 2024-04-25T02:08:53.477 INFO:tasks.workunit.client.0.smithi077.stdout:8/761: truncate d3/da/d27/d44/f9f 8740 0 2024-04-25T02:08:53.479 INFO:tasks.workunit.client.0.smithi077.stdout:2/662: dread d2/d9/ddc/dc4/f66 [0,4194304] 0 2024-04-25T02:08:53.484 INFO:tasks.workunit.client.0.smithi077.stdout:8/762: mkdir d3/d34/dc9/dcb/df8 0 2024-04-25T02:08:53.484 INFO:tasks.workunit.client.0.smithi077.stdout:8/763: chown d3/da/db/df/d2b 4898093 1 2024-04-25T02:08:53.485 INFO:tasks.workunit.client.0.smithi077.stdout:8/764: dread - d3/d34/fa8 zero size 2024-04-25T02:08:53.485 INFO:tasks.workunit.client.0.smithi077.stdout:8/765: fdatasync d3/da/d27/d44/db1/ff2 0 2024-04-25T02:08:53.485 INFO:tasks.workunit.client.0.smithi077.stdout:3/674: dread d0/d17/d4b/d59/faa [0,4194304] 0 2024-04-25T02:08:53.485 INFO:tasks.workunit.client.0.smithi077.stdout:3/675: creat d0/d3e/d42/ff7 x:0 0 0 2024-04-25T02:08:53.485 INFO:tasks.workunit.client.0.smithi077.stdout:3/676: write d0/d2/de/d48/d15/f99 [470535,99452] 0 2024-04-25T02:08:53.485 INFO:tasks.workunit.client.0.smithi077.stdout:2/663: rename d2/d9/d19/d1c/d3f/d53/d86/ca0 to d2/d9/d19/d1c/d37/ce2 0 2024-04-25T02:08:53.490 INFO:tasks.workunit.client.0.smithi077.stdout:3/677: truncate d0/d2/f41 4106387 0 2024-04-25T02:08:53.491 INFO:tasks.workunit.client.0.smithi077.stdout:2/664: truncate d2/d9/d18/d31/f63 1323861 0 2024-04-25T02:08:53.491 INFO:tasks.workunit.client.0.smithi077.stdout:2/665: dread - d2/d9/d19/d1c/d3f/fdd zero size 2024-04-25T02:08:53.494 INFO:tasks.workunit.client.0.smithi077.stdout:4/683: dwrite d0/d14/d21/d39/da/fb [0,4194304] 0 2024-04-25T02:08:53.497 INFO:tasks.workunit.client.0.smithi077.stdout:4/684: creat d0/d14/d60/d86/fdb x:0 0 0 2024-04-25T02:08:53.498 INFO:tasks.workunit.client.0.smithi077.stdout:4/685: symlink d0/d14/d21/d39/da/d12/ldc 0 2024-04-25T02:08:53.498 INFO:tasks.workunit.client.0.smithi077.stdout:4/686: stat d0/d14/d21/d39/d1d/d98/fa1 0 2024-04-25T02:08:53.498 INFO:tasks.workunit.client.0.smithi077.stdout:4/687: fsync d0/d14/d60/d62/f77 0 2024-04-25T02:08:53.504 INFO:tasks.workunit.client.0.smithi077.stdout:2/666: dread d2/d9/d18/d31/d7c/dab/fb2 [0,4194304] 0 2024-04-25T02:08:53.505 INFO:tasks.workunit.client.0.smithi077.stdout:2/667: symlink d2/d9/d18/d31/d7c/dab/le3 0 2024-04-25T02:08:53.505 INFO:tasks.workunit.client.0.smithi077.stdout:2/668: chown d2/d9/d19/dc2 914858382 1 2024-04-25T02:08:53.505 INFO:tasks.workunit.client.0.smithi077.stdout:2/669: creat d2/d28/fe4 x:0 0 0 2024-04-25T02:08:53.506 INFO:tasks.workunit.client.0.smithi077.stdout:2/670: getdents d2/d9/d2f 0 2024-04-25T02:08:53.508 INFO:tasks.workunit.client.0.smithi077.stdout:2/671: symlink d2/d9/d19/d1c/d37/dcb/le5 0 2024-04-25T02:08:53.508 INFO:tasks.workunit.client.0.smithi077.stdout:2/672: readlink d2/d9/d19/l4f 0 2024-04-25T02:08:53.510 INFO:tasks.workunit.client.0.smithi077.stdout:2/673: rename d2/d9/d19/d1c/d3f/f40 to d2/d9/d18/d31/d7c/fe6 0 2024-04-25T02:08:53.511 INFO:tasks.workunit.client.0.smithi077.stdout:4/688: write d0/d14/d21/f22 [8381032,73585] 0 2024-04-25T02:08:53.518 INFO:tasks.workunit.client.0.smithi077.stdout:7/590: dwrite d4/f16 [0,4194304] 0 2024-04-25T02:08:53.518 INFO:tasks.workunit.client.0.smithi077.stdout:0/672: rmdir d2/d17 39 2024-04-25T02:08:53.518 INFO:tasks.workunit.client.0.smithi077.stdout:0/673: fdatasync d2/d17/d1d/d34/d4c/fd3 0 2024-04-25T02:08:53.518 INFO:tasks.workunit.client.0.smithi077.stdout:0/674: creat d2/d9/d2a/db5/fea x:0 0 0 2024-04-25T02:08:53.518 INFO:tasks.workunit.client.0.smithi077.stdout:0/675: creat d2/d1c/feb x:0 0 0 2024-04-25T02:08:53.518 INFO:tasks.workunit.client.0.smithi077.stdout:5/661: dwrite d0/d2/fc8 [0,4194304] 0 2024-04-25T02:08:53.518 INFO:tasks.workunit.client.0.smithi077.stdout:8/766: dwrite d3/da/db/df/d30/f89 [0,4194304] 0 2024-04-25T02:08:53.519 INFO:tasks.workunit.client.0.smithi077.stdout:7/591: truncate d4/d13/d18/d2d/d30/f65 3763269 0 2024-04-25T02:08:53.519 INFO:tasks.workunit.client.0.smithi077.stdout:7/592: write d4/d13/d5b/fbc [596151,68529] 0 2024-04-25T02:08:53.519 INFO:tasks.workunit.client.0.smithi077.stdout:7/593: chown d4/d13/d18/l20 143594 1 2024-04-25T02:08:53.519 INFO:tasks.workunit.client.0.smithi077.stdout:8/767: dread d3/da/db/df/d2b/f95 [0,4194304] 0 2024-04-25T02:08:53.522 INFO:tasks.workunit.client.0.smithi077.stdout:0/676: rmdir d2/d17/d1d/d34/d4c 39 2024-04-25T02:08:53.525 INFO:tasks.workunit.client.0.smithi077.stdout:2/674: write d2/d9/d19/d2c/f47 [889118,69541] 0 2024-04-25T02:08:53.525 INFO:tasks.workunit.client.0.smithi077.stdout:3/678: dwrite d0/d2/de/d48/fe0 [0,4194304] 0 2024-04-25T02:08:53.530 INFO:tasks.workunit.client.0.smithi077.stdout:5/662: read d0/d25/d82/d87/d8b/da5/dc4/d23/d4a/f5c [3722599,114096] 0 2024-04-25T02:08:53.530 INFO:tasks.workunit.client.0.smithi077.stdout:7/594: symlink d4/d13/d5b/d8b/lc7 0 2024-04-25T02:08:53.530 INFO:tasks.workunit.client.0.smithi077.stdout:7/595: fdatasync d4/d13/d66/fc1 0 2024-04-25T02:08:53.531 INFO:tasks.workunit.client.0.smithi077.stdout:8/768: creat d3/d34/d3d/ff9 x:0 0 0 2024-04-25T02:08:53.531 INFO:tasks.workunit.client.0.smithi077.stdout:8/769: chown d3/da/d27/d16/feb 1131 1 2024-04-25T02:08:53.532 INFO:tasks.workunit.client.0.smithi077.stdout:8/770: fdatasync d3/da/f8a 0 2024-04-25T02:08:53.534 INFO:tasks.workunit.client.0.smithi077.stdout:3/679: mknod d0/d3e/da1/cf8 0 2024-04-25T02:08:53.536 INFO:tasks.workunit.client.0.smithi077.stdout:2/675: creat d2/d9/d18/d31/fe7 x:0 0 0 2024-04-25T02:08:53.540 INFO:tasks.workunit.client.0.smithi077.stdout:7/596: dread d4/f12 [0,4194304] 0 2024-04-25T02:08:53.564 INFO:tasks.workunit.client.0.smithi077.stdout:5/663: dwrite d0/d25/d82/d87/d8b/da5/dc4/d23/d4a/f74 [0,4194304] 0 2024-04-25T02:08:53.564 INFO:tasks.workunit.client.0.smithi077.stdout:5/664: creat d0/d2/d3/d9/d39/d3c/fd8 x:0 0 0 2024-04-25T02:08:53.598 INFO:tasks.workunit.client.0.smithi077.stdout:8/771: link d3/l1f d3/d81/lfa 0 2024-04-25T02:08:53.598 INFO:tasks.workunit.client.0.smithi077.stdout:8/772: write d3/da/db/df/d2b/d7b/fe2 [819540,46753] 0 2024-04-25T02:08:53.600 INFO:tasks.workunit.client.0.smithi077.stdout:4/689: dwrite d0/d14/d60/d86/d25/f7e [0,4194304] 0 2024-04-25T02:08:53.600 INFO:tasks.workunit.client.0.smithi077.stdout:4/690: readlink d0/d14/d79/da4/dac/dd4/ld5 0 2024-04-25T02:08:53.600 INFO:tasks.workunit.client.0.smithi077.stdout:4/691: readlink d0/d14/d60/l9b 0 2024-04-25T02:08:53.601 INFO:tasks.workunit.client.0.smithi077.stdout:2/676: rename d2/d9/d2f/d84/da6/fcf to d2/d9/d18/fe8 0 2024-04-25T02:08:53.604 INFO:tasks.workunit.client.0.smithi077.stdout:8/773: mkdir d3/da/db/df/d2b/d37/dfb 0 2024-04-25T02:08:53.606 INFO:tasks.workunit.client.0.smithi077.stdout:8/774: dread d3/d81/d86/fae [0,4194304] 0 2024-04-25T02:08:53.608 INFO:tasks.workunit.client.0.smithi077.stdout:4/692: mknod d0/d14/cdd 0 2024-04-25T02:08:53.608 INFO:tasks.workunit.client.0.smithi077.stdout:4/693: chown d0/d14/d21/d39/d1d 1818 1 2024-04-25T02:08:53.608 INFO:tasks.workunit.client.0.smithi077.stdout:4/694: write d0/d14/d21/d39/da/f63 [593593,81087] 0 2024-04-25T02:08:53.609 INFO:tasks.workunit.client.0.smithi077.stdout:2/677: creat d2/d78/d95/fe9 x:0 0 0 2024-04-25T02:08:53.611 INFO:tasks.workunit.client.0.smithi077.stdout:4/695: symlink d0/d14/d79/da4/lde 0 2024-04-25T02:08:53.612 INFO:tasks.workunit.client.0.smithi077.stdout:4/696: symlink d0/d14/d60/d62/ldf 0 2024-04-25T02:08:53.613 INFO:tasks.workunit.client.0.smithi077.stdout:5/665: dread d0/d2/f79 [0,4194304] 0 2024-04-25T02:08:53.614 INFO:tasks.workunit.client.0.smithi077.stdout:4/697: symlink d0/d14/d21/d39/d9a/le0 0 2024-04-25T02:08:53.615 INFO:tasks.workunit.client.0.smithi077.stdout:4/698: truncate d0/d14/d60/d86/f44 4385378 0 2024-04-25T02:08:53.618 INFO:tasks.workunit.client.0.smithi077.stdout:2/678: dread d2/d9/d19/d1c/d3f/d53/fa3 [0,4194304] 0 2024-04-25T02:08:53.619 INFO:tasks.workunit.client.0.smithi077.stdout:7/597: dwrite d4/d13/d18/d24/d3f/f44 [0,4194304] 0 2024-04-25T02:08:53.620 INFO:tasks.workunit.client.0.smithi077.stdout:7/598: mknod d4/d13/d18/d2d/d56/d68/db3/cc8 0 2024-04-25T02:08:53.622 INFO:tasks.workunit.client.0.smithi077.stdout:0/677: dwrite d2/d17/d1d/d34/d4c/f9a [0,4194304] 0 2024-04-25T02:08:53.624 INFO:tasks.workunit.client.0.smithi077.stdout:3/680: dwrite d0/d2/f18 [0,4194304] 0 2024-04-25T02:08:53.626 INFO:tasks.workunit.client.0.smithi077.stdout:5/666: dread d0/d25/f1a [0,4194304] 0 2024-04-25T02:08:53.626 INFO:tasks.workunit.client.0.smithi077.stdout:8/775: dwrite d3/da/d27/f3f [0,4194304] 0 2024-04-25T02:08:53.626 INFO:tasks.workunit.client.0.smithi077.stdout:8/776: chown d3/da/db/df/d2b/d37/c61 2 1 2024-04-25T02:08:53.628 INFO:tasks.workunit.client.0.smithi077.stdout:2/679: write d2/d9/d19/d2c/f5b [2799702,66200] 0 2024-04-25T02:08:53.628 INFO:tasks.workunit.client.0.smithi077.stdout:2/680: readlink d2/l2b 0 2024-04-25T02:08:53.628 INFO:tasks.workunit.client.0.smithi077.stdout:2/681: write d2/d59/fd2 [274215,24412] 0 2024-04-25T02:08:53.628 INFO:tasks.workunit.client.0.smithi077.stdout:2/682: read - d2/d9/d19/fbe zero size 2024-04-25T02:08:53.628 INFO:tasks.workunit.client.0.smithi077.stdout:8/777: dread d3/da/db/df/d2b/f79 [0,4194304] 0 2024-04-25T02:08:53.628 INFO:tasks.workunit.client.0.smithi077.stdout:8/778: fdatasync d3/da/d27/d16/d6b/f80 0 2024-04-25T02:08:53.633 INFO:tasks.workunit.client.0.smithi077.stdout:0/678: link d2/d17/d1d/d34/f36 d2/d8/d5f/d9f/fec 0 2024-04-25T02:08:53.635 INFO:tasks.workunit.client.0.smithi077.stdout:8/779: write d3/da/db/df/d2b/d37/ff4 [1083587,1530] 0 2024-04-25T02:08:53.640 INFO:tasks.workunit.client.0.smithi077.stdout:2/683: rename d2/d9/d2f/d84/d90/caa to d2/d9/d18/cea 0 2024-04-25T02:08:53.640 INFO:tasks.workunit.client.0.smithi077.stdout:2/684: write d2/d9/d18/fe8 [95201,11007] 0 2024-04-25T02:08:53.641 INFO:tasks.workunit.client.0.smithi077.stdout:2/685: write d2/d9/d18/fa [6391027,94347] 0 2024-04-25T02:08:53.644 INFO:tasks.workunit.client.0.smithi077.stdout:0/679: link d2/d17/d1d/d34/d4c/da2/d51/ca5 d2/d8/dad/ced 0 2024-04-25T02:08:53.644 INFO:tasks.workunit.client.0.smithi077.stdout:0/680: fdatasync d2/d17/d4e/f85 0 2024-04-25T02:08:53.647 INFO:tasks.workunit.client.0.smithi077.stdout:2/686: mknod d2/d9/d19/d1c/d3f/d53/d86/dca/ceb 0 2024-04-25T02:08:53.647 INFO:tasks.workunit.client.0.smithi077.stdout:2/687: fsync d2/d9/f8e 0 2024-04-25T02:08:53.648 INFO:tasks.workunit.client.0.smithi077.stdout:3/681: dread d0/d2/de/d36/fb7 [0,4194304] 0 2024-04-25T02:08:53.648 INFO:tasks.workunit.client.0.smithi077.stdout:3/682: creat d0/d3e/da1/ff9 x:0 0 0 2024-04-25T02:08:53.648 INFO:tasks.workunit.client.0.smithi077.stdout:3/683: truncate d0/d17/d4b/fa3 318623 0 2024-04-25T02:08:53.648 INFO:tasks.workunit.client.0.smithi077.stdout:0/681: mkdir d2/d17/d1d/d34/d83/dee 0 2024-04-25T02:08:53.648 INFO:tasks.workunit.client.0.smithi077.stdout:0/682: write d2/d17/d1d/db1/fc6 [804163,123316] 0 2024-04-25T02:08:53.650 INFO:tasks.workunit.client.0.smithi077.stdout:2/688: link d2/d9/d19/d1c/d3f/d53/d86/f96 d2/fec 0 2024-04-25T02:08:53.652 INFO:tasks.workunit.client.0.smithi077.stdout:0/683: creat d2/d8/db6/dd7/de0/fef x:0 0 0 2024-04-25T02:08:53.653 INFO:tasks.workunit.client.0.smithi077.stdout:2/689: rmdir d2/d9/ddc/dc5 0 2024-04-25T02:08:53.655 INFO:tasks.workunit.client.0.smithi077.stdout:0/684: link d2/d17/d1d/fbf d2/d17/d1d/d34/d4c/da2/dae/ff0 0 2024-04-25T02:08:53.656 INFO:tasks.workunit.client.0.smithi077.stdout:3/684: dread d0/f9 [0,4194304] 0 2024-04-25T02:08:53.656 INFO:tasks.workunit.client.0.smithi077.stdout:4/699: dwrite d0/d14/d21/d39/da/f63 [0,4194304] 0 2024-04-25T02:08:53.656 INFO:tasks.workunit.client.0.smithi077.stdout:4/700: dread - d0/d14/d60/d86/d25/f7f zero size 2024-04-25T02:08:53.656 INFO:tasks.workunit.client.0.smithi077.stdout:4/701: write d0/d14/d60/d62/fa8 [1259726,69676] 0 2024-04-25T02:08:53.656 INFO:tasks.workunit.client.0.smithi077.stdout:4/702: creat d0/d14/d21/d39/d1d/d98/fe1 x:0 0 0 2024-04-25T02:08:53.657 INFO:tasks.workunit.client.0.smithi077.stdout:5/667: dwrite d0/d25/d82/d87/d8b/da5/dc4/d23/d4a/f5d [0,4194304] 0 2024-04-25T02:08:53.657 INFO:tasks.workunit.client.0.smithi077.stdout:5/668: chown d0/d25/d82/d87/d8b/da5/dc4/la9 9 1 2024-04-25T02:08:53.657 INFO:tasks.workunit.client.0.smithi077.stdout:7/599: dwrite d4/d13/d18/d24/d3f/fc5 [0,4194304] 0 2024-04-25T02:08:53.657 INFO:tasks.workunit.client.0.smithi077.stdout:8/780: fsync d3/da/db/df/d2b/d37/ff4 0 2024-04-25T02:08:53.657 INFO:tasks.workunit.client.0.smithi077.stdout:7/600: chown d4/d13/d18/d2d/d30/l45 156248 1 2024-04-25T02:08:53.657 INFO:tasks.workunit.client.0.smithi077.stdout:2/690: creat d2/d9/d56/fed x:0 0 0 2024-04-25T02:08:53.658 INFO:tasks.workunit.client.0.smithi077.stdout:2/691: fdatasync d2/d9/d18/fb9 0 2024-04-25T02:08:53.658 INFO:tasks.workunit.client.0.smithi077.stdout:3/685: unlink d0/d2/de/d48/d15/f2a 0 2024-04-25T02:08:53.662 INFO:tasks.workunit.client.0.smithi077.stdout:6/812: sync 2024-04-25T02:08:53.663 INFO:tasks.workunit.client.0.smithi077.stdout:9/665: sync 2024-04-25T02:08:53.663 INFO:tasks.workunit.client.0.smithi077.stdout:1/668: sync 2024-04-25T02:08:53.663 INFO:tasks.workunit.client.0.smithi077.stdout:9/666: fdatasync df/d60/f83 0 2024-04-25T02:08:53.667 INFO:tasks.workunit.client.0.smithi077.stdout:5/669: creat d0/d2/da8/daf/fd9 x:0 0 0 2024-04-25T02:08:53.667 INFO:tasks.workunit.client.0.smithi077.stdout:5/670: readlink d0/d2/da8/lc0 0 2024-04-25T02:08:53.673 INFO:tasks.workunit.client.0.smithi077.stdout:8/781: mknod d3/da/d27/d16/d6b/cfc 0 2024-04-25T02:08:53.678 INFO:tasks.workunit.client.0.smithi077.stdout:2/692: write d2/d9/d2f/d84/fbd [3711859,22900] 0 2024-04-25T02:08:53.680 INFO:tasks.workunit.client.0.smithi077.stdout:3/686: link d0/d3e/d62/faf d0/d2/d2f/d5f/ffa 0 2024-04-25T02:08:53.680 INFO:tasks.workunit.client.0.smithi077.stdout:3/687: stat d0/d17/d4b/d59/f8e 0 2024-04-25T02:08:53.681 INFO:tasks.workunit.client.0.smithi077.stdout:1/669: mknod db/df/d14/d4d/d82/d32/d8f/ce0 0 2024-04-25T02:08:53.682 INFO:tasks.workunit.client.0.smithi077.stdout:3/688: mknod d0/d17/cfb 0 2024-04-25T02:08:53.684 INFO:tasks.workunit.client.0.smithi077.stdout:6/813: mkdir de/d12/d25/d60/d10e 0 2024-04-25T02:08:53.685 INFO:tasks.workunit.client.0.smithi077.stdout:1/670: truncate f1 1719452 0 2024-04-25T02:08:53.686 INFO:tasks.workunit.client.0.smithi077.stdout:2/693: getdents d2/d9/d2f/d84/da6 0 2024-04-25T02:08:53.686 INFO:tasks.workunit.client.0.smithi077.stdout:2/694: creat d2/d9/d56/fee x:0 0 0 2024-04-25T02:08:53.686 INFO:tasks.workunit.client.0.smithi077.stdout:2/695: truncate d2/d9/f8e 311025 0 2024-04-25T02:08:53.686 INFO:tasks.workunit.client.0.smithi077.stdout:2/696: write d2/d9/ddc/dad/fba [761000,61946] 0 2024-04-25T02:08:53.687 INFO:tasks.workunit.client.0.smithi077.stdout:2/697: chown d2/d9/d18/d31/c41 53 1 2024-04-25T02:08:53.688 INFO:tasks.workunit.client.0.smithi077.stdout:3/689: creat d0/d3e/ffc x:0 0 0 2024-04-25T02:08:53.688 INFO:tasks.workunit.client.0.smithi077.stdout:3/690: readlink d0/d17/d4b/d59/dc2/ldb 0 2024-04-25T02:08:53.688 INFO:tasks.workunit.client.0.smithi077.stdout:3/691: chown d0/d2/de/lf 1 1 2024-04-25T02:08:53.691 INFO:tasks.workunit.client.0.smithi077.stdout:1/671: creat db/df/d14/d33/d6c/fe1 x:0 0 0 2024-04-25T02:08:53.693 INFO:tasks.workunit.client.0.smithi077.stdout:3/692: creat d0/dc5/ffd x:0 0 0 2024-04-25T02:08:53.695 INFO:tasks.workunit.client.0.smithi077.stdout:6/814: link de/d53/d6f/fb0 de/d12/d25/f10f 0 2024-04-25T02:08:53.697 INFO:tasks.workunit.client.0.smithi077.stdout:1/672: rename db/c94 to db/df/d14/d33/d34/d66/ce2 0 2024-04-25T02:08:53.698 INFO:tasks.workunit.client.0.smithi077.stdout:6/815: truncate f5 3925255 0 2024-04-25T02:08:53.702 INFO:tasks.workunit.client.0.smithi077.stdout:3/693: dread d0/d3e/d93/fa5 [0,4194304] 0 2024-04-25T02:08:53.702 INFO:tasks.workunit.client.0.smithi077.stdout:3/694: chown d0/d3e 7618658 1 2024-04-25T02:08:53.702 INFO:tasks.workunit.client.0.smithi077.stdout:6/816: mknod de/d55/db7/c110 0 2024-04-25T02:08:53.702 INFO:tasks.workunit.client.0.smithi077.stdout:1/673: dread db/df/d14/f17 [0,4194304] 0 2024-04-25T02:08:53.702 INFO:tasks.workunit.client.0.smithi077.stdout:3/695: creat d0/d2/d2f/ffe x:0 0 0 2024-04-25T02:08:53.702 INFO:tasks.workunit.client.0.smithi077.stdout:6/817: symlink de/d5b/da6/l111 0 2024-04-25T02:08:53.702 INFO:tasks.workunit.client.0.smithi077.stdout:6/818: chown de/d12/d25/d3a/d6a/l6d 928 1 2024-04-25T02:08:53.702 INFO:tasks.workunit.client.0.smithi077.stdout:6/819: dread - de/d12/d25/d4b/fd0 zero size 2024-04-25T02:08:53.702 INFO:tasks.workunit.client.0.smithi077.stdout:6/820: chown de/d55 6703530 1 2024-04-25T02:08:53.703 INFO:tasks.workunit.client.0.smithi077.stdout:6/821: fsync de/d12/d25/d3a/d6a/dcd/fda 0 2024-04-25T02:08:53.703 INFO:tasks.workunit.client.0.smithi077.stdout:1/674: creat db/df/fe3 x:0 0 0 2024-04-25T02:08:53.703 INFO:tasks.workunit.client.0.smithi077.stdout:3/696: symlink d0/d3e/d93/dae/lff 0 2024-04-25T02:08:53.703 INFO:tasks.workunit.client.0.smithi077.stdout:1/675: mkdir db/df/d14/d4d/da9/de4 0 2024-04-25T02:08:53.703 INFO:tasks.workunit.client.0.smithi077.stdout:1/676: read - db/df/d14/d4d/d82/d42/d43/fb2 zero size 2024-04-25T02:08:53.705 INFO:tasks.workunit.client.0.smithi077.stdout:3/697: dread d0/f3c [0,4194304] 0 2024-04-25T02:08:53.709 INFO:tasks.workunit.client.0.smithi077.stdout:5/671: dwrite d0/d2/d1b/d35/f4f [4194304,4194304] 0 2024-04-25T02:08:53.709 INFO:tasks.workunit.client.0.smithi077.stdout:5/672: write d0/d2/d3/f2f [807537,3190] 0 2024-04-25T02:08:53.709 INFO:tasks.workunit.client.0.smithi077.stdout:5/673: dread - d0/d2/d1b/d35/fd5 zero size 2024-04-25T02:08:53.710 INFO:tasks.workunit.client.0.smithi077.stdout:2/698: dwrite d2/d9/d19/d1c/d3f/d53/fa3 [0,4194304] 0 2024-04-25T02:08:53.710 INFO:tasks.workunit.client.0.smithi077.stdout:9/667: dwrite df/d1b/d48/f64 [4194304,4194304] 0 2024-04-25T02:08:53.710 INFO:tasks.workunit.client.0.smithi077.stdout:9/668: chown df/d1b/l24 1 1 2024-04-25T02:08:53.711 INFO:tasks.workunit.client.0.smithi077.stdout:0/685: dwrite d2/d17/d1d/d34/d4c/da2/d51/fcf [0,4194304] 0 2024-04-25T02:08:53.711 INFO:tasks.workunit.client.0.smithi077.stdout:0/686: dread - d2/d8/fd0 zero size 2024-04-25T02:08:53.711 INFO:tasks.workunit.client.0.smithi077.stdout:6/822: dread f9 [0,4194304] 0 2024-04-25T02:08:53.713 INFO:tasks.workunit.client.0.smithi077.stdout:1/677: write db/df/d14/d4d/d82/d42/fb1 [2546781,52390] 0 2024-04-25T02:08:53.713 INFO:tasks.workunit.client.0.smithi077.stdout:7/601: dwrite d4/f50 [4194304,4194304] 0 2024-04-25T02:08:53.714 INFO:tasks.workunit.client.0.smithi077.stdout:2/699: rmdir d2/d9/d19/dc2 0 2024-04-25T02:08:53.714 INFO:tasks.workunit.client.0.smithi077.stdout:2/700: write d2/d59/d79/f9f [4634010,105363] 0 2024-04-25T02:08:53.714 INFO:tasks.workunit.client.0.smithi077.stdout:2/701: fsync d2/d9/d19/d1c/f81 0 2024-04-25T02:08:53.714 INFO:tasks.workunit.client.0.smithi077.stdout:2/702: fdatasync d2/d9/f8c 0 2024-04-25T02:08:53.715 INFO:tasks.workunit.client.0.smithi077.stdout:4/703: truncate d0/d14/d60/d62/fa8 1010211 0 2024-04-25T02:08:53.718 INFO:tasks.workunit.client.0.smithi077.stdout:9/669: rename df/d1b/d70/d74/dce to df/d1b/d56/ddf 0 2024-04-25T02:08:53.718 INFO:tasks.workunit.client.0.smithi077.stdout:9/670: chown df/d1b/d70/c8f 48 1 2024-04-25T02:08:53.722 INFO:tasks.workunit.client.0.smithi077.stdout:0/687: mknod d2/d17/d1d/d34/d4c/da2/cf1 0 2024-04-25T02:08:53.723 INFO:tasks.workunit.client.0.smithi077.stdout:6/823: symlink de/d12/d25/d3a/d6a/dcd/d36/dd2/l112 0 2024-04-25T02:08:53.724 INFO:tasks.workunit.client.0.smithi077.stdout:5/674: mkdir d0/d2/dda 0 2024-04-25T02:08:53.724 INFO:tasks.workunit.client.0.smithi077.stdout:5/675: fdatasync d0/d2/d3/f34 0 2024-04-25T02:08:53.724 INFO:tasks.workunit.client.0.smithi077.stdout:5/676: readlink d0/d2/d1b/d3b/l40 0 2024-04-25T02:08:53.734 INFO:tasks.workunit.client.0.smithi077.stdout:3/698: getdents d0/d2/d2f 0 2024-04-25T02:08:53.738 INFO:tasks.workunit.client.0.smithi077.stdout:1/678: mknod db/df/d14/d3e/d69/ce5 0 2024-04-25T02:08:53.739 INFO:tasks.workunit.client.0.smithi077.stdout:6/824: dwrite de/d53/f69 [0,4194304] 0 2024-04-25T02:08:53.740 INFO:tasks.workunit.client.0.smithi077.stdout:7/602: creat d4/d13/d18/d24/d3f/d59/fc9 x:0 0 0 2024-04-25T02:08:53.742 INFO:tasks.workunit.client.0.smithi077.stdout:2/703: mkdir d2/d9/d18/d31/def 0 2024-04-25T02:08:53.744 INFO:tasks.workunit.client.0.smithi077.stdout:4/704: creat d0/fe2 x:0 0 0 2024-04-25T02:08:53.749 INFO:tasks.workunit.client.0.smithi077.stdout:9/671: rename df/d1b/d56/d67/f8e to df/d1b/d48/db6/fe0 0 2024-04-25T02:08:53.751 INFO:tasks.workunit.client.0.smithi077.stdout:5/677: creat d0/d2/d3/d9/d39/d44/d5f/da4/fdb x:0 0 0 2024-04-25T02:08:53.751 INFO:tasks.workunit.client.0.smithi077.stdout:3/699: truncate d0/d3e/d93/fa5 2797352 0 2024-04-25T02:08:53.752 INFO:tasks.workunit.client.0.smithi077.stdout:3/700: chown d0/d2/l1c 477303 1 2024-04-25T02:08:53.756 INFO:tasks.workunit.client.0.smithi077.stdout:1/679: dwrite db/df/d56/dc3/fd7 [0,4194304] 0 2024-04-25T02:08:53.760 INFO:tasks.workunit.client.0.smithi077.stdout:0/688: rename d2/d17/d1d/d34/d4c/f72 to d2/d1c/ff2 0 2024-04-25T02:08:53.761 INFO:tasks.workunit.client.0.smithi077.stdout:5/678: mknod d0/d25/d82/d87/d8b/da5/dc4/d23/d4a/cdc 0 2024-04-25T02:08:53.763 INFO:tasks.workunit.client.0.smithi077.stdout:1/680: write db/df/d14/d4d/d82/f39 [3398835,45012] 0 2024-04-25T02:08:53.763 INFO:tasks.workunit.client.0.smithi077.stdout:3/701: mknod d0/d2/de/d36/c100 0 2024-04-25T02:08:53.763 INFO:tasks.workunit.client.0.smithi077.stdout:3/702: write d0/d2/d2f/d50/fe3 [216487,29619] 0 2024-04-25T02:08:53.764 INFO:tasks.workunit.client.0.smithi077.stdout:6/825: rmdir de/d12/d25/d3a/d6a/dcd 39 2024-04-25T02:08:53.766 INFO:tasks.workunit.client.0.smithi077.stdout:4/705: unlink d0/d14/d79/l8c 0 2024-04-25T02:08:53.770 INFO:tasks.workunit.client.0.smithi077.stdout:2/704: rename d2/d9/d18/d1b/fd7 to d2/d9/d56/ff0 0 2024-04-25T02:08:53.770 INFO:tasks.workunit.client.0.smithi077.stdout:2/705: chown d2/d9/d18/d1b/c6b 2523 1 2024-04-25T02:08:53.771 INFO:tasks.workunit.client.0.smithi077.stdout:0/689: mkdir d2/d17/d1d/d34/d4c/da2/de2/df3 0 2024-04-25T02:08:53.773 INFO:tasks.workunit.client.0.smithi077.stdout:5/679: mknod d0/d2/d1b/d3b/cdd 0 2024-04-25T02:08:53.773 INFO:tasks.workunit.client.0.smithi077.stdout:5/680: write d0/d25/d82/d87/d8b/da5/dc4/d23/fb7 [58657,63268] 0 2024-04-25T02:08:53.778 INFO:tasks.workunit.client.0.smithi077.stdout:9/672: rename df/f31 to df/d60/fe1 0 2024-04-25T02:08:53.778 INFO:tasks.workunit.client.0.smithi077.stdout:9/673: chown df/d60/d87/f91 249 1 2024-04-25T02:08:53.779 INFO:tasks.workunit.client.0.smithi077.stdout:2/706: symlink d2/d9/ddc/lf1 0 2024-04-25T02:08:53.781 INFO:tasks.workunit.client.0.smithi077.stdout:5/681: write d0/d2/d3/d9/d39/d44/f95 [2212293,331] 0 2024-04-25T02:08:53.781 INFO:tasks.workunit.client.0.smithi077.stdout:6/826: rename de/d12/d25/d60 to de/d12/d25/d3a/d6a/d113 0 2024-04-25T02:08:53.784 INFO:tasks.workunit.client.0.smithi077.stdout:5/682: mkdir d0/d2/d3/d9/d39/d44/d5f/dde 0 2024-04-25T02:08:53.784 INFO:tasks.workunit.client.0.smithi077.stdout:5/683: write d0/d2/d3/d9/f2b [3327335,126966] 0 2024-04-25T02:08:53.784 INFO:tasks.workunit.client.0.smithi077.stdout:5/684: fdatasync d0/d2/d1b/d3b/fd1 0 2024-04-25T02:08:53.788 INFO:tasks.workunit.client.0.smithi077.stdout:2/707: rename d2/d59/f71 to d2/d78/d95/ff2 0 2024-04-25T02:08:53.788 INFO:tasks.workunit.client.0.smithi077.stdout:2/708: chown d2/d9/d18/d31/fe7 6320971 1 2024-04-25T02:08:53.788 INFO:tasks.workunit.client.0.smithi077.stdout:2/709: stat d2/d9/d19/d1c 0 2024-04-25T02:08:53.789 INFO:tasks.workunit.client.0.smithi077.stdout:5/685: mkdir d0/d2/d68/ddf 0 2024-04-25T02:08:53.791 INFO:tasks.workunit.client.0.smithi077.stdout:5/686: dread d0/d2/d3/d9/d39/d3c/f91 [0,4194304] 0 2024-04-25T02:08:53.791 INFO:tasks.workunit.client.0.smithi077.stdout:5/687: fdatasync d0/d25/dc7/dca/f1f 0 2024-04-25T02:08:53.795 INFO:tasks.workunit.client.0.smithi077.stdout:0/690: read d2/d17/d1d/d34/f36 [1898090,7359] 0 2024-04-25T02:08:53.795 INFO:tasks.workunit.client.0.smithi077.stdout:0/691: truncate d2/d17/d1d/d34/d4c/da2/f6f 757463 0 2024-04-25T02:08:53.795 INFO:tasks.workunit.client.0.smithi077.stdout:0/692: truncate d2/d8/d5f/fc2 4370384 0 2024-04-25T02:08:53.795 INFO:tasks.workunit.client.0.smithi077.stdout:0/693: read - d2/d8/d5f/d9f/fe1 zero size 2024-04-25T02:08:53.795 INFO:tasks.workunit.client.0.smithi077.stdout:0/694: creat d2/d8/db6/dd7/de0/ff4 x:0 0 0 2024-04-25T02:08:53.795 INFO:tasks.workunit.client.0.smithi077.stdout:0/695: truncate d2/d8/f55 886546 0 2024-04-25T02:08:53.795 INFO:tasks.workunit.client.0.smithi077.stdout:0/696: truncate d2/d17/d1d/f3d 1432820 0 2024-04-25T02:08:53.795 INFO:tasks.workunit.client.0.smithi077.stdout:6/827: write de/d53/f7c [4082214,59380] 0 2024-04-25T02:08:53.795 INFO:tasks.workunit.client.0.smithi077.stdout:2/710: dread d2/d9/f8e [0,4194304] 0 2024-04-25T02:08:53.798 INFO:tasks.workunit.client.0.smithi077.stdout:6/828: mkdir de/d12/d114 0 2024-04-25T02:08:53.799 INFO:tasks.workunit.client.0.smithi077.stdout:2/711: mkdir d2/d9/d18/d31/d7c/df3 0 2024-04-25T02:08:53.801 INFO:tasks.workunit.client.0.smithi077.stdout:2/712: mkdir d2/d9/d19/d2c/d72/df4 0 2024-04-25T02:08:53.802 INFO:tasks.workunit.client.0.smithi077.stdout:1/681: dwrite db/df/d14/d4d/d82/d5c/f5e [0,4194304] 0 2024-04-25T02:08:53.802 INFO:tasks.workunit.client.0.smithi077.stdout:9/674: dwrite df/d60/d87/dca/fd9 [0,4194304] 0 2024-04-25T02:08:53.803 INFO:tasks.workunit.client.0.smithi077.stdout:4/706: dwrite d0/d14/d21/d39/f10 [0,4194304] 0 2024-04-25T02:08:53.803 INFO:tasks.workunit.client.0.smithi077.stdout:4/707: write d0/d14/d21/d39/da/f5b [1689678,115191] 0 2024-04-25T02:08:53.804 INFO:tasks.workunit.client.0.smithi077.stdout:2/713: rename d2/d59/d79/dc1 to d2/d9/d18/d1b/df5 0 2024-04-25T02:08:53.806 INFO:tasks.workunit.client.0.smithi077.stdout:1/682: getdents db/df/d56/dc3/dcd 0 2024-04-25T02:08:53.808 INFO:tasks.workunit.client.0.smithi077.stdout:9/675: write df/d1b/f40 [5107882,128621] 0 2024-04-25T02:08:53.812 INFO:tasks.workunit.client.0.smithi077.stdout:9/676: write df/fd8 [728912,40092] 0 2024-04-25T02:08:53.816 INFO:tasks.workunit.client.0.smithi077.stdout:5/688: dwrite d0/d2/d1b/d38/f64 [0,4194304] 0 2024-04-25T02:08:53.820 INFO:tasks.workunit.client.0.smithi077.stdout:4/708: creat d0/d14/d21/d39/da/fe3 x:0 0 0 2024-04-25T02:08:53.821 INFO:tasks.workunit.client.0.smithi077.stdout:0/697: dwrite d2/d1c/f4f [0,4194304] 0 2024-04-25T02:08:53.825 INFO:tasks.workunit.client.0.smithi077.stdout:1/683: symlink db/df/d14/d4d/d82/d42/d43/le6 0 2024-04-25T02:08:53.825 INFO:tasks.workunit.client.0.smithi077.stdout:1/684: write db/df/d14/f67 [3525205,83325] 0 2024-04-25T02:08:53.827 INFO:tasks.workunit.client.0.smithi077.stdout:9/677: rename df/f43 to df/d1b/d70/d74/fe2 0 2024-04-25T02:08:53.827 INFO:tasks.workunit.client.0.smithi077.stdout:9/678: stat df/d1b/d48/d75 0 2024-04-25T02:08:53.827 INFO:tasks.workunit.client.0.smithi077.stdout:9/679: write df/d1b/d48/d75/f8d [1013478,128762] 0 2024-04-25T02:08:53.827 INFO:tasks.workunit.client.0.smithi077.stdout:9/680: creat df/d1b/d70/d84/fe3 x:0 0 0 2024-04-25T02:08:53.832 INFO:tasks.workunit.client.0.smithi077.stdout:5/689: creat d0/d25/d82/d87/d8b/da5/dc4/d23/d4a/fe0 x:0 0 0 2024-04-25T02:08:53.833 INFO:tasks.workunit.client.0.smithi077.stdout:4/709: stat d0/d14/d21/d39/f4d 0 2024-04-25T02:08:53.833 INFO:tasks.workunit.client.0.smithi077.stdout:4/710: chown d0/f16 45 1 2024-04-25T02:08:53.833 INFO:tasks.workunit.client.0.smithi077.stdout:4/711: fsync d0/d14/d60/d78/dce/fd6 0 2024-04-25T02:08:53.834 INFO:tasks.workunit.client.0.smithi077.stdout:0/698: mkdir d2/d17/d1d/d34/d4c/da2/df5 0 2024-04-25T02:08:53.834 INFO:tasks.workunit.client.0.smithi077.stdout:0/699: readlink d2/d17/d4e/l6b 0 2024-04-25T02:08:53.837 INFO:tasks.workunit.client.0.smithi077.stdout:1/685: rename db/df/d14/d3e/d69/f90 to db/df/d14/d50/fe7 0 2024-04-25T02:08:53.839 INFO:tasks.workunit.client.0.smithi077.stdout:6/829: dwrite de/d12/d25/f9f [0,4194304] 0 2024-04-25T02:08:53.840 INFO:tasks.workunit.client.0.smithi077.stdout:2/714: dwrite f1 [0,4194304] 0 2024-04-25T02:08:53.840 INFO:tasks.workunit.client.0.smithi077.stdout:0/700: symlink d2/d9/d2a/lf6 0 2024-04-25T02:08:53.840 INFO:tasks.workunit.client.0.smithi077.stdout:0/701: write d2/d17/d1d/f53 [838619,130460] 0 2024-04-25T02:08:53.840 INFO:tasks.workunit.client.0.smithi077.stdout:0/702: chown d2/d27/d2d/dce/de7/f93 2953 1 2024-04-25T02:08:53.841 INFO:tasks.workunit.client.0.smithi077.stdout:0/703: readlink d2/d17/d4e/l6b 0 2024-04-25T02:08:53.841 INFO:tasks.workunit.client.0.smithi077.stdout:0/704: fdatasync d2/d17/d1d/d34/d4c/da2/f67 0 2024-04-25T02:08:53.843 INFO:tasks.workunit.client.0.smithi077.stdout:4/712: rename d0/d14/d60/d86/d25/fa5 to d0/d14/d21/d39/da/d12/fe4 0 2024-04-25T02:08:53.844 INFO:tasks.workunit.client.0.smithi077.stdout:1/686: creat db/df/d14/d33/d34/db4/fe8 x:0 0 0 2024-04-25T02:08:53.845 INFO:tasks.workunit.client.0.smithi077.stdout:5/690: dread d0/d2/d3/d9/d39/d44/d5f/f73 [0,4194304] 0 2024-04-25T02:08:53.852 INFO:tasks.workunit.client.0.smithi077.stdout:6/830: write de/d53/f69 [3744962,1294] 0 2024-04-25T02:08:53.853 INFO:tasks.workunit.client.0.smithi077.stdout:6/831: readlink de/d12/d25/d4b/lea 0 2024-04-25T02:08:53.854 INFO:tasks.workunit.client.0.smithi077.stdout:2/715: unlink d2/d9/d18/fb9 0 2024-04-25T02:08:53.855 INFO:tasks.workunit.client.0.smithi077.stdout:0/705: creat d2/d27/ff7 x:0 0 0 2024-04-25T02:08:53.860 INFO:tasks.workunit.client.0.smithi077.stdout:4/713: mkdir d0/d14/d21/d39/da/d12/de5 0 2024-04-25T02:08:53.860 INFO:tasks.workunit.client.0.smithi077.stdout:4/714: chown d0/d14/d60/d62 1 1 2024-04-25T02:08:53.860 INFO:tasks.workunit.client.0.smithi077.stdout:4/715: read d0/d14/d21/d39/d1d/f73 [716793,13203] 0 2024-04-25T02:08:53.860 INFO:tasks.workunit.client.0.smithi077.stdout:4/716: write d0/d14/d21/d39/da/d12/d35/d3e/f8f [232440,40321] 0 2024-04-25T02:08:53.860 INFO:tasks.workunit.client.0.smithi077.stdout:4/717: stat d0/d14/d60 0 2024-04-25T02:08:53.860 INFO:tasks.workunit.client.0.smithi077.stdout:4/718: dread - d0/d14/d21/d39/d1d/d98/fc1 zero size 2024-04-25T02:08:53.860 INFO:tasks.workunit.client.0.smithi077.stdout:4/719: chown d0/d14/d21/d39/d1d/f2c 31 1 2024-04-25T02:08:53.860 INFO:tasks.workunit.client.0.smithi077.stdout:6/832: read de/d5b/da6/fd8 [2319361,119476] 0 2024-04-25T02:08:53.861 INFO:tasks.workunit.client.0.smithi077.stdout:1/687: symlink db/df/d14/d4d/da9/de4/le9 0 2024-04-25T02:08:53.861 INFO:tasks.workunit.client.0.smithi077.stdout:4/720: dread d0/d14/d60/fa7 [0,4194304] 0 2024-04-25T02:08:53.861 INFO:tasks.workunit.client.0.smithi077.stdout:8/782: sync 2024-04-25T02:08:53.863 INFO:tasks.workunit.client.0.smithi077.stdout:6/833: mknod de/d12/d25/d3a/c115 0 2024-04-25T02:08:53.865 INFO:tasks.workunit.client.0.smithi077.stdout:1/688: unlink db/df/d14/d33/ccf 0 2024-04-25T02:08:53.867 INFO:tasks.workunit.client.0.smithi077.stdout:4/721: rename d0/d14/d21/d39/da/d12/d35/d3e/d3a/f51 to d0/d14/d60/d62/fe6 0 2024-04-25T02:08:53.867 INFO:tasks.workunit.client.0.smithi077.stdout:4/722: chown d0/d14/d21/d39/da/d12/d35/d3e/f4b 11662 1 2024-04-25T02:08:53.868 INFO:tasks.workunit.client.0.smithi077.stdout:8/783: mknod d3/da/d27/d16/dd2/cfd 0 2024-04-25T02:08:53.869 INFO:tasks.workunit.client.0.smithi077.stdout:1/689: symlink db/df/d14/d4d/d82/d42/d43/lea 0 2024-04-25T02:08:53.870 INFO:tasks.workunit.client.0.smithi077.stdout:5/691: dwrite d0/d2/d1b/f26 [0,4194304] 0 2024-04-25T02:08:53.870 INFO:tasks.workunit.client.0.smithi077.stdout:5/692: chown d0/d2/d3/d9/d39/d44 233542285 1 2024-04-25T02:08:53.872 INFO:tasks.workunit.client.0.smithi077.stdout:4/723: creat d0/d14/d79/da4/dac/fe7 x:0 0 0 2024-04-25T02:08:53.874 INFO:tasks.workunit.client.0.smithi077.stdout:8/784: symlink d3/da/db/df/d2b/d70/d7f/lfe 0 2024-04-25T02:08:53.874 INFO:tasks.workunit.client.0.smithi077.stdout:8/785: fsync d3/d7a/d7e/db0/fee 0 2024-04-25T02:08:53.874 INFO:tasks.workunit.client.0.smithi077.stdout:8/786: dread - d3/da/db/df/d30/f40 zero size 2024-04-25T02:08:53.874 INFO:tasks.workunit.client.0.smithi077.stdout:8/787: readlink d3/da/db/df/ddc/ddf/le4 0 2024-04-25T02:08:53.874 INFO:tasks.workunit.client.0.smithi077.stdout:8/788: getdents d3/d7a/de5 0 2024-04-25T02:08:53.875 INFO:tasks.workunit.client.0.smithi077.stdout:1/690: getdents db/df/d14/d4d/da9 0 2024-04-25T02:08:53.876 INFO:tasks.workunit.client.0.smithi077.stdout:1/691: write db/df/d56/d5d/d77/f91 [992760,48955] 0 2024-04-25T02:08:53.876 INFO:tasks.workunit.client.0.smithi077.stdout:1/692: read db/df/d14/d4d/d82/f39 [1449137,82067] 0 2024-04-25T02:08:53.878 INFO:tasks.workunit.client.0.smithi077.stdout:4/724: symlink d0/d14/d21/d39/da/d12/de5/le8 0 2024-04-25T02:08:53.879 INFO:tasks.workunit.client.0.smithi077.stdout:2/716: dwrite d2/d9/fb [0,4194304] 0 2024-04-25T02:08:53.879 INFO:tasks.workunit.client.0.smithi077.stdout:2/717: truncate d2/d9/f8e 1279022 0 2024-04-25T02:08:53.881 INFO:tasks.workunit.client.0.smithi077.stdout:1/693: dread db/df/d14/d4d/d82/d42/f7c [0,4194304] 0 2024-04-25T02:08:53.881 INFO:tasks.workunit.client.0.smithi077.stdout:2/718: mknod d2/d28/cf6 0 2024-04-25T02:08:53.882 INFO:tasks.workunit.client.0.smithi077.stdout:1/694: truncate db/df/d1b/f6f 780713 0 2024-04-25T02:08:53.883 INFO:tasks.workunit.client.0.smithi077.stdout:6/834: dwrite de/d12/d25/d3a/d6a/f7e [0,4194304] 0 2024-04-25T02:08:53.884 INFO:tasks.workunit.client.0.smithi077.stdout:2/719: rename d2/d9/d19/d1c/d3f/d53/d83/f99 to d2/d9/d19/d1c/d3f/d53/d83/ff7 0 2024-04-25T02:08:53.886 INFO:tasks.workunit.client.0.smithi077.stdout:1/695: unlink db/df/l92 0 2024-04-25T02:08:53.888 INFO:tasks.workunit.client.0.smithi077.stdout:6/835: mkdir de/d55/d88/d116 0 2024-04-25T02:08:53.888 INFO:tasks.workunit.client.0.smithi077.stdout:6/836: chown de/d55/db7/f10b 422 1 2024-04-25T02:08:53.889 INFO:tasks.workunit.client.0.smithi077.stdout:1/696: mkdir db/df/d14/d3e/daa/deb 0 2024-04-25T02:08:53.889 INFO:tasks.workunit.client.0.smithi077.stdout:1/697: creat db/df/d14/d4d/d82/d32/d8f/fec x:0 0 0 2024-04-25T02:08:53.889 INFO:tasks.workunit.client.0.smithi077.stdout:1/698: readlink db/df/d14/d3e/daa/lc1 0 2024-04-25T02:08:53.890 INFO:tasks.workunit.client.0.smithi077.stdout:6/837: symlink de/d12/d25/d3a/d6a/d113/d10e/l117 0 2024-04-25T02:08:53.892 INFO:tasks.workunit.client.0.smithi077.stdout:1/699: rename db/df/d56/dc3/fd7 to db/df/d14/d4d/fed 0 2024-04-25T02:08:53.894 INFO:tasks.workunit.client.0.smithi077.stdout:6/838: creat de/d12/f118 x:0 0 0 2024-04-25T02:08:53.894 INFO:tasks.workunit.client.0.smithi077.stdout:6/839: write de/d12/d25/d4b/fee [736065,8335] 0 2024-04-25T02:08:53.895 INFO:tasks.workunit.client.0.smithi077.stdout:1/700: rmdir db/df/d14/d4d/d82/d42 39 2024-04-25T02:08:53.895 INFO:tasks.workunit.client.0.smithi077.stdout:1/701: creat db/df/fee x:0 0 0 2024-04-25T02:08:53.895 INFO:tasks.workunit.client.0.smithi077.stdout:1/702: write db/fa6 [349804,116769] 0 2024-04-25T02:08:53.895 INFO:tasks.workunit.client.0.smithi077.stdout:1/703: chown db/df/d14/c74 15698836 1 2024-04-25T02:08:53.896 INFO:tasks.workunit.client.0.smithi077.stdout:6/840: creat de/d12/d25/d3a/d6a/dcd/f119 x:0 0 0 2024-04-25T02:08:53.898 INFO:tasks.workunit.client.0.smithi077.stdout:1/704: symlink db/df/d14/d3e/daa/deb/lef 0 2024-04-25T02:08:53.898 INFO:tasks.workunit.client.0.smithi077.stdout:3/703: sync 2024-04-25T02:08:53.898 INFO:tasks.workunit.client.0.smithi077.stdout:7/603: sync 2024-04-25T02:08:53.898 INFO:tasks.workunit.client.0.smithi077.stdout:2/720: dread d2/d59/d79/f9f [0,4194304] 0 2024-04-25T02:08:53.899 INFO:tasks.workunit.client.0.smithi077.stdout:8/789: dwrite d3/da/d27/f21 [4194304,4194304] 0 2024-04-25T02:08:53.899 INFO:tasks.workunit.client.0.smithi077.stdout:8/790: readlink d3/d81/d86/l99 0 2024-04-25T02:08:53.900 INFO:tasks.workunit.client.0.smithi077.stdout:7/604: symlink d4/d13/d18/d2d/d56/d68/db3/lca 0 2024-04-25T02:08:53.901 INFO:tasks.workunit.client.0.smithi077.stdout:4/725: dwrite d0/d14/d21/d39/d9a/fb9 [0,4194304] 0 2024-04-25T02:08:53.903 INFO:tasks.workunit.client.0.smithi077.stdout:7/605: mknod d4/ccb 0 2024-04-25T02:08:53.903 INFO:tasks.workunit.client.0.smithi077.stdout:5/693: dwrite d0/d25/d82/d87/d8b/da5/dc4/d23/d4a/fe0 [0,4194304] 0 2024-04-25T02:08:53.903 INFO:tasks.workunit.client.0.smithi077.stdout:5/694: fsync d0/f85 0 2024-04-25T02:08:53.908 INFO:tasks.workunit.client.0.smithi077.stdout:4/726: unlink d0/d14/d60/d86/d96/f5e 0 2024-04-25T02:08:53.912 INFO:tasks.workunit.client.0.smithi077.stdout:2/721: write d2/d9/d19/d1c/d3f/d53/f8a [154839,88168] 0 2024-04-25T02:08:53.920 INFO:tasks.workunit.client.0.smithi077.stdout:7/606: rmdir d4/d13/d18/d2d/d30 39 2024-04-25T02:08:53.920 INFO:tasks.workunit.client.0.smithi077.stdout:7/607: fdatasync d4/f16 0 2024-04-25T02:08:53.920 INFO:tasks.workunit.client.0.smithi077.stdout:7/608: write d4/d13/d5b/d8b/fb5 [1476220,45561] 0 2024-04-25T02:08:53.924 INFO:tasks.workunit.client.0.smithi077.stdout:2/722: unlink d2/d9/d18/c51 0 2024-04-25T02:08:53.926 INFO:tasks.workunit.client.0.smithi077.stdout:5/695: rename d0/d25/d82/d87/d8b/l66 to d0/d25/le1 0 2024-04-25T02:08:53.926 INFO:tasks.workunit.client.0.smithi077.stdout:5/696: stat d0/d2/d3/f34 0 2024-04-25T02:08:53.928 INFO:tasks.workunit.client.0.smithi077.stdout:2/723: unlink d2/d59/d79/db4/ce1 0 2024-04-25T02:08:53.930 INFO:tasks.workunit.client.0.smithi077.stdout:2/724: rename d2/d9/f17 to d2/d9/d19/d1c/ff8 0 2024-04-25T02:08:53.930 INFO:tasks.workunit.client.0.smithi077.stdout:2/725: write d2/f88 [9211865,28647] 0 2024-04-25T02:08:53.931 INFO:tasks.workunit.client.0.smithi077.stdout:7/609: write d4/fb [3377629,70849] 0 2024-04-25T02:08:53.931 INFO:tasks.workunit.client.0.smithi077.stdout:7/610: write d4/f37 [288664,102840] 0 2024-04-25T02:08:53.935 INFO:tasks.workunit.client.0.smithi077.stdout:2/726: dread d2/d78/fac [0,4194304] 0 2024-04-25T02:08:53.937 INFO:tasks.workunit.client.0.smithi077.stdout:3/704: dwrite d0/d2/de/d48/d15/f56 [0,4194304] 0 2024-04-25T02:08:53.937 INFO:tasks.workunit.client.0.smithi077.stdout:7/611: symlink d4/d13/d18/d2d/d56/d68/db3/lcc 0 2024-04-25T02:08:53.937 INFO:tasks.workunit.client.0.smithi077.stdout:7/612: write d4/d13/d18/d2d/f47 [1566274,40839] 0 2024-04-25T02:08:53.938 INFO:tasks.workunit.client.0.smithi077.stdout:1/705: dwrite db/df/d14/d3e/d69/f9e [0,4194304] 0 2024-04-25T02:08:53.939 INFO:tasks.workunit.client.0.smithi077.stdout:8/791: dwrite d3/da/fda [0,4194304] 0 2024-04-25T02:08:53.939 INFO:tasks.workunit.client.0.smithi077.stdout:4/727: dwrite d0/d14/d60/d86/f4a [0,4194304] 0 2024-04-25T02:08:53.942 INFO:tasks.workunit.client.0.smithi077.stdout:5/697: dread d0/d2/d1b/f54 [0,4194304] 0 2024-04-25T02:08:53.942 INFO:tasks.workunit.client.0.smithi077.stdout:5/698: dread - d0/d25/d82/d87/d8b/da5/fd4 zero size 2024-04-25T02:08:53.942 INFO:tasks.workunit.client.0.smithi077.stdout:5/699: stat d0/d25/d82/d87/d8b/f8e 0 2024-04-25T02:08:53.942 INFO:tasks.workunit.client.0.smithi077.stdout:2/727: creat d2/d9/d18/d1b/ff9 x:0 0 0 2024-04-25T02:08:53.942 INFO:tasks.workunit.client.0.smithi077.stdout:5/700: dread - d0/d2/d3/d9/d90/fce zero size 2024-04-25T02:08:53.942 INFO:tasks.workunit.client.0.smithi077.stdout:2/728: write d2/d9/f6a [1451800,79461] 0 2024-04-25T02:08:53.942 INFO:tasks.workunit.client.0.smithi077.stdout:7/613: creat d4/d13/d18/fcd x:0 0 0 2024-04-25T02:08:53.953 INFO:tasks.workunit.client.0.smithi077.stdout:4/728: symlink d0/d14/d21/d39/da/d12/d35/d3e/d3a/le9 0 2024-04-25T02:08:53.955 INFO:tasks.workunit.client.0.smithi077.stdout:8/792: dwrite d3/da/d27/d16/dbc/f6d [4194304,4194304] 0 2024-04-25T02:08:53.959 INFO:tasks.workunit.client.0.smithi077.stdout:7/614: creat d4/d13/d18/d2d/d56/d68/d88/fce x:0 0 0 2024-04-25T02:08:53.960 INFO:tasks.workunit.client.0.smithi077.stdout:1/706: getdents db/df/d1b 0 2024-04-25T02:08:53.963 INFO:tasks.workunit.client.0.smithi077.stdout:2/729: getdents d2/d9/d19/d1c/d3f/d53 0 2024-04-25T02:08:53.963 INFO:tasks.workunit.client.0.smithi077.stdout:7/615: dread d4/d13/d5b/d8b/fb5 [0,4194304] 0 2024-04-25T02:08:53.963 INFO:tasks.workunit.client.0.smithi077.stdout:2/730: stat d2/d59/c62 0 2024-04-25T02:08:53.963 INFO:tasks.workunit.client.0.smithi077.stdout:7/616: creat d4/d13/d18/d24/fcf x:0 0 0 2024-04-25T02:08:53.965 INFO:tasks.workunit.client.0.smithi077.stdout:4/729: symlink d0/d14/d21/d39/lea 0 2024-04-25T02:08:53.965 INFO:tasks.workunit.client.0.smithi077.stdout:4/730: fsync d0/d14/d60/d86/d34/fbe 0 2024-04-25T02:08:53.969 INFO:tasks.workunit.client.0.smithi077.stdout:4/731: link d0/d14/d21/d39/d9d/fc2 d0/d14/d21/d39/d9a/feb 0 2024-04-25T02:08:53.969 INFO:tasks.workunit.client.0.smithi077.stdout:4/732: write d0/d14/d21/d39/da/fe3 [675449,14093] 0 2024-04-25T02:08:53.969 INFO:tasks.workunit.client.0.smithi077.stdout:4/733: creat d0/d14/d21/d39/d9a/fec x:0 0 0 2024-04-25T02:08:53.969 INFO:tasks.workunit.client.0.smithi077.stdout:4/734: creat d0/d14/d79/da4/dac/fed x:0 0 0 2024-04-25T02:08:53.972 INFO:tasks.workunit.client.0.smithi077.stdout:8/793: dwrite d3/da/db/df/d2b/d37/f69 [0,4194304] 0 2024-04-25T02:08:53.972 INFO:tasks.workunit.client.0.smithi077.stdout:8/794: stat d3/da/db/df/l49 0 2024-04-25T02:08:53.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:53 smithi077 ceph-mon[26330]: pgmap v256: 65 pgs: 65 active+clean; 1.3 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 134 MiB/s rd, 169 MiB/s wr, 457 op/s 2024-04-25T02:08:53.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:53 smithi077 ceph-mon[26330]: from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:08:53.980 INFO:tasks.workunit.client.0.smithi077.stdout:8/795: mkdir d3/da/db/df/dff 0 2024-04-25T02:08:53.982 INFO:tasks.workunit.client.0.smithi077.stdout:8/796: rename d3/da/d27/d16/l23 to d3/d7a/l100 0 2024-04-25T02:08:53.983 INFO:tasks.workunit.client.0.smithi077.stdout:8/797: truncate d3/da/db/df/d2b/d37/fea 36539 0 2024-04-25T02:08:53.985 INFO:tasks.workunit.client.0.smithi077.stdout:9/681: sync 2024-04-25T02:08:53.987 INFO:tasks.workunit.client.0.smithi077.stdout:9/682: creat df/d1b/d70/d84/dde/fe4 x:0 0 0 2024-04-25T02:08:53.989 INFO:tasks.workunit.client.0.smithi077.stdout:9/683: symlink df/d60/le5 0 2024-04-25T02:08:53.991 INFO:tasks.workunit.client.0.smithi077.stdout:9/684: unlink df/d1b/f5d 0 2024-04-25T02:08:53.991 INFO:tasks.workunit.client.0.smithi077.stdout:9/685: fsync df/d60/d87/dca/fd9 0 2024-04-25T02:08:53.991 INFO:tasks.workunit.client.0.smithi077.stdout:9/686: write df/d1b/d56/fae [4500665,66060] 0 2024-04-25T02:08:53.991 INFO:tasks.workunit.client.0.smithi077.stdout:9/687: chown df/d1b/d48/db6/fe0 2 1 2024-04-25T02:08:53.991 INFO:tasks.workunit.client.0.smithi077.stdout:9/688: write df/f6b [2579655,42616] 0 2024-04-25T02:08:54.001 INFO:tasks.workunit.client.0.smithi077.stdout:9/689: dread df/d1b/d48/f5e [0,4194304] 0 2024-04-25T02:08:54.003 INFO:tasks.workunit.client.0.smithi077.stdout:1/707: dwrite db/df/d14/d4d/d82/fab [0,4194304] 0 2024-04-25T02:08:54.003 INFO:tasks.workunit.client.0.smithi077.stdout:1/708: chown db/f12 0 1 2024-04-25T02:08:54.003 INFO:tasks.workunit.client.0.smithi077.stdout:1/709: truncate db/f12 5136236 0 2024-04-25T02:08:54.003 INFO:tasks.workunit.client.0.smithi077.stdout:1/710: fdatasync db/df/d14/d3e/f54 0 2024-04-25T02:08:54.003 INFO:tasks.workunit.client.0.smithi077.stdout:1/711: chown db/df/d14/ccb 3690250 1 2024-04-25T02:08:54.003 INFO:tasks.workunit.client.0.smithi077.stdout:2/731: dwrite d2/d9/d19/d1c/d3f/d53/f8a [0,4194304] 0 2024-04-25T02:08:54.004 INFO:tasks.workunit.client.0.smithi077.stdout:9/690: creat df/d1b/d48/db6/fe6 x:0 0 0 2024-04-25T02:08:54.004 INFO:tasks.workunit.client.0.smithi077.stdout:9/691: readlink df/d60/le5 0 2024-04-25T02:08:54.005 INFO:tasks.workunit.client.0.smithi077.stdout:1/712: getdents db/df/d14/d4d/d82/d5c/d81 0 2024-04-25T02:08:54.007 INFO:tasks.workunit.client.0.smithi077.stdout:7/617: dwrite d4/d13/d18/d24/fcf [0,4194304] 0 2024-04-25T02:08:54.007 INFO:tasks.workunit.client.0.smithi077.stdout:7/618: fdatasync d4/d13/d18/d24/d3f/f44 0 2024-04-25T02:08:54.007 INFO:tasks.workunit.client.0.smithi077.stdout:7/619: write d4/d13/d18/d2d/d30/f86 [334742,1472] 0 2024-04-25T02:08:54.007 INFO:tasks.workunit.client.0.smithi077.stdout:7/620: chown d4/f16 619 1 2024-04-25T02:08:54.007 INFO:tasks.workunit.client.0.smithi077.stdout:8/798: dwrite d3/d34/dc9/dcb/fe7 [0,4194304] 0 2024-04-25T02:08:54.008 INFO:tasks.workunit.client.0.smithi077.stdout:9/692: symlink df/d1b/d48/db6/le7 0 2024-04-25T02:08:54.009 INFO:tasks.workunit.client.0.smithi077.stdout:1/713: creat db/df/d56/d5d/ff0 x:0 0 0 2024-04-25T02:08:54.018 INFO:tasks.workunit.client.0.smithi077.stdout:7/621: link d4/d13/d18/d2d/fac d4/d13/d2c/fd0 0 2024-04-25T02:08:54.018 INFO:tasks.workunit.client.0.smithi077.stdout:7/622: write d4/d13/d18/fb6 [1010697,87896] 0 2024-04-25T02:08:54.020 INFO:tasks.workunit.client.0.smithi077.stdout:9/693: dread df/d1b/d70/d74/fe2 [0,4194304] 0 2024-04-25T02:08:54.021 INFO:tasks.workunit.client.0.smithi077.stdout:9/694: readlink df/d1b/d56/l61 0 2024-04-25T02:08:54.021 INFO:tasks.workunit.client.0.smithi077.stdout:8/799: creat d3/d7a/de5/f101 x:0 0 0 2024-04-25T02:08:54.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:53 smithi112 ceph-mon[33313]: pgmap v256: 65 pgs: 65 active+clean; 1.3 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 134 MiB/s rd, 169 MiB/s wr, 457 op/s 2024-04-25T02:08:54.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:53 smithi112 ceph-mon[33313]: from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:08:54.063 INFO:tasks.workunit.client.0.smithi077.stdout:1/714: rename db/f12 to db/df/d14/d4d/d82/d42/d43/ff1 0 2024-04-25T02:08:54.065 INFO:tasks.workunit.client.0.smithi077.stdout:7/623: getdents d4/d13/d18/d2d/d56/d68/db3 0 2024-04-25T02:08:54.065 INFO:tasks.workunit.client.0.smithi077.stdout:7/624: dread - d4/d13/d2c/f92 zero size 2024-04-25T02:08:54.066 INFO:tasks.workunit.client.0.smithi077.stdout:9/695: creat df/d1b/d70/d74/fe8 x:0 0 0 2024-04-25T02:08:54.068 INFO:tasks.workunit.client.0.smithi077.stdout:8/800: unlink d3/da/f78 0 2024-04-25T02:08:54.072 INFO:tasks.workunit.client.0.smithi077.stdout:7/625: creat d4/d7c/fd1 x:0 0 0 2024-04-25T02:08:54.073 INFO:tasks.workunit.client.0.smithi077.stdout:9/696: stat l2 0 2024-04-25T02:08:54.073 INFO:tasks.workunit.client.0.smithi077.stdout:9/697: fsync df/d1b/d56/f59 0 2024-04-25T02:08:54.075 INFO:tasks.workunit.client.0.smithi077.stdout:0/706: sync 2024-04-25T02:08:54.075 INFO:tasks.workunit.client.0.smithi077.stdout:8/801: creat d3/da/d27/d16/dbc/f102 x:0 0 0 2024-04-25T02:08:54.075 INFO:tasks.workunit.client.0.smithi077.stdout:8/802: write d3/da/d27/f21 [2770112,72683] 0 2024-04-25T02:08:54.076 INFO:tasks.workunit.client.0.smithi077.stdout:7/626: mkdir d4/dd2 0 2024-04-25T02:08:54.076 INFO:tasks.workunit.client.0.smithi077.stdout:7/627: chown d4/d13/d2c/l3e 60 1 2024-04-25T02:08:54.079 INFO:tasks.workunit.client.0.smithi077.stdout:8/803: creat d3/da/d27/d44/db1/dc1/f103 x:0 0 0 2024-04-25T02:08:54.080 INFO:tasks.workunit.client.0.smithi077.stdout:3/705: sync 2024-04-25T02:08:54.080 INFO:tasks.workunit.client.0.smithi077.stdout:3/706: stat d0/d3e/da1/ff9 0 2024-04-25T02:08:54.080 INFO:tasks.workunit.client.0.smithi077.stdout:6/841: sync 2024-04-25T02:08:54.080 INFO:tasks.workunit.client.0.smithi077.stdout:5/701: sync 2024-04-25T02:08:54.080 INFO:tasks.workunit.client.0.smithi077.stdout:3/707: chown d0/d2/de/f82 1993494 1 2024-04-25T02:08:54.080 INFO:tasks.workunit.client.0.smithi077.stdout:5/702: fsync d0/d2/fc8 0 2024-04-25T02:08:54.080 INFO:tasks.workunit.client.0.smithi077.stdout:5/703: creat d0/d2/d3/d9/d39/d44/d80/fe2 x:0 0 0 2024-04-25T02:08:54.081 INFO:tasks.workunit.client.0.smithi077.stdout:7/628: creat d4/d13/d18/d2d/d30/dab/fd3 x:0 0 0 2024-04-25T02:08:54.081 INFO:tasks.workunit.client.0.smithi077.stdout:7/629: chown d4/d13/da9/c9e 2978828 1 2024-04-25T02:08:54.081 INFO:tasks.workunit.client.0.smithi077.stdout:8/804: dread d3/d34/fa9 [0,4194304] 0 2024-04-25T02:08:54.081 INFO:tasks.workunit.client.0.smithi077.stdout:8/805: creat d3/da/d27/d44/db1/dc1/f104 x:0 0 0 2024-04-25T02:08:54.082 INFO:tasks.workunit.client.0.smithi077.stdout:3/708: mknod d0/d2/d83/c101 0 2024-04-25T02:08:54.083 INFO:tasks.workunit.client.0.smithi077.stdout:6/842: creat de/d12/dba/f11a x:0 0 0 2024-04-25T02:08:54.084 INFO:tasks.workunit.client.0.smithi077.stdout:9/698: dread df/f14 [0,4194304] 0 2024-04-25T02:08:54.084 INFO:tasks.workunit.client.0.smithi077.stdout:1/715: dwrite db/df/f20 [8388608,4194304] 0 2024-04-25T02:08:54.085 INFO:tasks.workunit.client.0.smithi077.stdout:5/704: getdents d0/d2/da8 0 2024-04-25T02:08:54.087 INFO:tasks.workunit.client.0.smithi077.stdout:7/630: mknod d4/dd2/cd4 0 2024-04-25T02:08:54.089 INFO:tasks.workunit.client.0.smithi077.stdout:2/732: sync 2024-04-25T02:08:54.089 INFO:tasks.workunit.client.0.smithi077.stdout:4/735: sync 2024-04-25T02:08:54.089 INFO:tasks.workunit.client.0.smithi077.stdout:2/733: stat d2/d9/d18/fa 0 2024-04-25T02:08:54.089 INFO:tasks.workunit.client.0.smithi077.stdout:2/734: write d2/d9/ddc/dad/fba [888711,112193] 0 2024-04-25T02:08:54.089 INFO:tasks.workunit.client.0.smithi077.stdout:0/707: dread d2/d17/d4e/d5e/fb7 [0,4194304] 0 2024-04-25T02:08:54.090 INFO:tasks.workunit.client.0.smithi077.stdout:3/709: creat d0/d2/d2f/d50/f102 x:0 0 0 2024-04-25T02:08:54.093 INFO:tasks.workunit.client.0.smithi077.stdout:6/843: symlink de/d55/d88/l11b 0 2024-04-25T02:08:54.095 INFO:tasks.workunit.client.0.smithi077.stdout:1/716: link db/d26/c46 db/df/d14/d3e/daa/cf2 0 2024-04-25T02:08:54.096 INFO:tasks.workunit.client.0.smithi077.stdout:5/705: symlink d0/d25/d82/d87/d8b/da5/dc4/d41/le3 0 2024-04-25T02:08:54.096 INFO:tasks.workunit.client.0.smithi077.stdout:5/706: chown d0/d2/d3/f2f 0 1 2024-04-25T02:08:54.097 INFO:tasks.workunit.client.0.smithi077.stdout:7/631: creat d4/dd2/fd5 x:0 0 0 2024-04-25T02:08:54.097 INFO:tasks.workunit.client.0.smithi077.stdout:4/736: mknod d0/d14/d79/da4/dac/dd4/cee 0 2024-04-25T02:08:54.099 INFO:tasks.workunit.client.0.smithi077.stdout:2/735: creat d2/d9/d19/d1c/d3f/d53/d86/db3/ffa x:0 0 0 2024-04-25T02:08:54.099 INFO:tasks.workunit.client.0.smithi077.stdout:0/708: creat d2/d17/d1d/d34/d4c/da2/d51/de8/ff8 x:0 0 0 2024-04-25T02:08:54.100 INFO:tasks.workunit.client.0.smithi077.stdout:3/710: mkdir d0/d17/d4b/d59/d103 0 2024-04-25T02:08:54.100 INFO:tasks.workunit.client.0.smithi077.stdout:3/711: creat d0/d17/d4b/d59/f104 x:0 0 0 2024-04-25T02:08:54.100 INFO:tasks.workunit.client.0.smithi077.stdout:3/712: write d0/d17/f5d [1687618,94823] 0 2024-04-25T02:08:54.101 INFO:tasks.workunit.client.0.smithi077.stdout:3/713: stat d0/dc5 0 2024-04-25T02:08:54.102 INFO:tasks.workunit.client.0.smithi077.stdout:6/844: truncate de/d12/d25/d38/fbe 2270818 0 2024-04-25T02:08:54.103 INFO:tasks.workunit.client.0.smithi077.stdout:1/717: creat db/df/d56/d5d/d77/ff3 x:0 0 0 2024-04-25T02:08:54.104 INFO:tasks.workunit.client.0.smithi077.stdout:7/632: mkdir d4/d13/d18/d24/d3f/d59/dd6 0 2024-04-25T02:08:54.105 INFO:tasks.workunit.client.0.smithi077.stdout:4/737: symlink d0/d14/d60/lef 0 2024-04-25T02:08:54.105 INFO:tasks.workunit.client.0.smithi077.stdout:8/806: dwrite d3/da/d27/f3f [0,4194304] 0 2024-04-25T02:08:54.105 INFO:tasks.workunit.client.0.smithi077.stdout:8/807: fdatasync d3/ff7 0 2024-04-25T02:08:54.105 INFO:tasks.workunit.client.0.smithi077.stdout:8/808: chown d3/d34/d3d/cac 0 1 2024-04-25T02:08:54.105 INFO:tasks.workunit.client.0.smithi077.stdout:8/809: write d3/da/db/fa1 [1575126,118491] 0 2024-04-25T02:08:54.106 INFO:tasks.workunit.client.0.smithi077.stdout:0/709: creat d2/d17/d1d/d34/d4c/da2/de2/ff9 x:0 0 0 2024-04-25T02:08:54.106 INFO:tasks.workunit.client.0.smithi077.stdout:0/710: chown d2/d17/d1d/d34/d4c/da2/d51/de8 0 1 2024-04-25T02:08:54.106 INFO:tasks.workunit.client.0.smithi077.stdout:0/711: fsync d2/d17/d4e/f9b 0 2024-04-25T02:08:54.107 INFO:tasks.workunit.client.0.smithi077.stdout:9/699: dwrite df/d1b/d70/d74/fb8 [0,4194304] 0 2024-04-25T02:08:54.108 INFO:tasks.workunit.client.0.smithi077.stdout:3/714: mknod d0/d3e/d62/d6a/db9/dde/c105 0 2024-04-25T02:08:54.108 INFO:tasks.workunit.client.0.smithi077.stdout:5/707: write d0/d25/d82/d87/d8b/da5/dc4/d23/fa6 [3107200,32063] 0 2024-04-25T02:08:54.110 INFO:tasks.workunit.client.0.smithi077.stdout:6/845: rename de/d12/d25/d3a/fe0 to de/d55/db7/f11c 0 2024-04-25T02:08:54.111 INFO:tasks.workunit.client.0.smithi077.stdout:1/718: rename db/df/d56/d5d/d77/c79 to db/df/d56/d5d/d77/cf4 0 2024-04-25T02:08:54.111 INFO:tasks.workunit.client.0.smithi077.stdout:1/719: creat db/df/d14/d4d/d82/d32/d8f/ff5 x:0 0 0 2024-04-25T02:08:54.111 INFO:tasks.workunit.client.0.smithi077.stdout:7/633: mknod d4/d13/d18/d2d/d30/cd7 0 2024-04-25T02:08:54.112 INFO:tasks.workunit.client.0.smithi077.stdout:1/720: dread db/df/d14/d4d/d82/d42/f7c [0,4194304] 0 2024-04-25T02:08:54.113 INFO:tasks.workunit.client.0.smithi077.stdout:4/738: unlink d0/d14/d21/d39/da/d12/d35/f71 0 2024-04-25T02:08:54.115 INFO:tasks.workunit.client.0.smithi077.stdout:8/810: mkdir d3/d7a/d7e/db0/d105 0 2024-04-25T02:08:54.118 INFO:tasks.workunit.client.0.smithi077.stdout:3/715: link d0/d2/d2f/d5f/c6b d0/d3e/d62/d6a/d6e/c106 0 2024-04-25T02:08:54.120 INFO:tasks.workunit.client.0.smithi077.stdout:9/700: read df/d1b/f65 [3792640,129827] 0 2024-04-25T02:08:54.123 INFO:tasks.workunit.client.0.smithi077.stdout:6/846: getdents de/d12/d25/d3a/d6a/dcd/d36 0 2024-04-25T02:08:54.123 INFO:tasks.workunit.client.0.smithi077.stdout:6/847: creat de/d3b/de8/f11d x:0 0 0 2024-04-25T02:08:54.124 INFO:tasks.workunit.client.0.smithi077.stdout:6/848: write de/d12/d25/d3a/d6a/dcd/fed [91365,524] 0 2024-04-25T02:08:54.124 INFO:tasks.workunit.client.0.smithi077.stdout:6/849: chown de/d53/d6f/fb0 53018071 1 2024-04-25T02:08:54.129 INFO:tasks.workunit.client.0.smithi077.stdout:4/739: rename d0/d14/d79/fbb to d0/d14/d21/d39/da/d12/de5/ff0 0 2024-04-25T02:08:54.130 INFO:tasks.workunit.client.0.smithi077.stdout:8/811: symlink d3/d34/d3d/l106 0 2024-04-25T02:08:54.133 INFO:tasks.workunit.client.0.smithi077.stdout:5/708: rmdir d0/d25/d82/d87/d8b/da5 39 2024-04-25T02:08:54.137 INFO:tasks.workunit.client.0.smithi077.stdout:6/850: symlink de/d12/d25/d3a/d6a/dcd/d36/l11e 0 2024-04-25T02:08:54.137 INFO:tasks.workunit.client.0.smithi077.stdout:6/851: fdatasync de/d12/d25/d3a/d6a/dcd/fc8 0 2024-04-25T02:08:54.137 INFO:tasks.workunit.client.0.smithi077.stdout:2/736: dwrite d2/d9/f6a [0,4194304] 0 2024-04-25T02:08:54.139 INFO:tasks.workunit.client.0.smithi077.stdout:8/812: creat d3/d7a/d7e/db0/d105/f107 x:0 0 0 2024-04-25T02:08:54.140 INFO:tasks.workunit.client.0.smithi077.stdout:5/709: mknod d0/d2/d1b/d35/ce4 0 2024-04-25T02:08:54.140 INFO:tasks.workunit.client.0.smithi077.stdout:6/852: symlink de/d12/d25/de9/l11f 0 2024-04-25T02:08:54.141 INFO:tasks.workunit.client.0.smithi077.stdout:0/712: dwrite d2/d17/d4e/f9b [0,4194304] 0 2024-04-25T02:08:54.141 INFO:tasks.workunit.client.0.smithi077.stdout:1/721: dwrite db/df/d14/d33/d34/db4/fe8 [0,4194304] 0 2024-04-25T02:08:54.141 INFO:tasks.workunit.client.0.smithi077.stdout:1/722: chown db/df/d56/d5d/c7e 92586463 1 2024-04-25T02:08:54.141 INFO:tasks.workunit.client.0.smithi077.stdout:1/723: fdatasync db/d26/fa3 0 2024-04-25T02:08:54.143 INFO:tasks.workunit.client.0.smithi077.stdout:9/701: dwrite df/d1b/d70/d84/dde/f9e [0,4194304] 0 2024-04-25T02:08:54.144 INFO:tasks.workunit.client.0.smithi077.stdout:2/737: creat d2/d9/d19/d1c/d3f/d53/d86/dca/ffb x:0 0 0 2024-04-25T02:08:54.144 INFO:tasks.workunit.client.0.smithi077.stdout:2/738: stat d2/d9/d18/d31/d7c/dab 0 2024-04-25T02:08:54.146 INFO:tasks.workunit.client.0.smithi077.stdout:7/634: dwrite d4/d13/d66/f8f [4194304,4194304] 0 2024-04-25T02:08:54.160 INFO:tasks.workunit.client.0.smithi077.stdout:8/813: mkdir d3/da/d27/d44/db1/d108 0 2024-04-25T02:08:54.162 INFO:tasks.workunit.client.0.smithi077.stdout:5/710: rename d0/d2/d3/d9/d39/f81 to d0/d2/d3/d9/d39/d3c/fe5 0 2024-04-25T02:08:54.163 INFO:tasks.workunit.client.0.smithi077.stdout:6/853: mkdir de/d5b/da6/d120 0 2024-04-25T02:08:54.165 INFO:tasks.workunit.client.0.smithi077.stdout:3/716: dwrite d0/d17/f5d [0,4194304] 0 2024-04-25T02:08:54.165 INFO:tasks.workunit.client.0.smithi077.stdout:2/739: dwrite d2/d9/d18/fe8 [0,4194304] 0 2024-04-25T02:08:54.166 INFO:tasks.workunit.client.0.smithi077.stdout:4/740: rmdir d0 39 2024-04-25T02:08:54.167 INFO:tasks.workunit.client.0.smithi077.stdout:0/713: mknod d2/d27/cfa 0 2024-04-25T02:08:54.171 INFO:tasks.workunit.client.0.smithi077.stdout:9/702: unlink df/c5a 0 2024-04-25T02:08:54.175 INFO:tasks.workunit.client.0.smithi077.stdout:1/724: rename db/df/d14/f67 to db/df/d14/d33/d34/db4/ff6 0 2024-04-25T02:08:54.176 INFO:tasks.workunit.client.0.smithi077.stdout:5/711: creat d0/fe6 x:0 0 0 2024-04-25T02:08:54.179 INFO:tasks.workunit.client.0.smithi077.stdout:3/717: getdents d0/d3e/d62/d6a/db9 0 2024-04-25T02:08:54.180 INFO:tasks.workunit.client.0.smithi077.stdout:3/718: dread d0/d3e/d42/fb5 [0,4194304] 0 2024-04-25T02:08:54.182 INFO:tasks.workunit.client.0.smithi077.stdout:2/740: mkdir d2/d59/d79/db4/dfc 0 2024-04-25T02:08:54.183 INFO:tasks.workunit.client.0.smithi077.stdout:4/741: unlink d0/d14/laa 0 2024-04-25T02:08:54.183 INFO:tasks.workunit.client.0.smithi077.stdout:4/742: chown d0/d14/d21/d39/da/d12/d35/d3e/fb2 14082 1 2024-04-25T02:08:54.184 INFO:tasks.workunit.client.0.smithi077.stdout:0/714: mkdir d2/d8/dfb 0 2024-04-25T02:08:54.184 INFO:tasks.workunit.client.0.smithi077.stdout:4/743: read d0/d14/d21/d39/da/fe3 [591283,89146] 0 2024-04-25T02:08:54.185 INFO:tasks.workunit.client.0.smithi077.stdout:9/703: mkdir df/d1b/d70/d84/dde/de9 0 2024-04-25T02:08:54.187 INFO:tasks.workunit.client.0.smithi077.stdout:8/814: truncate d3/da/db/df/d2b/d37/f5a 3888227 0 2024-04-25T02:08:54.189 INFO:tasks.workunit.client.0.smithi077.stdout:7/635: rename d4/d13/l8e to d4/d13/d2c/ld8 0 2024-04-25T02:08:54.192 INFO:tasks.workunit.client.0.smithi077.stdout:1/725: creat db/df/d14/d4d/d82/d5c/d81/ff7 x:0 0 0 2024-04-25T02:08:54.193 INFO:tasks.workunit.client.0.smithi077.stdout:5/712: mkdir d0/d25/dc7/dca/d3e/de7 0 2024-04-25T02:08:54.194 INFO:tasks.workunit.client.0.smithi077.stdout:6/854: mkdir de/d12/d25/d121 0 2024-04-25T02:08:54.195 INFO:tasks.workunit.client.0.smithi077.stdout:3/719: mkdir d0/d17/dd4/d107 0 2024-04-25T02:08:54.196 INFO:tasks.workunit.client.0.smithi077.stdout:4/744: symlink d0/d14/d21/d39/d1d/lf1 0 2024-04-25T02:08:54.197 INFO:tasks.workunit.client.0.smithi077.stdout:7/636: dread d4/d13/d18/d2d/d30/f65 [0,4194304] 0 2024-04-25T02:08:54.198 INFO:tasks.workunit.client.0.smithi077.stdout:8/815: symlink d3/d34/l109 0 2024-04-25T02:08:54.200 INFO:tasks.workunit.client.0.smithi077.stdout:0/715: rename d2/d17/d1d/f53 to d2/d8/d5f/d9f/ffc 0 2024-04-25T02:08:54.200 INFO:tasks.workunit.client.0.smithi077.stdout:0/716: truncate d2/d8/d5f/d9f/ffc 1175690 0 2024-04-25T02:08:54.202 INFO:tasks.workunit.client.0.smithi077.stdout:1/726: creat db/df/d14/d4d/d82/d42/ff8 x:0 0 0 2024-04-25T02:08:54.202 INFO:tasks.workunit.client.0.smithi077.stdout:1/727: truncate db/df/d14/fde 666909 0 2024-04-25T02:08:54.203 INFO:tasks.workunit.client.0.smithi077.stdout:6/855: dread f9 [0,4194304] 0 2024-04-25T02:08:54.204 INFO:tasks.workunit.client.0.smithi077.stdout:3/720: link d0/d17/d4b/d59/dd2/ce2 d0/d17/c108 0 2024-04-25T02:08:54.206 INFO:tasks.workunit.client.0.smithi077.stdout:4/745: creat d0/d14/d60/d62/ff2 x:0 0 0 2024-04-25T02:08:54.207 INFO:tasks.workunit.client.0.smithi077.stdout:5/713: read d0/d2/d3/d9/d39/d3c/fe5 [2781772,125636] 0 2024-04-25T02:08:54.207 INFO:tasks.workunit.client.0.smithi077.stdout:7/637: link d4/d13/d2c/c4d d4/d13/d18/d2d/d56/d68/db3/cd9 0 2024-04-25T02:08:54.207 INFO:tasks.workunit.client.0.smithi077.stdout:2/741: dwrite d2/d9/d18/d31/d7c/dab/fb2 [0,4194304] 0 2024-04-25T02:08:54.209 INFO:tasks.workunit.client.0.smithi077.stdout:6/856: getdents de/d12/d25/de9 0 2024-04-25T02:08:54.210 INFO:tasks.workunit.client.0.smithi077.stdout:4/746: rmdir d0/d14/d21/d39/da/d12 39 2024-04-25T02:08:54.210 INFO:tasks.workunit.client.0.smithi077.stdout:8/816: read d3/da/db/df/d2b/d7b/fe2 [121199,27120] 0 2024-04-25T02:08:54.213 INFO:tasks.workunit.client.0.smithi077.stdout:5/714: rename d0/d2/d1b/c69 to d0/d25/d82/d87/ce8 0 2024-04-25T02:08:54.213 INFO:tasks.workunit.client.0.smithi077.stdout:5/715: fdatasync d0/d2/d3/d9/d39/d44/f53 0 2024-04-25T02:08:54.213 INFO:tasks.workunit.client.0.smithi077.stdout:5/716: fdatasync d0/d25/d82/d87/d8b/da5/dc4/d23/fa6 0 2024-04-25T02:08:54.213 INFO:tasks.workunit.client.0.smithi077.stdout:5/717: creat d0/d25/d82/d8d/fe9 x:0 0 0 2024-04-25T02:08:54.214 INFO:tasks.workunit.client.0.smithi077.stdout:7/638: mkdir d4/dd2/dda 0 2024-04-25T02:08:54.216 INFO:tasks.workunit.client.0.smithi077.stdout:4/747: mknod d0/d14/d60/d62/cf3 0 2024-04-25T02:08:54.216 INFO:tasks.workunit.client.0.smithi077.stdout:4/748: creat d0/d14/d60/d62/ff4 x:0 0 0 2024-04-25T02:08:54.216 INFO:tasks.workunit.client.0.smithi077.stdout:4/749: fsync d0/d14/d21/d39/da/d12/d35/d3e/fb2 0 2024-04-25T02:08:54.216 INFO:tasks.workunit.client.0.smithi077.stdout:4/750: write d0/d14/d60/d62/ff2 [317663,818] 0 2024-04-25T02:08:54.216 INFO:tasks.workunit.client.0.smithi077.stdout:4/751: truncate d0/d14/d21/d39/d1d/fbf 855877 0 2024-04-25T02:08:54.217 INFO:tasks.workunit.client.0.smithi077.stdout:1/728: write db/df/d14/d3e/daa/fb6 [3250151,96795] 0 2024-04-25T02:08:54.217 INFO:tasks.workunit.client.0.smithi077.stdout:8/817: creat d3/d81/d86/f10a x:0 0 0 2024-04-25T02:08:54.217 INFO:tasks.workunit.client.0.smithi077.stdout:8/818: stat d3/da/d27/d16/dbc/f6d 0 2024-04-25T02:08:54.218 INFO:tasks.workunit.client.0.smithi077.stdout:2/742: dread d2/d9/d19/d1c/f44 [0,4194304] 0 2024-04-25T02:08:54.218 INFO:tasks.workunit.client.0.smithi077.stdout:9/704: dwrite df/d1b/d48/d75/d90/fdd [0,4194304] 0 2024-04-25T02:08:54.220 INFO:tasks.workunit.client.0.smithi077.stdout:5/718: unlink d0/d2/d3/d9/d39/fd3 0 2024-04-25T02:08:54.221 INFO:tasks.workunit.client.0.smithi077.stdout:5/719: write d0/d25/d82/d87/f9c [2332266,71217] 0 2024-04-25T02:08:54.221 INFO:tasks.workunit.client.0.smithi077.stdout:5/720: truncate d0/d25/d82/d87/d8b/da5/dc4/d23/f67 1040891 0 2024-04-25T02:08:54.221 INFO:tasks.workunit.client.0.smithi077.stdout:5/721: write d0/d25/d82/d87/d8b/da5/dc4/d23/f67 [1297964,119098] 0 2024-04-25T02:08:54.221 INFO:tasks.workunit.client.0.smithi077.stdout:7/639: creat d4/d13/d18/d24/d3f/d58/fdb x:0 0 0 2024-04-25T02:08:54.226 INFO:tasks.workunit.client.0.smithi077.stdout:8/819: mkdir d3/da/d10b 0 2024-04-25T02:08:54.227 INFO:tasks.workunit.client.0.smithi077.stdout:1/729: dread db/df/d14/d33/d34/db4/ff6 [0,4194304] 0 2024-04-25T02:08:54.230 INFO:tasks.workunit.client.0.smithi077.stdout:3/721: dwrite d0/d17/f37 [0,4194304] 0 2024-04-25T02:08:54.230 INFO:tasks.workunit.client.0.smithi077.stdout:6/857: dwrite de/d12/d25/d3a/d6a/dcd/d36/fa4 [0,4194304] 0 2024-04-25T02:08:54.236 INFO:tasks.workunit.client.0.smithi077.stdout:2/743: mknod d2/d9/d19/d2c/cfd 0 2024-04-25T02:08:54.236 INFO:tasks.workunit.client.0.smithi077.stdout:2/744: chown d2/d9/d18/d1b/df5/dce 333 1 2024-04-25T02:08:54.239 INFO:tasks.workunit.client.0.smithi077.stdout:9/705: creat df/d1b/d70/d84/dde/de9/fea x:0 0 0 2024-04-25T02:08:54.240 INFO:tasks.workunit.client.0.smithi077.stdout:8/820: dwrite d3/da/f45 [8388608,4194304] 0 2024-04-25T02:08:54.240 INFO:tasks.workunit.client.0.smithi077.stdout:8/821: chown d3/c31 1109023 1 2024-04-25T02:08:54.240 INFO:tasks.workunit.client.0.smithi077.stdout:8/822: readlink d3/da/db/df/d2b/d37/l75 0 2024-04-25T02:08:54.241 INFO:tasks.workunit.client.0.smithi077.stdout:5/722: creat d0/d2/d68/db8/fea x:0 0 0 2024-04-25T02:08:54.241 INFO:tasks.workunit.client.0.smithi077.stdout:5/723: fsync d0/d2/d1b/d38/f5e 0 2024-04-25T02:08:54.243 INFO:tasks.workunit.client.0.smithi077.stdout:4/752: rename d0/d14/d21/d39/d9a/cc3 to d0/d14/d79/cf5 0 2024-04-25T02:08:54.247 INFO:tasks.workunit.client.0.smithi077.stdout:4/753: write d0/d14/d60/d86/d25/f31 [3260061,54676] 0 2024-04-25T02:08:54.249 INFO:tasks.workunit.client.0.smithi077.stdout:6/858: mkdir de/d53/d78/dfc/d122 0 2024-04-25T02:08:54.249 INFO:tasks.workunit.client.0.smithi077.stdout:6/859: chown de/d55/db7/lf9 0 1 2024-04-25T02:08:54.250 INFO:tasks.workunit.client.0.smithi077.stdout:2/745: mknod d2/d9/d18/d31/cfe 0 2024-04-25T02:08:54.253 INFO:tasks.workunit.client.0.smithi077.stdout:9/706: link df/d1b/d56/d67/d68/cdc df/d60/d87/ceb 0 2024-04-25T02:08:54.255 INFO:tasks.workunit.client.0.smithi077.stdout:8/823: mknod d3/da/d27/d16/dd2/c10c 0 2024-04-25T02:08:54.256 INFO:tasks.workunit.client.0.smithi077.stdout:5/724: creat d0/d25/feb x:0 0 0 2024-04-25T02:08:54.259 INFO:tasks.workunit.client.0.smithi077.stdout:7/640: rename d4/d13/d18/d2d/f46 to d4/d13/d18/d24/d3f/fdc 0 2024-04-25T02:08:54.259 INFO:tasks.workunit.client.0.smithi077.stdout:7/641: dread - d4/d13/d18/d2d/d30/f8a zero size 2024-04-25T02:08:54.260 INFO:tasks.workunit.client.0.smithi077.stdout:1/730: getdents db/df/d14/d4d/d82/d32 0 2024-04-25T02:08:54.262 INFO:tasks.workunit.client.0.smithi077.stdout:3/722: mknod d0/d2/de/d48/c109 0 2024-04-25T02:08:54.262 INFO:tasks.workunit.client.0.smithi077.stdout:3/723: chown d0/d3e/d42/d64/l71 2351342 1 2024-04-25T02:08:54.264 INFO:tasks.workunit.client.0.smithi077.stdout:6/860: link de/d12/d25/f31 de/d53/d6f/f123 0 2024-04-25T02:08:54.266 INFO:tasks.workunit.client.0.smithi077.stdout:9/707: mknod df/d60/d87/dca/cec 0 2024-04-25T02:08:54.270 INFO:tasks.workunit.client.0.smithi077.stdout:8/824: creat d3/da/d27/d16/db3/f10d x:0 0 0 2024-04-25T02:08:54.270 INFO:tasks.workunit.client.0.smithi077.stdout:8/825: dread - d3/da/d27/d16/dbc/fc0 zero size 2024-04-25T02:08:54.270 INFO:tasks.workunit.client.0.smithi077.stdout:4/754: dwrite d0/d14/d21/d39/d9a/feb [0,4194304] 0 2024-04-25T02:08:54.271 INFO:tasks.workunit.client.0.smithi077.stdout:4/755: read d0/d14/d79/fd8 [750670,76998] 0 2024-04-25T02:08:54.277 INFO:tasks.workunit.client.0.smithi077.stdout:7/642: creat d4/d13/d18/d2d/d56/d68/db3/fdd x:0 0 0 2024-04-25T02:08:54.278 INFO:tasks.workunit.client.0.smithi077.stdout:1/731: truncate db/d26/f3c 2311001 0 2024-04-25T02:08:54.279 INFO:tasks.workunit.client.0.smithi077.stdout:3/724: creat d0/d3e/d42/d64/f10a x:0 0 0 2024-04-25T02:08:54.280 INFO:tasks.workunit.client.0.smithi077.stdout:6/861: mkdir de/d12/d25/de9/d124 0 2024-04-25T02:08:54.285 INFO:tasks.workunit.client.0.smithi077.stdout:4/756: mkdir d0/d14/d21/d39/d1d/d98/df6 0 2024-04-25T02:08:54.286 INFO:tasks.workunit.client.0.smithi077.stdout:5/725: getdents d0/d2 0 2024-04-25T02:08:54.286 INFO:tasks.workunit.client.0.smithi077.stdout:5/726: write d0/d25/f47 [1684209,46687] 0 2024-04-25T02:08:54.287 INFO:tasks.workunit.client.0.smithi077.stdout:9/708: dwrite df/d1b/d48/f5e [0,4194304] 0 2024-04-25T02:08:54.288 INFO:tasks.workunit.client.0.smithi077.stdout:7/643: link d4/d13/d18/d24/d3f/fc5 d4/d13/d5b/d8b/fde 0 2024-04-25T02:08:54.288 INFO:tasks.workunit.client.0.smithi077.stdout:7/644: stat d4/d13/d18/d2d/f47 0 2024-04-25T02:08:54.289 INFO:tasks.workunit.client.0.smithi077.stdout:1/732: truncate db/df/d56/d5d/d77/f91 606732 0 2024-04-25T02:08:54.291 INFO:tasks.workunit.client.0.smithi077.stdout:3/725: mknod d0/d3e/d62/d6a/db9/c10b 0 2024-04-25T02:08:54.291 INFO:tasks.workunit.client.0.smithi077.stdout:3/726: read - d0/d3e/d42/ff7 zero size 2024-04-25T02:08:54.291 INFO:tasks.workunit.client.0.smithi077.stdout:3/727: dread - d0/d3e/d42/ff7 zero size 2024-04-25T02:08:54.291 INFO:tasks.workunit.client.0.smithi077.stdout:3/728: fsync d0/dc5/ffd 0 2024-04-25T02:08:54.291 INFO:tasks.workunit.client.0.smithi077.stdout:3/729: chown d0/d17/d4b/d59/d103 807 1 2024-04-25T02:08:54.291 INFO:tasks.workunit.client.0.smithi077.stdout:3/730: dread - d0/d2/d2f/ffe zero size 2024-04-25T02:08:54.292 INFO:tasks.workunit.client.0.smithi077.stdout:1/733: dread db/f59 [0,4194304] 0 2024-04-25T02:08:54.292 INFO:tasks.workunit.client.0.smithi077.stdout:6/862: mkdir de/d5b/d125 0 2024-04-25T02:08:54.293 INFO:tasks.workunit.client.0.smithi077.stdout:8/826: rmdir d3/d7a/d7e/db0/d105 39 2024-04-25T02:08:54.295 INFO:tasks.workunit.client.0.smithi077.stdout:4/757: getdents d0/d14/d21/d39 0 2024-04-25T02:08:54.299 INFO:tasks.workunit.client.0.smithi077.stdout:5/727: rename d0/d25/d82/d87/f9c to d0/d25/d82/d87/fec 0 2024-04-25T02:08:54.302 INFO:tasks.workunit.client.0.smithi077.stdout:7/645: unlink d4/d13/d18/d2d/d56/d68/d88/fb7 0 2024-04-25T02:08:54.302 INFO:tasks.workunit.client.0.smithi077.stdout:7/646: write d4/d13/d18/fcd [188482,89045] 0 2024-04-25T02:08:54.303 INFO:tasks.workunit.client.0.smithi077.stdout:1/734: symlink db/df/d14/d4d/d82/d32/lf9 0 2024-04-25T02:08:54.305 INFO:tasks.workunit.client.0.smithi077.stdout:6/863: creat de/d55/f126 x:0 0 0 2024-04-25T02:08:54.306 INFO:tasks.workunit.client.0.smithi077.stdout:8/827: mkdir d3/d34/d10e 0 2024-04-25T02:08:54.307 INFO:tasks.workunit.client.0.smithi077.stdout:4/758: truncate d0/d14/d60/d62/f8d 277342 0 2024-04-25T02:08:54.310 INFO:tasks.workunit.client.0.smithi077.stdout:7/647: truncate d4/d13/f2f 3609338 0 2024-04-25T02:08:54.312 INFO:tasks.workunit.client.0.smithi077.stdout:0/717: sync 2024-04-25T02:08:54.313 INFO:tasks.workunit.client.0.smithi077.stdout:5/728: rmdir d0/d25/d82/d8d 39 2024-04-25T02:08:54.315 INFO:tasks.workunit.client.0.smithi077.stdout:7/648: rmdir d4/d13/d18/d2d/d30/dc4 0 2024-04-25T02:08:54.315 INFO:tasks.workunit.client.0.smithi077.stdout:9/709: dwrite df/d1b/f6e [0,4194304] 0 2024-04-25T02:08:54.316 INFO:tasks.workunit.client.0.smithi077.stdout:6/864: dread de/d12/d25/d3a/d6a/dcd/f22 [0,4194304] 0 2024-04-25T02:08:54.316 INFO:tasks.workunit.client.0.smithi077.stdout:6/865: write de/d95/f10d [659872,40806] 0 2024-04-25T02:08:54.317 INFO:tasks.workunit.client.0.smithi077.stdout:5/729: write d0/d25/f1a [1477824,5472] 0 2024-04-25T02:08:54.317 INFO:tasks.workunit.client.0.smithi077.stdout:5/730: readlink d0/d25/d82/d87/d8b/da5/dc4/d41/l84 0 2024-04-25T02:08:54.317 INFO:tasks.workunit.client.0.smithi077.stdout:3/731: dwrite d0/d2/de/d48/d15/f66 [0,4194304] 0 2024-04-25T02:08:54.318 INFO:tasks.workunit.client.0.smithi077.stdout:7/649: symlink d4/d13/d18/d24/d3f/d59/dd6/ldf 0 2024-04-25T02:08:54.324 INFO:tasks.workunit.client.0.smithi077.stdout:6/866: unlink de/d53/d6f/fb0 0 2024-04-25T02:08:54.324 INFO:tasks.workunit.client.0.smithi077.stdout:4/759: dwrite d0/d14/d21/d39/d64/f82 [0,4194304] 0 2024-04-25T02:08:54.326 INFO:tasks.workunit.client.0.smithi077.stdout:5/731: link d0/d25/f8c d0/d2/d3/d9/d39/d44/d5f/da4/fed 0 2024-04-25T02:08:54.328 INFO:tasks.workunit.client.0.smithi077.stdout:9/710: dread df/d1b/f22 [0,4194304] 0 2024-04-25T02:08:54.328 INFO:tasks.workunit.client.0.smithi077.stdout:9/711: dread - df/d1b/d70/d84/dde/fe4 zero size 2024-04-25T02:08:54.328 INFO:tasks.workunit.client.0.smithi077.stdout:9/712: fsync df/d1b/d56/f6c 0 2024-04-25T02:08:54.328 INFO:tasks.workunit.client.0.smithi077.stdout:1/735: rename db/df/d14/d33/d34 to db/df/d14/dfa 0 2024-04-25T02:08:54.330 INFO:tasks.workunit.client.0.smithi077.stdout:6/867: write de/d12/d25/f10f [443344,35408] 0 2024-04-25T02:08:54.335 INFO:tasks.workunit.client.0.smithi077.stdout:7/650: dwrite d4/d13/d5b/d8b/fb9 [0,4194304] 0 2024-04-25T02:08:54.335 INFO:tasks.workunit.client.0.smithi077.stdout:7/651: fsync d4/d13/d18/d24/f3b 0 2024-04-25T02:08:54.335 INFO:tasks.workunit.client.0.smithi077.stdout:7/652: write d4/d13/d18/d2d/d56/d68/d88/fce [140527,117169] 0 2024-04-25T02:08:54.337 INFO:tasks.workunit.client.0.smithi077.stdout:4/760: symlink d0/d14/d21/d39/da/d12/d35/lf7 0 2024-04-25T02:08:54.337 INFO:tasks.workunit.client.0.smithi077.stdout:4/761: fdatasync d0/d14/d60/d62/fa8 0 2024-04-25T02:08:54.337 INFO:tasks.workunit.client.0.smithi077.stdout:4/762: read d0/d14/d60/d86/d25/f40 [2778754,31817] 0 2024-04-25T02:08:54.338 INFO:tasks.workunit.client.0.smithi077.stdout:5/732: symlink d0/d25/d82/d87/d8b/da5/dc4/d23/d4a/lee 0 2024-04-25T02:08:54.340 INFO:tasks.workunit.client.0.smithi077.stdout:9/713: mknod df/d1b/d48/db6/ced 0 2024-04-25T02:08:54.340 INFO:tasks.workunit.client.0.smithi077.stdout:9/714: fsync df/f2f 0 2024-04-25T02:08:54.342 INFO:tasks.workunit.client.0.smithi077.stdout:1/736: mknod db/df/d56/d5d/d77/db3/cfb 0 2024-04-25T02:08:54.342 INFO:tasks.workunit.client.0.smithi077.stdout:1/737: read db/df/d56/d5d/d77/f91 [126210,52520] 0 2024-04-25T02:08:54.342 INFO:tasks.workunit.client.0.smithi077.stdout:6/868: creat de/d53/d76/d10a/f127 x:0 0 0 2024-04-25T02:08:54.348 INFO:tasks.workunit.client.0.smithi077.stdout:7/653: unlink d4/d13/d18/d2d/fac 0 2024-04-25T02:08:54.348 INFO:tasks.workunit.client.0.smithi077.stdout:7/654: readlink d4/d13/d18/d2d/d30/l45 0 2024-04-25T02:08:54.348 INFO:tasks.workunit.client.0.smithi077.stdout:7/655: creat d4/d13/d18/d24/fe0 x:0 0 0 2024-04-25T02:08:54.348 INFO:tasks.workunit.client.0.smithi077.stdout:7/656: creat d4/d13/d18/d2d/d30/dab/fe1 x:0 0 0 2024-04-25T02:08:54.349 INFO:tasks.workunit.client.0.smithi077.stdout:4/763: unlink d0/d14/d60/d62/f8d 0 2024-04-25T02:08:54.349 INFO:tasks.workunit.client.0.smithi077.stdout:6/869: read de/d5b/da6/fb9 [2352419,98259] 0 2024-04-25T02:08:54.350 INFO:tasks.workunit.client.0.smithi077.stdout:5/733: unlink d0/c89 0 2024-04-25T02:08:54.350 INFO:tasks.workunit.client.0.smithi077.stdout:9/715: rmdir df/d1b/d56/d67/d68/db3 39 2024-04-25T02:08:54.352 INFO:tasks.workunit.client.0.smithi077.stdout:3/732: rename d0/d2/de/d48/c12 to d0/d3e/da1/c10c 0 2024-04-25T02:08:54.352 INFO:tasks.workunit.client.0.smithi077.stdout:3/733: write d0/d3e/d42/f60 [1098771,41348] 0 2024-04-25T02:08:54.353 INFO:tasks.workunit.client.0.smithi077.stdout:1/738: mknod db/df/d56/dc3/cfc 0 2024-04-25T02:08:54.353 INFO:tasks.workunit.client.0.smithi077.stdout:1/739: truncate db/df/d14/d3e/f64 1227002 0 2024-04-25T02:08:54.353 INFO:tasks.workunit.client.0.smithi077.stdout:2/746: sync 2024-04-25T02:08:54.353 INFO:tasks.workunit.client.0.smithi077.stdout:2/747: fdatasync d2/f5 0 2024-04-25T02:08:54.359 INFO:tasks.workunit.client.0.smithi077.stdout:7/657: chown d4/d13/d66/f9b 9657292 1 2024-04-25T02:08:54.359 INFO:tasks.workunit.client.0.smithi077.stdout:4/764: dread d0/d14/d21/d39/da/d12/d35/d3e/f38 [0,4194304] 0 2024-04-25T02:08:54.359 INFO:tasks.workunit.client.0.smithi077.stdout:7/658: chown d4/d13/f2f 198044 1 2024-04-25T02:08:54.359 INFO:tasks.workunit.client.0.smithi077.stdout:3/734: write d0/d3e/d42/fb5 [37525,65129] 0 2024-04-25T02:08:54.359 INFO:tasks.workunit.client.0.smithi077.stdout:7/659: chown d4/d13/d5b/d8b/fde 700086537 1 2024-04-25T02:08:54.359 INFO:tasks.workunit.client.0.smithi077.stdout:7/660: creat d4/d13/d18/d24/d3f/fe2 x:0 0 0 2024-04-25T02:08:54.362 INFO:tasks.workunit.client.0.smithi077.stdout:5/734: dread d0/d2/fc8 [0,4194304] 0 2024-04-25T02:08:54.363 INFO:tasks.workunit.client.0.smithi077.stdout:9/716: read df/d1b/d48/f54 [3687202,74795] 0 2024-04-25T02:08:54.368 INFO:tasks.workunit.client.0.smithi077.stdout:7/661: mknod d4/d13/d5b/d8b/db2/ce3 0 2024-04-25T02:08:54.370 INFO:tasks.workunit.client.0.smithi077.stdout:6/870: creat de/d12/d25/d3a/d6a/dcd/d36/f128 x:0 0 0 2024-04-25T02:08:54.370 INFO:tasks.workunit.client.0.smithi077.stdout:6/871: fdatasync de/d55/db7/fd3 0 2024-04-25T02:08:54.371 INFO:tasks.workunit.client.0.smithi077.stdout:1/740: dwrite db/fb0 [0,4194304] 0 2024-04-25T02:08:54.371 INFO:tasks.workunit.client.0.smithi077.stdout:1/741: fsync db/df/d14/d4d/d82/d32/d8f/fec 0 2024-04-25T02:08:54.374 INFO:tasks.workunit.client.0.smithi077.stdout:9/717: getdents df/d1b/d56/d67 0 2024-04-25T02:08:54.374 INFO:tasks.workunit.client.0.smithi077.stdout:9/718: fdatasync df/d60/d87/fcf 0 2024-04-25T02:08:54.375 INFO:tasks.workunit.client.0.smithi077.stdout:3/735: mkdir d0/d10d 0 2024-04-25T02:08:54.376 INFO:tasks.workunit.client.0.smithi077.stdout:7/662: getdents d4/d13/d18/d2d/d56 0 2024-04-25T02:08:54.376 INFO:tasks.workunit.client.0.smithi077.stdout:7/663: truncate d4/d13/d18/d2d/d56/d68/db3/fdd 1046885 0 2024-04-25T02:08:54.376 INFO:tasks.workunit.client.0.smithi077.stdout:7/664: dread - d4/d13/d18/f36 zero size 2024-04-25T02:08:54.379 INFO:tasks.workunit.client.0.smithi077.stdout:3/736: dread d0/d2/f35 [4194304,4194304] 0 2024-04-25T02:08:54.379 INFO:tasks.workunit.client.0.smithi077.stdout:3/737: chown d0/d2/de/d48/ca7 399 1 2024-04-25T02:08:54.379 INFO:tasks.workunit.client.0.smithi077.stdout:3/738: chown d0/d2/de/d48/cb 2843 1 2024-04-25T02:08:54.379 INFO:tasks.workunit.client.0.smithi077.stdout:3/739: chown d0/d2/de/d48/ca7 19552550 1 2024-04-25T02:08:54.381 INFO:tasks.workunit.client.0.smithi077.stdout:5/735: getdents d0 0 2024-04-25T02:08:54.382 INFO:tasks.workunit.client.0.smithi077.stdout:9/719: mkdir df/d1b/d48/dee 0 2024-04-25T02:08:54.382 INFO:tasks.workunit.client.0.smithi077.stdout:9/720: chown df/c35 110486165 1 2024-04-25T02:08:54.383 INFO:tasks.workunit.client.0.smithi077.stdout:7/665: getdents d4/d13/d18/d2d/d30 0 2024-04-25T02:08:54.383 INFO:tasks.workunit.client.0.smithi077.stdout:7/666: write d4/d13/d18/d2d/d56/f67 [586328,33663] 0 2024-04-25T02:08:54.383 INFO:tasks.workunit.client.0.smithi077.stdout:7/667: readlink d4/d13/d18/d24/d3f/d58/la4 0 2024-04-25T02:08:54.384 INFO:tasks.workunit.client.0.smithi077.stdout:3/740: rmdir d0/d2/d2f 39 2024-04-25T02:08:54.384 INFO:tasks.workunit.client.0.smithi077.stdout:1/742: write db/df/d14/d3e/f5b [3172661,43676] 0 2024-04-25T02:08:54.385 INFO:tasks.workunit.client.0.smithi077.stdout:1/743: fsync db/fb0 0 2024-04-25T02:08:54.385 INFO:tasks.workunit.client.0.smithi077.stdout:2/748: dwrite d2/d28/fde [0,4194304] 0 2024-04-25T02:08:54.386 INFO:tasks.workunit.client.0.smithi077.stdout:5/736: rename d0/d25/d82/d87/d8b/da5/dc4/d23/d4a/cdc to d0/d2/d3/d9/d39/d44/cef 0 2024-04-25T02:08:54.386 INFO:tasks.workunit.client.0.smithi077.stdout:9/721: getdents df/d60 0 2024-04-25T02:08:54.386 INFO:tasks.workunit.client.0.smithi077.stdout:9/722: creat df/d80/fef x:0 0 0 2024-04-25T02:08:54.389 INFO:tasks.workunit.client.0.smithi077.stdout:5/737: creat d0/d2/d3/db6/ff0 x:0 0 0 2024-04-25T02:08:54.390 INFO:tasks.workunit.client.0.smithi077.stdout:4/765: dwrite d0/d14/fbd [0,4194304] 0 2024-04-25T02:08:54.393 INFO:tasks.workunit.client.0.smithi077.stdout:9/723: rename df/d1b/d48/d75/d77/l7b to df/d1b/d70/d84/lf0 0 2024-04-25T02:08:54.397 INFO:tasks.workunit.client.0.smithi077.stdout:6/872: dwrite de/d3b/de8/f11d [0,4194304] 0 2024-04-25T02:08:54.399 INFO:tasks.workunit.client.0.smithi077.stdout:5/738: dread d0/d2/d1b/d38/f64 [0,4194304] 0 2024-04-25T02:08:54.409 INFO:tasks.workunit.client.0.smithi077.stdout:3/741: dwrite d0/d17/d4b/d59/f8e [0,4194304] 0 2024-04-25T02:08:54.413 INFO:tasks.workunit.client.0.smithi077.stdout:4/766: creat d0/d14/d21/d39/da/d12/d35/ff8 x:0 0 0 2024-04-25T02:08:54.414 INFO:tasks.workunit.client.0.smithi077.stdout:9/724: mknod df/d1b/d56/dbd/cf1 0 2024-04-25T02:08:54.415 INFO:tasks.workunit.client.0.smithi077.stdout:6/873: mknod de/d12/d25/d3a/d6a/dcd/d36/dd2/c129 0 2024-04-25T02:08:54.417 INFO:tasks.workunit.client.0.smithi077.stdout:5/739: truncate d0/d2/d1b/d35/fac 3925352 0 2024-04-25T02:08:54.420 INFO:tasks.workunit.client.0.smithi077.stdout:4/767: symlink d0/d14/d21/d39/d9a/lf9 0 2024-04-25T02:08:54.421 INFO:tasks.workunit.client.0.smithi077.stdout:9/725: mknod df/d1b/d56/d67/cf2 0 2024-04-25T02:08:54.422 INFO:tasks.workunit.client.0.smithi077.stdout:3/742: getdents d0/d2/d2f/d5f 0 2024-04-25T02:08:54.424 INFO:tasks.workunit.client.0.smithi077.stdout:7/668: dwrite d4/d13/d18/d2d/d56/fb4 [0,4194304] 0 2024-04-25T02:08:54.425 INFO:tasks.workunit.client.0.smithi077.stdout:9/726: rename df/f71 to df/d60/d87/ff3 0 2024-04-25T02:08:54.426 INFO:tasks.workunit.client.0.smithi077.stdout:3/743: creat d0/d2/d2f/db4/db6/df5/f10e x:0 0 0 2024-04-25T02:08:54.429 INFO:tasks.workunit.client.0.smithi077.stdout:2/749: dwrite d2/d9/f67 [0,4194304] 0 2024-04-25T02:08:54.431 INFO:tasks.workunit.client.0.smithi077.stdout:1/744: dwrite db/df/d14/dfa/db4/fe8 [0,4194304] 0 2024-04-25T02:08:54.433 INFO:tasks.workunit.client.0.smithi077.stdout:7/669: rename d4/d13/d18/d2d/d30/f6b to d4/d13/d18/fe4 0 2024-04-25T02:08:54.437 INFO:tasks.workunit.client.0.smithi077.stdout:9/727: creat df/d1b/d48/d75/ff4 x:0 0 0 2024-04-25T02:08:54.438 INFO:tasks.workunit.client.0.smithi077.stdout:2/750: symlink d2/lff 0 2024-04-25T02:08:54.439 INFO:tasks.workunit.client.0.smithi077.stdout:2/751: fsync d2/f88 0 2024-04-25T02:08:54.439 INFO:tasks.workunit.client.0.smithi077.stdout:2/752: fsync d2/d78/fac 0 2024-04-25T02:08:54.439 INFO:tasks.workunit.client.0.smithi077.stdout:2/753: stat d2/d9/d19/d2c/d72 0 2024-04-25T02:08:54.439 INFO:tasks.workunit.client.0.smithi077.stdout:5/740: dwrite d0/d25/d82/fa1 [0,4194304] 0 2024-04-25T02:08:54.440 INFO:tasks.workunit.client.0.smithi077.stdout:1/745: truncate db/df/d14/d4d/d82/fab 2573680 0 2024-04-25T02:08:54.440 INFO:tasks.workunit.client.0.smithi077.stdout:1/746: fdatasync f8 0 2024-04-25T02:08:54.442 INFO:tasks.workunit.client.0.smithi077.stdout:7/670: mkdir d4/d13/d18/d24/de5 0 2024-04-25T02:08:54.442 INFO:tasks.workunit.client.0.smithi077.stdout:6/874: dwrite de/d12/d25/d3a/d6a/d113/fd4 [0,4194304] 0 2024-04-25T02:08:54.446 INFO:tasks.workunit.client.0.smithi077.stdout:5/741: symlink d0/d2/d3/d9/d39/d44/d80/lf1 0 2024-04-25T02:08:54.448 INFO:tasks.workunit.client.0.smithi077.stdout:7/671: symlink d4/d13/d18/d2d/d56/d68/le6 0 2024-04-25T02:08:54.448 INFO:tasks.workunit.client.0.smithi077.stdout:7/672: readlink d4/d13/da9/lc3 0 2024-04-25T02:08:54.448 INFO:tasks.workunit.client.0.smithi077.stdout:8/828: sync 2024-04-25T02:08:54.448 INFO:tasks.workunit.client.0.smithi077.stdout:0/718: sync 2024-04-25T02:08:54.452 INFO:tasks.workunit.client.0.smithi077.stdout:0/719: mknod d2/d8/d5f/cfd 0 2024-04-25T02:08:54.452 INFO:tasks.workunit.client.0.smithi077.stdout:2/754: read d2/d9/d18/fe8 [1628495,27271] 0 2024-04-25T02:08:54.452 INFO:tasks.workunit.client.0.smithi077.stdout:2/755: dread - d2/d9/d19/fbe zero size 2024-04-25T02:08:54.453 INFO:tasks.workunit.client.0.smithi077.stdout:0/720: dread d2/d17/d1d/f3d [0,4194304] 0 2024-04-25T02:08:54.454 INFO:tasks.workunit.client.0.smithi077.stdout:5/742: rename d0/d25/f3a to d0/d2/d3/d9/ff2 0 2024-04-25T02:08:54.455 INFO:tasks.workunit.client.0.smithi077.stdout:8/829: mkdir d3/da/db/df/d2b/d70/d10f 0 2024-04-25T02:08:54.459 INFO:tasks.workunit.client.0.smithi077.stdout:2/756: rename d2/d9/d2f/l5f to d2/d9/d56/l100 0 2024-04-25T02:08:54.459 INFO:tasks.workunit.client.0.smithi077.stdout:2/757: chown d2/le 96846977 1 2024-04-25T02:08:54.460 INFO:tasks.workunit.client.0.smithi077.stdout:8/830: creat d3/da/db/df/d30/f110 x:0 0 0 2024-04-25T02:08:54.461 INFO:tasks.workunit.client.0.smithi077.stdout:0/721: getdents d2/d8/db6/dd7/de0 0 2024-04-25T02:08:54.463 INFO:tasks.workunit.client.0.smithi077.stdout:8/831: creat d3/da/db/df/f111 x:0 0 0 2024-04-25T02:08:54.464 INFO:tasks.workunit.client.0.smithi077.stdout:2/758: dread d2/d9/d2f/f38 [0,4194304] 0 2024-04-25T02:08:54.465 INFO:tasks.workunit.client.0.smithi077.stdout:4/768: dwrite d0/d14/d79/fb6 [0,4194304] 0 2024-04-25T02:08:54.465 INFO:tasks.workunit.client.0.smithi077.stdout:3/744: dwrite d0/d40/f57 [4194304,4194304] 0 2024-04-25T02:08:54.465 INFO:tasks.workunit.client.0.smithi077.stdout:1/747: dwrite db/df/d1b/fcc [0,4194304] 0 2024-04-25T02:08:54.465 INFO:tasks.workunit.client.0.smithi077.stdout:0/722: mkdir d2/d27/d2d/dfe 0 2024-04-25T02:08:54.466 INFO:tasks.workunit.client.0.smithi077.stdout:8/832: mkdir d3/da/db/df/d2b/d112 0 2024-04-25T02:08:54.467 INFO:tasks.workunit.client.0.smithi077.stdout:4/769: read d0/d14/d60/d62/f68 [1271361,86221] 0 2024-04-25T02:08:54.467 INFO:tasks.workunit.client.0.smithi077.stdout:9/728: getdents df/d1b/d56/d67 0 2024-04-25T02:08:54.467 INFO:tasks.workunit.client.0.smithi077.stdout:9/729: chown df/d1b/d56/fae 1175 1 2024-04-25T02:08:54.471 INFO:tasks.workunit.client.0.smithi077.stdout:2/759: write d2/d78/f7a [1670757,112785] 0 2024-04-25T02:08:54.472 INFO:tasks.workunit.client.0.smithi077.stdout:3/745: unlink d0/d3e/d42/c75 0 2024-04-25T02:08:54.472 INFO:tasks.workunit.client.0.smithi077.stdout:3/746: fdatasync d0/d2/de/d48/d15/f66 0 2024-04-25T02:08:54.473 INFO:tasks.workunit.client.0.smithi077.stdout:5/743: dwrite d0/d2/d1b/d38/f5e [0,4194304] 0 2024-04-25T02:08:54.476 INFO:tasks.workunit.client.0.smithi077.stdout:1/748: link db/df/d1b/c6b db/df/d14/d33/cfd 0 2024-04-25T02:08:54.477 INFO:tasks.workunit.client.0.smithi077.stdout:1/749: chown db/df/d14/d3e/f5b 870802 1 2024-04-25T02:08:54.477 INFO:tasks.workunit.client.0.smithi077.stdout:1/750: readlink db/df/d14/dfa/l93 0 2024-04-25T02:08:54.477 INFO:tasks.workunit.client.0.smithi077.stdout:1/751: truncate db/df/fee 345598 0 2024-04-25T02:08:54.478 INFO:tasks.workunit.client.0.smithi077.stdout:0/723: truncate d2/d17/d1d/d34/d4c/da2/f45 492728 0 2024-04-25T02:08:54.480 INFO:tasks.workunit.client.0.smithi077.stdout:8/833: symlink d3/da/db/df/ddc/ddf/l113 0 2024-04-25T02:08:54.481 INFO:tasks.workunit.client.0.smithi077.stdout:4/770: mkdir d0/d14/d60/d78/dce/dfa 0 2024-04-25T02:08:54.486 INFO:tasks.workunit.client.0.smithi077.stdout:9/730: stat df/d1b/l24 0 2024-04-25T02:08:54.489 INFO:tasks.workunit.client.0.smithi077.stdout:2/760: mknod d2/d9/c101 0 2024-04-25T02:08:54.489 INFO:tasks.workunit.client.0.smithi077.stdout:2/761: dread - d2/d9/d19/f34 zero size 2024-04-25T02:08:54.490 INFO:tasks.workunit.client.0.smithi077.stdout:3/747: symlink d0/d3e/d93/l10f 0 2024-04-25T02:08:54.492 INFO:tasks.workunit.client.0.smithi077.stdout:1/752: rename db to db/dfe 22 2024-04-25T02:08:54.493 INFO:tasks.workunit.client.0.smithi077.stdout:8/834: mknod d3/da/db/c114 0 2024-04-25T02:08:54.495 INFO:tasks.workunit.client.0.smithi077.stdout:4/771: mknod d0/cfb 0 2024-04-25T02:08:54.496 INFO:tasks.workunit.client.0.smithi077.stdout:0/724: dwrite d2/d27/d2d/f2f [0,4194304] 0 2024-04-25T02:08:54.496 INFO:tasks.workunit.client.0.smithi077.stdout:9/731: creat df/d1b/d56/d67/d68/ff5 x:0 0 0 2024-04-25T02:08:54.496 INFO:tasks.workunit.client.0.smithi077.stdout:9/732: readlink df/d1b/d56/l7a 0 2024-04-25T02:08:54.497 INFO:tasks.workunit.client.0.smithi077.stdout:2/762: unlink f1 0 2024-04-25T02:08:54.499 INFO:tasks.workunit.client.0.smithi077.stdout:3/748: mkdir d0/d3e/d62/d110 0 2024-04-25T02:08:54.499 INFO:tasks.workunit.client.0.smithi077.stdout:3/749: write d0/d40/f57 [477265,13735] 0 2024-04-25T02:08:54.500 INFO:tasks.workunit.client.0.smithi077.stdout:1/753: link db/df/d14/d4d/d82/d32/c4f db/d26/cff 0 2024-04-25T02:08:54.502 INFO:tasks.workunit.client.0.smithi077.stdout:4/772: truncate d0/d14/d60/d86/d25/f31 2125513 0 2024-04-25T02:08:54.505 INFO:tasks.workunit.client.0.smithi077.stdout:0/725: unlink d2/d17/d1d/d34/d4c/da2/de2/ff9 0 2024-04-25T02:08:54.505 INFO:tasks.workunit.client.0.smithi077.stdout:0/726: readlink d2/d17/d1d/la1 0 2024-04-25T02:08:54.506 INFO:tasks.workunit.client.0.smithi077.stdout:9/733: creat df/d1b/d56/dbd/ff6 x:0 0 0 2024-04-25T02:08:54.506 INFO:tasks.workunit.client.0.smithi077.stdout:9/734: truncate df/d1b/d48/d75/ff4 825376 0 2024-04-25T02:08:54.506 INFO:tasks.workunit.client.0.smithi077.stdout:9/735: getdents df/d1b/d56/d67 0 2024-04-25T02:08:54.506 INFO:tasks.workunit.client.0.smithi077.stdout:9/736: chown df/d60/d87 19602 1 2024-04-25T02:08:54.510 INFO:tasks.workunit.client.0.smithi077.stdout:1/754: mknod db/df/d14/dfa/db4/c100 0 2024-04-25T02:08:54.510 INFO:tasks.workunit.client.0.smithi077.stdout:1/755: write db/fbb [1161013,92003] 0 2024-04-25T02:08:54.512 INFO:tasks.workunit.client.0.smithi077.stdout:4/773: unlink d0/d14/d21/d39/da/d12/d35/d3e/l89 0 2024-04-25T02:08:54.514 INFO:tasks.workunit.client.0.smithi077.stdout:0/727: rename d2/d27/d2d/dce/de7/f91 to d2/d8/db6/fff 0 2024-04-25T02:08:54.515 INFO:tasks.workunit.client.0.smithi077.stdout:9/737: symlink df/d1b/d48/d75/d90/lf7 0 2024-04-25T02:08:54.519 INFO:tasks.workunit.client.0.smithi077.stdout:1/756: write db/df/d56/fa1 [1889975,122242] 0 2024-04-25T02:08:54.520 INFO:tasks.workunit.client.0.smithi077.stdout:4/774: creat d0/d14/d21/d39/da/ffc x:0 0 0 2024-04-25T02:08:54.521 INFO:tasks.workunit.client.0.smithi077.stdout:0/728: creat d2/d17/d1d/d34/d83/f100 x:0 0 0 2024-04-25T02:08:54.522 INFO:tasks.workunit.client.0.smithi077.stdout:9/738: link df/d1b/lb5 df/d60/d87/lf8 0 2024-04-25T02:08:54.522 INFO:tasks.workunit.client.0.smithi077.stdout:9/739: readlink df/d60/l72 0 2024-04-25T02:08:54.524 INFO:tasks.workunit.client.0.smithi077.stdout:2/763: dwrite d2/d9/d18/d1b/ff9 [0,4194304] 0 2024-04-25T02:08:54.525 INFO:tasks.workunit.client.0.smithi077.stdout:3/750: dwrite d0/d3e/d42/ff7 [0,4194304] 0 2024-04-25T02:08:54.526 INFO:tasks.workunit.client.0.smithi077.stdout:1/757: creat db/df/d14/d3e/d69/dad/f101 x:0 0 0 2024-04-25T02:08:54.526 INFO:tasks.workunit.client.0.smithi077.stdout:1/758: creat db/d26/f102 x:0 0 0 2024-04-25T02:08:54.526 INFO:tasks.workunit.client.0.smithi077.stdout:1/759: fdatasync db/df/d56/d5d/ff0 0 2024-04-25T02:08:54.526 INFO:tasks.workunit.client.0.smithi077.stdout:1/760: read db/d26/f2f [22427,53803] 0 2024-04-25T02:08:54.526 INFO:tasks.workunit.client.0.smithi077.stdout:3/751: dread d0/d17/d4b/fa3 [0,4194304] 0 2024-04-25T02:08:54.527 INFO:tasks.workunit.client.0.smithi077.stdout:0/729: truncate d2/d17/d1d/f3d 1100171 0 2024-04-25T02:08:54.531 INFO:tasks.workunit.client.0.smithi077.stdout:2/764: creat d2/d9/d2f/f102 x:0 0 0 2024-04-25T02:08:54.541 INFO:tasks.workunit.client.0.smithi077.stdout:1/761: rmdir db/df/d56/dc3 39 2024-04-25T02:08:54.541 INFO:tasks.workunit.client.0.smithi077.stdout:1/762: write db/df/d56/dc3/fc6 [172401,113289] 0 2024-04-25T02:08:54.541 INFO:tasks.workunit.client.0.smithi077.stdout:1/763: stat db/df/d14/d4d/da9/de4/le9 0 2024-04-25T02:08:54.542 INFO:tasks.workunit.client.0.smithi077.stdout:1/764: write db/df/d56/dc3/fc6 [247433,105691] 0 2024-04-25T02:08:54.543 INFO:tasks.workunit.client.0.smithi077.stdout:0/730: creat d2/d17/d1d/d34/d4c/da2/df5/f101 x:0 0 0 2024-04-25T02:08:54.544 INFO:tasks.workunit.client.0.smithi077.stdout:2/765: mkdir d2/d59/d103 0 2024-04-25T02:08:54.544 INFO:tasks.workunit.client.0.smithi077.stdout:2/766: creat d2/d9/d56/f104 x:0 0 0 2024-04-25T02:08:54.545 INFO:tasks.workunit.client.0.smithi077.stdout:2/767: truncate d2/d9/f6a 4828448 0 2024-04-25T02:08:54.545 INFO:tasks.workunit.client.0.smithi077.stdout:2/768: dread - d2/d9/d18/d31/fe7 zero size 2024-04-25T02:08:54.547 INFO:tasks.workunit.client.0.smithi077.stdout:2/769: truncate d2/d9/fb 4166634 0 2024-04-25T02:08:54.547 INFO:tasks.workunit.client.0.smithi077.stdout:2/770: creat d2/d78/d95/f105 x:0 0 0 2024-04-25T02:08:54.548 INFO:tasks.workunit.client.0.smithi077.stdout:2/771: write d2/d9/d18/d31/fe7 [907674,1273] 0 2024-04-25T02:08:54.548 INFO:tasks.workunit.client.0.smithi077.stdout:2/772: stat d2/d9/d56/ff0 0 2024-04-25T02:08:54.550 INFO:tasks.workunit.client.0.smithi077.stdout:2/773: symlink d2/d59/d79/db4/l106 0 2024-04-25T02:08:54.551 INFO:tasks.workunit.client.0.smithi077.stdout:2/774: mknod d2/d9/d19/d1c/d3f/c107 0 2024-04-25T02:08:54.555 INFO:tasks.workunit.client.0.smithi077.stdout:2/775: link d2/fec d2/d9/d19/f108 0 2024-04-25T02:08:54.557 INFO:tasks.workunit.client.0.smithi077.stdout:1/765: read db/df/d14/d4d/fed [4129183,61750] 0 2024-04-25T02:08:54.564 INFO:tasks.workunit.client.0.smithi077.stdout:4/775: dwrite d0/d14/d21/d39/d9a/fec [0,4194304] 0 2024-04-25T02:08:54.564 INFO:tasks.workunit.client.0.smithi077.stdout:4/776: fdatasync d0/d14/fbd 0 2024-04-25T02:08:54.565 INFO:tasks.workunit.client.0.smithi077.stdout:9/740: dwrite df/d1b/d70/d84/fe3 [0,4194304] 0 2024-04-25T02:08:54.565 INFO:tasks.workunit.client.0.smithi077.stdout:9/741: dread - df/d60/d87/fcf zero size 2024-04-25T02:08:54.565 INFO:tasks.workunit.client.0.smithi077.stdout:3/752: dwrite d0/d17/d4b/fab [4194304,4194304] 0 2024-04-25T02:08:54.565 INFO:tasks.workunit.client.0.smithi077.stdout:3/753: chown d0/d3e/d62/dba 174164 1 2024-04-25T02:08:54.566 INFO:tasks.workunit.client.0.smithi077.stdout:0/731: dwrite d2/d8/db6/dd7/de0/fef [0,4194304] 0 2024-04-25T02:08:54.566 INFO:tasks.workunit.client.0.smithi077.stdout:0/732: stat d2/d17/d1d/d34/d4c/da2/de2/df3 0 2024-04-25T02:08:54.567 INFO:tasks.workunit.client.0.smithi077.stdout:4/777: dread d0/d14/d21/d39/da/fab [0,4194304] 0 2024-04-25T02:08:54.568 INFO:tasks.workunit.client.0.smithi077.stdout:3/754: dread d0/d2/d2f/d50/fe3 [0,4194304] 0 2024-04-25T02:08:54.572 INFO:tasks.workunit.client.0.smithi077.stdout:1/766: getdents db/df/d14/d4d/d82 0 2024-04-25T02:08:54.572 INFO:tasks.workunit.client.0.smithi077.stdout:1/767: creat db/df/d14/d4d/d82/d32/d8f/f103 x:0 0 0 2024-04-25T02:08:54.580 INFO:tasks.workunit.client.0.smithi077.stdout:2/776: rmdir d2 39 2024-04-25T02:08:54.583 INFO:tasks.workunit.client.0.smithi077.stdout:1/768: dread db/df/d1b/fcc [0,4194304] 0 2024-04-25T02:08:54.587 INFO:tasks.workunit.client.0.smithi077.stdout:9/742: dwrite df/d1b/d48/d75/fa0 [0,4194304] 0 2024-04-25T02:08:54.588 INFO:tasks.workunit.client.0.smithi077.stdout:0/733: dwrite d2/d27/d2d/f6d [0,4194304] 0 2024-04-25T02:08:54.588 INFO:tasks.workunit.client.0.smithi077.stdout:0/734: write d2/d8/db6/fd2 [5673747,17605] 0 2024-04-25T02:08:54.590 INFO:tasks.workunit.client.0.smithi077.stdout:4/778: creat d0/d14/d60/d86/ffd x:0 0 0 2024-04-25T02:08:54.593 INFO:tasks.workunit.client.0.smithi077.stdout:2/777: stat d2/d9/d19/fbe 0 2024-04-25T02:08:54.597 INFO:tasks.workunit.client.0.smithi077.stdout:1/769: dwrite db/d26/fd8 [0,4194304] 0 2024-04-25T02:08:54.599 INFO:tasks.workunit.client.0.smithi077.stdout:4/779: mkdir d0/d14/d21/d39/da/d12/d35/dfe 0 2024-04-25T02:08:54.599 INFO:tasks.workunit.client.0.smithi077.stdout:4/780: truncate d0/d14/d21/d39/d1d/d98/fe1 128539 0 2024-04-25T02:08:54.600 INFO:tasks.workunit.client.0.smithi077.stdout:3/755: rmdir d0/d2/de/d36/da6 39 2024-04-25T02:08:54.601 INFO:tasks.workunit.client.0.smithi077.stdout:2/778: symlink d2/d9/d18/d1b/df5/l109 0 2024-04-25T02:08:54.601 INFO:tasks.workunit.client.0.smithi077.stdout:1/770: dread db/df/d1b/fcc [0,4194304] 0 2024-04-25T02:08:54.601 INFO:tasks.workunit.client.0.smithi077.stdout:9/743: rmdir df/d60/d87 39 2024-04-25T02:08:54.602 INFO:tasks.workunit.client.0.smithi077.stdout:9/744: write df/d60/d87/f91 [2170140,95961] 0 2024-04-25T02:08:54.603 INFO:tasks.workunit.client.0.smithi077.stdout:5/744: sync 2024-04-25T02:08:54.603 INFO:tasks.workunit.client.0.smithi077.stdout:7/673: sync 2024-04-25T02:08:54.603 INFO:tasks.workunit.client.0.smithi077.stdout:6/875: sync 2024-04-25T02:08:54.603 INFO:tasks.workunit.client.0.smithi077.stdout:7/674: fsync d4/d13/d66/f8f 0 2024-04-25T02:08:54.603 INFO:tasks.workunit.client.0.smithi077.stdout:7/675: stat d4/fe 0 2024-04-25T02:08:54.604 INFO:tasks.workunit.client.0.smithi077.stdout:4/781: dread d0/d14/d21/d39/da/fe3 [0,4194304] 0 2024-04-25T02:08:54.605 INFO:tasks.workunit.client.0.smithi077.stdout:3/756: mknod d0/d3e/d62/c111 0 2024-04-25T02:08:54.607 INFO:tasks.workunit.client.0.smithi077.stdout:3/757: dread d0/d17/d4b/fa3 [0,4194304] 0 2024-04-25T02:08:54.607 INFO:tasks.workunit.client.0.smithi077.stdout:7/676: dread d4/d13/d18/fcd [0,4194304] 0 2024-04-25T02:08:54.609 INFO:tasks.workunit.client.0.smithi077.stdout:8/835: sync 2024-04-25T02:08:54.609 INFO:tasks.workunit.client.0.smithi077.stdout:9/745: link df/f37 df/d1b/d48/d75/d77/ff9 0 2024-04-25T02:08:54.609 INFO:tasks.workunit.client.0.smithi077.stdout:9/746: fdatasync df/d1b/d48/db6/fe0 0 2024-04-25T02:08:54.610 INFO:tasks.workunit.client.0.smithi077.stdout:5/745: mkdir d0/d2/d1b/d35/df3 0 2024-04-25T02:08:54.611 INFO:tasks.workunit.client.0.smithi077.stdout:0/735: dwrite d2/d9/f65 [0,4194304] 0 2024-04-25T02:08:54.612 INFO:tasks.workunit.client.0.smithi077.stdout:6/876: symlink de/d53/d76/l12a 0 2024-04-25T02:08:54.613 INFO:tasks.workunit.client.0.smithi077.stdout:3/758: creat d0/d3e/d62/d6a/db9/dde/f112 x:0 0 0 2024-04-25T02:08:54.616 INFO:tasks.workunit.client.0.smithi077.stdout:8/836: creat d3/da/d27/d44/db1/f115 x:0 0 0 2024-04-25T02:08:54.616 INFO:tasks.workunit.client.0.smithi077.stdout:8/837: fsync d3/f7 0 2024-04-25T02:08:54.616 INFO:tasks.workunit.client.0.smithi077.stdout:8/838: truncate d3/da/d27/d44/fad 913135 0 2024-04-25T02:08:54.618 INFO:tasks.workunit.client.0.smithi077.stdout:9/747: unlink df/d1b/d56/f59 0 2024-04-25T02:08:54.619 INFO:tasks.workunit.client.0.smithi077.stdout:5/746: unlink d0/d2/d3/d9/l18 0 2024-04-25T02:08:54.621 INFO:tasks.workunit.client.0.smithi077.stdout:0/736: truncate d2/d17/d1d/d34/d4c/da2/d51/fcf 2705846 0 2024-04-25T02:08:54.622 INFO:tasks.workunit.client.0.smithi077.stdout:0/737: write d2/d8/d5f/d9f/ffc [1178465,23403] 0 2024-04-25T02:08:54.625 INFO:tasks.workunit.client.0.smithi077.stdout:5/747: dread d0/d25/d82/d87/fec [0,4194304] 0 2024-04-25T02:08:54.625 INFO:tasks.workunit.client.0.smithi077.stdout:5/748: creat d0/d2/d3/d9/d39/d3c/dc6/ff4 x:0 0 0 2024-04-25T02:08:54.625 INFO:tasks.workunit.client.0.smithi077.stdout:5/749: dread - d0/d25/feb zero size 2024-04-25T02:08:54.625 INFO:tasks.workunit.client.0.smithi077.stdout:5/750: chown d0/d25/d82/d87/d8b/da5/dc4/ca0 4 1 2024-04-25T02:08:54.625 INFO:tasks.workunit.client.0.smithi077.stdout:5/751: fdatasync d0/d25/d82/fd6 0 2024-04-25T02:08:54.625 INFO:tasks.workunit.client.0.smithi077.stdout:5/752: write d0/d25/d82/d87/d8b/da5/dc4/d23/d4a/f7e [1439207,116366] 0 2024-04-25T02:08:54.625 INFO:tasks.workunit.client.0.smithi077.stdout:2/779: dwrite d2/d9/d56/ff0 [0,4194304] 0 2024-04-25T02:08:54.625 INFO:tasks.workunit.client.0.smithi077.stdout:3/759: rename d0/d2/d83/lcc to d0/d3e/d62/d6a/d6e/l113 0 2024-04-25T02:08:54.625 INFO:tasks.workunit.client.0.smithi077.stdout:3/760: truncate d0/d2/d2f/db4/db6/df5/f10e 809294 0 2024-04-25T02:08:54.626 INFO:tasks.workunit.client.0.smithi077.stdout:8/839: rmdir d3/da/db/df/d2b/d112 0 2024-04-25T02:08:54.626 INFO:tasks.workunit.client.0.smithi077.stdout:9/748: mknod df/d1b/d70/d84/dde/de9/cfa 0 2024-04-25T02:08:54.627 INFO:tasks.workunit.client.0.smithi077.stdout:0/738: dread d2/d17/d4e/d5e/fb7 [0,4194304] 0 2024-04-25T02:08:54.628 INFO:tasks.workunit.client.0.smithi077.stdout:6/877: rmdir de/d55 39 2024-04-25T02:08:54.628 INFO:tasks.workunit.client.0.smithi077.stdout:6/878: dread - de/d55/f126 zero size 2024-04-25T02:08:54.630 INFO:tasks.workunit.client.0.smithi077.stdout:5/753: creat d0/d2/da8/ff5 x:0 0 0 2024-04-25T02:08:54.633 INFO:tasks.workunit.client.0.smithi077.stdout:2/780: symlink d2/d9/d19/d1c/d3f/d53/l10a 0 2024-04-25T02:08:54.633 INFO:tasks.workunit.client.0.smithi077.stdout:2/781: write d2/d9/d19/d1c/d3f/d53/d86/db3/ffa [537304,83754] 0 2024-04-25T02:08:54.633 INFO:tasks.workunit.client.0.smithi077.stdout:2/782: truncate d2/d28/fd8 568143 0 2024-04-25T02:08:54.633 INFO:tasks.workunit.client.0.smithi077.stdout:2/783: truncate d2/d9/d19/d1c/d3f/d53/d86/f96 1095858 0 2024-04-25T02:08:54.633 INFO:tasks.workunit.client.0.smithi077.stdout:2/784: dread - d2/d28/fe4 zero size 2024-04-25T02:08:54.633 INFO:tasks.workunit.client.0.smithi077.stdout:1/771: dwrite db/df/d14/d3e/d69/dad/f101 [0,4194304] 0 2024-04-25T02:08:54.633 INFO:tasks.workunit.client.0.smithi077.stdout:3/761: rename d0/d2/d2f/c31 to d0/d2/de/d48/d15/c114 0 2024-04-25T02:08:54.634 INFO:tasks.workunit.client.0.smithi077.stdout:4/782: dwrite d0/d14/fbd [4194304,4194304] 0 2024-04-25T02:08:54.634 INFO:tasks.workunit.client.0.smithi077.stdout:4/783: stat d0/d14/d79/da4/lde 0 2024-04-25T02:08:54.635 INFO:tasks.workunit.client.0.smithi077.stdout:8/840: mkdir d3/da/d27/d16/db3/d116 0 2024-04-25T02:08:54.635 INFO:tasks.workunit.client.0.smithi077.stdout:5/754: dread d0/d25/d82/d87/d8b/da5/dc4/d23/f67 [0,4194304] 0 2024-04-25T02:08:54.635 INFO:tasks.workunit.client.0.smithi077.stdout:5/755: chown d0/d2/da8 1695 1 2024-04-25T02:08:54.636 INFO:tasks.workunit.client.0.smithi077.stdout:5/756: chown d0/d2/d3/d9/d39/d44/c5b 0 1 2024-04-25T02:08:54.636 INFO:tasks.workunit.client.0.smithi077.stdout:5/757: fdatasync d0/d2/d1b/d35/fab 0 2024-04-25T02:08:54.636 INFO:tasks.workunit.client.0.smithi077.stdout:0/739: symlink d2/d17/d1d/d34/d83/l102 0 2024-04-25T02:08:54.636 INFO:tasks.workunit.client.0.smithi077.stdout:0/740: readlink d2/l79 0 2024-04-25T02:08:54.636 INFO:tasks.workunit.client.0.smithi077.stdout:0/741: write d2/d17/d4e/fb0 [2499993,87332] 0 2024-04-25T02:08:54.637 INFO:tasks.workunit.client.0.smithi077.stdout:0/742: dread - d2/d9/d2a/db5/fbc zero size 2024-04-25T02:08:54.637 INFO:tasks.workunit.client.0.smithi077.stdout:2/785: creat d2/d9/d18/d31/d7c/f10b x:0 0 0 2024-04-25T02:08:54.644 INFO:tasks.workunit.client.0.smithi077.stdout:9/749: dwrite df/d1b/d70/d74/fe8 [0,4194304] 0 2024-04-25T02:08:54.648 INFO:tasks.workunit.client.0.smithi077.stdout:0/743: write d2/d8/f97 [2637053,3208] 0 2024-04-25T02:08:54.648 INFO:tasks.workunit.client.0.smithi077.stdout:0/744: fdatasync d2/d9/d2a/fa9 0 2024-04-25T02:08:54.649 INFO:tasks.workunit.client.0.smithi077.stdout:6/879: rename de/d12/d25/d3a/d6a/dcd/l18 to de/d53/d6f/l12b 0 2024-04-25T02:08:54.650 INFO:tasks.workunit.client.0.smithi077.stdout:1/772: dwrite db/d26/f73 [0,4194304] 0 2024-04-25T02:08:54.659 INFO:tasks.workunit.client.0.smithi077.stdout:4/784: mkdir d0/d14/d60/dff 0 2024-04-25T02:08:54.659 INFO:tasks.workunit.client.0.smithi077.stdout:4/785: truncate d0/d14/d21/d39/da/fd0 729485 0 2024-04-25T02:08:54.660 INFO:tasks.workunit.client.0.smithi077.stdout:8/841: creat d3/da/db/df/ddc/f117 x:0 0 0 2024-04-25T02:08:54.662 INFO:tasks.workunit.client.0.smithi077.stdout:5/758: mkdir d0/d25/d82/d87/d8b/da5/dc4/d23/df6 0 2024-04-25T02:08:54.662 INFO:tasks.workunit.client.0.smithi077.stdout:5/759: readlink d0/d2/d1b/d3b/l6f 0 2024-04-25T02:08:54.666 INFO:tasks.workunit.client.0.smithi077.stdout:2/786: creat d2/d9/d18/d31/d7c/dab/dc8/f10c x:0 0 0 2024-04-25T02:08:54.666 INFO:tasks.workunit.client.0.smithi077.stdout:2/787: fdatasync d2/d9/d18/d31/f8d 0 2024-04-25T02:08:54.668 INFO:tasks.workunit.client.0.smithi077.stdout:9/750: symlink df/d1b/d48/dee/lfb 0 2024-04-25T02:08:54.669 INFO:tasks.workunit.client.0.smithi077.stdout:9/751: chown df/d1b/d48/db6/le7 107513476 1 2024-04-25T02:08:54.672 INFO:tasks.workunit.client.0.smithi077.stdout:6/880: dwrite de/d55/f9a [0,4194304] 0 2024-04-25T02:08:54.672 INFO:tasks.workunit.client.0.smithi077.stdout:6/881: chown de/d53/d6f/c9d 54 1 2024-04-25T02:08:54.672 INFO:tasks.workunit.client.0.smithi077.stdout:6/882: dread - de/d53/d76/d10a/f127 zero size 2024-04-25T02:08:54.672 INFO:tasks.workunit.client.0.smithi077.stdout:0/745: link d2/d8/dad/fd5 d2/d8/dfb/f103 0 2024-04-25T02:08:54.672 INFO:tasks.workunit.client.0.smithi077.stdout:0/746: write d2/d17/d1d/d34/d83/f92 [1292223,17777] 0 2024-04-25T02:08:54.677 INFO:tasks.workunit.client.0.smithi077.stdout:1/773: symlink db/df/d14/d3e/d69/dad/l104 0 2024-04-25T02:08:54.678 INFO:tasks.workunit.client.0.smithi077.stdout:3/762: rmdir d0/d17/d4b 39 2024-04-25T02:08:54.681 INFO:tasks.workunit.client.0.smithi077.stdout:4/786: symlink d0/d14/d21/d39/d64/l100 0 2024-04-25T02:08:54.683 INFO:tasks.workunit.client.0.smithi077.stdout:8/842: truncate d3/d81/d86/fae 825977 0 2024-04-25T02:08:54.683 INFO:tasks.workunit.client.0.smithi077.stdout:8/843: write d3/da/db/fa1 [2046074,92029] 0 2024-04-25T02:08:54.684 INFO:tasks.workunit.client.0.smithi077.stdout:2/788: creat d2/d9/d19/d1c/d37/dcb/f10d x:0 0 0 2024-04-25T02:08:54.689 INFO:tasks.workunit.client.0.smithi077.stdout:1/774: unlink db/df/d56/d5d/d77/c7f 0 2024-04-25T02:08:54.689 INFO:tasks.workunit.client.0.smithi077.stdout:1/775: fsync db/df/d14/d4d/d82/f7a 0 2024-04-25T02:08:54.689 INFO:tasks.workunit.client.0.smithi077.stdout:1/776: chown db/c4e 4819372 1 2024-04-25T02:08:54.689 INFO:tasks.workunit.client.0.smithi077.stdout:1/777: stat db/df/d14/d3e/d69/faf 0 2024-04-25T02:08:54.690 INFO:tasks.workunit.client.0.smithi077.stdout:3/763: symlink d0/d17/dd4/d107/l115 0 2024-04-25T02:08:54.691 INFO:tasks.workunit.client.0.smithi077.stdout:4/787: creat d0/d14/d60/d78/f101 x:0 0 0 2024-04-25T02:08:54.692 INFO:tasks.workunit.client.0.smithi077.stdout:9/752: dwrite df/d1b/d48/d75/f88 [0,4194304] 0 2024-04-25T02:08:54.693 INFO:tasks.workunit.client.0.smithi077.stdout:8/844: link d3/da/db/c114 d3/da/d27/d44/db1/d108/c118 0 2024-04-25T02:08:54.693 INFO:tasks.workunit.client.0.smithi077.stdout:2/789: dread d2/f88 [0,4194304] 0 2024-04-25T02:08:54.695 INFO:tasks.workunit.client.0.smithi077.stdout:5/760: dwrite d0/d25/d82/d87/d8b/da5/dc4/d23/d4a/f7e [0,4194304] 0 2024-04-25T02:08:54.695 INFO:tasks.workunit.client.0.smithi077.stdout:5/761: creat d0/d2/d3/d9/d39/d3c/dc6/ff7 x:0 0 0 2024-04-25T02:08:54.695 INFO:tasks.workunit.client.0.smithi077.stdout:5/762: truncate d0/d25/d82/d87/d8b/da5/dc4/d23/f67 1863605 0 2024-04-25T02:08:54.697 INFO:tasks.workunit.client.0.smithi077.stdout:0/747: getdents d2/d8/dad 0 2024-04-25T02:08:54.697 INFO:tasks.workunit.client.0.smithi077.stdout:0/748: chown d2/d17/d1d/d34/d4c/da2/dae 1453 1 2024-04-25T02:08:54.697 INFO:tasks.workunit.client.0.smithi077.stdout:0/749: write d2/d17/d1d/d34/d4c/fab [185502,101472] 0 2024-04-25T02:08:54.697 INFO:tasks.workunit.client.0.smithi077.stdout:0/750: fdatasync d2/d17/d1d/d34/d4c/da2/d51/fcf 0 2024-04-25T02:08:54.697 INFO:tasks.workunit.client.0.smithi077.stdout:0/751: chown d2/d17/d1d/d34/d4c/da2/de2 14 1 2024-04-25T02:08:54.698 INFO:tasks.workunit.client.0.smithi077.stdout:1/778: mknod db/df/d14/d3e/d69/dad/c105 0 2024-04-25T02:08:54.698 INFO:tasks.workunit.client.0.smithi077.stdout:1/779: write db/df/d56/d5d/d77/f8d [429815,67360] 0 2024-04-25T02:08:54.699 INFO:tasks.workunit.client.0.smithi077.stdout:3/764: symlink d0/dc5/l116 0 2024-04-25T02:08:54.700 INFO:tasks.workunit.client.0.smithi077.stdout:4/788: rename d0/d14/d21/d39/f10 to d0/d14/d79/da4/dbc/f102 0 2024-04-25T02:08:54.705 INFO:tasks.workunit.client.0.smithi077.stdout:2/790: mkdir d2/d9/ddc/dad/d10e 0 2024-04-25T02:08:54.706 INFO:tasks.workunit.client.0.smithi077.stdout:9/753: dread df/d1b/d48/db6/fe0 [4194304,4194304] 0 2024-04-25T02:08:54.707 INFO:tasks.workunit.client.0.smithi077.stdout:9/754: read df/d1b/d70/d74/fe2 [2646428,7494] 0 2024-04-25T02:08:54.707 INFO:tasks.workunit.client.0.smithi077.stdout:9/755: fdatasync df/d1b/d48/d75/fa5 0 2024-04-25T02:08:54.711 INFO:tasks.workunit.client.0.smithi077.stdout:0/752: mkdir d2/d17/d1d/d34/d4c/da2/de2/d104 0 2024-04-25T02:08:54.711 INFO:tasks.workunit.client.0.smithi077.stdout:0/753: chown d2/d9/f66 1 1 2024-04-25T02:08:54.716 INFO:tasks.workunit.client.0.smithi077.stdout:3/765: rename d0/d2/d2f/ld9 to d0/d2/de/d36/l117 0 2024-04-25T02:08:54.716 INFO:tasks.workunit.client.0.smithi077.stdout:3/766: write d0/d2/de/d48/d15/f2b [1777886,54861] 0 2024-04-25T02:08:54.716 INFO:tasks.workunit.client.0.smithi077.stdout:3/767: chown d0/d17/d4b/d59/d81/cbf 11471806 1 2024-04-25T02:08:54.717 INFO:tasks.workunit.client.0.smithi077.stdout:4/789: creat d0/d14/d79/da4/dbc/f103 x:0 0 0 2024-04-25T02:08:54.718 INFO:tasks.workunit.client.0.smithi077.stdout:2/791: creat d2/d9/d2f/d84/da6/f10f x:0 0 0 2024-04-25T02:08:54.721 INFO:tasks.workunit.client.0.smithi077.stdout:8/845: dwrite d3/da/db/df/d2b/f1d [0,4194304] 0 2024-04-25T02:08:54.721 INFO:tasks.workunit.client.0.smithi077.stdout:9/756: link df/d1b/d70/d84/dde/f89 df/d1b/d56/d67/d68/db3/ffc 0 2024-04-25T02:08:54.721 INFO:tasks.workunit.client.0.smithi077.stdout:8/846: readlink d3/d81/d86/ld1 0 2024-04-25T02:08:54.721 INFO:tasks.workunit.client.0.smithi077.stdout:9/757: creat df/d1b/d70/d84/ffd x:0 0 0 2024-04-25T02:08:54.722 INFO:tasks.workunit.client.0.smithi077.stdout:5/763: getdents d0/d25/d82/d87/d8b 0 2024-04-25T02:08:54.724 INFO:tasks.workunit.client.0.smithi077.stdout:1/780: symlink db/df/d14/l106 0 2024-04-25T02:08:54.724 INFO:tasks.workunit.client.0.smithi077.stdout:1/781: dread - db/df/d14/d3e/d69/dad/fdc zero size 2024-04-25T02:08:54.726 INFO:tasks.workunit.client.0.smithi077.stdout:5/764: dread d0/d2/d1b/d38/f64 [0,4194304] 0 2024-04-25T02:08:54.728 INFO:tasks.workunit.client.0.smithi077.stdout:1/782: dread db/df/d56/d5d/fd6 [0,4194304] 0 2024-04-25T02:08:54.728 INFO:tasks.workunit.client.0.smithi077.stdout:1/783: read - db/df/fe3 zero size 2024-04-25T02:08:54.732 INFO:tasks.workunit.client.0.smithi077.stdout:9/758: mkdir df/d1b/d48/d75/d90/dfe 0 2024-04-25T02:08:54.734 INFO:tasks.workunit.client.0.smithi077.stdout:7/677: sync 2024-04-25T02:08:54.735 INFO:tasks.workunit.client.0.smithi077.stdout:8/847: write d3/fd [3766031,93378] 0 2024-04-25T02:08:54.735 INFO:tasks.workunit.client.0.smithi077.stdout:8/848: chown d3/da/db/df/d30/f40 35441578 1 2024-04-25T02:08:54.736 INFO:tasks.workunit.client.0.smithi077.stdout:1/784: mkdir db/df/d14/d3e/daa/d107 0 2024-04-25T02:08:54.736 INFO:tasks.workunit.client.0.smithi077.stdout:1/785: creat db/df/d56/d5d/d77/f108 x:0 0 0 2024-04-25T02:08:54.739 INFO:tasks.workunit.client.0.smithi077.stdout:0/754: rename d2/d1c to d2/d8/db6/dd7/d105 0 2024-04-25T02:08:54.741 INFO:tasks.workunit.client.0.smithi077.stdout:7/678: mkdir d4/d13/d18/d2d/d56/de7 0 2024-04-25T02:08:54.741 INFO:tasks.workunit.client.0.smithi077.stdout:7/679: read d4/f37 [127896,49978] 0 2024-04-25T02:08:54.741 INFO:tasks.workunit.client.0.smithi077.stdout:7/680: fsync d4/d13/d18/d2d/d30/dab/fd3 0 2024-04-25T02:08:54.741 INFO:tasks.workunit.client.0.smithi077.stdout:7/681: chown d4/d13/d5b/d8b/fc0 171091 1 2024-04-25T02:08:54.741 INFO:tasks.workunit.client.0.smithi077.stdout:7/682: chown d4/lc 88 1 2024-04-25T02:08:54.741 INFO:tasks.workunit.client.0.smithi077.stdout:7/683: chown d4/d13/d18/d2d/d56/d68/d88 15 1 2024-04-25T02:08:54.741 INFO:tasks.workunit.client.0.smithi077.stdout:7/684: fsync d4/d13/d18/fe4 0 2024-04-25T02:08:54.743 INFO:tasks.workunit.client.0.smithi077.stdout:1/786: dread db/df/d14/d3e/f54 [0,4194304] 0 2024-04-25T02:08:54.745 INFO:tasks.workunit.client.0.smithi077.stdout:7/685: mkdir d4/d13/de8 0 2024-04-25T02:08:54.747 INFO:tasks.workunit.client.0.smithi077.stdout:1/787: unlink db/df/d14/d4d/d82/d32/l3a 0 2024-04-25T02:08:54.749 INFO:tasks.workunit.client.0.smithi077.stdout:7/686: mkdir d4/d13/d18/d24/d3f/de9 0 2024-04-25T02:08:54.753 INFO:tasks.workunit.client.0.smithi077.stdout:1/788: symlink db/d26/l109 0 2024-04-25T02:08:54.753 INFO:tasks.workunit.client.0.smithi077.stdout:1/789: stat db/df/d14/d3e/d69/dad/c105 0 2024-04-25T02:08:54.757 INFO:tasks.workunit.client.0.smithi077.stdout:8/849: dread d3/fc7 [0,4194304] 0 2024-04-25T02:08:54.758 INFO:tasks.workunit.client.0.smithi077.stdout:8/850: unlink d3/d34/l109 0 2024-04-25T02:08:54.758 INFO:tasks.workunit.client.0.smithi077.stdout:7/687: write d4/d13/d18/d24/f57 [734458,25053] 0 2024-04-25T02:08:54.759 INFO:tasks.workunit.client.0.smithi077.stdout:8/851: mknod d3/da/d27/d44/db1/c119 0 2024-04-25T02:08:54.760 INFO:tasks.workunit.client.0.smithi077.stdout:3/768: dwrite d0/d2/de/d36/fb8 [0,4194304] 0 2024-04-25T02:08:54.760 INFO:tasks.workunit.client.0.smithi077.stdout:1/790: dread db/df/d14/d50/f71 [0,4194304] 0 2024-04-25T02:08:54.760 INFO:tasks.workunit.client.0.smithi077.stdout:1/791: fsync db/df/d14/d4d/d82/d32/fa2 0 2024-04-25T02:08:54.763 INFO:tasks.workunit.client.0.smithi077.stdout:8/852: rename d3/d7a/d7e to d3/da/db/df/ddc/d11a 0 2024-04-25T02:08:54.765 INFO:tasks.workunit.client.0.smithi077.stdout:3/769: symlink d0/d17/d4b/d59/l118 0 2024-04-25T02:08:54.765 INFO:tasks.workunit.client.0.smithi077.stdout:3/770: creat d0/d3e/d42/d64/d88/f119 x:0 0 0 2024-04-25T02:08:54.766 INFO:tasks.workunit.client.0.smithi077.stdout:8/853: creat d3/da/db/f11b x:0 0 0 2024-04-25T02:08:54.769 INFO:tasks.workunit.client.0.smithi077.stdout:5/765: dwrite d0/d25/d82/fa1 [0,4194304] 0 2024-04-25T02:08:54.769 INFO:tasks.workunit.client.0.smithi077.stdout:5/766: write d0/d2/d1b/f8a [798217,21714] 0 2024-04-25T02:08:54.769 INFO:tasks.workunit.client.0.smithi077.stdout:3/771: symlink d0/d3e/d62/l11a 0 2024-04-25T02:08:54.769 INFO:tasks.workunit.client.0.smithi077.stdout:3/772: dread - d0/d2/d2f/d50/f102 zero size 2024-04-25T02:08:54.769 INFO:tasks.workunit.client.0.smithi077.stdout:2/792: dwrite d2/d9/d18/d1b/ff9 [0,4194304] 0 2024-04-25T02:08:54.772 INFO:tasks.workunit.client.0.smithi077.stdout:5/767: creat d0/ff8 x:0 0 0 2024-04-25T02:08:54.772 INFO:tasks.workunit.client.0.smithi077.stdout:5/768: chown d0/d2/da8/ff5 4075500 1 2024-04-25T02:08:54.774 INFO:tasks.workunit.client.0.smithi077.stdout:4/790: dwrite d0/d14/d21/d39/da/fe3 [0,4194304] 0 2024-04-25T02:08:54.775 INFO:tasks.workunit.client.0.smithi077.stdout:4/791: read d0/d14/d21/d39/da/d12/d35/d3e/f2b [2696944,1785] 0 2024-04-25T02:08:54.775 INFO:tasks.workunit.client.0.smithi077.stdout:9/759: dwrite df/d80/fef [0,4194304] 0 2024-04-25T02:08:54.775 INFO:tasks.workunit.client.0.smithi077.stdout:2/793: dread d2/d9/f8e [0,4194304] 0 2024-04-25T02:08:54.775 INFO:tasks.workunit.client.0.smithi077.stdout:2/794: getdents d2/d9/d18/d31/d7c/df3 0 2024-04-25T02:08:54.778 INFO:tasks.workunit.client.0.smithi077.stdout:5/769: rmdir d0/d2/d3/d9 39 2024-04-25T02:08:54.778 INFO:tasks.workunit.client.0.smithi077.stdout:5/770: creat d0/d25/dc7/dca/ff9 x:0 0 0 2024-04-25T02:08:54.779 INFO:tasks.workunit.client.0.smithi077.stdout:8/854: write d3/da/d27/d16/d6b/f80 [3445524,121551] 0 2024-04-25T02:08:54.785 INFO:tasks.workunit.client.0.smithi077.stdout:0/755: dwrite d2/d8/db6/dd7/d105/f7e [0,4194304] 0 2024-04-25T02:08:54.787 INFO:tasks.workunit.client.0.smithi077.stdout:4/792: unlink d0/d14/d60/d62/f68 0 2024-04-25T02:08:54.788 INFO:tasks.workunit.client.0.smithi077.stdout:4/793: stat d0/d14 0 2024-04-25T02:08:54.789 INFO:tasks.workunit.client.0.smithi077.stdout:2/795: dread d2/d28/fde [0,4194304] 0 2024-04-25T02:08:54.789 INFO:tasks.workunit.client.0.smithi077.stdout:7/688: dwrite d4/d13/d5b/d8b/fde [4194304,4194304] 0 2024-04-25T02:08:54.789 INFO:tasks.workunit.client.0.smithi077.stdout:7/689: chown d4/d13/d18/d2d/cb8 15441 1 2024-04-25T02:08:54.789 INFO:tasks.workunit.client.0.smithi077.stdout:2/796: dread - d2/d9/d18/d31/d7c/f10b zero size 2024-04-25T02:08:54.792 INFO:tasks.workunit.client.0.smithi077.stdout:9/760: mkdir df/d1b/d56/d67/dff 0 2024-04-25T02:08:54.795 INFO:tasks.workunit.client.0.smithi077.stdout:8/855: mknod d3/da/db/c11c 0 2024-04-25T02:08:54.795 INFO:tasks.workunit.client.0.smithi077.stdout:3/773: dwrite d0/dd3/ff6 [0,4194304] 0 2024-04-25T02:08:54.799 INFO:tasks.workunit.client.0.smithi077.stdout:7/690: write d4/f50 [2572437,127531] 0 2024-04-25T02:08:54.801 INFO:tasks.workunit.client.0.smithi077.stdout:2/797: mkdir d2/d9/d19/d1c/d3f/d53/d86/db3/d110 0 2024-04-25T02:08:54.802 INFO:tasks.workunit.client.0.smithi077.stdout:5/771: dwrite d0/d2/d1b/f76 [0,4194304] 0 2024-04-25T02:08:54.803 INFO:tasks.workunit.client.0.smithi077.stdout:9/761: symlink df/d1b/d48/dee/l100 0 2024-04-25T02:08:54.803 INFO:tasks.workunit.client.0.smithi077.stdout:0/756: dwrite d2/d17/d1d/d34/d4c/da2/df5/f101 [0,4194304] 0 2024-04-25T02:08:54.807 INFO:tasks.workunit.client.0.smithi077.stdout:5/772: dread d0/d2/d3/d9/f2a [0,4194304] 0 2024-04-25T02:08:54.807 INFO:tasks.workunit.client.0.smithi077.stdout:5/773: dread - d0/d2/d3/d9/d90/fce zero size 2024-04-25T02:08:54.807 INFO:tasks.workunit.client.0.smithi077.stdout:5/774: chown d0/d25/d82/d87/d8b/da5/fd4 298 1 2024-04-25T02:08:54.807 INFO:tasks.workunit.client.0.smithi077.stdout:5/775: chown d0/d25/d82/d87/d8b/da5/dc4/d23/d4a/f74 15387 1 2024-04-25T02:08:54.807 INFO:tasks.workunit.client.0.smithi077.stdout:5/776: creat d0/d2/d3/ffa x:0 0 0 2024-04-25T02:08:54.807 INFO:tasks.workunit.client.0.smithi077.stdout:5/777: fdatasync d0/d25/f8c 0 2024-04-25T02:08:54.808 INFO:tasks.workunit.client.0.smithi077.stdout:3/774: mknod d0/d2/de/d36/da0/c11b 0 2024-04-25T02:08:54.808 INFO:tasks.workunit.client.0.smithi077.stdout:3/775: write d0/d3e/d62/f68 [3141951,29734] 0 2024-04-25T02:08:54.808 INFO:tasks.workunit.client.0.smithi077.stdout:3/776: read - d0/d2/de/d36/da0/fd1 zero size 2024-04-25T02:08:54.809 INFO:tasks.workunit.client.0.smithi077.stdout:4/794: mkdir d0/d14/d79/d104 0 2024-04-25T02:08:54.809 INFO:tasks.workunit.client.0.smithi077.stdout:4/795: stat d0/d14/d21/d39/da/d12/d35/d3e/fb2 0 2024-04-25T02:08:54.810 INFO:tasks.workunit.client.0.smithi077.stdout:7/691: mknod d4/d13/d18/d24/d3f/de9/cea 0 2024-04-25T02:08:54.810 INFO:tasks.workunit.client.0.smithi077.stdout:7/692: write d4/d7c/fd1 [359575,75360] 0 2024-04-25T02:08:54.814 INFO:tasks.workunit.client.0.smithi077.stdout:9/762: dread df/d1b/d48/d75/ff4 [0,4194304] 0 2024-04-25T02:08:54.816 INFO:tasks.workunit.client.0.smithi077.stdout:6/883: sync 2024-04-25T02:08:54.822 INFO:tasks.workunit.client.0.smithi077.stdout:5/778: creat d0/d25/d82/d87/d8b/da5/dc4/ffb x:0 0 0 2024-04-25T02:08:54.826 INFO:tasks.workunit.client.0.smithi077.stdout:4/796: link d0/d14/d21/d39/l9 d0/d14/d79/d104/l105 0 2024-04-25T02:08:54.826 INFO:tasks.workunit.client.0.smithi077.stdout:4/797: write d0/d14/d60/d62/ff4 [264125,24035] 0 2024-04-25T02:08:54.826 INFO:tasks.workunit.client.0.smithi077.stdout:4/798: chown d0/d14/d21/d39/da/d12/d35 225658 1 2024-04-25T02:08:54.826 INFO:tasks.workunit.client.0.smithi077.stdout:4/799: truncate d0/d14/d60/d86/d34/fbe 149762 0 2024-04-25T02:08:54.828 INFO:tasks.workunit.client.0.smithi077.stdout:7/693: unlink d4/lb0 0 2024-04-25T02:08:54.831 INFO:tasks.workunit.client.0.smithi077.stdout:5/779: creat d0/d25/dc7/dca/d3e/de7/ffc x:0 0 0 2024-04-25T02:08:54.831 INFO:tasks.workunit.client.0.smithi077.stdout:5/780: dread - d0/d2/d1b/d35/fab zero size 2024-04-25T02:08:54.836 INFO:tasks.workunit.client.0.smithi077.stdout:6/884: creat de/d12/d25/d121/f12c x:0 0 0 2024-04-25T02:08:54.838 INFO:tasks.workunit.client.0.smithi077.stdout:4/800: truncate d0/d14/d21/f26 2802263 0 2024-04-25T02:08:54.839 INFO:tasks.workunit.client.0.smithi077.stdout:2/798: dwrite d2/d9/d2f/f38 [0,4194304] 0 2024-04-25T02:08:54.839 INFO:tasks.workunit.client.0.smithi077.stdout:2/799: write d2/d9/d18/fa [1258566,92240] 0 2024-04-25T02:08:54.839 INFO:tasks.workunit.client.0.smithi077.stdout:2/800: fsync d2/f5 0 2024-04-25T02:08:54.841 INFO:tasks.workunit.client.0.smithi077.stdout:5/781: mknod d0/d2/d3/d9/cfd 0 2024-04-25T02:08:54.844 INFO:tasks.workunit.client.0.smithi077.stdout:6/885: truncate de/d12/d25/d38/f67 1455323 0 2024-04-25T02:08:54.844 INFO:tasks.workunit.client.0.smithi077.stdout:6/886: chown de/d53/d78/c92 1128 1 2024-04-25T02:08:54.844 INFO:tasks.workunit.client.0.smithi077.stdout:6/887: creat de/d53/d76/d10a/f12d x:0 0 0 2024-04-25T02:08:54.844 INFO:tasks.workunit.client.0.smithi077.stdout:6/888: dread - de/d3b/de8/f108 zero size 2024-04-25T02:08:54.846 INFO:tasks.workunit.client.0.smithi077.stdout:5/782: mknod d0/d2/d1b/d3b/cfe 0 2024-04-25T02:08:54.846 INFO:tasks.workunit.client.0.smithi077.stdout:5/783: dread - d0/d2/d1b/d35/fab zero size 2024-04-25T02:08:54.846 INFO:tasks.workunit.client.0.smithi077.stdout:4/801: dread d0/d14/d60/d86/d96/f66 [0,4194304] 0 2024-04-25T02:08:54.846 INFO:tasks.workunit.client.0.smithi077.stdout:4/802: write d0/d14/d60/d62/fe6 [133957,111837] 0 2024-04-25T02:08:54.849 INFO:tasks.workunit.client.0.smithi077.stdout:6/889: creat de/d5b/d125/f12e x:0 0 0 2024-04-25T02:08:54.849 INFO:tasks.workunit.client.0.smithi077.stdout:6/890: write de/d12/f1c [4284111,15083] 0 2024-04-25T02:08:54.849 INFO:tasks.workunit.client.0.smithi077.stdout:6/891: stat de/d12/d25/d3a/d6a/d113/l100 0 2024-04-25T02:08:54.851 INFO:tasks.workunit.client.0.smithi077.stdout:5/784: creat d0/d25/d82/d8d/fff x:0 0 0 2024-04-25T02:08:54.851 INFO:tasks.workunit.client.0.smithi077.stdout:0/757: dwrite d2/d8/dad/fd5 [0,4194304] 0 2024-04-25T02:08:54.851 INFO:tasks.workunit.client.0.smithi077.stdout:0/758: creat d2/d9/d2a/f106 x:0 0 0 2024-04-25T02:08:54.851 INFO:tasks.workunit.client.0.smithi077.stdout:5/785: getdents d0/d2/d3/d9/d90 0 2024-04-25T02:08:54.858 INFO:tasks.workunit.client.0.smithi077.stdout:8/856: dwrite d3/da/db/df/d2b/f72 [0,4194304] 0 2024-04-25T02:08:54.858 INFO:tasks.workunit.client.0.smithi077.stdout:8/857: chown d3/da/db/df/d2b/d37/ff4 793 1 2024-04-25T02:08:54.858 INFO:tasks.workunit.client.0.smithi077.stdout:3/777: dwrite d0/d3e/d62/f68 [0,4194304] 0 2024-04-25T02:08:54.862 INFO:tasks.workunit.client.0.smithi077.stdout:9/763: dwrite df/d60/d87/dca/fd9 [4194304,4194304] 0 2024-04-25T02:08:54.862 INFO:tasks.workunit.client.0.smithi077.stdout:7/694: dwrite d4/d13/d18/d2d/d30/f63 [0,4194304] 0 2024-04-25T02:08:54.862 INFO:tasks.workunit.client.0.smithi077.stdout:9/764: creat df/d1b/d70/d84/dde/de9/f101 x:0 0 0 2024-04-25T02:08:54.862 INFO:tasks.workunit.client.0.smithi077.stdout:9/765: fsync df/d1b/d56/d67/fc5 0 2024-04-25T02:08:54.863 INFO:tasks.workunit.client.0.smithi077.stdout:9/766: chown df/fd8 8935 1 2024-04-25T02:08:54.863 INFO:tasks.workunit.client.0.smithi077.stdout:6/892: write de/d53/f61 [1870639,58652] 0 2024-04-25T02:08:54.863 INFO:tasks.workunit.client.0.smithi077.stdout:6/893: chown de/d12/d25/d38/fb1 3 1 2024-04-25T02:08:54.866 INFO:tasks.workunit.client.0.smithi077.stdout:8/858: dread d3/d34/fa9 [0,4194304] 0 2024-04-25T02:08:54.869 INFO:tasks.workunit.client.0.smithi077.stdout:9/767: mknod df/d1b/d70/dc9/c102 0 2024-04-25T02:08:54.870 INFO:tasks.workunit.client.0.smithi077.stdout:0/759: dread d2/d17/d1d/d34/d4c/fa0 [0,4194304] 0 2024-04-25T02:08:54.870 INFO:tasks.workunit.client.0.smithi077.stdout:0/760: dread - d2/d17/d1d/d34/d83/f8d zero size 2024-04-25T02:08:54.874 INFO:tasks.workunit.client.0.smithi077.stdout:8/859: link d3/da/d27/d16/dbc/l73 d3/da/db/df/l11d 0 2024-04-25T02:08:54.874 INFO:tasks.workunit.client.0.smithi077.stdout:8/860: stat l1 0 2024-04-25T02:08:54.875 INFO:tasks.workunit.client.0.smithi077.stdout:7/695: write d4/d13/d18/d24/d3f/f44 [4062140,51971] 0 2024-04-25T02:08:54.875 INFO:tasks.workunit.client.0.smithi077.stdout:7/696: fsync d4/d13/d18/d24/d3f/d59/fc9 0 2024-04-25T02:08:54.877 INFO:tasks.workunit.client.0.smithi077.stdout:6/894: rmdir de/d12/dba 39 2024-04-25T02:08:54.877 INFO:tasks.workunit.client.0.smithi077.stdout:4/803: dwrite d0/d14/d21/d39/da/fb [4194304,4194304] 0 2024-04-25T02:08:54.879 INFO:tasks.workunit.client.0.smithi077.stdout:8/861: mknod d3/da/d27/d16/c11e 0 2024-04-25T02:08:54.879 INFO:tasks.workunit.client.0.smithi077.stdout:8/862: chown d3/da/db/df/c43 167721 1 2024-04-25T02:08:54.879 INFO:tasks.workunit.client.0.smithi077.stdout:2/801: dwrite d2/d78/d95/fe9 [0,4194304] 0 2024-04-25T02:08:54.880 INFO:tasks.workunit.client.0.smithi077.stdout:8/863: read d3/d7a/fa3 [1230,64717] 0 2024-04-25T02:08:54.880 INFO:tasks.workunit.client.0.smithi077.stdout:5/786: dwrite d0/f86 [0,4194304] 0 2024-04-25T02:08:54.880 INFO:tasks.workunit.client.0.smithi077.stdout:7/697: creat d4/d13/d18/d2d/d56/feb x:0 0 0 2024-04-25T02:08:54.881 INFO:tasks.workunit.client.0.smithi077.stdout:9/768: write df/d1b/d70/d84/dde/f89 [1337903,129677] 0 2024-04-25T02:08:54.884 INFO:tasks.workunit.client.0.smithi077.stdout:4/804: getdents d0/d14/d21/d39/d1d 0 2024-04-25T02:08:54.890 INFO:tasks.workunit.client.0.smithi077.stdout:5/787: getdents d0/d25/d82/d87/d8b/d5a/db4 0 2024-04-25T02:08:54.892 INFO:tasks.workunit.client.0.smithi077.stdout:7/698: link l3 d4/d13/d5b/d8b/lec 0 2024-04-25T02:08:54.892 INFO:tasks.workunit.client.0.smithi077.stdout:7/699: fdatasync d4/d13/d18/d2d/d30/f34 0 2024-04-25T02:08:54.892 INFO:tasks.workunit.client.0.smithi077.stdout:7/700: write d4/d13/d18/d2d/d30/f86 [1172825,71266] 0 2024-04-25T02:08:54.895 INFO:tasks.workunit.client.0.smithi077.stdout:0/761: rename d2/d8/d5f/d9f to d2/d17/d1d/d34/d4c/da2/d51/de8/d107 0 2024-04-25T02:08:54.895 INFO:tasks.workunit.client.0.smithi077.stdout:0/762: truncate d2/d17/d1d/d34/d4c/da2/f18 4229887 0 2024-04-25T02:08:54.895 INFO:tasks.workunit.client.0.smithi077.stdout:0/763: fsync d2/d17/d1d/f20 0 2024-04-25T02:08:54.900 INFO:tasks.workunit.client.0.smithi077.stdout:9/769: creat df/d1b/d56/d67/f103 x:0 0 0 2024-04-25T02:08:54.900 INFO:tasks.workunit.client.0.smithi077.stdout:9/770: fdatasync df/d60/d87/ff3 0 2024-04-25T02:08:54.900 INFO:tasks.workunit.client.0.smithi077.stdout:1/792: sync 2024-04-25T02:08:54.901 INFO:tasks.workunit.client.0.smithi077.stdout:6/895: dwrite de/d53/f61 [4194304,4194304] 0 2024-04-25T02:08:54.903 INFO:tasks.workunit.client.0.smithi077.stdout:4/805: creat d0/d14/d60/d86/d96/f106 x:0 0 0 2024-04-25T02:08:54.906 INFO:tasks.workunit.client.0.smithi077.stdout:5/788: truncate d0/d2/d1b/f76 2460918 0 2024-04-25T02:08:54.906 INFO:tasks.workunit.client.0.smithi077.stdout:5/789: readlink d0/l11 0 2024-04-25T02:08:54.907 INFO:tasks.workunit.client.0.smithi077.stdout:2/802: rename d2/d9/d2f/lda to d2/d9/ddc/l111 0 2024-04-25T02:08:54.914 INFO:tasks.workunit.client.0.smithi077.stdout:7/701: dwrite d4/d13/d18/f94 [0,4194304] 0 2024-04-25T02:08:54.914 INFO:tasks.workunit.client.0.smithi077.stdout:7/702: readlink d4/d13/d18/d24/d3f/d59/dd6/ldf 0 2024-04-25T02:08:54.914 INFO:tasks.workunit.client.0.smithi077.stdout:7/703: creat d4/d13/d18/fed x:0 0 0 2024-04-25T02:08:54.915 INFO:tasks.workunit.client.0.smithi077.stdout:8/864: rename d3/fc7 to d3/d81/f11f 0 2024-04-25T02:08:54.915 INFO:tasks.workunit.client.0.smithi077.stdout:4/806: write d0/d14/d21/d39/d9a/fb9 [3749577,89300] 0 2024-04-25T02:08:54.917 INFO:tasks.workunit.client.0.smithi077.stdout:2/803: creat d2/d9/d18/d31/def/f112 x:0 0 0 2024-04-25T02:08:54.917 INFO:tasks.workunit.client.0.smithi077.stdout:2/804: chown d2/d9/d19/d2c/f5b 41245 1 2024-04-25T02:08:54.919 INFO:tasks.workunit.client.0.smithi077.stdout:9/771: getdents df/d1b/d56/d67/d68 0 2024-04-25T02:08:54.924 INFO:tasks.workunit.client.0.smithi077.stdout:7/704: dread d4/d13/f3c [0,4194304] 0 2024-04-25T02:08:54.924 INFO:tasks.workunit.client.0.smithi077.stdout:7/705: fsync d4/d13/d18/d24/d3f/fdc 0 2024-04-25T02:08:54.925 INFO:tasks.workunit.client.0.smithi077.stdout:4/807: creat d0/d14/d79/d104/f107 x:0 0 0 2024-04-25T02:08:54.925 INFO:tasks.workunit.client.0.smithi077.stdout:2/805: creat d2/d9/d19/d1c/f113 x:0 0 0 2024-04-25T02:08:54.926 INFO:tasks.workunit.client.0.smithi077.stdout:9/772: unlink df/d1b/d56/d67/d68/ld4 0 2024-04-25T02:08:54.929 INFO:tasks.workunit.client.0.smithi077.stdout:2/806: creat d2/d9/d2f/d84/d90/dd4/f114 x:0 0 0 2024-04-25T02:08:54.929 INFO:tasks.workunit.client.0.smithi077.stdout:7/706: getdents d4/d13/d18/d2d/d56/d68 0 2024-04-25T02:08:54.929 INFO:tasks.workunit.client.0.smithi077.stdout:7/707: dread - d4/d13/d18/d2d/d30/dab/fe1 zero size 2024-04-25T02:08:54.930 INFO:tasks.workunit.client.0.smithi077.stdout:7/708: stat d4/d13/l25 0 2024-04-25T02:08:54.931 INFO:tasks.workunit.client.0.smithi077.stdout:2/807: rmdir d2/d9/d18/d1b/df5/dce 0 2024-04-25T02:08:54.932 INFO:tasks.workunit.client.0.smithi077.stdout:8/865: dread d3/da/d27/d16/f1c [0,4194304] 0 2024-04-25T02:08:54.933 INFO:tasks.workunit.client.0.smithi077.stdout:7/709: fdatasync d4/d13/d66/f83 0 2024-04-25T02:08:54.934 INFO:tasks.workunit.client.0.smithi077.stdout:2/808: truncate d2/d9/d19/d1c/f44 1554579 0 2024-04-25T02:08:54.936 INFO:tasks.workunit.client.0.smithi077.stdout:8/866: truncate d3/ff7 1102806 0 2024-04-25T02:08:54.937 INFO:tasks.workunit.client.0.smithi077.stdout:9/773: dread fc [0,4194304] 0 2024-04-25T02:08:54.937 INFO:tasks.workunit.client.0.smithi077.stdout:9/774: fsync df/d1b/d70/d74/f95 0 2024-04-25T02:08:54.937 INFO:tasks.workunit.client.0.smithi077.stdout:7/710: truncate d4/d13/d66/f8f 6590933 0 2024-04-25T02:08:54.941 INFO:tasks.workunit.client.0.smithi077.stdout:7/711: rename d4/d13/l98 to d4/d13/d18/d24/d3f/d59/lee 0 2024-04-25T02:08:54.941 INFO:tasks.workunit.client.0.smithi077.stdout:7/712: write d4/d13/d18/f36 [165301,42411] 0 2024-04-25T02:08:54.941 INFO:tasks.workunit.client.0.smithi077.stdout:7/713: write d4/d13/d66/fc1 [30720,23546] 0 2024-04-25T02:08:54.941 INFO:tasks.workunit.client.0.smithi077.stdout:7/714: fdatasync d4/f12 0 2024-04-25T02:08:54.944 INFO:tasks.workunit.client.0.smithi077.stdout:8/867: getdents d3/da/d27/d44/db1 0 2024-04-25T02:08:54.944 INFO:tasks.workunit.client.0.smithi077.stdout:0/764: dwrite d2/d27/d2d/dce/de7/da7/fe5 [0,4194304] 0 2024-04-25T02:08:54.944 INFO:tasks.workunit.client.0.smithi077.stdout:5/790: dwrite d0/d2/d1b/fb9 [0,4194304] 0 2024-04-25T02:08:54.945 INFO:tasks.workunit.client.0.smithi077.stdout:7/715: symlink d4/dd2/lef 0 2024-04-25T02:08:54.946 INFO:tasks.workunit.client.0.smithi077.stdout:8/868: truncate d3/da/d27/f3f 2416440 0 2024-04-25T02:08:54.946 INFO:tasks.workunit.client.0.smithi077.stdout:8/869: readlink d3/da/d27/d16/la7 0 2024-04-25T02:08:54.946 INFO:tasks.workunit.client.0.smithi077.stdout:8/870: chown d3/da/db/df/l11d 64204160 1 2024-04-25T02:08:55.055 INFO:tasks.workunit.client.0.smithi077.stdout:8/871: rmdir d3/da/d27/d44 39 2024-04-25T02:08:55.055 INFO:tasks.workunit.client.0.smithi077.stdout:1/793: dwrite db/fbb [0,4194304] 0 2024-04-25T02:08:55.057 INFO:tasks.workunit.client.0.smithi077.stdout:8/872: mkdir d3/da/d27/d16/d6b/d120 0 2024-04-25T02:08:55.059 INFO:tasks.workunit.client.0.smithi077.stdout:1/794: dread db/df/d1b/fcc [0,4194304] 0 2024-04-25T02:08:55.064 INFO:tasks.workunit.client.0.smithi077.stdout:7/716: dread d4/d13/d5b/f5d [0,4194304] 0 2024-04-25T02:08:55.064 INFO:tasks.workunit.client.0.smithi077.stdout:7/717: write d4/d13/d18/d2d/d56/d68/f9a [51251,108972] 0 2024-04-25T02:08:55.064 INFO:tasks.workunit.client.0.smithi077.stdout:7/718: fsync d4/d13/d66/f9b 0 2024-04-25T02:08:55.065 INFO:tasks.workunit.client.0.smithi077.stdout:7/719: chown d4/f16 1143753 1 2024-04-25T02:08:55.074 INFO:tasks.workunit.client.0.smithi077.stdout:6/896: dwrite de/d55/db7/f11c [0,4194304] 0 2024-04-25T02:08:55.077 INFO:tasks.workunit.client.0.smithi077.stdout:5/791: dwrite d0/d2/d1b/d35/f96 [0,4194304] 0 2024-04-25T02:08:55.077 INFO:tasks.workunit.client.0.smithi077.stdout:9/775: dwrite df/d1b/d48/f64 [8388608,4194304] 0 2024-04-25T02:08:55.088 INFO:tasks.workunit.client.0.smithi077.stdout:9/776: dread df/d1b/d56/d67/f78 [0,4194304] 0 2024-04-25T02:08:55.093 INFO:tasks.workunit.client.0.smithi077.stdout:4/808: dwrite d0/d14/d60/d62/fa8 [0,4194304] 0 2024-04-25T02:08:55.097 INFO:tasks.workunit.client.0.smithi077.stdout:2/809: dwrite d2/d78/fac [0,4194304] 0 2024-04-25T02:08:55.101 INFO:tasks.workunit.client.0.smithi077.stdout:8/873: truncate d3/da/db/df/d2b/f72 752997 0 2024-04-25T02:08:55.101 INFO:tasks.workunit.client.0.smithi077.stdout:8/874: creat d3/da/d27/d16/dbc/f121 x:0 0 0 2024-04-25T02:08:55.101 INFO:tasks.workunit.client.0.smithi077.stdout:8/875: stat d3/da/d27/f6c 0 2024-04-25T02:08:55.101 INFO:tasks.workunit.client.0.smithi077.stdout:8/876: write d3/da/d27/d44/db1/ff2 [858495,79053] 0 2024-04-25T02:08:55.103 INFO:tasks.workunit.client.0.smithi077.stdout:1/795: creat db/df/d14/dfa/db4/f10a x:0 0 0 2024-04-25T02:08:55.103 INFO:tasks.workunit.client.0.smithi077.stdout:1/796: chown db/df/d14/d4d/d82/d32/c7b 24 1 2024-04-25T02:08:55.115 INFO:tasks.workunit.client.0.smithi077.stdout:0/765: dwrite d2/d8/db6/dd7/de0/ff4 [0,4194304] 0 2024-04-25T02:08:55.115 INFO:tasks.workunit.client.0.smithi077.stdout:0/766: fsync d2/d17/d1d/d34/d4c/f9a 0 2024-04-25T02:08:55.115 INFO:tasks.workunit.client.0.smithi077.stdout:0/767: chown d2/d17/d1d/d34/d4c/da2/d51/de8/d107/ffc 16 1 2024-04-25T02:08:55.116 INFO:tasks.workunit.client.0.smithi077.stdout:5/792: rmdir d0/d25/d82/d87/d8b/da5/dc4/d23/d4a 39 2024-04-25T02:08:55.118 INFO:tasks.workunit.client.0.smithi077.stdout:9/777: rename df/f26 to df/d1b/d70/d74/f104 0 2024-04-25T02:08:55.118 INFO:tasks.workunit.client.0.smithi077.stdout:9/778: fsync df/d60/d87/ff3 0 2024-04-25T02:08:55.119 INFO:tasks.workunit.client.0.smithi077.stdout:6/897: dwrite f9 [0,4194304] 0 2024-04-25T02:08:55.119 INFO:tasks.workunit.client.0.smithi077.stdout:2/810: dwrite d2/d59/f6e [0,4194304] 0 2024-04-25T02:08:55.121 INFO:tasks.workunit.client.0.smithi077.stdout:4/809: mkdir d0/d14/d60/d62/d108 0 2024-04-25T02:08:55.121 INFO:tasks.workunit.client.0.smithi077.stdout:4/810: chown d0/d14/d21/d39/d1d/fbf 34190 1 2024-04-25T02:08:55.126 INFO:tasks.workunit.client.0.smithi077.stdout:1/797: creat db/df/d14/d4d/da9/f10b x:0 0 0 2024-04-25T02:08:55.126 INFO:tasks.workunit.client.0.smithi077.stdout:1/798: chown db/df/f1d 133815 1 2024-04-25T02:08:55.127 INFO:tasks.workunit.client.0.smithi077.stdout:2/811: dread d2/d9/d18/d31/d7c/fe6 [0,4194304] 0 2024-04-25T02:08:55.128 INFO:tasks.workunit.client.0.smithi077.stdout:2/812: read - d2/d9/d19/f34 zero size 2024-04-25T02:08:55.128 INFO:tasks.workunit.client.0.smithi077.stdout:2/813: read - d2/d9/d2f/f102 zero size 2024-04-25T02:08:55.130 INFO:tasks.workunit.client.0.smithi077.stdout:0/768: mkdir d2/d27/d2d/dce/de7/da7/d108 0 2024-04-25T02:08:55.132 INFO:tasks.workunit.client.0.smithi077.stdout:5/793: truncate d0/d25/f30 8274887 0 2024-04-25T02:08:55.132 INFO:tasks.workunit.client.0.smithi077.stdout:5/794: truncate d0/d2/d3/d9/d39/d3c/dc6/ff4 183869 0 2024-04-25T02:08:55.132 INFO:tasks.workunit.client.0.smithi077.stdout:5/795: stat d0/d25/d82/d87/d8b/da5/dc4/f3f 0 2024-04-25T02:08:55.132 INFO:tasks.workunit.client.0.smithi077.stdout:5/796: chown d0/d2/d3/d9/d39/d44/d5f 25 1 2024-04-25T02:08:55.132 INFO:tasks.workunit.client.0.smithi077.stdout:5/797: readlink d0/d25/d82/d87/d8b/da5/dc4/la9 0 2024-04-25T02:08:55.133 INFO:tasks.workunit.client.0.smithi077.stdout:1/799: dread db/df/d14/d4d/fed [0,4194304] 0 2024-04-25T02:08:55.134 INFO:tasks.workunit.client.0.smithi077.stdout:8/877: rename d3/d34/dc9/dcb to d3/d34/d122 0 2024-04-25T02:08:55.135 INFO:tasks.workunit.client.0.smithi077.stdout:9/779: getdents df/d1b/d48/d75/d77 0 2024-04-25T02:08:55.135 INFO:tasks.workunit.client.0.smithi077.stdout:9/780: creat df/d1b/d70/d74/f105 x:0 0 0 2024-04-25T02:08:55.135 INFO:tasks.workunit.client.0.smithi077.stdout:9/781: dread - df/d1b/d70/d84/dde/fe4 zero size 2024-04-25T02:08:55.136 INFO:tasks.workunit.client.0.smithi077.stdout:6/898: write de/d12/d25/d4b/dd1/f10c [948004,86910] 0 2024-04-25T02:08:55.137 INFO:tasks.workunit.client.0.smithi077.stdout:4/811: symlink d0/d14/d60/dff/l109 0 2024-04-25T02:08:55.139 INFO:tasks.workunit.client.0.smithi077.stdout:0/769: mknod d2/d17/d1d/d34/d4c/da2/df5/c109 0 2024-04-25T02:08:55.139 INFO:tasks.workunit.client.0.smithi077.stdout:3/778: sync 2024-04-25T02:08:55.139 INFO:tasks.workunit.client.0.smithi077.stdout:2/814: write d2/d9/d19/d1c/ff8 [865577,123065] 0 2024-04-25T02:08:55.139 INFO:tasks.workunit.client.0.smithi077.stdout:2/815: chown d2/d9/d2f/f38 0 1 2024-04-25T02:08:55.139 INFO:tasks.workunit.client.0.smithi077.stdout:2/816: fdatasync d2/d9/d18/d31/d7c/fdf 0 2024-04-25T02:08:55.139 INFO:tasks.workunit.client.0.smithi077.stdout:0/770: write d2/d17/d1d/d34/d4c/da2/d51/de8/d107/fec [1771557,120085] 0 2024-04-25T02:08:55.139 INFO:tasks.workunit.client.0.smithi077.stdout:0/771: fdatasync d2/d27/ff7 0 2024-04-25T02:08:55.139 INFO:tasks.workunit.client.0.smithi077.stdout:0/772: chown d2/d8/db6/dd7/d105/f4f 7 1 2024-04-25T02:08:55.139 INFO:tasks.workunit.client.0.smithi077.stdout:5/798: mknod d0/d2/d1b/d38/c100 0 2024-04-25T02:08:55.140 INFO:tasks.workunit.client.0.smithi077.stdout:5/799: creat d0/d25/d82/f101 x:0 0 0 2024-04-25T02:08:55.142 INFO:tasks.workunit.client.0.smithi077.stdout:8/878: rename d3/c9 to d3/da/db/df/ddc/c123 0 2024-04-25T02:08:55.142 INFO:tasks.workunit.client.0.smithi077.stdout:8/879: getdents d3/da/db/df/d2b/d70/d10f 0 2024-04-25T02:08:55.142 INFO:tasks.workunit.client.0.smithi077.stdout:8/880: write d3/da/db/df/ddc/f117 [798780,108419] 0 2024-04-25T02:08:55.149 INFO:tasks.workunit.client.0.smithi077.stdout:3/779: link d0/d2/de/d36/c100 d0/d17/dd4/c11c 0 2024-04-25T02:08:55.150 INFO:tasks.workunit.client.0.smithi077.stdout:5/800: dread d0/d25/d82/d87/d8b/da5/dc4/d23/d4a/f74 [0,4194304] 0 2024-04-25T02:08:55.150 INFO:tasks.workunit.client.0.smithi077.stdout:5/801: dread - d0/d2/d1b/d35/fab zero size 2024-04-25T02:08:55.151 INFO:tasks.workunit.client.0.smithi077.stdout:2/817: rmdir d2/d9/d2f 39 2024-04-25T02:08:55.153 INFO:tasks.workunit.client.0.smithi077.stdout:0/773: mknod d2/d17/d1d/d34/d4c/da2/df5/c10a 0 2024-04-25T02:08:55.155 INFO:tasks.workunit.client.0.smithi077.stdout:1/800: mknod db/df/d14/c10c 0 2024-04-25T02:08:55.157 INFO:tasks.workunit.client.0.smithi077.stdout:9/782: creat df/d1b/d56/d67/d68/db3/f106 x:0 0 0 2024-04-25T02:08:55.161 INFO:tasks.workunit.client.0.smithi077.stdout:1/801: creat db/df/d14/f10d x:0 0 0 2024-04-25T02:08:55.161 INFO:tasks.workunit.client.0.smithi077.stdout:1/802: fsync db/df/d14/d3e/daa/fb6 0 2024-04-25T02:08:55.163 INFO:tasks.workunit.client.0.smithi077.stdout:9/783: symlink df/d1b/d48/dee/l107 0 2024-04-25T02:08:55.163 INFO:tasks.workunit.client.0.smithi077.stdout:9/784: stat df/d1b/d48/dee/l100 0 2024-04-25T02:08:55.163 INFO:tasks.workunit.client.0.smithi077.stdout:9/785: truncate df/d1b/d48/d75/d90/fb2 5961749 0 2024-04-25T02:08:55.163 INFO:tasks.workunit.client.0.smithi077.stdout:9/786: creat df/d1b/d70/d84/f108 x:0 0 0 2024-04-25T02:08:55.164 INFO:tasks.workunit.client.0.smithi077.stdout:5/802: rmdir d0/d2/d1b/d35 39 2024-04-25T02:08:55.167 INFO:tasks.workunit.client.0.smithi077.stdout:4/812: dwrite d0/d14/d21/d39/da/d12/d35/d3e/d3a/fcd [0,4194304] 0 2024-04-25T02:08:55.167 INFO:tasks.workunit.client.0.smithi077.stdout:4/813: write d0/f18 [5196373,1983] 0 2024-04-25T02:08:55.167 INFO:tasks.workunit.client.0.smithi077.stdout:4/814: chown d0/d14/d60/d86/d25 17112137 1 2024-04-25T02:08:55.168 INFO:tasks.workunit.client.0.smithi077.stdout:1/803: dread db/df/d14/d3e/f64 [0,4194304] 0 2024-04-25T02:08:55.169 INFO:tasks.workunit.client.0.smithi077.stdout:1/804: readlink db/df/d14/d4d/d82/d5c/d81/l9d 0 2024-04-25T02:08:55.169 INFO:tasks.workunit.client.0.smithi077.stdout:1/805: write db/d26/fd8 [4381435,18916] 0 2024-04-25T02:08:55.179 INFO:tasks.workunit.client.0.smithi077.stdout:9/787: unlink df/d1b/d48/d75/d77/ff9 0 2024-04-25T02:08:55.179 INFO:tasks.workunit.client.0.smithi077.stdout:9/788: read - df/d1b/d48/d75/d77/f7f zero size 2024-04-25T02:08:55.179 INFO:tasks.workunit.client.0.smithi077.stdout:9/789: chown df/f44 25 1 2024-04-25T02:08:55.180 INFO:tasks.workunit.client.0.smithi077.stdout:5/803: getdents d0/d25/d82/d87/d8b/da5/dc4/d41 0 2024-04-25T02:08:55.180 INFO:tasks.workunit.client.0.smithi077.stdout:5/804: fsync d0/d2/da8/daf/fd9 0 2024-04-25T02:08:55.181 INFO:tasks.workunit.client.0.smithi077.stdout:0/774: rmdir d2 39 2024-04-25T02:08:55.184 INFO:tasks.workunit.client.0.smithi077.stdout:8/881: dwrite d3/f4 [0,4194304] 0 2024-04-25T02:08:55.184 INFO:tasks.workunit.client.0.smithi077.stdout:6/899: dwrite de/d12/fa7 [0,4194304] 0 2024-04-25T02:08:55.184 INFO:tasks.workunit.client.0.smithi077.stdout:6/900: chown de/d12/d25/d3a/d6a/dcd/d36/dd2/l8e 2 1 2024-04-25T02:08:55.185 INFO:tasks.workunit.client.0.smithi077.stdout:6/901: write de/d12/d25/d3a/d6a/dcd/f119 [862623,15549] 0 2024-04-25T02:08:55.185 INFO:tasks.workunit.client.0.smithi077.stdout:3/780: dwrite d0/d3e/d62/f68 [4194304,4194304] 0 2024-04-25T02:08:55.186 INFO:tasks.workunit.client.0.smithi077.stdout:2/818: dwrite d2/d28/fd8 [0,4194304] 0 2024-04-25T02:08:55.187 INFO:tasks.workunit.client.0.smithi077.stdout:1/806: rename db/df/d14/d4d/d82/d5c/d81/f86 to db/df/d56/d5d/f10e 0 2024-04-25T02:08:55.187 INFO:tasks.workunit.client.0.smithi077.stdout:1/807: truncate db/df/d14/d4d/d82/d32/d8f/ff5 108081 0 2024-04-25T02:08:55.190 INFO:tasks.workunit.client.0.smithi077.stdout:0/775: creat d2/d17/d1d/d34/d4c/da2/dae/f10b x:0 0 0 2024-04-25T02:08:55.191 INFO:tasks.workunit.client.0.smithi077.stdout:8/882: truncate d3/ff7 123432 0 2024-04-25T02:08:55.196 INFO:tasks.workunit.client.0.smithi077.stdout:3/781: creat d0/d3e/d62/dba/f11d x:0 0 0 2024-04-25T02:08:55.210 INFO:tasks.workunit.client.0.smithi077.stdout:9/790: rename df/d1b/d48/d75/d77 to df/d60/d109 0 2024-04-25T02:08:55.211 INFO:tasks.workunit.client.0.smithi077.stdout:8/883: mkdir d3/da/db/df/ddc/ddf/d124 0 2024-04-25T02:08:55.212 INFO:tasks.workunit.client.0.smithi077.stdout:8/884: mkdir d3/da/d125 0 2024-04-25T02:08:55.213 INFO:tasks.workunit.client.0.smithi077.stdout:8/885: read d3/da/d27/d44/fad [766470,68680] 0 2024-04-25T02:08:55.222 INFO:tasks.workunit.client.0.smithi077.stdout:6/902: dwrite de/d12/dba/f11a [0,4194304] 0 2024-04-25T02:08:55.222 INFO:tasks.workunit.client.0.smithi077.stdout:2/819: dwrite d2/d78/d95/ff2 [0,4194304] 0 2024-04-25T02:08:55.222 INFO:tasks.workunit.client.0.smithi077.stdout:1/808: dwrite db/fbb [0,4194304] 0 2024-04-25T02:08:55.228 INFO:tasks.workunit.client.0.smithi077.stdout:1/809: dread db/df/d1b/f6f [0,4194304] 0 2024-04-25T02:08:55.231 INFO:tasks.workunit.client.0.smithi077.stdout:1/810: mkdir db/df/d14/d4d/d82/d10f 0 2024-04-25T02:08:55.233 INFO:tasks.workunit.client.0.smithi077.stdout:1/811: link db/df/d14/d4d/d82/d5c/d81/c8c db/df/d1b/c110 0 2024-04-25T02:08:55.233 INFO:tasks.workunit.client.0.smithi077.stdout:1/812: write db/df/d14/d3e/d69/dad/fdc [142714,42502] 0 2024-04-25T02:08:55.234 INFO:tasks.workunit.client.0.smithi077.stdout:1/813: truncate db/df/f20 4376630 0 2024-04-25T02:08:55.234 INFO:tasks.workunit.client.0.smithi077.stdout:9/791: dwrite df/fa2 [0,4194304] 0 2024-04-25T02:08:55.235 INFO:tasks.workunit.client.0.smithi077.stdout:6/903: read de/d12/d25/d38/f75 [545478,70067] 0 2024-04-25T02:08:55.235 INFO:tasks.workunit.client.0.smithi077.stdout:6/904: chown de/d55/dc2/fff 1707 1 2024-04-25T02:08:55.235 INFO:tasks.workunit.client.0.smithi077.stdout:1/814: mknod db/df/d56/d5d/d77/db3/c111 0 2024-04-25T02:08:55.238 INFO:tasks.workunit.client.0.smithi077.stdout:9/792: rename df/d1b/d70/c8f to df/d1b/c10a 0 2024-04-25T02:08:55.239 INFO:tasks.workunit.client.0.smithi077.stdout:9/793: mkdir df/d1b/d48/dee/d10b 0 2024-04-25T02:08:55.248 INFO:tasks.workunit.client.0.smithi077.stdout:8/886: dwrite d3/da/d27/d16/feb [0,4194304] 0 2024-04-25T02:08:55.249 INFO:tasks.workunit.client.0.smithi077.stdout:8/887: stat d3/da/d27/f76 0 2024-04-25T02:08:55.250 INFO:tasks.workunit.client.0.smithi077.stdout:6/905: read de/d12/d25/d3a/d6a/fef [3800291,30616] 0 2024-04-25T02:08:55.252 INFO:tasks.workunit.client.0.smithi077.stdout:8/888: mkdir d3/d81/d86/d126 0 2024-04-25T02:08:55.254 INFO:tasks.workunit.client.0.smithi077.stdout:2/820: dwrite d2/d9/d56/fed [0,4194304] 0 2024-04-25T02:08:55.255 INFO:tasks.workunit.client.0.smithi077.stdout:8/889: symlink d3/da/d27/d16/db3/l127 0 2024-04-25T02:08:55.255 INFO:tasks.workunit.client.0.smithi077.stdout:8/890: dread - d3/da/db/df/ddc/d11a/db0/ff6 zero size 2024-04-25T02:08:55.255 INFO:tasks.workunit.client.0.smithi077.stdout:8/891: dread - d3/da/d27/fbd zero size 2024-04-25T02:08:55.257 INFO:tasks.workunit.client.0.smithi077.stdout:2/821: rmdir d2/d9/d2f/d84/d90 39 2024-04-25T02:08:55.257 INFO:tasks.workunit.client.0.smithi077.stdout:2/822: chown d2/d9/d19/d1c/d37/dcb/f10d 11928 1 2024-04-25T02:08:55.258 INFO:tasks.workunit.client.0.smithi077.stdout:8/892: mkdir d3/d34/dc9/d128 0 2024-04-25T02:08:55.258 INFO:tasks.workunit.client.0.smithi077.stdout:8/893: truncate d3/da/db/df/d30/f110 933067 0 2024-04-25T02:08:55.260 INFO:tasks.workunit.client.0.smithi077.stdout:2/823: mknod d2/d9/ddc/dad/c115 0 2024-04-25T02:08:55.262 INFO:tasks.workunit.client.0.smithi077.stdout:8/894: creat d3/d34/dc9/f129 x:0 0 0 2024-04-25T02:08:55.262 INFO:tasks.workunit.client.0.smithi077.stdout:8/895: creat d3/da/d27/d16/dbc/f12a x:0 0 0 2024-04-25T02:08:55.262 INFO:tasks.workunit.client.0.smithi077.stdout:8/896: chown d3/da/d27/d16/dbc/fd5 5709 1 2024-04-25T02:08:55.263 INFO:tasks.workunit.client.0.smithi077.stdout:2/824: rmdir d2/d9/d19/d1c/d3f/d53 39 2024-04-25T02:08:55.263 INFO:tasks.workunit.client.0.smithi077.stdout:2/825: write d2/d78/d95/f105 [662975,66236] 0 2024-04-25T02:08:55.265 INFO:tasks.workunit.client.0.smithi077.stdout:1/815: dwrite db/df/d56/d5d/fd6 [0,4194304] 0 2024-04-25T02:08:55.265 INFO:tasks.workunit.client.0.smithi077.stdout:1/816: read - db/df/d14/d4d/d82/d5c/fc5 zero size 2024-04-25T02:08:55.265 INFO:tasks.workunit.client.0.smithi077.stdout:2/826: mknod d2/d59/d79/c116 0 2024-04-25T02:08:55.265 INFO:tasks.workunit.client.0.smithi077.stdout:2/827: write d2/fdb [342027,46738] 0 2024-04-25T02:08:55.266 INFO:tasks.workunit.client.0.smithi077.stdout:9/794: dwrite df/d80/fef [0,4194304] 0 2024-04-25T02:08:55.271 INFO:tasks.workunit.client.0.smithi077.stdout:1/817: rename db/df/d14/d4d/d82/d42/fb1 to db/df/d14/d50/f112 0 2024-04-25T02:08:55.271 INFO:tasks.workunit.client.0.smithi077.stdout:1/818: readlink db/df/d14/d4d/d82/d5c/la7 0 2024-04-25T02:08:55.271 INFO:tasks.workunit.client.0.smithi077.stdout:1/819: truncate db/df/d14/d4d/da9/f10b 87678 0 2024-04-25T02:08:55.271 INFO:tasks.workunit.client.0.smithi077.stdout:1/820: chown db/df/d1b/c110 16508 1 2024-04-25T02:08:55.272 INFO:tasks.workunit.client.0.smithi077.stdout:2/828: symlink d2/d59/d79/db4/dfc/l117 0 2024-04-25T02:08:55.273 INFO:tasks.workunit.client.0.smithi077.stdout:9/795: mknod df/d1b/d56/d67/dff/c10c 0 2024-04-25T02:08:55.275 INFO:tasks.workunit.client.0.smithi077.stdout:1/821: symlink db/df/d14/d4d/d82/d42/l113 0 2024-04-25T02:08:55.276 INFO:tasks.workunit.client.0.smithi077.stdout:6/906: dwrite de/d55/f126 [0,4194304] 0 2024-04-25T02:08:55.277 INFO:tasks.workunit.client.0.smithi077.stdout:9/796: symlink df/d1b/d48/d75/l10d 0 2024-04-25T02:08:55.277 INFO:tasks.workunit.client.0.smithi077.stdout:9/797: fdatasync df/d1b/f6e 0 2024-04-25T02:08:55.277 INFO:tasks.workunit.client.0.smithi077.stdout:8/897: write d3/da/db/df/d2b/d37/f4d [3747407,58912] 0 2024-04-25T02:08:55.278 INFO:tasks.workunit.client.0.smithi077.stdout:1/822: rename db/df/d14/d3e/d69/ce5 to db/df/d14/d4d/d82/d5c/d81/c114 0 2024-04-25T02:08:55.283 INFO:tasks.workunit.client.0.smithi077.stdout:6/907: dread de/d12/d25/d3a/d6a/dcd/f50 [0,4194304] 0 2024-04-25T02:08:55.283 INFO:tasks.workunit.client.0.smithi077.stdout:6/908: readlink de/d3b/l80 0 2024-04-25T02:08:55.288 INFO:tasks.workunit.client.0.smithi077.stdout:1/823: truncate db/df/d14/d4d/d82/d32/fa2 872145 0 2024-04-25T02:08:55.290 INFO:tasks.workunit.client.0.smithi077.stdout:6/909: truncate de/d12/f28 721926 0 2024-04-25T02:08:55.290 INFO:tasks.workunit.client.0.smithi077.stdout:6/910: truncate de/d12/d25/d38/fb1 430549 0 2024-04-25T02:08:55.290 INFO:tasks.workunit.client.0.smithi077.stdout:6/911: dread - de/d55/db7/f10b zero size 2024-04-25T02:08:55.290 INFO:tasks.workunit.client.0.smithi077.stdout:6/912: chown de/d5b/da6/cbb 1484951164 1 2024-04-25T02:08:55.290 INFO:tasks.workunit.client.0.smithi077.stdout:6/913: chown de/d12/f118 0 1 2024-04-25T02:08:55.291 INFO:tasks.workunit.client.0.smithi077.stdout:8/898: dread d3/f6f [0,4194304] 0 2024-04-25T02:08:55.291 INFO:tasks.workunit.client.0.smithi077.stdout:1/824: symlink db/df/d56/d5d/d77/db3/l115 0 2024-04-25T02:08:55.293 INFO:tasks.workunit.client.0.smithi077.stdout:2/829: dwrite d2/d9/d19/d1c/d3f/d53/f68 [0,4194304] 0 2024-04-25T02:08:55.293 INFO:tasks.workunit.client.0.smithi077.stdout:2/830: dread - d2/d9/d2f/f102 zero size 2024-04-25T02:08:55.296 INFO:tasks.workunit.client.0.smithi077.stdout:6/914: unlink de/d12/d25/d3a/d6a/dcd/d36/dd2/l51 0 2024-04-25T02:08:55.298 INFO:tasks.workunit.client.0.smithi077.stdout:8/899: creat d3/da/d27/d16/f12b x:0 0 0 2024-04-25T02:08:55.298 INFO:tasks.workunit.client.0.smithi077.stdout:8/900: chown d3/da/db/df/l49 132747 1 2024-04-25T02:08:55.299 INFO:tasks.workunit.client.0.smithi077.stdout:1/825: symlink db/df/d14/d4d/da9/de4/l116 0 2024-04-25T02:08:55.300 INFO:tasks.workunit.client.0.smithi077.stdout:1/826: chown db/df/d1b/c110 133705510 1 2024-04-25T02:08:55.300 INFO:tasks.workunit.client.0.smithi077.stdout:1/827: write db/df/d14/dfa/db4/fe8 [5065627,67448] 0 2024-04-25T02:08:55.303 INFO:tasks.workunit.client.0.smithi077.stdout:2/831: mkdir d2/d9/d19/d1c/d37/dcb/d118 0 2024-04-25T02:08:55.303 INFO:tasks.workunit.client.0.smithi077.stdout:2/832: dread - d2/d9/d19/d1c/d3f/d53/d86/dca/ffb zero size 2024-04-25T02:08:55.303 INFO:tasks.workunit.client.0.smithi077.stdout:2/833: write d2/d9/ddc/dc4/f66 [1927479,123405] 0 2024-04-25T02:08:55.303 INFO:tasks.workunit.client.0.smithi077.stdout:2/834: chown d2/d9/ddc/dad 168312161 1 2024-04-25T02:08:55.306 INFO:tasks.workunit.client.0.smithi077.stdout:6/915: mkdir de/d12/d25/d121/d12f 0 2024-04-25T02:08:55.309 INFO:tasks.workunit.client.0.smithi077.stdout:2/835: rename d2/d9/ddc/dad/d10e to d2/d9/d19/d1c/d3f/d53/d119 0 2024-04-25T02:08:55.309 INFO:tasks.workunit.client.0.smithi077.stdout:1/828: dread db/df/f20 [0,4194304] 0 2024-04-25T02:08:55.309 INFO:tasks.workunit.client.0.smithi077.stdout:9/798: write df/f37 [2751616,20178] 0 2024-04-25T02:08:55.312 INFO:tasks.workunit.client.0.smithi077.stdout:2/836: rename d2/d9/d19/d1c/d37/c58 to d2/d9/d2f/c11a 0 2024-04-25T02:08:55.313 INFO:tasks.workunit.client.0.smithi077.stdout:7/720: sync 2024-04-25T02:08:55.313 INFO:tasks.workunit.client.0.smithi077.stdout:8/901: dwrite d3/da/d27/d16/dbc/f102 [0,4194304] 0 2024-04-25T02:08:55.313 INFO:tasks.workunit.client.0.smithi077.stdout:8/902: chown d3/da/db/df/c43 28650 1 2024-04-25T02:08:55.314 INFO:tasks.workunit.client.0.smithi077.stdout:8/903: readlink d3/da/db/df/d2b/d70/lec 0 2024-04-25T02:08:55.314 INFO:tasks.workunit.client.0.smithi077.stdout:1/829: symlink db/df/d14/d3e/daa/deb/l117 0 2024-04-25T02:08:55.315 INFO:tasks.workunit.client.0.smithi077.stdout:9/799: symlink df/d1b/d70/l10e 0 2024-04-25T02:08:55.316 INFO:tasks.workunit.client.0.smithi077.stdout:9/800: read df/d1b/d48/d75/ff4 [536743,85098] 0 2024-04-25T02:08:55.316 INFO:tasks.workunit.client.0.smithi077.stdout:1/830: read db/df/d14/dfa/f55 [135350,121941] 0 2024-04-25T02:08:55.317 INFO:tasks.workunit.client.0.smithi077.stdout:8/904: dread d3/da/d27/d16/f66 [0,4194304] 0 2024-04-25T02:08:55.317 INFO:tasks.workunit.client.0.smithi077.stdout:8/905: dread - d3/da/db/df/f111 zero size 2024-04-25T02:08:55.317 INFO:tasks.workunit.client.0.smithi077.stdout:2/837: mknod d2/d9/ddc/c11b 0 2024-04-25T02:08:55.317 INFO:tasks.workunit.client.0.smithi077.stdout:2/838: readlink d2/d9/d2f/l35 0 2024-04-25T02:08:55.319 INFO:tasks.workunit.client.0.smithi077.stdout:1/831: dread db/df/d1b/fcc [0,4194304] 0 2024-04-25T02:08:55.326 INFO:tasks.workunit.client.0.smithi077.stdout:9/801: mkdir df/d1b/d48/d75/d90/d10f 0 2024-04-25T02:08:55.326 INFO:tasks.workunit.client.0.smithi077.stdout:6/916: dwrite f9 [0,4194304] 0 2024-04-25T02:08:55.327 INFO:tasks.workunit.client.0.smithi077.stdout:8/906: rename d3/da/db/c36 to d3/d34/c12c 0 2024-04-25T02:08:55.327 INFO:tasks.workunit.client.0.smithi077.stdout:8/907: fdatasync d3/da/db/df/d2b/d37/f69 0 2024-04-25T02:08:55.328 INFO:tasks.workunit.client.0.smithi077.stdout:2/839: mkdir d2/d78/d95/d11c 0 2024-04-25T02:08:55.329 INFO:tasks.workunit.client.0.smithi077.stdout:1/832: symlink db/df/d56/d5d/l118 0 2024-04-25T02:08:55.330 INFO:tasks.workunit.client.0.smithi077.stdout:7/721: link c2 d4/d13/d2c/cf0 0 2024-04-25T02:08:55.330 INFO:tasks.workunit.client.0.smithi077.stdout:7/722: fsync d4/d13/d18/fcd 0 2024-04-25T02:08:55.331 INFO:tasks.workunit.client.0.smithi077.stdout:9/802: truncate df/f3c 2845080 0 2024-04-25T02:08:55.334 INFO:tasks.workunit.client.0.smithi077.stdout:8/908: chown d3/da/db/df/d2b/c7d 526112220 1 2024-04-25T02:08:55.334 INFO:tasks.workunit.client.0.smithi077.stdout:7/723: dread d4/f37 [0,4194304] 0 2024-04-25T02:08:55.336 INFO:tasks.workunit.client.0.smithi077.stdout:2/840: truncate d2/d78/d95/ff2 3598271 0 2024-04-25T02:08:55.336 INFO:tasks.workunit.client.0.smithi077.stdout:2/841: fdatasync d2/d9/d2f/d84/d90/dd4/fe0 0 2024-04-25T02:08:55.336 INFO:tasks.workunit.client.0.smithi077.stdout:2/842: fsync d2/d9/d56/f104 0 2024-04-25T02:08:55.336 INFO:tasks.workunit.client.0.smithi077.stdout:2/843: fsync d2/d9/d19/d1c/f33 0 2024-04-25T02:08:55.339 INFO:tasks.workunit.client.0.smithi077.stdout:2/844: dread d2/d9/d19/d1c/f44 [0,4194304] 0 2024-04-25T02:08:55.339 INFO:tasks.workunit.client.0.smithi077.stdout:2/845: dread - d2/d9/d56/fee zero size 2024-04-25T02:08:55.339 INFO:tasks.workunit.client.0.smithi077.stdout:6/917: dread de/d12/d25/f83 [0,4194304] 0 2024-04-25T02:08:55.339 INFO:tasks.workunit.client.0.smithi077.stdout:6/918: creat de/d12/d25/d38/f130 x:0 0 0 2024-04-25T02:08:55.339 INFO:tasks.workunit.client.0.smithi077.stdout:6/919: chown de/d12/d25/d3a 1042509017 1 2024-04-25T02:08:55.339 INFO:tasks.workunit.client.0.smithi077.stdout:7/724: dread d4/d13/d18/fe4 [0,4194304] 0 2024-04-25T02:08:55.340 INFO:tasks.workunit.client.0.smithi077.stdout:4/815: sync 2024-04-25T02:08:55.340 INFO:tasks.workunit.client.0.smithi077.stdout:4/816: write d0/d14/d60/d86/d96/f106 [199793,119565] 0 2024-04-25T02:08:55.340 INFO:tasks.workunit.client.0.smithi077.stdout:4/817: truncate d0/d14/d60/d86/d25/f7f 152384 0 2024-04-25T02:08:55.340 INFO:tasks.workunit.client.0.smithi077.stdout:8/909: chown d3/da/db/df/d2b/lbf 963087306 1 2024-04-25T02:08:55.341 INFO:tasks.workunit.client.0.smithi077.stdout:2/846: creat d2/d9/d56/f11d x:0 0 0 2024-04-25T02:08:55.343 INFO:tasks.workunit.client.0.smithi077.stdout:9/803: write df/d60/d87/dca/fd9 [3780791,51943] 0 2024-04-25T02:08:55.343 INFO:tasks.workunit.client.0.smithi077.stdout:9/804: creat df/d1b/d48/d75/f110 x:0 0 0 2024-04-25T02:08:55.343 INFO:tasks.workunit.client.0.smithi077.stdout:9/805: chown df/l2c 153 1 2024-04-25T02:08:55.344 INFO:tasks.workunit.client.0.smithi077.stdout:6/920: rename de/d12/d25/d3a/d6a/dcd/fda to de/d12/d25/d3a/d6a/dcd/d36/f131 0 2024-04-25T02:08:55.345 INFO:tasks.workunit.client.0.smithi077.stdout:6/921: fdatasync de/d12/d25/d4b/fee 0 2024-04-25T02:08:55.346 INFO:tasks.workunit.client.0.smithi077.stdout:4/818: creat d0/d14/d21/d39/da/d12/f10a x:0 0 0 2024-04-25T02:08:55.346 INFO:tasks.workunit.client.0.smithi077.stdout:7/725: read d4/d13/d18/d2d/d30/f42 [2787489,93125] 0 2024-04-25T02:08:55.348 INFO:tasks.workunit.client.0.smithi077.stdout:9/806: unlink df/d60/d87/c8a 0 2024-04-25T02:08:55.348 INFO:tasks.workunit.client.0.smithi077.stdout:9/807: read - df/d80/fa8 zero size 2024-04-25T02:08:55.352 INFO:tasks.workunit.client.0.smithi077.stdout:8/910: rename d3/d34/d3d/l4a to d3/d34/d122/l12d 0 2024-04-25T02:08:55.353 INFO:tasks.workunit.client.0.smithi077.stdout:4/819: mknod d0/d14/d60/d62/d108/c10b 0 2024-04-25T02:08:55.353 INFO:tasks.workunit.client.0.smithi077.stdout:4/820: chown d0/d14/d21/d39/da/d12/fe4 830078624 1 2024-04-25T02:08:55.353 INFO:tasks.workunit.client.0.smithi077.stdout:4/821: chown d0/d14/d60/d62/fa8 6470 1 2024-04-25T02:08:55.354 INFO:tasks.workunit.client.0.smithi077.stdout:1/833: dwrite db/df/d14/d4d/d82/d5c/fb5 [0,4194304] 0 2024-04-25T02:08:55.354 INFO:tasks.workunit.client.0.smithi077.stdout:8/911: dread d3/fa0 [0,4194304] 0 2024-04-25T02:08:55.357 INFO:tasks.workunit.client.0.smithi077.stdout:9/808: link df/d1b/d70/d84/dde/caf df/d1b/d56/d67/d68/db3/c111 0 2024-04-25T02:08:55.357 INFO:tasks.workunit.client.0.smithi077.stdout:0/776: sync 2024-04-25T02:08:55.357 INFO:tasks.workunit.client.0.smithi077.stdout:3/782: sync 2024-04-25T02:08:55.358 INFO:tasks.workunit.client.0.smithi077.stdout:5/805: sync 2024-04-25T02:08:55.358 INFO:tasks.workunit.client.0.smithi077.stdout:2/847: dread d2/d9/d18/d31/d7c/dab/fb2 [0,4194304] 0 2024-04-25T02:08:55.359 INFO:tasks.workunit.client.0.smithi077.stdout:1/834: mknod db/df/d14/dfa/db4/c119 0 2024-04-25T02:08:55.360 INFO:tasks.workunit.client.0.smithi077.stdout:8/912: link d3/da/d27/d16/d8c/lef d3/d7a/de5/l12e 0 2024-04-25T02:08:55.361 INFO:tasks.workunit.client.0.smithi077.stdout:8/913: fdatasync d3/d34/d3d/ff9 0 2024-04-25T02:08:55.361 INFO:tasks.workunit.client.0.smithi077.stdout:4/822: mknod d0/d14/d21/d39/da/d12/d35/d3e/c10c 0 2024-04-25T02:08:55.362 INFO:tasks.workunit.client.0.smithi077.stdout:3/783: creat d0/d2/de/d36/da0/ddd/f11e x:0 0 0 2024-04-25T02:08:55.364 INFO:tasks.workunit.client.0.smithi077.stdout:2/848: mknod d2/d9/d19/d1c/d3f/d53/d86/dca/c11e 0 2024-04-25T02:08:55.365 INFO:tasks.workunit.client.0.smithi077.stdout:8/914: rename d3/d34/dc9/f129 to d3/d7a/f12f 0 2024-04-25T02:08:55.365 INFO:tasks.workunit.client.0.smithi077.stdout:8/915: readlink d3/da/db/df/l11d 0 2024-04-25T02:08:55.366 INFO:tasks.workunit.client.0.smithi077.stdout:8/916: dread - d3/da/d27/d44/db1/f115 zero size 2024-04-25T02:08:55.367 INFO:tasks.workunit.client.0.smithi077.stdout:9/809: dread df/d1b/d48/f6f [0,4194304] 0 2024-04-25T02:08:55.369 INFO:tasks.workunit.client.0.smithi077.stdout:4/823: mknod d0/d14/d60/d86/c10d 0 2024-04-25T02:08:55.369 INFO:tasks.workunit.client.0.smithi077.stdout:3/784: unlink d0/dc5/ffd 0 2024-04-25T02:08:55.369 INFO:tasks.workunit.client.0.smithi077.stdout:0/777: dread d2/d17/d1d/f20 [0,4194304] 0 2024-04-25T02:08:55.370 INFO:tasks.workunit.client.0.smithi077.stdout:5/806: rmdir d0/d25/d82/d87 39 2024-04-25T02:08:55.370 INFO:tasks.workunit.client.0.smithi077.stdout:5/807: write d0/d2/d3/d9/d39/d44/d80/fe2 [539755,109574] 0 2024-04-25T02:08:55.370 INFO:tasks.workunit.client.0.smithi077.stdout:5/808: creat d0/d25/dc7/dca/d3e/de7/f102 x:0 0 0 2024-04-25T02:08:55.373 INFO:tasks.workunit.client.0.smithi077.stdout:9/810: getdents df/d1b/d70/dc9 0 2024-04-25T02:08:55.373 INFO:tasks.workunit.client.0.smithi077.stdout:4/824: dread d0/d14/d21/d39/da/d12/d35/d3e/f8f [0,4194304] 0 2024-04-25T02:08:55.374 INFO:tasks.workunit.client.0.smithi077.stdout:3/785: creat d0/d3e/d62/d110/f11f x:0 0 0 2024-04-25T02:08:55.375 INFO:tasks.workunit.client.0.smithi077.stdout:3/786: creat d0/d3e/f120 x:0 0 0 2024-04-25T02:08:55.375 INFO:tasks.workunit.client.0.smithi077.stdout:3/787: chown d0/d17/d4b/d59/fe6 2249 1 2024-04-25T02:08:55.379 INFO:tasks.workunit.client.0.smithi077.stdout:7/726: dwrite d4/d13/d18/d24/d3f/d59/f5f [0,4194304] 0 2024-04-25T02:08:55.379 INFO:tasks.workunit.client.0.smithi077.stdout:7/727: fsync d4/d13/d18/d24/f3b 0 2024-04-25T02:08:55.379 INFO:tasks.workunit.client.0.smithi077.stdout:7/728: creat d4/d13/d18/d24/d3f/ff1 x:0 0 0 2024-04-25T02:08:55.379 INFO:tasks.workunit.client.0.smithi077.stdout:4/825: mknod d0/d14/d79/d104/c10e 0 2024-04-25T02:08:55.379 INFO:tasks.workunit.client.0.smithi077.stdout:1/835: dwrite f1 [0,4194304] 0 2024-04-25T02:08:55.380 INFO:tasks.workunit.client.0.smithi077.stdout:6/922: dwrite de/d12/d25/d3a/d6a/dcd/d36/f128 [0,4194304] 0 2024-04-25T02:08:55.382 INFO:tasks.workunit.client.0.smithi077.stdout:0/778: dread d2/d27/d2d/fca [0,4194304] 0 2024-04-25T02:08:55.385 INFO:tasks.workunit.client.0.smithi077.stdout:3/788: truncate d0/d3e/d62/d6a/f89 368316 0 2024-04-25T02:08:55.385 INFO:tasks.workunit.client.0.smithi077.stdout:3/789: creat d0/dc5/f121 x:0 0 0 2024-04-25T02:08:55.385 INFO:tasks.workunit.client.0.smithi077.stdout:2/849: rmdir d2/d9/d56 39 2024-04-25T02:08:55.389 INFO:tasks.workunit.client.0.smithi077.stdout:1/836: dread db/df/d56/dc3/fc6 [0,4194304] 0 2024-04-25T02:08:55.392 INFO:tasks.workunit.client.0.smithi077.stdout:7/729: symlink d4/dd2/lf2 0 2024-04-25T02:08:55.394 INFO:tasks.workunit.client.0.smithi077.stdout:2/850: dread d2/d9/d19/d1c/f33 [0,4194304] 0 2024-04-25T02:08:55.397 INFO:tasks.workunit.client.0.smithi077.stdout:6/923: truncate de/d12/f7a 2115550 0 2024-04-25T02:08:55.397 INFO:tasks.workunit.client.0.smithi077.stdout:4/826: dread d0/d14/d79/da4/dbc/f102 [0,4194304] 0 2024-04-25T02:08:55.399 INFO:tasks.workunit.client.0.smithi077.stdout:0/779: mkdir d2/d8/db6/dd7/d10c 0 2024-04-25T02:08:55.399 INFO:tasks.workunit.client.0.smithi077.stdout:0/780: write d2/d17/d1d/f20 [1730889,14471] 0 2024-04-25T02:08:55.400 INFO:tasks.workunit.client.0.smithi077.stdout:5/809: dwrite d0/d25/dc7/dca/d3e/de7/ffc [0,4194304] 0 2024-04-25T02:08:55.401 INFO:tasks.workunit.client.0.smithi077.stdout:9/811: dwrite df/d1b/f40 [0,4194304] 0 2024-04-25T02:08:55.406 INFO:tasks.workunit.client.0.smithi077.stdout:3/790: mknod d0/d3e/c122 0 2024-04-25T02:08:55.409 INFO:tasks.workunit.client.0.smithi077.stdout:2/851: link d2/d9/d19/d1c/d37/ce2 d2/d9/d19/d1c/d3f/d53/d83/c11f 0 2024-04-25T02:08:55.409 INFO:tasks.workunit.client.0.smithi077.stdout:2/852: readlink d2/d9/ddc/dc4/lb5 0 2024-04-25T02:08:55.410 INFO:tasks.workunit.client.0.smithi077.stdout:2/853: read - d2/d9/d2f/d84/da6/f10f zero size 2024-04-25T02:08:55.410 INFO:tasks.workunit.client.0.smithi077.stdout:2/854: write d2/d9/ddc/dc4/f66 [2946355,11690] 0 2024-04-25T02:08:55.412 INFO:tasks.workunit.client.0.smithi077.stdout:7/730: dwrite d4/d13/d18/d24/d3f/d59/f5f [0,4194304] 0 2024-04-25T02:08:55.412 INFO:tasks.workunit.client.0.smithi077.stdout:7/731: fdatasync d4/d13/f54 0 2024-04-25T02:08:55.412 INFO:tasks.workunit.client.0.smithi077.stdout:7/732: write d4/d13/d18/d2d/d56/feb [68892,93683] 0 2024-04-25T02:08:55.412 INFO:tasks.workunit.client.0.smithi077.stdout:0/781: dread d2/d17/d1d/d34/d4c/da2/df5/f101 [0,4194304] 0 2024-04-25T02:08:55.412 INFO:tasks.workunit.client.0.smithi077.stdout:0/782: chown d2/d17/d4e/d5e/lc4 81158 1 2024-04-25T02:08:55.412 INFO:tasks.workunit.client.0.smithi077.stdout:6/924: dread de/d12/d25/f31 [0,4194304] 0 2024-04-25T02:08:55.412 INFO:tasks.workunit.client.0.smithi077.stdout:6/925: creat de/d53/db2/f132 x:0 0 0 2024-04-25T02:08:55.412 INFO:tasks.workunit.client.0.smithi077.stdout:6/926: stat de/d53/d76/d10a/f12d 0 2024-04-25T02:08:55.412 INFO:tasks.workunit.client.0.smithi077.stdout:6/927: chown de/d55/d88/d116 3 1 2024-04-25T02:08:55.412 INFO:tasks.workunit.client.0.smithi077.stdout:4/827: unlink d0/d14/d21/d39/f76 0 2024-04-25T02:08:55.412 INFO:tasks.workunit.client.0.smithi077.stdout:4/828: write d0/d14/d60/d86/d96/f106 [906358,48042] 0 2024-04-25T02:08:55.416 INFO:tasks.workunit.client.0.smithi077.stdout:9/812: creat df/d1b/d48/dee/d10b/f112 x:0 0 0 2024-04-25T02:08:55.420 INFO:tasks.workunit.client.0.smithi077.stdout:2/855: write d2/d9/d18/d1b/ff9 [2792676,106715] 0 2024-04-25T02:08:55.420 INFO:tasks.workunit.client.0.smithi077.stdout:2/856: write d2/d9/ddc/dad/fba [1249516,98306] 0 2024-04-25T02:08:55.420 INFO:tasks.workunit.client.0.smithi077.stdout:2/857: readlink d2/d9/d18/d1b/l55 0 2024-04-25T02:08:55.420 INFO:tasks.workunit.client.0.smithi077.stdout:3/791: mkdir d0/d3e/d42/d123 0 2024-04-25T02:08:55.424 INFO:tasks.workunit.client.0.smithi077.stdout:1/837: unlink db/c2e 0 2024-04-25T02:08:55.424 INFO:tasks.workunit.client.0.smithi077.stdout:1/838: fsync db/d26/f3c 0 2024-04-25T02:08:55.425 INFO:tasks.workunit.client.0.smithi077.stdout:1/839: chown db/df/d14/d4d/d82/d42/d43/fb2 15 1 2024-04-25T02:08:55.425 INFO:tasks.workunit.client.0.smithi077.stdout:1/840: creat db/df/d14/d3e/d69/dad/f11a x:0 0 0 2024-04-25T02:08:55.428 INFO:tasks.workunit.client.0.smithi077.stdout:6/928: creat de/d5b/da6/d120/f133 x:0 0 0 2024-04-25T02:08:55.430 INFO:tasks.workunit.client.0.smithi077.stdout:4/829: symlink d0/l10f 0 2024-04-25T02:08:55.436 INFO:tasks.workunit.client.0.smithi077.stdout:6/929: link de/d12/f118 de/d55/db7/f134 0 2024-04-25T02:08:55.440 INFO:tasks.workunit.client.0.smithi077.stdout:2/858: write d2/d78/d95/fe9 [3236636,129462] 0 2024-04-25T02:08:55.453 INFO:tasks.workunit.client.0.smithi077.stdout:2/859: write d2/d9/d19/d1c/d3f/d53/f68 [2330972,84436] 0 2024-04-25T02:08:55.454 INFO:tasks.workunit.client.0.smithi077.stdout:2/860: unlink d2/d9/d19/d1c/d37/c74 0 2024-04-25T02:08:55.456 INFO:tasks.workunit.client.0.smithi077.stdout:2/861: rename d2/d9/d19/d1c/d3f/d53/l10a to d2/d9/ddc/dc4/l120 0 2024-04-25T02:08:55.456 INFO:tasks.workunit.client.0.smithi077.stdout:2/862: dread - d2/d9/d19/f34 zero size 2024-04-25T02:08:55.456 INFO:tasks.workunit.client.0.smithi077.stdout:7/733: dwrite d4/d13/d18/d2d/d30/f63 [0,4194304] 0 2024-04-25T02:08:55.457 INFO:tasks.workunit.client.0.smithi077.stdout:2/863: creat d2/d9/d19/d1c/d37/dcb/d118/f121 x:0 0 0 2024-04-25T02:08:55.457 INFO:tasks.workunit.client.0.smithi077.stdout:2/864: write d2/d9/d19/f108 [2044940,106038] 0 2024-04-25T02:08:55.457 INFO:tasks.workunit.client.0.smithi077.stdout:7/734: readlink d4/d13/d2c/ld8 0 2024-04-25T02:08:55.570 INFO:tasks.workunit.client.0.smithi077.stdout:2/865: fdatasync d2/fec 0 2024-04-25T02:08:55.572 INFO:tasks.workunit.client.0.smithi077.stdout:0/783: dwrite d2/d8/db6/dd7/de0/fef [0,4194304] 0 2024-04-25T02:08:55.573 INFO:tasks.workunit.client.0.smithi077.stdout:2/866: unlink d2/d9/d18/d31/f63 0 2024-04-25T02:08:55.576 INFO:tasks.workunit.client.0.smithi077.stdout:0/784: creat d2/d17/d1d/db1/f10d x:0 0 0 2024-04-25T02:08:55.576 INFO:tasks.workunit.client.0.smithi077.stdout:0/785: chown d2/d17/d4e/d5e/c87 11 1 2024-04-25T02:08:55.576 INFO:tasks.workunit.client.0.smithi077.stdout:0/786: chown d2/d9/f66 0 1 2024-04-25T02:08:55.576 INFO:tasks.workunit.client.0.smithi077.stdout:0/787: dread - d2/d17/d1d/d34/d4c/da2/dae/f10b zero size 2024-04-25T02:08:55.577 INFO:tasks.workunit.client.0.smithi077.stdout:0/788: write d2/d17/d1d/f3d [544284,71218] 0 2024-04-25T02:08:55.577 INFO:tasks.workunit.client.0.smithi077.stdout:0/789: fsync d2/d8/f26 0 2024-04-25T02:08:55.577 INFO:tasks.workunit.client.0.smithi077.stdout:0/790: chown d2/d8/db6/dd7/d105/l7a 3 1 2024-04-25T02:08:55.586 INFO:tasks.workunit.client.0.smithi077.stdout:3/792: dwrite d0/d3e/da1/ff9 [0,4194304] 0 2024-04-25T02:08:55.586 INFO:tasks.workunit.client.0.smithi077.stdout:3/793: write d0/d3e/d62/f68 [9061594,78193] 0 2024-04-25T02:08:55.587 INFO:tasks.workunit.client.0.smithi077.stdout:7/735: dwrite d4/d13/d18/f36 [0,4194304] 0 2024-04-25T02:08:55.588 INFO:tasks.workunit.client.0.smithi077.stdout:1/841: dwrite db/df/d14/d4d/d82/d42/f7c [0,4194304] 0 2024-04-25T02:08:55.590 INFO:tasks.workunit.client.0.smithi077.stdout:0/791: dread d2/d17/d1d/d34/d4c/da2/d51/de8/d107/fec [0,4194304] 0 2024-04-25T02:08:55.591 INFO:tasks.workunit.client.0.smithi077.stdout:2/867: dread d2/d9/d19/d2c/f36 [0,4194304] 0 2024-04-25T02:08:55.593 INFO:tasks.workunit.client.0.smithi077.stdout:7/736: unlink d4/d13/c60 0 2024-04-25T02:08:55.600 INFO:tasks.workunit.client.0.smithi077.stdout:1/842: creat db/df/d14/d3e/daa/d107/f11b x:0 0 0 2024-04-25T02:08:55.600 INFO:tasks.workunit.client.0.smithi077.stdout:1/843: chown db/df/d14/d4d/d82/d5c/fc5 7809339 1 2024-04-25T02:08:55.601 INFO:tasks.workunit.client.0.smithi077.stdout:1/844: write db/df/d56/d5d/d77/db3/fd9 [2164335,79025] 0 2024-04-25T02:08:55.603 INFO:tasks.workunit.client.0.smithi077.stdout:2/868: rename d2/d9/d19/d1c/d3f/d53/d86/f96 to d2/d9/d19/d1c/d3f/d53/d83/f122 0 2024-04-25T02:08:55.606 INFO:tasks.workunit.client.0.smithi077.stdout:1/845: rename db/df/d14/d3e/daa/lc8 to db/df/d14/d3e/l11c 0 2024-04-25T02:08:55.606 INFO:tasks.workunit.client.0.smithi077.stdout:1/846: fdatasync db/df/d14/d4d/d82/d42/d43/f8a 0 2024-04-25T02:08:55.608 INFO:tasks.workunit.client.0.smithi077.stdout:1/847: getdents db/df/d56/d5d/d77 0 2024-04-25T02:08:55.608 INFO:tasks.workunit.client.0.smithi077.stdout:1/848: fdatasync f8 0 2024-04-25T02:08:55.610 INFO:tasks.workunit.client.0.smithi077.stdout:1/849: link db/df/d14/d4d/fed db/df/d14/d4d/d82/d10f/f11d 0 2024-04-25T02:08:55.611 INFO:tasks.workunit.client.0.smithi077.stdout:1/850: write db/df/d1b/f6f [209918,72101] 0 2024-04-25T02:08:55.614 INFO:tasks.workunit.client.0.smithi077.stdout:1/851: truncate db/df/d14/dfa/f36 250695 0 2024-04-25T02:08:55.624 INFO:tasks.workunit.client.0.smithi077.stdout:0/792: dwrite d2/d17/d1d/d34/d4c/da2/d51/de8/d107/fec [0,4194304] 0 2024-04-25T02:08:55.624 INFO:tasks.workunit.client.0.smithi077.stdout:7/737: dwrite d4/d13/f54 [0,4194304] 0 2024-04-25T02:08:55.625 INFO:tasks.workunit.client.0.smithi077.stdout:7/738: truncate d4/d13/d18/d2d/d30/f42 4638578 0 2024-04-25T02:08:55.625 INFO:tasks.workunit.client.0.smithi077.stdout:2/869: dwrite d2/fdb [0,4194304] 0 2024-04-25T02:08:55.626 INFO:tasks.workunit.client.0.smithi077.stdout:0/793: creat d2/d27/d2d/dce/de7/f10e x:0 0 0 2024-04-25T02:08:55.630 INFO:tasks.workunit.client.0.smithi077.stdout:8/917: sync 2024-04-25T02:08:55.630 INFO:tasks.workunit.client.0.smithi077.stdout:8/918: truncate d3/d7a/f12f 595561 0 2024-04-25T02:08:55.630 INFO:tasks.workunit.client.0.smithi077.stdout:8/919: chown d3/da/db/df/ddc/le1 12469 1 2024-04-25T02:08:55.633 INFO:tasks.workunit.client.0.smithi077.stdout:0/794: mknod d2/d8/db6/dd7/d105/c10f 0 2024-04-25T02:08:55.634 INFO:tasks.workunit.client.0.smithi077.stdout:1/852: fsync db/df/d14/d3e/daa/d107/f11b 0 2024-04-25T02:08:55.634 INFO:tasks.workunit.client.0.smithi077.stdout:1/853: read db/df/d14/d4d/d82/d5c/f6a [120177,30413] 0 2024-04-25T02:08:55.639 INFO:tasks.workunit.client.0.smithi077.stdout:0/795: symlink d2/d17/d4e/l110 0 2024-04-25T02:08:55.642 INFO:tasks.workunit.client.0.smithi077.stdout:0/796: symlink d2/d17/d4e/l111 0 2024-04-25T02:08:55.643 INFO:tasks.workunit.client.0.smithi077.stdout:7/739: dread d4/fe [0,4194304] 0 2024-04-25T02:08:55.646 INFO:tasks.workunit.client.0.smithi077.stdout:7/740: link d4/d13/d18/d24/d3f/ff1 d4/d13/d18/d24/d3f/de9/ff3 0 2024-04-25T02:08:55.647 INFO:tasks.workunit.client.0.smithi077.stdout:0/797: getdents d2/d17/d1d/db1 0 2024-04-25T02:08:55.649 INFO:tasks.workunit.client.0.smithi077.stdout:7/741: link d4/c8 d4/d13/d18/d24/d3f/de9/cf4 0 2024-04-25T02:08:55.655 INFO:tasks.workunit.client.0.smithi077.stdout:2/870: dwrite d2/d78/d95/fe9 [0,4194304] 0 2024-04-25T02:08:55.655 INFO:tasks.workunit.client.0.smithi077.stdout:8/920: dwrite d3/da/db/df/d30/f89 [4194304,4194304] 0 2024-04-25T02:08:55.655 INFO:tasks.workunit.client.0.smithi077.stdout:2/871: write d2/d9/d18/fa [5501720,104670] 0 2024-04-25T02:08:55.655 INFO:tasks.workunit.client.0.smithi077.stdout:2/872: stat d2/d9/d18/d31/d7c/dab/dc8/f10c 0 2024-04-25T02:08:55.658 INFO:tasks.workunit.client.0.smithi077.stdout:0/798: rename d2/d27/d2d/dce/de7/f93 to d2/d27/d2d/f112 0 2024-04-25T02:08:55.663 INFO:tasks.workunit.client.0.smithi077.stdout:8/921: symlink d3/da/db/df/d2b/d37/l130 0 2024-04-25T02:08:55.665 INFO:tasks.workunit.client.0.smithi077.stdout:2/873: creat d2/d9/d18/d31/d7c/df3/f123 x:0 0 0 2024-04-25T02:08:55.666 INFO:tasks.workunit.client.0.smithi077.stdout:0/799: creat d2/d8/db6/f113 x:0 0 0 2024-04-25T02:08:55.666 INFO:tasks.workunit.client.0.smithi077.stdout:8/922: mknod d3/d81/d86/c131 0 2024-04-25T02:08:55.666 INFO:tasks.workunit.client.0.smithi077.stdout:8/923: chown d3/d7a 5970 1 2024-04-25T02:08:55.668 INFO:tasks.workunit.client.0.smithi077.stdout:2/874: unlink d2/d59/d79/l91 0 2024-04-25T02:08:55.668 INFO:tasks.workunit.client.0.smithi077.stdout:7/742: dwrite d4/d13/d18/fe4 [0,4194304] 0 2024-04-25T02:08:55.668 INFO:tasks.workunit.client.0.smithi077.stdout:8/924: symlink d3/l132 0 2024-04-25T02:08:55.670 INFO:tasks.workunit.client.0.smithi077.stdout:2/875: getdents d2 0 2024-04-25T02:08:55.672 INFO:tasks.workunit.client.0.smithi077.stdout:7/743: creat d4/d13/d5b/d8b/db2/ff5 x:0 0 0 2024-04-25T02:08:55.673 INFO:tasks.workunit.client.0.smithi077.stdout:8/925: creat d3/da/d27/d44/db1/f133 x:0 0 0 2024-04-25T02:08:55.676 INFO:tasks.workunit.client.0.smithi077.stdout:8/926: rename d3/da/db/df/d2b/c7d to d3/da/d27/c134 0 2024-04-25T02:08:55.677 INFO:tasks.workunit.client.0.smithi077.stdout:0/800: dread d2/d17/d1d/d34/d4c/f9a [0,4194304] 0 2024-04-25T02:08:55.685 INFO:tasks.workunit.client.0.smithi077.stdout:0/801: read d2/d17/d4e/f95 [3783302,77389] 0 2024-04-25T02:08:55.685 INFO:tasks.workunit.client.0.smithi077.stdout:0/802: write d2/d17/d1d/fbf [935189,4941] 0 2024-04-25T02:08:55.686 INFO:tasks.workunit.client.0.smithi077.stdout:0/803: mkdir d2/d27/d114 0 2024-04-25T02:08:55.686 INFO:tasks.workunit.client.0.smithi077.stdout:0/804: readlink d2/d9/d2a/ldd 0 2024-04-25T02:08:55.687 INFO:tasks.workunit.client.0.smithi077.stdout:0/805: mkdir d2/d17/d4e/d5e/d115 0 2024-04-25T02:08:55.689 INFO:tasks.workunit.client.0.smithi077.stdout:0/806: link d2/d17/d1d/db1/fc6 d2/d17/d1d/d34/d83/dee/f116 0 2024-04-25T02:08:55.689 INFO:tasks.workunit.client.0.smithi077.stdout:0/807: write d2/d8/db6/dd7/d105/f24 [1361075,111555] 0 2024-04-25T02:08:55.693 INFO:tasks.workunit.client.0.smithi077.stdout:8/927: write d3/da/d27/f76 [3488424,54861] 0 2024-04-25T02:08:55.694 INFO:tasks.workunit.client.0.smithi077.stdout:8/928: symlink d3/da/d27/d16/dbc/l135 0 2024-04-25T02:08:55.695 INFO:tasks.workunit.client.0.smithi077.stdout:8/929: creat d3/d34/f136 x:0 0 0 2024-04-25T02:08:55.695 INFO:tasks.workunit.client.0.smithi077.stdout:8/930: write d3/da/db/fe8 [230022,41383] 0 2024-04-25T02:08:55.698 INFO:tasks.workunit.client.0.smithi077.stdout:2/876: dwrite d2/d78/fac [0,4194304] 0 2024-04-25T02:08:55.698 INFO:tasks.workunit.client.0.smithi077.stdout:2/877: write d2/d9/d19/d1c/d3f/d53/d83/ff7 [822842,10873] 0 2024-04-25T02:08:55.698 INFO:tasks.workunit.client.0.smithi077.stdout:7/744: dwrite d4/dd2/fd5 [0,4194304] 0 2024-04-25T02:08:55.704 INFO:tasks.workunit.client.0.smithi077.stdout:0/808: write d2/d27/f8e [1376524,43927] 0 2024-04-25T02:08:55.708 INFO:tasks.workunit.client.0.smithi077.stdout:7/745: creat d4/d13/d18/d2d/d56/d68/d88/ff6 x:0 0 0 2024-04-25T02:08:55.709 INFO:tasks.workunit.client.0.smithi077.stdout:0/809: creat d2/d17/d1d/d34/d83/dee/f117 x:0 0 0 2024-04-25T02:08:55.713 INFO:tasks.workunit.client.0.smithi077.stdout:7/746: creat d4/d13/d18/d24/d3f/de9/ff7 x:0 0 0 2024-04-25T02:08:55.713 INFO:tasks.workunit.client.0.smithi077.stdout:7/747: chown d4/c15 15 1 2024-04-25T02:08:55.713 INFO:tasks.workunit.client.0.smithi077.stdout:7/748: write d4/d13/d18/d2d/d56/d68/db3/fdd [1803611,12765] 0 2024-04-25T02:08:55.714 INFO:tasks.workunit.client.0.smithi077.stdout:8/931: getdents d3/da/d27/d16/dbc 0 2024-04-25T02:08:55.717 INFO:tasks.workunit.client.0.smithi077.stdout:7/749: link d4/d13/d5b/d8b/lec d4/d13/d5b/d8b/lf8 0 2024-04-25T02:08:55.717 INFO:tasks.workunit.client.0.smithi077.stdout:2/878: dwrite d2/d9/ddc/dad/fba [0,4194304] 0 2024-04-25T02:08:55.724 INFO:tasks.workunit.client.0.smithi077.stdout:5/810: sync 2024-04-25T02:08:55.724 INFO:tasks.workunit.client.0.smithi077.stdout:2/879: mknod d2/d78/d95/d11c/c124 0 2024-04-25T02:08:55.726 INFO:tasks.workunit.client.0.smithi077.stdout:5/811: read d0/d2/d1b/f8a [744005,33931] 0 2024-04-25T02:08:55.726 INFO:tasks.workunit.client.0.smithi077.stdout:2/880: creat d2/d9/d2f/f125 x:0 0 0 2024-04-25T02:08:55.726 INFO:tasks.workunit.client.0.smithi077.stdout:2/881: chown d2/l4a 311400 1 2024-04-25T02:08:55.726 INFO:tasks.workunit.client.0.smithi077.stdout:2/882: stat d2/d9/d19/d1c/c75 0 2024-04-25T02:08:55.726 INFO:tasks.workunit.client.0.smithi077.stdout:2/883: readlink d2/d9/l21 0 2024-04-25T02:08:55.727 INFO:tasks.workunit.client.0.smithi077.stdout:5/812: mkdir d0/d103 0 2024-04-25T02:08:55.727 INFO:tasks.workunit.client.0.smithi077.stdout:5/813: write d0/d2/d3/d9/f2a [3869053,100322] 0 2024-04-25T02:08:55.728 INFO:tasks.workunit.client.0.smithi077.stdout:5/814: rename d0/d2/d1b/fb9 to d0/d2/d52/f104 0 2024-04-25T02:08:55.729 INFO:tasks.workunit.client.0.smithi077.stdout:7/750: write d4/d13/d18/d24/d3f/fdc [116564,82288] 0 2024-04-25T02:08:55.738 INFO:tasks.workunit.client.0.smithi077.stdout:0/810: dwrite d2/d8/db6/dd7/de0/fef [0,4194304] 0 2024-04-25T02:08:55.738 INFO:tasks.workunit.client.0.smithi077.stdout:8/932: dwrite d3/da/db/df/d2b/f72 [0,4194304] 0 2024-04-25T02:08:55.738 INFO:tasks.workunit.client.0.smithi077.stdout:8/933: write d3/da/d27/fbd [646951,97909] 0 2024-04-25T02:08:55.740 INFO:tasks.workunit.client.0.smithi077.stdout:0/811: rename d2/d17/d1d/d34/d4c/fab to d2/d27/d2d/dce/f118 0 2024-04-25T02:08:55.746 INFO:tasks.workunit.client.0.smithi077.stdout:8/934: rename d3/da/db/df/d30/f89 to d3/d34/d122/df8/f137 0 2024-04-25T02:08:55.749 INFO:tasks.workunit.client.0.smithi077.stdout:8/935: creat d3/d81/d86/d126/f138 x:0 0 0 2024-04-25T02:08:55.750 INFO:tasks.workunit.client.0.smithi077.stdout:4/830: sync 2024-04-25T02:08:55.750 INFO:tasks.workunit.client.0.smithi077.stdout:6/930: sync 2024-04-25T02:08:55.750 INFO:tasks.workunit.client.0.smithi077.stdout:9/813: sync 2024-04-25T02:08:55.750 INFO:tasks.workunit.client.0.smithi077.stdout:3/794: sync 2024-04-25T02:08:55.750 INFO:tasks.workunit.client.0.smithi077.stdout:1/854: sync 2024-04-25T02:08:55.750 INFO:tasks.workunit.client.0.smithi077.stdout:3/795: creat d0/d2/de/d36/da0/ddd/f124 x:0 0 0 2024-04-25T02:08:55.752 INFO:tasks.workunit.client.0.smithi077.stdout:3/796: mkdir d0/d2/de/d48/d15/d125 0 2024-04-25T02:08:55.754 INFO:tasks.workunit.client.0.smithi077.stdout:4/831: link d0/d14/d21/d39/da/d12/d35/lc5 d0/d14/d79/l110 0 2024-04-25T02:08:55.754 INFO:tasks.workunit.client.0.smithi077.stdout:4/832: chown d0/d14/d21/d39/d1d/d98/fc1 206071871 1 2024-04-25T02:08:55.755 INFO:tasks.workunit.client.0.smithi077.stdout:1/855: dread db/df/d14/d4d/d82/d5c/f6a [0,4194304] 0 2024-04-25T02:08:55.757 INFO:tasks.workunit.client.0.smithi077.stdout:4/833: symlink d0/d14/d60/d78/dce/dfa/l111 0 2024-04-25T02:08:55.760 INFO:tasks.workunit.client.0.smithi077.stdout:4/834: dread d0/d14/d60/d62/f77 [0,4194304] 0 2024-04-25T02:08:55.760 INFO:tasks.workunit.client.0.smithi077.stdout:4/835: chown d0/d14/f8b 424220 1 2024-04-25T02:08:55.760 INFO:tasks.workunit.client.0.smithi077.stdout:4/836: fdatasync d0/d14/d79/da4/faf 0 2024-04-25T02:08:55.760 INFO:tasks.workunit.client.0.smithi077.stdout:4/837: stat d0/d14 0 2024-04-25T02:08:55.760 INFO:tasks.workunit.client.0.smithi077.stdout:4/838: write d0/d14/d21/d39/da/d12/d35/d3e/f8f [511335,32433] 0 2024-04-25T02:08:55.760 INFO:tasks.workunit.client.0.smithi077.stdout:1/856: mknod db/df/d14/d4d/d82/d5c/c11e 0 2024-04-25T02:08:55.762 INFO:tasks.workunit.client.0.smithi077.stdout:3/797: dread d0/d2/de/d48/fb2 [0,4194304] 0 2024-04-25T02:08:55.763 INFO:tasks.workunit.client.0.smithi077.stdout:9/814: write df/d1b/f6e [3575882,121703] 0 2024-04-25T02:08:55.763 INFO:tasks.workunit.client.0.smithi077.stdout:9/815: chown df/d1b/d56/cc3 15 1 2024-04-25T02:08:55.767 INFO:tasks.workunit.client.0.smithi077.stdout:3/798: dread d0/d2/fc8 [0,4194304] 0 2024-04-25T02:08:55.771 INFO:tasks.workunit.client.0.smithi077.stdout:3/799: link d0/d3e/d42/c4c d0/d17/d4b/d59/d103/c126 0 2024-04-25T02:08:55.771 INFO:tasks.workunit.client.0.smithi077.stdout:3/800: write d0/d3e/d93/fa5 [4377,33385] 0 2024-04-25T02:08:55.771 INFO:tasks.workunit.client.0.smithi077.stdout:3/801: write d0/d2/d83/fc0 [891876,91373] 0 2024-04-25T02:08:55.772 INFO:tasks.workunit.client.0.smithi077.stdout:5/815: dwrite d0/d2/d1b/f54 [4194304,4194304] 0 2024-04-25T02:08:55.773 INFO:tasks.workunit.client.0.smithi077.stdout:7/751: dwrite d4/d13/d18/d2d/d30/dab/fe1 [0,4194304] 0 2024-04-25T02:08:55.773 INFO:tasks.workunit.client.0.smithi077.stdout:2/884: dwrite d2/d9/d19/d1c/f33 [0,4194304] 0 2024-04-25T02:08:55.777 INFO:tasks.workunit.client.0.smithi077.stdout:0/812: dwrite d2/d8/db6/f113 [0,4194304] 0 2024-04-25T02:08:55.779 INFO:tasks.workunit.client.0.smithi077.stdout:5/816: rename d0/d25/d82/d8d/fe9 to d0/d2/d3/db6/f105 0 2024-04-25T02:08:55.779 INFO:tasks.workunit.client.0.smithi077.stdout:3/802: rmdir d0/d3e/d93/dae 39 2024-04-25T02:08:55.781 INFO:tasks.workunit.client.0.smithi077.stdout:6/931: dwrite de/d12/d25/d4b/f79 [0,4194304] 0 2024-04-25T02:08:55.784 INFO:tasks.workunit.client.0.smithi077.stdout:7/752: write d4/d13/f3c [1203662,8317] 0 2024-04-25T02:08:55.785 INFO:tasks.workunit.client.0.smithi077.stdout:3/803: rename d0/d17/d4b/d59/d103/c126 to d0/d3e/d42/d64/d88/d9c/c127 0 2024-04-25T02:08:55.788 INFO:tasks.workunit.client.0.smithi077.stdout:6/932: rename de/d12/d25/d3a/d6a/dcd/fed to de/d53/d78/f135 0 2024-04-25T02:08:55.788 INFO:tasks.workunit.client.0.smithi077.stdout:3/804: mkdir d0/d3e/d42/d123/d128 0 2024-04-25T02:08:55.788 INFO:tasks.workunit.client.0.smithi077.stdout:3/805: fdatasync d0/d17/d4b/d59/f104 0 2024-04-25T02:08:55.789 INFO:tasks.workunit.client.0.smithi077.stdout:9/816: dread df/d1b/f20 [0,4194304] 0 2024-04-25T02:08:55.789 INFO:tasks.workunit.client.0.smithi077.stdout:3/806: mkdir d0/d17/dd4/d129 0 2024-04-25T02:08:55.791 INFO:tasks.workunit.client.0.smithi077.stdout:3/807: mkdir d0/d2/d83/d12a 0 2024-04-25T02:08:55.791 INFO:tasks.workunit.client.0.smithi077.stdout:3/808: creat d0/d3e/f12b x:0 0 0 2024-04-25T02:08:55.791 INFO:tasks.workunit.client.0.smithi077.stdout:3/809: write d0/d17/d4b/d59/f8e [5063949,81803] 0 2024-04-25T02:08:55.792 INFO:tasks.workunit.client.0.smithi077.stdout:9/817: getdents df/d60/d87 0 2024-04-25T02:08:55.793 INFO:tasks.workunit.client.0.smithi077.stdout:8/936: dwrite d3/da/d27/d16/f22 [0,4194304] 0 2024-04-25T02:08:55.795 INFO:tasks.workunit.client.0.smithi077.stdout:4/839: dwrite d0/d14/d60/d86/f4c [0,4194304] 0 2024-04-25T02:08:55.795 INFO:tasks.workunit.client.0.smithi077.stdout:1/857: dwrite db/df/d14/f97 [0,4194304] 0 2024-04-25T02:08:55.796 INFO:tasks.workunit.client.0.smithi077.stdout:9/818: stat df/c4f 0 2024-04-25T02:08:55.796 INFO:tasks.workunit.client.0.smithi077.stdout:9/819: write df/d1b/d56/dbd/ff6 [337835,53859] 0 2024-04-25T02:08:55.796 INFO:tasks.workunit.client.0.smithi077.stdout:4/840: dread d0/d14/d60/d86/d25/f7f [0,4194304] 0 2024-04-25T02:08:55.797 INFO:tasks.workunit.client.0.smithi077.stdout:4/841: creat d0/d14/d79/da4/dbc/f112 x:0 0 0 2024-04-25T02:08:55.802 INFO:tasks.workunit.client.0.smithi077.stdout:5/817: getdents d0/d2/d1b 0 2024-04-25T02:08:55.802 INFO:tasks.workunit.client.0.smithi077.stdout:5/818: fdatasync d0/d25/d82/d87/d8b/f8e 0 2024-04-25T02:08:55.802 INFO:tasks.workunit.client.0.smithi077.stdout:5/819: truncate d0/d2/d3/d9/d39/d44/d5f/da4/fed 586676 0 2024-04-25T02:08:55.804 INFO:tasks.workunit.client.0.smithi077.stdout:3/810: write d0/d2/de/d48/fe0 [3088694,83544] 0 2024-04-25T02:08:55.804 INFO:tasks.workunit.client.0.smithi077.stdout:9/820: unlink df/d1b/lb5 0 2024-04-25T02:08:55.809 INFO:tasks.workunit.client.0.smithi077.stdout:4/842: mknod d0/d14/d79/da4/dac/c113 0 2024-04-25T02:08:55.810 INFO:tasks.workunit.client.0.smithi077.stdout:8/937: write d3/da/d27/f3f [968258,72376] 0 2024-04-25T02:08:55.812 INFO:tasks.workunit.client.0.smithi077.stdout:6/933: dwrite de/d5b/da6/d120/f133 [0,4194304] 0 2024-04-25T02:08:55.812 INFO:tasks.workunit.client.0.smithi077.stdout:7/753: dwrite d4/d13/d18/d24/f57 [0,4194304] 0 2024-04-25T02:08:55.812 INFO:tasks.workunit.client.0.smithi077.stdout:7/754: readlink d4/d13/d18/d2d/d56/d68/db3/lcc 0 2024-04-25T02:08:55.816 INFO:tasks.workunit.client.0.smithi077.stdout:1/858: getdents db/df/d14/d4d/d82/d42/d43 0 2024-04-25T02:08:55.818 INFO:tasks.workunit.client.0.smithi077.stdout:5/820: creat d0/d2/d3/d9/d39/d44/d5f/da4/f106 x:0 0 0 2024-04-25T02:08:55.818 INFO:tasks.workunit.client.0.smithi077.stdout:5/821: chown d0/d2/d3/d9/d39/d3c/f93 903510 1 2024-04-25T02:08:55.822 INFO:tasks.workunit.client.0.smithi077.stdout:3/811: mkdir d0/d17/d4b/d59/dd2/d12c 0 2024-04-25T02:08:55.822 INFO:tasks.workunit.client.0.smithi077.stdout:3/812: fsync d0/d2/de/d48/d15/f1d 0 2024-04-25T02:08:55.824 INFO:tasks.workunit.client.0.smithi077.stdout:9/821: mknod df/d1b/d48/db6/c113 0 2024-04-25T02:08:55.825 INFO:tasks.workunit.client.0.smithi077.stdout:6/934: write de/d3b/de8/f11d [2616509,49538] 0 2024-04-25T02:08:55.825 INFO:tasks.workunit.client.0.smithi077.stdout:6/935: fdatasync de/d12/d25/d4b/fee 0 2024-04-25T02:08:55.826 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:55 smithi112 ceph-mon[33313]: pgmap v257: 65 pgs: 65 active+clean; 1.6 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 162 MiB/s rd, 210 MiB/s wr, 474 op/s 2024-04-25T02:08:55.827 INFO:tasks.workunit.client.0.smithi077.stdout:4/843: creat d0/d14/d21/d39/d9d/f114 x:0 0 0 2024-04-25T02:08:55.827 INFO:tasks.workunit.client.0.smithi077.stdout:4/844: stat d0/d14/f33 0 2024-04-25T02:08:55.827 INFO:tasks.workunit.client.0.smithi077.stdout:4/845: stat d0/d14/d21/d39/d9a/le0 0 2024-04-25T02:08:55.827 INFO:tasks.workunit.client.0.smithi077.stdout:4/846: chown d0/d14/d79/da4/dbc/f102 579 1 2024-04-25T02:08:55.827 INFO:tasks.workunit.client.0.smithi077.stdout:4/847: dread - d0/d14/d79/da4/dbc/f103 zero size 2024-04-25T02:08:55.827 INFO:tasks.workunit.client.0.smithi077.stdout:7/755: dread d4/d13/d18/d24/d3f/d58/f7f [0,4194304] 0 2024-04-25T02:08:55.828 INFO:tasks.workunit.client.0.smithi077.stdout:4/848: creat d0/d14/d21/d39/da/d12/d35/f115 x:0 0 0 2024-04-25T02:08:55.828 INFO:tasks.workunit.client.0.smithi077.stdout:7/756: dread - d4/d13/d18/d24/d3f/fe2 zero size 2024-04-25T02:08:55.828 INFO:tasks.workunit.client.0.smithi077.stdout:4/849: creat d0/d14/d21/d39/da/d12/d35/f116 x:0 0 0 2024-04-25T02:08:55.839 INFO:tasks.workunit.client.0.smithi077.stdout:8/938: symlink d3/da/d27/d16/d8c/l139 0 2024-04-25T02:08:55.845 INFO:tasks.workunit.client.0.smithi077.stdout:8/939: dread d3/da/d27/f6c [0,4194304] 0 2024-04-25T02:08:55.847 INFO:tasks.workunit.client.0.smithi077.stdout:1/859: creat db/df/d56/d5d/d77/f11f x:0 0 0 2024-04-25T02:08:55.849 INFO:tasks.workunit.client.0.smithi077.stdout:5/822: creat d0/d25/d82/d87/d8b/da5/dc4/d23/d4a/f107 x:0 0 0 2024-04-25T02:08:55.849 INFO:tasks.workunit.client.0.smithi077.stdout:5/823: fdatasync d0/d25/d82/fd6 0 2024-04-25T02:08:55.851 INFO:tasks.workunit.client.0.smithi077.stdout:3/813: mknod d0/d2/de/c12d 0 2024-04-25T02:08:55.854 INFO:tasks.workunit.client.0.smithi077.stdout:9/822: rename df/f39 to df/d1b/d48/d75/d90/d10f/f114 0 2024-04-25T02:08:55.854 INFO:tasks.workunit.client.0.smithi077.stdout:9/823: chown df/d1b/d56/d67/dff 17396 1 2024-04-25T02:08:55.855 INFO:tasks.workunit.client.0.smithi077.stdout:9/824: dread df/d1b/d48/d75/ff4 [0,4194304] 0 2024-04-25T02:08:55.859 INFO:tasks.workunit.client.0.smithi077.stdout:3/814: dread d0/d2/de/fc7 [0,4194304] 0 2024-04-25T02:08:55.859 INFO:tasks.workunit.client.0.smithi077.stdout:3/815: fsync d0/d17/d4b/fab 0 2024-04-25T02:08:55.859 INFO:tasks.workunit.client.0.smithi077.stdout:3/816: readlink d0/d3e/d93/dae/lbb 0 2024-04-25T02:08:55.859 INFO:tasks.workunit.client.0.smithi077.stdout:3/817: chown d0/d2/de/d36/da0/c11b 2256 1 2024-04-25T02:08:55.859 INFO:tasks.workunit.client.0.smithi077.stdout:3/818: dread - d0/dd3/fe7 zero size 2024-04-25T02:08:55.867 INFO:tasks.workunit.client.0.smithi077.stdout:4/850: getdents d0/d14/d60/dff 0 2024-04-25T02:08:55.870 INFO:tasks.workunit.client.0.smithi077.stdout:7/757: creat d4/d13/d5b/d8b/ff9 x:0 0 0 2024-04-25T02:08:55.873 INFO:tasks.workunit.client.0.smithi077.stdout:8/940: dwrite d3/f6 [0,4194304] 0 2024-04-25T02:08:55.873 INFO:tasks.workunit.client.0.smithi077.stdout:1/860: dwrite db/df/d14/d4d/d82/fab [0,4194304] 0 2024-04-25T02:08:55.877 INFO:tasks.workunit.client.0.smithi077.stdout:4/851: write d0/d14/d21/d39/da/d12/fe4 [748630,34220] 0 2024-04-25T02:08:55.879 INFO:tasks.workunit.client.0.smithi077.stdout:1/861: dread db/df/d14/d4d/fed [0,4194304] 0 2024-04-25T02:08:55.880 INFO:tasks.workunit.client.0.smithi077.stdout:5/824: mknod d0/d25/d82/d87/d8b/da5/dc4/d23/dba/c108 0 2024-04-25T02:08:55.882 INFO:tasks.workunit.client.0.smithi077.stdout:7/758: write d4/d13/f9c [298089,7032] 0 2024-04-25T02:08:55.883 INFO:tasks.workunit.client.0.smithi077.stdout:7/759: chown d4/d13/d18/d2d/d30/dab/cc2 2771 1 2024-04-25T02:08:55.883 INFO:tasks.workunit.client.0.smithi077.stdout:7/760: write d4/d13/d18/d24/d3f/de9/ff3 [205049,93334] 0 2024-04-25T02:08:55.885 INFO:tasks.workunit.client.0.smithi077.stdout:9/825: rename df/d1b/d48/d75/f110 to df/d1b/d48/d75/f115 0 2024-04-25T02:08:55.890 INFO:tasks.workunit.client.0.smithi077.stdout:3/819: rename d0/d2/de/d27/f51 to d0/d17/dd4/d107/f12e 0 2024-04-25T02:08:55.892 INFO:tasks.workunit.client.0.smithi077.stdout:6/936: creat de/d12/d25/de9/f136 x:0 0 0 2024-04-25T02:08:55.894 INFO:tasks.workunit.client.0.smithi077.stdout:4/852: dwrite d0/d14/d79/da4/dac/fe7 [0,4194304] 0 2024-04-25T02:08:55.898 INFO:tasks.workunit.client.0.smithi077.stdout:1/862: mkdir db/df/d14/d4d/d82/d42/d120 0 2024-04-25T02:08:55.898 INFO:tasks.workunit.client.0.smithi077.stdout:1/863: chown db/df/d14/d4d/da9 71311 1 2024-04-25T02:08:55.899 INFO:tasks.workunit.client.0.smithi077.stdout:9/826: write df/fa2 [4148550,71924] 0 2024-04-25T02:08:55.899 INFO:tasks.workunit.client.0.smithi077.stdout:9/827: fsync df/d1b/d56/fae 0 2024-04-25T02:08:55.900 INFO:tasks.workunit.client.0.smithi077.stdout:1/864: dread db/d26/f2f [0,4194304] 0 2024-04-25T02:08:55.900 INFO:tasks.workunit.client.0.smithi077.stdout:5/825: mknod d0/d25/d82/d87/d8b/da5/dc4/c109 0 2024-04-25T02:08:55.905 INFO:tasks.workunit.client.0.smithi077.stdout:7/761: mknod d4/d13/d18/d2d/d30/dab/cfa 0 2024-04-25T02:08:55.907 INFO:tasks.workunit.client.0.smithi077.stdout:6/937: dwrite de/d12/d25/d3a/d6a/f7e [0,4194304] 0 2024-04-25T02:08:55.907 INFO:tasks.workunit.client.0.smithi077.stdout:2/885: sync 2024-04-25T02:08:55.907 INFO:tasks.workunit.client.0.smithi077.stdout:0/813: sync 2024-04-25T02:08:55.908 INFO:tasks.workunit.client.0.smithi077.stdout:7/762: dread d4/d13/d66/f83 [0,4194304] 0 2024-04-25T02:08:55.908 INFO:tasks.workunit.client.0.smithi077.stdout:8/941: rename d3/da/db/fe8 to d3/d34/d3d/f13a 0 2024-04-25T02:08:55.911 INFO:tasks.workunit.client.0.smithi077.stdout:3/820: truncate d0/d2/de/d36/fb7 2513706 0 2024-04-25T02:08:55.916 INFO:tasks.workunit.client.0.smithi077.stdout:0/814: write d2/d8/db6/dd7/d105/ff2 [2353927,113270] 0 2024-04-25T02:08:55.916 INFO:tasks.workunit.client.0.smithi077.stdout:0/815: chown d2/d8/d5f/l89 5692340 1 2024-04-25T02:08:55.917 INFO:tasks.workunit.client.0.smithi077.stdout:4/853: rmdir d0/d14/d21 39 2024-04-25T02:08:55.919 INFO:tasks.workunit.client.0.smithi077.stdout:6/938: read de/d12/f17 [3142371,67096] 0 2024-04-25T02:08:55.920 INFO:tasks.workunit.client.0.smithi077.stdout:3/821: dread d0/d2/de/d48/f44 [0,4194304] 0 2024-04-25T02:08:55.920 INFO:tasks.workunit.client.0.smithi077.stdout:3/822: fsync d0/d3e/d93/fa5 0 2024-04-25T02:08:55.922 INFO:tasks.workunit.client.0.smithi077.stdout:8/942: dwrite d3/da/d27/f21 [4194304,4194304] 0 2024-04-25T02:08:55.927 INFO:tasks.workunit.client.0.smithi077.stdout:5/826: rename d0/d25/dc7/dca/d3e/de7/ffc to d0/d2/d3/d9/d39/d3c/f10a 0 2024-04-25T02:08:55.930 INFO:tasks.workunit.client.0.smithi077.stdout:0/816: truncate d2/d8/dad/fba 2379127 0 2024-04-25T02:08:55.930 INFO:tasks.workunit.client.0.smithi077.stdout:0/817: chown d2/d17/d1d/d34/d4c/da2/f18 3 1 2024-04-25T02:08:55.932 INFO:tasks.workunit.client.0.smithi077.stdout:1/865: dread db/df/d56/f58 [0,4194304] 0 2024-04-25T02:08:55.932 INFO:tasks.workunit.client.0.smithi077.stdout:1/866: readlink db/df/d14/lca 0 2024-04-25T02:08:55.932 INFO:tasks.workunit.client.0.smithi077.stdout:1/867: fdatasync db/d26/f2f 0 2024-04-25T02:08:55.932 INFO:tasks.workunit.client.0.smithi077.stdout:1/868: write db/df/d14/d50/f112 [528575,84304] 0 2024-04-25T02:08:55.933 INFO:tasks.workunit.client.0.smithi077.stdout:0/818: write d2/d27/d2d/fca [2239241,3575] 0 2024-04-25T02:08:55.934 INFO:tasks.workunit.client.0.smithi077.stdout:6/939: creat de/d12/d25/f137 x:0 0 0 2024-04-25T02:08:55.934 INFO:tasks.workunit.client.0.smithi077.stdout:6/940: stat de/d12/d25/d3a/d6a/fef 0 2024-04-25T02:08:55.935 INFO:tasks.workunit.client.0.smithi077.stdout:9/828: getdents df/d1b/d56/d67 0 2024-04-25T02:08:55.937 INFO:tasks.workunit.client.0.smithi077.stdout:3/823: rmdir d0/d2/de/d36/da0/da8 39 2024-04-25T02:08:55.939 INFO:tasks.workunit.client.0.smithi077.stdout:4/854: write d0/d14/d21/d39/d64/f82 [2338972,129316] 0 2024-04-25T02:08:55.939 INFO:tasks.workunit.client.0.smithi077.stdout:4/855: write d0/d14/d60/d86/fdb [860870,43788] 0 2024-04-25T02:08:55.940 INFO:tasks.workunit.client.0.smithi077.stdout:8/943: link d3/da/db/df/d30/c68 d3/da/db/df/ddc/d11a/db0/d105/c13b 0 2024-04-25T02:08:55.940 INFO:tasks.workunit.client.0.smithi077.stdout:8/944: chown d3/da/d27/d16/f66 28959 1 2024-04-25T02:08:55.940 INFO:tasks.workunit.client.0.smithi077.stdout:8/945: truncate d3/da/d27/d16/dbc/f12a 194857 0 2024-04-25T02:08:55.941 INFO:tasks.workunit.client.0.smithi077.stdout:8/946: truncate d3/f7 4719037 0 2024-04-25T02:08:55.942 INFO:tasks.workunit.client.0.smithi077.stdout:7/763: mknod d4/d13/d2c/cfb 0 2024-04-25T02:08:55.943 INFO:tasks.workunit.client.0.smithi077.stdout:7/764: creat d4/d13/d18/ffc x:0 0 0 2024-04-25T02:08:55.948 INFO:tasks.workunit.client.0.smithi077.stdout:2/886: rename d2/d9/d18/d31/d7c/fa1 to d2/d9/d18/d31/d7c/dab/dc8/f126 0 2024-04-25T02:08:55.950 INFO:tasks.workunit.client.0.smithi077.stdout:5/827: link d0/d2/d1b/d35/f4f d0/d25/d82/d87/d8b/da5/dc4/d23/dba/f10b 0 2024-04-25T02:08:55.958 INFO:tasks.workunit.client.0.smithi077.stdout:0/819: truncate d2/d17/d1d/db1/fc6 423729 0 2024-04-25T02:08:55.962 INFO:tasks.workunit.client.0.smithi077.stdout:9/829: symlink df/d1b/d48/l116 0 2024-04-25T02:08:55.964 INFO:tasks.workunit.client.0.smithi077.stdout:3/824: creat d0/d2/de/d36/da6/f12f x:0 0 0 2024-04-25T02:08:55.968 INFO:tasks.workunit.client.0.smithi077.stdout:7/765: creat d4/d13/de8/ffd x:0 0 0 2024-04-25T02:08:55.970 INFO:tasks.workunit.client.0.smithi077.stdout:5/828: creat d0/d25/d82/d87/d8b/da5/dc4/d41/f10c x:0 0 0 2024-04-25T02:08:55.970 INFO:tasks.workunit.client.0.smithi077.stdout:5/829: chown d0/d2/d1b/d35/c42 318 1 2024-04-25T02:08:55.972 INFO:tasks.workunit.client.0.smithi077.stdout:1/869: mknod db/c121 0 2024-04-25T02:08:55.973 INFO:tasks.workunit.client.0.smithi077.stdout:6/941: getdents de/d12/d25/d3a/d6a/dcd/d36/dd2 0 2024-04-25T02:08:55.978 INFO:tasks.workunit.client.0.smithi077.stdout:7/766: unlink d4/d13/d18/d24/d3f/d59/fc9 0 2024-04-25T02:08:55.978 INFO:tasks.workunit.client.0.smithi077.stdout:4/856: dwrite d0/d14/d21/d39/da/d12/d35/d3e/f57 [0,4194304] 0 2024-04-25T02:08:55.979 INFO:tasks.workunit.client.0.smithi077.stdout:8/947: dwrite d3/d7a/f12f [0,4194304] 0 2024-04-25T02:08:55.979 INFO:tasks.workunit.client.0.smithi077.stdout:8/948: read - d3/da/db/df/ddc/d11a/db0/d105/f107 zero size 2024-04-25T02:08:55.979 INFO:tasks.workunit.client.0.smithi077.stdout:8/949: write d3/da/db/df/d2b/d70/f8f [1921632,10958] 0 2024-04-25T02:08:55.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:55 smithi077 ceph-mon[26330]: pgmap v257: 65 pgs: 65 active+clean; 1.6 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 162 MiB/s rd, 210 MiB/s wr, 474 op/s 2024-04-25T02:08:55.980 INFO:tasks.workunit.client.0.smithi077.stdout:5/830: creat d0/d2/d3/d9/d39/d3c/f10d x:0 0 0 2024-04-25T02:08:55.981 INFO:tasks.workunit.client.0.smithi077.stdout:5/831: readlink d0/d25/d82/d87/d8b/da5/dc4/l7a 0 2024-04-25T02:08:55.981 INFO:tasks.workunit.client.0.smithi077.stdout:5/832: write d0/d2/d3/f7d [1050928,53901] 0 2024-04-25T02:08:55.981 INFO:tasks.workunit.client.0.smithi077.stdout:5/833: truncate d0/d2/d1b/d3b/f72 698362 0 2024-04-25T02:08:55.981 INFO:tasks.workunit.client.0.smithi077.stdout:5/834: creat d0/d2/d3/f10e x:0 0 0 2024-04-25T02:08:55.981 INFO:tasks.workunit.client.0.smithi077.stdout:5/835: chown d0/d25/dc7/dca/d3e/de7 161854 1 2024-04-25T02:08:55.981 INFO:tasks.workunit.client.0.smithi077.stdout:6/942: mkdir de/d12/d25/d121/d12f/d138 0 2024-04-25T02:08:55.983 INFO:tasks.workunit.client.0.smithi077.stdout:1/870: dread db/df/d1b/fcc [0,4194304] 0 2024-04-25T02:08:55.990 INFO:tasks.workunit.client.0.smithi077.stdout:8/950: creat d3/da/d27/d16/d6b/f13c x:0 0 0 2024-04-25T02:08:55.990 INFO:tasks.workunit.client.0.smithi077.stdout:8/951: getdents d3/d34/dc9/d128 0 2024-04-25T02:08:55.991 INFO:tasks.workunit.client.0.smithi077.stdout:7/767: dread d4/d13/d18/d24/fcf [0,4194304] 0 2024-04-25T02:08:55.993 INFO:tasks.workunit.client.0.smithi077.stdout:5/836: creat d0/d25/d82/d87/d8b/da5/f10f x:0 0 0 2024-04-25T02:08:55.995 INFO:tasks.workunit.client.0.smithi077.stdout:4/857: mknod d0/d14/d21/c117 0 2024-04-25T02:08:55.997 INFO:tasks.workunit.client.0.smithi077.stdout:1/871: dread db/df/d14/f97 [0,4194304] 0 2024-04-25T02:08:55.997 INFO:tasks.workunit.client.0.smithi077.stdout:2/887: dwrite d2/d9/d2f/d84/d90/dd4/f114 [0,4194304] 0 2024-04-25T02:08:55.997 INFO:tasks.workunit.client.0.smithi077.stdout:2/888: write d2/d9/d19/d2c/f5b [2801606,58237] 0 2024-04-25T02:08:55.998 INFO:tasks.workunit.client.0.smithi077.stdout:8/952: rename d3/da/db/df/d30/cab to d3/da/db/df/ddc/d11a/db0/d105/c13d 0 2024-04-25T02:08:55.998 INFO:tasks.workunit.client.0.smithi077.stdout:8/953: stat d3/d34/d3d/ff9 0 2024-04-25T02:08:56.000 INFO:tasks.workunit.client.0.smithi077.stdout:0/820: dwrite d2/d8/db6/dd7/de0/fef [0,4194304] 0 2024-04-25T02:08:56.001 INFO:tasks.workunit.client.0.smithi077.stdout:0/821: chown d2/d8/db6/dd7/d10c 1874388 1 2024-04-25T02:08:56.001 INFO:tasks.workunit.client.0.smithi077.stdout:3/825: dwrite d0/f23 [0,4194304] 0 2024-04-25T02:08:56.001 INFO:tasks.workunit.client.0.smithi077.stdout:6/943: mkdir de/d12/d25/d44/df5/d139 0 2024-04-25T02:08:56.001 INFO:tasks.workunit.client.0.smithi077.stdout:6/944: stat de/d55/db7/fd3 0 2024-04-25T02:08:56.002 INFO:tasks.workunit.client.0.smithi077.stdout:5/837: dread d0/d25/f36 [0,4194304] 0 2024-04-25T02:08:56.004 INFO:tasks.workunit.client.0.smithi077.stdout:4/858: symlink d0/d14/d79/da4/l118 0 2024-04-25T02:08:56.011 INFO:tasks.workunit.client.0.smithi077.stdout:6/945: dread de/d12/d25/d3a/d6a/dcd/f22 [0,4194304] 0 2024-04-25T02:08:56.019 INFO:tasks.workunit.client.0.smithi077.stdout:7/768: dwrite d4/d13/d18/f40 [0,4194304] 0 2024-04-25T02:08:56.019 INFO:tasks.workunit.client.0.smithi077.stdout:8/954: link d3/da/db/df/d2b/d37/f4d d3/da/db/df/d2b/d7b/f13e 0 2024-04-25T02:08:56.021 INFO:tasks.workunit.client.0.smithi077.stdout:0/822: symlink d2/d8/dfb/l119 0 2024-04-25T02:08:56.023 INFO:tasks.workunit.client.0.smithi077.stdout:1/872: dwrite db/df/d14/d4d/d82/d42/f7c [0,4194304] 0 2024-04-25T02:08:56.024 INFO:tasks.workunit.client.0.smithi077.stdout:4/859: dwrite d0/d14/d79/da4/dbc/f103 [0,4194304] 0 2024-04-25T02:08:56.025 INFO:tasks.workunit.client.0.smithi077.stdout:3/826: creat d0/d3e/d62/d6a/db9/f130 x:0 0 0 2024-04-25T02:08:56.029 INFO:tasks.workunit.client.0.smithi077.stdout:5/838: rename d0/d25/d82/d87/d8b/da5/dc4/d23/d4a/f107 to d0/d2/d3/d9/d39/d44/d5f/f110 0 2024-04-25T02:08:56.030 INFO:tasks.workunit.client.0.smithi077.stdout:5/839: write d0/fd [2950000,79669] 0 2024-04-25T02:08:56.038 INFO:tasks.workunit.client.0.smithi077.stdout:2/889: rmdir d2/d9/d19/d1c/d37/dcb 39 2024-04-25T02:08:56.038 INFO:tasks.workunit.client.0.smithi077.stdout:2/890: fsync d2/d9/d19/d1c/ff8 0 2024-04-25T02:08:56.042 INFO:tasks.workunit.client.0.smithi077.stdout:8/955: symlink d3/da/d27/d16/dbc/l13f 0 2024-04-25T02:08:56.042 INFO:tasks.workunit.client.0.smithi077.stdout:8/956: read - d3/da/db/df/ddc/d11a/db0/ff6 zero size 2024-04-25T02:08:56.044 INFO:tasks.workunit.client.0.smithi077.stdout:0/823: mknod d2/d8/db6/c11a 0 2024-04-25T02:08:56.044 INFO:tasks.workunit.client.0.smithi077.stdout:0/824: readlink d2/d17/l2e 0 2024-04-25T02:08:56.047 INFO:tasks.workunit.client.0.smithi077.stdout:1/873: symlink db/d26/l122 0 2024-04-25T02:08:56.047 INFO:tasks.workunit.client.0.smithi077.stdout:1/874: dread - db/df/d56/d5d/d77/f108 zero size 2024-04-25T02:08:56.047 INFO:tasks.workunit.client.0.smithi077.stdout:1/875: write db/df/d14/d4d/d82/d32/d8f/f103 [654083,116591] 0 2024-04-25T02:08:56.047 INFO:tasks.workunit.client.0.smithi077.stdout:1/876: stat db/df/d14/d3e/d69 0 2024-04-25T02:08:56.047 INFO:tasks.workunit.client.0.smithi077.stdout:1/877: stat db/df/d14/f97 0 2024-04-25T02:08:56.050 INFO:tasks.workunit.client.0.smithi077.stdout:4/860: dwrite d0/d14/d21/d39/da/fe3 [0,4194304] 0 2024-04-25T02:08:56.050 INFO:tasks.workunit.client.0.smithi077.stdout:4/861: dread - d0/d14/d21/d39/fd9 zero size 2024-04-25T02:08:56.051 INFO:tasks.workunit.client.0.smithi077.stdout:7/769: dwrite d4/f16 [0,4194304] 0 2024-04-25T02:08:56.051 INFO:tasks.workunit.client.0.smithi077.stdout:7/770: chown d4/d13/d18/d2d/d56 0 1 2024-04-25T02:08:56.053 INFO:tasks.workunit.client.0.smithi077.stdout:2/891: write d2/d9/d2f/f38 [4056926,39785] 0 2024-04-25T02:08:56.054 INFO:tasks.workunit.client.0.smithi077.stdout:3/827: mknod d0/d3e/d62/d6a/db9/dde/c131 0 2024-04-25T02:08:56.055 INFO:tasks.workunit.client.0.smithi077.stdout:3/828: dread - d0/d3e/d62/faf zero size 2024-04-25T02:08:56.055 INFO:tasks.workunit.client.0.smithi077.stdout:3/829: dread - d0/d2/d83/ff1 zero size 2024-04-25T02:08:56.055 INFO:tasks.workunit.client.0.smithi077.stdout:3/830: write d0/d3e/d42/d64/d88/f9e [951700,40430] 0 2024-04-25T02:08:56.055 INFO:tasks.workunit.client.0.smithi077.stdout:3/831: creat d0/d3e/d62/f132 x:0 0 0 2024-04-25T02:08:56.055 INFO:tasks.workunit.client.0.smithi077.stdout:3/832: chown d0/d2/d83/c92 33343 1 2024-04-25T02:08:56.057 INFO:tasks.workunit.client.0.smithi077.stdout:5/840: creat d0/d2/d3/d9/d39/d44/d5f/dde/f111 x:0 0 0 2024-04-25T02:08:56.059 INFO:tasks.workunit.client.0.smithi077.stdout:6/946: rmdir de/d12/d25/d4b/dd1 39 2024-04-25T02:08:56.064 INFO:tasks.workunit.client.0.smithi077.stdout:8/957: mkdir d3/d7a/d140 0 2024-04-25T02:08:56.066 INFO:tasks.workunit.client.0.smithi077.stdout:0/825: truncate d2/d8/d5f/f6c 3597642 0 2024-04-25T02:08:56.069 INFO:tasks.workunit.client.0.smithi077.stdout:4/862: symlink d0/d14/d60/l119 0 2024-04-25T02:08:56.071 INFO:tasks.workunit.client.0.smithi077.stdout:7/771: symlink d4/d13/d18/d24/d3f/d59/lfe 0 2024-04-25T02:08:56.074 INFO:tasks.workunit.client.0.smithi077.stdout:6/947: write de/d12/d25/d3a/d6a/f7e [3292538,12760] 0 2024-04-25T02:08:56.074 INFO:tasks.workunit.client.0.smithi077.stdout:6/948: readlink de/d53/d76/leb 0 2024-04-25T02:08:56.074 INFO:tasks.workunit.client.0.smithi077.stdout:6/949: write de/d3b/de8/f11d [1451187,120471] 0 2024-04-25T02:08:56.075 INFO:tasks.workunit.client.0.smithi077.stdout:1/878: dwrite db/df/d56/d5d/f10e [0,4194304] 0 2024-04-25T02:08:56.075 INFO:tasks.workunit.client.0.smithi077.stdout:1/879: chown db/df/d14/d4d/d82/d5c/d81 57885 1 2024-04-25T02:08:56.075 INFO:tasks.workunit.client.0.smithi077.stdout:9/830: dwrite df/d1b/d48/d75/d90/fb2 [0,4194304] 0 2024-04-25T02:08:56.076 INFO:tasks.workunit.client.0.smithi077.stdout:2/892: mknod d2/d9/d19/d2c/d72/c127 0 2024-04-25T02:08:56.076 INFO:tasks.workunit.client.0.smithi077.stdout:0/826: dread d2/d8/db6/f113 [0,4194304] 0 2024-04-25T02:08:56.076 INFO:tasks.workunit.client.0.smithi077.stdout:0/827: getdents d2/d17/d1d/d34/d4c/da2/de2/d104 0 2024-04-25T02:08:56.081 INFO:tasks.workunit.client.0.smithi077.stdout:3/833: symlink d0/d2/d2f/d50/l133 0 2024-04-25T02:08:56.081 INFO:tasks.workunit.client.0.smithi077.stdout:3/834: creat d0/d2/d83/f134 x:0 0 0 2024-04-25T02:08:56.084 INFO:tasks.workunit.client.0.smithi077.stdout:5/841: creat d0/d2/d1b/f112 x:0 0 0 2024-04-25T02:08:56.086 INFO:tasks.workunit.client.0.smithi077.stdout:8/958: mkdir d3/da/db/df/d2b/d70/d10f/d141 0 2024-04-25T02:08:56.088 INFO:tasks.workunit.client.0.smithi077.stdout:3/835: dread d0/d3e/d93/fa5 [0,4194304] 0 2024-04-25T02:08:56.090 INFO:tasks.workunit.client.0.smithi077.stdout:4/863: unlink d0/d14/d60/d86/d25/f7f 0 2024-04-25T02:08:56.091 INFO:tasks.workunit.client.0.smithi077.stdout:3/836: dread d0/d2/de/d48/fb2 [0,4194304] 0 2024-04-25T02:08:56.101 INFO:tasks.workunit.client.0.smithi077.stdout:7/772: mknod d4/d13/cff 0 2024-04-25T02:08:56.106 INFO:tasks.workunit.client.0.smithi077.stdout:5/842: dwrite d0/f50 [0,4194304] 0 2024-04-25T02:08:56.112 INFO:tasks.workunit.client.0.smithi077.stdout:1/880: link db/df/d14/d4d/d82/d5c/d81/l9a db/df/d14/dfa/d66/l123 0 2024-04-25T02:08:56.115 INFO:tasks.workunit.client.0.smithi077.stdout:9/831: mkdir df/d80/d117 0 2024-04-25T02:08:56.118 INFO:tasks.workunit.client.0.smithi077.stdout:2/893: mknod d2/d59/c128 0 2024-04-25T02:08:56.122 INFO:tasks.workunit.client.0.smithi077.stdout:0/828: mknod d2/d17/d1d/d34/d4c/da2/d51/de8/d107/c11b 0 2024-04-25T02:08:56.122 INFO:tasks.workunit.client.0.smithi077.stdout:0/829: write d2/d17/d1d/d34/d83/f100 [951616,104299] 0 2024-04-25T02:08:56.123 INFO:tasks.workunit.client.0.smithi077.stdout:2/894: dread d2/d9/d18/d31/d7c/dab/fb2 [0,4194304] 0 2024-04-25T02:08:56.127 INFO:tasks.workunit.client.0.smithi077.stdout:8/959: mkdir d3/da/db/df/ddc/ddf/d142 0 2024-04-25T02:08:56.128 INFO:tasks.workunit.client.0.smithi077.stdout:6/950: dwrite de/d12/d25/f7b [0,4194304] 0 2024-04-25T02:08:56.129 INFO:tasks.workunit.client.0.smithi077.stdout:3/837: truncate d0/d17/d4b/d59/faa 2416235 0 2024-04-25T02:08:56.134 INFO:tasks.workunit.client.0.smithi077.stdout:0/830: dread d2/d17/d1d/d34/f36 [0,4194304] 0 2024-04-25T02:08:56.139 INFO:tasks.workunit.client.0.smithi077.stdout:2/895: dwrite d2/d9/d56/fee [0,4194304] 0 2024-04-25T02:08:56.139 INFO:tasks.workunit.client.0.smithi077.stdout:2/896: fdatasync d2/d28/fd8 0 2024-04-25T02:08:56.139 INFO:tasks.workunit.client.0.smithi077.stdout:2/897: dread - d2/faf zero size 2024-04-25T02:08:56.139 INFO:tasks.workunit.client.0.smithi077.stdout:7/773: creat d4/d13/d18/d2d/f100 x:0 0 0 2024-04-25T02:08:56.143 INFO:tasks.workunit.client.0.smithi077.stdout:3/838: dread d0/d2/de/d48/fca [0,4194304] 0 2024-04-25T02:08:56.156 INFO:tasks.workunit.client.0.smithi077.stdout:5/843: symlink d0/d25/d82/d87/d8b/da5/dc4/d23/l113 0 2024-04-25T02:08:56.182 INFO:tasks.workunit.client.0.smithi077.stdout:1/881: symlink db/df/d14/d4d/da9/l124 0 2024-04-25T02:08:56.182 INFO:tasks.workunit.client.0.smithi077.stdout:1/882: truncate db/df/d14/d33/d6c/fe1 723999 0 2024-04-25T02:08:56.184 INFO:tasks.workunit.client.0.smithi077.stdout:9/832: rename df/d1b/l97 to df/d1b/d70/d84/dde/de9/l118 0 2024-04-25T02:08:56.184 INFO:tasks.workunit.client.0.smithi077.stdout:9/833: write df/d1b/d70/d74/fb8 [4749360,6248] 0 2024-04-25T02:08:56.185 INFO:tasks.workunit.client.0.smithi077.stdout:8/960: unlink d3/da/db/df/d2b/d37/c84 0 2024-04-25T02:08:56.189 INFO:tasks.workunit.client.0.smithi077.stdout:6/951: unlink de/lae 0 2024-04-25T02:08:56.193 INFO:tasks.workunit.client.0.smithi077.stdout:0/831: rmdir d2/d27/d2d/dce/de7/da7/d108 0 2024-04-25T02:08:56.194 INFO:tasks.workunit.client.0.smithi077.stdout:0/832: readlink d2/d17/d1d/d34/l44 0 2024-04-25T02:08:56.196 INFO:tasks.workunit.client.0.smithi077.stdout:8/961: dread d3/da/d27/d16/f22 [4194304,4194304] 0 2024-04-25T02:08:56.200 INFO:tasks.workunit.client.0.smithi077.stdout:2/898: creat d2/d9/d19/d1c/d37/f129 x:0 0 0 2024-04-25T02:08:56.210 INFO:tasks.workunit.client.0.smithi077.stdout:1/883: link db/df/d56/d5d/c9f db/df/d14/d4d/d82/d42/d43/c125 0 2024-04-25T02:08:56.211 INFO:tasks.workunit.client.0.smithi077.stdout:9/834: dwrite df/f49 [0,4194304] 0 2024-04-25T02:08:56.211 INFO:tasks.workunit.client.0.smithi077.stdout:9/835: readlink df/d1b/d70/d84/dde/de9/l118 0 2024-04-25T02:08:56.214 INFO:tasks.workunit.client.0.smithi077.stdout:6/952: write de/d12/d25/f10f [337753,74998] 0 2024-04-25T02:08:56.215 INFO:tasks.workunit.client.0.smithi077.stdout:0/833: creat d2/d8/db6/dd7/d105/f11c x:0 0 0 2024-04-25T02:08:56.217 INFO:tasks.workunit.client.0.smithi077.stdout:8/962: mkdir d3/da/d27/d16/dbc/d143 0 2024-04-25T02:08:56.219 INFO:tasks.workunit.client.0.smithi077.stdout:2/899: creat d2/d59/d79/db4/f12a x:0 0 0 2024-04-25T02:08:56.219 INFO:tasks.workunit.client.0.smithi077.stdout:2/900: chown d2/d9/d18/c57 3567929 1 2024-04-25T02:08:56.220 INFO:tasks.workunit.client.0.smithi077.stdout:2/901: write d2/d78/d95/ff2 [3619309,35502] 0 2024-04-25T02:08:56.221 INFO:tasks.workunit.client.0.smithi077.stdout:5/844: mknod d0/d25/c114 0 2024-04-25T02:08:56.221 INFO:tasks.workunit.client.0.smithi077.stdout:5/845: fsync d0/d2/da8/daf/fd9 0 2024-04-25T02:08:56.223 INFO:tasks.workunit.client.0.smithi077.stdout:1/884: creat db/df/d14/d3e/daa/deb/f126 x:0 0 0 2024-04-25T02:08:56.223 INFO:tasks.workunit.client.0.smithi077.stdout:7/774: dwrite d4/d13/d2c/f92 [0,4194304] 0 2024-04-25T02:08:56.224 INFO:tasks.workunit.client.0.smithi077.stdout:2/902: dread d2/fec [0,4194304] 0 2024-04-25T02:08:56.228 INFO:tasks.workunit.client.0.smithi077.stdout:6/953: dread de/d12/f71 [0,4194304] 0 2024-04-25T02:08:56.229 INFO:tasks.workunit.client.0.smithi077.stdout:0/834: creat d2/d9/d2a/f11d x:0 0 0 2024-04-25T02:08:56.235 INFO:tasks.workunit.client.0.smithi077.stdout:9/836: dread df/d60/d87/fb7 [0,4194304] 0 2024-04-25T02:08:56.247 INFO:tasks.workunit.client.0.smithi077.stdout:2/903: dwrite d2/d9/d18/d31/f8d [4194304,4194304] 0 2024-04-25T02:08:56.248 INFO:tasks.workunit.client.0.smithi077.stdout:0/835: creat d2/d8/dad/f11e x:0 0 0 2024-04-25T02:08:56.249 INFO:tasks.workunit.client.0.smithi077.stdout:6/954: dwrite de/d53/db2/fc3 [0,4194304] 0 2024-04-25T02:08:56.249 INFO:tasks.workunit.client.0.smithi077.stdout:6/955: write de/d12/d25/d3a/d6a/dcd/d36/fa2 [1049545,71852] 0 2024-04-25T02:08:56.249 INFO:tasks.workunit.client.0.smithi077.stdout:1/885: dwrite db/df/d56/d5d/d77/f108 [0,4194304] 0 2024-04-25T02:08:56.250 INFO:tasks.workunit.client.0.smithi077.stdout:9/837: creat df/f119 x:0 0 0 2024-04-25T02:08:56.253 INFO:tasks.workunit.client.0.smithi077.stdout:3/839: rename d0/d2/d2f/db4/db6/df5 to d0/d2/de/d48/d135 0 2024-04-25T02:08:56.253 INFO:tasks.workunit.client.0.smithi077.stdout:1/886: write db/df/d56/f58 [2687196,33826] 0 2024-04-25T02:08:56.253 INFO:tasks.workunit.client.0.smithi077.stdout:1/887: stat db/df/d56/d5d/d77/f11f 0 2024-04-25T02:08:56.257 INFO:tasks.workunit.client.0.smithi077.stdout:6/956: dread de/d12/fa7 [0,4194304] 0 2024-04-25T02:08:56.257 INFO:tasks.workunit.client.0.smithi077.stdout:6/957: fsync de/d12/f7a 0 2024-04-25T02:08:56.257 INFO:tasks.workunit.client.0.smithi077.stdout:6/958: readlink de/d12/d25/d4b/dd1/l106 0 2024-04-25T02:08:56.259 INFO:tasks.workunit.client.0.smithi077.stdout:2/904: creat d2/d9/d18/d1b/f12b x:0 0 0 2024-04-25T02:08:56.261 INFO:tasks.workunit.client.0.smithi077.stdout:1/888: write db/df/d14/d3e/d69/f9e [1626504,83844] 0 2024-04-25T02:08:56.262 INFO:tasks.workunit.client.0.smithi077.stdout:1/889: write db/df/d14/d3e/daa/deb/f126 [747478,11574] 0 2024-04-25T02:08:56.262 INFO:tasks.workunit.client.0.smithi077.stdout:0/836: creat d2/d17/d1d/d34/d4c/da2/d51/de8/f11f x:0 0 0 2024-04-25T02:08:56.271 INFO:tasks.workunit.client.0.smithi077.stdout:1/890: write db/df/d14/d4d/d82/d42/f7c [2682326,42520] 0 2024-04-25T02:08:56.275 INFO:tasks.workunit.client.0.smithi077.stdout:4/864: sync 2024-04-25T02:08:56.276 INFO:tasks.workunit.client.0.smithi077.stdout:6/959: dwrite de/d55/d88/fca [0,4194304] 0 2024-04-25T02:08:56.277 INFO:tasks.workunit.client.0.smithi077.stdout:9/838: dwrite df/f37 [0,4194304] 0 2024-04-25T02:08:56.277 INFO:tasks.workunit.client.0.smithi077.stdout:6/960: chown de/d12/d25/d3a/d6a/dcd/d36/f128 63 1 2024-04-25T02:08:56.277 INFO:tasks.workunit.client.0.smithi077.stdout:6/961: write de/d12/d25/f10f [1460833,40618] 0 2024-04-25T02:08:56.291 INFO:tasks.workunit.client.0.smithi077.stdout:4/865: dwrite d0/d14/f81 [0,4194304] 0 2024-04-25T02:08:56.291 INFO:tasks.workunit.client.0.smithi077.stdout:4/866: write d0/d14/d79/d104/f107 [339421,129524] 0 2024-04-25T02:08:56.295 INFO:tasks.workunit.client.0.smithi077.stdout:5/846: rename d0/d2 to d0/d25/d82/d87/d8b/d115 0 2024-04-25T02:08:56.295 INFO:tasks.workunit.client.0.smithi077.stdout:5/847: write d0/d25/d82/d87/d8b/da5/dc4/f21 [4472056,76088] 0 2024-04-25T02:08:56.297 INFO:tasks.workunit.client.0.smithi077.stdout:1/891: mkdir db/df/d14/dfa/d66/d127 0 2024-04-25T02:08:56.297 INFO:tasks.workunit.client.0.smithi077.stdout:1/892: readlink db/df/d14/d4d/d82/d42/d43/ldd 0 2024-04-25T02:08:56.298 INFO:tasks.workunit.client.0.smithi077.stdout:1/893: fsync db/df/d14/d4d/d82/f39 0 2024-04-25T02:08:56.300 INFO:tasks.workunit.client.0.smithi077.stdout:0/837: unlink d2/d27/d2d/l37 0 2024-04-25T02:08:56.302 INFO:tasks.workunit.client.0.smithi077.stdout:9/839: creat df/d60/d109/f11a x:0 0 0 2024-04-25T02:08:56.305 INFO:tasks.workunit.client.0.smithi077.stdout:6/962: chown de/d12/d25/l2b 612840270 1 2024-04-25T02:08:56.312 INFO:tasks.workunit.client.0.smithi077.stdout:4/867: dwrite d0/d14/d21/d39/da/fe3 [0,4194304] 0 2024-04-25T02:08:56.312 INFO:tasks.workunit.client.0.smithi077.stdout:4/868: readlink d0/d14/d21/d39/d1d/lca 0 2024-04-25T02:08:56.312 INFO:tasks.workunit.client.0.smithi077.stdout:4/869: read d0/d14/d21/d39/d1d/d98/fa1 [239039,68362] 0 2024-04-25T02:08:56.312 INFO:tasks.workunit.client.0.smithi077.stdout:4/870: fdatasync d0/d14/d21/d39/f3b 0 2024-04-25T02:08:56.313 INFO:tasks.workunit.client.0.smithi077.stdout:7/775: rename d4/d13/d5b/d8b/db2/ce3 to d4/d13/d18/d2d/d56/d68/c101 0 2024-04-25T02:08:56.317 INFO:tasks.workunit.client.0.smithi077.stdout:1/894: link db/df/d14/dfa/db4/c119 db/df/d14/dfa/d66/c128 0 2024-04-25T02:08:56.318 INFO:tasks.workunit.client.0.smithi077.stdout:0/838: dwrite d2/d9/d2a/fa9 [0,4194304] 0 2024-04-25T02:08:56.319 INFO:tasks.workunit.client.0.smithi077.stdout:6/963: fdatasync de/d12/d25/f9f 0 2024-04-25T02:08:56.319 INFO:tasks.workunit.client.0.smithi077.stdout:6/964: truncate de/d55/d88/fc0 1978912 0 2024-04-25T02:08:56.329 INFO:tasks.workunit.client.0.smithi077.stdout:4/871: dwrite d0/d14/d21/d39/d64/f82 [4194304,4194304] 0 2024-04-25T02:08:56.337 INFO:tasks.workunit.client.0.smithi077.stdout:7/776: dwrite d4/d13/de8/ffd [0,4194304] 0 2024-04-25T02:08:56.340 INFO:tasks.workunit.client.0.smithi077.stdout:4/872: dread d0/d14/d79/da4/dbc/f102 [0,4194304] 0 2024-04-25T02:08:56.344 INFO:tasks.workunit.client.0.smithi077.stdout:3/840: rename d0/d2/d83/fc0 to d0/d2/d83/d12a/f136 0 2024-04-25T02:08:56.350 INFO:tasks.workunit.client.0.smithi077.stdout:0/839: symlink d2/d27/d2d/dce/de7/da7/l120 0 2024-04-25T02:08:56.358 INFO:tasks.workunit.client.0.smithi077.stdout:4/873: mkdir d0/d14/d21/d39/d1d/d98/df6/d11a 0 2024-04-25T02:08:56.359 INFO:tasks.workunit.client.0.smithi077.stdout:0/840: dread d2/d8/db6/dd7/de0/fef [0,4194304] 0 2024-04-25T02:08:56.365 INFO:tasks.workunit.client.0.smithi077.stdout:2/905: rename d2/d9/d18/d31/d7c/df3/f123 to d2/d9/d2f/d84/f12c 0 2024-04-25T02:08:56.367 INFO:tasks.workunit.client.0.smithi077.stdout:2/906: write d2/d9/d19/d1c/f44 [1468421,120957] 0 2024-04-25T02:08:56.368 INFO:tasks.workunit.client.0.smithi077.stdout:3/841: truncate d0/d3e/d62/f68 4351604 0 2024-04-25T02:08:56.368 INFO:tasks.workunit.client.0.smithi077.stdout:3/842: chown d0/d2/de/d48/fca 7388134 1 2024-04-25T02:08:56.370 INFO:tasks.workunit.client.0.smithi077.stdout:1/895: getdents db/df/d14/d3e/daa 0 2024-04-25T02:08:56.372 INFO:tasks.workunit.client.0.smithi077.stdout:3/843: dread d0/d3e/d93/fa5 [0,4194304] 0 2024-04-25T02:08:56.372 INFO:tasks.workunit.client.0.smithi077.stdout:3/844: write d0/d2/d2f/d50/fe3 [511485,95510] 0 2024-04-25T02:08:56.374 INFO:tasks.workunit.client.0.smithi077.stdout:4/874: unlink d0/d14/d60/f69 0 2024-04-25T02:08:56.374 INFO:tasks.workunit.client.0.smithi077.stdout:4/875: chown d0/d14/d21/d39/f3b 658 1 2024-04-25T02:08:56.374 INFO:tasks.workunit.client.0.smithi077.stdout:4/876: write d0/d14/d60/d62/fa8 [5026776,24907] 0 2024-04-25T02:08:56.377 INFO:tasks.workunit.client.0.smithi077.stdout:0/841: mkdir d2/d17/d121 0 2024-04-25T02:08:56.381 INFO:tasks.workunit.client.0.smithi077.stdout:5/848: rename d0/d25/d82/d87/d8b/da5/f10f to d0/d25/d82/d8d/f116 0 2024-04-25T02:08:56.381 INFO:tasks.workunit.client.0.smithi077.stdout:8/963: sync 2024-04-25T02:08:56.383 INFO:tasks.workunit.client.0.smithi077.stdout:2/907: creat d2/d9/d18/d1b/df5/f12d x:0 0 0 2024-04-25T02:08:56.386 INFO:tasks.workunit.client.0.smithi077.stdout:1/896: symlink db/df/d56/dc3/dcd/l129 0 2024-04-25T02:08:56.388 INFO:tasks.workunit.client.0.smithi077.stdout:1/897: dread db/df/d14/dfa/db4/fe8 [4194304,4194304] 0 2024-04-25T02:08:56.388 INFO:tasks.workunit.client.0.smithi077.stdout:3/845: mknod d0/d3e/dc3/c137 0 2024-04-25T02:08:56.394 INFO:tasks.workunit.client.0.smithi077.stdout:0/842: creat d2/d17/d1d/d34/d4c/da2/d51/de8/d107/f122 x:0 0 0 2024-04-25T02:08:56.397 INFO:tasks.workunit.client.0.smithi077.stdout:9/840: rename df/f41 to df/d1b/d48/dee/f11b 0 2024-04-25T02:08:56.400 INFO:tasks.workunit.client.0.smithi077.stdout:5/849: getdents d0/d25/d82/d87 0 2024-04-25T02:08:56.400 INFO:tasks.workunit.client.0.smithi077.stdout:5/850: readlink d0/d25/d82/d87/d8b/da5/dc4/d23/lb3 0 2024-04-25T02:08:56.400 INFO:tasks.workunit.client.0.smithi077.stdout:5/851: chown d0/d25/d82/d87/d8b/d115/d3/f7d 511 1 2024-04-25T02:08:56.400 INFO:tasks.workunit.client.0.smithi077.stdout:5/852: fdatasync d0/d25/d82/d87/d8b/d115/d3/d9/d39/d44/d5f/f60 0 2024-04-25T02:08:56.403 INFO:tasks.workunit.client.0.smithi077.stdout:1/898: dwrite db/df/d56/d5d/fd6 [4194304,4194304] 0 2024-04-25T02:08:56.403 INFO:tasks.workunit.client.0.smithi077.stdout:1/899: chown db/df/d1b/fcc 130 1 2024-04-25T02:08:56.407 INFO:tasks.workunit.client.0.smithi077.stdout:1/900: dread db/df/d56/f58 [0,4194304] 0 2024-04-25T02:08:56.407 INFO:tasks.workunit.client.0.smithi077.stdout:1/901: creat db/df/d56/d5d/d77/f12a x:0 0 0 2024-04-25T02:08:56.407 INFO:tasks.workunit.client.0.smithi077.stdout:1/902: write db/df/d56/d5d/d77/f11f [157642,73048] 0 2024-04-25T02:08:56.410 INFO:tasks.workunit.client.0.smithi077.stdout:0/843: symlink d2/d17/d4e/d5e/d115/l123 0 2024-04-25T02:08:56.410 INFO:tasks.workunit.client.0.smithi077.stdout:0/844: write d2/d17/d1d/f3d [1233242,33203] 0 2024-04-25T02:08:56.414 INFO:tasks.workunit.client.0.smithi077.stdout:6/965: rename de/d12/d25/d44/df5/fe3 to de/d3b/f13a 0 2024-04-25T02:08:56.414 INFO:tasks.workunit.client.0.smithi077.stdout:6/966: chown de/d55/d88/fc0 14 1 2024-04-25T02:08:56.418 INFO:tasks.workunit.client.0.smithi077.stdout:9/841: link df/d1b/d48/l9b df/d1b/d48/d75/d90/dfe/l11c 0 2024-04-25T02:08:56.419 INFO:tasks.workunit.client.0.smithi077.stdout:1/903: dwrite db/df/d14/d3e/d69/dad/f101 [0,4194304] 0 2024-04-25T02:08:56.427 INFO:tasks.workunit.client.0.smithi077.stdout:3/846: getdents d0/d2 0 2024-04-25T02:08:56.430 INFO:tasks.workunit.client.0.smithi077.stdout:0/845: creat d2/d8/db6/dd7/f124 x:0 0 0 2024-04-25T02:08:56.434 INFO:tasks.workunit.client.0.smithi077.stdout:6/967: symlink de/d5b/d125/l13b 0 2024-04-25T02:08:56.434 INFO:tasks.workunit.client.0.smithi077.stdout:6/968: write de/d3b/de8/f11d [1737561,116958] 0 2024-04-25T02:08:56.437 INFO:tasks.workunit.client.0.smithi077.stdout:9/842: mkdir df/d1b/d56/ddf/d11d 0 2024-04-25T02:08:56.437 INFO:tasks.workunit.client.0.smithi077.stdout:9/843: write df/f2f [7655841,15823] 0 2024-04-25T02:08:56.437 INFO:tasks.workunit.client.0.smithi077.stdout:9/844: fsync df/d1b/d48/d75/fb9 0 2024-04-25T02:08:56.438 INFO:tasks.workunit.client.0.smithi077.stdout:1/904: symlink db/df/d14/d4d/da9/de4/l12b 0 2024-04-25T02:08:56.438 INFO:tasks.workunit.client.0.smithi077.stdout:1/905: stat db/df/d1b/f6f 0 2024-04-25T02:08:56.439 INFO:tasks.workunit.client.0.smithi077.stdout:5/853: rmdir d0/d25/dc7/dca/d3e/de7 39 2024-04-25T02:08:56.446 INFO:tasks.workunit.client.0.smithi077.stdout:3/847: creat d0/d3e/d42/d123/d128/f138 x:0 0 0 2024-04-25T02:08:56.448 INFO:tasks.workunit.client.0.smithi077.stdout:0/846: link d2/d17/d1d/d34/d4c/da2/l19 d2/d27/d2d/dfe/l125 0 2024-04-25T02:08:56.449 INFO:tasks.workunit.client.0.smithi077.stdout:0/847: write d2/d9/d2a/f58 [1694709,95045] 0 2024-04-25T02:08:56.451 INFO:tasks.workunit.client.0.smithi077.stdout:6/969: rmdir de/d3b 39 2024-04-25T02:08:56.451 INFO:tasks.workunit.client.0.smithi077.stdout:6/970: creat de/d53/d76/d10a/f13c x:0 0 0 2024-04-25T02:08:56.453 INFO:tasks.workunit.client.0.smithi077.stdout:3/848: read d0/d17/f37 [3010770,10362] 0 2024-04-25T02:08:56.454 INFO:tasks.workunit.client.0.smithi077.stdout:9/845: rmdir df/d1b/d56/d67/dff 39 2024-04-25T02:08:56.455 INFO:tasks.workunit.client.0.smithi077.stdout:1/906: symlink db/df/d14/d4d/da9/de4/l12c 0 2024-04-25T02:08:56.456 INFO:tasks.workunit.client.0.smithi077.stdout:6/971: dread de/d12/fa7 [0,4194304] 0 2024-04-25T02:08:56.456 INFO:tasks.workunit.client.0.smithi077.stdout:6/972: dread - de/d53/d76/d10a/f12d zero size 2024-04-25T02:08:56.456 INFO:tasks.workunit.client.0.smithi077.stdout:6/973: fsync de/d55/d88/fb5 0 2024-04-25T02:08:56.457 INFO:tasks.workunit.client.0.smithi077.stdout:5/854: truncate d0/d25/d82/d87/d8b/d115/d3/d9/d39/d3c/f93 572567 0 2024-04-25T02:08:56.457 INFO:tasks.workunit.client.0.smithi077.stdout:5/855: stat d0/d25/d82/d87/d8b/d5a 0 2024-04-25T02:08:56.462 INFO:tasks.workunit.client.0.smithi077.stdout:3/849: write d0/d3e/d62/f68 [1205168,4876] 0 2024-04-25T02:08:56.463 INFO:tasks.workunit.client.0.smithi077.stdout:3/850: chown d0/d2/de/d27/led 0 1 2024-04-25T02:08:56.465 INFO:tasks.workunit.client.0.smithi077.stdout:3/851: dread d0/d17/d4b/d59/faa [0,4194304] 0 2024-04-25T02:08:56.467 INFO:tasks.workunit.client.0.smithi077.stdout:5/856: write d0/d25/d82/d87/d8b/d115/d1b/f26 [1645499,15492] 0 2024-04-25T02:08:56.468 INFO:tasks.workunit.client.0.smithi077.stdout:4/877: rename d0/d14/d21/d39/d9d to d0/d14/d60/d78/dce/d11b 0 2024-04-25T02:08:56.475 INFO:tasks.workunit.client.0.smithi077.stdout:9/846: symlink df/d1b/d48/d75/d90/d10f/l11e 0 2024-04-25T02:08:56.478 INFO:tasks.workunit.client.0.smithi077.stdout:1/907: creat db/df/d14/d4d/d82/d32/f12d x:0 0 0 2024-04-25T02:08:56.479 INFO:tasks.workunit.client.0.smithi077.stdout:1/908: chown db/df/d14/d4d/d82/d42/d43/c80 32189437 1 2024-04-25T02:08:56.479 INFO:tasks.workunit.client.0.smithi077.stdout:1/909: truncate db/df/f1d 5386732 0 2024-04-25T02:08:56.479 INFO:tasks.workunit.client.0.smithi077.stdout:1/910: dread - db/df/d14/d4d/d82/d32/d8f/fda zero size 2024-04-25T02:08:56.480 INFO:tasks.workunit.client.0.smithi077.stdout:6/974: mknod de/d55/dc2/c13d 0 2024-04-25T02:08:56.480 INFO:tasks.workunit.client.0.smithi077.stdout:6/975: fdatasync de/d12/d25/d4b/fe4 0 2024-04-25T02:08:56.484 INFO:tasks.workunit.client.0.smithi077.stdout:3/852: creat d0/d10d/f139 x:0 0 0 2024-04-25T02:08:56.484 INFO:tasks.workunit.client.0.smithi077.stdout:3/853: dread - d0/d2/de/d27/fc9 zero size 2024-04-25T02:08:56.484 INFO:tasks.workunit.client.0.smithi077.stdout:3/854: fsync d0/d2/de/d36/fb8 0 2024-04-25T02:08:56.487 INFO:tasks.workunit.client.0.smithi077.stdout:0/848: getdents d2/d17/d1d/d34/d4c/da2/d51/de8/d107 0 2024-04-25T02:08:56.491 INFO:tasks.workunit.client.0.smithi077.stdout:5/857: symlink d0/d25/d82/d87/d8b/d115/d3/d9/d39/d3c/dc6/l117 0 2024-04-25T02:08:56.491 INFO:tasks.workunit.client.0.smithi077.stdout:5/858: creat d0/d25/d82/d87/d8b/da5/dc4/d23/d4a/f118 x:0 0 0 2024-04-25T02:08:56.492 INFO:tasks.workunit.client.0.smithi077.stdout:1/911: dwrite db/df/d14/d3e/d69/dad/f101 [0,4194304] 0 2024-04-25T02:08:56.492 INFO:tasks.workunit.client.0.smithi077.stdout:1/912: chown db/df/d14/dfa/l93 93725312 1 2024-04-25T02:08:56.492 INFO:tasks.workunit.client.0.smithi077.stdout:1/913: write db/df/d14/f17 [1497563,38500] 0 2024-04-25T02:08:56.493 INFO:tasks.workunit.client.0.smithi077.stdout:2/908: rename d2/d9/ddc/dad/cd9 to d2/d9/d19/d2c/d72/df4/c12e 0 2024-04-25T02:08:56.501 INFO:tasks.workunit.client.0.smithi077.stdout:5/859: creat d0/d25/d82/d87/d8b/d115/d3/d9/d90/f119 x:0 0 0 2024-04-25T02:08:56.502 INFO:tasks.workunit.client.0.smithi077.stdout:8/964: sync 2024-04-25T02:08:56.502 INFO:tasks.workunit.client.0.smithi077.stdout:7/777: sync 2024-04-25T02:08:56.509 INFO:tasks.workunit.client.0.smithi077.stdout:9/847: rename df/d1b/d48/db6/c113 to df/d1b/d56/c11f 0 2024-04-25T02:08:56.509 INFO:tasks.workunit.client.0.smithi077.stdout:9/848: chown df/l3a 2115 1 2024-04-25T02:08:56.512 INFO:tasks.workunit.client.0.smithi077.stdout:2/909: creat d2/d28/f12f x:0 0 0 2024-04-25T02:08:56.512 INFO:tasks.workunit.client.0.smithi077.stdout:2/910: creat d2/d9/d18/d1b/f130 x:0 0 0 2024-04-25T02:08:56.513 INFO:tasks.workunit.client.0.smithi077.stdout:5/860: mkdir d0/d25/d82/d87/d8b/d115/d3/d11a 0 2024-04-25T02:08:56.515 INFO:tasks.workunit.client.0.smithi077.stdout:8/965: getdents d3/da/db/df/d2b/d70 0 2024-04-25T02:08:56.515 INFO:tasks.workunit.client.0.smithi077.stdout:5/861: dread d0/d25/d82/d87/d8b/da5/dc4/d23/fd2 [0,4194304] 0 2024-04-25T02:08:56.517 INFO:tasks.workunit.client.0.smithi077.stdout:7/778: truncate d4/d13/d18/d2d/d56/f67 284156 0 2024-04-25T02:08:56.520 INFO:tasks.workunit.client.0.smithi077.stdout:1/914: mkdir db/df/d14/d12e 0 2024-04-25T02:08:56.520 INFO:tasks.workunit.client.0.smithi077.stdout:1/915: fsync db/df/d56/d5d/d77/f12a 0 2024-04-25T02:08:56.523 INFO:tasks.workunit.client.0.smithi077.stdout:6/976: rename de/d53/d6f/cfa to de/d55/d88/c13e 0 2024-04-25T02:08:56.523 INFO:tasks.workunit.client.0.smithi077.stdout:6/977: fdatasync de/d12/d25/d3a/d6a/dcd/d36/f56 0 2024-04-25T02:08:56.525 INFO:tasks.workunit.client.0.smithi077.stdout:9/849: creat df/d1b/d48/d75/d90/d10f/f120 x:0 0 0 2024-04-25T02:08:56.525 INFO:tasks.workunit.client.0.smithi077.stdout:9/850: dread - df/d1b/d48/db6/fe6 zero size 2024-04-25T02:08:56.525 INFO:tasks.workunit.client.0.smithi077.stdout:8/966: dread d3/f7 [0,4194304] 0 2024-04-25T02:08:56.525 INFO:tasks.workunit.client.0.smithi077.stdout:8/967: truncate d3/da/db/df/ddc/d11a/db0/d105/f107 566881 0 2024-04-25T02:08:56.528 INFO:tasks.workunit.client.0.smithi077.stdout:2/911: link d2/d9/d18/d31/c9c d2/d9/d19/d1c/d3f/d53/d86/dca/c131 0 2024-04-25T02:08:56.530 INFO:tasks.workunit.client.0.smithi077.stdout:5/862: creat d0/d25/d82/d87/d8b/d115/d1b/d35/f11b x:0 0 0 2024-04-25T02:08:56.530 INFO:tasks.workunit.client.0.smithi077.stdout:5/863: truncate d0/d25/d82/d87/d8b/d115/d3/d9/d39/d3c/fd8 872302 0 2024-04-25T02:08:56.533 INFO:tasks.workunit.client.0.smithi077.stdout:7/779: truncate d4/d13/d18/d2d/fae 733110 0 2024-04-25T02:08:56.533 INFO:tasks.workunit.client.0.smithi077.stdout:7/780: dread - d4/d13/d18/d24/d3f/de9/ff7 zero size 2024-04-25T02:08:56.533 INFO:tasks.workunit.client.0.smithi077.stdout:7/781: readlink d4/lc 0 2024-04-25T02:08:56.537 INFO:tasks.workunit.client.0.smithi077.stdout:1/916: unlink db/df/d14/d4d/d82/d32/c96 0 2024-04-25T02:08:56.537 INFO:tasks.workunit.client.0.smithi077.stdout:2/912: write d2/d9/d19/d1c/d3f/d53/f8a [1790659,3424] 0 2024-04-25T02:08:56.541 INFO:tasks.workunit.client.0.smithi077.stdout:7/782: dread d4/d13/d18/d2d/d30/f42 [0,4194304] 0 2024-04-25T02:08:56.543 INFO:tasks.workunit.client.0.smithi077.stdout:6/978: truncate de/f46 1521362 0 2024-04-25T02:08:56.544 INFO:tasks.workunit.client.0.smithi077.stdout:1/917: write db/df/d14/f97 [638731,78855] 0 2024-04-25T02:08:56.547 INFO:tasks.workunit.client.0.smithi077.stdout:9/851: mknod df/d1b/d48/d75/d90/d10f/c121 0 2024-04-25T02:08:56.547 INFO:tasks.workunit.client.0.smithi077.stdout:9/852: write df/f14 [3637814,126010] 0 2024-04-25T02:08:56.547 INFO:tasks.workunit.client.0.smithi077.stdout:9/853: creat df/d1b/d70/d84/dde/f122 x:0 0 0 2024-04-25T02:08:56.547 INFO:tasks.workunit.client.0.smithi077.stdout:9/854: write df/d1b/d70/d84/fda [968056,18906] 0 2024-04-25T02:08:56.549 INFO:tasks.workunit.client.0.smithi077.stdout:5/864: dwrite d0/d25/d82/d87/d8b/d115/d3/d9/d39/d44/d5f/da4/fed [0,4194304] 0 2024-04-25T02:08:56.551 INFO:tasks.workunit.client.0.smithi077.stdout:8/968: link d3/da/db/df/d2b/d37/f4d d3/da/db/df/d2b/d37/dfb/f144 0 2024-04-25T02:08:56.551 INFO:tasks.workunit.client.0.smithi077.stdout:8/969: write d3/d7a/fb8 [4105753,55034] 0 2024-04-25T02:08:56.558 INFO:tasks.workunit.client.0.smithi077.stdout:7/783: creat d4/d13/da9/f102 x:0 0 0 2024-04-25T02:08:56.558 INFO:tasks.workunit.client.0.smithi077.stdout:7/784: fdatasync d4/d13/d66/f73 0 2024-04-25T02:08:56.562 INFO:tasks.workunit.client.0.smithi077.stdout:2/913: dwrite d2/d78/d95/fe9 [0,4194304] 0 2024-04-25T02:08:56.562 INFO:tasks.workunit.client.0.smithi077.stdout:6/979: creat de/d12/d25/d4b/dd1/f13f x:0 0 0 2024-04-25T02:08:56.566 INFO:tasks.workunit.client.0.smithi077.stdout:1/918: link db/df/d14/dfa/db4/ff6 db/df/d14/d4d/d82/d5c/d81/f12f 0 2024-04-25T02:08:56.566 INFO:tasks.workunit.client.0.smithi077.stdout:1/919: getdents db/df/d14/d3e/daa 0 2024-04-25T02:08:56.566 INFO:tasks.workunit.client.0.smithi077.stdout:1/920: stat db/df/d14/d50/fe7 0 2024-04-25T02:08:56.574 INFO:tasks.workunit.client.0.smithi077.stdout:9/855: creat df/d60/d87/f123 x:0 0 0 2024-04-25T02:08:56.575 INFO:tasks.workunit.client.0.smithi077.stdout:1/921: dread db/df/d14/d4d/d82/fab [0,4194304] 0 2024-04-25T02:08:56.576 INFO:tasks.workunit.client.0.smithi077.stdout:1/922: chown db/l85 3396 1 2024-04-25T02:08:56.576 INFO:tasks.workunit.client.0.smithi077.stdout:1/923: getdents db/df/d14/d3e/daa 0 2024-04-25T02:08:56.585 INFO:tasks.workunit.client.0.smithi077.stdout:5/865: creat d0/d25/d82/d87/f11c x:0 0 0 2024-04-25T02:08:56.592 INFO:tasks.workunit.client.0.smithi077.stdout:3/855: rename d0/d3e/d62/dba to d0/d2/de/d27/d13a 0 2024-04-25T02:08:56.592 INFO:tasks.workunit.client.0.smithi077.stdout:0/849: rename d2/d27/d2d/dce/de7 to d2/d27/d2d/dce/de7/da7/ddf/d126 22 2024-04-25T02:08:56.593 INFO:tasks.workunit.client.0.smithi077.stdout:3/856: stat d0/d3e 0 2024-04-25T02:08:56.593 INFO:tasks.workunit.client.0.smithi077.stdout:3/857: write d0/d17/d4b/d59/d81/f95 [927263,106145] 0 2024-04-25T02:08:56.593 INFO:tasks.workunit.client.0.smithi077.stdout:3/858: chown d0/d3e/d93/dae 63562 1 2024-04-25T02:08:56.601 INFO:tasks.workunit.client.0.smithi077.stdout:9/856: dwrite df/f37 [4194304,4194304] 0 2024-04-25T02:08:56.601 INFO:tasks.workunit.client.0.smithi077.stdout:9/857: chown df/f18 793 1 2024-04-25T02:08:56.602 INFO:tasks.workunit.client.0.smithi077.stdout:3/859: dread d0/d3e/d62/d6a/d6e/f85 [0,4194304] 0 2024-04-25T02:08:56.615 INFO:tasks.workunit.client.0.smithi077.stdout:2/914: mknod d2/d9/ddc/dc4/c132 0 2024-04-25T02:08:56.615 INFO:tasks.workunit.client.0.smithi077.stdout:2/915: dread - d2/d9/d19/d1c/d3f/fae zero size 2024-04-25T02:08:56.623 INFO:tasks.workunit.client.0.smithi077.stdout:6/980: mkdir de/d12/d25/d121/d12f/d140 0 2024-04-25T02:08:56.624 INFO:tasks.workunit.client.0.smithi077.stdout:1/924: truncate db/df/d56/d5d/d77/f108 3184047 0 2024-04-25T02:08:56.627 INFO:tasks.workunit.client.0.smithi077.stdout:5/866: symlink d0/d25/d82/d87/d8b/d115/d1b/d35/df3/l11d 0 2024-04-25T02:08:56.629 INFO:tasks.workunit.client.0.smithi077.stdout:8/970: getdents d3/d81/d86/d126 0 2024-04-25T02:08:56.631 INFO:tasks.workunit.client.0.smithi077.stdout:0/850: mkdir d2/d17/d1d/d34/d127 0 2024-04-25T02:08:56.631 INFO:tasks.workunit.client.0.smithi077.stdout:0/851: dread - d2/d17/d1d/d34/d4c/da2/d51/de8/d107/f122 zero size 2024-04-25T02:08:56.631 INFO:tasks.workunit.client.0.smithi077.stdout:0/852: chown d2/d17/d1d/d34/d4c/da2/d51/de8/d107/cbb 0 1 2024-04-25T02:08:56.632 INFO:tasks.workunit.client.0.smithi077.stdout:7/785: link d4/d13/da9/f102 d4/d13/d18/d24/d3f/f103 0 2024-04-25T02:08:56.637 INFO:tasks.workunit.client.0.smithi077.stdout:8/971: dread d3/f2a [0,4194304] 0 2024-04-25T02:08:56.640 INFO:tasks.workunit.client.0.smithi077.stdout:6/981: creat de/d55/dc2/f141 x:0 0 0 2024-04-25T02:08:56.640 INFO:tasks.workunit.client.0.smithi077.stdout:6/982: creat de/d53/d76/d10a/f142 x:0 0 0 2024-04-25T02:08:56.640 INFO:tasks.workunit.client.0.smithi077.stdout:2/916: dwrite d2/d78/d95/ff2 [0,4194304] 0 2024-04-25T02:08:56.640 INFO:tasks.workunit.client.0.smithi077.stdout:2/917: read - d2/d9/d2f/f102 zero size 2024-04-25T02:08:56.641 INFO:tasks.workunit.client.0.smithi077.stdout:7/786: mkdir d4/d7c/d104 0 2024-04-25T02:08:56.642 INFO:tasks.workunit.client.0.smithi077.stdout:9/858: getdents df/d1b/d48/d75/d90 0 2024-04-25T02:08:56.645 INFO:tasks.workunit.client.0.smithi077.stdout:6/983: stat de/d12/d25/d4b/cf2 0 2024-04-25T02:08:56.647 INFO:tasks.workunit.client.0.smithi077.stdout:7/787: write d4/d13/d66/f8f [294248,17100] 0 2024-04-25T02:08:56.649 INFO:tasks.workunit.client.0.smithi077.stdout:7/788: dread d4/d13/d18/fcd [0,4194304] 0 2024-04-25T02:08:56.649 INFO:tasks.workunit.client.0.smithi077.stdout:7/789: chown d4/d13/d18/d24/d3f/de9/ff7 9087753 1 2024-04-25T02:08:56.649 INFO:tasks.workunit.client.0.smithi077.stdout:7/790: stat d4/d13/d18/d24/d3f/d59/dd6 0 2024-04-25T02:08:56.649 INFO:tasks.workunit.client.0.smithi077.stdout:7/791: getdents d4/dd2/dda 0 2024-04-25T02:08:56.651 INFO:tasks.workunit.client.0.smithi077.stdout:9/859: symlink df/d1b/d48/d75/d90/d10f/l124 0 2024-04-25T02:08:56.654 INFO:tasks.workunit.client.0.smithi077.stdout:6/984: mknod de/d12/d25/d121/d12f/d140/c143 0 2024-04-25T02:08:56.654 INFO:tasks.workunit.client.0.smithi077.stdout:6/985: stat de/d55/db7/fd3 0 2024-04-25T02:08:56.654 INFO:tasks.workunit.client.0.smithi077.stdout:6/986: dread - de/d12/d25/de9/f136 zero size 2024-04-25T02:08:56.655 INFO:tasks.workunit.client.0.smithi077.stdout:4/878: sync 2024-04-25T02:08:56.655 INFO:tasks.workunit.client.0.smithi077.stdout:1/925: dread db/df/d56/d5d/d77/f108 [0,4194304] 0 2024-04-25T02:08:56.656 INFO:tasks.workunit.client.0.smithi077.stdout:7/792: link d4/d13/d18/d2d/d30/f34 d4/d13/d5b/d8b/f105 0 2024-04-25T02:08:56.656 INFO:tasks.workunit.client.0.smithi077.stdout:7/793: stat d4/d13/d5b 0 2024-04-25T02:08:56.656 INFO:tasks.workunit.client.0.smithi077.stdout:7/794: chown d4/d13/d18/d24/d3f/d58/f2b 126 1 2024-04-25T02:08:56.656 INFO:tasks.workunit.client.0.smithi077.stdout:7/795: write d4/d13/d18/d24/d3f/f103 [986008,125957] 0 2024-04-25T02:08:56.656 INFO:tasks.workunit.client.0.smithi077.stdout:7/796: creat d4/dd2/f106 x:0 0 0 2024-04-25T02:08:56.657 INFO:tasks.workunit.client.0.smithi077.stdout:2/918: getdents d2/d9/d18/d31/d7c/df3 0 2024-04-25T02:08:56.662 INFO:tasks.workunit.client.0.smithi077.stdout:6/987: rename f0 to de/d12/d25/d3a/d6a/dcd/d36/f144 0 2024-04-25T02:08:56.665 INFO:tasks.workunit.client.0.smithi077.stdout:4/879: write d0/d14/f8b [1316937,70800] 0 2024-04-25T02:08:56.668 INFO:tasks.workunit.client.0.smithi077.stdout:2/919: mknod d2/d9/d19/d1c/c133 0 2024-04-25T02:08:56.668 INFO:tasks.workunit.client.0.smithi077.stdout:2/920: write d2/d9/d19/d1c/d37/dcb/f10d [1991,56806] 0 2024-04-25T02:08:56.671 INFO:tasks.workunit.client.0.smithi077.stdout:9/860: dwrite df/d1b/d56/dbd/ff6 [0,4194304] 0 2024-04-25T02:08:56.671 INFO:tasks.workunit.client.0.smithi077.stdout:9/861: read df/d1b/f6e [3793906,81725] 0 2024-04-25T02:08:56.673 INFO:tasks.workunit.client.0.smithi077.stdout:6/988: symlink de/d5b/l145 0 2024-04-25T02:08:56.673 INFO:tasks.workunit.client.0.smithi077.stdout:6/989: fsync de/d12/dba/f11a 0 2024-04-25T02:08:56.674 INFO:tasks.workunit.client.0.smithi077.stdout:1/926: dread f8 [0,4194304] 0 2024-04-25T02:08:56.683 INFO:tasks.workunit.client.0.smithi077.stdout:4/880: creat d0/d14/d79/da4/dac/f11c x:0 0 0 2024-04-25T02:08:56.683 INFO:tasks.workunit.client.0.smithi077.stdout:7/797: getdents d4/d13/da9 0 2024-04-25T02:08:56.690 INFO:tasks.workunit.client.0.smithi077.stdout:9/862: unlink df/d1b/d70/ca1 0 2024-04-25T02:08:56.698 INFO:tasks.workunit.client.0.smithi077.stdout:9/863: link df/d60/f83 df/d1b/d70/d84/dde/de9/f125 0 2024-04-25T02:08:56.700 INFO:tasks.workunit.client.0.smithi077.stdout:1/927: dwrite db/df/d14/d3e/f54 [0,4194304] 0 2024-04-25T02:08:56.701 INFO:tasks.workunit.client.0.smithi077.stdout:2/921: dwrite d2/d9/f8c [0,4194304] 0 2024-04-25T02:08:56.701 INFO:tasks.workunit.client.0.smithi077.stdout:2/922: creat d2/d9/d18/d31/d7c/dab/dc8/f134 x:0 0 0 2024-04-25T02:08:56.701 INFO:tasks.workunit.client.0.smithi077.stdout:2/923: chown d2/d9/d18/l1f 2093828389 1 2024-04-25T02:08:56.701 INFO:tasks.workunit.client.0.smithi077.stdout:6/990: dwrite de/d53/f7c [0,4194304] 0 2024-04-25T02:08:56.701 INFO:tasks.workunit.client.0.smithi077.stdout:6/991: stat de/d53/d78/ff3 0 2024-04-25T02:08:56.743 INFO:tasks.workunit.client.0.smithi077.stdout:9/864: mknod df/d1b/d70/d84/dde/c126 0 2024-04-25T02:08:56.754 INFO:tasks.workunit.client.0.smithi077.stdout:2/924: link d2/d9/ddc/dad/fba d2/d59/d79/db4/f135 0 2024-04-25T02:08:56.760 INFO:tasks.workunit.client.0.smithi077.stdout:9/865: dwrite df/d1b/d56/d67/f103 [0,4194304] 0 2024-04-25T02:08:56.833 INFO:tasks.workunit.client.0.smithi077.stdout:4/881: rename d0/d14/d60/d86/d34/cba to d0/d14/d79/c11d 0 2024-04-25T02:08:56.892 INFO:tasks.workunit.client.0.smithi077.stdout:4/882: fdatasync d0/d14/d21/f2f 0 2024-04-25T02:08:56.897 INFO:tasks.workunit.client.0.smithi077.stdout:9/866: write df/d1b/f30 [437652,51539] 0 2024-04-25T02:08:56.927 INFO:tasks.workunit.client.0.smithi077.stdout:3/860: sync 2024-04-25T02:08:56.936 INFO:tasks.workunit.client.0.smithi077.stdout:4/883: creat d0/f11e x:0 0 0 2024-04-25T02:08:56.937 INFO:tasks.workunit.client.0.smithi077.stdout:9/867: link df/d1b/d48/db6/le7 df/d1b/d70/l127 0 2024-04-25T02:08:56.937 INFO:tasks.workunit.client.0.smithi077.stdout:9/868: chown df/l3a 1455 1 2024-04-25T02:08:56.938 INFO:tasks.workunit.client.0.smithi077.stdout:4/884: dread d0/d14/d79/d104/f107 [0,4194304] 0 2024-04-25T02:08:56.938 INFO:tasks.workunit.client.0.smithi077.stdout:4/885: chown d0/d14/d79/da4 1055488351 1 2024-04-25T02:08:56.940 INFO:tasks.workunit.client.0.smithi077.stdout:4/886: creat d0/d14/d60/d86/d25/f11f x:0 0 0 2024-04-25T02:08:56.940 INFO:tasks.workunit.client.0.smithi077.stdout:4/887: stat d0/d14/d60/d86/f6d 0 2024-04-25T02:08:56.945 INFO:tasks.workunit.client.0.smithi077.stdout:4/888: mknod d0/d14/d21/d39/da/d12/d35/d3e/c120 0 2024-04-25T02:08:56.958 INFO:tasks.workunit.client.0.smithi077.stdout:6/992: mkdir de/d12/d25/d3a/d6a/dcd/d36/d146 0 2024-04-25T02:08:56.959 INFO:tasks.workunit.client.0.smithi077.stdout:6/993: dread de/d12/d25/d38/fb1 [0,4194304] 0 2024-04-25T02:08:56.959 INFO:tasks.workunit.client.0.smithi077.stdout:6/994: write de/d12/d25/f83 [4878596,59030] 0 2024-04-25T02:08:56.964 INFO:tasks.workunit.client.0.smithi077.stdout:1/928: rename db/f59 to db/df/d14/d4d/d82/d10f/f130 0 2024-04-25T02:08:56.967 INFO:tasks.workunit.client.0.smithi077.stdout:9/869: rename df/d1b/l24 to df/d1b/d70/d84/dde/de9/l128 0 2024-04-25T02:08:56.967 INFO:tasks.workunit.client.0.smithi077.stdout:9/870: read - df/d1b/d70/d84/dde/de9/fea zero size 2024-04-25T02:08:56.968 INFO:tasks.workunit.client.0.smithi077.stdout:4/889: dwrite d0/d14/d21/d39/d9a/feb [0,4194304] 0 2024-04-25T02:08:56.968 INFO:tasks.workunit.client.0.smithi077.stdout:4/890: chown d0/d14/d60/fc7 31340 1 2024-04-25T02:08:56.972 INFO:tasks.workunit.client.0.smithi077.stdout:6/995: rename de/d12/d25/d3a/d6a/dcd/f50 to de/d55/dc2/f147 0 2024-04-25T02:08:56.978 INFO:tasks.workunit.client.0.smithi077.stdout:4/891: symlink d0/d14/d21/d39/da/d12/d35/l121 0 2024-04-25T02:08:56.981 INFO:tasks.workunit.client.0.smithi077.stdout:1/929: getdents db/df/d14/d3e/daa/deb 0 2024-04-25T02:08:56.981 INFO:tasks.workunit.client.0.smithi077.stdout:1/930: readlink db/df/d14/d33/d6c/lc2 0 2024-04-25T02:08:56.986 INFO:tasks.workunit.client.0.smithi077.stdout:4/892: creat d0/d14/d21/d39/d1d/f122 x:0 0 0 2024-04-25T02:08:56.986 INFO:tasks.workunit.client.0.smithi077.stdout:1/931: dread db/df/d56/fa1 [0,4194304] 0 2024-04-25T02:08:56.988 INFO:tasks.workunit.client.0.smithi077.stdout:6/996: truncate de/d12/d25/f4a 3894226 0 2024-04-25T02:08:56.989 INFO:tasks.workunit.client.0.smithi077.stdout:9/871: dwrite df/d1b/f6e [0,4194304] 0 2024-04-25T02:08:56.989 INFO:tasks.workunit.client.0.smithi077.stdout:9/872: chown l9 83194184 1 2024-04-25T02:08:56.989 INFO:tasks.workunit.client.0.smithi077.stdout:9/873: truncate df/d1b/f51 519633 0 2024-04-25T02:08:56.989 INFO:tasks.workunit.client.0.smithi077.stdout:9/874: stat df/d1b/f20 0 2024-04-25T02:08:56.990 INFO:tasks.workunit.client.0.smithi077.stdout:4/893: unlink d0/d14/cdd 0 2024-04-25T02:08:56.994 INFO:tasks.workunit.client.0.smithi077.stdout:1/932: stat db/df/d14/d4d/d82/ca4 0 2024-04-25T02:08:56.999 INFO:tasks.workunit.client.0.smithi077.stdout:4/894: write d0/d14/d60/d62/fa8 [776522,24245] 0 2024-04-25T02:08:57.002 INFO:tasks.workunit.client.0.smithi077.stdout:4/895: rmdir d0/d14/d21 39 2024-04-25T02:08:57.005 INFO:tasks.workunit.client.0.smithi077.stdout:6/997: read de/d12/d25/f40 [1897278,125685] 0 2024-04-25T02:08:57.005 INFO:tasks.workunit.client.0.smithi077.stdout:6/998: chown de/d53/d76/leb 36 1 2024-04-25T02:08:57.005 INFO:tasks.workunit.client.0.smithi077.stdout:6/999: write de/d53/d78/f135 [1230580,126711] 0 2024-04-25T02:08:57.006 INFO:tasks.workunit.client.0.smithi077.stdout:4/896: creat d0/d14/d21/d39/da/d12/de5/f123 x:0 0 0 2024-04-25T02:08:57.013 INFO:tasks.workunit.client.0.smithi077.stdout:1/933: dwrite db/df/d14/d3e/f64 [0,4194304] 0 2024-04-25T02:08:57.014 INFO:tasks.workunit.client.0.smithi077.stdout:9/875: dwrite df/f2e [0,4194304] 0 2024-04-25T02:08:57.014 INFO:tasks.workunit.client.0.smithi077.stdout:9/876: chown df/d1b/d56/dbd/ff6 1 1 2024-04-25T02:08:57.014 INFO:tasks.workunit.client.0.smithi077.stdout:9/877: chown df/d1b/c53 0 1 2024-04-25T02:08:57.023 INFO:tasks.workunit.client.0.smithi077.stdout:4/897: dwrite d0/d14/d21/d39/f4d [0,4194304] 0 2024-04-25T02:08:57.026 INFO:tasks.workunit.client.0.smithi077.stdout:4/898: rmdir d0/d14/d21 39 2024-04-25T02:08:57.032 INFO:tasks.workunit.client.0.smithi077.stdout:4/899: truncate d0/d14/d21/d39/da/d12/d35/d3e/f36 8328473 0 2024-04-25T02:08:57.035 INFO:tasks.workunit.client.0.smithi077.stdout:4/900: mknod d0/d14/c124 0 2024-04-25T02:08:57.036 INFO:tasks.workunit.client.0.smithi077.stdout:9/878: dwrite df/f62 [0,4194304] 0 2024-04-25T02:08:57.036 INFO:tasks.workunit.client.0.smithi077.stdout:1/934: dwrite db/df/d56/f58 [0,4194304] 0 2024-04-25T02:08:57.036 INFO:tasks.workunit.client.0.smithi077.stdout:1/935: fsync db/df/d14/dfa/f36 0 2024-04-25T02:08:57.036 INFO:tasks.workunit.client.0.smithi077.stdout:9/879: write df/d1b/d56/d67/f7e [959376,90801] 0 2024-04-25T02:08:57.037 INFO:tasks.workunit.client.0.smithi077.stdout:9/880: read df/d1b/d48/d75/f8d [246072,116792] 0 2024-04-25T02:08:57.037 INFO:tasks.workunit.client.0.smithi077.stdout:9/881: read - df/d1b/d70/d84/dde/fe4 zero size 2024-04-25T02:08:57.038 INFO:tasks.workunit.client.0.smithi077.stdout:4/901: rename d0/d14/d21/d39/da/d12/d35/d3e/c10c to d0/d14/d60/d62/d108/c125 0 2024-04-25T02:08:57.041 INFO:tasks.workunit.client.0.smithi077.stdout:9/882: dread df/f13 [0,4194304] 0 2024-04-25T02:08:57.051 INFO:tasks.workunit.client.0.smithi077.stdout:9/883: dread df/d1b/d48/f64 [8388608,4194304] 0 2024-04-25T02:08:57.056 INFO:tasks.workunit.client.0.smithi077.stdout:4/902: dwrite d0/d14/d21/d39/da/d12/d35/d3e/d3a/f7d [0,4194304] 0 2024-04-25T02:08:57.056 INFO:tasks.workunit.client.0.smithi077.stdout:4/903: chown d0/d14/d21/d39/da/d12/d35/d3e/f8f 8675877 1 2024-04-25T02:08:57.059 INFO:tasks.workunit.client.0.smithi077.stdout:1/936: rmdir db/df/d14/d4d/d82/d5c/d81 39 2024-04-25T02:08:57.059 INFO:tasks.workunit.client.0.smithi077.stdout:1/937: write db/df/d14/d4d/d82/d42/d43/f8a [598368,19685] 0 2024-04-25T02:08:57.059 INFO:tasks.workunit.client.0.smithi077.stdout:1/938: chown db/df/d14/d4d/d82/d5c/c9c 1085 1 2024-04-25T02:08:57.063 INFO:tasks.workunit.client.0.smithi077.stdout:4/904: symlink d0/d14/d60/d86/d25/l126 0 2024-04-25T02:08:57.067 INFO:tasks.workunit.client.0.smithi077.stdout:7/798: sync 2024-04-25T02:08:57.067 INFO:tasks.workunit.client.0.smithi077.stdout:5/867: sync 2024-04-25T02:08:57.067 INFO:tasks.workunit.client.0.smithi077.stdout:8/972: sync 2024-04-25T02:08:57.067 INFO:tasks.workunit.client.0.smithi077.stdout:0/853: sync 2024-04-25T02:08:57.067 INFO:tasks.workunit.client.0.smithi077.stdout:2/925: sync 2024-04-25T02:08:57.067 INFO:tasks.workunit.client.0.smithi077.stdout:8/973: creat d3/d34/dc9/f145 x:0 0 0 2024-04-25T02:08:57.067 INFO:tasks.workunit.client.0.smithi077.stdout:8/974: truncate d3/da/d27/d44/ff1 233901 0 2024-04-25T02:08:57.068 INFO:tasks.workunit.client.0.smithi077.stdout:4/905: symlink d0/d14/d79/l127 0 2024-04-25T02:08:57.068 INFO:tasks.workunit.client.0.smithi077.stdout:1/939: dread db/df/d56/d5d/fd6 [4194304,4194304] 0 2024-04-25T02:08:57.069 INFO:tasks.workunit.client.0.smithi077.stdout:5/868: getdents d0/d25/d82/d87/d8b/d115/d3/d9/d39 0 2024-04-25T02:08:57.073 INFO:tasks.workunit.client.0.smithi077.stdout:0/854: unlink d2/d8/db6/dd7/de0/ff4 0 2024-04-25T02:08:57.075 INFO:tasks.workunit.client.0.smithi077.stdout:7/799: dread d4/d13/d18/d24/f3b [0,4194304] 0 2024-04-25T02:08:57.077 INFO:tasks.workunit.client.0.smithi077.stdout:9/884: dwrite df/d1b/d56/d67/d68/ff5 [0,4194304] 0 2024-04-25T02:08:57.079 INFO:tasks.workunit.client.0.smithi077.stdout:2/926: creat d2/d59/f136 x:0 0 0 2024-04-25T02:08:57.079 INFO:tasks.workunit.client.0.smithi077.stdout:2/927: chown d2/d9/d18/d1b/df5/f12d 2 1 2024-04-25T02:08:57.079 INFO:tasks.workunit.client.0.smithi077.stdout:2/928: fdatasync d2/d9/d19/d2c/f5b 0 2024-04-25T02:08:57.079 INFO:tasks.workunit.client.0.smithi077.stdout:2/929: creat d2/d9/d18/d31/d7c/dab/dc8/f137 x:0 0 0 2024-04-25T02:08:57.081 INFO:tasks.workunit.client.0.smithi077.stdout:4/906: creat d0/d14/d21/d39/d1d/d98/f128 x:0 0 0 2024-04-25T02:08:57.084 INFO:tasks.workunit.client.0.smithi077.stdout:5/869: mknod d0/d25/d82/d87/d8b/d115/d1b/d35/df3/c11e 0 2024-04-25T02:08:57.086 INFO:tasks.workunit.client.0.smithi077.stdout:0/855: mknod d2/d17/d121/c128 0 2024-04-25T02:08:57.087 INFO:tasks.workunit.client.0.smithi077.stdout:2/930: dread d2/d9/d2f/d84/fbd [0,4194304] 0 2024-04-25T02:08:57.089 INFO:tasks.workunit.client.0.smithi077.stdout:8/975: dwrite d3/da/db/df/d2b/d7b/fe2 [0,4194304] 0 2024-04-25T02:08:57.089 INFO:tasks.workunit.client.0.smithi077.stdout:7/800: mkdir d4/dd2/d107 0 2024-04-25T02:08:57.089 INFO:tasks.workunit.client.0.smithi077.stdout:8/976: chown d3/da/db 102370 1 2024-04-25T02:08:57.090 INFO:tasks.workunit.client.0.smithi077.stdout:7/801: creat d4/d13/d18/d2d/d56/d68/d88/f108 x:0 0 0 2024-04-25T02:08:57.091 INFO:tasks.workunit.client.0.smithi077.stdout:2/931: read d2/f5 [4915590,594] 0 2024-04-25T02:08:57.091 INFO:tasks.workunit.client.0.smithi077.stdout:1/940: dwrite db/df/d1b/fcc [4194304,4194304] 0 2024-04-25T02:08:57.092 INFO:tasks.workunit.client.0.smithi077.stdout:7/802: dread d4/d13/d18/d2d/d56/feb [0,4194304] 0 2024-04-25T02:08:57.095 INFO:tasks.workunit.client.0.smithi077.stdout:9/885: rename df/d1b/d70/d84/dde/de9/cfa to df/d1b/d48/d75/d90/d10f/c129 0 2024-04-25T02:08:57.101 INFO:tasks.workunit.client.0.smithi077.stdout:4/907: creat d0/d14/d60/d62/d108/f129 x:0 0 0 2024-04-25T02:08:57.108 INFO:tasks.workunit.client.0.smithi077.stdout:4/908: dread d0/d14/d60/d86/d96/f66 [0,4194304] 0 2024-04-25T02:08:57.110 INFO:tasks.workunit.client.0.smithi077.stdout:8/977: getdents d3/da/d27/d16/d8c 0 2024-04-25T02:08:57.110 INFO:tasks.workunit.client.0.smithi077.stdout:8/978: dread - d3/d7a/de5/f101 zero size 2024-04-25T02:08:57.110 INFO:tasks.workunit.client.0.smithi077.stdout:8/979: write d3/da/d27/d44/f9f [755176,98825] 0 2024-04-25T02:08:57.110 INFO:tasks.workunit.client.0.smithi077.stdout:8/980: stat d3/da/d27/d44/db1/f133 0 2024-04-25T02:08:57.112 INFO:tasks.workunit.client.0.smithi077.stdout:2/932: truncate d2/d9/d19/d1c/f81 395073 0 2024-04-25T02:08:57.117 INFO:tasks.workunit.client.0.smithi077.stdout:1/941: creat db/df/d14/d3e/daa/f131 x:0 0 0 2024-04-25T02:08:57.121 INFO:tasks.workunit.client.0.smithi077.stdout:4/909: unlink d0/d14/d21/d39/da/f2d 0 2024-04-25T02:08:57.123 INFO:tasks.workunit.client.0.smithi077.stdout:8/981: mkdir d3/da/d27/d44/d146 0 2024-04-25T02:08:57.123 INFO:tasks.workunit.client.0.smithi077.stdout:5/870: dwrite d0/d25/d82/d87/d8b/d115/d3/d9/d39/d44/d5f/da4/fdb [0,4194304] 0 2024-04-25T02:08:57.125 INFO:tasks.workunit.client.0.smithi077.stdout:1/942: rename db/df/d14/d4d/d82/d42/d120 to db/df/d14/d3e/d69/d132 0 2024-04-25T02:08:57.126 INFO:tasks.workunit.client.0.smithi077.stdout:8/982: chown d3/da/db/df/d2b/f79 15558 1 2024-04-25T02:08:57.127 INFO:tasks.workunit.client.0.smithi077.stdout:1/943: dread db/df/d56/d5d/d77/f11f [0,4194304] 0 2024-04-25T02:08:57.129 INFO:tasks.workunit.client.0.smithi077.stdout:7/803: dwrite d4/d13/d66/f73 [0,4194304] 0 2024-04-25T02:08:57.129 INFO:tasks.workunit.client.0.smithi077.stdout:9/886: dwrite df/f3c [0,4194304] 0 2024-04-25T02:08:57.129 INFO:tasks.workunit.client.0.smithi077.stdout:9/887: chown df/d1b/d48/d75/fa5 23 1 2024-04-25T02:08:57.130 INFO:tasks.workunit.client.0.smithi077.stdout:0/856: dwrite d2/d17/d1d/d34/d83/dee/f116 [0,4194304] 0 2024-04-25T02:08:57.130 INFO:tasks.workunit.client.0.smithi077.stdout:0/857: truncate d2/d17/d1d/d34/d83/dee/f117 686758 0 2024-04-25T02:08:57.135 INFO:tasks.workunit.client.0.smithi077.stdout:1/944: rename db/df/d14/f17 to db/df/d14/d4d/da9/de4/f133 0 2024-04-25T02:08:57.135 INFO:tasks.workunit.client.0.smithi077.stdout:0/858: write d2/d17/d1d/d34/d4c/da2/dae/ff0 [108405,24292] 0 2024-04-25T02:08:57.135 INFO:tasks.workunit.client.0.smithi077.stdout:0/859: write d2/d17/d1d/d34/d83/f8d [802535,22712] 0 2024-04-25T02:08:57.135 INFO:tasks.workunit.client.0.smithi077.stdout:0/860: dread - d2/d17/d1d/db1/fe4 zero size 2024-04-25T02:08:57.136 INFO:tasks.workunit.client.0.smithi077.stdout:0/861: truncate d2/d8/dad/f11e 391817 0 2024-04-25T02:08:57.136 INFO:tasks.workunit.client.0.smithi077.stdout:0/862: chown d2/d17/d1d/d34 24779686 1 2024-04-25T02:08:57.136 INFO:tasks.workunit.client.0.smithi077.stdout:0/863: dread - d2/d8/db6/dd7/fda zero size 2024-04-25T02:08:57.136 INFO:tasks.workunit.client.0.smithi077.stdout:0/864: truncate d2/d27/d2d/dce/de7/da7/fe5 5156994 0 2024-04-25T02:08:57.140 INFO:tasks.workunit.client.0.smithi077.stdout:7/804: chown d4/d13/d2c/c41 823233 1 2024-04-25T02:08:57.140 INFO:tasks.workunit.client.0.smithi077.stdout:7/805: stat d4/d13/d18/d24 0 2024-04-25T02:08:57.140 INFO:tasks.workunit.client.0.smithi077.stdout:7/806: write d4/d13/d18/f94 [4584356,59086] 0 2024-04-25T02:08:57.143 INFO:tasks.workunit.client.0.smithi077.stdout:9/888: rmdir df/d1b/d70 39 2024-04-25T02:08:57.143 INFO:tasks.workunit.client.0.smithi077.stdout:9/889: write df/d1b/d56/d67/f7e [1595103,38373] 0 2024-04-25T02:08:57.149 INFO:tasks.workunit.client.0.smithi077.stdout:5/871: symlink d0/d25/l11f 0 2024-04-25T02:08:57.151 INFO:tasks.workunit.client.0.smithi077.stdout:0/865: mknod d2/d17/d1d/d34/d4c/c129 0 2024-04-25T02:08:57.153 INFO:tasks.workunit.client.0.smithi077.stdout:7/807: getdents d4/d13/d18/d24 0 2024-04-25T02:08:57.156 INFO:tasks.workunit.client.0.smithi077.stdout:9/890: rename df/d1b/d70/d84/fad to df/d1b/d48/d75/d90/dfe/f12a 0 2024-04-25T02:08:57.156 INFO:tasks.workunit.client.0.smithi077.stdout:2/933: dwrite d2/d9/d19/d1c/d3f/d53/d83/ff7 [0,4194304] 0 2024-04-25T02:08:57.159 INFO:tasks.workunit.client.0.smithi077.stdout:5/872: unlink d0/d25/d82/d87/d8b/d115/d3/d9/d39/d44/d80/faa 0 2024-04-25T02:08:57.161 INFO:tasks.workunit.client.0.smithi077.stdout:7/808: link d4/lc d4/d13/d18/d2d/d30/l109 0 2024-04-25T02:08:57.162 INFO:tasks.workunit.client.0.smithi077.stdout:3/861: sync 2024-04-25T02:08:57.162 INFO:tasks.workunit.client.0.smithi077.stdout:3/862: dread - d0/d2/d2f/d50/f102 zero size 2024-04-25T02:08:57.162 INFO:tasks.workunit.client.0.smithi077.stdout:0/866: dread d2/d8/db6/dd7/de0/fef [0,4194304] 0 2024-04-25T02:08:57.164 INFO:tasks.workunit.client.0.smithi077.stdout:8/983: dwrite d3/da/db/df/f111 [0,4194304] 0 2024-04-25T02:08:57.164 INFO:tasks.workunit.client.0.smithi077.stdout:4/910: dwrite d0/d14/d60/d86/d25/f31 [0,4194304] 0 2024-04-25T02:08:57.168 INFO:tasks.workunit.client.0.smithi077.stdout:2/934: mkdir d2/d9/d19/d1c/d37/d138 0 2024-04-25T02:08:57.168 INFO:tasks.workunit.client.0.smithi077.stdout:2/935: read d2/d9/d19/d2c/f5b [2071269,26738] 0 2024-04-25T02:08:57.169 INFO:tasks.workunit.client.0.smithi077.stdout:1/945: dwrite db/df/d56/d5d/d77/f8d [0,4194304] 0 2024-04-25T02:08:57.169 INFO:tasks.workunit.client.0.smithi077.stdout:1/946: write db/df/d14/d4d/d82/d32/d8f/fec [154625,108503] 0 2024-04-25T02:08:57.169 INFO:tasks.workunit.client.0.smithi077.stdout:9/891: dwrite df/d80/fa8 [0,4194304] 0 2024-04-25T02:08:57.170 INFO:tasks.workunit.client.0.smithi077.stdout:5/873: symlink d0/d25/d82/d87/d8b/d115/d3/d9/d39/d3c/dc6/l120 0 2024-04-25T02:08:57.173 INFO:tasks.workunit.client.0.smithi077.stdout:7/809: truncate d4/d13/d18/d2d/d30/f86 541830 0 2024-04-25T02:08:57.177 INFO:tasks.workunit.client.0.smithi077.stdout:3/863: link d0/d2/de/lf d0/d2/d2f/d5f/l13b 0 2024-04-25T02:08:57.180 INFO:tasks.workunit.client.0.smithi077.stdout:0/867: creat d2/d8/f12a x:0 0 0 2024-04-25T02:08:57.181 INFO:tasks.workunit.client.0.smithi077.stdout:2/936: write d2/d9/f67 [3797287,7150] 0 2024-04-25T02:08:57.182 INFO:tasks.workunit.client.0.smithi077.stdout:9/892: write df/d1b/f6e [2089264,87606] 0 2024-04-25T02:08:57.182 INFO:tasks.workunit.client.0.smithi077.stdout:9/893: dread - df/d1b/d70/d84/dde/f122 zero size 2024-04-25T02:08:57.187 INFO:tasks.workunit.client.0.smithi077.stdout:8/984: mkdir d3/d34/d3d/d147 0 2024-04-25T02:08:57.191 INFO:tasks.workunit.client.0.smithi077.stdout:4/911: truncate d0/d14/d60/d86/d25/f40 1527878 0 2024-04-25T02:08:57.191 INFO:tasks.workunit.client.0.smithi077.stdout:4/912: creat d0/d14/d60/d62/f12a x:0 0 0 2024-04-25T02:08:57.192 INFO:tasks.workunit.client.0.smithi077.stdout:5/874: dread d0/d25/d82/d87/d8b/da5/dc4/f3f [0,4194304] 0 2024-04-25T02:08:57.193 INFO:tasks.workunit.client.0.smithi077.stdout:7/810: dwrite d4/d13/d18/d24/d3f/de9/ff3 [0,4194304] 0 2024-04-25T02:08:57.193 INFO:tasks.workunit.client.0.smithi077.stdout:7/811: fdatasync d4/d13/d5b/f64 0 2024-04-25T02:08:57.193 INFO:tasks.workunit.client.0.smithi077.stdout:1/947: dwrite db/df/d14/d3e/f64 [0,4194304] 0 2024-04-25T02:08:57.200 INFO:tasks.workunit.client.0.smithi077.stdout:8/985: write d3/da/db/df/d2b/f72 [602494,1662] 0 2024-04-25T02:08:57.201 INFO:tasks.workunit.client.0.smithi077.stdout:3/864: mknod d0/d17/d4b/d59/dc2/c13c 0 2024-04-25T02:08:57.201 INFO:tasks.workunit.client.0.smithi077.stdout:3/865: fdatasync d0/d2/d83/ff1 0 2024-04-25T02:08:57.204 INFO:tasks.workunit.client.0.smithi077.stdout:0/868: rename d2/d17/d4e/d5e/c9c to d2/d17/d4e/d5e/c12b 0 2024-04-25T02:08:57.204 INFO:tasks.workunit.client.0.smithi077.stdout:9/894: dwrite df/d1b/d70/d84/dde/de9/f101 [0,4194304] 0 2024-04-25T02:08:57.206 INFO:tasks.workunit.client.0.smithi077.stdout:2/937: creat d2/d9/d19/d1c/d3f/d53/d86/dca/f139 x:0 0 0 2024-04-25T02:08:57.206 INFO:tasks.workunit.client.0.smithi077.stdout:2/938: readlink d2/d9/d19/d2c/d72/l92 0 2024-04-25T02:08:57.210 INFO:tasks.workunit.client.0.smithi077.stdout:4/913: link d0/d14/d79/d104/l105 d0/l12b 0 2024-04-25T02:08:57.210 INFO:tasks.workunit.client.0.smithi077.stdout:4/914: write d0/f11e [747404,53513] 0 2024-04-25T02:08:57.212 INFO:tasks.workunit.client.0.smithi077.stdout:5/875: mknod d0/d25/d82/d87/d8b/d115/d3/d9/d39/d44/d5f/da4/c121 0 2024-04-25T02:08:57.212 INFO:tasks.workunit.client.0.smithi077.stdout:5/876: write d0/d25/d82/d87/d8b/d115/d3/f55 [180643,116197] 0 2024-04-25T02:08:57.222 INFO:tasks.workunit.client.0.smithi077.stdout:7/812: creat d4/d13/d18/d2d/d30/f10a x:0 0 0 2024-04-25T02:08:57.222 INFO:tasks.workunit.client.0.smithi077.stdout:5/877: dread d0/d25/d82/d87/d8b/d115/d3/f2f [0,4194304] 0 2024-04-25T02:08:57.222 INFO:tasks.workunit.client.0.smithi077.stdout:5/878: chown d0/d25/d82/d87/d8b/d115/d1b/d35/df3 6881020 1 2024-04-25T02:08:57.224 INFO:tasks.workunit.client.0.smithi077.stdout:1/948: creat db/df/d14/d3e/d69/f134 x:0 0 0 2024-04-25T02:08:57.227 INFO:tasks.workunit.client.0.smithi077.stdout:2/939: dwrite d2/d9/d18/d31/fe7 [0,4194304] 0 2024-04-25T02:08:57.227 INFO:tasks.workunit.client.0.smithi077.stdout:2/940: chown d2/d9/d2f/d84/f12c 3161368 1 2024-04-25T02:08:57.227 INFO:tasks.workunit.client.0.smithi077.stdout:2/941: dread - d2/d9/d2f/d84/da6/f10f zero size 2024-04-25T02:08:57.229 INFO:tasks.workunit.client.0.smithi077.stdout:8/986: mknod d3/da/db/df/d30/c148 0 2024-04-25T02:08:57.229 INFO:tasks.workunit.client.0.smithi077.stdout:1/949: dread db/df/d14/d3e/d69/faf [0,4194304] 0 2024-04-25T02:08:57.229 INFO:tasks.workunit.client.0.smithi077.stdout:1/950: chown db/df/d14/d3e/d69/faf 1 1 2024-04-25T02:08:57.231 INFO:tasks.workunit.client.0.smithi077.stdout:3/866: symlink d0/d17/d4b/l13d 0 2024-04-25T02:08:57.233 INFO:tasks.workunit.client.0.smithi077.stdout:8/987: dread d3/da/db/fa1 [0,4194304] 0 2024-04-25T02:08:57.233 INFO:tasks.workunit.client.0.smithi077.stdout:8/988: truncate d3/da/db/df/d30/fb7 937411 0 2024-04-25T02:08:57.233 INFO:tasks.workunit.client.0.smithi077.stdout:8/989: getdents d3/d34/d10e 0 2024-04-25T02:08:57.233 INFO:tasks.workunit.client.0.smithi077.stdout:8/990: write d3/d81/d86/f10a [315298,59254] 0 2024-04-25T02:08:57.233 INFO:tasks.workunit.client.0.smithi077.stdout:8/991: readlink d3/da/d27/d16/d8c/la5 0 2024-04-25T02:08:57.234 INFO:tasks.workunit.client.0.smithi077.stdout:8/992: truncate d3/da/db/df/d30/f40 490635 0 2024-04-25T02:08:57.234 INFO:tasks.workunit.client.0.smithi077.stdout:0/869: rename d2/fa3 to d2/d8/db6/dd7/d105/f12c 0 2024-04-25T02:08:57.234 INFO:tasks.workunit.client.0.smithi077.stdout:0/870: truncate d2/d17/d1d/d34/d4c/da2/d51/f76 374500 0 2024-04-25T02:08:57.245 INFO:tasks.workunit.client.0.smithi077.stdout:9/895: unlink df/d1b/d56/d67/d68/db3/ld1 0 2024-04-25T02:08:57.247 INFO:tasks.workunit.client.0.smithi077.stdout:4/915: rmdir d0/d14/d60/d78/dce/dfa 39 2024-04-25T02:08:57.247 INFO:tasks.workunit.client.0.smithi077.stdout:4/916: readlink d0/d14/d21/d39/da/l59 0 2024-04-25T02:08:57.250 INFO:tasks.workunit.client.0.smithi077.stdout:7/813: link d4/d13/d18/d24/d3f/f103 d4/d13/da9/f10b 0 2024-04-25T02:08:57.253 INFO:tasks.workunit.client.0.smithi077.stdout:5/879: creat d0/d25/d82/d87/d8b/d115/d3/f122 x:0 0 0 2024-04-25T02:08:57.257 INFO:tasks.workunit.client.0.smithi077.stdout:8/993: dwrite d3/da/db/df/d30/f82 [0,4194304] 0 2024-04-25T02:08:57.263 INFO:tasks.workunit.client.0.smithi077.stdout:2/942: mknod d2/d9/d19/d1c/d3f/c13a 0 2024-04-25T02:08:57.263 INFO:tasks.workunit.client.0.smithi077.stdout:2/943: creat d2/d59/d79/db4/f13b x:0 0 0 2024-04-25T02:08:57.263 INFO:tasks.workunit.client.0.smithi077.stdout:4/917: dread d0/d14/d60/d86/d96/f5c [4194304,4194304] 0 2024-04-25T02:08:57.269 INFO:tasks.workunit.client.0.smithi077.stdout:1/951: getdents db/df/d14/d4d/d82/d42 0 2024-04-25T02:08:57.270 INFO:tasks.workunit.client.0.smithi077.stdout:7/814: dwrite d4/d13/d18/d24/d3f/d58/fdb [0,4194304] 0 2024-04-25T02:08:57.272 INFO:tasks.workunit.client.0.smithi077.stdout:3/867: chown d0/d2/de/d48/c1e 58709 1 2024-04-25T02:08:57.272 INFO:tasks.workunit.client.0.smithi077.stdout:3/868: readlink d0/d3e/l3a 0 2024-04-25T02:08:57.273 INFO:tasks.workunit.client.0.smithi077.stdout:3/869: readlink d0/d3e/d42/d64/d88/l8c 0 2024-04-25T02:08:57.273 INFO:tasks.workunit.client.0.smithi077.stdout:3/870: dread - d0/d2/d83/f134 zero size 2024-04-25T02:08:57.273 INFO:tasks.workunit.client.0.smithi077.stdout:3/871: chown d0/d2/d83/f86 106083919 1 2024-04-25T02:08:57.273 INFO:tasks.workunit.client.0.smithi077.stdout:0/871: dwrite d2/d27/d2d/dce/de7/da7/fe5 [0,4194304] 0 2024-04-25T02:08:57.274 INFO:tasks.workunit.client.0.smithi077.stdout:9/896: creat df/d1b/d56/ddf/f12b x:0 0 0 2024-04-25T02:08:57.274 INFO:tasks.workunit.client.0.smithi077.stdout:9/897: readlink df/d1b/d48/d75/d90/d10f/l124 0 2024-04-25T02:08:57.275 INFO:tasks.workunit.client.0.smithi077.stdout:9/898: fdatasync df/d1b/d56/d67/d68/ff5 0 2024-04-25T02:08:57.278 INFO:tasks.workunit.client.0.smithi077.stdout:5/880: creat d0/d25/d82/d87/d8b/d115/d3/d9/d39/d44/d5f/dde/f123 x:0 0 0 2024-04-25T02:08:57.278 INFO:tasks.workunit.client.0.smithi077.stdout:5/881: fsync d0/d25/d82/d87/d8b/da5/fc3 0 2024-04-25T02:08:57.291 INFO:tasks.workunit.client.0.smithi077.stdout:8/994: rmdir d3/d34/d122 39 2024-04-25T02:08:57.291 INFO:tasks.workunit.client.0.smithi077.stdout:8/995: fdatasync d3/d34/dc9/f145 0 2024-04-25T02:08:57.300 INFO:tasks.workunit.client.0.smithi077.stdout:2/944: creat d2/d9/d19/d1c/d3f/d53/d86/db3/f13c x:0 0 0 2024-04-25T02:08:57.309 INFO:tasks.workunit.client.0.smithi077.stdout:1/952: rename db/df/d14/d3e/d69/dad/f101 to db/df/d56/d5d/d77/f135 0 2024-04-25T02:08:57.317 INFO:tasks.workunit.client.0.smithi077.stdout:7/815: rmdir d4/d13/d18/d24/d3f/d59/dd6 39 2024-04-25T02:08:57.317 INFO:tasks.workunit.client.0.smithi077.stdout:7/816: write d4/d13/d18/d2d/d30/f8a [798994,128088] 0 2024-04-25T02:08:57.326 INFO:tasks.workunit.client.0.smithi077.stdout:2/945: dwrite d2/d9/d2f/f125 [0,4194304] 0 2024-04-25T02:08:57.326 INFO:tasks.workunit.client.0.smithi077.stdout:2/946: write d2/d9/f8c [4549018,9763] 0 2024-04-25T02:08:57.326 INFO:tasks.workunit.client.0.smithi077.stdout:2/947: truncate d2/d9/d2f/f102 688837 0 2024-04-25T02:08:57.327 INFO:tasks.workunit.client.0.smithi077.stdout:3/872: creat d0/d17/d4b/f13e x:0 0 0 2024-04-25T02:08:57.336 INFO:tasks.workunit.client.0.smithi077.stdout:0/872: creat d2/d17/d121/f12d x:0 0 0 2024-04-25T02:08:57.336 INFO:tasks.workunit.client.0.smithi077.stdout:0/873: creat d2/d17/d121/f12e x:0 0 0 2024-04-25T02:08:57.376 INFO:tasks.workunit.client.0.smithi077.stdout:5/882: mknod d0/d25/d82/d87/d8b/d115/d3/d9/d39/d44/d5f/c124 0 2024-04-25T02:08:57.381 INFO:tasks.workunit.client.0.smithi077.stdout:8/996: rename d3/da/db/df/d2b/d7b/lf3 to d3/da/db/df/ddc/d11a/l149 0 2024-04-25T02:08:57.381 INFO:tasks.workunit.client.0.smithi077.stdout:8/997: write d3/fd0 [828711,65624] 0 2024-04-25T02:08:57.381 INFO:tasks.workunit.client.0.smithi077.stdout:8/998: write d3/da/d27/f76 [2180673,26966] 0 2024-04-25T02:08:57.384 INFO:tasks.workunit.client.0.smithi077.stdout:1/953: stat db/df/d14/d4d/d82/c24 0 2024-04-25T02:08:57.384 INFO:tasks.workunit.client.0.smithi077.stdout:1/954: write db/df/d14/d4d/d82/d32/f3f [3397742,76348] 0 2024-04-25T02:08:57.387 INFO:tasks.workunit.client.0.smithi077.stdout:7/817: link d4/d13/d18/d24/c31 d4/d7c/c10c 0 2024-04-25T02:08:57.395 INFO:tasks.workunit.client.0.smithi077.stdout:2/948: unlink d2/d9/d18/fa 0 2024-04-25T02:08:57.397 INFO:tasks.workunit.client.0.smithi077.stdout:3/873: rmdir d0/d17/d4b/d59/dd2 39 2024-04-25T02:08:57.405 INFO:tasks.workunit.client.0.smithi077.stdout:9/899: getdents df 0 2024-04-25T02:08:57.409 INFO:tasks.workunit.client.0.smithi077.stdout:5/883: unlink d0/d25/d82/d87/d8b/d115/d1b/d35/c42 0 2024-04-25T02:08:57.409 INFO:tasks.workunit.client.0.smithi077.stdout:5/884: fdatasync d0/f50 0 2024-04-25T02:08:57.410 INFO:tasks.workunit.client.0.smithi077.stdout:7/818: dwrite d4/fb [0,4194304] 0 2024-04-25T02:08:57.414 INFO:tasks.workunit.client.0.smithi077.stdout:0/874: rename d2/d17/d1d/d34/d4c/f9a to d2/d8/db6/dd7/de0/f12f 0 2024-04-25T02:08:57.414 INFO:tasks.workunit.client.0.smithi077.stdout:0/875: dread - d2/d8/db6/dd7/d105/faf zero size 2024-04-25T02:08:57.417 INFO:tasks.workunit.client.0.smithi077.stdout:9/900: write df/d1b/d56/dbd/ff6 [1415841,78120] 0 2024-04-25T02:08:57.425 INFO:tasks.workunit.client.0.smithi077.stdout:3/874: creat d0/d2/de/d48/d135/f13f x:0 0 0 2024-04-25T02:08:57.429 INFO:tasks.workunit.client.0.smithi077.stdout:7/819: getdents d4/d13/d2c 0 2024-04-25T02:08:57.432 INFO:tasks.workunit.client.0.smithi077.stdout:8/999: rename d3/da/cb5 to d3/d34/d3d/d147/c14a 0 2024-04-25T02:08:57.436 INFO:tasks.workunit.client.0.smithi077.stdout:5/885: dwrite d0/d25/d82/d87/d8b/d115/d3/f31 [4194304,4194304] 0 2024-04-25T02:08:57.438 INFO:tasks.workunit.client.0.smithi077.stdout:2/949: rename d2/d59/f6e to d2/d9/d56/f13d 0 2024-04-25T02:08:57.438 INFO:tasks.workunit.client.0.smithi077.stdout:2/950: fsync d2/d9/d19/d1c/d3f/d53/d86/db3/ffa 0 2024-04-25T02:08:57.438 INFO:tasks.workunit.client.0.smithi077.stdout:2/951: write d2/d9/d18/d31/d7c/dab/dc8/f10c [484924,39972] 0 2024-04-25T02:08:57.438 INFO:tasks.workunit.client.0.smithi077.stdout:2/952: dread - d2/d9/d19/d1c/d3f/d53/d86/dca/f139 zero size 2024-04-25T02:08:57.441 INFO:tasks.workunit.client.0.smithi077.stdout:5/886: creat d0/d25/d82/d87/d8b/d5a/f125 x:0 0 0 2024-04-25T02:08:57.444 INFO:tasks.workunit.client.0.smithi077.stdout:3/875: rename d0/d17/d4b/d59/dc2/ldb to d0/d2/de/d48/d15/l140 0 2024-04-25T02:08:57.446 INFO:tasks.workunit.client.0.smithi077.stdout:7/820: dwrite d4/f16 [0,4194304] 0 2024-04-25T02:08:57.447 INFO:tasks.workunit.client.0.smithi077.stdout:9/901: dwrite df/d1b/d70/d84/fe3 [0,4194304] 0 2024-04-25T02:08:57.447 INFO:tasks.workunit.client.0.smithi077.stdout:0/876: dwrite d2/d17/d4e/f85 [0,4194304] 0 2024-04-25T02:08:57.450 INFO:tasks.workunit.client.0.smithi077.stdout:3/876: rename d0/d2/d2f/d50/fe3 to d0/d3e/d62/d6a/f141 0 2024-04-25T02:08:57.450 INFO:tasks.workunit.client.0.smithi077.stdout:3/877: chown d0/d2/d2f/c78 389 1 2024-04-25T02:08:57.450 INFO:tasks.workunit.client.0.smithi077.stdout:3/878: chown d0/d3e/da1 108907 1 2024-04-25T02:08:57.453 INFO:tasks.workunit.client.0.smithi077.stdout:2/953: getdents d2/d9/d18/d31/d7c/dab/dc8 0 2024-04-25T02:08:57.456 INFO:tasks.workunit.client.0.smithi077.stdout:7/821: unlink d4/d13/d5b/d8b/lc7 0 2024-04-25T02:08:57.462 INFO:tasks.workunit.client.0.smithi077.stdout:9/902: unlink df/d1b/d48/d75/d90/fb2 0 2024-04-25T02:08:57.464 INFO:tasks.workunit.client.0.smithi077.stdout:3/879: symlink d0/d17/dd4/l142 0 2024-04-25T02:08:57.467 INFO:tasks.workunit.client.0.smithi077.stdout:0/877: dwrite d2/d17/d1d/d34/d83/dee/f117 [0,4194304] 0 2024-04-25T02:08:57.467 INFO:tasks.workunit.client.0.smithi077.stdout:0/878: write d2/d17/d121/f12d [880013,5211] 0 2024-04-25T02:08:57.467 INFO:tasks.workunit.client.0.smithi077.stdout:7/822: symlink d4/d13/d18/d24/l10d 0 2024-04-25T02:08:57.468 INFO:tasks.workunit.client.0.smithi077.stdout:5/887: dwrite d0/f50 [0,4194304] 0 2024-04-25T02:08:57.468 INFO:tasks.workunit.client.0.smithi077.stdout:2/954: dread d2/d59/d79/f9f [0,4194304] 0 2024-04-25T02:08:57.472 INFO:tasks.workunit.client.0.smithi077.stdout:3/880: creat d0/d2/d2f/db4/db6/f143 x:0 0 0 2024-04-25T02:08:57.478 INFO:tasks.workunit.client.0.smithi077.stdout:0/879: creat d2/d27/f130 x:0 0 0 2024-04-25T02:08:57.481 INFO:tasks.workunit.client.0.smithi077.stdout:5/888: write d0/d25/d82/d87/d8b/d115/d3/d9/d39/d44/d5f/f60 [2724034,33342] 0 2024-04-25T02:08:57.481 INFO:tasks.workunit.client.0.smithi077.stdout:5/889: dread - d0/d25/feb zero size 2024-04-25T02:08:57.481 INFO:tasks.workunit.client.0.smithi077.stdout:5/890: write d0/d25/d82/d87/d8b/d115/da8/ff5 [440104,113726] 0 2024-04-25T02:08:57.482 INFO:tasks.workunit.client.0.smithi077.stdout:2/955: creat d2/d9/d56/f13e x:0 0 0 2024-04-25T02:08:57.482 INFO:tasks.workunit.client.0.smithi077.stdout:2/956: truncate d2/d9/d18/d31/d7c/dab/dc8/f10c 747394 0 2024-04-25T02:08:57.484 INFO:tasks.workunit.client.0.smithi077.stdout:9/903: getdents df/d1b 0 2024-04-25T02:08:57.484 INFO:tasks.workunit.client.0.smithi077.stdout:3/881: dread d0/d2/de/f82 [0,4194304] 0 2024-04-25T02:08:57.487 INFO:tasks.workunit.client.0.smithi077.stdout:7/823: link d4/d13/d18/d2d/f47 d4/d13/d18/d2d/d56/d68/db3/f10e 0 2024-04-25T02:08:57.492 INFO:tasks.workunit.client.0.smithi077.stdout:5/891: rename d0/d25/d82/d87/d8b/d115/d3/f7d to d0/d25/dc7/dca/f126 0 2024-04-25T02:08:57.495 INFO:tasks.workunit.client.0.smithi077.stdout:9/904: mkdir df/d60/d12c 0 2024-04-25T02:08:57.497 INFO:tasks.workunit.client.0.smithi077.stdout:0/880: dwrite d2/d9/f66 [0,4194304] 0 2024-04-25T02:08:57.499 INFO:tasks.workunit.client.0.smithi077.stdout:3/882: symlink d0/d3e/d42/d64/l144 0 2024-04-25T02:08:57.501 INFO:tasks.workunit.client.0.smithi077.stdout:7/824: truncate d4/d13/d18/d2d/d30/f63 1390591 0 2024-04-25T02:08:57.501 INFO:tasks.workunit.client.0.smithi077.stdout:7/825: chown d4/d13/d18/d2d/d56/d68/d88/ff6 18 1 2024-04-25T02:08:57.501 INFO:tasks.workunit.client.0.smithi077.stdout:7/826: stat d4/d13/d18/d24/d3f/ff1 0 2024-04-25T02:08:57.503 INFO:tasks.workunit.client.0.smithi077.stdout:2/957: getdents d2/d9/d19/d1c 0 2024-04-25T02:08:57.507 INFO:tasks.workunit.client.0.smithi077.stdout:0/881: rename d2/d9/d2a/fa9 to d2/d8/db6/dd7/d10c/f131 0 2024-04-25T02:08:57.509 INFO:tasks.workunit.client.0.smithi077.stdout:3/883: creat d0/d2/de/f145 x:0 0 0 2024-04-25T02:08:57.509 INFO:tasks.workunit.client.0.smithi077.stdout:3/884: truncate d0/d2/de/d48/d15/f99 935240 0 2024-04-25T02:08:57.511 INFO:tasks.workunit.client.0.smithi077.stdout:7/827: mknod d4/d13/d18/d24/d3f/d59/c10f 0 2024-04-25T02:08:57.513 INFO:tasks.workunit.client.0.smithi077.stdout:5/892: dwrite d0/d25/d82/d87/d8b/d115/d1b/d3b/fd1 [0,4194304] 0 2024-04-25T02:08:57.513 INFO:tasks.workunit.client.0.smithi077.stdout:5/893: readlink d0/d25/d82/d87/d8b/da5/dc4/l7f 0 2024-04-25T02:08:57.513 INFO:tasks.workunit.client.0.smithi077.stdout:5/894: chown d0/d25/d82/d87/d8b/d115/d1b/d35/f4f 4535034 1 2024-04-25T02:08:57.513 INFO:tasks.workunit.client.0.smithi077.stdout:9/905: dwrite df/f62 [0,4194304] 0 2024-04-25T02:08:57.513 INFO:tasks.workunit.client.0.smithi077.stdout:9/906: chown df/d60/d109/fbf 7 1 2024-04-25T02:08:57.513 INFO:tasks.workunit.client.0.smithi077.stdout:9/907: truncate df/d1b/d48/dee/f11b 2272374 0 2024-04-25T02:08:57.513 INFO:tasks.workunit.client.0.smithi077.stdout:9/908: dread - df/d60/d109/f7f zero size 2024-04-25T02:08:57.513 INFO:tasks.workunit.client.0.smithi077.stdout:2/958: getdents d2/d9/d19/d1c/d37 0 2024-04-25T02:08:57.518 INFO:tasks.workunit.client.0.smithi077.stdout:3/885: mkdir d0/d17/d4b/d59/dc2/d146 0 2024-04-25T02:08:57.519 INFO:tasks.workunit.client.0.smithi077.stdout:3/886: chown d0/d2/de/d48/d15/d125 12160508 1 2024-04-25T02:08:57.519 INFO:tasks.workunit.client.0.smithi077.stdout:3/887: chown d0/dd3/fef 2522 1 2024-04-25T02:08:57.523 INFO:tasks.workunit.client.0.smithi077.stdout:7/828: creat d4/d13/d18/d2d/d56/d68/f110 x:0 0 0 2024-04-25T02:08:57.527 INFO:tasks.workunit.client.0.smithi077.stdout:9/909: dread df/d1b/d56/dbd/ff6 [0,4194304] 0 2024-04-25T02:08:57.527 INFO:tasks.workunit.client.0.smithi077.stdout:9/910: dread - df/d1b/d56/d67/d68/db3/f106 zero size 2024-04-25T02:08:57.527 INFO:tasks.workunit.client.0.smithi077.stdout:9/911: truncate df/d1b/d48/db6/fd0 77323 0 2024-04-25T02:08:57.527 INFO:tasks.workunit.client.0.smithi077.stdout:9/912: readlink df/d1b/d70/l10e 0 2024-04-25T02:08:57.527 INFO:tasks.workunit.client.0.smithi077.stdout:9/913: fdatasync df/d1b/f96 0 2024-04-25T02:08:57.527 INFO:tasks.workunit.client.0.smithi077.stdout:9/914: creat df/d1b/d48/dee/d10b/f12d x:0 0 0 2024-04-25T02:08:57.528 INFO:tasks.workunit.client.0.smithi077.stdout:2/959: creat d2/d9/d19/d1c/d37/dcb/d118/f13f x:0 0 0 2024-04-25T02:08:57.528 INFO:tasks.workunit.client.0.smithi077.stdout:3/888: dread d0/d2/de/d48/d15/f1d [0,4194304] 0 2024-04-25T02:08:57.529 INFO:tasks.workunit.client.0.smithi077.stdout:3/889: read d0/d17/d4b/fa3 [523,37109] 0 2024-04-25T02:08:57.530 INFO:tasks.workunit.client.0.smithi077.stdout:7/829: write d4/d13/d18/d2d/d30/f8c [2193209,51973] 0 2024-04-25T02:08:57.531 INFO:tasks.workunit.client.0.smithi077.stdout:9/915: mknod df/d1b/d48/dee/c12e 0 2024-04-25T02:08:57.532 INFO:tasks.workunit.client.0.smithi077.stdout:5/895: dwrite d0/d25/d82/f101 [0,4194304] 0 2024-04-25T02:08:57.533 INFO:tasks.workunit.client.0.smithi077.stdout:2/960: link d2/d9/d18/d31/d7c/fdf d2/d9/d19/d1c/d3f/f140 0 2024-04-25T02:08:57.533 INFO:tasks.workunit.client.0.smithi077.stdout:2/961: write d2/d9/d19/d1c/ff8 [9054104,94152] 0 2024-04-25T02:08:57.533 INFO:tasks.workunit.client.0.smithi077.stdout:2/962: truncate d2/d9/d19/d1c/d3f/f140 652643 0 2024-04-25T02:08:57.534 INFO:tasks.workunit.client.0.smithi077.stdout:2/963: chown d2/d9/ddc/dc4 37232054 1 2024-04-25T02:08:57.535 INFO:tasks.workunit.client.0.smithi077.stdout:3/890: creat d0/d17/d4b/d59/f147 x:0 0 0 2024-04-25T02:08:57.535 INFO:tasks.workunit.client.0.smithi077.stdout:3/891: chown d0/d3e/d42/d64/d88 0 1 2024-04-25T02:08:57.537 INFO:tasks.workunit.client.0.smithi077.stdout:7/830: truncate d4/f50 2204997 0 2024-04-25T02:08:57.538 INFO:tasks.workunit.client.0.smithi077.stdout:2/964: dread d2/d9/ddc/dc4/f66 [0,4194304] 0 2024-04-25T02:08:57.539 INFO:tasks.workunit.client.0.smithi077.stdout:9/916: symlink df/d1b/d56/d67/d68/db3/l12f 0 2024-04-25T02:08:57.539 INFO:tasks.workunit.client.0.smithi077.stdout:9/917: chown df/d80/c81 14 1 2024-04-25T02:08:57.539 INFO:tasks.workunit.client.0.smithi077.stdout:9/918: chown df/d1b/d56/fae 222 1 2024-04-25T02:08:57.548 INFO:tasks.workunit.client.0.smithi077.stdout:3/892: mkdir d0/d2/de/d27/d13a/d148 0 2024-04-25T02:08:57.551 INFO:tasks.workunit.client.0.smithi077.stdout:7/831: mknod d4/d13/d18/d2d/d56/de7/c111 0 2024-04-25T02:08:57.551 INFO:tasks.workunit.client.0.smithi077.stdout:7/832: read - d4/d13/f48 zero size 2024-04-25T02:08:57.553 INFO:tasks.workunit.client.0.smithi077.stdout:2/965: unlink d2/d78/fac 0 2024-04-25T02:08:57.553 INFO:tasks.workunit.client.0.smithi077.stdout:2/966: write d2/d9/d2f/d84/da6/fbc [2583332,35178] 0 2024-04-25T02:08:57.554 INFO:tasks.workunit.client.0.smithi077.stdout:2/967: write d2/d9/d19/fbe [130728,43551] 0 2024-04-25T02:08:57.554 INFO:tasks.workunit.client.0.smithi077.stdout:2/968: write d2/d9/d18/d31/d7c/fdf [28341,99995] 0 2024-04-25T02:08:57.555 INFO:tasks.workunit.client.0.smithi077.stdout:9/919: mknod df/d1b/d48/db6/c130 0 2024-04-25T02:08:57.555 INFO:tasks.workunit.client.0.smithi077.stdout:4/918: sync 2024-04-25T02:08:57.555 INFO:tasks.workunit.client.0.smithi077.stdout:4/919: fdatasync d0/d14/d79/da4/dbc/f112 0 2024-04-25T02:08:57.559 INFO:tasks.workunit.client.0.smithi077.stdout:7/833: write d4/d13/d66/f73 [2170755,98483] 0 2024-04-25T02:08:57.559 INFO:tasks.workunit.client.0.smithi077.stdout:7/834: fsync d4/d13/da9/fba 0 2024-04-25T02:08:57.563 INFO:tasks.workunit.client.0.smithi077.stdout:4/920: dread d0/d14/d21/f26 [0,4194304] 0 2024-04-25T02:08:57.573 INFO:tasks.workunit.client.0.smithi077.stdout:4/921: dread d0/d14/d21/d39/da/fe3 [0,4194304] 0 2024-04-25T02:08:57.580 INFO:tasks.workunit.client.0.smithi077.stdout:2/969: link d2/d9/c7f d2/d59/d79/db4/c141 0 2024-04-25T02:08:57.583 INFO:tasks.workunit.client.0.smithi077.stdout:9/920: symlink df/d1b/d56/d67/l131 0 2024-04-25T02:08:57.587 INFO:tasks.workunit.client.0.smithi077.stdout:2/970: write d2/d9/f6a [3220402,48758] 0 2024-04-25T02:08:57.587 INFO:tasks.workunit.client.0.smithi077.stdout:2/971: read d2/d9/d19/d1c/d37/dcb/f10d [14584,46841] 0 2024-04-25T02:08:57.587 INFO:tasks.workunit.client.0.smithi077.stdout:2/972: chown d2/d9/d19/d1c/c75 3558 1 2024-04-25T02:08:57.591 INFO:tasks.workunit.client.0.smithi077.stdout:7/835: symlink d4/d13/d2c/l112 0 2024-04-25T02:08:57.591 INFO:tasks.workunit.client.0.smithi077.stdout:7/836: chown d4/d13/d18/d24/d3f/d59/c10f 278 1 2024-04-25T02:08:57.591 INFO:tasks.workunit.client.0.smithi077.stdout:7/837: read d4/d13/d18/d2d/d30/f42 [3488479,29901] 0 2024-04-25T02:08:57.599 INFO:tasks.workunit.client.0.smithi077.stdout:4/922: mknod d0/d14/d60/d86/d25/c12c 0 2024-04-25T02:08:57.599 INFO:tasks.workunit.client.0.smithi077.stdout:4/923: creat d0/d14/d21/d39/da/d12/d35/f12d x:0 0 0 2024-04-25T02:08:57.602 INFO:tasks.workunit.client.0.smithi077.stdout:7/838: dread d4/d13/d18/d24/d3f/d59/f5f [0,4194304] 0 2024-04-25T02:08:57.602 INFO:tasks.workunit.client.0.smithi077.stdout:7/839: read d4/d13/d18/d2d/d56/d68/f9a [125849,28548] 0 2024-04-25T02:08:57.604 INFO:tasks.workunit.client.0.smithi077.stdout:4/924: mkdir d0/d14/d60/d86/d25/d12e 0 2024-04-25T02:08:57.607 INFO:tasks.workunit.client.0.smithi077.stdout:9/921: link df/l2b df/d60/d87/l132 0 2024-04-25T02:08:57.607 INFO:tasks.workunit.client.0.smithi077.stdout:2/973: dwrite d2/d9/ddc/dad/fba [0,4194304] 0 2024-04-25T02:08:57.607 INFO:tasks.workunit.client.0.smithi077.stdout:2/974: readlink d2/d9/ddc/l9e 0 2024-04-25T02:08:57.607 INFO:tasks.workunit.client.0.smithi077.stdout:2/975: write d2/d9/d18/d31/f4b [3061603,9907] 0 2024-04-25T02:08:57.610 INFO:tasks.workunit.client.0.smithi077.stdout:7/840: rename d4/d13/d18/d2d/d56/d68/le6 to d4/dd2/l113 0 2024-04-25T02:08:57.611 INFO:tasks.workunit.client.0.smithi077.stdout:4/925: rmdir d0/d14/d79/da4 39 2024-04-25T02:08:57.614 INFO:tasks.workunit.client.0.smithi077.stdout:0/882: dwrite d2/d17/d4e/f85 [4194304,4194304] 0 2024-04-25T02:08:57.617 INFO:tasks.workunit.client.0.smithi077.stdout:2/976: link d2/d9/l21 d2/d78/l142 0 2024-04-25T02:08:57.617 INFO:tasks.workunit.client.0.smithi077.stdout:2/977: write d2/d9/d18/d31/d7c/f10b [22561,69846] 0 2024-04-25T02:08:57.617 INFO:tasks.workunit.client.0.smithi077.stdout:2/978: write d2/d9/d56/f13e [629776,58435] 0 2024-04-25T02:08:57.617 INFO:tasks.workunit.client.0.smithi077.stdout:2/979: creat d2/d59/d79/db4/f143 x:0 0 0 2024-04-25T02:08:57.619 INFO:tasks.workunit.client.0.smithi077.stdout:7/841: getdents d4/d13/d18/d24/d3f/d59/dd6 0 2024-04-25T02:08:57.621 INFO:tasks.workunit.client.0.smithi077.stdout:9/922: dwrite df/d1b/d70/d74/fe8 [0,4194304] 0 2024-04-25T02:08:57.622 INFO:tasks.workunit.client.0.smithi077.stdout:4/926: rename d0/d14/d60/fc4 to d0/d14/d60/d78/dce/d11b/f12f 0 2024-04-25T02:08:57.622 INFO:tasks.workunit.client.0.smithi077.stdout:4/927: dread - d0/d14/d60/fc7 zero size 2024-04-25T02:08:57.629 INFO:tasks.workunit.client.0.smithi077.stdout:0/883: symlink d2/d17/d1d/d34/d4c/da2/de2/d104/l132 0 2024-04-25T02:08:57.629 INFO:tasks.workunit.client.0.smithi077.stdout:0/884: write d2/d9/d2a/f106 [281940,124829] 0 2024-04-25T02:08:57.633 INFO:tasks.workunit.client.0.smithi077.stdout:2/980: dwrite d2/d59/d79/db4/f12a [0,4194304] 0 2024-04-25T02:08:57.635 INFO:tasks.workunit.client.0.smithi077.stdout:7/842: mknod d4/d13/d18/d24/de5/c114 0 2024-04-25T02:08:57.641 INFO:tasks.workunit.client.0.smithi077.stdout:9/923: mknod df/d1b/d48/dee/d10b/c133 0 2024-04-25T02:08:57.642 INFO:tasks.workunit.client.0.smithi077.stdout:9/924: write df/d60/d109/fbf [610342,96906] 0 2024-04-25T02:08:57.643 INFO:tasks.workunit.client.0.smithi077.stdout:4/928: mknod d0/d14/d60/d62/c130 0 2024-04-25T02:08:57.645 INFO:tasks.workunit.client.0.smithi077.stdout:0/885: dwrite d2/d27/d2d/f6d [0,4194304] 0 2024-04-25T02:08:57.645 INFO:tasks.workunit.client.0.smithi077.stdout:0/886: write d2/d17/d1d/d34/d4c/da2/d51/de8/d107/fe1 [933351,72797] 0 2024-04-25T02:08:57.645 INFO:tasks.workunit.client.0.smithi077.stdout:0/887: stat d2/d17/d1d/db1/f10d 0 2024-04-25T02:08:57.645 INFO:tasks.workunit.client.0.smithi077.stdout:0/888: truncate d2/d8/db6/f113 5059621 0 2024-04-25T02:08:57.646 INFO:tasks.workunit.client.0.smithi077.stdout:0/889: dread d2/d8/dad/f11e [0,4194304] 0 2024-04-25T02:08:57.665 INFO:tasks.workunit.client.0.smithi077.stdout:2/981: unlink d2/d28/f12f 0 2024-04-25T02:08:57.665 INFO:tasks.workunit.client.0.smithi077.stdout:2/982: stat d2/d9/d19/l2d 0 2024-04-25T02:08:57.666 INFO:tasks.workunit.client.0.smithi077.stdout:4/929: dwrite d0/d14/d60/d62/f12a [0,4194304] 0 2024-04-25T02:08:57.666 INFO:tasks.workunit.client.0.smithi077.stdout:4/930: read - d0/d14/d21/d39/da/d12/d35/f12d zero size 2024-04-25T02:08:57.666 INFO:tasks.workunit.client.0.smithi077.stdout:4/931: truncate d0/d14/d21/d39/d1d/f122 935571 0 2024-04-25T02:08:57.666 INFO:tasks.workunit.client.0.smithi077.stdout:9/925: dwrite df/d1b/d56/fae [0,4194304] 0 2024-04-25T02:08:57.666 INFO:tasks.workunit.client.0.smithi077.stdout:9/926: write df/d1b/f30 [4736475,119255] 0 2024-04-25T02:08:57.668 INFO:tasks.workunit.client.0.smithi077.stdout:7/843: unlink d4/d13/de8/ffd 0 2024-04-25T02:08:57.670 INFO:tasks.workunit.client.0.smithi077.stdout:0/890: rename d2/d9/d2a/lf6 to d2/d9/d2a/db5/l133 0 2024-04-25T02:08:57.670 INFO:tasks.workunit.client.0.smithi077.stdout:0/891: chown d2/d17 210 1 2024-04-25T02:08:57.674 INFO:tasks.workunit.client.0.smithi077.stdout:2/983: link d2/l11 d2/d9/ddc/dad/l144 0 2024-04-25T02:08:57.674 INFO:tasks.workunit.client.0.smithi077.stdout:2/984: truncate d2/d9/d2f/d84/da6/f10f 430839 0 2024-04-25T02:08:57.674 INFO:tasks.workunit.client.0.smithi077.stdout:2/985: write d2/d9/d2f/f38 [2857298,97952] 0 2024-04-25T02:08:57.678 INFO:tasks.workunit.client.0.smithi077.stdout:0/892: dread d2/f6 [0,4194304] 0 2024-04-25T02:08:57.679 INFO:tasks.workunit.client.0.smithi077.stdout:4/932: creat d0/d14/d60/d86/d34/f131 x:0 0 0 2024-04-25T02:08:57.685 INFO:tasks.workunit.client.0.smithi077.stdout:2/986: dread d2/d9/d2f/f125 [0,4194304] 0 2024-04-25T02:08:57.688 INFO:tasks.workunit.client.0.smithi077.stdout:7/844: mknod d4/d7c/d104/c115 0 2024-04-25T02:08:57.688 INFO:tasks.workunit.client.0.smithi077.stdout:7/845: write d4/d13/d5b/fbc [508934,123547] 0 2024-04-25T02:08:57.696 INFO:tasks.workunit.client.0.smithi077.stdout:2/987: write d2/d59/d79/db4/f12a [2359132,56775] 0 2024-04-25T02:08:57.696 INFO:tasks.workunit.client.0.smithi077.stdout:2/988: fdatasync d2/fdb 0 2024-04-25T02:08:57.696 INFO:tasks.workunit.client.0.smithi077.stdout:2/989: stat d2/d9/ddc/dad/fba 0 2024-04-25T02:08:57.698 INFO:tasks.workunit.client.0.smithi077.stdout:9/927: rmdir df/d1b/d70/d84/dde/de9 39 2024-04-25T02:08:57.703 INFO:tasks.workunit.client.0.smithi077.stdout:4/933: rename d0/d14/d21/d39/d64/lb7 to d0/d14/d21/d39/da/d12/d35/dfe/l132 0 2024-04-25T02:08:57.704 INFO:tasks.workunit.client.0.smithi077.stdout:4/934: write d0/d14/d21/d39/d1d/f73 [578535,66730] 0 2024-04-25T02:08:57.704 INFO:tasks.workunit.client.0.smithi077.stdout:4/935: truncate d0/d14/d21/d39/da/d12/d35/d3e/f8f 929243 0 2024-04-25T02:08:57.705 INFO:tasks.workunit.client.0.smithi077.stdout:0/893: dwrite d2/d9/d2a/db5/fbc [0,4194304] 0 2024-04-25T02:08:57.705 INFO:tasks.workunit.client.0.smithi077.stdout:5/896: dwrite d0/d25/d82/d87/d8b/d115/d1b/d3b/f72 [0,4194304] 0 2024-04-25T02:08:57.705 INFO:tasks.workunit.client.0.smithi077.stdout:5/897: fsync d0/d25/d82/d87/d8b/da5/dc4/d23/d4a/f7e 0 2024-04-25T02:08:57.707 INFO:tasks.workunit.client.0.smithi077.stdout:2/990: creat d2/d9/d19/d2c/f145 x:0 0 0 2024-04-25T02:08:57.707 INFO:tasks.workunit.client.0.smithi077.stdout:2/991: dread - d2/d9/d19/d1c/d3f/d53/d86/dca/ffb zero size 2024-04-25T02:08:57.707 INFO:tasks.workunit.client.0.smithi077.stdout:2/992: stat d2/d9/d19/d2c 0 2024-04-25T02:08:57.713 INFO:tasks.workunit.client.0.smithi077.stdout:4/936: unlink d0/d14/d21/d39/d1d/lf1 0 2024-04-25T02:08:57.713 INFO:tasks.workunit.client.0.smithi077.stdout:4/937: dread - d0/d14/d21/d39/da/d12/de5/f123 zero size 2024-04-25T02:08:57.713 INFO:tasks.workunit.client.0.smithi077.stdout:4/938: creat d0/d14/d21/d39/d1d/f133 x:0 0 0 2024-04-25T02:08:57.719 INFO:tasks.workunit.client.0.smithi077.stdout:0/894: creat d2/d17/d1d/d34/d127/f134 x:0 0 0 2024-04-25T02:08:57.722 INFO:tasks.workunit.client.0.smithi077.stdout:0/895: dread d2/d17/d1d/d34/d4c/da2/f45 [0,4194304] 0 2024-04-25T02:08:57.723 INFO:tasks.workunit.client.0.smithi077.stdout:1/955: sync 2024-04-25T02:08:57.723 INFO:tasks.workunit.client.0.smithi077.stdout:1/956: creat db/df/d14/d4d/da9/f136 x:0 0 0 2024-04-25T02:08:57.723 INFO:tasks.workunit.client.0.smithi077.stdout:1/957: chown db/df/d14/d4d/d82/d42/cae 724829505 1 2024-04-25T02:08:57.724 INFO:tasks.workunit.client.0.smithi077.stdout:9/928: dwrite df/d1b/f30 [0,4194304] 0 2024-04-25T02:08:57.726 INFO:tasks.workunit.client.0.smithi077.stdout:5/898: unlink d0/d25/d82/d87/d8b/d115/d1b/f112 0 2024-04-25T02:08:57.729 INFO:tasks.workunit.client.0.smithi077.stdout:2/993: mkdir d2/d59/d103/d146 0 2024-04-25T02:08:57.734 INFO:tasks.workunit.client.0.smithi077.stdout:4/939: creat d0/d14/d79/da4/f134 x:0 0 0 2024-04-25T02:08:57.738 INFO:tasks.workunit.client.0.smithi077.stdout:0/896: rename d2/d8/db6/dd7/d105/f12c to d2/d27/d2d/dce/de7/f135 0 2024-04-25T02:08:57.738 INFO:tasks.workunit.client.0.smithi077.stdout:0/897: write d2/d27/f8e [2863637,116086] 0 2024-04-25T02:08:57.742 INFO:tasks.workunit.client.0.smithi077.stdout:2/994: dread d2/d78/d95/fe9 [0,4194304] 0 2024-04-25T02:08:57.743 INFO:tasks.workunit.client.0.smithi077.stdout:1/958: creat db/df/d14/d4d/d82/d5c/f137 x:0 0 0 2024-04-25T02:08:57.745 INFO:tasks.workunit.client.0.smithi077.stdout:9/929: creat df/d1b/d48/d75/d90/f134 x:0 0 0 2024-04-25T02:08:57.745 INFO:tasks.workunit.client.0.smithi077.stdout:9/930: dread - df/d1b/d48/d75/fb9 zero size 2024-04-25T02:08:57.747 INFO:tasks.workunit.client.0.smithi077.stdout:1/959: dread db/df/d14/d4d/d82/d32/fa2 [0,4194304] 0 2024-04-25T02:08:57.747 INFO:tasks.workunit.client.0.smithi077.stdout:1/960: readlink db/df/d56/d5d/l118 0 2024-04-25T02:08:57.750 INFO:tasks.workunit.client.0.smithi077.stdout:0/898: creat d2/d27/d114/f136 x:0 0 0 2024-04-25T02:08:57.751 INFO:tasks.workunit.client.0.smithi077.stdout:2/995: dread d2/d78/d95/ff2 [0,4194304] 0 2024-04-25T02:08:57.751 INFO:tasks.workunit.client.0.smithi077.stdout:2/996: write d2/d9/d2f/d84/da6/fbc [3211511,13464] 0 2024-04-25T02:08:57.752 INFO:tasks.workunit.client.0.smithi077.stdout:4/940: rmdir d0/d14/d21/d39/d1d/d98 39 2024-04-25T02:08:57.752 INFO:tasks.workunit.client.0.smithi077.stdout:5/899: dwrite d0/d25/d82/d87/d8b/d115/d3/d9/d39/d3c/f91 [0,4194304] 0 2024-04-25T02:08:57.754 INFO:tasks.workunit.client.0.smithi077.stdout:5/900: dread d0/d25/d82/d87/d8b/d115/d3/d9/d39/d3c/dc6/ff4 [0,4194304] 0 2024-04-25T02:08:57.757 INFO:tasks.workunit.client.0.smithi077.stdout:1/961: unlink db/df/d56/d5d/d77/db3/fd9 0 2024-04-25T02:08:57.762 INFO:tasks.workunit.client.0.smithi077.stdout:0/899: rename d2/d27/c43 to d2/d17/d1d/d34/d4c/da2/de2/c137 0 2024-04-25T02:08:57.763 INFO:tasks.workunit.client.0.smithi077.stdout:7/846: getdents d4/dd2 0 2024-04-25T02:08:57.763 INFO:tasks.workunit.client.0.smithi077.stdout:7/847: write d4/d13/da9/f102 [1736168,91678] 0 2024-04-25T02:08:57.766 INFO:tasks.workunit.client.0.smithi077.stdout:2/997: mkdir d2/d9/d18/d31/d7c/dab/dc8/d147 0 2024-04-25T02:08:57.766 INFO:tasks.workunit.client.0.smithi077.stdout:2/998: chown d2/d9/d19/d1c/d3f/d53/d86/dca/l15 1191 1 2024-04-25T02:08:57.768 INFO:tasks.workunit.client.0.smithi077.stdout:9/931: dwrite df/d1b/d70/d74/fe8 [0,4194304] 0 2024-04-25T02:08:57.769 INFO:tasks.workunit.client.0.smithi077.stdout:9/932: read - df/d1b/fc2 zero size 2024-04-25T02:08:57.777 INFO:tasks.workunit.client.0.smithi077.stdout:5/901: dread d0/fd [0,4194304] 0 2024-04-25T02:08:57.777 INFO:tasks.workunit.client.0.smithi077.stdout:5/902: stat d0/d25/d82/d87/d8b/da5/dc4/d23/d4a/f5c 0 2024-04-25T02:08:57.781 INFO:tasks.workunit.client.0.smithi077.stdout:4/941: dwrite d0/d14/d60/d86/d34/fbe [0,4194304] 0 2024-04-25T02:08:57.786 INFO:tasks.workunit.client.0.smithi077.stdout:9/933: rmdir df/d1b/d48/dee 39 2024-04-25T02:08:57.787 INFO:tasks.workunit.client.0.smithi077.stdout:2/999: dwrite d2/d9/d19/d1c/f33 [0,4194304] 0 2024-04-25T02:08:57.789 INFO:tasks.workunit.client.0.smithi077.stdout:7/848: dwrite d4/f12 [0,4194304] 0 2024-04-25T02:08:57.789 INFO:tasks.workunit.client.0.smithi077.stdout:7/849: stat d4/d7c/fd1 0 2024-04-25T02:08:57.790 INFO:tasks.workunit.client.0.smithi077.stdout:7/850: chown d4/d13/d18/d24/d3f/d58 347044398 1 2024-04-25T02:08:57.795 INFO:tasks.workunit.client.0.smithi077.stdout:5/903: mknod d0/c127 0 2024-04-25T02:08:57.799 INFO:tasks.workunit.client.0.smithi077.stdout:9/934: dread df/f10 [0,4194304] 0 2024-04-25T02:08:57.800 INFO:tasks.workunit.client.0.smithi077.stdout:9/935: truncate df/d1b/d70/d84/fd5 884345 0 2024-04-25T02:08:57.802 INFO:tasks.workunit.client.0.smithi077.stdout:4/942: link d0/d14/d21/d39/da/d12/f10a d0/d14/d60/d86/f135 0 2024-04-25T02:08:57.802 INFO:tasks.workunit.client.0.smithi077.stdout:4/943: fsync d0/d14/d60/d62/ff2 0 2024-04-25T02:08:57.803 INFO:tasks.workunit.client.0.smithi077.stdout:3/893: sync 2024-04-25T02:08:57.821 INFO:tasks.workunit.client.0.smithi077.stdout:9/936: mkdir df/d1b/d48/d75/d90/d135 0 2024-04-25T02:08:57.822 INFO:tasks.workunit.client.0.smithi077.stdout:9/937: dread - df/d1b/fc2 zero size 2024-04-25T02:08:57.825 INFO:tasks.workunit.client.0.smithi077.stdout:3/894: mkdir d0/d2/de/d48/d135/d149 0 2024-04-25T02:08:57.826 INFO:tasks.workunit.client.0.smithi077.stdout:7/851: mknod d4/d13/d66/c116 0 2024-04-25T02:08:57.834 INFO:tasks.workunit.client.0.smithi077.stdout:9/938: creat df/d1b/d48/d75/f136 x:0 0 0 2024-04-25T02:08:57.834 INFO:tasks.workunit.client.0.smithi077.stdout:9/939: write df/d1b/d48/f54 [5855361,93665] 0 2024-04-25T02:08:57.836 INFO:tasks.workunit.client.0.smithi077.stdout:3/895: mknod d0/dc5/c14a 0 2024-04-25T02:08:57.836 INFO:tasks.workunit.client.0.smithi077.stdout:3/896: write d0/d17/f37 [7801657,31389] 0 2024-04-25T02:08:57.836 INFO:tasks.workunit.client.0.smithi077.stdout:3/897: creat d0/d3e/d42/d64/d88/f14b x:0 0 0 2024-04-25T02:08:57.838 INFO:tasks.workunit.client.0.smithi077.stdout:7/852: mkdir d4/d13/d18/d24/d3f/d58/d117 0 2024-04-25T02:08:57.844 INFO:tasks.workunit.client.0.smithi077.stdout:4/944: dwrite d0/d14/d21/f2a [0,4194304] 0 2024-04-25T02:08:57.844 INFO:tasks.workunit.client.0.smithi077.stdout:3/898: write d0/dd3/fef [856036,67834] 0 2024-04-25T02:08:57.844 INFO:tasks.workunit.client.0.smithi077.stdout:3/899: chown d0/d3e/d62/d6a/db9/dde/f112 571 1 2024-04-25T02:08:57.855 INFO:tasks.workunit.client.0.smithi077.stdout:4/945: unlink d0/d14/d21/d39/da/d12/d35/lc8 0 2024-04-25T02:08:57.855 INFO:tasks.workunit.client.0.smithi077.stdout:5/904: rmdir d0/d25/d82/d87/d8b/d115/d1b 39 2024-04-25T02:08:57.855 INFO:tasks.workunit.client.0.smithi077.stdout:5/905: fdatasync d0/d25/d82/d87/d8b/d115/d1b/d3b/fd1 0 2024-04-25T02:08:57.859 INFO:tasks.workunit.client.0.smithi077.stdout:9/940: dwrite df/f10 [4194304,4194304] 0 2024-04-25T02:08:57.859 INFO:tasks.workunit.client.0.smithi077.stdout:7/853: dwrite d4/d13/d18/f36 [0,4194304] 0 2024-04-25T02:08:57.859 INFO:tasks.workunit.client.0.smithi077.stdout:9/941: dread - df/d1b/d56/ddf/f12b zero size 2024-04-25T02:08:57.860 INFO:tasks.workunit.client.0.smithi077.stdout:3/900: mkdir d0/d17/d4b/d59/d103/d14c 0 2024-04-25T02:08:57.860 INFO:tasks.workunit.client.0.smithi077.stdout:3/901: write d0/f1f [733739,111176] 0 2024-04-25T02:08:57.863 INFO:tasks.workunit.client.0.smithi077.stdout:5/906: truncate d0/d25/d82/d87/d8b/da5/dc4/f21 1485044 0 2024-04-25T02:08:57.863 INFO:tasks.workunit.client.0.smithi077.stdout:5/907: chown d0/d25/d82 55 1 2024-04-25T02:08:57.866 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:57 smithi112 ceph-mon[33313]: pgmap v258: 65 pgs: 65 active+clean; 1.8 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 183 MiB/s rd, 238 MiB/s wr, 479 op/s 2024-04-25T02:08:57.868 INFO:tasks.workunit.client.0.smithi077.stdout:7/854: truncate d4/d13/d18/d2d/f47 1330192 0 2024-04-25T02:08:57.870 INFO:tasks.workunit.client.0.smithi077.stdout:9/942: mknod df/c137 0 2024-04-25T02:08:57.871 INFO:tasks.workunit.client.0.smithi077.stdout:4/946: dwrite d0/d14/d60/d78/dce/d11b/f114 [0,4194304] 0 2024-04-25T02:08:57.871 INFO:tasks.workunit.client.0.smithi077.stdout:4/947: dread - d0/d14/d21/d39/d1d/f133 zero size 2024-04-25T02:08:57.872 INFO:tasks.workunit.client.0.smithi077.stdout:3/902: symlink d0/d17/d4b/d59/l14d 0 2024-04-25T02:08:57.872 INFO:tasks.workunit.client.0.smithi077.stdout:3/903: write d0/dc5/f121 [71035,32399] 0 2024-04-25T02:08:57.874 INFO:tasks.workunit.client.0.smithi077.stdout:5/908: unlink d0/d25/d82/d87/d8b/d115/d3/ccc 0 2024-04-25T02:08:57.876 INFO:tasks.workunit.client.0.smithi077.stdout:0/900: rmdir d2/d27/d114 39 2024-04-25T02:08:57.878 INFO:tasks.workunit.client.0.smithi077.stdout:7/855: creat d4/d13/d2c/f118 x:0 0 0 2024-04-25T02:08:57.878 INFO:tasks.workunit.client.0.smithi077.stdout:9/943: dread df/f2e [0,4194304] 0 2024-04-25T02:08:57.879 INFO:tasks.workunit.client.0.smithi077.stdout:9/944: creat df/d1b/d48/d75/d90/f138 x:0 0 0 2024-04-25T02:08:57.885 INFO:tasks.workunit.client.0.smithi077.stdout:4/948: getdents d0/d14/d79/da4/dac/dd4 0 2024-04-25T02:08:57.888 INFO:tasks.workunit.client.0.smithi077.stdout:5/909: creat d0/d25/d82/d87/d8b/d115/f128 x:0 0 0 2024-04-25T02:08:57.890 INFO:tasks.workunit.client.0.smithi077.stdout:0/901: mknod d2/c138 0 2024-04-25T02:08:57.890 INFO:tasks.workunit.client.0.smithi077.stdout:0/902: fdatasync d2/d27/d2d/dce/de7/da7/fe5 0 2024-04-25T02:08:57.890 INFO:tasks.workunit.client.0.smithi077.stdout:3/904: dwrite d0/d2/de/d36/fb7 [0,4194304] 0 2024-04-25T02:08:57.892 INFO:tasks.workunit.client.0.smithi077.stdout:7/856: mknod d4/d13/d5b/d8b/db2/c119 0 2024-04-25T02:08:57.892 INFO:tasks.workunit.client.0.smithi077.stdout:7/857: read d4/d13/d18/d24/d3f/d58/f2b [334517,29119] 0 2024-04-25T02:08:57.892 INFO:tasks.workunit.client.0.smithi077.stdout:7/858: write d4/f9f [826771,33886] 0 2024-04-25T02:08:57.892 INFO:tasks.workunit.client.0.smithi077.stdout:7/859: truncate d4/d13/d18/d2d/d30/dab/fd3 557441 0 2024-04-25T02:08:57.895 INFO:tasks.workunit.client.0.smithi077.stdout:9/945: symlink df/d1b/d56/ddf/d11d/l139 0 2024-04-25T02:08:57.895 INFO:tasks.workunit.client.0.smithi077.stdout:9/946: chown df/d1b/d48/f64 1260980 1 2024-04-25T02:08:57.899 INFO:tasks.workunit.client.0.smithi077.stdout:0/903: write d2/d8/db6/dd7/de0/f12f [3417278,66247] 0 2024-04-25T02:08:57.900 INFO:tasks.workunit.client.0.smithi077.stdout:7/860: chown d4/d13/d66/l78 990 1 2024-04-25T02:08:57.902 INFO:tasks.workunit.client.0.smithi077.stdout:0/904: dread d2/d9/d2a/f58 [0,4194304] 0 2024-04-25T02:08:57.903 INFO:tasks.workunit.client.0.smithi077.stdout:9/947: truncate df/d1b/f51 197712 0 2024-04-25T02:08:57.905 INFO:tasks.workunit.client.0.smithi077.stdout:4/949: rename d0/d14/d21/d39/d64/c99 to d0/d14/d21/d39/da/d12/d35/d3e/d3a/c136 0 2024-04-25T02:08:57.907 INFO:tasks.workunit.client.0.smithi077.stdout:7/861: symlink d4/d13/d18/d24/d3f/l11a 0 2024-04-25T02:08:57.908 INFO:tasks.workunit.client.0.smithi077.stdout:7/862: readlink d4/d13/d18/d24/d3f/d59/lee 0 2024-04-25T02:08:57.914 INFO:tasks.workunit.client.0.smithi077.stdout:7/863: dread d4/d7c/fd1 [0,4194304] 0 2024-04-25T02:08:57.914 INFO:tasks.workunit.client.0.smithi077.stdout:0/905: write d2/d17/d4e/f9b [2291888,9786] 0 2024-04-25T02:08:57.914 INFO:tasks.workunit.client.0.smithi077.stdout:0/906: creat d2/d17/d121/f139 x:0 0 0 2024-04-25T02:08:57.918 INFO:tasks.workunit.client.0.smithi077.stdout:7/864: mkdir d4/d13/d18/d24/d3f/d59/dd6/d11b 0 2024-04-25T02:08:57.918 INFO:tasks.workunit.client.0.smithi077.stdout:7/865: creat d4/d13/d18/d2d/d56/d68/d88/f11c x:0 0 0 2024-04-25T02:08:57.927 INFO:tasks.workunit.client.0.smithi077.stdout:7/866: creat d4/f11d x:0 0 0 2024-04-25T02:08:57.927 INFO:tasks.workunit.client.0.smithi077.stdout:7/867: stat d4/d13/d18/d24/de5 0 2024-04-25T02:08:57.927 INFO:tasks.workunit.client.0.smithi077.stdout:7/868: fdatasync d4/d13/d2c/f2e 0 2024-04-25T02:08:57.927 INFO:tasks.workunit.client.0.smithi077.stdout:7/869: creat d4/d13/de8/f11e x:0 0 0 2024-04-25T02:08:57.928 INFO:tasks.workunit.client.0.smithi077.stdout:5/910: dwrite d0/d25/dc7/dca/fd7 [0,4194304] 0 2024-04-25T02:08:57.928 INFO:tasks.workunit.client.0.smithi077.stdout:5/911: read d0/d25/d82/d87/d8b/d115/d3/f15 [1781241,78864] 0 2024-04-25T02:08:57.928 INFO:tasks.workunit.client.0.smithi077.stdout:5/912: write d0/d25/d82/d87/d8b/d115/d1b/d35/fac [2603186,48760] 0 2024-04-25T02:08:57.929 INFO:tasks.workunit.client.0.smithi077.stdout:5/913: write d0/fe6 [245109,80792] 0 2024-04-25T02:08:57.929 INFO:tasks.workunit.client.0.smithi077.stdout:5/914: chown d0/d25/d82/d87/d8b/d115/d3/d11a 160587 1 2024-04-25T02:08:57.931 INFO:tasks.workunit.client.0.smithi077.stdout:7/870: mkdir d4/dd2/d107/d11f 0 2024-04-25T02:08:57.933 INFO:tasks.workunit.client.0.smithi077.stdout:3/905: dwrite d0/d3e/d62/f68 [0,4194304] 0 2024-04-25T02:08:57.933 INFO:tasks.workunit.client.0.smithi077.stdout:9/948: dwrite df/d1b/d48/f6f [0,4194304] 0 2024-04-25T02:08:57.933 INFO:tasks.workunit.client.0.smithi077.stdout:9/949: dread - df/d1b/d48/d75/fb9 zero size 2024-04-25T02:08:57.933 INFO:tasks.workunit.client.0.smithi077.stdout:9/950: write df/fa2 [3067012,696] 0 2024-04-25T02:08:57.940 INFO:tasks.workunit.client.0.smithi077.stdout:4/950: dwrite d0/d14/d21/d39/da/d12/f10a [0,4194304] 0 2024-04-25T02:08:57.940 INFO:tasks.workunit.client.0.smithi077.stdout:4/951: write d0/d14/d79/d104/f107 [713127,31046] 0 2024-04-25T02:08:57.940 INFO:tasks.workunit.client.0.smithi077.stdout:4/952: chown d0/d14/d60/d86/d25/lb3 2 1 2024-04-25T02:08:57.940 INFO:tasks.workunit.client.0.smithi077.stdout:0/907: dwrite d2/d9/d2a/db5/fbc [0,4194304] 0 2024-04-25T02:08:57.954 INFO:tasks.workunit.client.0.smithi077.stdout:4/953: mknod d0/d14/d60/d78/dce/c137 0 2024-04-25T02:08:57.957 INFO:tasks.workunit.client.0.smithi077.stdout:0/908: rename d2/d17/d1d/d34/d4c/da2/d51/de8/f11f to d2/d8/dfb/f13a 0 2024-04-25T02:08:57.959 INFO:tasks.workunit.client.0.smithi077.stdout:9/951: unlink df/d60/d87/lcc 0 2024-04-25T02:08:57.961 INFO:tasks.workunit.client.0.smithi077.stdout:4/954: link d0/d14/d60/d86/d25/f11f d0/d14/d21/d39/da/d12/d35/dfe/f138 0 2024-04-25T02:08:57.963 INFO:tasks.workunit.client.0.smithi077.stdout:9/952: mknod df/d80/d117/c13a 0 2024-04-25T02:08:57.965 INFO:tasks.workunit.client.0.smithi077.stdout:5/915: dwrite d0/d25/d82/d87/d8b/da5/dc4/d23/f7c [0,4194304] 0 2024-04-25T02:08:57.966 INFO:tasks.workunit.client.0.smithi077.stdout:7/871: dwrite d4/fb [0,4194304] 0 2024-04-25T02:08:57.966 INFO:tasks.workunit.client.0.smithi077.stdout:3/906: dwrite d0/d2/de/d36/fb8 [0,4194304] 0 2024-04-25T02:08:57.968 INFO:tasks.workunit.client.0.smithi077.stdout:4/955: truncate d0/d14/d21/d39/da/d12/d35/d3e/f2b 548682 0 2024-04-25T02:08:57.971 INFO:tasks.workunit.client.0.smithi077.stdout:9/953: creat df/d1b/f13b x:0 0 0 2024-04-25T02:08:57.971 INFO:tasks.workunit.client.0.smithi077.stdout:4/956: dread d0/d14/d21/d39/da/fab [0,4194304] 0 2024-04-25T02:08:57.976 INFO:tasks.workunit.client.0.smithi077.stdout:1/962: sync 2024-04-25T02:08:57.976 INFO:tasks.workunit.client.0.smithi077.stdout:1/963: write db/df/fe3 [867471,75072] 0 2024-04-25T02:08:57.977 INFO:tasks.workunit.client.0.smithi077.stdout:7/872: mkdir d4/dd2/d107/d120 0 2024-04-25T02:08:57.977 INFO:tasks.workunit.client.0.smithi077.stdout:7/873: dread - d4/d13/f48 zero size 2024-04-25T02:08:57.977 INFO:tasks.workunit.client.0.smithi077.stdout:0/909: dwrite d2/d17/d121/f12e [0,4194304] 0 2024-04-25T02:08:57.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:57 smithi077 ceph-mon[26330]: pgmap v258: 65 pgs: 65 active+clean; 1.8 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 183 MiB/s rd, 238 MiB/s wr, 479 op/s 2024-04-25T02:08:57.980 INFO:tasks.workunit.client.0.smithi077.stdout:5/916: write d0/d25/d82/d87/d8b/da5/dc4/d23/d4a/f5d [1658345,35838] 0 2024-04-25T02:08:57.980 INFO:tasks.workunit.client.0.smithi077.stdout:5/917: stat d0/d25/d82/d87/d8b/da5/dc4/ca0 0 2024-04-25T02:08:57.981 INFO:tasks.workunit.client.0.smithi077.stdout:3/907: mkdir d0/d17/dd4/d14e 0 2024-04-25T02:08:57.986 INFO:tasks.workunit.client.0.smithi077.stdout:9/954: link df/d1b/d48/db6/le7 df/d1b/d48/d75/d90/dfe/l13c 0 2024-04-25T02:08:57.988 INFO:tasks.workunit.client.0.smithi077.stdout:1/964: truncate db/df/d56/d5d/d77/f8d 469939 0 2024-04-25T02:08:57.988 INFO:tasks.workunit.client.0.smithi077.stdout:4/957: dwrite d0/d14/d60/d86/d96/f66 [4194304,4194304] 0 2024-04-25T02:08:57.992 INFO:tasks.workunit.client.0.smithi077.stdout:7/874: mkdir d4/d13/d18/d2d/d56/d68/d88/d121 0 2024-04-25T02:08:57.992 INFO:tasks.workunit.client.0.smithi077.stdout:7/875: chown d4/d13/d2c/cf0 239 1 2024-04-25T02:08:57.999 INFO:tasks.workunit.client.0.smithi077.stdout:1/965: dread db/df/d14/f97 [0,4194304] 0 2024-04-25T02:08:57.999 INFO:tasks.workunit.client.0.smithi077.stdout:1/966: write db/fa6 [1188812,41315] 0 2024-04-25T02:08:57.999 INFO:tasks.workunit.client.0.smithi077.stdout:1/967: write db/df/d14/d4d/d82/d5c/f137 [79270,36818] 0 2024-04-25T02:08:57.999 INFO:tasks.workunit.client.0.smithi077.stdout:0/910: mknod d2/d17/d1d/d34/d4c/da2/d51/c13b 0 2024-04-25T02:08:58.006 INFO:tasks.workunit.client.0.smithi077.stdout:3/908: mkdir d0/d2/de/d36/da0/d14f 0 2024-04-25T02:08:58.007 INFO:tasks.workunit.client.0.smithi077.stdout:3/909: stat d0/d2/de/c12d 0 2024-04-25T02:08:58.014 INFO:tasks.workunit.client.0.smithi077.stdout:9/955: truncate df/d1b/f20 2165840 0 2024-04-25T02:08:58.014 INFO:tasks.workunit.client.0.smithi077.stdout:9/956: chown df/d1b/d48/dee/c12e 4868887 1 2024-04-25T02:08:58.015 INFO:tasks.workunit.client.0.smithi077.stdout:1/968: dwrite db/df/d14/dfa/f55 [0,4194304] 0 2024-04-25T02:08:58.015 INFO:tasks.workunit.client.0.smithi077.stdout:1/969: chown db/df/d1b 0 1 2024-04-25T02:08:58.019 INFO:tasks.workunit.client.0.smithi077.stdout:4/958: mknod d0/d14/d60/d62/c139 0 2024-04-25T02:08:58.020 INFO:tasks.workunit.client.0.smithi077.stdout:4/959: dread - d0/d14/d79/da4/faf zero size 2024-04-25T02:08:58.020 INFO:tasks.workunit.client.0.smithi077.stdout:4/960: dread - d0/d14/d21/d39/da/d12/d35/dfe/f138 zero size 2024-04-25T02:08:58.045 INFO:tasks.workunit.client.0.smithi077.stdout:9/957: dwrite df/f49 [0,4194304] 0 2024-04-25T02:08:58.045 INFO:tasks.workunit.client.0.smithi077.stdout:4/961: dwrite d0/d14/d60/d62/f77 [0,4194304] 0 2024-04-25T02:08:58.045 INFO:tasks.workunit.client.0.smithi077.stdout:9/958: write df/d80/fef [5209994,2871] 0 2024-04-25T02:08:58.049 INFO:tasks.workunit.client.0.smithi077.stdout:7/876: mknod d4/c122 0 2024-04-25T02:08:58.051 INFO:tasks.workunit.client.0.smithi077.stdout:0/911: creat d2/d27/d2d/dce/de7/f13c x:0 0 0 2024-04-25T02:08:58.054 INFO:tasks.workunit.client.0.smithi077.stdout:3/910: rename d0/d3e/d42/d64/l71 to d0/d2/de/d36/da0/l150 0 2024-04-25T02:08:58.056 INFO:tasks.workunit.client.0.smithi077.stdout:9/959: read df/d1b/d48/f64 [11131894,95317] 0 2024-04-25T02:08:58.060 INFO:tasks.workunit.client.0.smithi077.stdout:4/962: dwrite d0/d14/d21/d39/da/d12/d35/d3e/f50 [0,4194304] 0 2024-04-25T02:08:58.060 INFO:tasks.workunit.client.0.smithi077.stdout:4/963: truncate d0/d14/d21/d39/da/d12/d35/f12d 628952 0 2024-04-25T02:08:58.062 INFO:tasks.workunit.client.0.smithi077.stdout:1/970: truncate db/df/d14/d4d/d82/fab 3494131 0 2024-04-25T02:08:58.064 INFO:tasks.workunit.client.0.smithi077.stdout:1/971: dread db/df/fe3 [0,4194304] 0 2024-04-25T02:08:58.064 INFO:tasks.workunit.client.0.smithi077.stdout:3/911: dread d0/d2/f41 [0,4194304] 0 2024-04-25T02:08:58.064 INFO:tasks.workunit.client.0.smithi077.stdout:3/912: chown d0/d3e/d42/d123/d128 166 1 2024-04-25T02:08:58.068 INFO:tasks.workunit.client.0.smithi077.stdout:7/877: mknod d4/d13/d5b/d8b/db2/c123 0 2024-04-25T02:08:58.069 INFO:tasks.workunit.client.0.smithi077.stdout:7/878: write d4/f37 [1129866,109962] 0 2024-04-25T02:08:58.071 INFO:tasks.workunit.client.0.smithi077.stdout:0/912: mkdir d2/d17/d1d/db1/d13d 0 2024-04-25T02:08:58.071 INFO:tasks.workunit.client.0.smithi077.stdout:0/913: write d2/d17/d1d/d34/d4c/da2/f18 [877025,11539] 0 2024-04-25T02:08:58.073 INFO:tasks.workunit.client.0.smithi077.stdout:7/879: write d4/d13/d18/d2d/d30/f63 [922346,13604] 0 2024-04-25T02:08:58.090 INFO:tasks.workunit.client.0.smithi077.stdout:7/880: dwrite d4/dd2/f106 [0,4194304] 0 2024-04-25T02:08:58.092 INFO:tasks.workunit.client.0.smithi077.stdout:4/964: link d0/d14/d21/d39/da/d12/d35/l55 d0/d14/d79/da4/l13a 0 2024-04-25T02:08:58.092 INFO:tasks.workunit.client.0.smithi077.stdout:4/965: creat d0/d14/d79/da4/f13b x:0 0 0 2024-04-25T02:08:58.097 INFO:tasks.workunit.client.0.smithi077.stdout:1/972: symlink db/df/d14/d3e/daa/l138 0 2024-04-25T02:08:58.100 INFO:tasks.workunit.client.0.smithi077.stdout:3/913: creat d0/d2/de/d48/f151 x:0 0 0 2024-04-25T02:08:58.100 INFO:tasks.workunit.client.0.smithi077.stdout:3/914: chown d0/d3e/d93/dae/lbb 183434 1 2024-04-25T02:08:58.100 INFO:tasks.workunit.client.0.smithi077.stdout:3/915: readlink d0/d2/d2f/d5f/ld0 0 2024-04-25T02:08:58.100 INFO:tasks.workunit.client.0.smithi077.stdout:3/916: fdatasync d0/d2/d83/f134 0 2024-04-25T02:08:58.104 INFO:tasks.workunit.client.0.smithi077.stdout:0/914: unlink d2/l7 0 2024-04-25T02:08:58.104 INFO:tasks.workunit.client.0.smithi077.stdout:0/915: write d2/d17/d4e/f8a [1559983,96616] 0 2024-04-25T02:08:58.106 INFO:tasks.workunit.client.0.smithi077.stdout:9/960: getdents df/d60/d87/dca 0 2024-04-25T02:08:58.113 INFO:tasks.workunit.client.0.smithi077.stdout:7/881: dwrite d4/d13/d5b/d8b/fde [0,4194304] 0 2024-04-25T02:08:58.113 INFO:tasks.workunit.client.0.smithi077.stdout:0/916: dread d2/d8/dad/fba [0,4194304] 0 2024-04-25T02:08:58.116 INFO:tasks.workunit.client.0.smithi077.stdout:7/882: fsync d4/f37 0 2024-04-25T02:08:58.118 INFO:tasks.workunit.client.0.smithi077.stdout:1/973: rename db/d26/l122 to db/df/d14/d4d/d82/d10f/l139 0 2024-04-25T02:08:58.124 INFO:tasks.workunit.client.0.smithi077.stdout:0/917: mknod d2/d8/c13e 0 2024-04-25T02:08:58.124 INFO:tasks.workunit.client.0.smithi077.stdout:0/918: chown d2/d8/db6/dd7 0 1 2024-04-25T02:08:58.125 INFO:tasks.workunit.client.0.smithi077.stdout:1/974: dread db/df/d14/d4d/d82/d5c/fb5 [0,4194304] 0 2024-04-25T02:08:58.129 INFO:tasks.workunit.client.0.smithi077.stdout:4/966: link d0/d14/d21/l6e d0/d14/d60/d86/l13c 0 2024-04-25T02:08:58.129 INFO:tasks.workunit.client.0.smithi077.stdout:4/967: write d0/d14/d60/d86/d96/fa9 [290003,24702] 0 2024-04-25T02:08:58.129 INFO:tasks.workunit.client.0.smithi077.stdout:4/968: fsync d0/d14/d21/d39/da/ffc 0 2024-04-25T02:08:58.129 INFO:tasks.workunit.client.0.smithi077.stdout:4/969: write d0/d14/d21/d39/da/d12/d35/d3e/f57 [4485529,9873] 0 2024-04-25T02:08:58.132 INFO:tasks.workunit.client.0.smithi077.stdout:7/883: mknod d4/d13/d18/d24/d3f/de9/c124 0 2024-04-25T02:08:58.133 INFO:tasks.workunit.client.0.smithi077.stdout:1/975: dread db/df/d14/d3e/daa/fb6 [0,4194304] 0 2024-04-25T02:08:58.133 INFO:tasks.workunit.client.0.smithi077.stdout:1/976: chown db/df/d56/d5d/f10e 8593 1 2024-04-25T02:08:58.134 INFO:tasks.workunit.client.0.smithi077.stdout:1/977: stat db/df/d14/lca 0 2024-04-25T02:08:58.134 INFO:tasks.workunit.client.0.smithi077.stdout:1/978: truncate db/df/d56/d5d/d77/f108 3894694 0 2024-04-25T02:08:58.137 INFO:tasks.workunit.client.0.smithi077.stdout:9/961: rename df/d1b/f40 to df/d1b/d70/d84/dde/de9/f13d 0 2024-04-25T02:08:58.139 INFO:tasks.workunit.client.0.smithi077.stdout:4/970: write d0/d14/d60/d86/f4c [1125245,16386] 0 2024-04-25T02:08:58.139 INFO:tasks.workunit.client.0.smithi077.stdout:4/971: read - d0/d14/d21/d39/da/d12/d35/f115 zero size 2024-04-25T02:08:58.139 INFO:tasks.workunit.client.0.smithi077.stdout:3/917: rmdir d0/d2/de/d27 39 2024-04-25T02:08:58.139 INFO:tasks.workunit.client.0.smithi077.stdout:3/918: chown d0/d17/d4b/d59/f104 23249186 1 2024-04-25T02:08:58.139 INFO:tasks.workunit.client.0.smithi077.stdout:3/919: creat d0/d17/d4b/f152 x:0 0 0 2024-04-25T02:08:58.139 INFO:tasks.workunit.client.0.smithi077.stdout:3/920: fsync d0/d17/dd4/d107/f12e 0 2024-04-25T02:08:58.140 INFO:tasks.workunit.client.0.smithi077.stdout:0/919: dwrite d2/d17/d1d/d34/d4c/da2/dae/ff0 [0,4194304] 0 2024-04-25T02:08:58.144 INFO:tasks.workunit.client.0.smithi077.stdout:3/921: dread d0/d2/de/f82 [0,4194304] 0 2024-04-25T02:08:58.146 INFO:tasks.workunit.client.0.smithi077.stdout:7/884: link d4/c15 d4/dd2/c125 0 2024-04-25T02:08:58.149 INFO:tasks.workunit.client.0.smithi077.stdout:1/979: symlink db/df/d56/dc3/l13a 0 2024-04-25T02:08:58.152 INFO:tasks.workunit.client.0.smithi077.stdout:9/962: creat df/d60/f13e x:0 0 0 2024-04-25T02:08:58.156 INFO:tasks.workunit.client.0.smithi077.stdout:4/972: rename d0/d14/d21/d39/f61 to d0/d14/d60/d78/f13d 0 2024-04-25T02:08:58.160 INFO:tasks.workunit.client.0.smithi077.stdout:4/973: dread d0/d14/d79/d104/f107 [0,4194304] 0 2024-04-25T02:08:58.162 INFO:tasks.workunit.client.0.smithi077.stdout:3/922: dwrite d0/f1f [0,4194304] 0 2024-04-25T02:08:58.173 INFO:tasks.workunit.client.0.smithi077.stdout:7/885: symlink d4/d13/d18/d24/d3f/de9/l126 0 2024-04-25T02:08:58.173 INFO:tasks.workunit.client.0.smithi077.stdout:7/886: fdatasync d4/d13/d18/f94 0 2024-04-25T02:08:58.179 INFO:tasks.workunit.client.0.smithi077.stdout:1/980: unlink db/df/d56/d5d/d77/ff3 0 2024-04-25T02:08:58.181 INFO:tasks.workunit.client.0.smithi077.stdout:9/963: mknod df/d1b/d56/ddf/d11d/c13f 0 2024-04-25T02:08:58.181 INFO:tasks.workunit.client.0.smithi077.stdout:9/964: chown df/d1b/d70/cbc 5 1 2024-04-25T02:08:58.181 INFO:tasks.workunit.client.0.smithi077.stdout:9/965: fdatasync df/d1b/d48/d75/d90/d10f/f114 0 2024-04-25T02:08:58.181 INFO:tasks.workunit.client.0.smithi077.stdout:9/966: chown df/d60/l9d 918207 1 2024-04-25T02:08:58.182 INFO:tasks.workunit.client.0.smithi077.stdout:1/981: dread db/df/d14/d4d/d82/d5c/fb5 [0,4194304] 0 2024-04-25T02:08:58.184 INFO:tasks.workunit.client.0.smithi077.stdout:4/974: creat d0/d14/d21/d39/f13e x:0 0 0 2024-04-25T02:08:58.190 INFO:tasks.workunit.client.0.smithi077.stdout:3/923: unlink d0/d17/cc1 0 2024-04-25T02:08:58.190 INFO:tasks.workunit.client.0.smithi077.stdout:3/924: dread - d0/d2/de/d36/da0/fd1 zero size 2024-04-25T02:08:58.193 INFO:tasks.workunit.client.0.smithi077.stdout:7/887: rename d4/d13/d2c/cf0 to d4/d13/d18/d2d/d56/d68/c127 0 2024-04-25T02:08:58.196 INFO:tasks.workunit.client.0.smithi077.stdout:9/967: mkdir df/d1b/d48/d75/d90/d135/d140 0 2024-04-25T02:08:58.196 INFO:tasks.workunit.client.0.smithi077.stdout:9/968: dread - df/d1b/d56/d67/d68/db3/f106 zero size 2024-04-25T02:08:58.197 INFO:tasks.workunit.client.0.smithi077.stdout:1/982: dwrite db/d26/f2f [0,4194304] 0 2024-04-25T02:08:58.198 INFO:tasks.workunit.client.0.smithi077.stdout:3/925: truncate d0/d2/fc8 473198 0 2024-04-25T02:08:58.201 INFO:tasks.workunit.client.0.smithi077.stdout:7/888: link d4/d13/d5b/d8b/la0 d4/d13/de8/l128 0 2024-04-25T02:08:58.204 INFO:tasks.workunit.client.0.smithi077.stdout:4/975: mknod d0/d14/d21/c13f 0 2024-04-25T02:08:58.204 INFO:tasks.workunit.client.0.smithi077.stdout:4/976: truncate d0/d14/d21/f2f 1076583 0 2024-04-25T02:08:58.204 INFO:tasks.workunit.client.0.smithi077.stdout:5/918: sync 2024-04-25T02:08:58.213 INFO:tasks.workunit.client.0.smithi077.stdout:4/977: rmdir d0/d14/d21/d39/da/d12/d35/d3e/d3a 39 2024-04-25T02:08:58.216 INFO:tasks.workunit.client.0.smithi077.stdout:5/919: creat d0/d25/d82/d87/d8b/d115/d1b/d35/df3/f129 x:0 0 0 2024-04-25T02:08:58.217 INFO:tasks.workunit.client.0.smithi077.stdout:7/889: dread d4/d13/d18/d24/d3f/fc5 [0,4194304] 0 2024-04-25T02:08:58.217 INFO:tasks.workunit.client.0.smithi077.stdout:7/890: chown d4/cb1 352481 1 2024-04-25T02:08:58.220 INFO:tasks.workunit.client.0.smithi077.stdout:1/983: dwrite db/df/d56/f58 [0,4194304] 0 2024-04-25T02:08:58.220 INFO:tasks.workunit.client.0.smithi077.stdout:3/926: dwrite d0/d3e/d62/d6a/db9/dde/f112 [0,4194304] 0 2024-04-25T02:08:58.221 INFO:tasks.workunit.client.0.smithi077.stdout:5/920: unlink d0/ff8 0 2024-04-25T02:08:58.227 INFO:tasks.workunit.client.0.smithi077.stdout:7/891: rename d4/d13/c5a to d4/d13/d18/d24/d3f/de9/c129 0 2024-04-25T02:08:58.233 INFO:tasks.workunit.client.0.smithi077.stdout:4/978: unlink d0/d14/d21/d39/d64/l100 0 2024-04-25T02:08:58.233 INFO:tasks.workunit.client.0.smithi077.stdout:4/979: write d0/d14/d60/d86/d96/f97 [4717501,37267] 0 2024-04-25T02:08:58.233 INFO:tasks.workunit.client.0.smithi077.stdout:4/980: readlink d0/d14/d79/da4/l13a 0 2024-04-25T02:08:58.233 INFO:tasks.workunit.client.0.smithi077.stdout:4/981: chown d0/d14/d21/d39/da/f63 18700 1 2024-04-25T02:08:58.236 INFO:tasks.workunit.client.0.smithi077.stdout:7/892: read d4/d13/d2c/f92 [382670,68457] 0 2024-04-25T02:08:58.240 INFO:tasks.workunit.client.0.smithi077.stdout:1/984: dwrite db/df/d14/f97 [0,4194304] 0 2024-04-25T02:08:58.241 INFO:tasks.workunit.client.0.smithi077.stdout:7/893: dread d4/d13/d5b/d8b/f105 [0,4194304] 0 2024-04-25T02:08:58.241 INFO:tasks.workunit.client.0.smithi077.stdout:7/894: stat d4/d13/d18/d2d/d56/d68/f9a 0 2024-04-25T02:08:58.241 INFO:tasks.workunit.client.0.smithi077.stdout:7/895: write d4/d13/d18/d2d/d30/dab/fe1 [4798146,60099] 0 2024-04-25T02:08:58.241 INFO:tasks.workunit.client.0.smithi077.stdout:7/896: chown d4/d13/d5b 27608 1 2024-04-25T02:08:58.241 INFO:tasks.workunit.client.0.smithi077.stdout:7/897: dread - d4/d13/d18/d2d/d56/d68/d88/f108 zero size 2024-04-25T02:08:58.249 INFO:tasks.workunit.client.0.smithi077.stdout:3/927: getdents d0/d2/d2f/d50 0 2024-04-25T02:08:58.254 INFO:tasks.workunit.client.0.smithi077.stdout:1/985: creat db/df/d14/d3e/d69/d132/f13b x:0 0 0 2024-04-25T02:08:58.260 INFO:tasks.workunit.client.0.smithi077.stdout:7/898: rename d4/d13/l25 to d4/d13/l12a 0 2024-04-25T02:08:58.267 INFO:tasks.workunit.client.0.smithi077.stdout:3/928: rename d0/d40/c91 to d0/d2/de/d27/d13a/d148/c153 0 2024-04-25T02:08:58.267 INFO:tasks.workunit.client.0.smithi077.stdout:1/986: dwrite db/df/d14/d3e/daa/f131 [0,4194304] 0 2024-04-25T02:08:58.269 INFO:tasks.workunit.client.0.smithi077.stdout:1/987: write db/df/fe3 [809506,108227] 0 2024-04-25T02:08:58.269 INFO:tasks.workunit.client.0.smithi077.stdout:3/929: write d0/d2/f35 [4217494,15946] 0 2024-04-25T02:08:58.269 INFO:tasks.workunit.client.0.smithi077.stdout:3/930: stat d0/d3e/d62/f68 0 2024-04-25T02:08:58.269 INFO:tasks.workunit.client.0.smithi077.stdout:1/988: creat db/df/d14/d3e/d69/dad/f13c x:0 0 0 2024-04-25T02:08:58.269 INFO:tasks.workunit.client.0.smithi077.stdout:7/899: mkdir d4/dd2/d107/d120/d12b 0 2024-04-25T02:08:58.277 INFO:tasks.workunit.client.0.smithi077.stdout:3/931: mknod d0/d17/dd4/c154 0 2024-04-25T02:08:58.278 INFO:tasks.workunit.client.0.smithi077.stdout:3/932: write d0/d3e/d62/f132 [828051,84564] 0 2024-04-25T02:08:58.278 INFO:tasks.workunit.client.0.smithi077.stdout:3/933: truncate d0/d17/d4b/d59/f104 595121 0 2024-04-25T02:08:58.278 INFO:tasks.workunit.client.0.smithi077.stdout:1/989: getdents db/df/d56/d5d 0 2024-04-25T02:08:58.280 INFO:tasks.workunit.client.0.smithi077.stdout:1/990: dread db/df/d14/d3e/d69/dad/fdc [0,4194304] 0 2024-04-25T02:08:58.280 INFO:tasks.workunit.client.0.smithi077.stdout:1/991: read - db/df/d14/dfa/db4/fdf zero size 2024-04-25T02:08:58.280 INFO:tasks.workunit.client.0.smithi077.stdout:7/900: truncate d4/d13/f54 745081 0 2024-04-25T02:08:58.288 INFO:tasks.workunit.client.0.smithi077.stdout:3/934: creat d0/d2/de/d36/da0/f155 x:0 0 0 2024-04-25T02:08:58.290 INFO:tasks.workunit.client.0.smithi077.stdout:4/982: truncate d0/d14/d21/d39/da/d12/d35/f12d 561821 0 2024-04-25T02:08:58.291 INFO:tasks.workunit.client.0.smithi077.stdout:1/992: truncate db/df/d14/d3e/daa/deb/f126 335686 0 2024-04-25T02:08:58.294 INFO:tasks.workunit.client.0.smithi077.stdout:7/901: mkdir d4/dd2/d107/d120/d12c 0 2024-04-25T02:08:58.294 INFO:tasks.workunit.client.0.smithi077.stdout:7/902: chown d4/dd2/d107/d120 20 1 2024-04-25T02:08:58.295 INFO:tasks.workunit.client.0.smithi077.stdout:3/935: truncate d0/d2/de/d48/d15/f56 3339750 0 2024-04-25T02:08:58.296 INFO:tasks.workunit.client.0.smithi077.stdout:3/936: write d0/d2/de/d36/da6/fc6 [650591,85368] 0 2024-04-25T02:08:58.296 INFO:tasks.workunit.client.0.smithi077.stdout:3/937: fdatasync d0/d2/d2f/ffe 0 2024-04-25T02:08:58.298 INFO:tasks.workunit.client.0.smithi077.stdout:4/983: link d0/d14/d60/d86/fdb d0/d14/d79/da4/dac/dd4/f140 0 2024-04-25T02:08:58.300 INFO:tasks.workunit.client.0.smithi077.stdout:1/993: rmdir db/df/d14/d4d/d82/d10f 39 2024-04-25T02:08:58.307 INFO:tasks.workunit.client.0.smithi077.stdout:7/903: dwrite d4/d13/d18/d2d/d30/dab/fd3 [0,4194304] 0 2024-04-25T02:08:58.310 INFO:tasks.workunit.client.0.smithi077.stdout:3/938: symlink d0/d17/dd4/d129/l156 0 2024-04-25T02:08:58.313 INFO:tasks.workunit.client.0.smithi077.stdout:1/994: truncate db/df/d14/d4d/d82/d5c/fb5 664761 0 2024-04-25T02:08:58.320 INFO:tasks.workunit.client.0.smithi077.stdout:4/984: dwrite d0/d14/d79/da4/dbc/f103 [0,4194304] 0 2024-04-25T02:08:58.324 INFO:tasks.workunit.client.0.smithi077.stdout:1/995: link db/df/d14/d4d/d82/d32/d8f/fda db/df/d14/d4d/d82/d42/f13d 0 2024-04-25T02:08:58.329 INFO:tasks.workunit.client.0.smithi077.stdout:7/904: dwrite d4/d13/d18/d2d/d30/f55 [0,4194304] 0 2024-04-25T02:08:58.330 INFO:tasks.workunit.client.0.smithi077.stdout:1/996: link db/f18 db/df/d14/d3e/daa/deb/f13e 0 2024-04-25T02:08:58.332 INFO:tasks.workunit.client.0.smithi077.stdout:1/997: dread db/df/d14/d4d/d82/d42/d43/f8a [0,4194304] 0 2024-04-25T02:08:58.333 INFO:tasks.workunit.client.0.smithi077.stdout:1/998: write db/fa6 [1557139,66601] 0 2024-04-25T02:08:58.338 INFO:tasks.workunit.client.0.smithi077.stdout:4/985: dwrite d0/d14/d21/d39/da/d12/d35/d3e/f50 [0,4194304] 0 2024-04-25T02:08:58.342 INFO:tasks.workunit.client.0.smithi077.stdout:7/905: dread d4/dd2/f106 [0,4194304] 0 2024-04-25T02:08:58.342 INFO:tasks.workunit.client.0.smithi077.stdout:7/906: chown d4/d13/d2c 1586718344 1 2024-04-25T02:08:58.343 INFO:tasks.workunit.client.0.smithi077.stdout:1/999: rmdir db/df/d14/d12e 0 2024-04-25T02:08:58.349 INFO:tasks.workunit.client.0.smithi077.stdout:7/907: link d4/d13/d18/d24/d3f/d58/la4 d4/d13/d18/d24/d3f/d58/d117/l12d 0 2024-04-25T02:08:58.351 INFO:tasks.workunit.client.0.smithi077.stdout:4/986: rmdir d0/d14/d79/d104 39 2024-04-25T02:08:58.351 INFO:tasks.workunit.client.0.smithi077.stdout:4/987: chown d0/d14/d60/d78/f13d 116729 1 2024-04-25T02:08:58.354 INFO:tasks.workunit.client.0.smithi077.stdout:7/908: dread d4/d13/d5b/d8b/fde [0,4194304] 0 2024-04-25T02:08:58.369 INFO:tasks.workunit.client.0.smithi077.stdout:4/988: dwrite d0/f6b [4194304,4194304] 0 2024-04-25T02:08:58.373 INFO:tasks.workunit.client.0.smithi077.stdout:7/909: dwrite d4/d13/d18/d2d/d56/d68/d88/fce [0,4194304] 0 2024-04-25T02:08:58.373 INFO:tasks.workunit.client.0.smithi077.stdout:7/910: fsync d4/d13/f48 0 2024-04-25T02:08:58.380 INFO:tasks.workunit.client.0.smithi077.stdout:7/911: write d4/d13/d18/d2d/d56/fb4 [3732887,1335] 0 2024-04-25T02:08:58.380 INFO:tasks.workunit.client.0.smithi077.stdout:7/912: write d4/d13/d66/f9b [714790,90307] 0 2024-04-25T02:08:58.381 INFO:tasks.workunit.client.0.smithi077.stdout:4/989: link d0/d14/d21/d39/d64/fd2 d0/d14/d60/d86/d25/d12e/f141 0 2024-04-25T02:08:58.385 INFO:tasks.workunit.client.0.smithi077.stdout:7/913: dread d4/d13/f3c [0,4194304] 0 2024-04-25T02:08:58.388 INFO:tasks.workunit.client.0.smithi077.stdout:7/914: write d4/d13/d18/d24/d3f/d59/f5f [3517206,75422] 0 2024-04-25T02:08:58.393 INFO:tasks.workunit.client.0.smithi077.stdout:0/920: sync 2024-04-25T02:08:58.393 INFO:tasks.workunit.client.0.smithi077.stdout:9/969: sync 2024-04-25T02:08:58.394 INFO:tasks.workunit.client.0.smithi077.stdout:0/921: stat d2/d17/d1d/d34/d4c/da2/d51/de8/ff8 0 2024-04-25T02:08:58.401 INFO:tasks.workunit.client.0.smithi077.stdout:9/970: rename df/d1b/d48/d75/fa5 to df/f141 0 2024-04-25T02:08:58.401 INFO:tasks.workunit.client.0.smithi077.stdout:9/971: creat df/d60/d109/f142 x:0 0 0 2024-04-25T02:08:58.402 INFO:tasks.workunit.client.0.smithi077.stdout:9/972: write df/d1b/d48/dee/f11b [3028209,14861] 0 2024-04-25T02:08:58.403 INFO:tasks.workunit.client.0.smithi077.stdout:4/990: dwrite d0/d14/d60/d78/dce/fd6 [4194304,4194304] 0 2024-04-25T02:08:58.403 INFO:tasks.workunit.client.0.smithi077.stdout:7/915: dread d4/d13/d5b/d8b/fc0 [0,4194304] 0 2024-04-25T02:08:58.410 INFO:tasks.workunit.client.0.smithi077.stdout:5/921: sync 2024-04-25T02:08:58.411 INFO:tasks.workunit.client.0.smithi077.stdout:5/922: write d0/d25/d82/d87/d8b/d115/d1b/f54 [9110247,57746] 0 2024-04-25T02:08:58.412 INFO:tasks.workunit.client.0.smithi077.stdout:3/939: read d0/d2/de/d48/d15/f56 [2324817,3352] 0 2024-04-25T02:08:58.412 INFO:tasks.workunit.client.0.smithi077.stdout:4/991: write d0/d14/d21/f22 [8458585,106288] 0 2024-04-25T02:08:58.412 INFO:tasks.workunit.client.0.smithi077.stdout:4/992: fsync d0/d14/d79/da4/dbc/f102 0 2024-04-25T02:08:58.422 INFO:tasks.workunit.client.0.smithi077.stdout:5/923: mknod d0/d25/d82/d87/d8b/d115/d68/db8/c12a 0 2024-04-25T02:08:58.426 INFO:tasks.workunit.client.0.smithi077.stdout:4/993: mkdir d0/d14/d60/d86/d34/d142 0 2024-04-25T02:08:58.426 INFO:tasks.workunit.client.0.smithi077.stdout:4/994: truncate d0/d14/d21/d39/d1d/fbf 1114324 0 2024-04-25T02:08:58.426 INFO:tasks.workunit.client.0.smithi077.stdout:4/995: write d0/d14/d21/d39/f13e [476117,21592] 0 2024-04-25T02:08:58.426 INFO:tasks.workunit.client.0.smithi077.stdout:4/996: chown d0/d14/d21/d39/da/d12/c67 13 1 2024-04-25T02:08:58.429 INFO:tasks.workunit.client.0.smithi077.stdout:7/916: getdents d4/d13/de8 0 2024-04-25T02:08:58.434 INFO:tasks.workunit.client.0.smithi077.stdout:3/940: dwrite d0/d2/de/d48/f29 [0,4194304] 0 2024-04-25T02:08:58.443 INFO:tasks.workunit.client.0.smithi077.stdout:3/941: truncate d0/f1f 2099528 0 2024-04-25T02:08:58.444 INFO:tasks.workunit.client.0.smithi077.stdout:3/942: creat d0/d2/de/d36/da0/ddd/f157 x:0 0 0 2024-04-25T02:08:58.444 INFO:tasks.workunit.client.0.smithi077.stdout:3/943: chown d0/d2/d2f/d50/l133 102 1 2024-04-25T02:08:58.450 INFO:tasks.workunit.client.0.smithi077.stdout:3/944: write d0/f3c [1387826,21977] 0 2024-04-25T02:08:58.450 INFO:tasks.workunit.client.0.smithi077.stdout:3/945: chown d0/d17/cfb 454273 1 2024-04-25T02:08:58.452 INFO:tasks.workunit.client.0.smithi077.stdout:5/924: dwrite d0/d25/d82/d87/d8b/d115/d3/d9/d39/d44/d5f/f110 [0,4194304] 0 2024-04-25T02:08:58.452 INFO:tasks.workunit.client.0.smithi077.stdout:7/917: dwrite d4/d13/d66/f8f [0,4194304] 0 2024-04-25T02:08:58.453 INFO:tasks.workunit.client.0.smithi077.stdout:3/946: rename d0/d2/de/d36/da0/fd1 to d0/d2/d2f/d50/f158 0 2024-04-25T02:08:58.453 INFO:tasks.workunit.client.0.smithi077.stdout:3/947: chown d0/d3e/d62/d6a/d6e/c106 95 1 2024-04-25T02:08:58.456 INFO:tasks.workunit.client.0.smithi077.stdout:4/997: dwrite d0/d14/d79/da4/dac/dd4/f140 [0,4194304] 0 2024-04-25T02:08:58.456 INFO:tasks.workunit.client.0.smithi077.stdout:4/998: chown d0/d14/d21/d39/da/d12/d35/d3e/f36 29931 1 2024-04-25T02:08:58.456 INFO:tasks.workunit.client.0.smithi077.stdout:4/999: write d0/d14/d60/d78/f101 [998406,102509] 0 2024-04-25T02:08:58.459 INFO:tasks.workunit.client.0.smithi077.stdout:5/925: mkdir d0/d25/d82/d87/d8b/d115/d3/d11a/d12b 0 2024-04-25T02:08:58.459 INFO:tasks.workunit.client.0.smithi077.stdout:5/926: chown d0/d25/f36 328 1 2024-04-25T02:08:58.460 INFO:tasks.workunit.client.0.smithi077.stdout:7/918: creat d4/dd2/f12e x:0 0 0 2024-04-25T02:08:58.462 INFO:tasks.workunit.client.0.smithi077.stdout:3/948: symlink d0/d2/d2f/db4/db6/l159 0 2024-04-25T02:08:58.462 INFO:tasks.workunit.client.0.smithi077.stdout:3/949: chown d0/d2/de/d48/f44 12041 1 2024-04-25T02:08:58.462 INFO:tasks.workunit.client.0.smithi077.stdout:3/950: chown d0/d2/de/d48/d15/c58 925 1 2024-04-25T02:08:58.467 INFO:tasks.workunit.client.0.smithi077.stdout:5/927: creat d0/d25/f12c x:0 0 0 2024-04-25T02:08:58.467 INFO:tasks.workunit.client.0.smithi077.stdout:5/928: fsync d0/d25/d82/d87/d8b/d115/d3/d9/d39/d44/d5f/f73 0 2024-04-25T02:08:58.467 INFO:tasks.workunit.client.0.smithi077.stdout:5/929: chown d0/l99 242 1 2024-04-25T02:08:58.470 INFO:tasks.workunit.client.0.smithi077.stdout:5/930: mkdir d0/d25/d82/d87/d8b/d115/d1b/d3b/d12d 0 2024-04-25T02:08:58.473 INFO:tasks.workunit.client.0.smithi077.stdout:7/919: rename d4/d13/d18/d24/de5 to d4/d13/d66/d12f 0 2024-04-25T02:08:58.483 INFO:tasks.workunit.client.0.smithi077.stdout:7/920: creat d4/d13/de8/f130 x:0 0 0 2024-04-25T02:08:58.483 INFO:tasks.workunit.client.0.smithi077.stdout:7/921: fdatasync d4/d13/d5b/d8b/fc0 0 2024-04-25T02:08:58.483 INFO:tasks.workunit.client.0.smithi077.stdout:7/922: fsync d4/d13/da9/fad 0 2024-04-25T02:08:58.483 INFO:tasks.workunit.client.0.smithi077.stdout:3/951: dwrite d0/d2/d2f/d5f/f9b [0,4194304] 0 2024-04-25T02:08:58.485 INFO:tasks.workunit.client.0.smithi077.stdout:7/923: dread d4/f37 [0,4194304] 0 2024-04-25T02:08:58.487 INFO:tasks.workunit.client.0.smithi077.stdout:3/952: mkdir d0/d3e/d62/d6a/d6e/d15a 0 2024-04-25T02:08:58.487 INFO:tasks.workunit.client.0.smithi077.stdout:3/953: creat d0/dc5/f15b x:0 0 0 2024-04-25T02:08:58.488 INFO:tasks.workunit.client.0.smithi077.stdout:7/924: mknod d4/d13/d18/d24/d3f/de9/c131 0 2024-04-25T02:08:58.488 INFO:tasks.workunit.client.0.smithi077.stdout:7/925: write d4/d13/d18/d2d/f47 [2083075,3281] 0 2024-04-25T02:08:58.491 INFO:tasks.workunit.client.0.smithi077.stdout:7/926: mkdir d4/d13/d18/d24/d132 0 2024-04-25T02:08:58.505 INFO:tasks.workunit.client.1.smithi112.stdout:8/71: sync 2024-04-25T02:08:58.505 INFO:tasks.workunit.client.1.smithi112.stdout:9/78: sync 2024-04-25T02:08:58.505 INFO:tasks.workunit.client.1.smithi112.stdout:4/31: sync 2024-04-25T02:08:58.505 INFO:tasks.workunit.client.1.smithi112.stdout:4/32: creat d2/fb x:0 0 0 2024-04-25T02:08:58.506 INFO:tasks.workunit.client.1.smithi112.stdout:8/72: write fb [8155964,83861] 0 2024-04-25T02:08:58.506 INFO:tasks.workunit.client.1.smithi112.stdout:4/33: dread - d2/f8 zero size 2024-04-25T02:08:58.506 INFO:tasks.workunit.client.1.smithi112.stdout:4/34: write d2/fb [183951,25042] 0 2024-04-25T02:08:58.506 INFO:tasks.workunit.client.1.smithi112.stdout:5/112: sync 2024-04-25T02:08:58.506 INFO:tasks.workunit.client.1.smithi112.stdout:1/39: sync 2024-04-25T02:08:58.506 INFO:tasks.workunit.client.1.smithi112.stdout:1/40: fdatasync d7/d9/fa 0 2024-04-25T02:08:58.506 INFO:tasks.workunit.client.1.smithi112.stdout:1/41: stat d7/d9/lb 0 2024-04-25T02:08:58.506 INFO:tasks.workunit.client.1.smithi112.stdout:0/109: sync 2024-04-25T02:08:58.506 INFO:tasks.workunit.client.1.smithi112.stdout:6/134: sync 2024-04-25T02:08:58.506 INFO:tasks.workunit.client.1.smithi112.stdout:2/12: sync 2024-04-25T02:08:58.506 INFO:tasks.workunit.client.1.smithi112.stdout:3/10: sync 2024-04-25T02:08:58.506 INFO:tasks.workunit.client.1.smithi112.stdout:3/11: dread - no filename 2024-04-25T02:08:58.507 INFO:tasks.workunit.client.1.smithi112.stdout:3/12: chown c1 20897777 1 2024-04-25T02:08:58.507 INFO:tasks.workunit.client.1.smithi112.stdout:7/13: sync 2024-04-25T02:08:58.512 INFO:tasks.workunit.client.1.smithi112.stdout:5/113: mknod d1/d2/d4/c2b 0 2024-04-25T02:08:58.513 INFO:tasks.workunit.client.1.smithi112.stdout:1/42: getdents d7/d9 0 2024-04-25T02:08:58.514 INFO:tasks.workunit.client.0.smithi077.stdout:7/927: dwrite d4/d13/d18/d2d/f47 [0,4194304] 0 2024-04-25T02:08:58.515 INFO:tasks.workunit.client.1.smithi112.stdout:0/110: mkdir da/d1d/d22 0 2024-04-25T02:08:58.516 INFO:tasks.workunit.client.1.smithi112.stdout:6/135: creat d0/f30 x:0 0 0 2024-04-25T02:08:58.516 INFO:tasks.workunit.client.1.smithi112.stdout:6/136: creat d0/d2/d2c/f31 x:0 0 0 2024-04-25T02:08:58.516 INFO:tasks.workunit.client.1.smithi112.stdout:6/137: chown d0/d2/d4/f13 69475 1 2024-04-25T02:08:58.516 INFO:tasks.workunit.client.1.smithi112.stdout:6/138: fdatasync d0/d2/d4/f1d 0 2024-04-25T02:08:58.517 INFO:tasks.workunit.client.0.smithi077.stdout:7/928: mknod d4/dd2/d107/d11f/c133 0 2024-04-25T02:08:58.519 INFO:tasks.workunit.client.1.smithi112.stdout:8/73: read fd [1874531,61380] 0 2024-04-25T02:08:58.521 INFO:tasks.workunit.client.0.smithi077.stdout:7/929: mkdir d4/d13/d18/d24/d3f/de9/d134 0 2024-04-25T02:08:58.522 INFO:tasks.workunit.client.0.smithi077.stdout:7/930: fdatasync d4/d13/d66/f9b 0 2024-04-25T02:08:58.523 INFO:tasks.workunit.client.1.smithi112.stdout:4/35: dwrite f0 [0,4194304] 0 2024-04-25T02:08:58.523 INFO:tasks.workunit.client.1.smithi112.stdout:4/36: fdatasync d2/fb 0 2024-04-25T02:08:58.523 INFO:tasks.workunit.client.1.smithi112.stdout:7/14: unlink c0 0 2024-04-25T02:08:58.524 INFO:tasks.workunit.client.1.smithi112.stdout:7/15: fdatasync - no filename 2024-04-25T02:08:58.525 INFO:tasks.workunit.client.1.smithi112.stdout:1/43: rmdir d7/d9 39 2024-04-25T02:08:58.527 INFO:tasks.workunit.client.1.smithi112.stdout:0/111: mkdir da/d13/d23 0 2024-04-25T02:08:58.527 INFO:tasks.workunit.client.1.smithi112.stdout:0/112: chown da/c14 555 1 2024-04-25T02:08:58.527 INFO:tasks.workunit.client.1.smithi112.stdout:0/113: truncate da/d13/d1e/f21 943428 0 2024-04-25T02:08:58.529 INFO:tasks.workunit.client.1.smithi112.stdout:8/74: unlink f14 0 2024-04-25T02:08:58.530 INFO:tasks.workunit.client.1.smithi112.stdout:3/13: rename c1 to c2 0 2024-04-25T02:08:58.531 INFO:tasks.workunit.client.0.smithi077.stdout:0/922: sync 2024-04-25T02:08:58.533 INFO:tasks.workunit.client.0.smithi077.stdout:0/923: rename d2/d17/d121/f12d to d2/d9/f13f 0 2024-04-25T02:08:58.535 INFO:tasks.workunit.client.0.smithi077.stdout:7/931: dwrite d4/d13/d18/d2d/d56/d68/f9a [0,4194304] 0 2024-04-25T02:08:58.535 INFO:tasks.workunit.client.0.smithi077.stdout:7/932: write d4/d13/d18/d2d/d56/fb4 [4363093,38160] 0 2024-04-25T02:08:58.535 INFO:tasks.workunit.client.1.smithi112.stdout:7/16: mknod c1 0 2024-04-25T02:08:58.536 INFO:tasks.workunit.client.0.smithi077.stdout:0/924: rmdir d2/d27/d2d/dce 39 2024-04-25T02:08:58.536 INFO:tasks.workunit.client.0.smithi077.stdout:0/925: truncate d2/d9/d2a/f106 1229772 0 2024-04-25T02:08:58.536 INFO:tasks.workunit.client.0.smithi077.stdout:0/926: readlink d2/d27/l78 0 2024-04-25T02:08:58.537 INFO:tasks.workunit.client.0.smithi077.stdout:0/927: read d2/d17/d1d/d34/d4c/da2/f6f [146770,101647] 0 2024-04-25T02:08:58.541 INFO:tasks.workunit.client.1.smithi112.stdout:0/114: dread da/d13/f17 [0,4194304] 0 2024-04-25T02:08:58.543 INFO:tasks.workunit.client.1.smithi112.stdout:8/75: mkdir d15/d17 0 2024-04-25T02:08:58.543 INFO:tasks.workunit.client.1.smithi112.stdout:8/76: fdatasync fd 0 2024-04-25T02:08:58.545 INFO:tasks.workunit.client.0.smithi077.stdout:7/933: creat d4/d13/d18/d2d/d56/f135 x:0 0 0 2024-04-25T02:08:58.545 INFO:tasks.workunit.client.0.smithi077.stdout:7/934: truncate d4/d13/d18/d2d/d56/d68/fbe 730411 0 2024-04-25T02:08:58.546 INFO:tasks.workunit.client.1.smithi112.stdout:3/14: creat f3 x:0 0 0 2024-04-25T02:08:58.546 INFO:tasks.workunit.client.1.smithi112.stdout:2/13: write d3/f4 [898889,15502] 0 2024-04-25T02:08:58.546 INFO:tasks.workunit.client.1.smithi112.stdout:2/14: chown d3/c6 39 1 2024-04-25T02:08:58.547 INFO:tasks.workunit.client.0.smithi077.stdout:0/928: dread d2/d17/d121/f12e [0,4194304] 0 2024-04-25T02:08:58.547 INFO:tasks.workunit.client.0.smithi077.stdout:0/929: truncate d2/d17/d4e/f95 4355423 0 2024-04-25T02:08:58.548 INFO:tasks.workunit.client.1.smithi112.stdout:7/17: mknod c2 0 2024-04-25T02:08:58.548 INFO:tasks.workunit.client.1.smithi112.stdout:7/18: fsync - no filename 2024-04-25T02:08:58.552 INFO:tasks.workunit.client.1.smithi112.stdout:0/115: mkdir da/d13/d20/d24 0 2024-04-25T02:08:58.554 INFO:tasks.workunit.client.1.smithi112.stdout:8/77: unlink lf 0 2024-04-25T02:08:58.556 INFO:tasks.workunit.client.0.smithi077.stdout:7/935: link d4/d13/d18/d2d/d30/dab/cc2 d4/d13/d18/d2d/d56/d68/d88/d121/c136 0 2024-04-25T02:08:58.557 INFO:tasks.workunit.client.0.smithi077.stdout:7/936: creat d4/d13/d5b/d8b/db2/f137 x:0 0 0 2024-04-25T02:08:58.557 INFO:tasks.workunit.client.0.smithi077.stdout:7/937: fsync d4/d13/d2c/f2e 0 2024-04-25T02:08:58.560 INFO:tasks.workunit.client.0.smithi077.stdout:0/930: mkdir d2/d8/db6/dd7/de0/d140 0 2024-04-25T02:08:58.562 INFO:tasks.workunit.client.1.smithi112.stdout:1/44: dwrite d7/d9/fa [0,4194304] 0 2024-04-25T02:08:58.562 INFO:tasks.workunit.client.1.smithi112.stdout:7/19: rename c1 to c3 0 2024-04-25T02:08:58.566 INFO:tasks.workunit.client.1.smithi112.stdout:8/78: read f7 [1472817,22450] 0 2024-04-25T02:08:58.568 INFO:tasks.workunit.client.1.smithi112.stdout:3/15: symlink l4 0 2024-04-25T02:08:58.568 INFO:tasks.workunit.client.1.smithi112.stdout:3/16: fdatasync f3 0 2024-04-25T02:08:58.568 INFO:tasks.workunit.client.1.smithi112.stdout:3/17: write f3 [868464,2024] 0 2024-04-25T02:08:58.570 INFO:tasks.workunit.client.0.smithi077.stdout:7/938: creat d4/d13/d18/d24/d3f/d59/dd6/f138 x:0 0 0 2024-04-25T02:08:58.572 INFO:tasks.workunit.client.1.smithi112.stdout:7/20: creat f4 x:0 0 0 2024-04-25T02:08:58.573 INFO:tasks.workunit.client.1.smithi112.stdout:2/15: dwrite f1 [0,4194304] 0 2024-04-25T02:08:58.574 INFO:tasks.workunit.client.0.smithi077.stdout:0/931: rename d2/d9/f65 to d2/d8/db6/dd7/f141 0 2024-04-25T02:08:58.578 INFO:tasks.workunit.client.1.smithi112.stdout:3/18: creat f5 x:0 0 0 2024-04-25T02:08:58.583 INFO:tasks.workunit.client.0.smithi077.stdout:9/973: sync 2024-04-25T02:08:58.584 INFO:tasks.workunit.client.1.smithi112.stdout:1/45: write d7/d9/fa [2418489,120965] 0 2024-04-25T02:08:58.584 INFO:tasks.workunit.client.1.smithi112.stdout:5/114: dwrite d1/d2/d4/f13 [0,4194304] 0 2024-04-25T02:08:58.591 INFO:tasks.workunit.client.1.smithi112.stdout:8/79: dread fa [0,4194304] 0 2024-04-25T02:08:58.591 INFO:tasks.workunit.client.1.smithi112.stdout:8/80: chown fd 425091767 1 2024-04-25T02:08:58.592 INFO:tasks.workunit.client.0.smithi077.stdout:9/974: dread df/d1b/d70/d84/dde/f9e [0,4194304] 0 2024-04-25T02:08:58.592 INFO:tasks.workunit.client.0.smithi077.stdout:9/975: write df/d1b/d48/d75/fb9 [428848,26732] 0 2024-04-25T02:08:58.593 INFO:tasks.workunit.client.1.smithi112.stdout:3/19: fdatasync f3 0 2024-04-25T02:08:58.597 INFO:tasks.workunit.client.1.smithi112.stdout:3/20: creat f6 x:0 0 0 2024-04-25T02:08:58.599 INFO:tasks.workunit.client.0.smithi077.stdout:9/976: getdents df/d1b/d48 0 2024-04-25T02:08:58.599 INFO:tasks.workunit.client.0.smithi077.stdout:9/977: chown df/f37 3791 1 2024-04-25T02:08:58.602 INFO:tasks.workunit.client.1.smithi112.stdout:7/21: unlink c3 0 2024-04-25T02:08:58.602 INFO:tasks.workunit.client.1.smithi112.stdout:7/22: rmdir - no directory 2024-04-25T02:08:58.602 INFO:tasks.workunit.client.1.smithi112.stdout:7/23: dread - f4 zero size 2024-04-25T02:08:58.605 INFO:tasks.workunit.client.0.smithi077.stdout:9/978: rename df/f13 to df/f143 0 2024-04-25T02:08:58.606 INFO:tasks.workunit.client.1.smithi112.stdout:3/21: rename f3 to f7 0 2024-04-25T02:08:58.606 INFO:tasks.workunit.client.1.smithi112.stdout:3/22: fdatasync f7 0 2024-04-25T02:08:58.606 INFO:tasks.workunit.client.1.smithi112.stdout:3/23: read - f6 zero size 2024-04-25T02:08:58.607 INFO:tasks.workunit.client.1.smithi112.stdout:3/24: chown c0 3436557 1 2024-04-25T02:08:58.608 INFO:tasks.workunit.client.1.smithi112.stdout:3/25: symlink l8 0 2024-04-25T02:08:58.609 INFO:tasks.workunit.client.1.smithi112.stdout:3/26: unlink f6 0 2024-04-25T02:08:58.615 INFO:tasks.workunit.client.1.smithi112.stdout:3/27: dread f7 [0,4194304] 0 2024-04-25T02:08:58.616 INFO:tasks.workunit.client.0.smithi077.stdout:7/939: dwrite d4/d13/d66/f9b [0,4194304] 0 2024-04-25T02:08:58.616 INFO:tasks.workunit.client.0.smithi077.stdout:0/932: dwrite d2/f82 [0,4194304] 0 2024-04-25T02:08:58.619 INFO:tasks.workunit.client.1.smithi112.stdout:8/81: dwrite f12 [0,4194304] 0 2024-04-25T02:08:58.619 INFO:tasks.workunit.client.1.smithi112.stdout:5/115: dwrite d1/f18 [0,4194304] 0 2024-04-25T02:08:58.619 INFO:tasks.workunit.client.1.smithi112.stdout:8/82: chown d15 216711 1 2024-04-25T02:08:58.619 INFO:tasks.workunit.client.1.smithi112.stdout:3/28: rename c2 to c9 0 2024-04-25T02:08:58.619 INFO:tasks.workunit.client.1.smithi112.stdout:2/16: dwrite d3/f4 [0,4194304] 0 2024-04-25T02:08:58.630 INFO:tasks.workunit.client.0.smithi077.stdout:0/933: rmdir d2/d27/d114 39 2024-04-25T02:08:58.630 INFO:tasks.workunit.client.0.smithi077.stdout:0/934: chown d2/d8/db6/dd7/f124 112066 1 2024-04-25T02:08:58.632 INFO:tasks.workunit.client.1.smithi112.stdout:5/116: truncate d1/d2/f11 1905592 0 2024-04-25T02:08:58.632 INFO:tasks.workunit.client.1.smithi112.stdout:5/117: chown d1/d2/d4/d1d/f2a 25 1 2024-04-25T02:08:58.634 INFO:tasks.workunit.client.0.smithi077.stdout:5/931: sync 2024-04-25T02:08:58.634 INFO:tasks.workunit.client.0.smithi077.stdout:0/935: mkdir d2/d142 0 2024-04-25T02:08:58.635 INFO:tasks.workunit.client.0.smithi077.stdout:0/936: dread - d2/d8/db6/fff zero size 2024-04-25T02:08:58.635 INFO:tasks.workunit.client.0.smithi077.stdout:0/937: chown d2/d17/d1d/d34/l44 56090 1 2024-04-25T02:08:58.636 INFO:tasks.workunit.client.1.smithi112.stdout:3/29: creat fa x:0 0 0 2024-04-25T02:08:58.642 INFO:tasks.workunit.client.0.smithi077.stdout:0/938: mkdir d2/d8/dfb/d143 0 2024-04-25T02:08:58.642 INFO:tasks.workunit.client.0.smithi077.stdout:0/939: dread - d2/d17/d1d/db1/fe4 zero size 2024-04-25T02:08:58.642 INFO:tasks.workunit.client.0.smithi077.stdout:5/932: dread d0/d25/d82/d87/d8b/da5/dc4/f21 [0,4194304] 0 2024-04-25T02:08:58.644 INFO:tasks.workunit.client.1.smithi112.stdout:8/83: write f12 [2865287,27626] 0 2024-04-25T02:08:58.646 INFO:tasks.workunit.client.1.smithi112.stdout:5/118: rmdir d1/d2/d1e 0 2024-04-25T02:08:58.646 INFO:tasks.workunit.client.0.smithi077.stdout:5/933: dread d0/d25/d82/d87/d8b/da5/dc4/d23/fd2 [0,4194304] 0 2024-04-25T02:08:58.648 INFO:tasks.workunit.client.0.smithi077.stdout:0/940: mknod d2/d8/db6/dd7/c144 0 2024-04-25T02:08:58.651 INFO:tasks.workunit.client.0.smithi077.stdout:5/934: truncate d0/d25/d82/fa1 1815785 0 2024-04-25T02:08:58.652 INFO:tasks.workunit.client.0.smithi077.stdout:5/935: chown d0/d25/d82/d87/d8b/d115/d3/d9/d39/d44/d5f/da4/fed 3 1 2024-04-25T02:08:58.652 INFO:tasks.workunit.client.0.smithi077.stdout:9/979: dwrite df/d1b/d70/d84/f108 [0,4194304] 0 2024-04-25T02:08:58.653 INFO:tasks.workunit.client.1.smithi112.stdout:0/116: dwrite f2 [0,4194304] 0 2024-04-25T02:08:58.653 INFO:tasks.workunit.client.0.smithi077.stdout:7/940: dwrite d4/d13/d18/d2d/d56/feb [0,4194304] 0 2024-04-25T02:08:58.653 INFO:tasks.workunit.client.1.smithi112.stdout:2/17: getdents d3 0 2024-04-25T02:08:58.655 INFO:tasks.workunit.client.1.smithi112.stdout:8/84: creat d15/f18 x:0 0 0 2024-04-25T02:08:58.656 INFO:tasks.workunit.client.0.smithi077.stdout:3/954: sync 2024-04-25T02:08:58.657 INFO:tasks.workunit.client.0.smithi077.stdout:5/936: creat d0/d25/dc7/f12e x:0 0 0 2024-04-25T02:08:58.658 INFO:tasks.workunit.client.1.smithi112.stdout:7/24: dwrite f4 [0,4194304] 0 2024-04-25T02:08:58.660 INFO:tasks.workunit.client.1.smithi112.stdout:3/30: symlink lb 0 2024-04-25T02:08:58.660 INFO:tasks.workunit.client.1.smithi112.stdout:3/31: write fa [4903,39308] 0 2024-04-25T02:08:58.662 INFO:tasks.workunit.client.1.smithi112.stdout:3/32: write f7 [333431,99179] 0 2024-04-25T02:08:58.662 INFO:tasks.workunit.client.1.smithi112.stdout:3/33: dread - f5 zero size 2024-04-25T02:08:58.662 INFO:tasks.workunit.client.1.smithi112.stdout:3/34: chown lb 116817 1 2024-04-25T02:08:58.662 INFO:tasks.workunit.client.1.smithi112.stdout:3/35: read fa [19995,24880] 0 2024-04-25T02:08:58.665 INFO:tasks.workunit.client.1.smithi112.stdout:0/117: rename da/l1a to da/d13/l25 0 2024-04-25T02:08:58.667 INFO:tasks.workunit.client.1.smithi112.stdout:2/18: mknod d3/c7 0 2024-04-25T02:08:58.667 INFO:tasks.workunit.client.1.smithi112.stdout:2/19: stat f1 0 2024-04-25T02:08:58.670 INFO:tasks.workunit.client.1.smithi112.stdout:1/46: dwrite f2 [0,4194304] 0 2024-04-25T02:08:58.671 INFO:tasks.workunit.client.0.smithi077.stdout:7/941: write d4/d13/d2c/fd0 [1314001,61727] 0 2024-04-25T02:08:58.671 INFO:tasks.workunit.client.0.smithi077.stdout:7/942: write d4/d13/d18/d2d/d30/f8c [3901231,37204] 0 2024-04-25T02:08:58.672 INFO:tasks.workunit.client.0.smithi077.stdout:0/941: dwrite d2/d27/d2d/dce/f118 [0,4194304] 0 2024-04-25T02:08:58.673 INFO:tasks.workunit.client.0.smithi077.stdout:9/980: dwrite df/d1b/d48/f54 [0,4194304] 0 2024-04-25T02:08:58.674 INFO:tasks.workunit.client.0.smithi077.stdout:5/937: unlink d0/d25/d82/d87/d8b/d115/d68/db8/c12a 0 2024-04-25T02:08:58.677 INFO:tasks.workunit.client.0.smithi077.stdout:7/943: dread d4/d13/d2c/fd0 [0,4194304] 0 2024-04-25T02:08:58.686 INFO:tasks.workunit.client.1.smithi112.stdout:0/118: read da/f10 [2848175,19683] 0 2024-04-25T02:08:58.690 INFO:tasks.workunit.client.0.smithi077.stdout:9/981: mknod df/d1b/d70/dc9/c144 0 2024-04-25T02:08:58.691 INFO:tasks.workunit.client.1.smithi112.stdout:8/85: rmdir d15 39 2024-04-25T02:08:58.696 INFO:tasks.workunit.client.0.smithi077.stdout:5/938: rmdir d0/d25/d82/d87/d8b/da5/dc4/d23 39 2024-04-25T02:08:58.696 INFO:tasks.workunit.client.0.smithi077.stdout:5/939: getdents d0/d25/d82/d87/d8b/d115/d3/d9/d39 0 2024-04-25T02:08:58.696 INFO:tasks.workunit.client.0.smithi077.stdout:5/940: fdatasync d0/d25/d82/d87/d8b/d115/d3/d9/d39/d3c/dc6/ff7 0 2024-04-25T02:08:58.696 INFO:tasks.workunit.client.0.smithi077.stdout:7/944: creat d4/d13/d18/d24/d3f/d59/dd6/d11b/f139 x:0 0 0 2024-04-25T02:08:58.698 INFO:tasks.workunit.client.0.smithi077.stdout:9/982: creat df/d1b/d56/ddf/d11d/f145 x:0 0 0 2024-04-25T02:08:58.699 INFO:tasks.workunit.client.0.smithi077.stdout:9/983: write df/d1b/d70/d74/f105 [238101,24058] 0 2024-04-25T02:08:58.699 INFO:tasks.workunit.client.1.smithi112.stdout:1/47: mknod d7/dd/cf 0 2024-04-25T02:08:58.699 INFO:tasks.workunit.client.1.smithi112.stdout:1/48: chown d7 31150 1 2024-04-25T02:08:58.701 INFO:tasks.workunit.client.0.smithi077.stdout:7/945: unlink d4/d13/d5b/d8b/la0 0 2024-04-25T02:08:58.701 INFO:tasks.workunit.client.0.smithi077.stdout:7/946: write d4/d13/da9/fad [736106,94277] 0 2024-04-25T02:08:58.702 INFO:tasks.workunit.client.1.smithi112.stdout:7/25: truncate f4 916692 0 2024-04-25T02:08:58.703 INFO:tasks.workunit.client.1.smithi112.stdout:5/119: dwrite d1/d16/f19 [0,4194304] 0 2024-04-25T02:08:58.704 INFO:tasks.workunit.client.1.smithi112.stdout:3/36: mkdir dc 0 2024-04-25T02:08:58.705 INFO:tasks.workunit.client.0.smithi077.stdout:7/947: mkdir d4/d13/de8/d13a 0 2024-04-25T02:08:58.706 INFO:tasks.workunit.client.1.smithi112.stdout:0/119: unlink da/d13/l25 0 2024-04-25T02:08:58.706 INFO:tasks.workunit.client.1.smithi112.stdout:0/120: chown da/c19 2131967 1 2024-04-25T02:08:58.707 INFO:tasks.workunit.client.1.smithi112.stdout:0/121: chown f2 517932639 1 2024-04-25T02:08:58.709 INFO:tasks.workunit.client.0.smithi077.stdout:7/948: rename d4/dd2/l113 to d4/dd2/d107/d120/d12b/l13b 0 2024-04-25T02:08:58.711 INFO:tasks.workunit.client.1.smithi112.stdout:8/86: creat d15/d17/f19 x:0 0 0 2024-04-25T02:08:58.713 INFO:tasks.workunit.client.0.smithi077.stdout:0/942: dwrite d2/d17/d1d/d34/d83/fd8 [0,4194304] 0 2024-04-25T02:08:58.713 INFO:tasks.workunit.client.0.smithi077.stdout:0/943: fsync d2/d27/d2d/f112 0 2024-04-25T02:08:58.713 INFO:tasks.workunit.client.1.smithi112.stdout:2/20: dwrite d3/f4 [0,4194304] 0 2024-04-25T02:08:58.713 INFO:tasks.workunit.client.1.smithi112.stdout:1/49: creat d7/d9/f10 x:0 0 0 2024-04-25T02:08:58.715 INFO:tasks.workunit.client.0.smithi077.stdout:7/949: rename d4/d13/f48 to d4/d13/d18/d24/d3f/de9/f13c 0 2024-04-25T02:08:58.716 INFO:tasks.workunit.client.1.smithi112.stdout:5/120: creat d1/d2/d4/f2c x:0 0 0 2024-04-25T02:08:58.722 INFO:tasks.workunit.client.0.smithi077.stdout:9/984: dwrite df/d1b/d70/d84/dde/de9/fea [0,4194304] 0 2024-04-25T02:08:58.722 INFO:tasks.workunit.client.0.smithi077.stdout:5/941: dwrite d0/d25/dc7/f12e [0,4194304] 0 2024-04-25T02:08:58.725 INFO:tasks.workunit.client.1.smithi112.stdout:3/37: rmdir dc 0 2024-04-25T02:08:58.725 INFO:tasks.workunit.client.1.smithi112.stdout:3/38: fdatasync f5 0 2024-04-25T02:08:58.729 INFO:tasks.workunit.client.1.smithi112.stdout:8/87: dread f12 [0,4194304] 0 2024-04-25T02:08:58.729 INFO:tasks.workunit.client.1.smithi112.stdout:8/88: chown f10 19749 1 2024-04-25T02:08:58.729 INFO:tasks.workunit.client.1.smithi112.stdout:8/89: write f6 [6598007,88437] 0 2024-04-25T02:08:58.730 INFO:tasks.workunit.client.1.smithi112.stdout:0/122: creat da/f26 x:0 0 0 2024-04-25T02:08:58.733 INFO:tasks.workunit.client.0.smithi077.stdout:9/985: dread df/fd8 [0,4194304] 0 2024-04-25T02:08:58.734 INFO:tasks.workunit.client.0.smithi077.stdout:0/944: mkdir d2/d17/d1d/d34/d145 0 2024-04-25T02:08:58.734 INFO:tasks.workunit.client.0.smithi077.stdout:0/945: read - d2/d17/d1d/d34/d127/f134 zero size 2024-04-25T02:08:58.734 INFO:tasks.workunit.client.1.smithi112.stdout:7/26: dread f4 [0,4194304] 0 2024-04-25T02:08:58.735 INFO:tasks.workunit.client.1.smithi112.stdout:8/90: dread fa [0,4194304] 0 2024-04-25T02:08:58.739 INFO:tasks.workunit.client.0.smithi077.stdout:7/950: dwrite d4/d13/d18/ffc [0,4194304] 0 2024-04-25T02:08:58.739 INFO:tasks.workunit.client.0.smithi077.stdout:7/951: fdatasync d4/d13/d2c/f2e 0 2024-04-25T02:08:58.739 INFO:tasks.workunit.client.1.smithi112.stdout:1/50: dwrite d7/d9/fa [0,4194304] 0 2024-04-25T02:08:58.744 INFO:tasks.workunit.client.1.smithi112.stdout:3/39: creat fd x:0 0 0 2024-04-25T02:08:58.744 INFO:tasks.workunit.client.1.smithi112.stdout:3/40: truncate fd 688056 0 2024-04-25T02:08:58.747 INFO:tasks.workunit.client.1.smithi112.stdout:0/123: symlink da/d1d/l27 0 2024-04-25T02:08:58.749 INFO:tasks.workunit.client.0.smithi077.stdout:5/942: creat d0/d25/d82/d87/d8b/da5/dc4/d23/f12f x:0 0 0 2024-04-25T02:08:58.755 INFO:tasks.workunit.client.1.smithi112.stdout:2/21: mknod d3/c8 0 2024-04-25T02:08:58.757 INFO:tasks.workunit.client.0.smithi077.stdout:9/986: symlink df/d1b/d70/dc9/l146 0 2024-04-25T02:08:58.758 INFO:tasks.workunit.client.1.smithi112.stdout:1/51: dwrite f4 [0,4194304] 0 2024-04-25T02:08:58.758 INFO:tasks.workunit.client.1.smithi112.stdout:1/52: truncate f4 4930781 0 2024-04-25T02:08:58.759 INFO:tasks.workunit.client.1.smithi112.stdout:7/27: unlink c2 0 2024-04-25T02:08:58.759 INFO:tasks.workunit.client.1.smithi112.stdout:7/28: write f4 [989353,3423] 0 2024-04-25T02:08:58.759 INFO:tasks.workunit.client.1.smithi112.stdout:7/29: rmdir - no directory 2024-04-25T02:08:58.760 INFO:tasks.workunit.client.0.smithi077.stdout:0/946: mknod d2/d17/d1d/d34/d4c/da2/dae/c146 0 2024-04-25T02:08:58.762 INFO:tasks.workunit.client.1.smithi112.stdout:8/91: mkdir d15/d17/d1a 0 2024-04-25T02:08:58.765 INFO:tasks.workunit.client.0.smithi077.stdout:7/952: dwrite d4/d13/d18/d24/f57 [0,4194304] 0 2024-04-25T02:08:58.766 INFO:tasks.workunit.client.1.smithi112.stdout:3/41: unlink c0 0 2024-04-25T02:08:58.768 INFO:tasks.workunit.client.0.smithi077.stdout:7/953: dread d4/d13/d18/d24/d3f/d58/f2b [0,4194304] 0 2024-04-25T02:08:58.771 INFO:tasks.workunit.client.1.smithi112.stdout:0/124: mknod da/d13/d1e/c28 0 2024-04-25T02:08:58.774 INFO:tasks.workunit.client.1.smithi112.stdout:2/22: creat d3/f9 x:0 0 0 2024-04-25T02:08:58.774 INFO:tasks.workunit.client.0.smithi077.stdout:7/954: read d4/dd2/f106 [2814755,85736] 0 2024-04-25T02:08:58.774 INFO:tasks.workunit.client.0.smithi077.stdout:7/955: chown d4/d13/d18/d24/d3f/d58/d117 3943409 1 2024-04-25T02:08:58.774 INFO:tasks.workunit.client.0.smithi077.stdout:7/956: truncate d4/d13/d18/d24/d3f/d59/f5f 4413674 0 2024-04-25T02:08:58.775 INFO:tasks.workunit.client.0.smithi077.stdout:9/987: dwrite df/d1b/d48/d75/d90/dfe/f12a [0,4194304] 0 2024-04-25T02:08:58.775 INFO:tasks.workunit.client.0.smithi077.stdout:9/988: dread - df/d1b/d56/ddf/d11d/f145 zero size 2024-04-25T02:08:58.776 INFO:tasks.workunit.client.1.smithi112.stdout:7/30: symlink l5 0 2024-04-25T02:08:58.777 INFO:tasks.workunit.client.1.smithi112.stdout:8/92: symlink d15/d17/l1b 0 2024-04-25T02:08:58.778 INFO:tasks.workunit.client.1.smithi112.stdout:8/93: chown fe 61 1 2024-04-25T02:08:58.779 INFO:tasks.workunit.client.0.smithi077.stdout:5/943: symlink d0/d25/d82/d87/d8b/d115/da8/l130 0 2024-04-25T02:08:58.782 INFO:tasks.workunit.client.0.smithi077.stdout:0/947: rename d2/f4b to d2/d17/d4e/d5e/f147 0 2024-04-25T02:08:58.784 INFO:tasks.workunit.client.1.smithi112.stdout:0/125: dread da/d13/f15 [0,4194304] 0 2024-04-25T02:08:58.784 INFO:tasks.workunit.client.1.smithi112.stdout:1/53: getdents d7/d9 0 2024-04-25T02:08:58.786 INFO:tasks.workunit.client.1.smithi112.stdout:2/23: write d3/f4 [1798854,41906] 0 2024-04-25T02:08:58.787 INFO:tasks.workunit.client.1.smithi112.stdout:7/31: rename f4 to f6 0 2024-04-25T02:08:58.788 INFO:tasks.workunit.client.1.smithi112.stdout:7/32: write f6 [102993,54134] 0 2024-04-25T02:08:58.789 INFO:tasks.workunit.client.1.smithi112.stdout:7/33: write f6 [580929,86594] 0 2024-04-25T02:08:58.789 INFO:tasks.workunit.client.0.smithi077.stdout:3/955: sync 2024-04-25T02:08:58.790 INFO:tasks.workunit.client.1.smithi112.stdout:2/24: fdatasync d3/f4 0 2024-04-25T02:08:58.791 INFO:tasks.workunit.client.1.smithi112.stdout:8/94: unlink f13 0 2024-04-25T02:08:58.791 INFO:tasks.workunit.client.1.smithi112.stdout:8/95: creat d15/d17/f1c x:0 0 0 2024-04-25T02:08:58.794 INFO:tasks.workunit.client.0.smithi077.stdout:9/989: mkdir df/d60/d147 0 2024-04-25T02:08:58.796 INFO:tasks.workunit.client.1.smithi112.stdout:3/42: rename f7 to fe 0 2024-04-25T02:08:58.798 INFO:tasks.workunit.client.0.smithi077.stdout:7/957: rename d4/dd2/d107/d120/d12c to d4/d13d 0 2024-04-25T02:08:58.801 INFO:tasks.workunit.client.1.smithi112.stdout:0/126: unlink da/f16 0 2024-04-25T02:08:58.801 INFO:tasks.workunit.client.1.smithi112.stdout:0/127: truncate da/f26 357057 0 2024-04-25T02:08:58.802 INFO:tasks.workunit.client.0.smithi077.stdout:3/956: dread d0/d3e/d42/ff7 [0,4194304] 0 2024-04-25T02:08:58.802 INFO:tasks.workunit.client.0.smithi077.stdout:0/948: stat d2/d9/d2a/db5/l133 0 2024-04-25T02:08:58.803 INFO:tasks.workunit.client.1.smithi112.stdout:1/54: dwrite d7/d9/f10 [0,4194304] 0 2024-04-25T02:08:58.805 INFO:tasks.workunit.client.1.smithi112.stdout:7/34: mkdir d7 0 2024-04-25T02:08:58.807 INFO:tasks.workunit.client.0.smithi077.stdout:5/944: rename d0/d25/d82/d87/d8b/da5/dc4/d23/d4a/f74 to d0/f131 0 2024-04-25T02:08:58.807 INFO:tasks.workunit.client.0.smithi077.stdout:5/945: dread - d0/d25/d82/d8d/fff zero size 2024-04-25T02:08:58.807 INFO:tasks.workunit.client.0.smithi077.stdout:3/957: truncate d0/d17/dd4/d107/f12e 3408234 0 2024-04-25T02:08:58.809 INFO:tasks.workunit.client.0.smithi077.stdout:7/958: write d4/d13/d66/f8f [4968216,85267] 0 2024-04-25T02:08:58.810 INFO:tasks.workunit.client.1.smithi112.stdout:8/96: creat d15/d17/d1a/f1d x:0 0 0 2024-04-25T02:08:58.810 INFO:tasks.workunit.client.1.smithi112.stdout:8/97: creat d15/d17/f1e x:0 0 0 2024-04-25T02:08:58.811 INFO:tasks.workunit.client.0.smithi077.stdout:0/949: rename d2/d17/d1d/d34/d145 to d2/d17/d1d/d34/d4c/da2/de2/d104/d148 0 2024-04-25T02:08:58.811 INFO:tasks.workunit.client.0.smithi077.stdout:0/950: dread - d2/d8/db6/dd7/d105/f11c zero size 2024-04-25T02:08:58.811 INFO:tasks.workunit.client.0.smithi077.stdout:0/951: chown d2/d17/d1d/d34/d4c/da2/df5/c10a 70366245 1 2024-04-25T02:08:58.812 INFO:tasks.workunit.client.1.smithi112.stdout:7/35: dread f6 [0,4194304] 0 2024-04-25T02:08:58.813 INFO:tasks.workunit.client.0.smithi077.stdout:5/946: creat d0/d25/f132 x:0 0 0 2024-04-25T02:08:58.814 INFO:tasks.workunit.client.0.smithi077.stdout:5/947: chown d0/d25/d82/d87/d8b/d115/d1b/d3b/cfe 28825540 1 2024-04-25T02:08:58.815 INFO:tasks.workunit.client.1.smithi112.stdout:0/128: creat da/d13/d20/f29 x:0 0 0 2024-04-25T02:08:58.820 INFO:tasks.workunit.client.0.smithi077.stdout:9/990: dwrite df/d1b/d70/d84/dde/de9/f101 [0,4194304] 0 2024-04-25T02:08:58.820 INFO:tasks.workunit.client.0.smithi077.stdout:9/991: write df/d1b/f47 [1606918,119253] 0 2024-04-25T02:08:58.820 INFO:tasks.workunit.client.0.smithi077.stdout:7/959: truncate d4/d13/d18/d2d/d30/f8a 5615 0 2024-04-25T02:08:58.820 INFO:tasks.workunit.client.0.smithi077.stdout:7/960: write d4/d13/d18/d2d/d56/d68/d88/ff6 [144916,10289] 0 2024-04-25T02:08:58.823 INFO:tasks.workunit.client.1.smithi112.stdout:1/55: creat d7/dd/de/f11 x:0 0 0 2024-04-25T02:08:58.827 INFO:tasks.workunit.client.0.smithi077.stdout:0/952: unlink d2/d27/d2d/f6d 0 2024-04-25T02:08:58.827 INFO:tasks.workunit.client.0.smithi077.stdout:0/953: chown d2/d17/d1d/d34/d4c/da2/de2 25377407 1 2024-04-25T02:08:58.827 INFO:tasks.workunit.client.0.smithi077.stdout:0/954: chown d2/d17/d1d/d34/d4c/da2 44 1 2024-04-25T02:08:58.829 INFO:tasks.workunit.client.1.smithi112.stdout:2/25: mkdir d3/da 0 2024-04-25T02:08:58.831 INFO:tasks.workunit.client.0.smithi077.stdout:5/948: creat d0/d25/d82/d87/d8b/d115/d3/d9/d39/f133 x:0 0 0 2024-04-25T02:08:58.833 INFO:tasks.workunit.client.1.smithi112.stdout:1/56: dread d7/d9/f10 [0,4194304] 0 2024-04-25T02:08:58.833 INFO:tasks.workunit.client.1.smithi112.stdout:1/57: chown d7/d9/cc 2431 1 2024-04-25T02:08:58.833 INFO:tasks.workunit.client.1.smithi112.stdout:1/58: fsync f6 0 2024-04-25T02:08:58.837 INFO:tasks.workunit.client.0.smithi077.stdout:3/958: getdents d0/d17/d4b/d59 0 2024-04-25T02:08:58.839 INFO:tasks.workunit.client.0.smithi077.stdout:0/955: dread d2/d8/db6/dd7/d105/f7e [0,4194304] 0 2024-04-25T02:08:58.839 INFO:tasks.workunit.client.1.smithi112.stdout:2/26: dread f1 [0,4194304] 0 2024-04-25T02:08:58.840 INFO:tasks.workunit.client.1.smithi112.stdout:8/98: symlink d15/d17/l1f 0 2024-04-25T02:08:58.840 INFO:tasks.workunit.client.0.smithi077.stdout:3/959: dread d0/d2/f18 [4194304,4194304] 0 2024-04-25T02:08:58.841 INFO:tasks.workunit.client.1.smithi112.stdout:1/59: write d7/d9/f10 [4358734,13551] 0 2024-04-25T02:08:58.842 INFO:tasks.workunit.client.1.smithi112.stdout:7/36: unlink l5 0 2024-04-25T02:08:58.844 INFO:tasks.workunit.client.0.smithi077.stdout:9/992: rmdir df/d1b/d48/d75/d90/dfe 39 2024-04-25T02:08:58.844 INFO:tasks.workunit.client.0.smithi077.stdout:5/949: dread d0/d25/d82/d87/d8b/d115/f79 [0,4194304] 0 2024-04-25T02:08:58.846 INFO:tasks.workunit.client.1.smithi112.stdout:3/43: symlink lf 0 2024-04-25T02:08:58.847 INFO:tasks.workunit.client.1.smithi112.stdout:3/44: stat lf 0 2024-04-25T02:08:58.849 INFO:tasks.workunit.client.0.smithi077.stdout:7/961: rename d4/dd2/cd4 to d4/d13/d18/d24/c13e 0 2024-04-25T02:08:58.853 INFO:tasks.workunit.client.1.smithi112.stdout:0/129: unlink da/lc 0 2024-04-25T02:08:58.859 INFO:tasks.workunit.client.0.smithi077.stdout:0/956: unlink d2/d8/db6/dd7/f124 0 2024-04-25T02:08:58.860 INFO:tasks.workunit.client.0.smithi077.stdout:3/960: mknod d0/d17/d4b/c15c 0 2024-04-25T02:08:58.862 INFO:tasks.workunit.client.1.smithi112.stdout:2/27: creat d3/da/fb x:0 0 0 2024-04-25T02:08:58.863 INFO:tasks.workunit.client.1.smithi112.stdout:2/28: write d3/f4 [500785,107148] 0 2024-04-25T02:08:58.864 INFO:tasks.workunit.client.0.smithi077.stdout:9/993: creat df/d1b/d70/dc9/f148 x:0 0 0 2024-04-25T02:08:58.864 INFO:tasks.workunit.client.0.smithi077.stdout:9/994: write df/d1b/d56/fae [5462276,90465] 0 2024-04-25T02:08:58.864 INFO:tasks.workunit.client.0.smithi077.stdout:9/995: chown df/d1b/d56/l7a 1527 1 2024-04-25T02:08:58.864 INFO:tasks.workunit.client.0.smithi077.stdout:9/996: truncate df/d1b/d56/ddf/f12b 974796 0 2024-04-25T02:08:58.865 INFO:tasks.workunit.client.1.smithi112.stdout:8/99: rename fc to d15/d17/d1a/f20 0 2024-04-25T02:08:58.865 INFO:tasks.workunit.client.1.smithi112.stdout:8/100: readlink d15/d17/l1f 0 2024-04-25T02:08:58.865 INFO:tasks.workunit.client.1.smithi112.stdout:8/101: readlink d15/d17/l1b 0 2024-04-25T02:08:58.867 INFO:tasks.workunit.client.0.smithi077.stdout:3/961: rename d0/d2/d2f/d5f/cf0 to d0/d3e/da1/c15d 0 2024-04-25T02:08:58.868 INFO:tasks.workunit.client.1.smithi112.stdout:1/60: creat d7/dd/f12 x:0 0 0 2024-04-25T02:08:58.869 INFO:tasks.workunit.client.0.smithi077.stdout:3/962: read d0/d17/d4b/d59/d81/f95 [658083,7324] 0 2024-04-25T02:08:58.873 INFO:tasks.workunit.client.1.smithi112.stdout:0/130: creat da/d13/d20/d24/f2a x:0 0 0 2024-04-25T02:08:58.875 INFO:tasks.workunit.client.0.smithi077.stdout:0/957: dread d2/d17/d1d/db1/fc6 [0,4194304] 0 2024-04-25T02:08:58.875 INFO:tasks.workunit.client.0.smithi077.stdout:3/963: mknod d0/d2/de/d48/d135/d149/c15e 0 2024-04-25T02:08:58.877 INFO:tasks.workunit.client.1.smithi112.stdout:7/37: rename f6 to d7/f8 0 2024-04-25T02:08:58.878 INFO:tasks.workunit.client.0.smithi077.stdout:0/958: rename d2/d9/d2a/le9 to d2/d27/l149 0 2024-04-25T02:08:58.878 INFO:tasks.workunit.client.0.smithi077.stdout:0/959: readlink d2/d27/d2d/dce/de7/da7/l120 0 2024-04-25T02:08:58.878 INFO:tasks.workunit.client.1.smithi112.stdout:8/102: symlink d15/l21 0 2024-04-25T02:08:58.879 INFO:tasks.workunit.client.1.smithi112.stdout:3/45: dwrite fe [0,4194304] 0 2024-04-25T02:08:58.879 INFO:tasks.workunit.client.1.smithi112.stdout:3/46: chown f5 726 1 2024-04-25T02:08:58.879 INFO:tasks.workunit.client.0.smithi077.stdout:3/964: unlink d0/d3e/d42/d64/d88/f9e 0 2024-04-25T02:08:58.880 INFO:tasks.workunit.client.1.smithi112.stdout:1/61: mknod d7/dd/c13 0 2024-04-25T02:08:58.883 INFO:tasks.workunit.client.0.smithi077.stdout:3/965: link d0/d2/d2f/db4/db6/l159 d0/d3e/d42/d64/d88/d9c/l15f 0 2024-04-25T02:08:58.883 INFO:tasks.workunit.client.0.smithi077.stdout:3/966: truncate d0/d3e/d62/faf 235801 0 2024-04-25T02:08:58.884 INFO:tasks.workunit.client.0.smithi077.stdout:0/960: rmdir d2/d17/d1d/d34/d4c/da2/dae 39 2024-04-25T02:08:58.885 INFO:tasks.workunit.client.0.smithi077.stdout:5/950: dwrite d0/d25/d82/d87/d8b/d115/d1b/f54 [4194304,4194304] 0 2024-04-25T02:08:58.885 INFO:tasks.workunit.client.0.smithi077.stdout:7/962: dwrite d4/d13/d18/d2d/d30/f34 [0,4194304] 0 2024-04-25T02:08:58.886 INFO:tasks.workunit.client.0.smithi077.stdout:7/963: fdatasync d4/f11d 0 2024-04-25T02:08:58.886 INFO:tasks.workunit.client.1.smithi112.stdout:7/38: mknod d7/c9 0 2024-04-25T02:08:58.887 INFO:tasks.workunit.client.0.smithi077.stdout:3/967: symlink d0/dd3/l160 0 2024-04-25T02:08:58.887 INFO:tasks.workunit.client.0.smithi077.stdout:3/968: write d0/d2/d83/ff1 [784902,31459] 0 2024-04-25T02:08:58.887 INFO:tasks.workunit.client.0.smithi077.stdout:3/969: dread - d0/d3e/d62/d6a/db9/f130 zero size 2024-04-25T02:08:58.887 INFO:tasks.workunit.client.0.smithi077.stdout:3/970: chown d0/d40/l49 0 1 2024-04-25T02:08:58.887 INFO:tasks.workunit.client.0.smithi077.stdout:3/971: write d0/d2/f18 [5236527,75953] 0 2024-04-25T02:08:58.887 INFO:tasks.workunit.client.1.smithi112.stdout:7/39: dread d7/f8 [0,4194304] 0 2024-04-25T02:08:58.889 INFO:tasks.workunit.client.1.smithi112.stdout:2/29: dwrite d3/f9 [0,4194304] 0 2024-04-25T02:08:58.889 INFO:tasks.workunit.client.1.smithi112.stdout:2/30: readlink - no filename 2024-04-25T02:08:58.890 INFO:tasks.workunit.client.0.smithi077.stdout:0/961: rename d2/d17/d1d/d34/d4c/da2/d51/de8/d107/fec to d2/d8/dad/f14a 0 2024-04-25T02:08:58.890 INFO:tasks.workunit.client.0.smithi077.stdout:9/997: dwrite df/d60/d87/dca/fd9 [4194304,4194304] 0 2024-04-25T02:08:58.891 INFO:tasks.workunit.client.0.smithi077.stdout:9/998: dread - df/d1b/fc2 zero size 2024-04-25T02:08:58.891 INFO:tasks.workunit.client.0.smithi077.stdout:9/999: fdatasync df/f10 0 2024-04-25T02:08:58.897 INFO:tasks.workunit.client.1.smithi112.stdout:1/62: creat d7/d9/f14 x:0 0 0 2024-04-25T02:08:58.897 INFO:tasks.workunit.client.1.smithi112.stdout:1/63: chown d7/d9 733600 1 2024-04-25T02:08:58.898 INFO:tasks.workunit.client.1.smithi112.stdout:1/64: write d7/dd/f12 [328726,71971] 0 2024-04-25T02:08:58.905 INFO:tasks.workunit.client.0.smithi077.stdout:5/951: symlink d0/d25/d82/d87/d8b/d115/d1b/d35/l134 0 2024-04-25T02:08:58.905 INFO:tasks.workunit.client.0.smithi077.stdout:5/952: read - d0/d25/d82/d87/d8b/d115/d3/db6/f105 zero size 2024-04-25T02:08:58.905 INFO:tasks.workunit.client.0.smithi077.stdout:5/953: write d0/d25/d82/d87/d8b/da5/dc4/ffb [37256,24422] 0 2024-04-25T02:08:58.905 INFO:tasks.workunit.client.0.smithi077.stdout:5/954: write d0/d25/d82/d87/d8b/d115/d3/d9/d90/f119 [981319,28402] 0 2024-04-25T02:08:58.905 INFO:tasks.workunit.client.0.smithi077.stdout:5/955: write d0/d25/d82/d8d/f116 [731409,105909] 0 2024-04-25T02:08:58.908 INFO:tasks.workunit.client.0.smithi077.stdout:3/972: rmdir d0/d17/dd4 39 2024-04-25T02:08:58.908 INFO:tasks.workunit.client.0.smithi077.stdout:3/973: stat d0/d17/d4b/d59/dc2/c13c 0 2024-04-25T02:08:58.910 INFO:tasks.workunit.client.0.smithi077.stdout:5/956: mkdir d0/d25/d82/d87/d8b/da5/dc4/d41/d135 0 2024-04-25T02:08:58.912 INFO:tasks.workunit.client.1.smithi112.stdout:7/40: mknod d7/ca 0 2024-04-25T02:08:58.916 INFO:tasks.workunit.client.0.smithi077.stdout:7/964: dwrite d4/d13/d2c/f2e [0,4194304] 0 2024-04-25T02:08:58.918 INFO:tasks.workunit.client.0.smithi077.stdout:0/962: dwrite d2/d8/d5f/fc2 [0,4194304] 0 2024-04-25T02:08:58.918 INFO:tasks.workunit.client.0.smithi077.stdout:0/963: creat d2/d17/d1d/d34/d83/dee/f14b x:0 0 0 2024-04-25T02:08:58.918 INFO:tasks.workunit.client.1.smithi112.stdout:2/31: mkdir d3/da/dc 0 2024-04-25T02:08:58.918 INFO:tasks.workunit.client.1.smithi112.stdout:2/32: write d3/da/fb [84949,72151] 0 2024-04-25T02:08:58.919 INFO:tasks.workunit.client.1.smithi112.stdout:3/47: symlink l10 0 2024-04-25T02:08:58.920 INFO:tasks.workunit.client.1.smithi112.stdout:3/48: fdatasync fe 0 2024-04-25T02:08:58.920 INFO:tasks.workunit.client.1.smithi112.stdout:3/49: chown fe 29733 1 2024-04-25T02:08:58.925 INFO:tasks.workunit.client.0.smithi077.stdout:7/965: creat d4/d13/d18/d2d/d56/de7/f13f x:0 0 0 2024-04-25T02:08:58.928 INFO:tasks.workunit.client.1.smithi112.stdout:0/131: rename da/d13/d20 to da/d13/d23/d2b 0 2024-04-25T02:08:58.928 INFO:tasks.workunit.client.1.smithi112.stdout:0/132: fdatasync da/d13/d1e/f21 0 2024-04-25T02:08:58.932 INFO:tasks.workunit.client.0.smithi077.stdout:0/964: truncate d2/d17/d1d/d34/d4c/da2/d51/f59 584380 0 2024-04-25T02:08:58.932 INFO:tasks.workunit.client.0.smithi077.stdout:0/965: truncate d2/d17/f61 5797792 0 2024-04-25T02:08:58.932 INFO:tasks.workunit.client.0.smithi077.stdout:0/966: write d2/d17/d4e/f95 [2894813,41753] 0 2024-04-25T02:08:58.933 INFO:tasks.workunit.client.0.smithi077.stdout:5/957: dwrite d0/d25/d82/d87/d8b/d115/d3/d9/d39/d44/d5f/da4/f106 [0,4194304] 0 2024-04-25T02:08:58.933 INFO:tasks.workunit.client.0.smithi077.stdout:3/974: dwrite d0/d2/d2f/db4/db6/f143 [0,4194304] 0 2024-04-25T02:08:58.933 INFO:tasks.workunit.client.0.smithi077.stdout:3/975: dread - d0/d2/de/d36/da0/ddd/f157 zero size 2024-04-25T02:08:58.933 INFO:tasks.workunit.client.0.smithi077.stdout:3/976: fsync d0/d3e/d42/d64/d88/f119 0 2024-04-25T02:08:58.933 INFO:tasks.workunit.client.1.smithi112.stdout:1/65: rmdir d7/dd 39 2024-04-25T02:08:58.934 INFO:tasks.workunit.client.0.smithi077.stdout:7/966: symlink d4/d13/d18/d2d/d56/d68/l140 0 2024-04-25T02:08:58.936 INFO:tasks.workunit.client.1.smithi112.stdout:8/103: rename f12 to d15/d17/f22 0 2024-04-25T02:08:58.936 INFO:tasks.workunit.client.1.smithi112.stdout:8/104: creat d15/d17/f23 x:0 0 0 2024-04-25T02:08:58.937 INFO:tasks.workunit.client.1.smithi112.stdout:0/133: creat da/d13/d23/d2b/d24/f2c x:0 0 0 2024-04-25T02:08:58.937 INFO:tasks.workunit.client.1.smithi112.stdout:0/134: write da/d13/d23/d2b/d24/f2a [886820,57259] 0 2024-04-25T02:08:58.938 INFO:tasks.workunit.client.0.smithi077.stdout:0/967: truncate d2/d17/d4e/d5e/f147 1397223 0 2024-04-25T02:08:58.940 INFO:tasks.workunit.client.0.smithi077.stdout:0/968: write d2/d17/d1d/d34/d83/f92 [1233722,59370] 0 2024-04-25T02:08:58.946 INFO:tasks.workunit.client.1.smithi112.stdout:7/41: dwrite d7/f8 [0,4194304] 0 2024-04-25T02:08:58.946 INFO:tasks.workunit.client.1.smithi112.stdout:7/42: rename d7 to d7/db 22 2024-04-25T02:08:58.949 INFO:tasks.workunit.client.1.smithi112.stdout:8/105: mkdir d15/d17/d24 0 2024-04-25T02:08:58.951 INFO:tasks.workunit.client.0.smithi077.stdout:5/958: dread d0/d25/d82/d87/d8b/d115/d3/d9/d39/d44/d5f/da4/fed [0,4194304] 0 2024-04-25T02:08:58.956 INFO:tasks.workunit.client.0.smithi077.stdout:7/967: truncate d4/d13/d18/d2d/fae 719329 0 2024-04-25T02:08:58.958 INFO:tasks.workunit.client.0.smithi077.stdout:0/969: getdents d2/d17/d1d/d34/d4c/da2/df5 0 2024-04-25T02:08:58.958 INFO:tasks.workunit.client.0.smithi077.stdout:0/970: fsync d2/d17/d1d/d34/d83/dee/f117 0 2024-04-25T02:08:58.959 INFO:tasks.workunit.client.0.smithi077.stdout:0/971: chown d2/d27/d2d/dce/de7/f13c 823 1 2024-04-25T02:08:58.963 INFO:tasks.workunit.client.1.smithi112.stdout:7/43: dread d7/f8 [0,4194304] 0 2024-04-25T02:08:58.968 INFO:tasks.workunit.client.1.smithi112.stdout:2/33: truncate d3/da/fb 4547 0 2024-04-25T02:08:58.968 INFO:tasks.workunit.client.1.smithi112.stdout:2/34: mknod d3/da/cd 0 2024-04-25T02:08:58.968 INFO:tasks.workunit.client.1.smithi112.stdout:3/50: truncate fd 248704 0 2024-04-25T02:08:58.969 INFO:tasks.workunit.client.1.smithi112.stdout:7/44: write d7/f8 [3041808,68489] 0 2024-04-25T02:08:58.969 INFO:tasks.workunit.client.0.smithi077.stdout:3/977: dwrite d0/d3e/d93/dae/feb [0,4194304] 0 2024-04-25T02:08:58.969 INFO:tasks.workunit.client.1.smithi112.stdout:1/66: dwrite f2 [0,4194304] 0 2024-04-25T02:08:58.969 INFO:tasks.workunit.client.1.smithi112.stdout:1/67: truncate d7/d9/f14 896038 0 2024-04-25T02:08:58.969 INFO:tasks.workunit.client.1.smithi112.stdout:1/68: dread - d7/dd/de/f11 zero size 2024-04-25T02:08:58.970 INFO:tasks.workunit.client.1.smithi112.stdout:2/35: mkdir d3/de 0 2024-04-25T02:08:58.971 INFO:tasks.workunit.client.1.smithi112.stdout:1/69: write f6 [1033113,42489] 0 2024-04-25T02:08:58.973 INFO:tasks.workunit.client.0.smithi077.stdout:5/959: dwrite d0/d25/d82/d87/d8b/d115/d3/f55 [0,4194304] 0 2024-04-25T02:08:58.977 INFO:tasks.workunit.client.1.smithi112.stdout:7/45: creat d7/fc x:0 0 0 2024-04-25T02:08:58.978 INFO:tasks.workunit.client.1.smithi112.stdout:8/106: dwrite d15/d17/f23 [0,4194304] 0 2024-04-25T02:08:58.980 INFO:tasks.workunit.client.1.smithi112.stdout:1/70: symlink d7/dd/l15 0 2024-04-25T02:08:58.983 INFO:tasks.workunit.client.1.smithi112.stdout:3/51: rename l10 to l11 0 2024-04-25T02:08:58.983 INFO:tasks.workunit.client.1.smithi112.stdout:3/52: readlink l11 0 2024-04-25T02:08:58.986 INFO:tasks.workunit.client.1.smithi112.stdout:0/135: write da/f18 [2728243,20401] 0 2024-04-25T02:08:58.991 INFO:tasks.workunit.client.0.smithi077.stdout:5/960: creat d0/d25/d82/d87/d8b/d115/d3/d9/d39/d3c/f136 x:0 0 0 2024-04-25T02:08:58.992 INFO:tasks.workunit.client.0.smithi077.stdout:5/961: chown d0/d25/d82/d87/d8b/da5/dc4/f3f 43389 1 2024-04-25T02:08:58.992 INFO:tasks.workunit.client.0.smithi077.stdout:0/972: truncate d2/d17/d1d/d34/d4c/da2/d51/f59 1541833 0 2024-04-25T02:08:58.998 INFO:tasks.workunit.client.1.smithi112.stdout:7/46: dwrite d7/f8 [0,4194304] 0 2024-04-25T02:08:59.003 INFO:tasks.workunit.client.1.smithi112.stdout:8/107: symlink d15/d17/d1a/l25 0 2024-04-25T02:08:59.004 INFO:tasks.workunit.client.0.smithi077.stdout:3/978: rmdir d0/d3e/d42/d123/d128 39 2024-04-25T02:08:59.008 INFO:tasks.workunit.client.0.smithi077.stdout:5/962: dwrite d0/d25/d82/d87/d8b/d115/da8/daf/fd9 [0,4194304] 0 2024-04-25T02:08:59.008 INFO:tasks.workunit.client.0.smithi077.stdout:5/963: readlink d0/d25/d82/d87/d8b/d115/d1b/d3b/l40 0 2024-04-25T02:08:59.008 INFO:tasks.workunit.client.0.smithi077.stdout:5/964: write d0/d25/d82/d8d/f116 [1058853,31541] 0 2024-04-25T02:08:59.009 INFO:tasks.workunit.client.0.smithi077.stdout:5/965: fdatasync d0/f50 0 2024-04-25T02:08:59.009 INFO:tasks.workunit.client.0.smithi077.stdout:5/966: fsync d0/d25/d82/d87/d8b/d115/d3/db6/f105 0 2024-04-25T02:08:59.012 INFO:tasks.workunit.client.1.smithi112.stdout:8/108: mkdir d15/d26 0 2024-04-25T02:08:59.020 INFO:tasks.workunit.client.1.smithi112.stdout:3/53: mkdir d12 0 2024-04-25T02:08:59.024 INFO:tasks.workunit.client.0.smithi077.stdout:0/973: symlink d2/d8/l14c 0 2024-04-25T02:08:59.024 INFO:tasks.workunit.client.0.smithi077.stdout:0/974: read - d2/d8/db6/dd7/fda zero size 2024-04-25T02:08:59.024 INFO:tasks.workunit.client.0.smithi077.stdout:0/975: write d2/d8/db6/dd7/de0/f12f [1658479,112686] 0 2024-04-25T02:08:59.024 INFO:tasks.workunit.client.0.smithi077.stdout:0/976: write d2/f6 [1252480,86061] 0 2024-04-25T02:08:59.026 INFO:tasks.workunit.client.1.smithi112.stdout:8/109: creat d15/d17/d24/f27 x:0 0 0 2024-04-25T02:08:59.026 INFO:tasks.workunit.client.1.smithi112.stdout:8/110: write f10 [818666,58976] 0 2024-04-25T02:08:59.026 INFO:tasks.workunit.client.1.smithi112.stdout:8/111: write d15/f18 [92549,118504] 0 2024-04-25T02:08:59.027 INFO:tasks.workunit.client.0.smithi077.stdout:3/979: creat d0/d3e/d93/dae/f161 x:0 0 0 2024-04-25T02:08:59.030 INFO:tasks.workunit.client.1.smithi112.stdout:8/112: unlink d15/d17/f1c 0 2024-04-25T02:08:59.033 INFO:tasks.workunit.client.1.smithi112.stdout:8/113: creat d15/f28 x:0 0 0 2024-04-25T02:08:59.033 INFO:tasks.workunit.client.1.smithi112.stdout:8/114: truncate d15/f28 711581 0 2024-04-25T02:08:59.034 INFO:tasks.workunit.client.1.smithi112.stdout:3/54: dwrite fd [0,4194304] 0 2024-04-25T02:08:59.035 INFO:tasks.workunit.client.1.smithi112.stdout:3/55: chown lb 885 1 2024-04-25T02:08:59.035 INFO:tasks.workunit.client.1.smithi112.stdout:3/56: read - f5 zero size 2024-04-25T02:08:59.037 INFO:tasks.workunit.client.1.smithi112.stdout:8/115: creat d15/d26/f29 x:0 0 0 2024-04-25T02:08:59.038 INFO:tasks.workunit.client.1.smithi112.stdout:8/116: creat d15/d26/f2a x:0 0 0 2024-04-25T02:08:59.038 INFO:tasks.workunit.client.1.smithi112.stdout:8/117: read fb [1207225,107878] 0 2024-04-25T02:08:59.041 INFO:tasks.workunit.client.0.smithi077.stdout:0/977: rename d2/d8/dad/fba to d2/d17/d1d/d34/d4c/da2/de2/d104/d148/f14d 0 2024-04-25T02:08:59.042 INFO:tasks.workunit.client.1.smithi112.stdout:3/57: mkdir d12/d13 0 2024-04-25T02:08:59.043 INFO:tasks.workunit.client.0.smithi077.stdout:3/980: mknod d0/d3e/d93/c162 0 2024-04-25T02:08:59.046 INFO:tasks.workunit.client.0.smithi077.stdout:5/967: mknod d0/d25/d82/d87/d8b/d115/d3/d9/c137 0 2024-04-25T02:08:59.046 INFO:tasks.workunit.client.0.smithi077.stdout:5/968: chown d0/d25/d82/d87/d8b/d115/d3/d9/d39/d44/d80 809904 1 2024-04-25T02:08:59.046 INFO:tasks.workunit.client.0.smithi077.stdout:5/969: dread - d0/d25/d82/d87/d8b/d115/d3/d9/d90/fce zero size 2024-04-25T02:08:59.046 INFO:tasks.workunit.client.0.smithi077.stdout:5/970: write d0/d25/d82/d87/d8b/d115/d3/d9/d39/d44/f95 [2431647,68015] 0 2024-04-25T02:08:59.048 INFO:tasks.workunit.client.1.smithi112.stdout:1/71: truncate d7/d9/fa 4762776 0 2024-04-25T02:08:59.051 INFO:tasks.workunit.client.0.smithi077.stdout:0/978: symlink d2/d17/d1d/d34/d4c/da2/l14e 0 2024-04-25T02:08:59.056 INFO:tasks.workunit.client.0.smithi077.stdout:5/971: creat d0/d25/dc7/dca/f138 x:0 0 0 2024-04-25T02:08:59.056 INFO:tasks.workunit.client.0.smithi077.stdout:5/972: chown d0/d25/d82/d87/d8b/d115/d3/d9/d39/d3c/dc6/l117 17043700 1 2024-04-25T02:08:59.057 INFO:tasks.workunit.client.1.smithi112.stdout:8/118: getdents d15/d17 0 2024-04-25T02:08:59.060 INFO:tasks.workunit.client.1.smithi112.stdout:8/119: rmdir d15/d17/d1a 39 2024-04-25T02:08:59.060 INFO:tasks.workunit.client.1.smithi112.stdout:8/120: creat d15/d26/f2b x:0 0 0 2024-04-25T02:08:59.060 INFO:tasks.workunit.client.1.smithi112.stdout:8/121: creat d15/f2c x:0 0 0 2024-04-25T02:08:59.061 INFO:tasks.workunit.client.1.smithi112.stdout:0/136: dwrite da/f12 [4194304,4194304] 0 2024-04-25T02:08:59.061 INFO:tasks.workunit.client.0.smithi077.stdout:7/968: sync 2024-04-25T02:08:59.061 INFO:tasks.workunit.client.0.smithi077.stdout:3/981: dwrite d0/d3e/d93/dae/f161 [0,4194304] 0 2024-04-25T02:08:59.061 INFO:tasks.workunit.client.0.smithi077.stdout:7/969: chown d4/d13/de8/f130 967 1 2024-04-25T02:08:59.064 INFO:tasks.workunit.client.0.smithi077.stdout:0/979: dread d2/d17/d1d/d34/d83/dee/f117 [0,4194304] 0 2024-04-25T02:08:59.064 INFO:tasks.workunit.client.0.smithi077.stdout:5/973: dread d0/d25/d82/d87/d8b/d115/d3/f34 [0,4194304] 0 2024-04-25T02:08:59.064 INFO:tasks.workunit.client.0.smithi077.stdout:5/974: dread - d0/d25/d82/d87/d8b/d115/d3/d9/d39/d3c/f136 zero size 2024-04-25T02:08:59.064 INFO:tasks.workunit.client.0.smithi077.stdout:5/975: dread - d0/d25/d82/d87/d8b/d115/d3/ffa zero size 2024-04-25T02:08:59.066 INFO:tasks.workunit.client.1.smithi112.stdout:3/58: truncate fd 46204 0 2024-04-25T02:08:59.068 INFO:tasks.workunit.client.1.smithi112.stdout:0/137: mknod da/d13/d23/d2b/c2d 0 2024-04-25T02:08:59.072 INFO:tasks.workunit.client.0.smithi077.stdout:5/976: dread d0/d25/d82/d87/d8b/da5/dc4/d23/fa6 [0,4194304] 0 2024-04-25T02:08:59.073 INFO:tasks.workunit.client.1.smithi112.stdout:3/59: creat d12/f14 x:0 0 0 2024-04-25T02:08:59.075 INFO:tasks.workunit.client.0.smithi077.stdout:7/970: rename d4/d13/d18/d24/d3f/ff1 to d4/d13/d18/d2d/d56/d68/f141 0 2024-04-25T02:08:59.077 INFO:tasks.workunit.client.1.smithi112.stdout:0/138: mkdir da/d1d/d2e 0 2024-04-25T02:08:59.082 INFO:tasks.workunit.client.1.smithi112.stdout:0/139: rmdir da/d1d/d22 0 2024-04-25T02:08:59.084 INFO:tasks.workunit.client.1.smithi112.stdout:0/140: getdents da/d13/d23/d2b/d24 0 2024-04-25T02:08:59.085 INFO:tasks.workunit.client.0.smithi077.stdout:0/980: read d2/d27/d2d/dce/de7/da7/fe5 [3385159,121212] 0 2024-04-25T02:08:59.085 INFO:tasks.workunit.client.1.smithi112.stdout:0/141: symlink da/d13/l2f 0 2024-04-25T02:08:59.086 INFO:tasks.workunit.client.1.smithi112.stdout:8/122: dwrite d15/d26/f2a [0,4194304] 0 2024-04-25T02:08:59.087 INFO:tasks.workunit.client.1.smithi112.stdout:8/123: write fe [8425,90485] 0 2024-04-25T02:08:59.087 INFO:tasks.workunit.client.1.smithi112.stdout:8/124: truncate d15/f18 693935 0 2024-04-25T02:08:59.087 INFO:tasks.workunit.client.0.smithi077.stdout:3/982: dwrite d0/d2/de/d27/d13a/f11d [0,4194304] 0 2024-04-25T02:08:59.087 INFO:tasks.workunit.client.0.smithi077.stdout:0/981: truncate d2/d8/db6/dd7/d105/f7e 120832 0 2024-04-25T02:08:59.087 INFO:tasks.workunit.client.0.smithi077.stdout:0/982: creat d2/d17/d1d/d34/d127/f14f x:0 0 0 2024-04-25T02:08:59.089 INFO:tasks.workunit.client.1.smithi112.stdout:0/142: creat da/d13/d23/d2b/f30 x:0 0 0 2024-04-25T02:08:59.091 INFO:tasks.workunit.client.1.smithi112.stdout:0/143: write da/d13/d23/d2b/d24/f2a [62883,67807] 0 2024-04-25T02:08:59.092 INFO:tasks.workunit.client.1.smithi112.stdout:0/144: dread da/d13/f17 [0,4194304] 0 2024-04-25T02:08:59.092 INFO:tasks.workunit.client.1.smithi112.stdout:0/145: truncate da/f26 725910 0 2024-04-25T02:08:59.092 INFO:tasks.workunit.client.1.smithi112.stdout:0/146: chown da/f10 53069 1 2024-04-25T02:08:59.093 INFO:tasks.workunit.client.1.smithi112.stdout:1/72: read d7/d9/fa [2386250,522] 0 2024-04-25T02:08:59.093 INFO:tasks.workunit.client.1.smithi112.stdout:1/73: creat d7/d9/f16 x:0 0 0 2024-04-25T02:08:59.096 INFO:tasks.workunit.client.0.smithi077.stdout:5/977: dwrite d0/d25/d82/d87/d8b/da5/dc4/d23/f7c [0,4194304] 0 2024-04-25T02:08:59.097 INFO:tasks.workunit.client.1.smithi112.stdout:8/125: readlink d15/d17/l1b 0 2024-04-25T02:08:59.097 INFO:tasks.workunit.client.1.smithi112.stdout:3/60: dread fd [0,4194304] 0 2024-04-25T02:08:59.099 INFO:tasks.workunit.client.0.smithi077.stdout:3/983: creat d0/f163 x:0 0 0 2024-04-25T02:08:59.109 INFO:tasks.workunit.client.0.smithi077.stdout:0/983: mknod d2/d27/d2d/dce/de7/da7/ddf/c150 0 2024-04-25T02:08:59.111 INFO:tasks.workunit.client.1.smithi112.stdout:1/74: rmdir d7 39 2024-04-25T02:08:59.112 INFO:tasks.workunit.client.1.smithi112.stdout:0/147: dread da/fb [0,4194304] 0 2024-04-25T02:08:59.115 INFO:tasks.workunit.client.1.smithi112.stdout:8/126: symlink d15/d26/l2d 0 2024-04-25T02:08:59.117 INFO:tasks.workunit.client.1.smithi112.stdout:3/61: creat d12/d13/f15 x:0 0 0 2024-04-25T02:08:59.118 INFO:tasks.workunit.client.0.smithi077.stdout:3/984: dwrite d0/d2/d83/d12a/f136 [0,4194304] 0 2024-04-25T02:08:59.120 INFO:tasks.workunit.client.1.smithi112.stdout:1/75: link d7/d9/f16 d7/dd/de/f17 0 2024-04-25T02:08:59.122 INFO:tasks.workunit.client.1.smithi112.stdout:1/76: dread d7/dd/f12 [0,4194304] 0 2024-04-25T02:08:59.123 INFO:tasks.workunit.client.1.smithi112.stdout:0/148: mknod da/c31 0 2024-04-25T02:08:59.124 INFO:tasks.workunit.client.1.smithi112.stdout:0/149: creat da/f32 x:0 0 0 2024-04-25T02:08:59.124 INFO:tasks.workunit.client.1.smithi112.stdout:0/150: write da/d13/d23/d2b/d24/f2a [678935,25947] 0 2024-04-25T02:08:59.125 INFO:tasks.workunit.client.0.smithi077.stdout:5/978: rename d0/f131 to d0/d25/d82/d87/d8b/d5a/f139 0 2024-04-25T02:08:59.128 INFO:tasks.workunit.client.1.smithi112.stdout:3/62: symlink d12/d13/l16 0 2024-04-25T02:08:59.128 INFO:tasks.workunit.client.1.smithi112.stdout:3/63: chown fe 1 1 2024-04-25T02:08:59.133 INFO:tasks.workunit.client.1.smithi112.stdout:1/77: symlink d7/dd/de/l18 0 2024-04-25T02:08:59.133 INFO:tasks.workunit.client.1.smithi112.stdout:1/78: read - d7/d9/f16 zero size 2024-04-25T02:08:59.135 INFO:tasks.workunit.client.0.smithi077.stdout:3/985: creat d0/d3e/dc3/f164 x:0 0 0 2024-04-25T02:08:59.136 INFO:tasks.workunit.client.1.smithi112.stdout:8/127: write d15/d17/f23 [2203023,110827] 0 2024-04-25T02:08:59.138 INFO:tasks.workunit.client.0.smithi077.stdout:0/984: rename d2/d8/l14c to d2/d8/db6/l151 0 2024-04-25T02:08:59.139 INFO:tasks.workunit.client.1.smithi112.stdout:0/151: creat da/d13/d23/d2b/d24/f33 x:0 0 0 2024-04-25T02:08:59.141 INFO:tasks.workunit.client.1.smithi112.stdout:3/64: unlink fa 0 2024-04-25T02:08:59.146 INFO:tasks.workunit.client.1.smithi112.stdout:1/79: symlink d7/d9/l19 0 2024-04-25T02:08:59.148 INFO:tasks.workunit.client.0.smithi077.stdout:5/979: dwrite d0/d25/d82/d87/d8b/d5a/f139 [4194304,4194304] 0 2024-04-25T02:08:59.149 INFO:tasks.workunit.client.0.smithi077.stdout:0/985: rename d2/d17/d1d/d34/d83 to d2/d8/dad/d152 0 2024-04-25T02:08:59.151 INFO:tasks.workunit.client.0.smithi077.stdout:3/986: dread d0/d2/de/f82 [0,4194304] 0 2024-04-25T02:08:59.152 INFO:tasks.workunit.client.1.smithi112.stdout:8/128: rmdir d15/d17 39 2024-04-25T02:08:59.154 INFO:tasks.workunit.client.1.smithi112.stdout:0/152: symlink da/l34 0 2024-04-25T02:08:59.156 INFO:tasks.workunit.client.0.smithi077.stdout:5/980: dread d0/d25/d82/d87/d8b/da5/dc4/f3f [0,4194304] 0 2024-04-25T02:08:59.156 INFO:tasks.workunit.client.0.smithi077.stdout:5/981: creat d0/d25/dc7/dca/f13a x:0 0 0 2024-04-25T02:08:59.156 INFO:tasks.workunit.client.0.smithi077.stdout:5/982: chown d0/d25/d82/d87/d8b/d115/d68/db8/fea 39376298 1 2024-04-25T02:08:59.156 INFO:tasks.workunit.client.0.smithi077.stdout:5/983: fdatasync d0/d25/d82/d87/d8b/da5/dc4/d23/d4a/f5d 0 2024-04-25T02:08:59.156 INFO:tasks.workunit.client.0.smithi077.stdout:5/984: chown d0/d25/d82/d87/d8b/d115/d1b/d35/df3/l11d 8 1 2024-04-25T02:08:59.157 INFO:tasks.workunit.client.0.smithi077.stdout:0/986: rename d2/lcb to d2/d8/db6/dd7/d105/l153 0 2024-04-25T02:08:59.159 INFO:tasks.workunit.client.1.smithi112.stdout:3/65: dwrite fd [0,4194304] 0 2024-04-25T02:08:59.159 INFO:tasks.workunit.client.1.smithi112.stdout:1/80: creat d7/dd/f1a x:0 0 0 2024-04-25T02:08:59.159 INFO:tasks.workunit.client.1.smithi112.stdout:1/81: creat d7/d9/f1b x:0 0 0 2024-04-25T02:08:59.159 INFO:tasks.workunit.client.1.smithi112.stdout:1/82: write d7/dd/f12 [743193,112450] 0 2024-04-25T02:08:59.159 INFO:tasks.workunit.client.1.smithi112.stdout:1/83: stat d7/d9/l19 0 2024-04-25T02:08:59.159 INFO:tasks.workunit.client.1.smithi112.stdout:1/84: fdatasync f2 0 2024-04-25T02:08:59.159 INFO:tasks.workunit.client.1.smithi112.stdout:1/85: creat d7/dd/f1c x:0 0 0 2024-04-25T02:08:59.162 INFO:tasks.workunit.client.1.smithi112.stdout:0/153: creat da/d13/f35 x:0 0 0 2024-04-25T02:08:59.162 INFO:tasks.workunit.client.1.smithi112.stdout:0/154: dread - da/d13/d23/d2b/d24/f33 zero size 2024-04-25T02:08:59.164 INFO:tasks.workunit.client.0.smithi077.stdout:5/985: creat d0/d25/d82/d87/d8b/d115/d68/f13b x:0 0 0 2024-04-25T02:08:59.167 INFO:tasks.workunit.client.0.smithi077.stdout:7/971: sync 2024-04-25T02:08:59.168 INFO:tasks.workunit.client.1.smithi112.stdout:8/129: dwrite f6 [0,4194304] 0 2024-04-25T02:08:59.168 INFO:tasks.workunit.client.1.smithi112.stdout:8/130: read fd [12154,54148] 0 2024-04-25T02:08:59.168 INFO:tasks.workunit.client.0.smithi077.stdout:3/987: rename d0/d3e/d62/f8d to d0/d17/f165 0 2024-04-25T02:08:59.169 INFO:tasks.workunit.client.1.smithi112.stdout:3/66: dread fe [0,4194304] 0 2024-04-25T02:08:59.170 INFO:tasks.workunit.client.0.smithi077.stdout:0/987: mkdir d2/d8/dfb/d154 0 2024-04-25T02:08:59.170 INFO:tasks.workunit.client.0.smithi077.stdout:0/988: dread - d2/d9/d2a/db5/fea zero size 2024-04-25T02:08:59.171 INFO:tasks.workunit.client.0.smithi077.stdout:0/989: fsync d2/d17/d1d/d34/d4c/da2/dae/f10b 0 2024-04-25T02:08:59.172 INFO:tasks.workunit.client.0.smithi077.stdout:5/986: symlink d0/d25/d82/d87/d8b/d115/d3/d9/d39/l13c 0 2024-04-25T02:08:59.172 INFO:tasks.workunit.client.0.smithi077.stdout:5/987: dread - d0/d25/d82/d8d/fff zero size 2024-04-25T02:08:59.173 INFO:tasks.workunit.client.1.smithi112.stdout:0/155: symlink da/d13/d23/d2b/l36 0 2024-04-25T02:08:59.173 INFO:tasks.workunit.client.1.smithi112.stdout:0/156: write f2 [4820473,130818] 0 2024-04-25T02:08:59.174 INFO:tasks.workunit.client.0.smithi077.stdout:7/972: symlink d4/d13/d18/d2d/d56/de7/l142 0 2024-04-25T02:08:59.176 INFO:tasks.workunit.client.1.smithi112.stdout:3/67: mkdir d12/d13/d17 0 2024-04-25T02:08:59.179 INFO:tasks.workunit.client.0.smithi077.stdout:5/988: unlink d0/d25/d82/d87/d8b/d115/d3/d9/d39/d44/f53 0 2024-04-25T02:08:59.181 INFO:tasks.workunit.client.1.smithi112.stdout:0/157: symlink da/d13/l37 0 2024-04-25T02:08:59.183 INFO:tasks.workunit.client.1.smithi112.stdout:1/86: getdents d7/dd 0 2024-04-25T02:08:59.186 INFO:tasks.workunit.client.1.smithi112.stdout:0/158: link da/d13/l37 da/d13/d23/d2b/l38 0 2024-04-25T02:08:59.189 INFO:tasks.workunit.client.1.smithi112.stdout:8/131: link d15/d17/f22 d15/d17/f2e 0 2024-04-25T02:08:59.192 INFO:tasks.workunit.client.1.smithi112.stdout:3/68: rmdir d12 39 2024-04-25T02:08:59.192 INFO:tasks.workunit.client.1.smithi112.stdout:3/69: fdatasync d12/d13/f15 0 2024-04-25T02:08:59.194 INFO:tasks.workunit.client.1.smithi112.stdout:1/87: truncate f4 1410024 0 2024-04-25T02:08:59.194 INFO:tasks.workunit.client.1.smithi112.stdout:1/88: write d7/dd/de/f11 [341314,101354] 0 2024-04-25T02:08:59.198 INFO:tasks.workunit.client.1.smithi112.stdout:1/89: getdents d7 0 2024-04-25T02:08:59.198 INFO:tasks.workunit.client.1.smithi112.stdout:1/90: stat f6 0 2024-04-25T02:08:59.205 INFO:tasks.workunit.client.0.smithi077.stdout:7/973: dwrite d4/d13/d18/d2d/d30/f10a [0,4194304] 0 2024-04-25T02:08:59.208 INFO:tasks.workunit.client.1.smithi112.stdout:8/132: dread fd [0,4194304] 0 2024-04-25T02:08:59.209 INFO:tasks.workunit.client.0.smithi077.stdout:5/989: dwrite d0/d25/f1a [0,4194304] 0 2024-04-25T02:08:59.209 INFO:tasks.workunit.client.0.smithi077.stdout:5/990: chown d0/d25/d82/d87/d8b/d115/d1b/f54 0 1 2024-04-25T02:08:59.211 INFO:tasks.workunit.client.0.smithi077.stdout:5/991: mkdir d0/d25/d82/d87/d8b/da5/dc4/d41/d135/d13d 0 2024-04-25T02:08:59.211 INFO:tasks.workunit.client.0.smithi077.stdout:5/992: write d0/d25/d82/d87/d8b/da5/dc4/d23/d4a/fad [585012,53559] 0 2024-04-25T02:08:59.213 INFO:tasks.workunit.client.0.smithi077.stdout:5/993: rename d0/d25/d82/d87/d8b/d115/f128 to d0/d25/d82/d87/d8b/d115/d52/f13e 0 2024-04-25T02:08:59.213 INFO:tasks.workunit.client.0.smithi077.stdout:5/994: creat d0/d25/d82/d87/d8b/d115/d3/f13f x:0 0 0 2024-04-25T02:08:59.213 INFO:tasks.workunit.client.0.smithi077.stdout:5/995: write d0/d25/d82/d87/d8b/d115/d3/d9/d39/d3c/fd8 [1186599,35249] 0 2024-04-25T02:08:59.217 INFO:tasks.workunit.client.0.smithi077.stdout:5/996: mknod d0/d25/d82/d87/d8b/d5a/c140 0 2024-04-25T02:08:59.218 INFO:tasks.workunit.client.0.smithi077.stdout:5/997: rmdir d0/d25/d82/d87/d8b/d115/d52 39 2024-04-25T02:08:59.221 INFO:tasks.workunit.client.1.smithi112.stdout:0/159: dwrite da/f32 [0,4194304] 0 2024-04-25T02:08:59.222 INFO:tasks.workunit.client.1.smithi112.stdout:8/133: fsync fe 0 2024-04-25T02:08:59.222 INFO:tasks.workunit.client.1.smithi112.stdout:1/91: dwrite d7/dd/f1a [0,4194304] 0 2024-04-25T02:08:59.223 INFO:tasks.workunit.client.1.smithi112.stdout:1/92: chown d7/d9/l19 8043084 1 2024-04-25T02:08:59.223 INFO:tasks.workunit.client.1.smithi112.stdout:1/93: fsync d7/dd/f1c 0 2024-04-25T02:08:59.223 INFO:tasks.workunit.client.1.smithi112.stdout:3/70: dwrite d12/f14 [0,4194304] 0 2024-04-25T02:08:59.223 INFO:tasks.workunit.client.1.smithi112.stdout:0/160: dread da/d13/d1e/f21 [0,4194304] 0 2024-04-25T02:08:59.223 INFO:tasks.workunit.client.1.smithi112.stdout:0/161: rename da/d1d/d2e to da/d1d/d2e/d39 22 2024-04-25T02:08:59.231 INFO:tasks.workunit.client.1.smithi112.stdout:1/94: mknod d7/c1d 0 2024-04-25T02:08:59.233 INFO:tasks.workunit.client.1.smithi112.stdout:1/95: dread f4 [0,4194304] 0 2024-04-25T02:08:59.235 INFO:tasks.workunit.client.1.smithi112.stdout:8/134: dread f6 [0,4194304] 0 2024-04-25T02:08:59.235 INFO:tasks.workunit.client.1.smithi112.stdout:3/71: mknod d12/d13/c18 0 2024-04-25T02:08:59.236 INFO:tasks.workunit.client.0.smithi077.stdout:7/974: dwrite d4/d13/d18/d24/d3f/d59/dd6/d11b/f139 [0,4194304] 0 2024-04-25T02:08:59.240 INFO:tasks.workunit.client.0.smithi077.stdout:5/998: dwrite d0/d25/d82/d87/d8b/d115/d3/d9/d39/d44/d5f/da4/f106 [0,4194304] 0 2024-04-25T02:08:59.241 INFO:tasks.workunit.client.1.smithi112.stdout:1/96: rename d7/dd to d7/d9/d1e 0 2024-04-25T02:08:59.241 INFO:tasks.workunit.client.1.smithi112.stdout:1/97: chown d7/d9/cc 57670 1 2024-04-25T02:08:59.242 INFO:tasks.workunit.client.1.smithi112.stdout:1/98: dread d7/d9/f14 [0,4194304] 0 2024-04-25T02:08:59.242 INFO:tasks.workunit.client.1.smithi112.stdout:1/99: write d7/d9/fa [876686,73448] 0 2024-04-25T02:08:59.242 INFO:tasks.workunit.client.1.smithi112.stdout:1/100: truncate d7/d9/d1e/de/f11 1331179 0 2024-04-25T02:08:59.242 INFO:tasks.workunit.client.1.smithi112.stdout:1/101: write d7/d9/d1e/f1c [264824,127855] 0 2024-04-25T02:08:59.242 INFO:tasks.workunit.client.1.smithi112.stdout:1/102: fsync d7/d9/d1e/f12 0 2024-04-25T02:08:59.242 INFO:tasks.workunit.client.1.smithi112.stdout:1/103: readlink d7/d9/d1e/de/l18 0 2024-04-25T02:08:59.245 INFO:tasks.workunit.client.1.smithi112.stdout:8/135: dread - d15/d17/d1a/f1d zero size 2024-04-25T02:08:59.245 INFO:tasks.workunit.client.1.smithi112.stdout:8/136: fsync f10 0 2024-04-25T02:08:59.245 INFO:tasks.workunit.client.1.smithi112.stdout:8/137: dread fe [0,4194304] 0 2024-04-25T02:08:59.250 INFO:tasks.workunit.client.0.smithi077.stdout:7/975: rmdir d4/d13/da9 39 2024-04-25T02:08:59.253 INFO:tasks.workunit.client.1.smithi112.stdout:1/104: dread d7/d9/d1e/f1a [0,4194304] 0 2024-04-25T02:08:59.253 INFO:tasks.workunit.client.1.smithi112.stdout:1/105: chown f2 0 1 2024-04-25T02:08:59.253 INFO:tasks.workunit.client.1.smithi112.stdout:1/106: fsync d7/d9/d1e/de/f11 0 2024-04-25T02:08:59.253 INFO:tasks.workunit.client.1.smithi112.stdout:1/107: write f4 [1852802,94428] 0 2024-04-25T02:08:59.256 INFO:tasks.workunit.client.0.smithi077.stdout:7/976: unlink c2 0 2024-04-25T02:08:59.259 INFO:tasks.workunit.client.1.smithi112.stdout:0/162: truncate da/f26 610219 0 2024-04-25T02:08:59.262 INFO:tasks.workunit.client.0.smithi077.stdout:7/977: symlink d4/d13/d18/d2d/d56/d68/d88/d121/l143 0 2024-04-25T02:08:59.262 INFO:tasks.workunit.client.0.smithi077.stdout:5/999: dwrite d0/d25/dc7/dca/f1f [0,4194304] 0 2024-04-25T02:08:59.264 INFO:tasks.workunit.client.1.smithi112.stdout:0/163: write da/f18 [1069076,117385] 0 2024-04-25T02:08:59.265 INFO:tasks.workunit.client.0.smithi077.stdout:7/978: dread d4/fa [0,4194304] 0 2024-04-25T02:08:59.265 INFO:tasks.workunit.client.0.smithi077.stdout:7/979: write d4/d13/d18/d2d/f100 [479432,130375] 0 2024-04-25T02:08:59.265 INFO:tasks.workunit.client.1.smithi112.stdout:8/138: creat d15/d17/d1a/f2f x:0 0 0 2024-04-25T02:08:59.265 INFO:tasks.workunit.client.1.smithi112.stdout:0/164: dread da/d13/f17 [0,4194304] 0 2024-04-25T02:08:59.270 INFO:tasks.workunit.client.1.smithi112.stdout:1/108: dread d7/d9/fa [0,4194304] 0 2024-04-25T02:08:59.273 INFO:tasks.workunit.client.1.smithi112.stdout:8/139: rename d15/d26/f2a to d15/f30 0 2024-04-25T02:08:59.273 INFO:tasks.workunit.client.1.smithi112.stdout:8/140: truncate d15/d17/d1a/f1d 889868 0 2024-04-25T02:08:59.277 INFO:tasks.workunit.client.1.smithi112.stdout:0/165: symlink da/d13/d23/d2b/d24/l3a 0 2024-04-25T02:08:59.277 INFO:tasks.workunit.client.1.smithi112.stdout:0/166: stat da/d13/f15 0 2024-04-25T02:08:59.277 INFO:tasks.workunit.client.1.smithi112.stdout:0/167: fsync da/d13/f17 0 2024-04-25T02:08:59.281 INFO:tasks.workunit.client.1.smithi112.stdout:1/109: mkdir d7/d9/d1f 0 2024-04-25T02:08:59.281 INFO:tasks.workunit.client.1.smithi112.stdout:1/110: chown d7/d9/f16 1 1 2024-04-25T02:08:59.281 INFO:tasks.workunit.client.1.smithi112.stdout:1/111: chown d7/d9/d1e/c13 2436253 1 2024-04-25T02:08:59.284 INFO:tasks.workunit.client.1.smithi112.stdout:8/141: creat d15/d17/f31 x:0 0 0 2024-04-25T02:08:59.285 INFO:tasks.workunit.client.0.smithi077.stdout:7/980: dwrite d4/d13/d5b/d8b/fb9 [0,4194304] 0 2024-04-25T02:08:59.285 INFO:tasks.workunit.client.0.smithi077.stdout:7/981: dread - d4/d13/d18/d24/fbf zero size 2024-04-25T02:08:59.288 INFO:tasks.workunit.client.0.smithi077.stdout:3/988: sync 2024-04-25T02:08:59.288 INFO:tasks.workunit.client.0.smithi077.stdout:0/990: sync 2024-04-25T02:08:59.288 INFO:tasks.workunit.client.0.smithi077.stdout:0/991: readlink d2/d27/d2d/dce/de7/da7/l120 0 2024-04-25T02:08:59.289 INFO:tasks.workunit.client.1.smithi112.stdout:0/168: dread da/f18 [0,4194304] 0 2024-04-25T02:08:59.292 INFO:tasks.workunit.client.1.smithi112.stdout:1/112: symlink d7/d9/d1e/l20 0 2024-04-25T02:08:59.292 INFO:tasks.workunit.client.1.smithi112.stdout:1/113: fsync d7/d9/f14 0 2024-04-25T02:08:59.293 INFO:tasks.workunit.client.1.smithi112.stdout:1/114: truncate f4 2096722 0 2024-04-25T02:08:59.297 INFO:tasks.workunit.client.0.smithi077.stdout:7/982: symlink d4/d13/d2c/l144 0 2024-04-25T02:08:59.299 INFO:tasks.workunit.client.0.smithi077.stdout:3/989: mknod d0/d17/d4b/d59/c166 0 2024-04-25T02:08:59.301 INFO:tasks.workunit.client.0.smithi077.stdout:0/992: creat d2/d17/d1d/d34/d4c/da2/dae/f155 x:0 0 0 2024-04-25T02:08:59.301 INFO:tasks.workunit.client.0.smithi077.stdout:0/993: stat d2/d17/d1d/l23 0 2024-04-25T02:08:59.304 INFO:tasks.workunit.client.0.smithi077.stdout:0/994: mknod d2/d17/d1d/d34/d4c/da2/d51/de8/d107/c156 0 2024-04-25T02:08:59.304 INFO:tasks.workunit.client.0.smithi077.stdout:0/995: dread - d2/d17/d1d/db1/f10d zero size 2024-04-25T02:08:59.304 INFO:tasks.workunit.client.0.smithi077.stdout:0/996: chown d2/d17/d1d/d34/d4c/da2/dae/lc1 322 1 2024-04-25T02:08:59.308 INFO:tasks.workunit.client.0.smithi077.stdout:7/983: dread d4/d13/d66/f9b [0,4194304] 0 2024-04-25T02:08:59.308 INFO:tasks.workunit.client.0.smithi077.stdout:7/984: chown d4/d13/d18/d24/f57 1518 1 2024-04-25T02:08:59.308 INFO:tasks.workunit.client.0.smithi077.stdout:0/997: rename d2/d142 to d2/d17/d1d/d34/d4c/da2/d51/de8/d107/d157 0 2024-04-25T02:08:59.309 INFO:tasks.workunit.client.1.smithi112.stdout:8/142: dwrite d15/f18 [0,4194304] 0 2024-04-25T02:08:59.312 INFO:tasks.workunit.client.0.smithi077.stdout:7/985: creat d4/d13/d66/d12f/f145 x:0 0 0 2024-04-25T02:08:59.313 INFO:tasks.workunit.client.0.smithi077.stdout:3/990: dread d0/d2/de/d48/fca [0,4194304] 0 2024-04-25T02:08:59.315 INFO:tasks.workunit.client.0.smithi077.stdout:7/986: symlink d4/d13/l146 0 2024-04-25T02:08:59.317 INFO:tasks.workunit.client.1.smithi112.stdout:0/169: dwrite da/d13/d23/d2b/d24/f33 [0,4194304] 0 2024-04-25T02:08:59.317 INFO:tasks.workunit.client.1.smithi112.stdout:0/170: creat da/d13/d1e/f3b x:0 0 0 2024-04-25T02:08:59.317 INFO:tasks.workunit.client.1.smithi112.stdout:0/171: truncate da/d13/f17 854123 0 2024-04-25T02:08:59.317 INFO:tasks.workunit.client.1.smithi112.stdout:0/172: creat da/d13/d1e/f3c x:0 0 0 2024-04-25T02:08:59.318 INFO:tasks.workunit.client.1.smithi112.stdout:8/143: mknod d15/d17/d1a/c32 0 2024-04-25T02:08:59.320 INFO:tasks.workunit.client.1.smithi112.stdout:1/115: truncate f4 1739318 0 2024-04-25T02:08:59.322 INFO:tasks.workunit.client.0.smithi077.stdout:3/991: creat d0/d17/dd4/d129/f167 x:0 0 0 2024-04-25T02:08:59.326 INFO:tasks.workunit.client.0.smithi077.stdout:7/987: unlink d4/d13/d18/d24/d3f/d58/f7f 0 2024-04-25T02:08:59.330 INFO:tasks.workunit.client.0.smithi077.stdout:7/988: rmdir d4/d13/d18/d24/d3f/de9 39 2024-04-25T02:08:59.332 INFO:tasks.workunit.client.0.smithi077.stdout:0/998: dwrite d2/f6 [0,4194304] 0 2024-04-25T02:08:59.332 INFO:tasks.workunit.client.0.smithi077.stdout:0/999: fdatasync d2/d8/dad/d152/dee/f14b 0 2024-04-25T02:08:59.334 INFO:tasks.workunit.client.1.smithi112.stdout:0/173: mkdir da/d13/d23/d2b/d3d 0 2024-04-25T02:08:59.335 INFO:tasks.workunit.client.0.smithi077.stdout:7/989: dread d4/d13/d18/d2d/f100 [0,4194304] 0 2024-04-25T02:08:59.336 INFO:tasks.workunit.client.1.smithi112.stdout:1/116: unlink d7/d9/d1e/de/f11 0 2024-04-25T02:08:59.336 INFO:tasks.workunit.client.1.smithi112.stdout:1/117: creat d7/d9/f21 x:0 0 0 2024-04-25T02:08:59.336 INFO:tasks.workunit.client.1.smithi112.stdout:1/118: fsync d7/d9/f16 0 2024-04-25T02:08:59.337 INFO:tasks.workunit.client.0.smithi077.stdout:3/992: dread d0/f9 [0,4194304] 0 2024-04-25T02:08:59.337 INFO:tasks.workunit.client.0.smithi077.stdout:7/990: dread d4/d13/d18/fcd [0,4194304] 0 2024-04-25T02:08:59.337 INFO:tasks.workunit.client.0.smithi077.stdout:7/991: fdatasync d4/d13/d2c/f2e 0 2024-04-25T02:08:59.339 INFO:tasks.workunit.client.1.smithi112.stdout:8/144: rmdir d15/d26 39 2024-04-25T02:08:59.339 INFO:tasks.workunit.client.1.smithi112.stdout:8/145: creat d15/d17/d1a/f33 x:0 0 0 2024-04-25T02:08:59.341 INFO:tasks.workunit.client.0.smithi077.stdout:7/992: mkdir d4/dd2/d147 0 2024-04-25T02:08:59.342 INFO:tasks.workunit.client.1.smithi112.stdout:1/119: truncate d7/d9/f10 3888704 0 2024-04-25T02:08:59.348 INFO:tasks.workunit.client.1.smithi112.stdout:0/174: dread f2 [0,4194304] 0 2024-04-25T02:08:59.348 INFO:tasks.workunit.client.1.smithi112.stdout:8/146: chown d15/d17/f1e 5 1 2024-04-25T02:08:59.350 INFO:tasks.workunit.client.0.smithi077.stdout:7/993: rmdir d4/d13/d2c 39 2024-04-25T02:08:59.350 INFO:tasks.workunit.client.0.smithi077.stdout:7/994: read d4/d13/d66/f73 [3566018,43687] 0 2024-04-25T02:08:59.351 INFO:tasks.workunit.client.0.smithi077.stdout:7/995: write d4/d13/d2c/f118 [390316,95530] 0 2024-04-25T02:08:59.353 INFO:tasks.workunit.client.1.smithi112.stdout:1/120: creat d7/d9/d1e/f22 x:0 0 0 2024-04-25T02:08:59.353 INFO:tasks.workunit.client.1.smithi112.stdout:1/121: write d7/d9/f14 [454387,40124] 0 2024-04-25T02:08:59.355 INFO:tasks.workunit.client.1.smithi112.stdout:8/147: mknod d15/d17/d1a/c34 0 2024-04-25T02:08:59.355 INFO:tasks.workunit.client.1.smithi112.stdout:8/148: fdatasync d15/f28 0 2024-04-25T02:08:59.355 INFO:tasks.workunit.client.0.smithi077.stdout:3/993: dwrite d0/d40/f57 [8388608,4194304] 0 2024-04-25T02:08:59.357 INFO:tasks.workunit.client.1.smithi112.stdout:1/122: symlink d7/d9/d1f/l23 0 2024-04-25T02:08:59.358 INFO:tasks.workunit.client.1.smithi112.stdout:0/175: write da/f12 [5019317,13045] 0 2024-04-25T02:08:59.358 INFO:tasks.workunit.client.1.smithi112.stdout:0/176: dread - da/d13/d23/d2b/d24/f2c zero size 2024-04-25T02:08:59.361 INFO:tasks.workunit.client.1.smithi112.stdout:8/149: truncate d15/f18 3669037 0 2024-04-25T02:08:59.362 INFO:tasks.workunit.client.0.smithi077.stdout:3/994: symlink d0/d3e/d62/d6a/d6e/d15a/l168 0 2024-04-25T02:08:59.366 INFO:tasks.workunit.client.1.smithi112.stdout:1/123: rename d7/d9/f21 to d7/f24 0 2024-04-25T02:08:59.367 INFO:tasks.workunit.client.0.smithi077.stdout:3/995: write d0/d3e/d62/d6a/d6e/f85 [309289,10827] 0 2024-04-25T02:08:59.367 INFO:tasks.workunit.client.0.smithi077.stdout:3/996: write d0/dc5/f15b [693530,52426] 0 2024-04-25T02:08:59.367 INFO:tasks.workunit.client.0.smithi077.stdout:7/996: creat d4/d13/de8/d13a/f148 x:0 0 0 2024-04-25T02:08:59.370 INFO:tasks.workunit.client.1.smithi112.stdout:0/177: mknod da/d1d/d2e/c3e 0 2024-04-25T02:08:59.372 INFO:tasks.workunit.client.1.smithi112.stdout:0/178: write da/d13/d1e/f3b [202639,72504] 0 2024-04-25T02:08:59.372 INFO:tasks.workunit.client.1.smithi112.stdout:0/179: creat da/d13/d1e/f3f x:0 0 0 2024-04-25T02:08:59.373 INFO:tasks.workunit.client.1.smithi112.stdout:1/124: mkdir d7/d9/d1f/d25 0 2024-04-25T02:08:59.375 INFO:tasks.workunit.client.0.smithi077.stdout:3/997: dread d0/d2/f35 [0,4194304] 0 2024-04-25T02:08:59.376 INFO:tasks.workunit.client.0.smithi077.stdout:3/998: stat d0/d17/dd4/d14e 0 2024-04-25T02:08:59.377 INFO:tasks.workunit.client.1.smithi112.stdout:8/150: dwrite d15/d17/f31 [0,4194304] 0 2024-04-25T02:08:59.378 INFO:tasks.workunit.client.1.smithi112.stdout:1/125: mkdir d7/d9/d26 0 2024-04-25T02:08:59.378 INFO:tasks.workunit.client.1.smithi112.stdout:1/126: readlink d7/d9/d1f/l23 0 2024-04-25T02:08:59.378 INFO:tasks.workunit.client.1.smithi112.stdout:0/180: dread f2 [0,4194304] 0 2024-04-25T02:08:59.378 INFO:tasks.workunit.client.0.smithi077.stdout:3/999: dread d0/d3e/d42/d64/d88/fbd [0,4194304] 0 2024-04-25T02:08:59.381 INFO:tasks.workunit.client.1.smithi112.stdout:8/151: dread - d15/d17/d24/f27 zero size 2024-04-25T02:08:59.383 INFO:tasks.workunit.client.1.smithi112.stdout:1/127: creat d7/d9/d1e/de/f27 x:0 0 0 2024-04-25T02:08:59.383 INFO:tasks.workunit.client.1.smithi112.stdout:1/128: truncate d7/d9/d1e/de/f17 15921 0 2024-04-25T02:08:59.384 INFO:tasks.workunit.client.1.smithi112.stdout:0/181: truncate da/f10 1778598 0 2024-04-25T02:08:59.384 INFO:tasks.workunit.client.1.smithi112.stdout:8/152: rmdir d15/d26 39 2024-04-25T02:08:59.384 INFO:tasks.workunit.client.1.smithi112.stdout:8/153: chown d15/f30 2641163 1 2024-04-25T02:08:59.387 INFO:tasks.workunit.client.0.smithi077.stdout:7/997: dwrite d4/d13/d18/d24/d3f/d58/f52 [0,4194304] 0 2024-04-25T02:08:59.387 INFO:tasks.workunit.client.1.smithi112.stdout:1/129: unlink d7/d9/d1e/f1c 0 2024-04-25T02:08:59.388 INFO:tasks.workunit.client.1.smithi112.stdout:8/154: dread f6 [0,4194304] 0 2024-04-25T02:08:59.389 INFO:tasks.workunit.client.1.smithi112.stdout:1/130: dread d7/d9/d1e/de/f17 [0,4194304] 0 2024-04-25T02:08:59.391 INFO:tasks.workunit.client.1.smithi112.stdout:0/182: mkdir da/d1d/d2e/d40 0 2024-04-25T02:08:59.391 INFO:tasks.workunit.client.1.smithi112.stdout:0/183: readlink da/d13/d23/d2b/l36 0 2024-04-25T02:08:59.395 INFO:tasks.workunit.client.1.smithi112.stdout:8/155: mkdir d15/d35 0 2024-04-25T02:08:59.397 INFO:tasks.workunit.client.0.smithi077.stdout:7/998: symlink d4/d13/de8/d13a/l149 0 2024-04-25T02:08:59.400 INFO:tasks.workunit.client.1.smithi112.stdout:8/156: truncate f10 387609 0 2024-04-25T02:08:59.402 INFO:tasks.workunit.client.0.smithi077.stdout:7/999: symlink d4/d13/d18/d24/d3f/d58/d117/l14a 0 2024-04-25T02:08:59.403 INFO:tasks.workunit.client.1.smithi112.stdout:1/131: getdents d7/d9 0 2024-04-25T02:08:59.407 INFO:tasks.workunit.client.0.smithi077.stderr:+ rm -rf -- ./tmp.ZbkMo10vOc 2024-04-25T02:08:59.407 INFO:tasks.workunit.client.1.smithi112.stdout:0/184: dwrite da/d13/d23/d2b/d24/f2c [0,4194304] 0 2024-04-25T02:08:59.407 INFO:tasks.workunit.client.1.smithi112.stdout:0/185: chown da/d13/d23/d2b/f30 307303 1 2024-04-25T02:08:59.407 INFO:tasks.workunit.client.1.smithi112.stdout:0/186: readlink da/d13/d23/d2b/l38 0 2024-04-25T02:08:59.408 INFO:tasks.workunit.client.1.smithi112.stdout:1/132: mkdir d7/d9/d26/d28 0 2024-04-25T02:08:59.416 INFO:tasks.workunit.client.1.smithi112.stdout:8/157: rmdir d15 39 2024-04-25T02:08:59.418 INFO:tasks.workunit.client.1.smithi112.stdout:0/187: rmdir da/d13/d23/d2b/d3d 0 2024-04-25T02:08:59.421 INFO:tasks.workunit.client.1.smithi112.stdout:8/158: dread d15/d17/f23 [0,4194304] 0 2024-04-25T02:08:59.421 INFO:tasks.workunit.client.1.smithi112.stdout:8/159: write d15/f2c [1022137,48860] 0 2024-04-25T02:08:59.422 INFO:tasks.workunit.client.1.smithi112.stdout:1/133: symlink d7/d9/d1e/l29 0 2024-04-25T02:08:59.425 INFO:tasks.workunit.client.1.smithi112.stdout:0/188: rename da/d13/d23/d2b/f29 to da/d1d/d2e/d40/f41 0 2024-04-25T02:08:59.429 INFO:tasks.workunit.client.1.smithi112.stdout:8/160: creat d15/d17/d1a/f36 x:0 0 0 2024-04-25T02:08:59.434 INFO:tasks.workunit.client.1.smithi112.stdout:8/161: dread d15/d17/f23 [0,4194304] 0 2024-04-25T02:08:59.435 INFO:tasks.workunit.client.1.smithi112.stdout:0/189: symlink da/d1d/d2e/d40/l42 0 2024-04-25T02:08:59.443 INFO:tasks.workunit.client.1.smithi112.stdout:1/134: rmdir d7/d9/d1e 39 2024-04-25T02:08:59.444 INFO:tasks.workunit.client.1.smithi112.stdout:0/190: creat da/d1d/f43 x:0 0 0 2024-04-25T02:08:59.448 INFO:tasks.workunit.client.1.smithi112.stdout:1/135: symlink d7/d9/l2a 0 2024-04-25T02:08:59.448 INFO:tasks.workunit.client.1.smithi112.stdout:1/136: write d7/d9/f16 [429026,38793] 0 2024-04-25T02:08:59.453 INFO:tasks.workunit.client.1.smithi112.stdout:8/162: dwrite f10 [0,4194304] 0 2024-04-25T02:08:59.457 INFO:tasks.workunit.client.1.smithi112.stdout:8/163: mkdir d15/d26/d37 0 2024-04-25T02:08:59.457 INFO:tasks.workunit.client.1.smithi112.stdout:8/164: write d15/d26/f29 [454896,78819] 0 2024-04-25T02:08:59.460 INFO:tasks.workunit.client.1.smithi112.stdout:8/165: rename d15/d17/f22 to d15/d26/d37/f38 0 2024-04-25T02:08:59.460 INFO:tasks.workunit.client.1.smithi112.stdout:8/166: write fa [820371,70015] 0 2024-04-25T02:08:59.463 INFO:tasks.workunit.client.1.smithi112.stdout:8/167: symlink d15/l39 0 2024-04-25T02:08:59.463 INFO:tasks.workunit.client.1.smithi112.stdout:8/168: chown d15/d26/l2d 356 1 2024-04-25T02:08:59.467 INFO:tasks.workunit.client.1.smithi112.stdout:8/169: creat d15/d26/f3a x:0 0 0 2024-04-25T02:08:59.468 INFO:tasks.workunit.client.1.smithi112.stdout:8/170: write d15/d26/f29 [1114467,57897] 0 2024-04-25T02:08:59.468 INFO:tasks.workunit.client.1.smithi112.stdout:8/171: stat d15/d26/d37 0 2024-04-25T02:08:59.469 INFO:tasks.workunit.client.1.smithi112.stdout:0/191: dwrite da/f10 [0,4194304] 0 2024-04-25T02:08:59.471 INFO:tasks.workunit.client.1.smithi112.stdout:1/137: dwrite f2 [0,4194304] 0 2024-04-25T02:08:59.471 INFO:tasks.workunit.client.1.smithi112.stdout:1/138: write d7/d9/f1b [824486,78298] 0 2024-04-25T02:08:59.475 INFO:tasks.workunit.client.1.smithi112.stdout:0/192: mknod da/d1d/d2e/c44 0 2024-04-25T02:08:59.477 INFO:tasks.workunit.client.1.smithi112.stdout:1/139: mknod d7/d9/d1f/c2b 0 2024-04-25T02:08:59.479 INFO:tasks.workunit.client.1.smithi112.stdout:0/193: mkdir da/d13/d45 0 2024-04-25T02:08:59.479 INFO:tasks.workunit.client.1.smithi112.stdout:0/194: chown da/d1d/d2e/d40/l42 583374 1 2024-04-25T02:08:59.479 INFO:tasks.workunit.client.1.smithi112.stdout:0/195: creat da/f46 x:0 0 0 2024-04-25T02:08:59.481 INFO:tasks.workunit.client.1.smithi112.stdout:1/140: creat d7/f2c x:0 0 0 2024-04-25T02:08:59.481 INFO:tasks.workunit.client.1.smithi112.stdout:1/141: fdatasync d7/f2c 0 2024-04-25T02:08:59.481 INFO:tasks.workunit.client.1.smithi112.stdout:1/142: readlink d7/d9/d1e/l15 0 2024-04-25T02:08:59.481 INFO:tasks.workunit.client.1.smithi112.stdout:1/143: dread - d7/f2c zero size 2024-04-25T02:08:59.482 INFO:tasks.workunit.client.1.smithi112.stdout:8/172: getdents d15 0 2024-04-25T02:08:59.482 INFO:tasks.workunit.client.1.smithi112.stdout:8/173: write d15/d26/f2b [622368,5002] 0 2024-04-25T02:08:59.485 INFO:tasks.workunit.client.1.smithi112.stdout:1/144: mknod d7/c2d 0 2024-04-25T02:08:59.485 INFO:tasks.workunit.client.1.smithi112.stdout:1/145: rename d7/d9 to d7/d9/d2e 22 2024-04-25T02:08:59.485 INFO:tasks.workunit.client.1.smithi112.stdout:8/174: readlink d15/d17/l1f 0 2024-04-25T02:08:59.487 INFO:tasks.workunit.client.1.smithi112.stdout:1/146: truncate d7/d9/d1e/f12 638994 0 2024-04-25T02:08:59.487 INFO:tasks.workunit.client.1.smithi112.stdout:1/147: chown d7/d9/l2a 2 1 2024-04-25T02:08:59.487 INFO:tasks.workunit.client.1.smithi112.stdout:1/148: truncate d7/d9/d1e/f22 935421 0 2024-04-25T02:08:59.488 INFO:tasks.workunit.client.1.smithi112.stdout:0/196: read da/f32 [688398,101528] 0 2024-04-25T02:08:59.489 INFO:tasks.workunit.client.1.smithi112.stdout:0/197: symlink da/d13/d1e/l47 0 2024-04-25T02:08:59.489 INFO:tasks.workunit.client.1.smithi112.stdout:0/198: fsync da/f26 0 2024-04-25T02:08:59.489 INFO:tasks.workunit.client.1.smithi112.stdout:0/199: dread - da/d1d/f43 zero size 2024-04-25T02:08:59.489 INFO:tasks.workunit.client.1.smithi112.stdout:0/200: truncate da/d13/d1e/f3c 313471 0 2024-04-25T02:08:59.489 INFO:tasks.workunit.client.1.smithi112.stdout:0/201: dread - da/d13/d1e/f3f zero size 2024-04-25T02:08:59.492 INFO:tasks.workunit.client.1.smithi112.stdout:8/175: rename fb to d15/d17/f3b 0 2024-04-25T02:08:59.495 INFO:tasks.workunit.client.1.smithi112.stdout:0/202: getdents da/d13/d23 0 2024-04-25T02:08:59.496 INFO:tasks.workunit.client.1.smithi112.stdout:1/149: rename d7/d9/l19 to d7/d9/d1e/l2f 0 2024-04-25T02:08:59.501 INFO:tasks.workunit.client.1.smithi112.stdout:0/203: rename da/d13/f15 to da/d13/d23/d2b/d24/f48 0 2024-04-25T02:08:59.504 INFO:tasks.workunit.client.1.smithi112.stdout:1/150: creat d7/d9/d1f/d25/f30 x:0 0 0 2024-04-25T02:08:59.507 INFO:tasks.workunit.client.1.smithi112.stdout:8/176: symlink d15/d17/l3c 0 2024-04-25T02:08:59.507 INFO:tasks.workunit.client.1.smithi112.stdout:8/177: dread - d15/d17/d1a/f2f zero size 2024-04-25T02:08:59.509 INFO:tasks.workunit.client.1.smithi112.stdout:0/204: truncate da/d13/d23/d2b/d24/f48 1913528 0 2024-04-25T02:08:59.509 INFO:tasks.workunit.client.1.smithi112.stdout:0/205: fsync da/d13/d1e/f3c 0 2024-04-25T02:08:59.512 INFO:tasks.workunit.client.1.smithi112.stdout:8/178: symlink d15/d17/d1a/l3d 0 2024-04-25T02:08:59.516 INFO:tasks.workunit.client.1.smithi112.stdout:0/206: mkdir da/d1d/d2e/d40/d49 0 2024-04-25T02:08:59.518 INFO:tasks.workunit.client.1.smithi112.stdout:1/151: dwrite d7/f24 [0,4194304] 0 2024-04-25T02:08:59.519 INFO:tasks.workunit.client.1.smithi112.stdout:8/179: fdatasync d15/f2c 0 2024-04-25T02:08:59.520 INFO:tasks.workunit.client.1.smithi112.stdout:0/207: getdents da/d13/d23/d2b 0 2024-04-25T02:08:59.526 INFO:tasks.workunit.client.1.smithi112.stdout:1/152: rename d7/d9/lb to d7/d9/d1f/l31 0 2024-04-25T02:08:59.526 INFO:tasks.workunit.client.1.smithi112.stdout:1/153: truncate d7/f2c 350633 0 2024-04-25T02:08:59.527 INFO:tasks.workunit.client.1.smithi112.stdout:1/154: dread d7/f2c [0,4194304] 0 2024-04-25T02:08:59.528 INFO:tasks.workunit.client.1.smithi112.stdout:0/208: mknod da/c4a 0 2024-04-25T02:08:59.530 INFO:tasks.workunit.client.1.smithi112.stdout:8/180: rename d15/d17/l3c to d15/l3e 0 2024-04-25T02:08:59.531 INFO:tasks.workunit.client.1.smithi112.stdout:0/209: rmdir da/d13/d23 39 2024-04-25T02:08:59.532 INFO:tasks.workunit.client.1.smithi112.stdout:0/210: chown l9 131 1 2024-04-25T02:08:59.533 INFO:tasks.workunit.client.1.smithi112.stdout:0/211: mknod da/d13/d1e/c4b 0 2024-04-25T02:08:59.534 INFO:tasks.workunit.client.1.smithi112.stdout:1/155: dread d7/d9/f1b [0,4194304] 0 2024-04-25T02:08:59.534 INFO:tasks.workunit.client.1.smithi112.stdout:1/156: dread d7/d9/d1e/f22 [0,4194304] 0 2024-04-25T02:08:59.537 INFO:tasks.workunit.client.1.smithi112.stdout:0/212: mknod da/c4c 0 2024-04-25T02:08:59.539 INFO:tasks.workunit.client.1.smithi112.stdout:1/157: mkdir d7/d9/d26/d28/d32 0 2024-04-25T02:08:59.548 INFO:tasks.workunit.client.1.smithi112.stdout:8/181: dwrite d15/d26/f3a [0,4194304] 0 2024-04-25T02:08:59.576 INFO:tasks.workunit.client.1.smithi112.stdout:0/213: dwrite da/d13/f35 [0,4194304] 0 2024-04-25T02:08:59.576 INFO:tasks.workunit.client.1.smithi112.stdout:1/158: dwrite d7/d9/f10 [0,4194304] 0 2024-04-25T02:08:59.576 INFO:tasks.workunit.client.1.smithi112.stdout:8/182: dwrite d15/d17/d1a/f1d [0,4194304] 0 2024-04-25T02:08:59.580 INFO:tasks.workunit.client.1.smithi112.stdout:0/214: mkdir da/d1d/d2e/d40/d49/d4d 0 2024-04-25T02:08:59.581 INFO:tasks.workunit.client.1.smithi112.stdout:1/159: symlink d7/d9/d1e/l33 0 2024-04-25T02:08:59.581 INFO:tasks.workunit.client.1.smithi112.stdout:1/160: stat d7/d9/fa 0 2024-04-25T02:08:59.586 INFO:tasks.workunit.client.1.smithi112.stdout:0/215: rename da/d13/d1e/f21 to da/d13/d1e/f4e 0 2024-04-25T02:08:59.588 INFO:tasks.workunit.client.1.smithi112.stdout:1/161: link d7/d9/d1e/cf d7/d9/d26/d28/d32/c34 0 2024-04-25T02:08:59.588 INFO:tasks.workunit.client.1.smithi112.stdout:1/162: write d7/d9/d1e/de/f17 [1121687,57379] 0 2024-04-25T02:08:59.593 INFO:tasks.workunit.client.1.smithi112.stdout:1/163: link d7/d9/d1e/cf d7/d9/d1e/de/c35 0 2024-04-25T02:08:59.594 INFO:tasks.workunit.client.1.smithi112.stdout:0/216: dread da/d13/d23/d2b/d24/f33 [0,4194304] 0 2024-04-25T02:08:59.595 INFO:tasks.workunit.client.1.smithi112.stdout:0/217: fsync da/d13/d1e/f3c 0 2024-04-25T02:08:59.595 INFO:tasks.workunit.client.1.smithi112.stdout:0/218: write da/f46 [974028,42451] 0 2024-04-25T02:08:59.595 INFO:tasks.workunit.client.1.smithi112.stdout:0/219: write f2 [5563747,110105] 0 2024-04-25T02:08:59.596 INFO:tasks.workunit.client.1.smithi112.stdout:8/183: truncate fa 1451894 0 2024-04-25T02:08:59.596 INFO:tasks.workunit.client.1.smithi112.stdout:8/184: write d15/d26/f2b [923149,29177] 0 2024-04-25T02:08:59.597 INFO:tasks.workunit.client.1.smithi112.stdout:8/185: chown fa 1572661 1 2024-04-25T02:08:59.597 INFO:tasks.workunit.client.1.smithi112.stdout:8/186: chown d15/d17/f31 49262455 1 2024-04-25T02:08:59.599 INFO:tasks.workunit.client.1.smithi112.stdout:1/164: unlink d7/c1d 0 2024-04-25T02:08:59.604 INFO:tasks.workunit.client.1.smithi112.stdout:8/187: rename d15/d17/d1a/f20 to d15/d26/d37/f3f 0 2024-04-25T02:08:59.604 INFO:tasks.workunit.client.1.smithi112.stdout:8/188: truncate d15/d26/f29 1764774 0 2024-04-25T02:08:59.613 INFO:tasks.workunit.client.1.smithi112.stdout:0/220: dwrite da/f10 [0,4194304] 0 2024-04-25T02:08:59.613 INFO:tasks.workunit.client.1.smithi112.stdout:0/221: chown da/f32 4605103 1 2024-04-25T02:08:59.615 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:59 smithi112 ceph-mon[33313]: pgmap v259: 65 pgs: 65 active+clean; 2.1 GiB data, 7.9 GiB used, 529 GiB / 536 GiB avail; 203 MiB/s rd, 255 MiB/s wr, 395 op/s 2024-04-25T02:08:59.616 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:59 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:08:59.616 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:08:59 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:08:59.617 INFO:tasks.workunit.client.1.smithi112.stdout:0/222: mkdir da/d1d/d2e/d40/d49/d4f 0 2024-04-25T02:08:59.617 INFO:tasks.workunit.client.1.smithi112.stdout:0/223: readlink da/d13/d23/d2b/l38 0 2024-04-25T02:08:59.617 INFO:tasks.workunit.client.1.smithi112.stdout:0/224: dread - da/d1d/d2e/d40/f41 zero size 2024-04-25T02:08:59.618 INFO:tasks.workunit.client.1.smithi112.stdout:0/225: write f2 [5513130,116409] 0 2024-04-25T02:08:59.626 INFO:tasks.workunit.client.1.smithi112.stdout:1/165: dwrite d7/d9/f1b [0,4194304] 0 2024-04-25T02:08:59.632 INFO:tasks.workunit.client.1.smithi112.stdout:0/226: dwrite da/d13/d23/d2b/f30 [0,4194304] 0 2024-04-25T02:08:59.632 INFO:tasks.workunit.client.1.smithi112.stdout:0/227: chown da/f46 269177 1 2024-04-25T02:08:59.639 INFO:tasks.workunit.client.1.smithi112.stdout:0/228: rename da/f12 to da/d13/d23/d2b/f50 0 2024-04-25T02:08:59.641 INFO:tasks.workunit.client.1.smithi112.stdout:0/229: creat da/d1d/d2e/d40/d49/d4f/f51 x:0 0 0 2024-04-25T02:08:59.641 INFO:tasks.workunit.client.1.smithi112.stdout:0/230: creat da/f52 x:0 0 0 2024-04-25T02:08:59.643 INFO:tasks.workunit.client.1.smithi112.stdout:1/166: dwrite f4 [0,4194304] 0 2024-04-25T02:08:59.647 INFO:tasks.workunit.client.1.smithi112.stdout:1/167: creat d7/d9/d1f/f36 x:0 0 0 2024-04-25T02:08:59.649 INFO:tasks.workunit.client.1.smithi112.stdout:0/231: rmdir da/d13/d1e 39 2024-04-25T02:08:59.650 INFO:tasks.workunit.client.1.smithi112.stdout:0/232: truncate da/f52 207208 0 2024-04-25T02:08:59.650 INFO:tasks.workunit.client.1.smithi112.stdout:0/233: chown da/c4a 12189 1 2024-04-25T02:08:59.651 INFO:tasks.workunit.client.1.smithi112.stdout:1/168: creat d7/d9/d26/f37 x:0 0 0 2024-04-25T02:08:59.652 INFO:tasks.workunit.client.1.smithi112.stdout:0/234: link da/d1d/d2e/c44 da/d1d/d2e/d40/d49/d4f/c53 0 2024-04-25T02:08:59.655 INFO:tasks.workunit.client.1.smithi112.stdout:1/169: rename d7/d9/d1e/l20 to d7/d9/d26/d28/d32/l38 0 2024-04-25T02:08:59.662 INFO:tasks.workunit.client.1.smithi112.stdout:0/235: dread da/d13/d23/d2b/d24/f2c [0,4194304] 0 2024-04-25T02:08:59.665 INFO:tasks.workunit.client.1.smithi112.stdout:1/170: write d7/d9/fa [1959781,113777] 0 2024-04-25T02:08:59.674 INFO:tasks.workunit.client.1.smithi112.stdout:0/236: truncate da/f18 1043329 0 2024-04-25T02:08:59.679 INFO:tasks.workunit.client.1.smithi112.stdout:0/237: fsync da/f18 0 2024-04-25T02:08:59.679 INFO:tasks.workunit.client.1.smithi112.stdout:0/238: stat da/f18 0 2024-04-25T02:08:59.682 INFO:tasks.workunit.client.1.smithi112.stdout:0/239: mknod da/d1d/d2e/d40/c54 0 2024-04-25T02:08:59.684 INFO:tasks.workunit.client.1.smithi112.stdout:1/171: dwrite d7/f24 [0,4194304] 0 2024-04-25T02:08:59.685 INFO:tasks.workunit.client.1.smithi112.stdout:1/172: chown d7/d9/f16 3260 1 2024-04-25T02:08:59.685 INFO:tasks.workunit.client.1.smithi112.stdout:1/173: chown d7/d9/d1e/f22 1013 1 2024-04-25T02:08:59.685 INFO:tasks.workunit.client.1.smithi112.stdout:1/174: fdatasync f2 0 2024-04-25T02:08:59.685 INFO:tasks.workunit.client.1.smithi112.stdout:1/175: readlink d7/d9/d1e/l15 0 2024-04-25T02:08:59.685 INFO:tasks.workunit.client.1.smithi112.stdout:1/176: fdatasync d7/f24 0 2024-04-25T02:08:59.685 INFO:tasks.workunit.client.1.smithi112.stdout:1/177: chown d7/d9/d1e/de/c35 2 1 2024-04-25T02:08:59.685 INFO:tasks.workunit.client.1.smithi112.stdout:1/178: getdents d7/d9/d26/d28/d32 0 2024-04-25T02:08:59.687 INFO:tasks.workunit.client.1.smithi112.stdout:1/179: getdents d7/d9/d1f/d25 0 2024-04-25T02:08:59.689 INFO:tasks.workunit.client.1.smithi112.stdout:1/180: read d7/d9/f16 [904000,103427] 0 2024-04-25T02:08:59.689 INFO:tasks.workunit.client.1.smithi112.stdout:1/181: write d7/d9/d1e/de/f17 [1135520,17112] 0 2024-04-25T02:08:59.691 INFO:tasks.workunit.client.1.smithi112.stdout:1/182: unlink d7/d9/d1e/f22 0 2024-04-25T02:08:59.691 INFO:tasks.workunit.client.1.smithi112.stdout:0/240: dread f2 [0,4194304] 0 2024-04-25T02:08:59.691 INFO:tasks.workunit.client.1.smithi112.stdout:0/241: stat da/d13/d1e/f3f 0 2024-04-25T02:08:59.691 INFO:tasks.workunit.client.1.smithi112.stdout:0/242: chown da/d13/f35 9 1 2024-04-25T02:08:59.693 INFO:tasks.workunit.client.1.smithi112.stdout:1/183: mkdir d7/d9/d1f/d25/d39 0 2024-04-25T02:08:59.693 INFO:tasks.workunit.client.1.smithi112.stdout:1/184: chown d7/d9/d26/d28/d32/l38 22358168 1 2024-04-25T02:08:59.694 INFO:tasks.workunit.client.1.smithi112.stdout:0/243: link da/d13/d23/d2b/d24/f33 da/d13/d23/d2b/d24/f55 0 2024-04-25T02:08:59.694 INFO:tasks.workunit.client.1.smithi112.stdout:0/244: stat da/f32 0 2024-04-25T02:08:59.695 INFO:tasks.workunit.client.1.smithi112.stdout:1/185: mknod d7/d9/d1f/d25/c3a 0 2024-04-25T02:08:59.696 INFO:tasks.workunit.client.1.smithi112.stdout:0/245: rmdir da/d13/d23/d2b 39 2024-04-25T02:08:59.699 INFO:tasks.workunit.client.1.smithi112.stdout:0/246: rename da/l1c to da/d1d/d2e/d40/d49/d4f/l56 0 2024-04-25T02:08:59.707 INFO:tasks.workunit.client.1.smithi112.stdout:0/247: dread da/d13/d23/d2b/f30 [0,4194304] 0 2024-04-25T02:08:59.709 INFO:tasks.workunit.client.1.smithi112.stdout:0/248: truncate da/d13/d23/d2b/d24/f2c 2770624 0 2024-04-25T02:08:59.715 INFO:tasks.workunit.client.1.smithi112.stdout:1/186: dwrite f4 [4194304,4194304] 0 2024-04-25T02:08:59.715 INFO:tasks.workunit.client.1.smithi112.stdout:1/187: chown d7/d9/d1e/f1a 3 1 2024-04-25T02:08:59.716 INFO:tasks.workunit.client.1.smithi112.stdout:0/249: write da/d13/d23/d2b/d24/f33 [1179509,116919] 0 2024-04-25T02:08:59.717 INFO:tasks.workunit.client.1.smithi112.stdout:0/250: chown da/d1d/d2e/d40/c54 108 1 2024-04-25T02:08:59.720 INFO:tasks.workunit.client.1.smithi112.stdout:1/188: rename d7/d9/f14 to d7/d9/d1e/de/f3b 0 2024-04-25T02:08:59.725 INFO:tasks.workunit.client.1.smithi112.stdout:0/251: rmdir da/d1d/d2e/d40/d49/d4d 0 2024-04-25T02:08:59.726 INFO:tasks.workunit.client.1.smithi112.stdout:0/252: chown da/d13/d23 1542926 1 2024-04-25T02:08:59.741 INFO:tasks.workunit.client.1.smithi112.stdout:0/253: dwrite da/d1d/d2e/d40/f41 [0,4194304] 0 2024-04-25T02:08:59.742 INFO:tasks.workunit.client.1.smithi112.stdout:0/254: chown da/d1d 326448497 1 2024-04-25T02:08:59.746 INFO:tasks.workunit.client.1.smithi112.stdout:0/255: symlink da/d1d/d2e/d40/l57 0 2024-04-25T02:08:59.764 INFO:tasks.workunit.client.1.smithi112.stdout:0/256: dwrite da/d13/d23/d2b/d24/f55 [0,4194304] 0 2024-04-25T02:08:59.764 INFO:tasks.workunit.client.1.smithi112.stdout:0/257: truncate da/d13/f35 4976743 0 2024-04-25T02:08:59.764 INFO:tasks.workunit.client.1.smithi112.stdout:0/258: stat da/d1d/d2e/c3e 0 2024-04-25T02:08:59.765 INFO:tasks.workunit.client.1.smithi112.stdout:0/259: unlink da/d1d/d2e/d40/d49/d4f/c53 0 2024-04-25T02:08:59.780 INFO:tasks.workunit.client.1.smithi112.stdout:0/260: dwrite da/d1d/d2e/d40/f41 [0,4194304] 0 2024-04-25T02:08:59.893 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:59 smithi077 ceph-mon[26330]: pgmap v259: 65 pgs: 65 active+clean; 2.1 GiB data, 7.9 GiB used, 529 GiB / 536 GiB avail; 203 MiB/s rd, 255 MiB/s wr, 395 op/s 2024-04-25T02:08:59.893 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:59 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:08:59.893 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:08:59 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:09:00.502 INFO:tasks.workunit.client.1.smithi112.stdout:7/47: sync 2024-04-25T02:09:00.502 INFO:tasks.workunit.client.1.smithi112.stdout:6/139: sync 2024-04-25T02:09:00.502 INFO:tasks.workunit.client.1.smithi112.stdout:8/189: sync 2024-04-25T02:09:00.503 INFO:tasks.workunit.client.1.smithi112.stdout:5/121: sync 2024-04-25T02:09:00.503 INFO:tasks.workunit.client.1.smithi112.stdout:3/72: sync 2024-04-25T02:09:00.503 INFO:tasks.workunit.client.1.smithi112.stdout:3/73: readlink l11 0 2024-04-25T02:09:00.503 INFO:tasks.workunit.client.1.smithi112.stdout:6/140: chown d0/d2/d4/dd/c21 174 1 2024-04-25T02:09:00.503 INFO:tasks.workunit.client.1.smithi112.stdout:2/36: sync 2024-04-25T02:09:00.503 INFO:tasks.workunit.client.1.smithi112.stdout:1/189: sync 2024-04-25T02:09:00.503 INFO:tasks.workunit.client.1.smithi112.stdout:0/261: sync 2024-04-25T02:09:00.503 INFO:tasks.workunit.client.1.smithi112.stdout:9/79: sync 2024-04-25T02:09:00.503 INFO:tasks.workunit.client.1.smithi112.stdout:1/190: dread - d7/d9/d1f/d25/f30 zero size 2024-04-25T02:09:00.503 INFO:tasks.workunit.client.1.smithi112.stdout:4/37: sync 2024-04-25T02:09:00.504 INFO:tasks.workunit.client.1.smithi112.stdout:4/38: readlink - no filename 2024-04-25T02:09:00.507 INFO:tasks.workunit.client.1.smithi112.stdout:5/122: rename d1/f15 to d1/d2/f2d 0 2024-04-25T02:09:00.507 INFO:tasks.workunit.client.1.smithi112.stdout:5/123: truncate d1/d2/d4/f2c 680386 0 2024-04-25T02:09:00.508 INFO:tasks.workunit.client.1.smithi112.stdout:8/190: mkdir d15/d40 0 2024-04-25T02:09:00.511 INFO:tasks.workunit.client.1.smithi112.stdout:7/48: mkdir d7/dd 0 2024-04-25T02:09:00.511 INFO:tasks.workunit.client.1.smithi112.stdout:7/49: getdents d7/dd 0 2024-04-25T02:09:00.512 INFO:tasks.workunit.client.1.smithi112.stdout:2/37: dread d3/f9 [0,4194304] 0 2024-04-25T02:09:00.513 INFO:tasks.workunit.client.1.smithi112.stdout:6/141: mkdir d0/d32 0 2024-04-25T02:09:00.517 INFO:tasks.workunit.client.1.smithi112.stdout:1/191: creat d7/d9/d26/d28/f3c x:0 0 0 2024-04-25T02:09:00.520 INFO:tasks.workunit.client.1.smithi112.stdout:5/124: symlink d1/d2/d4/l2e 0 2024-04-25T02:09:00.522 INFO:tasks.workunit.client.1.smithi112.stdout:7/50: mkdir d7/dd/de 0 2024-04-25T02:09:00.523 INFO:tasks.workunit.client.1.smithi112.stdout:3/74: dwrite d12/f14 [0,4194304] 0 2024-04-25T02:09:00.523 INFO:tasks.workunit.client.1.smithi112.stdout:2/38: dread f1 [0,4194304] 0 2024-04-25T02:09:00.525 INFO:tasks.workunit.client.1.smithi112.stdout:6/142: dread d0/d2/d4/f5 [0,4194304] 0 2024-04-25T02:09:00.526 INFO:tasks.workunit.client.1.smithi112.stdout:6/143: dread - d0/d2/d4/dd/f26 zero size 2024-04-25T02:09:00.526 INFO:tasks.workunit.client.1.smithi112.stdout:6/144: fsync d0/f27 0 2024-04-25T02:09:00.526 INFO:tasks.workunit.client.1.smithi112.stdout:6/145: write d0/d2/f15 [1062905,2694] 0 2024-04-25T02:09:00.526 INFO:tasks.workunit.client.1.smithi112.stdout:1/192: truncate d7/d9/d1e/f1a 3140499 0 2024-04-25T02:09:00.526 INFO:tasks.workunit.client.1.smithi112.stdout:1/193: chown d7/d9/f1b 114706272 1 2024-04-25T02:09:00.527 INFO:tasks.workunit.client.1.smithi112.stdout:4/39: getdents d2 0 2024-04-25T02:09:00.529 INFO:tasks.workunit.client.1.smithi112.stdout:5/125: symlink d1/d2/l2f 0 2024-04-25T02:09:00.529 INFO:tasks.workunit.client.1.smithi112.stdout:5/126: readlink d1/d2/d4/la 0 2024-04-25T02:09:00.530 INFO:tasks.workunit.client.1.smithi112.stdout:8/191: mkdir d15/d17/d41 0 2024-04-25T02:09:00.531 INFO:tasks.workunit.client.1.smithi112.stdout:7/51: creat d7/dd/ff x:0 0 0 2024-04-25T02:09:00.531 INFO:tasks.workunit.client.1.smithi112.stdout:7/52: chown d7/f8 1656253 1 2024-04-25T02:09:00.533 INFO:tasks.workunit.client.1.smithi112.stdout:3/75: creat d12/f19 x:0 0 0 2024-04-25T02:09:00.535 INFO:tasks.workunit.client.1.smithi112.stdout:2/39: mkdir d3/de/df 0 2024-04-25T02:09:00.537 INFO:tasks.workunit.client.1.smithi112.stdout:6/146: truncate d0/d2/d4/f5 7356413 0 2024-04-25T02:09:00.537 INFO:tasks.workunit.client.1.smithi112.stdout:6/147: creat d0/d2/d2c/f33 x:0 0 0 2024-04-25T02:09:00.539 INFO:tasks.workunit.client.1.smithi112.stdout:5/127: dread d1/d2/d4/ff [0,4194304] 0 2024-04-25T02:09:00.540 INFO:tasks.workunit.client.1.smithi112.stdout:1/194: link d7/d9/d1e/l33 d7/l3d 0 2024-04-25T02:09:00.540 INFO:tasks.workunit.client.1.smithi112.stdout:1/195: chown d7/d9/d26/d28/d32/c34 38 1 2024-04-25T02:09:00.540 INFO:tasks.workunit.client.1.smithi112.stdout:1/196: creat d7/d9/d1f/f3e x:0 0 0 2024-04-25T02:09:00.540 INFO:tasks.workunit.client.1.smithi112.stdout:1/197: fsync d7/f24 0 2024-04-25T02:09:00.547 INFO:tasks.workunit.client.1.smithi112.stdout:4/40: creat d2/fc x:0 0 0 2024-04-25T02:09:00.548 INFO:tasks.workunit.client.1.smithi112.stdout:8/192: link f10 d15/f42 0 2024-04-25T02:09:00.548 INFO:tasks.workunit.client.1.smithi112.stdout:8/193: chown d15/d17/d41 398 1 2024-04-25T02:09:00.548 INFO:tasks.workunit.client.1.smithi112.stdout:8/194: chown d15/f42 83148513 1 2024-04-25T02:09:00.553 INFO:tasks.workunit.client.1.smithi112.stdout:7/53: rmdir d7/dd/de 0 2024-04-25T02:09:00.554 INFO:tasks.workunit.client.1.smithi112.stdout:7/54: creat d7/dd/f10 x:0 0 0 2024-04-25T02:09:00.557 INFO:tasks.workunit.client.1.smithi112.stdout:2/40: unlink c2 0 2024-04-25T02:09:00.563 INFO:tasks.workunit.client.1.smithi112.stdout:6/148: creat d0/d2/d4/d28/f34 x:0 0 0 2024-04-25T02:09:00.564 INFO:tasks.workunit.client.1.smithi112.stdout:2/41: write d3/f9 [1682832,123904] 0 2024-04-25T02:09:00.569 INFO:tasks.workunit.client.1.smithi112.stdout:8/195: truncate f7 5524673 0 2024-04-25T02:09:00.571 INFO:tasks.workunit.client.1.smithi112.stdout:3/76: dwrite f5 [0,4194304] 0 2024-04-25T02:09:00.572 INFO:tasks.workunit.client.1.smithi112.stdout:9/80: dwrite d1/f1c [4194304,4194304] 0 2024-04-25T02:09:00.572 INFO:tasks.workunit.client.1.smithi112.stdout:7/55: mknod d7/dd/c11 0 2024-04-25T02:09:00.572 INFO:tasks.workunit.client.1.smithi112.stdout:4/41: dwrite d2/fc [0,4194304] 0 2024-04-25T02:09:00.575 INFO:tasks.workunit.client.1.smithi112.stdout:6/149: mknod d0/d2/d4/c35 0 2024-04-25T02:09:00.581 INFO:tasks.workunit.client.1.smithi112.stdout:3/77: rmdir d12/d13/d17 0 2024-04-25T02:09:00.583 INFO:tasks.workunit.client.1.smithi112.stdout:5/128: dwrite d1/d2/d4/d1d/f2a [0,4194304] 0 2024-04-25T02:09:00.583 INFO:tasks.workunit.client.1.smithi112.stdout:9/81: dread d1/f1c [0,4194304] 0 2024-04-25T02:09:00.584 INFO:tasks.workunit.client.1.smithi112.stdout:1/198: dwrite f6 [0,4194304] 0 2024-04-25T02:09:00.593 INFO:tasks.workunit.client.1.smithi112.stdout:6/150: mkdir d0/d36 0 2024-04-25T02:09:00.598 INFO:tasks.workunit.client.1.smithi112.stdout:1/199: dread d7/d9/d1e/f1a [0,4194304] 0 2024-04-25T02:09:00.598 INFO:tasks.workunit.client.1.smithi112.stdout:3/78: mknod d12/d13/c1a 0 2024-04-25T02:09:00.599 INFO:tasks.workunit.client.1.smithi112.stdout:3/79: chown lb 11 1 2024-04-25T02:09:00.599 INFO:tasks.workunit.client.1.smithi112.stdout:3/80: dread - d12/f19 zero size 2024-04-25T02:09:00.599 INFO:tasks.workunit.client.1.smithi112.stdout:3/81: chown lb 53558971 1 2024-04-25T02:09:00.599 INFO:tasks.workunit.client.1.smithi112.stdout:7/56: dwrite d7/dd/ff [0,4194304] 0 2024-04-25T02:09:00.599 INFO:tasks.workunit.client.1.smithi112.stdout:5/129: dread d1/d16/f19 [0,4194304] 0 2024-04-25T02:09:00.608 INFO:tasks.workunit.client.1.smithi112.stdout:5/130: dread d1/f6 [0,4194304] 0 2024-04-25T02:09:00.609 INFO:tasks.workunit.client.1.smithi112.stdout:4/42: rmdir d2 39 2024-04-25T02:09:00.615 INFO:tasks.workunit.client.1.smithi112.stdout:9/82: truncate d1/f5 2931360 0 2024-04-25T02:09:00.617 INFO:tasks.workunit.client.1.smithi112.stdout:5/131: mknod d1/d2/d28/c30 0 2024-04-25T02:09:00.618 INFO:tasks.workunit.client.1.smithi112.stdout:4/43: creat d2/fd x:0 0 0 2024-04-25T02:09:00.620 INFO:tasks.workunit.client.1.smithi112.stdout:3/82: write fd [2157134,29578] 0 2024-04-25T02:09:00.620 INFO:tasks.workunit.client.1.smithi112.stdout:3/83: write fd [152960,31288] 0 2024-04-25T02:09:00.620 INFO:tasks.workunit.client.1.smithi112.stdout:3/84: write fd [165402,125382] 0 2024-04-25T02:09:00.620 INFO:tasks.workunit.client.1.smithi112.stdout:2/42: dwrite d3/f9 [4194304,4194304] 0 2024-04-25T02:09:00.624 INFO:tasks.workunit.client.1.smithi112.stdout:1/200: dwrite d7/d9/d1f/d25/f30 [0,4194304] 0 2024-04-25T02:09:00.624 INFO:tasks.workunit.client.1.smithi112.stdout:7/57: dwrite d7/fc [0,4194304] 0 2024-04-25T02:09:00.624 INFO:tasks.workunit.client.1.smithi112.stdout:7/58: write d7/dd/f10 [63889,30907] 0 2024-04-25T02:09:00.624 INFO:tasks.workunit.client.1.smithi112.stdout:7/59: fdatasync d7/dd/ff 0 2024-04-25T02:09:00.624 INFO:tasks.workunit.client.1.smithi112.stdout:7/60: readlink - no filename 2024-04-25T02:09:00.624 INFO:tasks.workunit.client.1.smithi112.stdout:7/61: fsync d7/f8 0 2024-04-25T02:09:00.625 INFO:tasks.workunit.client.1.smithi112.stdout:7/62: chown d7 6965 1 2024-04-25T02:09:00.626 INFO:tasks.workunit.client.1.smithi112.stdout:5/132: creat d1/d2/f31 x:0 0 0 2024-04-25T02:09:00.626 INFO:tasks.workunit.client.1.smithi112.stdout:5/133: chown d1/d2/d4/d1d/l1f 0 1 2024-04-25T02:09:00.627 INFO:tasks.workunit.client.1.smithi112.stdout:4/44: stat d2/c3 0 2024-04-25T02:09:00.635 INFO:tasks.workunit.client.1.smithi112.stdout:9/83: write d1/fd [739742,22342] 0 2024-04-25T02:09:00.636 INFO:tasks.workunit.client.1.smithi112.stdout:1/201: mkdir d7/d9/d26/d28/d3f 0 2024-04-25T02:09:00.637 INFO:tasks.workunit.client.1.smithi112.stdout:1/202: chown d7/d9/d1e/de/c35 605823 1 2024-04-25T02:09:00.637 INFO:tasks.workunit.client.1.smithi112.stdout:1/203: chown d7/d9/f10 24711 1 2024-04-25T02:09:00.637 INFO:tasks.workunit.client.1.smithi112.stdout:1/204: dread - d7/d9/d26/f37 zero size 2024-04-25T02:09:00.639 INFO:tasks.workunit.client.1.smithi112.stdout:5/134: mknod d1/d2/d28/c32 0 2024-04-25T02:09:00.640 INFO:tasks.workunit.client.1.smithi112.stdout:4/45: creat d2/fe x:0 0 0 2024-04-25T02:09:00.641 INFO:tasks.workunit.client.1.smithi112.stdout:9/84: chown d1/d13/f18 1684 1 2024-04-25T02:09:00.641 INFO:tasks.workunit.client.1.smithi112.stdout:9/85: truncate d1/d13/f18 907818 0 2024-04-25T02:09:00.642 INFO:tasks.workunit.client.1.smithi112.stdout:1/205: mkdir d7/d9/d1e/d40 0 2024-04-25T02:09:00.644 INFO:tasks.workunit.client.1.smithi112.stdout:5/135: truncate d1/f8 1908058 0 2024-04-25T02:09:00.644 INFO:tasks.workunit.client.1.smithi112.stdout:5/136: truncate d1/d2/d4/f2c 1288024 0 2024-04-25T02:09:00.647 INFO:tasks.workunit.client.1.smithi112.stdout:3/85: dwrite fe [0,4194304] 0 2024-04-25T02:09:00.647 INFO:tasks.workunit.client.1.smithi112.stdout:3/86: write fd [3841396,24765] 0 2024-04-25T02:09:00.648 INFO:tasks.workunit.client.1.smithi112.stdout:2/43: dwrite d3/f4 [0,4194304] 0 2024-04-25T02:09:00.648 INFO:tasks.workunit.client.1.smithi112.stdout:2/44: write d3/da/fb [220798,95846] 0 2024-04-25T02:09:00.648 INFO:tasks.workunit.client.1.smithi112.stdout:9/86: creat d1/d13/f1d x:0 0 0 2024-04-25T02:09:00.649 INFO:tasks.workunit.client.1.smithi112.stdout:4/46: dread d2/fb [0,4194304] 0 2024-04-25T02:09:00.649 INFO:tasks.workunit.client.1.smithi112.stdout:4/47: fsync d2/fc 0 2024-04-25T02:09:00.649 INFO:tasks.workunit.client.1.smithi112.stdout:7/63: dwrite d7/f8 [0,4194304] 0 2024-04-25T02:09:00.650 INFO:tasks.workunit.client.1.smithi112.stdout:5/137: rename d1/d2/fb to d1/d2/f33 0 2024-04-25T02:09:00.652 INFO:tasks.workunit.client.1.smithi112.stdout:3/87: rename d12/d13/f15 to d12/d13/f1b 0 2024-04-25T02:09:00.653 INFO:tasks.workunit.client.1.smithi112.stdout:2/45: symlink d3/da/l10 0 2024-04-25T02:09:00.655 INFO:tasks.workunit.client.1.smithi112.stdout:9/87: getdents d1 0 2024-04-25T02:09:00.657 INFO:tasks.workunit.client.1.smithi112.stdout:9/88: write d1/fa [96452,126178] 0 2024-04-25T02:09:00.662 INFO:tasks.workunit.client.1.smithi112.stdout:1/206: dwrite d7/d9/d1f/f36 [0,4194304] 0 2024-04-25T02:09:00.662 INFO:tasks.workunit.client.1.smithi112.stdout:1/207: chown d7/d9/d1e/de/f3b 200 1 2024-04-25T02:09:00.663 INFO:tasks.workunit.client.1.smithi112.stdout:5/138: rename d1/d2/d4/f13 to d1/d2/d4/d1d/f34 0 2024-04-25T02:09:00.663 INFO:tasks.workunit.client.1.smithi112.stdout:5/139: chown d1/d2/f2d 0 1 2024-04-25T02:09:00.664 INFO:tasks.workunit.client.1.smithi112.stdout:3/88: rmdir d12/d13 39 2024-04-25T02:09:00.664 INFO:tasks.workunit.client.1.smithi112.stdout:3/89: chown d12/d13/f1b 687 1 2024-04-25T02:09:00.665 INFO:tasks.workunit.client.1.smithi112.stdout:3/90: read fd [151475,14812] 0 2024-04-25T02:09:00.668 INFO:tasks.workunit.client.1.smithi112.stdout:4/48: mknod d2/cf 0 2024-04-25T02:09:00.672 INFO:tasks.workunit.client.1.smithi112.stdout:7/64: truncate d7/fc 1096883 0 2024-04-25T02:09:00.672 INFO:tasks.workunit.client.1.smithi112.stdout:7/65: chown d7/ca 693883934 1 2024-04-25T02:09:00.672 INFO:tasks.workunit.client.1.smithi112.stdout:7/66: chown d7/fc 44491 1 2024-04-25T02:09:00.677 INFO:tasks.workunit.client.1.smithi112.stdout:4/49: dread f0 [0,4194304] 0 2024-04-25T02:09:00.691 INFO:tasks.workunit.client.1.smithi112.stdout:3/91: unlink lb 0 2024-04-25T02:09:00.696 INFO:tasks.workunit.client.1.smithi112.stdout:7/67: symlink d7/l12 0 2024-04-25T02:09:00.699 INFO:tasks.workunit.client.1.smithi112.stdout:7/68: truncate d7/fc 424644 0 2024-04-25T02:09:00.700 INFO:tasks.workunit.client.1.smithi112.stdout:1/208: dwrite d7/d9/d1f/f3e [0,4194304] 0 2024-04-25T02:09:00.702 INFO:tasks.workunit.client.1.smithi112.stdout:7/69: rename d7/dd/ff to d7/f13 0 2024-04-25T02:09:00.702 INFO:tasks.workunit.client.1.smithi112.stdout:7/70: stat d7/f8 0 2024-04-25T02:09:00.704 INFO:tasks.workunit.client.1.smithi112.stdout:1/209: symlink d7/d9/d1e/l41 0 2024-04-25T02:09:00.705 INFO:tasks.workunit.client.1.smithi112.stdout:7/71: symlink d7/l14 0 2024-04-25T02:09:00.711 INFO:tasks.workunit.client.1.smithi112.stdout:5/140: dwrite d1/d2/d4/d1d/f2a [0,4194304] 0 2024-04-25T02:09:00.712 INFO:tasks.workunit.client.1.smithi112.stdout:3/92: dwrite fd [0,4194304] 0 2024-04-25T02:09:00.715 INFO:tasks.workunit.client.1.smithi112.stdout:3/93: creat d12/d13/f1c x:0 0 0 2024-04-25T02:09:00.717 INFO:tasks.workunit.client.1.smithi112.stdout:5/141: rmdir d1/d2 39 2024-04-25T02:09:00.717 INFO:tasks.workunit.client.1.smithi112.stdout:1/210: dread d7/f24 [0,4194304] 0 2024-04-25T02:09:00.717 INFO:tasks.workunit.client.1.smithi112.stdout:1/211: getdents d7/d9/d1f/d25/d39 0 2024-04-25T02:09:00.718 INFO:tasks.workunit.client.1.smithi112.stdout:1/212: symlink d7/d9/d26/d28/d32/l42 0 2024-04-25T02:09:00.721 INFO:tasks.workunit.client.1.smithi112.stdout:9/89: truncate d1/d13/f18 136542 0 2024-04-25T02:09:00.733 INFO:tasks.workunit.client.1.smithi112.stdout:9/90: write d1/f4 [2759468,71846] 0 2024-04-25T02:09:00.733 INFO:tasks.workunit.client.1.smithi112.stdout:3/94: dwrite f5 [4194304,4194304] 0 2024-04-25T02:09:00.734 INFO:tasks.workunit.client.1.smithi112.stdout:9/91: read d1/f4 [3915848,45014] 0 2024-04-25T02:09:00.735 INFO:tasks.workunit.client.1.smithi112.stdout:7/72: dread d7/fc [0,4194304] 0 2024-04-25T02:09:00.735 INFO:tasks.workunit.client.1.smithi112.stdout:7/73: write d7/fc [1123967,20795] 0 2024-04-25T02:09:00.737 INFO:tasks.workunit.client.1.smithi112.stdout:7/74: write d7/fc [175048,17689] 0 2024-04-25T02:09:00.737 INFO:tasks.workunit.client.1.smithi112.stdout:7/75: stat d7/fc 0 2024-04-25T02:09:00.737 INFO:tasks.workunit.client.1.smithi112.stdout:7/76: readlink d7/l12 0 2024-04-25T02:09:00.740 INFO:tasks.workunit.client.1.smithi112.stdout:1/213: rmdir d7/d9/d26 39 2024-04-25T02:09:00.745 INFO:tasks.workunit.client.1.smithi112.stdout:3/95: rmdir d12/d13 39 2024-04-25T02:09:00.745 INFO:tasks.workunit.client.1.smithi112.stdout:3/96: creat d12/f1d x:0 0 0 2024-04-25T02:09:00.746 INFO:tasks.workunit.client.1.smithi112.stdout:9/92: dread d1/f5 [0,4194304] 0 2024-04-25T02:09:00.751 INFO:tasks.workunit.client.1.smithi112.stdout:1/214: mkdir d7/d9/d26/d28/d43 0 2024-04-25T02:09:00.756 INFO:tasks.workunit.client.1.smithi112.stdout:9/93: truncate d1/f17 801664 0 2024-04-25T02:09:00.759 INFO:tasks.workunit.client.1.smithi112.stdout:1/215: rmdir d7/d9/d26 39 2024-04-25T02:09:00.759 INFO:tasks.workunit.client.1.smithi112.stdout:3/97: dwrite d12/d13/f1b [0,4194304] 0 2024-04-25T02:09:00.760 INFO:tasks.workunit.client.1.smithi112.stdout:9/94: creat d1/f1e x:0 0 0 2024-04-25T02:09:00.779 INFO:tasks.workunit.client.1.smithi112.stdout:9/95: dwrite d1/f4 [0,4194304] 0 2024-04-25T02:09:00.779 INFO:tasks.workunit.client.1.smithi112.stdout:9/96: write d1/fa [817224,14354] 0 2024-04-25T02:09:00.779 INFO:tasks.workunit.client.1.smithi112.stdout:9/97: fdatasync d1/f5 0 2024-04-25T02:09:00.789 INFO:tasks.workunit.client.1.smithi112.stdout:9/98: truncate d1/f17 473865 0 2024-04-25T02:09:00.792 INFO:tasks.workunit.client.1.smithi112.stdout:9/99: unlink d1/d13/f1b 0 2024-04-25T02:09:00.799 INFO:tasks.workunit.client.1.smithi112.stdout:9/100: unlink d1/f17 0 2024-04-25T02:09:00.801 INFO:tasks.workunit.client.1.smithi112.stdout:9/101: link d1/fd d1/f1f 0 2024-04-25T02:09:00.802 INFO:tasks.workunit.client.1.smithi112.stdout:9/102: creat d1/d13/f20 x:0 0 0 2024-04-25T02:09:00.805 INFO:tasks.workunit.client.1.smithi112.stdout:9/103: rename d1/f1f to d1/f21 0 2024-04-25T02:09:00.822 INFO:tasks.workunit.client.1.smithi112.stdout:9/104: dwrite d1/df/f11 [4194304,4194304] 0 2024-04-25T02:09:00.825 INFO:tasks.workunit.client.1.smithi112.stdout:9/105: rename d1/l9 to d1/df/l22 0 2024-04-25T02:09:00.841 INFO:tasks.workunit.client.1.smithi112.stdout:9/106: dwrite d1/f21 [0,4194304] 0 2024-04-25T02:09:00.841 INFO:tasks.workunit.client.1.smithi112.stdout:9/107: chown d1/d13/f20 56 1 2024-04-25T02:09:00.841 INFO:tasks.workunit.client.1.smithi112.stdout:9/108: creat d1/df/f23 x:0 0 0 2024-04-25T02:09:00.846 INFO:tasks.workunit.client.1.smithi112.stdout:9/109: rename d1/df/c19 to d1/d13/c24 0 2024-04-25T02:09:00.849 INFO:tasks.workunit.client.1.smithi112.stdout:9/110: symlink d1/l25 0 2024-04-25T02:09:00.850 INFO:tasks.workunit.client.1.smithi112.stdout:9/111: readlink d1/l25 0 2024-04-25T02:09:00.854 INFO:tasks.workunit.client.1.smithi112.stdout:9/112: rename d1/d13/f1d to d1/d13/f26 0 2024-04-25T02:09:00.865 INFO:tasks.workunit.client.1.smithi112.stdout:9/113: rename d1/f14 to d1/f27 0 2024-04-25T02:09:00.865 INFO:tasks.workunit.client.1.smithi112.stdout:9/114: chown d1/d13/f26 112 1 2024-04-25T02:09:00.866 INFO:tasks.workunit.client.1.smithi112.stdout:9/115: symlink d1/df/l28 0 2024-04-25T02:09:00.880 INFO:tasks.workunit.client.1.smithi112.stdout:9/116: dwrite d1/d13/f20 [0,4194304] 0 2024-04-25T02:09:00.880 INFO:tasks.workunit.client.1.smithi112.stdout:9/117: creat d1/df/f29 x:0 0 0 2024-04-25T02:09:00.886 INFO:tasks.workunit.client.1.smithi112.stdout:9/118: rename d1/c7 to d1/c2a 0 2024-04-25T02:09:00.886 INFO:tasks.workunit.client.1.smithi112.stdout:9/119: chown d1/d13/f18 0 1 2024-04-25T02:09:00.887 INFO:tasks.workunit.client.1.smithi112.stdout:9/120: read d1/f10 [724939,109297] 0 2024-04-25T02:09:00.887 INFO:tasks.workunit.client.1.smithi112.stdout:9/121: truncate d1/f15 4492093 0 2024-04-25T02:09:00.887 INFO:tasks.workunit.client.1.smithi112.stdout:9/122: creat d1/f2b x:0 0 0 2024-04-25T02:09:00.887 INFO:tasks.workunit.client.1.smithi112.stdout:9/123: fsync d1/d13/f18 0 2024-04-25T02:09:00.894 INFO:tasks.workunit.client.1.smithi112.stdout:9/124: write d1/f12 [2571012,22779] 0 2024-04-25T02:09:00.896 INFO:tasks.workunit.client.1.smithi112.stdout:9/125: link d1/f21 d1/f2c 0 2024-04-25T02:09:00.918 INFO:tasks.workunit.client.1.smithi112.stdout:9/126: dwrite d1/f12 [4194304,4194304] 0 2024-04-25T02:09:00.925 INFO:tasks.workunit.client.1.smithi112.stdout:9/127: write d1/fd [1754433,110677] 0 2024-04-25T02:09:00.926 INFO:tasks.workunit.client.1.smithi112.stdout:9/128: creat d1/df/f2d x:0 0 0 2024-04-25T02:09:00.926 INFO:tasks.workunit.client.1.smithi112.stdout:9/129: creat d1/f2e x:0 0 0 2024-04-25T02:09:00.929 INFO:tasks.workunit.client.1.smithi112.stdout:9/130: symlink d1/d13/l2f 0 2024-04-25T02:09:00.933 INFO:tasks.workunit.client.1.smithi112.stdout:9/131: getdents d1/df 0 2024-04-25T02:09:00.936 INFO:tasks.workunit.client.1.smithi112.stdout:9/132: mknod d1/c30 0 2024-04-25T02:09:00.936 INFO:tasks.workunit.client.1.smithi112.stdout:9/133: creat d1/f31 x:0 0 0 2024-04-25T02:09:00.939 INFO:tasks.workunit.client.1.smithi112.stdout:9/134: mknod d1/c32 0 2024-04-25T02:09:00.939 INFO:tasks.workunit.client.1.smithi112.stdout:9/135: chown d1/c2a 9795 1 2024-04-25T02:09:00.939 INFO:tasks.workunit.client.1.smithi112.stdout:9/136: write d1/df/f29 [1047411,32149] 0 2024-04-25T02:09:00.939 INFO:tasks.workunit.client.1.smithi112.stdout:9/137: chown d1/df/l28 1 1 2024-04-25T02:09:00.939 INFO:tasks.workunit.client.1.smithi112.stdout:9/138: fdatasync d1/df/f2d 0 2024-04-25T02:09:00.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:00 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:09:00.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:00 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:09:00.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:00 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:09:00.991 INFO:tasks.workunit.client.1.smithi112.stdout:0/262: sync 2024-04-25T02:09:00.995 INFO:tasks.workunit.client.1.smithi112.stdout:0/263: mkdir da/d1d/d2e/d40/d49/d4f/d58 0 2024-04-25T02:09:01.000 INFO:tasks.workunit.client.1.smithi112.stdout:0/264: symlink da/d13/d1e/l59 0 2024-04-25T02:09:01.000 INFO:tasks.workunit.client.1.smithi112.stdout:0/265: truncate da/d13/d1e/f3b 450457 0 2024-04-25T02:09:01.000 INFO:tasks.workunit.client.1.smithi112.stdout:0/266: dread - da/d1d/f43 zero size 2024-04-25T02:09:01.013 INFO:tasks.workunit.client.1.smithi112.stdout:0/267: dwrite da/d13/d23/d2b/d24/f55 [4194304,4194304] 0 2024-04-25T02:09:01.022 INFO:tasks.workunit.client.1.smithi112.stdout:0/268: write da/d13/d23/d2b/d24/f48 [1866998,30181] 0 2024-04-25T02:09:01.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:00 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:09:01.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:00 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:09:01.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:00 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:09:01.046 INFO:tasks.workunit.client.1.smithi112.stdout:0/269: dwrite da/f26 [0,4194304] 0 2024-04-25T02:09:01.046 INFO:tasks.workunit.client.1.smithi112.stdout:0/270: write da/d1d/f43 [181217,58775] 0 2024-04-25T02:09:01.046 INFO:tasks.workunit.client.1.smithi112.stdout:0/271: write f2 [6425340,29889] 0 2024-04-25T02:09:01.047 INFO:tasks.workunit.client.1.smithi112.stdout:0/272: write da/d13/d23/d2b/d24/f48 [708167,53193] 0 2024-04-25T02:09:01.048 INFO:tasks.workunit.client.1.smithi112.stdout:0/273: write da/f18 [1876628,14873] 0 2024-04-25T02:09:01.048 INFO:tasks.workunit.client.1.smithi112.stdout:0/274: stat da/d13/d1e/f4e 0 2024-04-25T02:09:01.072 INFO:tasks.workunit.client.1.smithi112.stdout:0/275: dwrite da/f32 [0,4194304] 0 2024-04-25T02:09:01.073 INFO:tasks.workunit.client.1.smithi112.stdout:0/276: write da/d13/d23/d2b/f50 [8508194,29667] 0 2024-04-25T02:09:01.074 INFO:tasks.workunit.client.1.smithi112.stdout:0/277: creat da/d13/d45/f5a x:0 0 0 2024-04-25T02:09:01.075 INFO:tasks.workunit.client.1.smithi112.stdout:0/278: rename da/d1d/l27 to da/d1d/d2e/d40/d49/l5b 0 2024-04-25T02:09:01.077 INFO:tasks.workunit.client.1.smithi112.stdout:0/279: rename da/c14 to da/d13/c5c 0 2024-04-25T02:09:01.078 INFO:tasks.workunit.client.1.smithi112.stdout:0/280: mknod da/d13/c5d 0 2024-04-25T02:09:01.079 INFO:tasks.workunit.client.1.smithi112.stdout:0/281: chown da/l1b 3395141 1 2024-04-25T02:09:01.080 INFO:tasks.workunit.client.1.smithi112.stdout:0/282: mkdir da/d13/d45/d5e 0 2024-04-25T02:09:01.080 INFO:tasks.workunit.client.1.smithi112.stdout:0/283: truncate da/d1d/f43 1280309 0 2024-04-25T02:09:01.088 INFO:tasks.workunit.client.1.smithi112.stdout:0/284: write da/d13/d23/d2b/d24/f33 [2246938,107012] 0 2024-04-25T02:09:01.089 INFO:tasks.workunit.client.1.smithi112.stdout:0/285: mkdir da/d1d/d2e/d40/d49/d5f 0 2024-04-25T02:09:01.095 INFO:tasks.workunit.client.1.smithi112.stdout:0/286: write da/fb [2360194,112960] 0 2024-04-25T02:09:01.095 INFO:tasks.workunit.client.1.smithi112.stdout:0/287: chown da/f52 1833601 1 2024-04-25T02:09:01.104 INFO:tasks.workunit.client.1.smithi112.stdout:0/288: dread da/d13/d23/d2b/d24/f33 [0,4194304] 0 2024-04-25T02:09:01.106 INFO:tasks.workunit.client.1.smithi112.stdout:0/289: creat da/d13/d23/d2b/f60 x:0 0 0 2024-04-25T02:09:01.120 INFO:tasks.workunit.client.1.smithi112.stdout:0/290: dwrite da/f10 [4194304,4194304] 0 2024-04-25T02:09:01.121 INFO:tasks.workunit.client.1.smithi112.stdout:0/291: stat da/d1d/f43 0 2024-04-25T02:09:01.129 INFO:tasks.workunit.client.1.smithi112.stdout:0/292: dread da/f32 [0,4194304] 0 2024-04-25T02:09:01.129 INFO:tasks.workunit.client.1.smithi112.stdout:0/293: chown da/d13/d45/f5a 58501 1 2024-04-25T02:09:01.131 INFO:tasks.workunit.client.1.smithi112.stdout:0/294: creat da/d1d/d2e/d40/d49/f61 x:0 0 0 2024-04-25T02:09:01.200 INFO:tasks.workunit.client.1.smithi112.stdout:0/295: truncate da/f10 6116185 0 2024-04-25T02:09:01.202 INFO:tasks.workunit.client.1.smithi112.stdout:0/296: mknod da/d1d/d2e/d40/d49/d5f/c62 0 2024-04-25T02:09:01.202 INFO:tasks.workunit.client.1.smithi112.stdout:0/297: readlink da/d1d/d2e/d40/d49/l5b 0 2024-04-25T02:09:01.246 INFO:tasks.workunit.client.1.smithi112.stdout:6/151: sync 2024-04-25T02:09:01.246 INFO:tasks.workunit.client.1.smithi112.stdout:8/196: sync 2024-04-25T02:09:01.246 INFO:tasks.workunit.client.1.smithi112.stdout:8/197: chown d15/d26/d37/f3f 24 1 2024-04-25T02:09:01.247 INFO:tasks.workunit.client.1.smithi112.stdout:0/298: rmdir da/d1d 39 2024-04-25T02:09:01.251 INFO:tasks.workunit.client.1.smithi112.stdout:6/152: rename d0/f7 to d0/d36/f37 0 2024-04-25T02:09:01.251 INFO:tasks.workunit.client.1.smithi112.stdout:6/153: read d0/d2/f10 [3099129,60300] 0 2024-04-25T02:09:01.257 INFO:tasks.workunit.client.1.smithi112.stdout:6/154: dread d0/f17 [0,4194304] 0 2024-04-25T02:09:01.260 INFO:tasks.workunit.client.1.smithi112.stdout:0/299: dread da/d1d/d2e/d40/f41 [0,4194304] 0 2024-04-25T02:09:01.264 INFO:tasks.workunit.client.1.smithi112.stdout:6/155: unlink d0/c1e 0 2024-04-25T02:09:01.264 INFO:tasks.workunit.client.1.smithi112.stdout:6/156: chown d0/d2/d2c/f33 8064269 1 2024-04-25T02:09:01.264 INFO:tasks.workunit.client.1.smithi112.stdout:6/157: fdatasync d0/d2/f15 0 2024-04-25T02:09:01.266 INFO:tasks.workunit.client.1.smithi112.stdout:0/300: mknod da/d13/d23/c63 0 2024-04-25T02:09:01.266 INFO:tasks.workunit.client.1.smithi112.stdout:0/301: write da/d13/d23/d2b/f60 [104118,5130] 0 2024-04-25T02:09:01.267 INFO:tasks.workunit.client.1.smithi112.stdout:6/158: mknod d0/c38 0 2024-04-25T02:09:01.269 INFO:tasks.workunit.client.1.smithi112.stdout:8/198: dwrite d15/d17/f3b [4194304,4194304] 0 2024-04-25T02:09:01.273 INFO:tasks.workunit.client.1.smithi112.stdout:6/159: rename d0/d2/l29 to d0/l39 0 2024-04-25T02:09:01.278 INFO:tasks.workunit.client.1.smithi112.stdout:8/199: unlink d15/d17/d1a/f36 0 2024-04-25T02:09:01.284 INFO:tasks.workunit.client.1.smithi112.stdout:0/302: getdents da/d13/d23/d2b/d24 0 2024-04-25T02:09:01.286 INFO:tasks.workunit.client.1.smithi112.stdout:6/160: mknod d0/d2/d4/dd/c3a 0 2024-04-25T02:09:01.298 INFO:tasks.workunit.client.1.smithi112.stdout:8/200: link d15/d17/d24/f27 d15/d17/d1a/f43 0 2024-04-25T02:09:01.299 INFO:tasks.workunit.client.1.smithi112.stdout:6/161: dread d0/d36/f37 [0,4194304] 0 2024-04-25T02:09:01.301 INFO:tasks.workunit.client.1.smithi112.stdout:8/201: rename d15/d17/f31 to d15/d17/d1a/f44 0 2024-04-25T02:09:01.302 INFO:tasks.workunit.client.1.smithi112.stdout:6/162: stat d0/l16 0 2024-04-25T02:09:01.303 INFO:tasks.workunit.client.1.smithi112.stdout:0/303: dwrite da/d1d/d2e/d40/d49/d4f/f51 [0,4194304] 0 2024-04-25T02:09:01.306 INFO:tasks.workunit.client.1.smithi112.stdout:8/202: rename d15/f16 to d15/d17/d41/f45 0 2024-04-25T02:09:01.310 INFO:tasks.workunit.client.1.smithi112.stdout:6/163: mkdir d0/d2/d3b 0 2024-04-25T02:09:01.310 INFO:tasks.workunit.client.1.smithi112.stdout:6/164: dread - d0/d2/d4/f19 zero size 2024-04-25T02:09:01.311 INFO:tasks.workunit.client.1.smithi112.stdout:6/165: truncate d0/f2b 7525784 0 2024-04-25T02:09:01.311 INFO:tasks.workunit.client.1.smithi112.stdout:6/166: chown d0/d2/d4/f19 18489 1 2024-04-25T02:09:01.311 INFO:tasks.workunit.client.1.smithi112.stdout:6/167: write d0/d2/d4/f1d [473002,41553] 0 2024-04-25T02:09:01.319 INFO:tasks.workunit.client.1.smithi112.stdout:8/203: write d15/f30 [1092756,41722] 0 2024-04-25T02:09:01.321 INFO:tasks.workunit.client.1.smithi112.stdout:0/304: mknod da/d13/d45/c64 0 2024-04-25T02:09:01.331 INFO:tasks.workunit.client.1.smithi112.stdout:6/168: link d0/d2/d4/c2a d0/d2/d1f/c3c 0 2024-04-25T02:09:01.331 INFO:tasks.workunit.client.1.smithi112.stdout:6/169: dread - d0/f30 zero size 2024-04-25T02:09:01.336 INFO:tasks.workunit.client.1.smithi112.stdout:0/305: rename da/d13/f35 to da/d13/f65 0 2024-04-25T02:09:01.339 INFO:tasks.workunit.client.1.smithi112.stdout:8/204: dwrite d15/d26/f2b [0,4194304] 0 2024-04-25T02:09:01.341 INFO:tasks.workunit.client.1.smithi112.stdout:2/46: sync 2024-04-25T02:09:01.345 INFO:tasks.workunit.client.1.smithi112.stdout:6/170: rename d0/d2/f10 to d0/d2/d4/dd/f3d 0 2024-04-25T02:09:01.349 INFO:tasks.workunit.client.1.smithi112.stdout:0/306: symlink da/d1d/d2e/d40/d49/d4f/l66 0 2024-04-25T02:09:01.349 INFO:tasks.workunit.client.1.smithi112.stdout:0/307: fdatasync da/fb 0 2024-04-25T02:09:01.349 INFO:tasks.workunit.client.1.smithi112.stdout:0/308: stat da/d13/d1e/f3b 0 2024-04-25T02:09:01.349 INFO:tasks.workunit.client.1.smithi112.stdout:5/142: sync 2024-04-25T02:09:01.349 INFO:tasks.workunit.client.1.smithi112.stdout:1/216: sync 2024-04-25T02:09:01.349 INFO:tasks.workunit.client.1.smithi112.stdout:9/139: sync 2024-04-25T02:09:01.349 INFO:tasks.workunit.client.1.smithi112.stdout:4/50: sync 2024-04-25T02:09:01.349 INFO:tasks.workunit.client.1.smithi112.stdout:3/98: sync 2024-04-25T02:09:01.349 INFO:tasks.workunit.client.1.smithi112.stdout:4/51: fdatasync d2/fc 0 2024-04-25T02:09:01.349 INFO:tasks.workunit.client.1.smithi112.stdout:1/217: readlink d7/d9/d1e/l29 0 2024-04-25T02:09:01.349 INFO:tasks.workunit.client.1.smithi112.stdout:7/77: sync 2024-04-25T02:09:01.349 INFO:tasks.workunit.client.1.smithi112.stdout:1/218: write d7/d9/d26/f37 [980279,64147] 0 2024-04-25T02:09:01.349 INFO:tasks.workunit.client.1.smithi112.stdout:3/99: write d12/f19 [247177,90807] 0 2024-04-25T02:09:01.350 INFO:tasks.workunit.client.1.smithi112.stdout:8/205: write d15/f42 [2926189,87361] 0 2024-04-25T02:09:01.358 INFO:tasks.workunit.client.1.smithi112.stdout:8/206: dread fd [0,4194304] 0 2024-04-25T02:09:01.362 INFO:tasks.workunit.client.1.smithi112.stdout:6/171: stat d0/l39 0 2024-04-25T02:09:01.363 INFO:tasks.workunit.client.1.smithi112.stdout:0/309: mknod da/d1d/c67 0 2024-04-25T02:09:01.366 INFO:tasks.workunit.client.1.smithi112.stdout:3/100: dwrite fd [0,4194304] 0 2024-04-25T02:09:01.366 INFO:tasks.workunit.client.1.smithi112.stdout:9/140: mkdir d1/df/d33 0 2024-04-25T02:09:01.370 INFO:tasks.workunit.client.1.smithi112.stdout:4/52: dread - d2/f6 zero size 2024-04-25T02:09:01.370 INFO:tasks.workunit.client.1.smithi112.stdout:4/53: stat f0 0 2024-04-25T02:09:01.377 INFO:tasks.workunit.client.1.smithi112.stdout:7/78: symlink d7/dd/l15 0 2024-04-25T02:09:01.377 INFO:tasks.workunit.client.1.smithi112.stdout:5/143: dread d1/f8 [0,4194304] 0 2024-04-25T02:09:01.377 INFO:tasks.workunit.client.1.smithi112.stdout:5/144: readlink d1/d16/l1b 0 2024-04-25T02:09:01.379 INFO:tasks.workunit.client.1.smithi112.stdout:1/219: truncate d7/f24 965426 0 2024-04-25T02:09:01.379 INFO:tasks.workunit.client.1.smithi112.stdout:1/220: read - d7/d9/d1e/de/f27 zero size 2024-04-25T02:09:01.383 INFO:tasks.workunit.client.1.smithi112.stdout:9/141: dwrite d1/fd [0,4194304] 0 2024-04-25T02:09:01.383 INFO:tasks.workunit.client.1.smithi112.stdout:9/142: chown d1/f5 2927 1 2024-04-25T02:09:01.383 INFO:tasks.workunit.client.1.smithi112.stdout:9/143: chown d1/df/l22 118 1 2024-04-25T02:09:01.383 INFO:tasks.workunit.client.1.smithi112.stdout:9/144: write d1/f27 [585212,58073] 0 2024-04-25T02:09:01.383 INFO:tasks.workunit.client.1.smithi112.stdout:9/145: write d1/d13/f26 [455785,58146] 0 2024-04-25T02:09:01.383 INFO:tasks.workunit.client.1.smithi112.stdout:9/146: write d1/d13/f26 [953382,23235] 0 2024-04-25T02:09:01.383 INFO:tasks.workunit.client.1.smithi112.stdout:8/207: mknod d15/d17/d24/c46 0 2024-04-25T02:09:01.384 INFO:tasks.workunit.client.1.smithi112.stdout:2/47: mknod d3/c11 0 2024-04-25T02:09:01.384 INFO:tasks.workunit.client.1.smithi112.stdout:2/48: write d3/f4 [5115268,49063] 0 2024-04-25T02:09:01.389 INFO:tasks.workunit.client.1.smithi112.stdout:0/310: link da/l1f da/d13/d1e/l68 0 2024-04-25T02:09:01.389 INFO:tasks.workunit.client.1.smithi112.stdout:0/311: chown da/d1d/d2e/d40/d49/l5b 524 1 2024-04-25T02:09:01.390 INFO:tasks.workunit.client.1.smithi112.stdout:9/147: dread d1/df/f11 [0,4194304] 0 2024-04-25T02:09:01.392 INFO:tasks.workunit.client.1.smithi112.stdout:3/101: symlink d12/d13/l1e 0 2024-04-25T02:09:01.392 INFO:tasks.workunit.client.1.smithi112.stdout:3/102: read - d12/f1d zero size 2024-04-25T02:09:01.392 INFO:tasks.workunit.client.1.smithi112.stdout:3/103: chown d12/d13/f1c 459105 1 2024-04-25T02:09:01.392 INFO:tasks.workunit.client.1.smithi112.stdout:3/104: chown d12/d13/l16 3 1 2024-04-25T02:09:01.393 INFO:tasks.workunit.client.1.smithi112.stdout:4/54: truncate f0 1430024 0 2024-04-25T02:09:01.397 INFO:tasks.workunit.client.1.smithi112.stdout:1/221: read d7/f24 [874969,16520] 0 2024-04-25T02:09:01.397 INFO:tasks.workunit.client.1.smithi112.stdout:7/79: dwrite d7/f8 [0,4194304] 0 2024-04-25T02:09:01.399 INFO:tasks.workunit.client.1.smithi112.stdout:8/208: creat d15/d17/d41/f47 x:0 0 0 2024-04-25T02:09:01.399 INFO:tasks.workunit.client.1.smithi112.stdout:7/80: dread d7/dd/f10 [0,4194304] 0 2024-04-25T02:09:01.399 INFO:tasks.workunit.client.1.smithi112.stdout:7/81: write d7/fc [535246,77043] 0 2024-04-25T02:09:01.399 INFO:tasks.workunit.client.1.smithi112.stdout:7/82: creat d7/f16 x:0 0 0 2024-04-25T02:09:01.399 INFO:tasks.workunit.client.1.smithi112.stdout:7/83: write d7/dd/f10 [907321,21261] 0 2024-04-25T02:09:01.400 INFO:tasks.workunit.client.1.smithi112.stdout:2/49: rename d3/da/fb to d3/de/df/f12 0 2024-04-25T02:09:01.407 INFO:tasks.workunit.client.1.smithi112.stdout:6/172: write d0/d2/d4/fb [3416240,18671] 0 2024-04-25T02:09:01.408 INFO:tasks.workunit.client.1.smithi112.stdout:0/312: mknod da/d1d/d2e/d40/d49/d4f/d58/c69 0 2024-04-25T02:09:01.413 INFO:tasks.workunit.client.1.smithi112.stdout:9/148: symlink d1/l34 0 2024-04-25T02:09:01.414 INFO:tasks.workunit.client.1.smithi112.stdout:3/105: mkdir d12/d1f 0 2024-04-25T02:09:01.416 INFO:tasks.workunit.client.1.smithi112.stdout:4/55: dread - d2/f9 zero size 2024-04-25T02:09:01.416 INFO:tasks.workunit.client.1.smithi112.stdout:4/56: write d2/fb [672525,20433] 0 2024-04-25T02:09:01.417 INFO:tasks.workunit.client.1.smithi112.stdout:4/57: chown d2/f6 66902037 1 2024-04-25T02:09:01.420 INFO:tasks.workunit.client.1.smithi112.stdout:5/145: mknod d1/c35 0 2024-04-25T02:09:01.421 INFO:tasks.workunit.client.1.smithi112.stdout:1/222: mknod d7/d9/d26/c44 0 2024-04-25T02:09:01.421 INFO:tasks.workunit.client.1.smithi112.stdout:1/223: fdatasync d7/d9/d1e/f12 0 2024-04-25T02:09:01.422 INFO:tasks.workunit.client.1.smithi112.stdout:0/313: dwrite da/f10 [4194304,4194304] 0 2024-04-25T02:09:01.425 INFO:tasks.workunit.client.1.smithi112.stdout:8/209: creat d15/d17/f48 x:0 0 0 2024-04-25T02:09:01.425 INFO:tasks.workunit.client.1.smithi112.stdout:8/210: read - d15/d17/d24/f27 zero size 2024-04-25T02:09:01.429 INFO:tasks.workunit.client.1.smithi112.stdout:7/84: link d7/fc d7/f17 0 2024-04-25T02:09:01.429 INFO:tasks.workunit.client.1.smithi112.stdout:7/85: chown d7 1974283070 1 2024-04-25T02:09:01.429 INFO:tasks.workunit.client.1.smithi112.stdout:7/86: creat d7/dd/f18 x:0 0 0 2024-04-25T02:09:01.429 INFO:tasks.workunit.client.1.smithi112.stdout:7/87: truncate d7/f16 406836 0 2024-04-25T02:09:01.429 INFO:tasks.workunit.client.1.smithi112.stdout:7/88: fdatasync d7/dd/f18 0 2024-04-25T02:09:01.431 INFO:tasks.workunit.client.1.smithi112.stdout:7/89: dread d7/fc [0,4194304] 0 2024-04-25T02:09:01.431 INFO:tasks.workunit.client.1.smithi112.stdout:0/314: dread da/fb [0,4194304] 0 2024-04-25T02:09:01.433 INFO:tasks.workunit.client.1.smithi112.stdout:8/211: dread d15/d26/f2b [0,4194304] 0 2024-04-25T02:09:01.450 INFO:tasks.workunit.client.1.smithi112.stdout:6/173: mknod d0/d2/d1f/c3e 0 2024-04-25T02:09:01.450 INFO:tasks.workunit.client.1.smithi112.stdout:6/174: read - d0/d2/d4/dd/f24 zero size 2024-04-25T02:09:01.450 INFO:tasks.workunit.client.1.smithi112.stdout:6/175: readlink d0/l25 0 2024-04-25T02:09:01.452 INFO:tasks.workunit.client.1.smithi112.stdout:9/149: symlink d1/d13/l35 0 2024-04-25T02:09:01.452 INFO:tasks.workunit.client.1.smithi112.stdout:3/106: creat d12/d13/f20 x:0 0 0 2024-04-25T02:09:01.454 INFO:tasks.workunit.client.1.smithi112.stdout:7/90: dwrite d7/dd/f10 [0,4194304] 0 2024-04-25T02:09:01.455 INFO:tasks.workunit.client.1.smithi112.stdout:8/212: dwrite d15/f42 [0,4194304] 0 2024-04-25T02:09:01.458 INFO:tasks.workunit.client.1.smithi112.stdout:5/146: link d1/f6 d1/d2/f36 0 2024-04-25T02:09:01.461 INFO:tasks.workunit.client.1.smithi112.stdout:1/224: mkdir d7/d9/d1e/d45 0 2024-04-25T02:09:01.463 INFO:tasks.workunit.client.1.smithi112.stdout:6/176: dread d0/d2/d4/fb [0,4194304] 0 2024-04-25T02:09:01.463 INFO:tasks.workunit.client.1.smithi112.stdout:6/177: creat d0/d2/d2c/f3f x:0 0 0 2024-04-25T02:09:01.464 INFO:tasks.workunit.client.1.smithi112.stdout:7/91: dread d7/fc [0,4194304] 0 2024-04-25T02:09:01.464 INFO:tasks.workunit.client.1.smithi112.stdout:0/315: creat da/d13/d1e/f6a x:0 0 0 2024-04-25T02:09:01.466 INFO:tasks.workunit.client.1.smithi112.stdout:9/150: mknod d1/c36 0 2024-04-25T02:09:01.466 INFO:tasks.workunit.client.1.smithi112.stdout:9/151: fsync d1/f2b 0 2024-04-25T02:09:01.466 INFO:tasks.workunit.client.1.smithi112.stdout:9/152: creat d1/d13/f37 x:0 0 0 2024-04-25T02:09:01.466 INFO:tasks.workunit.client.1.smithi112.stdout:9/153: fsync d1/f2c 0 2024-04-25T02:09:01.470 INFO:tasks.workunit.client.1.smithi112.stdout:8/213: link d15/d17/d1a/f2f d15/d40/f49 0 2024-04-25T02:09:01.470 INFO:tasks.workunit.client.1.smithi112.stdout:8/214: dread - d15/d17/d1a/f33 zero size 2024-04-25T02:09:01.473 INFO:tasks.workunit.client.1.smithi112.stdout:5/147: creat d1/d16/d22/f37 x:0 0 0 2024-04-25T02:09:01.475 INFO:tasks.workunit.client.1.smithi112.stdout:7/92: link d7/f17 d7/f19 0 2024-04-25T02:09:01.475 INFO:tasks.workunit.client.1.smithi112.stdout:7/93: chown d7/fc 3420244 1 2024-04-25T02:09:01.477 INFO:tasks.workunit.client.1.smithi112.stdout:3/107: dwrite d12/d13/f1b [0,4194304] 0 2024-04-25T02:09:01.480 INFO:tasks.workunit.client.1.smithi112.stdout:9/154: rename d1/f15 to d1/f38 0 2024-04-25T02:09:01.484 INFO:tasks.workunit.client.1.smithi112.stdout:7/94: symlink d7/dd/l1a 0 2024-04-25T02:09:01.493 INFO:tasks.workunit.client.1.smithi112.stdout:3/108: dread fd [0,4194304] 0 2024-04-25T02:09:01.494 INFO:tasks.workunit.client.1.smithi112.stdout:9/155: rmdir d1/df/d33 0 2024-04-25T02:09:01.496 INFO:tasks.workunit.client.1.smithi112.stdout:4/58: dwrite d2/f8 [0,4194304] 0 2024-04-25T02:09:01.499 INFO:tasks.workunit.client.1.smithi112.stdout:9/156: truncate d1/df/f29 485534 0 2024-04-25T02:09:01.503 INFO:tasks.workunit.client.1.smithi112.stdout:6/178: dwrite d0/d2/d4/dd/f26 [0,4194304] 0 2024-04-25T02:09:01.505 INFO:tasks.workunit.client.1.smithi112.stdout:9/157: creat d1/df/f39 x:0 0 0 2024-04-25T02:09:01.507 INFO:tasks.workunit.client.1.smithi112.stdout:4/59: rename f0 to d2/f10 0 2024-04-25T02:09:01.513 INFO:tasks.workunit.client.1.smithi112.stdout:9/158: symlink d1/df/l3a 0 2024-04-25T02:09:01.513 INFO:tasks.workunit.client.1.smithi112.stdout:9/159: creat d1/f3b x:0 0 0 2024-04-25T02:09:01.514 INFO:tasks.workunit.client.1.smithi112.stdout:4/60: creat d2/f11 x:0 0 0 2024-04-25T02:09:01.516 INFO:tasks.workunit.client.1.smithi112.stdout:1/225: dwrite d7/d9/d1e/de/f3b [0,4194304] 0 2024-04-25T02:09:01.521 INFO:tasks.workunit.client.1.smithi112.stdout:9/160: mkdir d1/df/d3c 0 2024-04-25T02:09:01.521 INFO:tasks.workunit.client.1.smithi112.stdout:9/161: stat d1/df/l22 0 2024-04-25T02:09:01.522 INFO:tasks.workunit.client.1.smithi112.stdout:8/215: dwrite f6 [4194304,4194304] 0 2024-04-25T02:09:01.523 INFO:tasks.workunit.client.1.smithi112.stdout:4/61: stat d2/c7 0 2024-04-25T02:09:01.524 INFO:tasks.workunit.client.1.smithi112.stdout:4/62: write d2/fb [575806,56678] 0 2024-04-25T02:09:01.527 INFO:tasks.workunit.client.1.smithi112.stdout:4/63: dread d2/f10 [0,4194304] 0 2024-04-25T02:09:01.529 INFO:tasks.workunit.client.1.smithi112.stdout:0/316: dwrite da/f32 [0,4194304] 0 2024-04-25T02:09:01.535 INFO:tasks.workunit.client.1.smithi112.stdout:0/317: mkdir da/d1d/d2e/d40/d49/d6b 0 2024-04-25T02:09:01.536 INFO:tasks.workunit.client.1.smithi112.stdout:5/148: dwrite d1/d2/f36 [0,4194304] 0 2024-04-25T02:09:01.537 INFO:tasks.workunit.client.1.smithi112.stdout:0/318: dread da/d13/d23/d2b/f60 [0,4194304] 0 2024-04-25T02:09:01.538 INFO:tasks.workunit.client.1.smithi112.stdout:4/64: mkdir d2/d12 0 2024-04-25T02:09:01.541 INFO:tasks.workunit.client.1.smithi112.stdout:5/149: mknod d1/d2/c38 0 2024-04-25T02:09:01.542 INFO:tasks.workunit.client.1.smithi112.stdout:0/319: truncate da/d1d/f43 1268823 0 2024-04-25T02:09:01.545 INFO:tasks.workunit.client.1.smithi112.stdout:5/150: stat d1/d2/d4/c10 0 2024-04-25T02:09:01.545 INFO:tasks.workunit.client.1.smithi112.stdout:5/151: chown d1/f29 13802216 1 2024-04-25T02:09:01.545 INFO:tasks.workunit.client.1.smithi112.stdout:5/152: write d1/d2/d4/d1d/f25 [279499,31272] 0 2024-04-25T02:09:01.551 INFO:tasks.workunit.client.1.smithi112.stdout:5/153: mknod d1/c39 0 2024-04-25T02:09:01.555 INFO:tasks.workunit.client.1.smithi112.stdout:0/320: dread da/f10 [0,4194304] 0 2024-04-25T02:09:01.555 INFO:tasks.workunit.client.1.smithi112.stdout:7/95: dwrite d7/f13 [0,4194304] 0 2024-04-25T02:09:01.555 INFO:tasks.workunit.client.1.smithi112.stdout:3/109: dwrite d12/f1d [0,4194304] 0 2024-04-25T02:09:01.555 INFO:tasks.workunit.client.1.smithi112.stdout:0/321: chown da/d1d/d2e/d40/d49/d5f/c62 85 1 2024-04-25T02:09:01.555 INFO:tasks.workunit.client.1.smithi112.stdout:0/322: fsync da/f18 0 2024-04-25T02:09:01.555 INFO:tasks.workunit.client.1.smithi112.stdout:6/179: dwrite d0/d2/d2c/f33 [0,4194304] 0 2024-04-25T02:09:01.555 INFO:tasks.workunit.client.1.smithi112.stdout:5/154: unlink d1/d16/d22/f24 0 2024-04-25T02:09:01.556 INFO:tasks.workunit.client.1.smithi112.stdout:5/155: truncate d1/d16/d22/f37 442212 0 2024-04-25T02:09:01.556 INFO:tasks.workunit.client.1.smithi112.stdout:6/180: dread d0/f17 [0,4194304] 0 2024-04-25T02:09:01.559 INFO:tasks.workunit.client.1.smithi112.stdout:1/226: dwrite d7/d9/d26/f37 [0,4194304] 0 2024-04-25T02:09:01.559 INFO:tasks.workunit.client.1.smithi112.stdout:0/323: symlink da/d1d/d2e/d40/d49/d6b/l6c 0 2024-04-25T02:09:01.559 INFO:tasks.workunit.client.1.smithi112.stdout:9/162: dwrite d1/f1e [0,4194304] 0 2024-04-25T02:09:01.559 INFO:tasks.workunit.client.1.smithi112.stdout:4/65: dwrite d2/fe [0,4194304] 0 2024-04-25T02:09:01.560 INFO:tasks.workunit.client.1.smithi112.stdout:9/163: creat d1/d13/f3d x:0 0 0 2024-04-25T02:09:01.560 INFO:tasks.workunit.client.1.smithi112.stdout:9/164: stat d1/df/f11 0 2024-04-25T02:09:01.560 INFO:tasks.workunit.client.1.smithi112.stdout:4/66: write d2/fd [623654,7573] 0 2024-04-25T02:09:01.561 INFO:tasks.workunit.client.1.smithi112.stdout:8/216: dwrite fe [0,4194304] 0 2024-04-25T02:09:01.561 INFO:tasks.workunit.client.1.smithi112.stdout:8/217: fdatasync d15/d26/d37/f3f 0 2024-04-25T02:09:01.561 INFO:tasks.workunit.client.1.smithi112.stdout:8/218: write d15/d26/f3a [4361239,92025] 0 2024-04-25T02:09:01.561 INFO:tasks.workunit.client.1.smithi112.stdout:8/219: readlink d15/d17/d1a/l25 0 2024-04-25T02:09:01.563 INFO:tasks.workunit.client.1.smithi112.stdout:5/156: symlink d1/d2/d4/l3a 0 2024-04-25T02:09:01.563 INFO:tasks.workunit.client.1.smithi112.stdout:5/157: write d1/f29 [111993,57310] 0 2024-04-25T02:09:01.567 INFO:tasks.workunit.client.1.smithi112.stdout:1/227: mkdir d7/d9/d46 0 2024-04-25T02:09:01.568 INFO:tasks.workunit.client.1.smithi112.stdout:4/67: dread d2/fe [0,4194304] 0 2024-04-25T02:09:01.568 INFO:tasks.workunit.client.1.smithi112.stdout:4/68: chown d2/fc 5334 1 2024-04-25T02:09:01.569 INFO:tasks.workunit.client.1.smithi112.stdout:0/324: unlink da/d13/d23/d2b/d24/f55 0 2024-04-25T02:09:01.572 INFO:tasks.workunit.client.1.smithi112.stdout:6/181: dread d0/f1a [0,4194304] 0 2024-04-25T02:09:01.580 INFO:tasks.workunit.client.1.smithi112.stdout:4/69: fsync d2/f11 0 2024-04-25T02:09:01.582 INFO:tasks.workunit.client.1.smithi112.stdout:8/220: unlink d15/d26/f2b 0 2024-04-25T02:09:01.583 INFO:tasks.workunit.client.1.smithi112.stdout:1/228: symlink d7/d9/d1e/l47 0 2024-04-25T02:09:01.587 INFO:tasks.workunit.client.1.smithi112.stdout:0/325: mkdir da/d1d/d2e/d40/d49/d4f/d58/d6d 0 2024-04-25T02:09:01.587 INFO:tasks.workunit.client.1.smithi112.stdout:0/326: stat da/d13/d23/d2b/d24/f48 0 2024-04-25T02:09:01.588 INFO:tasks.workunit.client.1.smithi112.stdout:6/182: creat d0/d2/d3b/f40 x:0 0 0 2024-04-25T02:09:01.591 INFO:tasks.workunit.client.1.smithi112.stdout:4/70: truncate d2/fc 2366452 0 2024-04-25T02:09:01.593 INFO:tasks.workunit.client.1.smithi112.stdout:4/71: write d2/f10 [444512,36659] 0 2024-04-25T02:09:01.594 INFO:tasks.workunit.client.1.smithi112.stdout:5/158: rename d1/d2/d4/f2c to d1/f3b 0 2024-04-25T02:09:01.596 INFO:tasks.workunit.client.1.smithi112.stdout:0/327: write da/f10 [7284725,94607] 0 2024-04-25T02:09:01.597 INFO:tasks.workunit.client.1.smithi112.stdout:0/328: stat da/fb 0 2024-04-25T02:09:01.597 INFO:tasks.workunit.client.1.smithi112.stdout:0/329: truncate da/d13/d1e/f3f 579574 0 2024-04-25T02:09:01.597 INFO:tasks.workunit.client.1.smithi112.stdout:0/330: truncate da/d13/d45/f5a 564874 0 2024-04-25T02:09:01.603 INFO:tasks.workunit.client.1.smithi112.stdout:8/221: getdents d15/d17 0 2024-04-25T02:09:01.607 INFO:tasks.workunit.client.1.smithi112.stdout:4/72: unlink d2/f8 0 2024-04-25T02:09:01.608 INFO:tasks.workunit.client.1.smithi112.stdout:0/331: dread da/d13/f65 [0,4194304] 0 2024-04-25T02:09:01.608 INFO:tasks.workunit.client.1.smithi112.stdout:0/332: write da/d13/d23/d2b/f60 [579245,109666] 0 2024-04-25T02:09:01.608 INFO:tasks.workunit.client.1.smithi112.stdout:0/333: stat da/d1d/d2e/c3e 0 2024-04-25T02:09:01.609 INFO:tasks.workunit.client.1.smithi112.stdout:5/159: mknod d1/d2/c3c 0 2024-04-25T02:09:01.609 INFO:tasks.workunit.client.1.smithi112.stdout:5/160: dread - d1/d2/f31 zero size 2024-04-25T02:09:01.609 INFO:tasks.workunit.client.1.smithi112.stdout:5/161: rename d1 to d1/d16/d22/d3d 22 2024-04-25T02:09:01.610 INFO:tasks.workunit.client.1.smithi112.stdout:6/183: dwrite d0/f2b [4194304,4194304] 0 2024-04-25T02:09:01.614 INFO:tasks.workunit.client.1.smithi112.stdout:0/334: creat da/d1d/d2e/d40/d49/d4f/d58/f6e x:0 0 0 2024-04-25T02:09:01.616 INFO:tasks.workunit.client.1.smithi112.stdout:8/222: read fe [3740463,87207] 0 2024-04-25T02:09:01.616 INFO:tasks.workunit.client.1.smithi112.stdout:8/223: write d15/d17/f48 [825451,90957] 0 2024-04-25T02:09:01.617 INFO:tasks.workunit.client.1.smithi112.stdout:4/73: link d2/fd d2/f13 0 2024-04-25T02:09:01.621 INFO:tasks.workunit.client.1.smithi112.stdout:0/335: link da/c4a da/d1d/d2e/d40/d49/d4f/c6f 0 2024-04-25T02:09:01.622 INFO:tasks.workunit.client.1.smithi112.stdout:8/224: rename d15/l3e to d15/d17/d41/l4a 0 2024-04-25T02:09:01.624 INFO:tasks.workunit.client.1.smithi112.stdout:9/165: rmdir d1/d13 39 2024-04-25T02:09:01.624 INFO:tasks.workunit.client.1.smithi112.stdout:9/166: truncate d1/df/f29 567011 0 2024-04-25T02:09:01.625 INFO:tasks.workunit.client.1.smithi112.stdout:4/74: symlink d2/d12/l14 0 2024-04-25T02:09:01.630 INFO:tasks.workunit.client.1.smithi112.stdout:9/167: symlink d1/l3e 0 2024-04-25T02:09:01.631 INFO:tasks.workunit.client.1.smithi112.stdout:5/162: dwrite d1/d2/d4/f9 [0,4194304] 0 2024-04-25T02:09:01.631 INFO:tasks.workunit.client.1.smithi112.stdout:6/184: dwrite d0/f17 [0,4194304] 0 2024-04-25T02:09:01.631 INFO:tasks.workunit.client.1.smithi112.stdout:6/185: chown d0/l22 1090420591 1 2024-04-25T02:09:01.631 INFO:tasks.workunit.client.1.smithi112.stdout:6/186: chown d0/d2/d4/la 3 1 2024-04-25T02:09:01.631 INFO:tasks.workunit.client.1.smithi112.stdout:6/187: readlink d0/d2/d4/l23 0 2024-04-25T02:09:01.633 INFO:tasks.workunit.client.1.smithi112.stdout:8/225: write d15/d26/d37/f3f [2861819,66182] 0 2024-04-25T02:09:01.635 INFO:tasks.workunit.client.1.smithi112.stdout:8/226: fdatasync d15/d26/d37/f3f 0 2024-04-25T02:09:01.635 INFO:tasks.workunit.client.1.smithi112.stdout:6/188: write d0/d2/f15 [47814,96389] 0 2024-04-25T02:09:01.641 INFO:tasks.workunit.client.1.smithi112.stdout:4/75: dread d2/fc [0,4194304] 0 2024-04-25T02:09:01.643 INFO:tasks.workunit.client.1.smithi112.stdout:4/76: read d2/fc [1332914,32536] 0 2024-04-25T02:09:01.643 INFO:tasks.workunit.client.1.smithi112.stdout:4/77: chown d2/cf 14578 1 2024-04-25T02:09:01.644 INFO:tasks.workunit.client.1.smithi112.stdout:4/78: write d2/fc [2381472,88409] 0 2024-04-25T02:09:01.644 INFO:tasks.workunit.client.1.smithi112.stdout:4/79: write d2/f11 [466080,23124] 0 2024-04-25T02:09:01.647 INFO:tasks.workunit.client.1.smithi112.stdout:9/168: getdents d1/d13 0 2024-04-25T02:09:01.655 INFO:tasks.workunit.client.1.smithi112.stdout:0/336: rmdir da 39 2024-04-25T02:09:01.657 INFO:tasks.workunit.client.1.smithi112.stdout:5/163: getdents d1 0 2024-04-25T02:09:01.659 INFO:tasks.workunit.client.1.smithi112.stdout:8/227: rename d15/f30 to d15/d17/d1a/f4b 0 2024-04-25T02:09:01.659 INFO:tasks.workunit.client.1.smithi112.stdout:8/228: write d15/d26/d37/f38 [4789567,113835] 0 2024-04-25T02:09:01.660 INFO:tasks.workunit.client.1.smithi112.stdout:6/189: rmdir d0/d36 39 2024-04-25T02:09:01.666 INFO:tasks.workunit.client.1.smithi112.stdout:5/164: write d1/d2/f36 [2004449,40202] 0 2024-04-25T02:09:01.669 INFO:tasks.workunit.client.1.smithi112.stdout:6/190: write d0/f17 [330498,516] 0 2024-04-25T02:09:01.669 INFO:tasks.workunit.client.1.smithi112.stdout:6/191: chown d0/c14 995418 1 2024-04-25T02:09:01.681 INFO:tasks.workunit.client.1.smithi112.stdout:0/337: rmdir da/d13/d45 39 2024-04-25T02:09:01.681 INFO:tasks.workunit.client.1.smithi112.stdout:0/338: fsync da/d13/f17 0 2024-04-25T02:09:01.682 INFO:tasks.workunit.client.1.smithi112.stdout:8/229: creat d15/d35/f4c x:0 0 0 2024-04-25T02:09:01.685 INFO:tasks.workunit.client.1.smithi112.stdout:4/80: rmdir d2 39 2024-04-25T02:09:01.685 INFO:tasks.workunit.client.1.smithi112.stdout:4/81: write d2/f11 [600170,58615] 0 2024-04-25T02:09:01.687 INFO:tasks.workunit.client.1.smithi112.stdout:5/165: rmdir d1/d2/d28 39 2024-04-25T02:09:01.690 INFO:tasks.workunit.client.1.smithi112.stdout:4/82: unlink d2/d12/l14 0 2024-04-25T02:09:01.692 INFO:tasks.workunit.client.1.smithi112.stdout:0/339: read da/d1d/d2e/d40/f41 [3920541,101712] 0 2024-04-25T02:09:01.692 INFO:tasks.workunit.client.1.smithi112.stdout:5/166: link d1/d2/d4/la d1/d16/l3e 0 2024-04-25T02:09:01.692 INFO:tasks.workunit.client.1.smithi112.stdout:5/167: readlink d1/d16/l3e 0 2024-04-25T02:09:01.692 INFO:tasks.workunit.client.1.smithi112.stdout:8/230: dread f7 [0,4194304] 0 2024-04-25T02:09:01.692 INFO:tasks.workunit.client.1.smithi112.stdout:6/192: dwrite d0/d2/d2c/f2e [0,4194304] 0 2024-04-25T02:09:01.693 INFO:tasks.workunit.client.1.smithi112.stdout:4/83: creat d2/f15 x:0 0 0 2024-04-25T02:09:01.806 INFO:tasks.workunit.client.1.smithi112.stdout:0/340: getdents da/d1d/d2e/d40/d49 0 2024-04-25T02:09:01.806 INFO:tasks.workunit.client.1.smithi112.stdout:0/341: chown da/d1d/d2e/d40/f41 94160075 1 2024-04-25T02:09:01.806 INFO:tasks.workunit.client.1.smithi112.stdout:0/342: write da/d1d/f43 [2066517,108489] 0 2024-04-25T02:09:01.806 INFO:tasks.workunit.client.1.smithi112.stdout:0/343: write da/d13/d1e/f3f [71632,7507] 0 2024-04-25T02:09:01.887 INFO:tasks.workunit.client.1.smithi112.stdout:8/231: creat d15/d40/f4d x:0 0 0 2024-04-25T02:09:01.887 INFO:tasks.workunit.client.1.smithi112.stdout:8/232: readlink d15/l21 0 2024-04-25T02:09:01.944 INFO:tasks.workunit.client.1.smithi112.stdout:6/193: mkdir d0/d2/d2c/d41 0 2024-04-25T02:09:01.947 INFO:tasks.workunit.client.1.smithi112.stdout:4/84: creat d2/d12/f16 x:0 0 0 2024-04-25T02:09:01.947 INFO:tasks.workunit.client.1.smithi112.stdout:4/85: write d2/fe [5139230,116371] 0 2024-04-25T02:09:01.947 INFO:tasks.workunit.client.1.smithi112.stdout:4/86: dread - d2/f9 zero size 2024-04-25T02:09:01.947 INFO:tasks.workunit.client.1.smithi112.stdout:6/194: dread d0/d36/f37 [0,4194304] 0 2024-04-25T02:09:01.948 INFO:tasks.workunit.client.1.smithi112.stdout:4/87: dread d2/fb [0,4194304] 0 2024-04-25T02:09:01.949 INFO:tasks.workunit.client.1.smithi112.stdout:0/344: symlink da/d1d/d2e/d40/d49/d4f/l70 0 2024-04-25T02:09:01.960 INFO:tasks.workunit.client.1.smithi112.stdout:8/233: symlink d15/d17/d24/l4e 0 2024-04-25T02:09:01.973 INFO:tasks.workunit.client.1.smithi112.stdout:4/88: mkdir d2/d17 0 2024-04-25T02:09:01.973 INFO:tasks.workunit.client.1.smithi112.stdout:4/89: dread - d2/d12/f16 zero size 2024-04-25T02:09:01.973 INFO:tasks.workunit.client.1.smithi112.stdout:4/90: truncate d2/f11 795978 0 2024-04-25T02:09:01.976 INFO:tasks.workunit.client.1.smithi112.stdout:8/234: rmdir d15/d17/d1a 39 2024-04-25T02:09:01.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:01 smithi077 ceph-mon[26330]: pgmap v260: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 203 MiB/s rd, 270 MiB/s wr, 351 op/s 2024-04-25T02:09:01.981 INFO:tasks.workunit.client.1.smithi112.stdout:4/91: unlink d2/f11 0 2024-04-25T02:09:01.982 INFO:tasks.workunit.client.1.smithi112.stdout:4/92: getdents d2/d17 0 2024-04-25T02:09:01.987 INFO:tasks.workunit.client.1.smithi112.stdout:4/93: mkdir d2/d12/d18 0 2024-04-25T02:09:02.010 INFO:tasks.workunit.client.1.smithi112.stdout:4/94: dwrite d2/f6 [0,4194304] 0 2024-04-25T02:09:02.011 INFO:tasks.workunit.client.1.smithi112.stdout:4/95: fsync d2/f13 0 2024-04-25T02:09:02.014 INFO:tasks.workunit.client.1.smithi112.stdout:4/96: dread d2/fd [0,4194304] 0 2024-04-25T02:09:02.021 INFO:tasks.workunit.client.1.smithi112.stdout:4/97: link d2/fb d2/d12/f19 0 2024-04-25T02:09:02.027 INFO:tasks.workunit.client.1.smithi112.stdout:4/98: rename d2/fc to d2/f1a 0 2024-04-25T02:09:02.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:01 smithi112 ceph-mon[33313]: pgmap v260: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 203 MiB/s rd, 270 MiB/s wr, 351 op/s 2024-04-25T02:09:02.031 INFO:tasks.workunit.client.1.smithi112.stdout:4/99: mkdir d2/d12/d18/d1b 0 2024-04-25T02:09:02.033 INFO:tasks.workunit.client.1.smithi112.stdout:4/100: write d2/fd [14714,15266] 0 2024-04-25T02:09:02.034 INFO:tasks.workunit.client.1.smithi112.stdout:4/101: dread d2/fb [0,4194304] 0 2024-04-25T02:09:02.034 INFO:tasks.workunit.client.1.smithi112.stdout:4/102: write d2/fb [872160,64036] 0 2024-04-25T02:09:02.038 INFO:tasks.workunit.client.1.smithi112.stdout:4/103: rmdir d2/d12/d18 39 2024-04-25T02:09:02.038 INFO:tasks.workunit.client.1.smithi112.stdout:4/104: stat d2/c3 0 2024-04-25T02:09:02.038 INFO:tasks.workunit.client.1.smithi112.stdout:4/105: rename d2/d17 to d2/d17/d1c 22 2024-04-25T02:09:02.042 INFO:tasks.workunit.client.1.smithi112.stdout:4/106: unlink d2/f10 0 2024-04-25T02:09:02.046 INFO:tasks.workunit.client.1.smithi112.stdout:4/107: unlink d2/f6 0 2024-04-25T02:09:02.049 INFO:tasks.workunit.client.1.smithi112.stdout:4/108: unlink d2/f13 0 2024-04-25T02:09:02.066 INFO:tasks.workunit.client.1.smithi112.stdout:4/109: dwrite d2/d12/f16 [0,4194304] 0 2024-04-25T02:09:02.071 INFO:tasks.workunit.client.1.smithi112.stdout:4/110: creat d2/f1d x:0 0 0 2024-04-25T02:09:02.075 INFO:tasks.workunit.client.1.smithi112.stdout:6/195: mkdir d0/d42 0 2024-04-25T02:09:02.075 INFO:tasks.workunit.client.1.smithi112.stdout:6/196: write d0/d2/d4/d28/f34 [86103,81783] 0 2024-04-25T02:09:02.078 INFO:tasks.workunit.client.1.smithi112.stdout:6/197: link d0/f27 d0/d2/d1f/f43 0 2024-04-25T02:09:02.078 INFO:tasks.workunit.client.1.smithi112.stdout:6/198: getdents d0/d2/d2c/d41 0 2024-04-25T02:09:02.085 INFO:tasks.workunit.client.1.smithi112.stdout:6/199: dread d0/d2/d4/dd/f26 [0,4194304] 0 2024-04-25T02:09:02.089 INFO:tasks.workunit.client.1.smithi112.stdout:6/200: dread d0/f17 [0,4194304] 0 2024-04-25T02:09:02.089 INFO:tasks.workunit.client.1.smithi112.stdout:6/201: write d0/d2/d4/f1d [1230276,62178] 0 2024-04-25T02:09:02.091 INFO:tasks.workunit.client.1.smithi112.stdout:5/168: rmdir d1/d2 39 2024-04-25T02:09:02.091 INFO:tasks.workunit.client.1.smithi112.stdout:5/169: fsync d1/d16/f19 0 2024-04-25T02:09:02.092 INFO:tasks.workunit.client.1.smithi112.stdout:5/170: truncate d1/f3b 2144967 0 2024-04-25T02:09:02.097 INFO:tasks.workunit.client.1.smithi112.stdout:6/202: dread d0/d2/d2c/f2e [0,4194304] 0 2024-04-25T02:09:02.098 INFO:tasks.workunit.client.1.smithi112.stdout:6/203: mknod d0/d32/c44 0 2024-04-25T02:09:02.100 INFO:tasks.workunit.client.1.smithi112.stdout:6/204: mkdir d0/d32/d45 0 2024-04-25T02:09:02.100 INFO:tasks.workunit.client.1.smithi112.stdout:6/205: chown d0/d2/c9 0 1 2024-04-25T02:09:02.101 INFO:tasks.workunit.client.1.smithi112.stdout:5/171: write d1/d2/d4/d1d/f2a [4183024,36207] 0 2024-04-25T02:09:02.101 INFO:tasks.workunit.client.1.smithi112.stdout:5/172: chown d1/d2/d4/l2e 7791 1 2024-04-25T02:09:02.103 INFO:tasks.workunit.client.1.smithi112.stdout:5/173: truncate d1/d2/f33 2999157 0 2024-04-25T02:09:02.105 INFO:tasks.workunit.client.1.smithi112.stdout:5/174: mkdir d1/d3f 0 2024-04-25T02:09:02.116 INFO:tasks.workunit.client.1.smithi112.stdout:6/206: dwrite d0/f2b [8388608,4194304] 0 2024-04-25T02:09:02.116 INFO:tasks.workunit.client.1.smithi112.stdout:6/207: fdatasync d0/d2/d3b/f40 0 2024-04-25T02:09:02.118 INFO:tasks.workunit.client.1.smithi112.stdout:6/208: rename d0/d2/d4/c2a to d0/c46 0 2024-04-25T02:09:02.125 INFO:tasks.workunit.client.1.smithi112.stdout:6/209: read d0/d2/d2c/f33 [3466663,71242] 0 2024-04-25T02:09:02.129 INFO:tasks.workunit.client.1.smithi112.stdout:4/111: rmdir d2 39 2024-04-25T02:09:02.129 INFO:tasks.workunit.client.1.smithi112.stdout:4/112: dread - d2/f1d zero size 2024-04-25T02:09:02.129 INFO:tasks.workunit.client.1.smithi112.stdout:4/113: chown d2/fe 6 1 2024-04-25T02:09:02.130 INFO:tasks.workunit.client.1.smithi112.stdout:2/50: sync 2024-04-25T02:09:02.135 INFO:tasks.workunit.client.1.smithi112.stdout:2/51: mknod d3/de/df/c13 0 2024-04-25T02:09:02.137 INFO:tasks.workunit.client.1.smithi112.stdout:2/52: symlink d3/da/l14 0 2024-04-25T02:09:02.137 INFO:tasks.workunit.client.1.smithi112.stdout:2/53: fsync f1 0 2024-04-25T02:09:02.146 INFO:tasks.workunit.client.1.smithi112.stdout:4/114: dwrite d2/d12/f19 [0,4194304] 0 2024-04-25T02:09:02.146 INFO:tasks.workunit.client.1.smithi112.stdout:4/115: chown d2/c7 1802200348 1 2024-04-25T02:09:02.159 INFO:tasks.workunit.client.1.smithi112.stdout:2/54: dwrite d3/de/df/f12 [0,4194304] 0 2024-04-25T02:09:02.160 INFO:tasks.workunit.client.1.smithi112.stdout:4/116: write d2/fb [1206282,109991] 0 2024-04-25T02:09:02.168 INFO:tasks.workunit.client.1.smithi112.stdout:2/55: rename f1 to d3/da/f15 0 2024-04-25T02:09:02.170 INFO:tasks.workunit.client.1.smithi112.stdout:4/117: read d2/fd [345177,20226] 0 2024-04-25T02:09:02.175 INFO:tasks.workunit.client.1.smithi112.stdout:5/175: dwrite d1/f8 [0,4194304] 0 2024-04-25T02:09:02.176 INFO:tasks.workunit.client.1.smithi112.stdout:2/56: symlink d3/da/dc/l16 0 2024-04-25T02:09:02.183 INFO:tasks.workunit.client.1.smithi112.stdout:5/176: symlink d1/d2/l40 0 2024-04-25T02:09:02.183 INFO:tasks.workunit.client.1.smithi112.stdout:5/177: getdents d1/d3f 0 2024-04-25T02:09:02.183 INFO:tasks.workunit.client.1.smithi112.stdout:2/57: creat d3/de/f17 x:0 0 0 2024-04-25T02:09:02.183 INFO:tasks.workunit.client.1.smithi112.stdout:2/58: dread - d3/de/f17 zero size 2024-04-25T02:09:02.186 INFO:tasks.workunit.client.1.smithi112.stdout:5/178: mkdir d1/d41 0 2024-04-25T02:09:02.196 INFO:tasks.workunit.client.1.smithi112.stdout:6/210: dwrite d0/f1a [0,4194304] 0 2024-04-25T02:09:02.199 INFO:tasks.workunit.client.1.smithi112.stdout:6/211: mknod d0/d32/d45/c47 0 2024-04-25T02:09:02.199 INFO:tasks.workunit.client.1.smithi112.stdout:6/212: creat d0/d2/d4/dd/f48 x:0 0 0 2024-04-25T02:09:02.199 INFO:tasks.workunit.client.1.smithi112.stdout:6/213: write d0/f30 [71550,64828] 0 2024-04-25T02:09:02.199 INFO:tasks.workunit.client.1.smithi112.stdout:6/214: write d0/d2/d4/d28/f34 [998217,118229] 0 2024-04-25T02:09:02.199 INFO:tasks.workunit.client.1.smithi112.stdout:6/215: chown d0/d2/d4/f11 23 1 2024-04-25T02:09:02.199 INFO:tasks.workunit.client.1.smithi112.stdout:5/179: write d1/d2/d4/fe [260920,89201] 0 2024-04-25T02:09:02.199 INFO:tasks.workunit.client.1.smithi112.stdout:4/118: dwrite d2/f9 [0,4194304] 0 2024-04-25T02:09:02.204 INFO:tasks.workunit.client.1.smithi112.stdout:5/180: symlink d1/d3f/l42 0 2024-04-25T02:09:02.205 INFO:tasks.workunit.client.1.smithi112.stdout:5/181: dread d1/d16/d22/f37 [0,4194304] 0 2024-04-25T02:09:02.205 INFO:tasks.workunit.client.1.smithi112.stdout:5/182: write d1/d2/d4/d1d/f25 [829803,65958] 0 2024-04-25T02:09:02.211 INFO:tasks.workunit.client.1.smithi112.stdout:6/216: dwrite d0/d2/d4/f13 [0,4194304] 0 2024-04-25T02:09:02.218 INFO:tasks.workunit.client.1.smithi112.stdout:5/183: creat d1/d2/f43 x:0 0 0 2024-04-25T02:09:02.219 INFO:tasks.workunit.client.1.smithi112.stdout:6/217: symlink d0/d2/d4/dd/l49 0 2024-04-25T02:09:02.219 INFO:tasks.workunit.client.1.smithi112.stdout:6/218: truncate d0/d2/d3b/f40 472802 0 2024-04-25T02:09:02.220 INFO:tasks.workunit.client.1.smithi112.stdout:5/184: fdatasync d1/d2/d4/d1d/f25 0 2024-04-25T02:09:02.221 INFO:tasks.workunit.client.1.smithi112.stdout:5/185: truncate d1/f29 1152783 0 2024-04-25T02:09:02.221 INFO:tasks.workunit.client.1.smithi112.stdout:4/119: rename d2/d12/d18 to d2/d1e 0 2024-04-25T02:09:02.221 INFO:tasks.workunit.client.1.smithi112.stdout:6/219: dread d0/f27 [0,4194304] 0 2024-04-25T02:09:02.222 INFO:tasks.workunit.client.1.smithi112.stdout:5/186: getdents d1 0 2024-04-25T02:09:02.222 INFO:tasks.workunit.client.1.smithi112.stdout:4/120: rmdir d2 39 2024-04-25T02:09:02.223 INFO:tasks.workunit.client.1.smithi112.stdout:6/220: symlink d0/d2/d4/l4a 0 2024-04-25T02:09:02.224 INFO:tasks.workunit.client.1.smithi112.stdout:5/187: symlink d1/d16/d22/l44 0 2024-04-25T02:09:02.225 INFO:tasks.workunit.client.1.smithi112.stdout:6/221: fdatasync d0/f30 0 2024-04-25T02:09:02.226 INFO:tasks.workunit.client.1.smithi112.stdout:4/121: creat d2/f1f x:0 0 0 2024-04-25T02:09:02.227 INFO:tasks.workunit.client.1.smithi112.stdout:5/188: mkdir d1/d2/d45 0 2024-04-25T02:09:02.230 INFO:tasks.workunit.client.1.smithi112.stdout:6/222: symlink d0/d2/d4/dd/l4b 0 2024-04-25T02:09:02.231 INFO:tasks.workunit.client.1.smithi112.stdout:6/223: mknod d0/d2/d4/c4c 0 2024-04-25T02:09:02.232 INFO:tasks.workunit.client.1.smithi112.stdout:6/224: getdents d0/d36 0 2024-04-25T02:09:02.233 INFO:tasks.workunit.client.1.smithi112.stdout:4/122: dread d2/f9 [0,4194304] 0 2024-04-25T02:09:02.234 INFO:tasks.workunit.client.1.smithi112.stdout:6/225: link d0/d2/d4/dd/c21 d0/d32/c4d 0 2024-04-25T02:09:02.235 INFO:tasks.workunit.client.1.smithi112.stdout:4/123: mkdir d2/d17/d20 0 2024-04-25T02:09:02.238 INFO:tasks.workunit.client.1.smithi112.stdout:4/124: rename d2/fd to d2/d1e/d1b/f21 0 2024-04-25T02:09:02.239 INFO:tasks.workunit.client.1.smithi112.stdout:6/226: getdents d0/d2/d4/d28 0 2024-04-25T02:09:02.260 INFO:tasks.workunit.client.1.smithi112.stdout:5/189: dwrite d1/d2/f43 [0,4194304] 0 2024-04-25T02:09:02.261 INFO:tasks.workunit.client.1.smithi112.stdout:4/125: dwrite d2/fe [0,4194304] 0 2024-04-25T02:09:02.264 INFO:tasks.workunit.client.1.smithi112.stdout:4/126: getdents d2/d1e 0 2024-04-25T02:09:02.267 INFO:tasks.workunit.client.1.smithi112.stdout:5/190: write d1/d2/d4/ff [396973,9918] 0 2024-04-25T02:09:02.274 INFO:tasks.workunit.client.1.smithi112.stdout:5/191: rename d1/d16/f17 to d1/f46 0 2024-04-25T02:09:02.274 INFO:tasks.workunit.client.1.smithi112.stdout:5/192: dread - d1/d16/f20 zero size 2024-04-25T02:09:02.274 INFO:tasks.workunit.client.1.smithi112.stdout:5/193: chown d1/d2/d4/d1d/f25 11 1 2024-04-25T02:09:02.280 INFO:tasks.workunit.client.1.smithi112.stdout:6/227: getdents d0/d32 0 2024-04-25T02:09:02.282 INFO:tasks.workunit.client.1.smithi112.stdout:6/228: mknod d0/d2/d3b/c4e 0 2024-04-25T02:09:02.282 INFO:tasks.workunit.client.1.smithi112.stdout:6/229: stat d0/l22 0 2024-04-25T02:09:02.282 INFO:tasks.workunit.client.1.smithi112.stdout:6/230: truncate d0/f1a 4826296 0 2024-04-25T02:09:02.282 INFO:tasks.workunit.client.1.smithi112.stdout:6/231: write d0/f30 [180620,84862] 0 2024-04-25T02:09:02.283 INFO:tasks.workunit.client.1.smithi112.stdout:6/232: write d0/d2/d4/f11 [568913,100637] 0 2024-04-25T02:09:02.284 INFO:tasks.workunit.client.1.smithi112.stdout:4/127: dwrite d2/fb [0,4194304] 0 2024-04-25T02:09:02.284 INFO:tasks.workunit.client.1.smithi112.stdout:4/128: readlink - no filename 2024-04-25T02:09:02.285 INFO:tasks.workunit.client.1.smithi112.stdout:5/194: read d1/d2/d4/d1d/f34 [344040,75356] 0 2024-04-25T02:09:02.285 INFO:tasks.workunit.client.1.smithi112.stdout:5/195: stat d1/d16/f19 0 2024-04-25T02:09:02.287 INFO:tasks.workunit.client.1.smithi112.stdout:6/233: rename d0/f27 to d0/d2/d4/f4f 0 2024-04-25T02:09:02.287 INFO:tasks.workunit.client.1.smithi112.stdout:6/234: fsync d0/d2/d4/d28/f34 0 2024-04-25T02:09:02.288 INFO:tasks.workunit.client.1.smithi112.stdout:4/129: mkdir d2/d12/d22 0 2024-04-25T02:09:02.291 INFO:tasks.workunit.client.1.smithi112.stdout:5/196: creat d1/d41/f47 x:0 0 0 2024-04-25T02:09:02.292 INFO:tasks.workunit.client.1.smithi112.stdout:6/235: rename d0/d2/d4/l4a to d0/d32/d45/l50 0 2024-04-25T02:09:02.293 INFO:tasks.workunit.client.1.smithi112.stdout:4/130: rmdir d2/d1e 39 2024-04-25T02:09:02.296 INFO:tasks.workunit.client.1.smithi112.stdout:5/197: mknod d1/d41/c48 0 2024-04-25T02:09:02.298 INFO:tasks.workunit.client.1.smithi112.stdout:6/236: creat d0/d32/d45/f51 x:0 0 0 2024-04-25T02:09:02.298 INFO:tasks.workunit.client.1.smithi112.stdout:6/237: creat d0/d32/d45/f52 x:0 0 0 2024-04-25T02:09:02.300 INFO:tasks.workunit.client.1.smithi112.stdout:4/131: creat d2/d17/d20/f23 x:0 0 0 2024-04-25T02:09:02.302 INFO:tasks.workunit.client.1.smithi112.stdout:5/198: symlink d1/d16/d22/l49 0 2024-04-25T02:09:02.304 INFO:tasks.workunit.client.1.smithi112.stdout:5/199: symlink d1/d3f/l4a 0 2024-04-25T02:09:02.307 INFO:tasks.workunit.client.1.smithi112.stdout:5/200: link d1/d2/d4/fe d1/d16/d22/f4b 0 2024-04-25T02:09:02.309 INFO:tasks.workunit.client.1.smithi112.stdout:6/238: dread d0/f2b [4194304,4194304] 0 2024-04-25T02:09:02.310 INFO:tasks.workunit.client.1.smithi112.stdout:6/239: getdents d0/d32 0 2024-04-25T02:09:02.314 INFO:tasks.workunit.client.1.smithi112.stdout:6/240: rename d0/d42 to d0/d2/d3b/d53 0 2024-04-25T02:09:02.314 INFO:tasks.workunit.client.1.smithi112.stdout:5/201: dread d1/d16/f19 [0,4194304] 0 2024-04-25T02:09:02.316 INFO:tasks.workunit.client.1.smithi112.stdout:5/202: creat d1/d2/d45/f4c x:0 0 0 2024-04-25T02:09:02.316 INFO:tasks.workunit.client.1.smithi112.stdout:5/203: stat d1/c35 0 2024-04-25T02:09:02.317 INFO:tasks.workunit.client.1.smithi112.stdout:6/241: symlink d0/d32/l54 0 2024-04-25T02:09:02.319 INFO:tasks.workunit.client.1.smithi112.stdout:4/132: dwrite d2/f9 [0,4194304] 0 2024-04-25T02:09:02.319 INFO:tasks.workunit.client.1.smithi112.stdout:4/133: chown d2/f15 529738507 1 2024-04-25T02:09:02.319 INFO:tasks.workunit.client.1.smithi112.stdout:4/134: read - d2/d17/d20/f23 zero size 2024-04-25T02:09:02.319 INFO:tasks.workunit.client.1.smithi112.stdout:5/204: creat d1/d16/f4d x:0 0 0 2024-04-25T02:09:02.320 INFO:tasks.workunit.client.1.smithi112.stdout:6/242: mknod d0/d2/d2c/c55 0 2024-04-25T02:09:02.326 INFO:tasks.workunit.client.1.smithi112.stdout:4/135: symlink d2/d17/l24 0 2024-04-25T02:09:02.329 INFO:tasks.workunit.client.1.smithi112.stdout:6/243: symlink d0/d2/d4/d28/l56 0 2024-04-25T02:09:02.329 INFO:tasks.workunit.client.1.smithi112.stdout:6/244: write d0/d2/d4/f11 [1306444,40150] 0 2024-04-25T02:09:02.329 INFO:tasks.workunit.client.1.smithi112.stdout:6/245: chown d0/d2/d2c/f33 892451 1 2024-04-25T02:09:02.333 INFO:tasks.workunit.client.1.smithi112.stdout:4/136: mkdir d2/d17/d25 0 2024-04-25T02:09:02.337 INFO:tasks.workunit.client.1.smithi112.stdout:9/169: sync 2024-04-25T02:09:02.337 INFO:tasks.workunit.client.1.smithi112.stdout:9/170: truncate d1/d13/f18 1623191 0 2024-04-25T02:09:02.337 INFO:tasks.workunit.client.1.smithi112.stdout:7/96: sync 2024-04-25T02:09:02.337 INFO:tasks.workunit.client.1.smithi112.stdout:3/110: sync 2024-04-25T02:09:02.338 INFO:tasks.workunit.client.1.smithi112.stdout:1/229: sync 2024-04-25T02:09:02.338 INFO:tasks.workunit.client.1.smithi112.stdout:1/230: write d7/d9/d1e/de/f17 [2227172,18473] 0 2024-04-25T02:09:02.340 INFO:tasks.workunit.client.1.smithi112.stdout:6/246: creat d0/d2/d4/d28/f57 x:0 0 0 2024-04-25T02:09:02.342 INFO:tasks.workunit.client.1.smithi112.stdout:4/137: mkdir d2/d17/d20/d26 0 2024-04-25T02:09:02.346 INFO:tasks.workunit.client.1.smithi112.stdout:7/97: mknod d7/dd/c1b 0 2024-04-25T02:09:02.346 INFO:tasks.workunit.client.1.smithi112.stdout:7/98: creat d7/dd/f1c x:0 0 0 2024-04-25T02:09:02.347 INFO:tasks.workunit.client.1.smithi112.stdout:1/231: symlink d7/d9/d1f/l48 0 2024-04-25T02:09:02.348 INFO:tasks.workunit.client.1.smithi112.stdout:1/232: chown d7/d9/d1e/de/f3b 3197 1 2024-04-25T02:09:02.349 INFO:tasks.workunit.client.1.smithi112.stdout:6/247: truncate d0/f17 3626094 0 2024-04-25T02:09:02.356 INFO:tasks.workunit.client.1.smithi112.stdout:4/138: read d2/f9 [2944395,117376] 0 2024-04-25T02:09:02.356 INFO:tasks.workunit.client.1.smithi112.stdout:4/139: fdatasync d2/f1f 0 2024-04-25T02:09:02.358 INFO:tasks.workunit.client.1.smithi112.stdout:7/99: dread d7/dd/f10 [0,4194304] 0 2024-04-25T02:09:02.360 INFO:tasks.workunit.client.1.smithi112.stdout:7/100: truncate d7/dd/f10 1479187 0 2024-04-25T02:09:02.363 INFO:tasks.workunit.client.1.smithi112.stdout:9/171: dwrite d1/f1c [8388608,4194304] 0 2024-04-25T02:09:02.363 INFO:tasks.workunit.client.1.smithi112.stdout:9/172: write d1/d13/f37 [797004,37456] 0 2024-04-25T02:09:02.366 INFO:tasks.workunit.client.1.smithi112.stdout:9/173: creat d1/d13/f3f x:0 0 0 2024-04-25T02:09:02.366 INFO:tasks.workunit.client.1.smithi112.stdout:9/174: truncate d1/df/f2d 831875 0 2024-04-25T02:09:02.367 INFO:tasks.workunit.client.1.smithi112.stdout:3/111: dwrite d12/d13/f1c [0,4194304] 0 2024-04-25T02:09:02.368 INFO:tasks.workunit.client.1.smithi112.stdout:9/175: write d1/f27 [1541339,64109] 0 2024-04-25T02:09:02.368 INFO:tasks.workunit.client.1.smithi112.stdout:9/176: dread - d1/df/f23 zero size 2024-04-25T02:09:02.375 INFO:tasks.workunit.client.1.smithi112.stdout:9/177: rmdir d1/df 39 2024-04-25T02:09:02.377 INFO:tasks.workunit.client.1.smithi112.stdout:9/178: creat d1/df/f40 x:0 0 0 2024-04-25T02:09:02.378 INFO:tasks.workunit.client.1.smithi112.stdout:3/112: write fe [765174,64815] 0 2024-04-25T02:09:02.378 INFO:tasks.workunit.client.1.smithi112.stdout:3/113: chown d12/f1d 2 1 2024-04-25T02:09:02.379 INFO:tasks.workunit.client.1.smithi112.stdout:7/101: dwrite d7/fc [0,4194304] 0 2024-04-25T02:09:02.379 INFO:tasks.workunit.client.1.smithi112.stdout:7/102: chown d7/f16 15700 1 2024-04-25T02:09:02.380 INFO:tasks.workunit.client.1.smithi112.stdout:3/114: truncate d12/f14 1930397 0 2024-04-25T02:09:02.383 INFO:tasks.workunit.client.1.smithi112.stdout:9/179: dread d1/fa [0,4194304] 0 2024-04-25T02:09:02.393 INFO:tasks.workunit.client.1.smithi112.stdout:7/103: read d7/f19 [3500983,21402] 0 2024-04-25T02:09:02.393 INFO:tasks.workunit.client.1.smithi112.stdout:7/104: chown d7 51271864 1 2024-04-25T02:09:02.393 INFO:tasks.workunit.client.1.smithi112.stdout:7/105: chown d7/f8 42266 1 2024-04-25T02:09:02.393 INFO:tasks.workunit.client.1.smithi112.stdout:7/106: creat d7/dd/f1d x:0 0 0 2024-04-25T02:09:02.393 INFO:tasks.workunit.client.1.smithi112.stdout:7/107: chown d7/f16 1699 1 2024-04-25T02:09:02.393 INFO:tasks.workunit.client.1.smithi112.stdout:7/108: fsync d7/f13 0 2024-04-25T02:09:02.393 INFO:tasks.workunit.client.1.smithi112.stdout:7/109: creat d7/f1e x:0 0 0 2024-04-25T02:09:02.393 INFO:tasks.workunit.client.1.smithi112.stdout:7/110: creat d7/f1f x:0 0 0 2024-04-25T02:09:02.393 INFO:tasks.workunit.client.1.smithi112.stdout:7/111: chown d7/dd/c1b 21 1 2024-04-25T02:09:02.393 INFO:tasks.workunit.client.1.smithi112.stdout:7/112: chown d7/f13 14273 1 2024-04-25T02:09:02.394 INFO:tasks.workunit.client.1.smithi112.stdout:7/113: dread - d7/dd/f1c zero size 2024-04-25T02:09:02.394 INFO:tasks.workunit.client.1.smithi112.stdout:7/114: truncate d7/f19 5208064 0 2024-04-25T02:09:02.403 INFO:tasks.workunit.client.1.smithi112.stdout:7/115: mkdir d7/dd/d20 0 2024-04-25T02:09:02.404 INFO:tasks.workunit.client.1.smithi112.stdout:7/116: creat d7/dd/f21 x:0 0 0 2024-04-25T02:09:02.404 INFO:tasks.workunit.client.1.smithi112.stdout:7/117: truncate d7/f1f 407374 0 2024-04-25T02:09:02.404 INFO:tasks.workunit.client.1.smithi112.stdout:7/118: fsync d7/f8 0 2024-04-25T02:09:02.404 INFO:tasks.workunit.client.1.smithi112.stdout:7/119: creat d7/f22 x:0 0 0 2024-04-25T02:09:02.404 INFO:tasks.workunit.client.1.smithi112.stdout:7/120: truncate d7/f22 643779 0 2024-04-25T02:09:02.404 INFO:tasks.workunit.client.1.smithi112.stdout:7/121: dread d7/f1f [0,4194304] 0 2024-04-25T02:09:02.404 INFO:tasks.workunit.client.1.smithi112.stdout:7/122: creat d7/f23 x:0 0 0 2024-04-25T02:09:02.404 INFO:tasks.workunit.client.1.smithi112.stdout:7/123: creat d7/f24 x:0 0 0 2024-04-25T02:09:02.409 INFO:tasks.workunit.client.1.smithi112.stdout:3/115: dwrite d12/d13/f1c [0,4194304] 0 2024-04-25T02:09:02.409 INFO:tasks.workunit.client.1.smithi112.stdout:9/180: dwrite d1/f4 [0,4194304] 0 2024-04-25T02:09:02.415 INFO:tasks.workunit.client.1.smithi112.stdout:7/124: mkdir d7/d25 0 2024-04-25T02:09:02.416 INFO:tasks.workunit.client.1.smithi112.stdout:7/125: creat d7/dd/f26 x:0 0 0 2024-04-25T02:09:02.416 INFO:tasks.workunit.client.1.smithi112.stdout:7/126: creat d7/f27 x:0 0 0 2024-04-25T02:09:02.418 INFO:tasks.workunit.client.1.smithi112.stdout:1/233: truncate d7/d9/f16 364227 0 2024-04-25T02:09:02.421 INFO:tasks.workunit.client.1.smithi112.stdout:9/181: mkdir d1/d13/d41 0 2024-04-25T02:09:02.425 INFO:tasks.workunit.client.1.smithi112.stdout:3/116: write d12/d13/f1b [1922358,47858] 0 2024-04-25T02:09:02.433 INFO:tasks.workunit.client.1.smithi112.stdout:3/117: getdents d12 0 2024-04-25T02:09:02.434 INFO:tasks.workunit.client.1.smithi112.stdout:3/118: creat d12/d13/f21 x:0 0 0 2024-04-25T02:09:02.436 INFO:tasks.workunit.client.1.smithi112.stdout:1/234: dwrite d7/d9/d1e/f1a [0,4194304] 0 2024-04-25T02:09:02.440 INFO:tasks.workunit.client.1.smithi112.stdout:1/235: mknod d7/d9/d26/c49 0 2024-04-25T02:09:02.443 INFO:tasks.workunit.client.1.smithi112.stdout:1/236: rmdir d7/d9/d1e/d45 0 2024-04-25T02:09:02.450 INFO:tasks.workunit.client.1.smithi112.stdout:1/237: dread d7/d9/d1f/f36 [0,4194304] 0 2024-04-25T02:09:02.450 INFO:tasks.workunit.client.1.smithi112.stdout:1/238: write d7/d9/d1e/f12 [1420050,4805] 0 2024-04-25T02:09:02.453 INFO:tasks.workunit.client.1.smithi112.stdout:1/239: symlink d7/d9/d26/l4a 0 2024-04-25T02:09:02.453 INFO:tasks.workunit.client.1.smithi112.stdout:1/240: chown f2 791595724 1 2024-04-25T02:09:02.455 INFO:tasks.workunit.client.1.smithi112.stdout:1/241: truncate f4 4841992 0 2024-04-25T02:09:02.455 INFO:tasks.workunit.client.1.smithi112.stdout:9/182: getdents d1/d13 0 2024-04-25T02:09:02.459 INFO:tasks.workunit.client.1.smithi112.stdout:1/242: mkdir d7/d4b 0 2024-04-25T02:09:02.459 INFO:tasks.workunit.client.1.smithi112.stdout:1/243: write d7/f2c [1225122,13532] 0 2024-04-25T02:09:02.461 INFO:tasks.workunit.client.1.smithi112.stdout:9/183: link d1/d13/l35 d1/l42 0 2024-04-25T02:09:02.475 INFO:tasks.workunit.client.1.smithi112.stdout:1/244: dwrite f6 [4194304,4194304] 0 2024-04-25T02:09:02.500 INFO:tasks.workunit.client.1.smithi112.stdout:9/184: mkdir d1/df/d3c/d43 0 2024-04-25T02:09:02.502 INFO:tasks.workunit.client.1.smithi112.stdout:3/119: rmdir d12/d13 39 2024-04-25T02:09:02.506 INFO:tasks.workunit.client.1.smithi112.stdout:1/245: truncate d7/d9/f16 57656 0 2024-04-25T02:09:02.508 INFO:tasks.workunit.client.1.smithi112.stdout:9/185: stat d1/c2a 0 2024-04-25T02:09:02.508 INFO:tasks.workunit.client.1.smithi112.stdout:9/186: truncate d1/f31 669883 0 2024-04-25T02:09:02.513 INFO:tasks.workunit.client.1.smithi112.stdout:1/246: creat d7/d9/d26/f4c x:0 0 0 2024-04-25T02:09:02.513 INFO:tasks.workunit.client.1.smithi112.stdout:1/247: chown d7/d9 6450069 1 2024-04-25T02:09:02.518 INFO:tasks.workunit.client.1.smithi112.stdout:1/248: read d7/f2c [1102901,27413] 0 2024-04-25T02:09:02.518 INFO:tasks.workunit.client.1.smithi112.stdout:1/249: creat d7/f4d x:0 0 0 2024-04-25T02:09:02.530 INFO:tasks.workunit.client.1.smithi112.stdout:1/250: dread f2 [0,4194304] 0 2024-04-25T02:09:02.540 INFO:tasks.workunit.client.1.smithi112.stdout:3/120: dwrite d12/d13/f1c [0,4194304] 0 2024-04-25T02:09:02.540 INFO:tasks.workunit.client.1.smithi112.stdout:9/187: dwrite d1/f12 [4194304,4194304] 0 2024-04-25T02:09:02.549 INFO:tasks.workunit.client.1.smithi112.stdout:3/121: write d12/d13/f1c [3137925,40460] 0 2024-04-25T02:09:02.552 INFO:tasks.workunit.client.1.smithi112.stdout:3/122: symlink d12/d1f/l22 0 2024-04-25T02:09:02.553 INFO:tasks.workunit.client.1.smithi112.stdout:9/188: dwrite d1/f12 [8388608,4194304] 0 2024-04-25T02:09:02.555 INFO:tasks.workunit.client.1.smithi112.stdout:3/123: mknod d12/c23 0 2024-04-25T02:09:02.556 INFO:tasks.workunit.client.1.smithi112.stdout:3/124: mkdir d12/d1f/d24 0 2024-04-25T02:09:02.557 INFO:tasks.workunit.client.1.smithi112.stdout:9/189: dread d1/d13/f26 [0,4194304] 0 2024-04-25T02:09:02.557 INFO:tasks.workunit.client.1.smithi112.stdout:9/190: write d1/f31 [1187451,8220] 0 2024-04-25T02:09:02.562 INFO:tasks.workunit.client.1.smithi112.stdout:3/125: dread fe [0,4194304] 0 2024-04-25T02:09:02.567 INFO:tasks.workunit.client.1.smithi112.stdout:3/126: write d12/f14 [83044,62792] 0 2024-04-25T02:09:02.576 INFO:tasks.workunit.client.1.smithi112.stdout:9/191: write d1/f38 [1147598,17498] 0 2024-04-25T02:09:02.593 INFO:tasks.workunit.client.1.smithi112.stdout:3/127: dwrite f5 [8388608,4194304] 0 2024-04-25T02:09:02.593 INFO:tasks.workunit.client.1.smithi112.stdout:3/128: chown d12/d13/l1e 0 1 2024-04-25T02:09:02.593 INFO:tasks.workunit.client.1.smithi112.stdout:9/192: dwrite d1/f2c [0,4194304] 0 2024-04-25T02:09:02.594 INFO:tasks.workunit.client.1.smithi112.stdout:3/129: link f5 d12/d1f/f25 0 2024-04-25T02:09:02.594 INFO:tasks.workunit.client.1.smithi112.stdout:3/130: write d12/d13/f1b [2805145,91909] 0 2024-04-25T02:09:02.596 INFO:tasks.workunit.client.1.smithi112.stdout:9/193: unlink d1/f1e 0 2024-04-25T02:09:02.597 INFO:tasks.workunit.client.1.smithi112.stdout:9/194: mknod d1/d13/d41/c44 0 2024-04-25T02:09:02.599 INFO:tasks.workunit.client.1.smithi112.stdout:3/131: mknod d12/c26 0 2024-04-25T02:09:02.599 INFO:tasks.workunit.client.1.smithi112.stdout:3/132: chown d12/d13/f1c 3144 1 2024-04-25T02:09:02.601 INFO:tasks.workunit.client.1.smithi112.stdout:3/133: mkdir d12/d1f/d27 0 2024-04-25T02:09:02.601 INFO:tasks.workunit.client.1.smithi112.stdout:3/134: write d12/d13/f20 [820755,5340] 0 2024-04-25T02:09:02.603 INFO:tasks.workunit.client.1.smithi112.stdout:3/135: rename fe to d12/d1f/d27/f28 0 2024-04-25T02:09:02.606 INFO:tasks.workunit.client.1.smithi112.stdout:3/136: write d12/f19 [792417,127567] 0 2024-04-25T02:09:02.618 INFO:tasks.workunit.client.1.smithi112.stdout:9/195: dwrite d1/df/f11 [4194304,4194304] 0 2024-04-25T02:09:02.619 INFO:tasks.workunit.client.1.smithi112.stdout:9/196: mknod d1/c45 0 2024-04-25T02:09:02.620 INFO:tasks.workunit.client.1.smithi112.stdout:3/137: dread d12/d1f/f25 [8388608,4194304] 0 2024-04-25T02:09:02.620 INFO:tasks.workunit.client.1.smithi112.stdout:3/138: chown l11 16691 1 2024-04-25T02:09:02.621 INFO:tasks.workunit.client.1.smithi112.stdout:9/197: fdatasync d1/f31 0 2024-04-25T02:09:02.621 INFO:tasks.workunit.client.1.smithi112.stdout:9/198: fsync d1/d13/f20 0 2024-04-25T02:09:02.630 INFO:tasks.workunit.client.1.smithi112.stdout:9/199: dread d1/df/f11 [4194304,4194304] 0 2024-04-25T02:09:02.630 INFO:tasks.workunit.client.1.smithi112.stdout:9/200: chown d1/df/f11 3799387 1 2024-04-25T02:09:02.632 INFO:tasks.workunit.client.1.smithi112.stdout:9/201: mkdir d1/df/d3c/d46 0 2024-04-25T02:09:02.635 INFO:tasks.workunit.client.1.smithi112.stdout:9/202: rename d1/d13/f3d to d1/d13/f47 0 2024-04-25T02:09:02.635 INFO:tasks.workunit.client.1.smithi112.stdout:9/203: chown d1/df/l22 13335490 1 2024-04-25T02:09:02.636 INFO:tasks.workunit.client.1.smithi112.stdout:3/139: truncate d12/d13/f1c 3817862 0 2024-04-25T02:09:02.643 INFO:tasks.workunit.client.1.smithi112.stdout:3/140: link d12/c23 d12/c29 0 2024-04-25T02:09:02.646 INFO:tasks.workunit.client.1.smithi112.stdout:3/141: rmdir d12/d1f/d24 0 2024-04-25T02:09:02.646 INFO:tasks.workunit.client.1.smithi112.stdout:3/142: dread - d12/d13/f21 zero size 2024-04-25T02:09:02.647 INFO:tasks.workunit.client.1.smithi112.stdout:9/204: truncate d1/f4 1988523 0 2024-04-25T02:09:02.654 INFO:tasks.workunit.client.1.smithi112.stdout:3/143: rename d12/d13/l1e to d12/l2a 0 2024-04-25T02:09:02.654 INFO:tasks.workunit.client.1.smithi112.stdout:3/144: chown d12 0 1 2024-04-25T02:09:02.658 INFO:tasks.workunit.client.1.smithi112.stdout:3/145: creat d12/d1f/d27/f2b x:0 0 0 2024-04-25T02:09:02.658 INFO:tasks.workunit.client.1.smithi112.stdout:3/146: stat d12/d1f/d27/f28 0 2024-04-25T02:09:02.658 INFO:tasks.workunit.client.1.smithi112.stdout:3/147: rename d12 to d12/d13/d2c 22 2024-04-25T02:09:02.660 INFO:tasks.workunit.client.1.smithi112.stdout:3/148: creat d12/f2d x:0 0 0 2024-04-25T02:09:02.661 INFO:tasks.workunit.client.1.smithi112.stdout:9/205: truncate d1/f12 10139352 0 2024-04-25T02:09:02.701 INFO:tasks.workunit.client.1.smithi112.stdout:3/149: dwrite d12/d1f/d27/f28 [0,4194304] 0 2024-04-25T02:09:02.701 INFO:tasks.workunit.client.1.smithi112.stdout:3/150: write d12/d13/f1b [3519051,81356] 0 2024-04-25T02:09:02.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:02 smithi112 ceph-mon[33313]: Standby manager daemon smithi112.cswrxs restarted 2024-04-25T02:09:02.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:02 smithi112 ceph-mon[33313]: Standby manager daemon smithi112.cswrxs started 2024-04-25T02:09:02.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:02 smithi112 ceph-mon[33313]: from='mgr.? 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.cswrxs/crt"}]: dispatch 2024-04-25T02:09:02.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:02 smithi112 ceph-mon[33313]: from='mgr.? 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T02:09:02.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:02 smithi112 ceph-mon[33313]: from='mgr.? 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.cswrxs/key"}]: dispatch 2024-04-25T02:09:02.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:02 smithi112 ceph-mon[33313]: from='mgr.? 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T02:09:02.790 INFO:tasks.workunit.client.1.smithi112.stdout:3/151: fdatasync d12/f1d 0 2024-04-25T02:09:02.804 INFO:tasks.workunit.client.1.smithi112.stdout:3/152: dwrite d12/d1f/d27/f2b [0,4194304] 0 2024-04-25T02:09:02.817 INFO:tasks.workunit.client.1.smithi112.stdout:3/153: creat d12/d13/f2e x:0 0 0 2024-04-25T02:09:02.819 INFO:tasks.workunit.client.1.smithi112.stdout:3/154: rmdir d12/d1f 39 2024-04-25T02:09:02.819 INFO:tasks.workunit.client.1.smithi112.stdout:3/155: fsync d12/d13/f1c 0 2024-04-25T02:09:02.819 INFO:tasks.workunit.client.1.smithi112.stdout:3/156: write d12/d13/f21 [1038975,5438] 0 2024-04-25T02:09:02.819 INFO:tasks.workunit.client.1.smithi112.stdout:3/157: chown d12/c23 5 1 2024-04-25T02:09:02.819 INFO:tasks.workunit.client.1.smithi112.stdout:3/158: fsync d12/d1f/d27/f28 0 2024-04-25T02:09:02.819 INFO:tasks.workunit.client.1.smithi112.stdout:3/159: chown d12/d13/l16 78 1 2024-04-25T02:09:02.829 INFO:tasks.workunit.client.1.smithi112.stdout:3/160: write d12/d1f/d27/f2b [3808604,72834] 0 2024-04-25T02:09:02.829 INFO:tasks.workunit.client.1.smithi112.stdout:3/161: read - d12/f2d zero size 2024-04-25T02:09:02.841 INFO:tasks.workunit.client.1.smithi112.stdout:3/162: write d12/f1d [2840181,121854] 0 2024-04-25T02:09:02.841 INFO:tasks.workunit.client.1.smithi112.stdout:9/206: dwrite d1/f10 [0,4194304] 0 2024-04-25T02:09:02.843 INFO:tasks.workunit.client.1.smithi112.stdout:3/163: stat l11 0 2024-04-25T02:09:02.847 INFO:tasks.workunit.client.1.smithi112.stdout:3/164: mknod d12/d1f/d27/c2f 0 2024-04-25T02:09:02.854 INFO:tasks.workunit.client.1.smithi112.stdout:3/165: dread f5 [8388608,4194304] 0 2024-04-25T02:09:02.854 INFO:tasks.workunit.client.1.smithi112.stdout:3/166: creat d12/d13/f30 x:0 0 0 2024-04-25T02:09:02.854 INFO:tasks.workunit.client.1.smithi112.stdout:3/167: creat d12/d13/f31 x:0 0 0 2024-04-25T02:09:02.854 INFO:tasks.workunit.client.1.smithi112.stdout:3/168: write d12/d13/f21 [456218,69640] 0 2024-04-25T02:09:02.857 INFO:tasks.workunit.client.1.smithi112.stdout:8/235: sync 2024-04-25T02:09:02.858 INFO:tasks.workunit.client.1.smithi112.stdout:0/345: sync 2024-04-25T02:09:02.858 INFO:tasks.workunit.client.1.smithi112.stdout:0/346: read da/d13/f17 [704925,523] 0 2024-04-25T02:09:02.858 INFO:tasks.workunit.client.1.smithi112.stdout:0/347: readlink da/d13/d1e/l59 0 2024-04-25T02:09:02.859 INFO:tasks.workunit.client.1.smithi112.stdout:0/348: stat da/c31 0 2024-04-25T02:09:02.859 INFO:tasks.workunit.client.1.smithi112.stdout:0/349: write da/d1d/d2e/d40/d49/d4f/d58/f6e [287578,81274] 0 2024-04-25T02:09:02.859 INFO:tasks.workunit.client.1.smithi112.stdout:0/350: fsync da/d13/d23/d2b/d24/f33 0 2024-04-25T02:09:02.859 INFO:tasks.workunit.client.1.smithi112.stdout:9/207: dwrite d1/f2b [0,4194304] 0 2024-04-25T02:09:02.859 INFO:tasks.workunit.client.1.smithi112.stdout:9/208: chown d1/le 160537739 1 2024-04-25T02:09:02.860 INFO:tasks.workunit.client.1.smithi112.stdout:8/236: mkdir d15/d26/d4f 0 2024-04-25T02:09:02.862 INFO:tasks.workunit.client.1.smithi112.stdout:0/351: creat da/d1d/d2e/d40/d49/d4f/f71 x:0 0 0 2024-04-25T02:09:02.867 INFO:tasks.workunit.client.1.smithi112.stdout:0/352: mknod da/d1d/c72 0 2024-04-25T02:09:02.869 INFO:tasks.workunit.client.1.smithi112.stdout:0/353: creat da/d1d/d2e/d40/d49/d6b/f73 x:0 0 0 2024-04-25T02:09:02.869 INFO:tasks.workunit.client.1.smithi112.stdout:8/237: write d15/d17/d1a/f1d [3745969,44509] 0 2024-04-25T02:09:02.870 INFO:tasks.workunit.client.1.smithi112.stdout:0/354: creat da/d13/d45/f74 x:0 0 0 2024-04-25T02:09:02.871 INFO:tasks.workunit.client.1.smithi112.stdout:8/238: mknod d15/d40/c50 0 2024-04-25T02:09:02.872 INFO:tasks.workunit.client.1.smithi112.stdout:9/209: dwrite d1/d13/f47 [0,4194304] 0 2024-04-25T02:09:02.872 INFO:tasks.workunit.client.1.smithi112.stdout:0/355: truncate da/d13/d23/d2b/f50 5450727 0 2024-04-25T02:09:02.873 INFO:tasks.workunit.client.1.smithi112.stdout:8/239: symlink d15/d26/l51 0 2024-04-25T02:09:02.877 INFO:tasks.workunit.client.1.smithi112.stdout:9/210: mkdir d1/d48 0 2024-04-25T02:09:02.877 INFO:tasks.workunit.client.1.smithi112.stdout:9/211: fsync d1/fd 0 2024-04-25T02:09:02.879 INFO:tasks.workunit.client.1.smithi112.stdout:0/356: link da/d13/d45/c64 da/d1d/d2e/d40/d49/d4f/d58/d6d/c75 0 2024-04-25T02:09:02.880 INFO:tasks.workunit.client.1.smithi112.stdout:8/240: mkdir d15/d26/d37/d52 0 2024-04-25T02:09:02.880 INFO:tasks.workunit.client.1.smithi112.stdout:8/241: readlink d15/d17/d24/l4e 0 2024-04-25T02:09:02.880 INFO:tasks.workunit.client.1.smithi112.stdout:8/242: truncate d15/f28 1379220 0 2024-04-25T02:09:02.881 INFO:tasks.workunit.client.1.smithi112.stdout:8/243: creat d15/d26/f53 x:0 0 0 2024-04-25T02:09:02.881 INFO:tasks.workunit.client.1.smithi112.stdout:8/244: fsync d15/d26/d37/f38 0 2024-04-25T02:09:02.881 INFO:tasks.workunit.client.1.smithi112.stdout:9/212: rename d1/df/c1a to d1/d13/c49 0 2024-04-25T02:09:02.886 INFO:tasks.workunit.client.1.smithi112.stdout:0/357: symlink da/d1d/d2e/d40/d49/d4f/d58/l76 0 2024-04-25T02:09:02.891 INFO:tasks.workunit.client.1.smithi112.stdout:0/358: mkdir da/d13/d23/d77 0 2024-04-25T02:09:02.891 INFO:tasks.workunit.client.1.smithi112.stdout:0/359: write da/d1d/d2e/d40/f41 [5107578,35821] 0 2024-04-25T02:09:02.891 INFO:tasks.workunit.client.1.smithi112.stdout:0/360: fdatasync da/d13/d45/f74 0 2024-04-25T02:09:02.892 INFO:tasks.workunit.client.1.smithi112.stdout:0/361: mkdir da/d13/d23/d2b/d78 0 2024-04-25T02:09:02.893 INFO:tasks.workunit.client.1.smithi112.stdout:0/362: creat da/d13/d23/d2b/d78/f79 x:0 0 0 2024-04-25T02:09:02.894 INFO:tasks.workunit.client.1.smithi112.stdout:8/245: dwrite d15/d17/f48 [0,4194304] 0 2024-04-25T02:09:02.895 INFO:tasks.workunit.client.1.smithi112.stdout:0/363: mkdir da/d13/d45/d5e/d7a 0 2024-04-25T02:09:02.896 INFO:tasks.workunit.client.1.smithi112.stdout:8/246: write d15/f2c [983235,9695] 0 2024-04-25T02:09:02.903 INFO:tasks.workunit.client.1.smithi112.stdout:0/364: creat da/d1d/d2e/d40/d49/d4f/d58/f7b x:0 0 0 2024-04-25T02:09:02.903 INFO:tasks.workunit.client.1.smithi112.stdout:0/365: creat da/d1d/d2e/d40/d49/d4f/d58/f7c x:0 0 0 2024-04-25T02:09:02.904 INFO:tasks.workunit.client.1.smithi112.stdout:0/366: dread da/d13/d1e/f3c [0,4194304] 0 2024-04-25T02:09:02.906 INFO:tasks.workunit.client.1.smithi112.stdout:0/367: symlink da/d1d/d2e/d40/d49/d5f/l7d 0 2024-04-25T02:09:02.906 INFO:tasks.workunit.client.1.smithi112.stdout:0/368: chown da/d13 18 1 2024-04-25T02:09:02.907 INFO:tasks.workunit.client.1.smithi112.stdout:0/369: dread da/d13/d1e/f4e [0,4194304] 0 2024-04-25T02:09:02.907 INFO:tasks.workunit.client.1.smithi112.stdout:0/370: dread - da/d1d/d2e/d40/d49/d4f/d58/f7c zero size 2024-04-25T02:09:02.907 INFO:tasks.workunit.client.1.smithi112.stdout:0/371: write da/d1d/f43 [2788781,36007] 0 2024-04-25T02:09:02.909 INFO:tasks.workunit.client.1.smithi112.stdout:0/372: creat da/d13/f7e x:0 0 0 2024-04-25T02:09:02.911 INFO:tasks.workunit.client.1.smithi112.stdout:0/373: rename da/d1d/c67 to da/d1d/d2e/c7f 0 2024-04-25T02:09:02.912 INFO:tasks.workunit.client.1.smithi112.stdout:8/247: dwrite d15/d17/d1a/f4b [0,4194304] 0 2024-04-25T02:09:02.912 INFO:tasks.workunit.client.1.smithi112.stdout:8/248: dread - d15/d17/f1e zero size 2024-04-25T02:09:02.912 INFO:tasks.workunit.client.1.smithi112.stdout:8/249: chown d15/d17 60 1 2024-04-25T02:09:02.914 INFO:tasks.workunit.client.1.smithi112.stdout:0/374: mkdir da/d13/d23/d2b/d80 0 2024-04-25T02:09:02.915 INFO:tasks.workunit.client.1.smithi112.stdout:8/250: mknod d15/d17/d41/c54 0 2024-04-25T02:09:02.915 INFO:tasks.workunit.client.1.smithi112.stdout:8/251: readlink d15/d17/d1a/l3d 0 2024-04-25T02:09:02.916 INFO:tasks.workunit.client.1.smithi112.stdout:0/375: creat da/f81 x:0 0 0 2024-04-25T02:09:02.920 INFO:tasks.workunit.client.1.smithi112.stdout:0/376: dread da/d13/d23/d2b/d24/f2a [0,4194304] 0 2024-04-25T02:09:02.921 INFO:tasks.workunit.client.1.smithi112.stdout:0/377: mkdir da/d1d/d2e/d40/d49/d4f/d82 0 2024-04-25T02:09:02.922 INFO:tasks.workunit.client.1.smithi112.stdout:0/378: dread da/d13/d1e/f3f [0,4194304] 0 2024-04-25T02:09:02.923 INFO:tasks.workunit.client.1.smithi112.stdout:8/252: dread f10 [0,4194304] 0 2024-04-25T02:09:02.924 INFO:tasks.workunit.client.1.smithi112.stdout:8/253: truncate fd 4659435 0 2024-04-25T02:09:02.929 INFO:tasks.workunit.client.1.smithi112.stdout:8/254: mknod d15/d17/d24/c55 0 2024-04-25T02:09:02.930 INFO:tasks.workunit.client.1.smithi112.stdout:8/255: fsync f6 0 2024-04-25T02:09:02.944 INFO:tasks.workunit.client.1.smithi112.stdout:0/379: dwrite da/d13/d1e/f3f [0,4194304] 0 2024-04-25T02:09:02.944 INFO:tasks.workunit.client.1.smithi112.stdout:0/380: truncate da/d1d/d2e/d40/d49/d4f/f71 995175 0 2024-04-25T02:09:02.944 INFO:tasks.workunit.client.1.smithi112.stdout:8/256: dwrite d15/d17/d24/f27 [0,4194304] 0 2024-04-25T02:09:02.954 INFO:tasks.workunit.client.1.smithi112.stdout:8/257: write d15/d17/d41/f45 [6046112,47002] 0 2024-04-25T02:09:02.954 INFO:tasks.workunit.client.1.smithi112.stdout:8/258: dread - d15/d35/f4c zero size 2024-04-25T02:09:02.957 INFO:tasks.workunit.client.1.smithi112.stdout:8/259: mkdir d15/d35/d56 0 2024-04-25T02:09:02.960 INFO:tasks.workunit.client.1.smithi112.stdout:8/260: symlink d15/d35/d56/l57 0 2024-04-25T02:09:02.960 INFO:tasks.workunit.client.1.smithi112.stdout:8/261: chown d15/d17/d24/c46 8167 1 2024-04-25T02:09:02.960 INFO:tasks.workunit.client.1.smithi112.stdout:8/262: stat d15/d40/c50 0 2024-04-25T02:09:02.960 INFO:tasks.workunit.client.1.smithi112.stdout:8/263: creat d15/d40/f58 x:0 0 0 2024-04-25T02:09:02.960 INFO:tasks.workunit.client.1.smithi112.stdout:8/264: write d15/d26/d37/f38 [3178120,124494] 0 2024-04-25T02:09:02.962 INFO:tasks.workunit.client.1.smithi112.stdout:8/265: creat d15/d35/d56/f59 x:0 0 0 2024-04-25T02:09:02.962 INFO:tasks.workunit.client.1.smithi112.stdout:8/266: stat f6 0 2024-04-25T02:09:02.967 INFO:tasks.workunit.client.1.smithi112.stdout:8/267: getdents d15/d26 0 2024-04-25T02:09:02.968 INFO:tasks.workunit.client.1.smithi112.stdout:8/268: stat d15/d26/d37/f38 0 2024-04-25T02:09:02.974 INFO:tasks.workunit.client.1.smithi112.stdout:8/269: write d15/d17/f48 [4171739,14658] 0 2024-04-25T02:09:02.975 INFO:tasks.workunit.client.1.smithi112.stdout:8/270: mkdir d15/d26/d5a 0 2024-04-25T02:09:02.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:02 smithi077 ceph-mon[26330]: Standby manager daemon smithi112.cswrxs restarted 2024-04-25T02:09:02.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:02 smithi077 ceph-mon[26330]: Standby manager daemon smithi112.cswrxs started 2024-04-25T02:09:02.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:02 smithi077 ceph-mon[26330]: from='mgr.? 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.cswrxs/crt"}]: dispatch 2024-04-25T02:09:02.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:02 smithi077 ceph-mon[26330]: from='mgr.? 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T02:09:02.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:02 smithi077 ceph-mon[26330]: from='mgr.? 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.cswrxs/key"}]: dispatch 2024-04-25T02:09:02.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:02 smithi077 ceph-mon[26330]: from='mgr.? 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T02:09:02.981 INFO:tasks.workunit.client.1.smithi112.stdout:8/271: dread d15/f42 [0,4194304] 0 2024-04-25T02:09:02.995 INFO:tasks.workunit.client.1.smithi112.stdout:8/272: dwrite d15/d17/d1a/f1d [0,4194304] 0 2024-04-25T02:09:02.996 INFO:tasks.workunit.client.1.smithi112.stdout:8/273: mknod d15/c5b 0 2024-04-25T02:09:02.996 INFO:tasks.workunit.client.1.smithi112.stdout:8/274: dread - d15/d17/d1a/f2f zero size 2024-04-25T02:09:02.996 INFO:tasks.workunit.client.1.smithi112.stdout:8/275: dread - d15/d17/f1e zero size 2024-04-25T02:09:03.001 INFO:tasks.workunit.client.1.smithi112.stdout:8/276: dread f10 [0,4194304] 0 2024-04-25T02:09:03.002 INFO:tasks.workunit.client.1.smithi112.stdout:8/277: mkdir d15/d35/d5c 0 2024-04-25T02:09:03.003 INFO:tasks.workunit.client.1.smithi112.stdout:8/278: rmdir d15/d26 39 2024-04-25T02:09:03.003 INFO:tasks.workunit.client.1.smithi112.stdout:8/279: fdatasync f7 0 2024-04-25T02:09:03.003 INFO:tasks.workunit.client.1.smithi112.stdout:8/280: creat d15/d35/f5d x:0 0 0 2024-04-25T02:09:03.004 INFO:tasks.workunit.client.1.smithi112.stdout:8/281: write d15/d26/d37/f38 [4544446,42661] 0 2024-04-25T02:09:03.006 INFO:tasks.workunit.client.1.smithi112.stdout:8/282: mkdir d15/d35/d5c/d5e 0 2024-04-25T02:09:03.007 INFO:tasks.workunit.client.1.smithi112.stdout:8/283: truncate d15/d26/f29 580660 0 2024-04-25T02:09:03.008 INFO:tasks.workunit.client.1.smithi112.stdout:2/59: sync 2024-04-25T02:09:03.008 INFO:tasks.workunit.client.1.smithi112.stdout:2/60: stat d3/c7 0 2024-04-25T02:09:03.016 INFO:tasks.workunit.client.1.smithi112.stdout:8/284: dread d15/d17/d1a/f1d [0,4194304] 0 2024-04-25T02:09:03.019 INFO:tasks.workunit.client.1.smithi112.stdout:2/61: write d3/de/df/f12 [2880156,22990] 0 2024-04-25T02:09:03.022 INFO:tasks.workunit.client.1.smithi112.stdout:8/285: write d15/d17/d41/f45 [709117,99787] 0 2024-04-25T02:09:03.026 INFO:tasks.workunit.client.1.smithi112.stdout:8/286: unlink d15/d26/d37/f3f 0 2024-04-25T02:09:03.026 INFO:tasks.workunit.client.1.smithi112.stdout:8/287: readlink d15/d17/d1a/l25 0 2024-04-25T02:09:03.036 INFO:tasks.workunit.client.1.smithi112.stdout:2/62: dwrite d3/f9 [0,4194304] 0 2024-04-25T02:09:03.038 INFO:tasks.workunit.client.1.smithi112.stdout:2/63: mkdir d3/da/d18 0 2024-04-25T02:09:03.038 INFO:tasks.workunit.client.1.smithi112.stdout:2/64: getdents d3/da/dc 0 2024-04-25T02:09:03.041 INFO:tasks.workunit.client.1.smithi112.stdout:2/65: symlink d3/l19 0 2024-04-25T02:09:03.041 INFO:tasks.workunit.client.1.smithi112.stdout:2/66: fsync d3/da/f15 0 2024-04-25T02:09:03.044 INFO:tasks.workunit.client.1.smithi112.stdout:2/67: rename d3/da/l14 to d3/da/dc/l1a 0 2024-04-25T02:09:03.046 INFO:tasks.workunit.client.1.smithi112.stdout:2/68: truncate d3/da/f15 3117536 0 2024-04-25T02:09:03.049 INFO:tasks.workunit.client.1.smithi112.stdout:2/69: creat d3/f1b x:0 0 0 2024-04-25T02:09:03.054 INFO:tasks.workunit.client.1.smithi112.stdout:8/288: dwrite f7 [4194304,4194304] 0 2024-04-25T02:09:03.058 INFO:tasks.workunit.client.1.smithi112.stdout:8/289: rename d15/d26/d5a to d15/d35/d5f 0 2024-04-25T02:09:03.069 INFO:tasks.workunit.client.1.smithi112.stdout:2/70: dwrite d3/de/df/f12 [0,4194304] 0 2024-04-25T02:09:03.071 INFO:tasks.workunit.client.1.smithi112.stdout:2/71: link d3/f9 d3/da/f1c 0 2024-04-25T02:09:03.072 INFO:tasks.workunit.client.1.smithi112.stdout:2/72: symlink d3/da/l1d 0 2024-04-25T02:09:03.072 INFO:tasks.workunit.client.1.smithi112.stdout:2/73: write d3/f1b [955790,37893] 0 2024-04-25T02:09:03.072 INFO:tasks.workunit.client.1.smithi112.stdout:2/74: stat d3/da/l10 0 2024-04-25T02:09:03.072 INFO:tasks.workunit.client.1.smithi112.stdout:2/75: dread - d3/de/f17 zero size 2024-04-25T02:09:03.073 INFO:tasks.workunit.client.1.smithi112.stdout:2/76: write d3/f1b [1319172,121691] 0 2024-04-25T02:09:03.073 INFO:tasks.workunit.client.1.smithi112.stdout:8/290: truncate d15/d17/d1a/f1d 950297 0 2024-04-25T02:09:03.074 INFO:tasks.workunit.client.1.smithi112.stdout:8/291: creat d15/d40/f60 x:0 0 0 2024-04-25T02:09:03.076 INFO:tasks.workunit.client.1.smithi112.stdout:8/292: unlink d15/l39 0 2024-04-25T02:09:03.076 INFO:tasks.workunit.client.1.smithi112.stdout:8/293: creat d15/d35/f61 x:0 0 0 2024-04-25T02:09:03.079 INFO:tasks.workunit.client.1.smithi112.stdout:2/77: dread d3/da/f15 [0,4194304] 0 2024-04-25T02:09:03.130 INFO:tasks.workunit.client.1.smithi112.stdout:8/294: dwrite f10 [4194304,4194304] 0 2024-04-25T02:09:03.144 INFO:tasks.workunit.client.1.smithi112.stdout:2/78: truncate d3/de/df/f12 2115383 0 2024-04-25T02:09:03.145 INFO:tasks.workunit.client.1.smithi112.stdout:8/295: truncate d15/d17/f3b 5520565 0 2024-04-25T02:09:03.146 INFO:tasks.workunit.client.1.smithi112.stdout:8/296: dread - d15/d35/f61 zero size 2024-04-25T02:09:03.148 INFO:tasks.workunit.client.1.smithi112.stdout:2/79: rename d3/c8 to d3/da/c1e 0 2024-04-25T02:09:03.153 INFO:tasks.workunit.client.1.smithi112.stdout:2/80: link d3/da/dc/l1a d3/da/d18/l1f 0 2024-04-25T02:09:03.155 INFO:tasks.workunit.client.1.smithi112.stdout:2/81: mkdir d3/da/dc/d20 0 2024-04-25T02:09:03.156 INFO:tasks.workunit.client.1.smithi112.stdout:2/82: creat d3/da/dc/d20/f21 x:0 0 0 2024-04-25T02:09:03.157 INFO:tasks.workunit.client.1.smithi112.stdout:2/83: write d3/f1b [319628,30505] 0 2024-04-25T02:09:03.159 INFO:tasks.workunit.client.1.smithi112.stdout:2/84: symlink d3/de/df/l22 0 2024-04-25T02:09:03.161 INFO:tasks.workunit.client.1.smithi112.stdout:8/297: dwrite d15/d17/d1a/f4b [0,4194304] 0 2024-04-25T02:09:03.161 INFO:tasks.workunit.client.1.smithi112.stdout:2/85: rename d3/da/dc/l16 to d3/da/dc/l23 0 2024-04-25T02:09:03.167 INFO:tasks.workunit.client.1.smithi112.stdout:2/86: symlink d3/l24 0 2024-04-25T02:09:03.167 INFO:tasks.workunit.client.1.smithi112.stdout:2/87: chown d3/da/dc 7452655 1 2024-04-25T02:09:03.171 INFO:tasks.workunit.client.1.smithi112.stdout:2/88: write d3/da/f15 [684578,60813] 0 2024-04-25T02:09:03.171 INFO:tasks.workunit.client.1.smithi112.stdout:2/89: dread - d3/da/dc/d20/f21 zero size 2024-04-25T02:09:03.172 INFO:tasks.workunit.client.1.smithi112.stdout:2/90: mkdir d3/de/df/d25 0 2024-04-25T02:09:03.172 INFO:tasks.workunit.client.1.smithi112.stdout:2/91: dread - d3/da/dc/d20/f21 zero size 2024-04-25T02:09:03.172 INFO:tasks.workunit.client.1.smithi112.stdout:2/92: readlink d3/de/df/l22 0 2024-04-25T02:09:03.172 INFO:tasks.workunit.client.1.smithi112.stdout:2/93: rmdir d3/da/d18 39 2024-04-25T02:09:03.175 INFO:tasks.workunit.client.1.smithi112.stdout:2/94: symlink d3/l26 0 2024-04-25T02:09:03.177 INFO:tasks.workunit.client.1.smithi112.stdout:2/95: dread d3/f1b [0,4194304] 0 2024-04-25T02:09:03.178 INFO:tasks.workunit.client.1.smithi112.stdout:2/96: write d3/da/dc/d20/f21 [310118,45291] 0 2024-04-25T02:09:03.179 INFO:tasks.workunit.client.1.smithi112.stdout:2/97: mkdir d3/da/d18/d27 0 2024-04-25T02:09:03.190 INFO:tasks.workunit.client.1.smithi112.stdout:2/98: rmdir d3 39 2024-04-25T02:09:03.191 INFO:tasks.workunit.client.1.smithi112.stdout:2/99: rmdir d3/de/df 39 2024-04-25T02:09:03.193 INFO:tasks.workunit.client.1.smithi112.stdout:2/100: rename d3/c7 to d3/de/df/d25/c28 0 2024-04-25T02:09:03.194 INFO:tasks.workunit.client.1.smithi112.stdout:2/101: creat d3/da/f29 x:0 0 0 2024-04-25T02:09:03.198 INFO:tasks.workunit.client.1.smithi112.stdout:4/140: sync 2024-04-25T02:09:03.198 INFO:tasks.workunit.client.1.smithi112.stdout:1/251: sync 2024-04-25T02:09:03.198 INFO:tasks.workunit.client.1.smithi112.stdout:7/127: sync 2024-04-25T02:09:03.198 INFO:tasks.workunit.client.1.smithi112.stdout:7/128: chown d7/l14 14884673 1 2024-04-25T02:09:03.199 INFO:tasks.workunit.client.1.smithi112.stdout:1/252: chown d7/d9/d1f/f36 5210922 1 2024-04-25T02:09:03.199 INFO:tasks.workunit.client.1.smithi112.stdout:5/205: sync 2024-04-25T02:09:03.199 INFO:tasks.workunit.client.1.smithi112.stdout:6/248: sync 2024-04-25T02:09:03.199 INFO:tasks.workunit.client.1.smithi112.stdout:5/206: creat d1/d16/d22/f4e x:0 0 0 2024-04-25T02:09:03.199 INFO:tasks.workunit.client.1.smithi112.stdout:5/207: chown d1/f29 246 1 2024-04-25T02:09:03.200 INFO:tasks.workunit.client.1.smithi112.stdout:7/129: mknod d7/c28 0 2024-04-25T02:09:03.202 INFO:tasks.workunit.client.1.smithi112.stdout:2/102: dread d3/f4 [0,4194304] 0 2024-04-25T02:09:03.204 INFO:tasks.workunit.client.1.smithi112.stdout:5/208: mkdir d1/d2/d28/d4f 0 2024-04-25T02:09:03.207 INFO:tasks.workunit.client.1.smithi112.stdout:4/141: write d2/fb [2581431,29734] 0 2024-04-25T02:09:03.207 INFO:tasks.workunit.client.1.smithi112.stdout:7/130: mkdir d7/d29 0 2024-04-25T02:09:03.208 INFO:tasks.workunit.client.1.smithi112.stdout:2/103: creat d3/de/df/d25/f2a x:0 0 0 2024-04-25T02:09:03.210 INFO:tasks.workunit.client.1.smithi112.stdout:5/209: creat d1/f50 x:0 0 0 2024-04-25T02:09:03.210 INFO:tasks.workunit.client.1.smithi112.stdout:5/210: dread - d1/f50 zero size 2024-04-25T02:09:03.210 INFO:tasks.workunit.client.1.smithi112.stdout:1/253: rename d7/d9/d26 to d7/d9/d4e 0 2024-04-25T02:09:03.212 INFO:tasks.workunit.client.1.smithi112.stdout:7/131: unlink d7/c9 0 2024-04-25T02:09:03.213 INFO:tasks.workunit.client.1.smithi112.stdout:5/211: mkdir d1/d16/d51 0 2024-04-25T02:09:03.213 INFO:tasks.workunit.client.1.smithi112.stdout:5/212: readlink d1/d3f/l4a 0 2024-04-25T02:09:03.214 INFO:tasks.workunit.client.1.smithi112.stdout:4/142: link d2/f9 d2/f27 0 2024-04-25T02:09:03.215 INFO:tasks.workunit.client.1.smithi112.stdout:1/254: dread d7/d9/d1e/f12 [0,4194304] 0 2024-04-25T02:09:03.216 INFO:tasks.workunit.client.1.smithi112.stdout:6/249: dwrite d0/d2/d2c/f31 [0,4194304] 0 2024-04-25T02:09:03.216 INFO:tasks.workunit.client.1.smithi112.stdout:6/250: creat d0/d2/d3b/f58 x:0 0 0 2024-04-25T02:09:03.217 INFO:tasks.workunit.client.1.smithi112.stdout:7/132: creat d7/d29/f2a x:0 0 0 2024-04-25T02:09:03.217 INFO:tasks.workunit.client.1.smithi112.stdout:7/133: fsync d7/f22 0 2024-04-25T02:09:03.217 INFO:tasks.workunit.client.1.smithi112.stdout:5/213: dread d1/d2/d4/d1d/f25 [0,4194304] 0 2024-04-25T02:09:03.218 INFO:tasks.workunit.client.1.smithi112.stdout:5/214: creat d1/d2/f52 x:0 0 0 2024-04-25T02:09:03.221 INFO:tasks.workunit.client.1.smithi112.stdout:1/255: creat d7/d9/d4e/d28/d32/f4f x:0 0 0 2024-04-25T02:09:03.221 INFO:tasks.workunit.client.1.smithi112.stdout:1/256: chown f4 1 1 2024-04-25T02:09:03.227 INFO:tasks.workunit.client.1.smithi112.stdout:7/134: creat d7/dd/d20/f2b x:0 0 0 2024-04-25T02:09:03.227 INFO:tasks.workunit.client.1.smithi112.stdout:7/135: dread - d7/dd/d20/f2b zero size 2024-04-25T02:09:03.231 INFO:tasks.workunit.client.1.smithi112.stdout:5/215: unlink d1/d2/d4/c10 0 2024-04-25T02:09:03.231 INFO:tasks.workunit.client.1.smithi112.stdout:5/216: chown d1/d16/d22 689439 1 2024-04-25T02:09:03.231 INFO:tasks.workunit.client.1.smithi112.stdout:5/217: readlink d1/d16/l3e 0 2024-04-25T02:09:03.231 INFO:tasks.workunit.client.1.smithi112.stdout:4/143: getdents d2/d17/d20 0 2024-04-25T02:09:03.232 INFO:tasks.workunit.client.1.smithi112.stdout:4/144: truncate d2/f15 806646 0 2024-04-25T02:09:03.233 INFO:tasks.workunit.client.1.smithi112.stdout:1/257: rmdir d7/d9/d4e 39 2024-04-25T02:09:03.234 INFO:tasks.workunit.client.1.smithi112.stdout:7/136: mkdir d7/dd/d20/d2c 0 2024-04-25T02:09:03.236 INFO:tasks.workunit.client.1.smithi112.stdout:5/218: truncate d1/f6 2396923 0 2024-04-25T02:09:03.238 INFO:tasks.workunit.client.1.smithi112.stdout:7/137: dread d7/f17 [0,4194304] 0 2024-04-25T02:09:03.238 INFO:tasks.workunit.client.1.smithi112.stdout:4/145: truncate d2/d12/f16 2804340 0 2024-04-25T02:09:03.239 INFO:tasks.workunit.client.1.smithi112.stdout:4/146: chown d2/d12/f16 31 1 2024-04-25T02:09:03.239 INFO:tasks.workunit.client.1.smithi112.stdout:4/147: read d2/f27 [3433440,123795] 0 2024-04-25T02:09:03.239 INFO:tasks.workunit.client.1.smithi112.stdout:1/258: mknod d7/c50 0 2024-04-25T02:09:03.241 INFO:tasks.workunit.client.1.smithi112.stdout:1/259: mkdir d7/d9/d51 0 2024-04-25T02:09:03.242 INFO:tasks.workunit.client.1.smithi112.stdout:1/260: mknod d7/d9/d4e/d28/c52 0 2024-04-25T02:09:03.244 INFO:tasks.workunit.client.1.smithi112.stdout:1/261: unlink d7/d9/d1f/l48 0 2024-04-25T02:09:03.254 INFO:tasks.workunit.client.1.smithi112.stdout:7/138: dwrite d7/dd/f18 [0,4194304] 0 2024-04-25T02:09:03.254 INFO:tasks.workunit.client.1.smithi112.stdout:7/139: dread - d7/f24 zero size 2024-04-25T02:09:03.260 INFO:tasks.workunit.client.1.smithi112.stdout:7/140: creat d7/d25/f2d x:0 0 0 2024-04-25T02:09:03.270 INFO:tasks.workunit.client.1.smithi112.stdout:5/219: dwrite d1/d2/d45/f4c [0,4194304] 0 2024-04-25T02:09:03.271 INFO:tasks.workunit.client.1.smithi112.stdout:1/262: dwrite d7/d9/d1e/de/f17 [0,4194304] 0 2024-04-25T02:09:03.271 INFO:tasks.workunit.client.1.smithi112.stdout:1/263: dread - d7/d9/d1e/de/f27 zero size 2024-04-25T02:09:03.275 INFO:tasks.workunit.client.1.smithi112.stdout:1/264: dread d7/d9/d1f/f36 [0,4194304] 0 2024-04-25T02:09:03.280 INFO:tasks.workunit.client.1.smithi112.stdout:1/265: creat d7/d9/d4e/d28/d3f/f53 x:0 0 0 2024-04-25T02:09:03.280 INFO:tasks.workunit.client.1.smithi112.stdout:1/266: creat d7/d9/d1f/f54 x:0 0 0 2024-04-25T02:09:03.281 INFO:tasks.workunit.client.1.smithi112.stdout:4/148: write d2/d12/f16 [658456,32217] 0 2024-04-25T02:09:03.281 INFO:tasks.workunit.client.1.smithi112.stdout:7/141: dwrite d7/f1e [0,4194304] 0 2024-04-25T02:09:03.281 INFO:tasks.workunit.client.1.smithi112.stdout:7/142: write d7/dd/d20/f2b [362020,97132] 0 2024-04-25T02:09:03.287 INFO:tasks.workunit.client.1.smithi112.stdout:1/267: symlink d7/d9/d4e/d28/d3f/l55 0 2024-04-25T02:09:03.293 INFO:tasks.workunit.client.1.smithi112.stdout:4/149: creat d2/d17/f28 x:0 0 0 2024-04-25T02:09:03.301 INFO:tasks.workunit.client.1.smithi112.stdout:5/220: rename d1/d2/d4/l2e to d1/d2/d28/l53 0 2024-04-25T02:09:03.303 INFO:tasks.workunit.client.1.smithi112.stdout:1/268: mknod d7/d9/d4e/d28/d43/c56 0 2024-04-25T02:09:03.303 INFO:tasks.workunit.client.1.smithi112.stdout:1/269: fdatasync d7/f24 0 2024-04-25T02:09:03.303 INFO:tasks.workunit.client.1.smithi112.stdout:1/270: chown d7 8948068 1 2024-04-25T02:09:03.304 INFO:tasks.workunit.client.1.smithi112.stdout:7/143: rmdir d7/dd 39 2024-04-25T02:09:03.305 INFO:tasks.workunit.client.1.smithi112.stdout:5/221: creat d1/d2/d4/f54 x:0 0 0 2024-04-25T02:09:03.305 INFO:tasks.workunit.client.1.smithi112.stdout:5/222: chown d1/d16/f19 1 1 2024-04-25T02:09:03.305 INFO:tasks.workunit.client.1.smithi112.stdout:5/223: chown d1/f6 3664896 1 2024-04-25T02:09:03.305 INFO:tasks.workunit.client.1.smithi112.stdout:5/224: read d1/d16/d22/f37 [329779,102145] 0 2024-04-25T02:09:03.306 INFO:tasks.workunit.client.1.smithi112.stdout:4/150: dwrite d2/d1e/d1b/f21 [0,4194304] 0 2024-04-25T02:09:03.306 INFO:tasks.workunit.client.1.smithi112.stdout:1/271: creat d7/d9/d1e/d40/f57 x:0 0 0 2024-04-25T02:09:03.307 INFO:tasks.workunit.client.1.smithi112.stdout:7/144: mkdir d7/dd/d20/d2c/d2e 0 2024-04-25T02:09:03.307 INFO:tasks.workunit.client.1.smithi112.stdout:7/145: read - d7/d25/f2d zero size 2024-04-25T02:09:03.308 INFO:tasks.workunit.client.1.smithi112.stdout:5/225: creat d1/d16/d51/f55 x:0 0 0 2024-04-25T02:09:03.315 INFO:tasks.workunit.client.1.smithi112.stdout:1/272: dread d7/d9/d1e/f1a [0,4194304] 0 2024-04-25T02:09:03.320 INFO:tasks.workunit.client.1.smithi112.stdout:4/151: dwrite d2/f9 [0,4194304] 0 2024-04-25T02:09:03.370 INFO:tasks.workunit.client.1.smithi112.stdout:3/169: sync 2024-04-25T02:09:03.371 INFO:tasks.workunit.client.1.smithi112.stdout:7/146: symlink d7/dd/d20/d2c/l2f 0 2024-04-25T02:09:03.374 INFO:tasks.workunit.client.1.smithi112.stdout:7/147: write d7/dd/f10 [1031917,93116] 0 2024-04-25T02:09:03.374 INFO:tasks.workunit.client.1.smithi112.stdout:7/148: chown d7/dd/l1a 19928 1 2024-04-25T02:09:03.374 INFO:tasks.workunit.client.1.smithi112.stdout:7/149: stat d7/l12 0 2024-04-25T02:09:03.374 INFO:tasks.workunit.client.1.smithi112.stdout:7/150: dread - d7/dd/f21 zero size 2024-04-25T02:09:03.376 INFO:tasks.workunit.client.1.smithi112.stdout:1/273: truncate d7/d9/d4e/f37 299810 0 2024-04-25T02:09:03.379 INFO:tasks.workunit.client.1.smithi112.stdout:4/152: truncate d2/f1a 115487 0 2024-04-25T02:09:03.381 INFO:tasks.workunit.client.1.smithi112.stdout:3/170: truncate d12/d13/f21 401287 0 2024-04-25T02:09:03.381 INFO:tasks.workunit.client.1.smithi112.stdout:3/171: fdatasync f5 0 2024-04-25T02:09:03.381 INFO:tasks.workunit.client.1.smithi112.stdout:3/172: write d12/d13/f2e [98584,126811] 0 2024-04-25T02:09:03.384 INFO:tasks.workunit.client.1.smithi112.stdout:5/226: getdents d1 0 2024-04-25T02:09:03.384 INFO:tasks.workunit.client.1.smithi112.stdout:5/227: read d1/d16/d22/f4b [1062123,4765] 0 2024-04-25T02:09:03.384 INFO:tasks.workunit.client.1.smithi112.stdout:5/228: write d1/f18 [4240091,75184] 0 2024-04-25T02:09:03.385 INFO:tasks.workunit.client.1.smithi112.stdout:7/151: creat d7/dd/f30 x:0 0 0 2024-04-25T02:09:03.386 INFO:tasks.workunit.client.1.smithi112.stdout:7/152: read - d7/dd/f26 zero size 2024-04-25T02:09:03.387 INFO:tasks.workunit.client.1.smithi112.stdout:1/274: mkdir d7/d9/d51/d58 0 2024-04-25T02:09:03.389 INFO:tasks.workunit.client.1.smithi112.stdout:4/153: symlink d2/d17/l29 0 2024-04-25T02:09:03.389 INFO:tasks.workunit.client.1.smithi112.stdout:4/154: truncate d2/f15 1637372 0 2024-04-25T02:09:03.390 INFO:tasks.workunit.client.1.smithi112.stdout:5/229: rmdir d1 39 2024-04-25T02:09:03.394 INFO:tasks.workunit.client.1.smithi112.stdout:7/153: unlink d7/dd/c1b 0 2024-04-25T02:09:03.395 INFO:tasks.workunit.client.1.smithi112.stdout:7/154: fdatasync d7/dd/f18 0 2024-04-25T02:09:03.395 INFO:tasks.workunit.client.1.smithi112.stdout:7/155: dread d7/f16 [0,4194304] 0 2024-04-25T02:09:03.396 INFO:tasks.workunit.client.1.smithi112.stdout:4/155: truncate d2/f9 2123244 0 2024-04-25T02:09:03.396 INFO:tasks.workunit.client.1.smithi112.stdout:4/156: read d2/f1a [45105,114896] 0 2024-04-25T02:09:03.397 INFO:tasks.workunit.client.1.smithi112.stdout:1/275: write d7/d9/d1f/f3e [2199712,69770] 0 2024-04-25T02:09:03.399 INFO:tasks.workunit.client.1.smithi112.stdout:5/230: symlink d1/l56 0 2024-04-25T02:09:03.399 INFO:tasks.workunit.client.1.smithi112.stdout:5/231: readlink d1/d3f/l4a 0 2024-04-25T02:09:03.399 INFO:tasks.workunit.client.1.smithi112.stdout:3/173: dwrite d12/d1f/d27/f2b [0,4194304] 0 2024-04-25T02:09:03.399 INFO:tasks.workunit.client.1.smithi112.stdout:4/157: mkdir d2/d17/d25/d2a 0 2024-04-25T02:09:03.406 INFO:tasks.workunit.client.1.smithi112.stdout:3/174: creat d12/d1f/f32 x:0 0 0 2024-04-25T02:09:03.411 INFO:tasks.workunit.client.1.smithi112.stdout:3/175: unlink d12/d13/c18 0 2024-04-25T02:09:03.415 INFO:tasks.workunit.client.1.smithi112.stdout:3/176: truncate d12/f1d 3068058 0 2024-04-25T02:09:03.421 INFO:tasks.workunit.client.1.smithi112.stdout:7/156: dwrite d7/dd/f1d [0,4194304] 0 2024-04-25T02:09:03.422 INFO:tasks.workunit.client.1.smithi112.stdout:7/157: write d7/dd/f21 [669009,102942] 0 2024-04-25T02:09:03.422 INFO:tasks.workunit.client.1.smithi112.stdout:7/158: stat d7/dd/c11 0 2024-04-25T02:09:03.422 INFO:tasks.workunit.client.1.smithi112.stdout:1/276: dwrite f2 [0,4194304] 0 2024-04-25T02:09:03.424 INFO:tasks.workunit.client.1.smithi112.stdout:4/158: write d2/f9 [253633,131051] 0 2024-04-25T02:09:03.430 INFO:tasks.workunit.client.1.smithi112.stdout:3/177: dwrite d12/d13/f30 [0,4194304] 0 2024-04-25T02:09:03.430 INFO:tasks.workunit.client.1.smithi112.stdout:3/178: write d12/d1f/d27/f28 [4883510,13915] 0 2024-04-25T02:09:03.430 INFO:tasks.workunit.client.1.smithi112.stdout:3/179: readlink d12/l2a 0 2024-04-25T02:09:03.430 INFO:tasks.workunit.client.1.smithi112.stdout:4/159: fsync d2/f9 0 2024-04-25T02:09:03.432 INFO:tasks.workunit.client.1.smithi112.stdout:7/159: symlink d7/d29/l31 0 2024-04-25T02:09:03.432 INFO:tasks.workunit.client.1.smithi112.stdout:7/160: dread - d7/f23 zero size 2024-04-25T02:09:03.432 INFO:tasks.workunit.client.1.smithi112.stdout:7/161: dread - d7/f27 zero size 2024-04-25T02:09:03.433 INFO:tasks.workunit.client.1.smithi112.stdout:5/232: write d1/d2/f2d [1093405,130251] 0 2024-04-25T02:09:03.439 INFO:tasks.workunit.client.1.smithi112.stdout:1/277: symlink d7/d9/d51/d58/l59 0 2024-04-25T02:09:03.439 INFO:tasks.workunit.client.1.smithi112.stdout:1/278: fdatasync d7/d9/fa 0 2024-04-25T02:09:03.439 INFO:tasks.workunit.client.1.smithi112.stdout:1/279: chown d7/c2d 27 1 2024-04-25T02:09:03.439 INFO:tasks.workunit.client.1.smithi112.stdout:1/280: chown d7/d9/d4e/f37 83 1 2024-04-25T02:09:03.442 INFO:tasks.workunit.client.1.smithi112.stdout:1/281: write d7/d9/fa [4660798,24838] 0 2024-04-25T02:09:03.449 INFO:tasks.workunit.client.1.smithi112.stdout:1/282: write d7/d9/f1b [1988199,52957] 0 2024-04-25T02:09:03.449 INFO:tasks.workunit.client.1.smithi112.stdout:1/283: chown d7/d9/d1e/d40/f57 37 1 2024-04-25T02:09:03.451 INFO:tasks.workunit.client.1.smithi112.stdout:5/233: dwrite d1/d16/d22/f4e [0,4194304] 0 2024-04-25T02:09:03.462 INFO:tasks.workunit.client.1.smithi112.stdout:3/180: unlink fd 0 2024-04-25T02:09:03.462 INFO:tasks.workunit.client.1.smithi112.stdout:3/181: dread - d12/f2d zero size 2024-04-25T02:09:03.462 INFO:tasks.workunit.client.1.smithi112.stdout:3/182: chown d12/c23 257 1 2024-04-25T02:09:03.466 INFO:tasks.workunit.client.1.smithi112.stdout:4/160: creat d2/d17/d25/d2a/f2b x:0 0 0 2024-04-25T02:09:03.466 INFO:tasks.workunit.client.1.smithi112.stdout:4/161: dread - d2/d17/d20/f23 zero size 2024-04-25T02:09:03.466 INFO:tasks.workunit.client.1.smithi112.stdout:4/162: dread - d2/f1d zero size 2024-04-25T02:09:03.466 INFO:tasks.workunit.client.1.smithi112.stdout:4/163: truncate d2/d17/d25/d2a/f2b 243549 0 2024-04-25T02:09:03.466 INFO:tasks.workunit.client.1.smithi112.stdout:4/164: write d2/f1d [804859,115269] 0 2024-04-25T02:09:03.537 INFO:tasks.workunit.client.1.smithi112.stdout:1/284: rename d7/d9/d4e/c49 to d7/d9/d1e/d40/c5a 0 2024-04-25T02:09:03.545 INFO:tasks.workunit.client.1.smithi112.stdout:9/213: sync 2024-04-25T02:09:03.546 INFO:tasks.workunit.client.1.smithi112.stdout:3/183: link d12/d13/f21 d12/d1f/f33 0 2024-04-25T02:09:03.548 INFO:tasks.workunit.client.1.smithi112.stdout:4/165: rmdir d2/d17/d25 39 2024-04-25T02:09:03.548 INFO:tasks.workunit.client.1.smithi112.stdout:4/166: chown d2/d17/f28 58328 1 2024-04-25T02:09:03.555 INFO:tasks.workunit.client.1.smithi112.stdout:1/285: creat d7/d9/d51/d58/f5b x:0 0 0 2024-04-25T02:09:03.555 INFO:tasks.workunit.client.1.smithi112.stdout:1/286: chown d7/d9/d1e/l29 152463702 1 2024-04-25T02:09:03.555 INFO:tasks.workunit.client.1.smithi112.stdout:4/167: mknod d2/d17/d20/c2c 0 2024-04-25T02:09:03.558 INFO:tasks.workunit.client.1.smithi112.stdout:4/168: unlink d2/fe 0 2024-04-25T02:09:03.559 INFO:tasks.workunit.client.1.smithi112.stdout:1/287: rmdir d7/d9/d1e 39 2024-04-25T02:09:03.560 INFO:tasks.workunit.client.1.smithi112.stdout:4/169: write d2/f1d [340884,57355] 0 2024-04-25T02:09:03.576 INFO:tasks.workunit.client.1.smithi112.stdout:9/214: dwrite d1/df/f29 [0,4194304] 0 2024-04-25T02:09:03.579 INFO:tasks.workunit.client.1.smithi112.stdout:9/215: dread d1/f5 [0,4194304] 0 2024-04-25T02:09:03.582 INFO:tasks.workunit.client.1.smithi112.stdout:9/216: link d1/f12 d1/df/d3c/d43/f4a 0 2024-04-25T02:09:03.583 INFO:tasks.workunit.client.1.smithi112.stdout:1/288: dwrite d7/d9/f16 [0,4194304] 0 2024-04-25T02:09:03.583 INFO:tasks.workunit.client.1.smithi112.stdout:1/289: truncate d7/d9/f16 4723713 0 2024-04-25T02:09:03.586 INFO:tasks.workunit.client.1.smithi112.stdout:3/184: dwrite d12/d13/f31 [0,4194304] 0 2024-04-25T02:09:03.587 INFO:tasks.workunit.client.1.smithi112.stdout:4/170: dwrite d2/f15 [0,4194304] 0 2024-04-25T02:09:03.590 INFO:tasks.workunit.client.1.smithi112.stdout:3/185: mkdir d12/d13/d34 0 2024-04-25T02:09:03.590 INFO:tasks.workunit.client.1.smithi112.stdout:3/186: truncate d12/d13/f31 4790756 0 2024-04-25T02:09:03.590 INFO:tasks.workunit.client.1.smithi112.stdout:3/187: chown d12/d1f/d27/f2b 0 1 2024-04-25T02:09:03.590 INFO:tasks.workunit.client.1.smithi112.stdout:3/188: write d12/d13/f20 [1560925,2661] 0 2024-04-25T02:09:03.590 INFO:tasks.workunit.client.1.smithi112.stdout:3/189: creat d12/d1f/d27/f35 x:0 0 0 2024-04-25T02:09:03.599 INFO:tasks.workunit.client.1.smithi112.stdout:9/217: dread d1/f1c [4194304,4194304] 0 2024-04-25T02:09:03.604 INFO:tasks.workunit.client.1.smithi112.stdout:4/171: truncate d2/fb 2423321 0 2024-04-25T02:09:03.604 INFO:tasks.workunit.client.1.smithi112.stdout:4/172: write d2/d17/d25/d2a/f2b [839347,72210] 0 2024-04-25T02:09:03.604 INFO:tasks.workunit.client.1.smithi112.stdout:4/173: stat d2/d17/d20 0 2024-04-25T02:09:03.604 INFO:tasks.workunit.client.1.smithi112.stdout:4/174: truncate d2/d17/d25/d2a/f2b 1175144 0 2024-04-25T02:09:03.604 INFO:tasks.workunit.client.1.smithi112.stdout:4/175: chown d2/f9 7 1 2024-04-25T02:09:03.607 INFO:tasks.workunit.client.1.smithi112.stdout:4/176: dread d2/d12/f16 [0,4194304] 0 2024-04-25T02:09:03.608 INFO:tasks.workunit.client.1.smithi112.stdout:0/381: sync 2024-04-25T02:09:03.608 INFO:tasks.workunit.client.1.smithi112.stdout:0/382: chown da/d1d/d2e/d40/d49/d4f/d58 476 1 2024-04-25T02:09:03.608 INFO:tasks.workunit.client.1.smithi112.stdout:8/298: sync 2024-04-25T02:09:03.608 INFO:tasks.workunit.client.1.smithi112.stdout:8/299: fdatasync d15/d35/f5d 0 2024-04-25T02:09:03.609 INFO:tasks.workunit.client.1.smithi112.stdout:9/218: mknod d1/df/d3c/c4b 0 2024-04-25T02:09:03.609 INFO:tasks.workunit.client.1.smithi112.stdout:9/219: readlink d1/l3e 0 2024-04-25T02:09:03.610 INFO:tasks.workunit.client.1.smithi112.stdout:9/220: chown d1/f27 1929040664 1 2024-04-25T02:09:03.611 INFO:tasks.workunit.client.1.smithi112.stdout:1/290: dwrite d7/d9/d1e/de/f3b [0,4194304] 0 2024-04-25T02:09:03.611 INFO:tasks.workunit.client.1.smithi112.stdout:3/190: rename d12/f2d to d12/f36 0 2024-04-25T02:09:03.611 INFO:tasks.workunit.client.1.smithi112.stdout:3/191: creat d12/d13/f37 x:0 0 0 2024-04-25T02:09:03.612 INFO:tasks.workunit.client.1.smithi112.stdout:3/192: write d12/d13/f20 [1449550,129398] 0 2024-04-25T02:09:03.612 INFO:tasks.workunit.client.1.smithi112.stdout:3/193: chown d12/d13/f20 18508427 1 2024-04-25T02:09:03.612 INFO:tasks.workunit.client.1.smithi112.stdout:4/177: creat d2/f2d x:0 0 0 2024-04-25T02:09:03.612 INFO:tasks.workunit.client.1.smithi112.stdout:4/178: write d2/f9 [1927090,26357] 0 2024-04-25T02:09:03.614 INFO:tasks.workunit.client.1.smithi112.stdout:0/383: rmdir da/d13/d1e 39 2024-04-25T02:09:03.615 INFO:tasks.workunit.client.1.smithi112.stdout:8/300: creat d15/d17/d1a/f62 x:0 0 0 2024-04-25T02:09:03.619 INFO:tasks.workunit.client.1.smithi112.stdout:9/221: creat d1/d13/d41/f4c x:0 0 0 2024-04-25T02:09:03.624 INFO:tasks.workunit.client.1.smithi112.stdout:8/301: dread fe [0,4194304] 0 2024-04-25T02:09:03.626 INFO:tasks.workunit.client.1.smithi112.stdout:1/291: rmdir d7/d9/d4e/d28/d32 39 2024-04-25T02:09:03.626 INFO:tasks.workunit.client.1.smithi112.stdout:1/292: chown d7/d9/d1e/l2f 5345570 1 2024-04-25T02:09:03.632 INFO:tasks.workunit.client.1.smithi112.stdout:4/179: dwrite d2/f9 [0,4194304] 0 2024-04-25T02:09:03.634 INFO:tasks.workunit.client.1.smithi112.stdout:0/384: creat da/d13/d1e/f83 x:0 0 0 2024-04-25T02:09:03.634 INFO:tasks.workunit.client.1.smithi112.stdout:0/385: creat da/d13/d23/d2b/d78/f84 x:0 0 0 2024-04-25T02:09:03.636 INFO:tasks.workunit.client.1.smithi112.stdout:8/302: unlink d15/d17/d24/f27 0 2024-04-25T02:09:03.638 INFO:tasks.workunit.client.1.smithi112.stdout:9/222: dwrite d1/f4 [0,4194304] 0 2024-04-25T02:09:03.639 INFO:tasks.workunit.client.1.smithi112.stdout:1/293: symlink d7/d9/l5c 0 2024-04-25T02:09:03.642 INFO:tasks.workunit.client.1.smithi112.stdout:4/180: truncate d2/f1d 402050 0 2024-04-25T02:09:03.643 INFO:tasks.workunit.client.1.smithi112.stdout:3/194: rmdir d12/d13 39 2024-04-25T02:09:03.644 INFO:tasks.workunit.client.1.smithi112.stdout:0/386: rmdir da/d13/d23/d2b 39 2024-04-25T02:09:03.645 INFO:tasks.workunit.client.1.smithi112.stdout:0/387: dread da/d13/f17 [0,4194304] 0 2024-04-25T02:09:03.645 INFO:tasks.workunit.client.1.smithi112.stdout:8/303: symlink d15/d35/d5c/d5e/l63 0 2024-04-25T02:09:03.646 INFO:tasks.workunit.client.1.smithi112.stdout:3/195: dread d12/f19 [0,4194304] 0 2024-04-25T02:09:03.654 INFO:tasks.workunit.client.1.smithi112.stdout:9/223: rename d1/le to d1/d48/l4d 0 2024-04-25T02:09:03.655 INFO:tasks.workunit.client.1.smithi112.stdout:3/196: dread d12/d1f/f25 [4194304,4194304] 0 2024-04-25T02:09:03.655 INFO:tasks.workunit.client.1.smithi112.stdout:1/294: mknod d7/d9/d4e/d28/d32/c5d 0 2024-04-25T02:09:03.660 INFO:tasks.workunit.client.1.smithi112.stdout:4/181: link d2/d17/d20/c2c d2/d1e/d1b/c2e 0 2024-04-25T02:09:03.668 INFO:tasks.workunit.client.1.smithi112.stdout:9/224: mknod d1/df/d3c/d43/c4e 0 2024-04-25T02:09:03.671 INFO:tasks.workunit.client.1.smithi112.stdout:3/197: rmdir d12/d13 39 2024-04-25T02:09:03.671 INFO:tasks.workunit.client.1.smithi112.stdout:3/198: chown d12/d13/c1a 8340805 1 2024-04-25T02:09:03.673 INFO:tasks.workunit.client.1.smithi112.stdout:4/182: link d2/f1a d2/d12/d22/f2f 0 2024-04-25T02:09:03.673 INFO:tasks.workunit.client.1.smithi112.stdout:8/304: dwrite d15/d17/f2e [0,4194304] 0 2024-04-25T02:09:03.673 INFO:tasks.workunit.client.1.smithi112.stdout:8/305: chown d15/d35/f5d 92621 1 2024-04-25T02:09:03.673 INFO:tasks.workunit.client.1.smithi112.stdout:0/388: dwrite da/d13/d23/d2b/f60 [0,4194304] 0 2024-04-25T02:09:03.673 INFO:tasks.workunit.client.1.smithi112.stdout:1/295: dwrite d7/d9/d4e/d28/d32/f4f [0,4194304] 0 2024-04-25T02:09:03.675 INFO:tasks.workunit.client.1.smithi112.stdout:9/225: symlink d1/d13/d41/l4f 0 2024-04-25T02:09:03.678 INFO:tasks.workunit.client.1.smithi112.stdout:2/104: sync 2024-04-25T02:09:03.678 INFO:tasks.workunit.client.1.smithi112.stdout:6/251: sync 2024-04-25T02:09:03.678 INFO:tasks.workunit.client.1.smithi112.stdout:2/105: creat d3/da/f2b x:0 0 0 2024-04-25T02:09:03.678 INFO:tasks.workunit.client.1.smithi112.stdout:2/106: chown d3/da/f29 34472 1 2024-04-25T02:09:03.678 INFO:tasks.workunit.client.1.smithi112.stdout:7/162: sync 2024-04-25T02:09:03.678 INFO:tasks.workunit.client.1.smithi112.stdout:5/234: sync 2024-04-25T02:09:03.678 INFO:tasks.workunit.client.1.smithi112.stdout:3/199: creat d12/d13/f38 x:0 0 0 2024-04-25T02:09:03.679 INFO:tasks.workunit.client.1.smithi112.stdout:2/107: write d3/f4 [4757669,117858] 0 2024-04-25T02:09:03.683 INFO:tasks.workunit.client.1.smithi112.stdout:9/226: write d1/df/f29 [1195162,97337] 0 2024-04-25T02:09:03.683 INFO:tasks.workunit.client.1.smithi112.stdout:9/227: creat d1/d13/d41/f50 x:0 0 0 2024-04-25T02:09:03.683 INFO:tasks.workunit.client.1.smithi112.stdout:4/183: mknod d2/d12/d22/c30 0 2024-04-25T02:09:03.684 INFO:tasks.workunit.client.1.smithi112.stdout:5/235: dread d1/d2/d4/ff [0,4194304] 0 2024-04-25T02:09:03.685 INFO:tasks.workunit.client.1.smithi112.stdout:8/306: mkdir d15/d17/d41/d64 0 2024-04-25T02:09:03.690 INFO:tasks.workunit.client.1.smithi112.stdout:0/389: truncate da/d13/d23/d2b/f30 1430022 0 2024-04-25T02:09:03.690 INFO:tasks.workunit.client.1.smithi112.stdout:0/390: chown da/d13/d23/d2b 4522350 1 2024-04-25T02:09:03.691 INFO:tasks.workunit.client.1.smithi112.stdout:0/391: dread da/d13/d45/f5a [0,4194304] 0 2024-04-25T02:09:03.692 INFO:tasks.workunit.client.1.smithi112.stdout:6/252: symlink d0/d32/d45/l59 0 2024-04-25T02:09:03.692 INFO:tasks.workunit.client.1.smithi112.stdout:6/253: dread - d0/d2/d4/f19 zero size 2024-04-25T02:09:03.693 INFO:tasks.workunit.client.1.smithi112.stdout:6/254: write d0/d2/d4/f11 [210300,1686] 0 2024-04-25T02:09:03.693 INFO:tasks.workunit.client.1.smithi112.stdout:6/255: chown d0/d2/d3b 42168 1 2024-04-25T02:09:03.694 INFO:tasks.workunit.client.1.smithi112.stdout:7/163: mknod d7/c32 0 2024-04-25T02:09:03.694 INFO:tasks.workunit.client.1.smithi112.stdout:7/164: stat d7/ca 0 2024-04-25T02:09:03.696 INFO:tasks.workunit.client.1.smithi112.stdout:3/200: link l4 d12/d13/l39 0 2024-04-25T02:09:03.697 INFO:tasks.workunit.client.1.smithi112.stdout:3/201: chown d12/d13/d34 17 1 2024-04-25T02:09:03.697 INFO:tasks.workunit.client.1.smithi112.stdout:3/202: creat d12/d13/f3a x:0 0 0 2024-04-25T02:09:03.697 INFO:tasks.workunit.client.1.smithi112.stdout:3/203: readlink d12/l2a 0 2024-04-25T02:09:03.697 INFO:tasks.workunit.client.1.smithi112.stdout:3/204: stat d12/d13/f38 0 2024-04-25T02:09:03.698 INFO:tasks.workunit.client.1.smithi112.stdout:2/108: dwrite d3/da/f15 [0,4194304] 0 2024-04-25T02:09:03.699 INFO:tasks.workunit.client.1.smithi112.stdout:9/228: mkdir d1/df/d51 0 2024-04-25T02:09:03.701 INFO:tasks.workunit.client.1.smithi112.stdout:4/184: mknod d2/d1e/c31 0 2024-04-25T02:09:03.702 INFO:tasks.workunit.client.1.smithi112.stdout:5/236: creat d1/d2/d28/f57 x:0 0 0 2024-04-25T02:09:03.705 INFO:tasks.workunit.client.1.smithi112.stdout:0/392: rename da/d13/f17 to da/d1d/d2e/d40/d49/d6b/f85 0 2024-04-25T02:09:03.710 INFO:tasks.workunit.client.1.smithi112.stdout:4/185: write d2/f15 [1330787,3142] 0 2024-04-25T02:09:03.711 INFO:tasks.workunit.client.1.smithi112.stdout:6/256: creat d0/d36/f5a x:0 0 0 2024-04-25T02:09:03.711 INFO:tasks.workunit.client.1.smithi112.stdout:6/257: write d0/d36/f37 [1688933,34958] 0 2024-04-25T02:09:03.711 INFO:tasks.workunit.client.1.smithi112.stdout:4/186: dread d2/d12/d22/f2f [0,4194304] 0 2024-04-25T02:09:03.713 INFO:tasks.workunit.client.1.smithi112.stdout:2/109: read d3/da/f1c [4651433,119178] 0 2024-04-25T02:09:03.713 INFO:tasks.workunit.client.1.smithi112.stdout:2/110: creat d3/da/f2c x:0 0 0 2024-04-25T02:09:03.713 INFO:tasks.workunit.client.1.smithi112.stdout:7/165: creat d7/dd/d20/d2c/d2e/f33 x:0 0 0 2024-04-25T02:09:03.713 INFO:tasks.workunit.client.1.smithi112.stdout:7/166: stat d7/f1e 0 2024-04-25T02:09:03.714 INFO:tasks.workunit.client.1.smithi112.stdout:0/393: dread da/f10 [0,4194304] 0 2024-04-25T02:09:03.716 INFO:tasks.workunit.client.1.smithi112.stdout:0/394: write da/d1d/f43 [407278,6154] 0 2024-04-25T02:09:03.716 INFO:tasks.workunit.client.1.smithi112.stdout:3/205: symlink d12/d13/l3b 0 2024-04-25T02:09:03.716 INFO:tasks.workunit.client.1.smithi112.stdout:5/237: symlink d1/d41/l58 0 2024-04-25T02:09:03.717 INFO:tasks.workunit.client.1.smithi112.stdout:5/238: write d1/d2/d4/d1d/f2a [1721275,67943] 0 2024-04-25T02:09:03.717 INFO:tasks.workunit.client.1.smithi112.stdout:9/229: rename d1/f2c to d1/df/d3c/f52 0 2024-04-25T02:09:03.719 INFO:tasks.workunit.client.1.smithi112.stdout:8/307: dwrite d15/d17/d1a/f4b [0,4194304] 0 2024-04-25T02:09:03.720 INFO:tasks.workunit.client.1.smithi112.stdout:9/230: fsync d1/df/f29 0 2024-04-25T02:09:03.720 INFO:tasks.workunit.client.1.smithi112.stdout:6/258: mknod d0/d2/d3b/d53/c5b 0 2024-04-25T02:09:03.720 INFO:tasks.workunit.client.1.smithi112.stdout:6/259: creat d0/d2/d4/d28/f5c x:0 0 0 2024-04-25T02:09:03.722 INFO:tasks.workunit.client.1.smithi112.stdout:4/187: mknod d2/d17/d25/c32 0 2024-04-25T02:09:03.725 INFO:tasks.workunit.client.1.smithi112.stdout:2/111: rmdir d3 39 2024-04-25T02:09:03.725 INFO:tasks.workunit.client.1.smithi112.stdout:2/112: write d3/da/f2c [567809,55529] 0 2024-04-25T02:09:03.725 INFO:tasks.workunit.client.1.smithi112.stdout:2/113: fdatasync d3/de/f17 0 2024-04-25T02:09:03.726 INFO:tasks.workunit.client.1.smithi112.stdout:0/395: mknod da/d13/d23/d2b/c86 0 2024-04-25T02:09:03.728 INFO:tasks.workunit.client.1.smithi112.stdout:5/239: fsync d1/d2/d45/f4c 0 2024-04-25T02:09:03.731 INFO:tasks.workunit.client.1.smithi112.stdout:7/167: dwrite d7/dd/f30 [0,4194304] 0 2024-04-25T02:09:03.731 INFO:tasks.workunit.client.1.smithi112.stdout:3/206: rename c9 to d12/d1f/d27/c3c 0 2024-04-25T02:09:03.731 INFO:tasks.workunit.client.1.smithi112.stdout:3/207: write d12/d13/f1b [371151,66490] 0 2024-04-25T02:09:03.732 INFO:tasks.workunit.client.1.smithi112.stdout:8/308: creat d15/d26/d37/f65 x:0 0 0 2024-04-25T02:09:03.733 INFO:tasks.workunit.client.1.smithi112.stdout:9/231: write d1/df/d3c/f52 [2178237,108805] 0 2024-04-25T02:09:03.736 INFO:tasks.workunit.client.1.smithi112.stdout:6/260: link d0/d2/d4/f1d d0/d2/d2c/d41/f5d 0 2024-04-25T02:09:03.741 INFO:tasks.workunit.client.1.smithi112.stdout:4/188: link d2/d17/l29 d2/d12/l33 0 2024-04-25T02:09:03.741 INFO:tasks.workunit.client.1.smithi112.stdout:4/189: chown d2 31447098 1 2024-04-25T02:09:03.744 INFO:tasks.workunit.client.1.smithi112.stdout:5/240: link d1/d3f/l42 d1/d2/d4/l59 0 2024-04-25T02:09:03.752 INFO:tasks.workunit.client.1.smithi112.stdout:4/190: rename d2/f9 to d2/d17/d25/d2a/f34 0 2024-04-25T02:09:03.754 INFO:tasks.workunit.client.1.smithi112.stdout:5/241: creat d1/d2/f5a x:0 0 0 2024-04-25T02:09:03.755 INFO:tasks.workunit.client.1.smithi112.stdout:7/168: getdents d7/dd 0 2024-04-25T02:09:03.759 INFO:tasks.workunit.client.1.smithi112.stdout:4/191: creat d2/d1e/f35 x:0 0 0 2024-04-25T02:09:03.767 INFO:tasks.workunit.client.1.smithi112.stdout:6/261: rmdir d0/d2/d2c 39 2024-04-25T02:09:03.768 INFO:tasks.workunit.client.1.smithi112.stdout:6/262: symlink d0/d2/d4/d28/l5e 0 2024-04-25T02:09:03.769 INFO:tasks.workunit.client.1.smithi112.stdout:6/263: symlink d0/d2/d1f/l5f 0 2024-04-25T02:09:03.772 INFO:tasks.workunit.client.1.smithi112.stdout:2/114: dwrite d3/da/dc/d20/f21 [0,4194304] 0 2024-04-25T02:09:03.772 INFO:tasks.workunit.client.1.smithi112.stdout:2/115: chown d3/da/d18/d27 0 1 2024-04-25T02:09:03.772 INFO:tasks.workunit.client.1.smithi112.stdout:4/192: rmdir d2/d17 39 2024-04-25T02:09:03.772 INFO:tasks.workunit.client.1.smithi112.stdout:4/193: chown d2/d12/f16 2892577 1 2024-04-25T02:09:03.772 INFO:tasks.workunit.client.1.smithi112.stdout:4/194: truncate d2/f1f 906838 0 2024-04-25T02:09:03.773 INFO:tasks.workunit.client.1.smithi112.stdout:5/242: rmdir d1/d2 39 2024-04-25T02:09:03.777 INFO:tasks.workunit.client.1.smithi112.stdout:2/116: getdents d3/da 0 2024-04-25T02:09:03.779 INFO:tasks.workunit.client.1.smithi112.stdout:3/208: dwrite d12/d1f/f33 [0,4194304] 0 2024-04-25T02:09:03.779 INFO:tasks.workunit.client.1.smithi112.stdout:8/309: dwrite d15/d40/f60 [0,4194304] 0 2024-04-25T02:09:03.779 INFO:tasks.workunit.client.1.smithi112.stdout:0/396: dwrite da/d13/d23/d2b/d24/f48 [0,4194304] 0 2024-04-25T02:09:03.781 INFO:tasks.workunit.client.1.smithi112.stdout:9/232: dwrite d1/df/f40 [0,4194304] 0 2024-04-25T02:09:03.781 INFO:tasks.workunit.client.1.smithi112.stdout:9/233: creat d1/d13/d41/f53 x:0 0 0 2024-04-25T02:09:03.783 INFO:tasks.workunit.client.1.smithi112.stdout:4/195: dread d2/d17/d25/d2a/f34 [0,4194304] 0 2024-04-25T02:09:03.783 INFO:tasks.workunit.client.1.smithi112.stdout:4/196: write d2/d17/d25/d2a/f34 [4856302,197] 0 2024-04-25T02:09:03.783 INFO:tasks.workunit.client.1.smithi112.stdout:4/197: dread d2/f1a [0,4194304] 0 2024-04-25T02:09:03.784 INFO:tasks.workunit.client.1.smithi112.stdout:2/117: dread d3/da/f2c [0,4194304] 0 2024-04-25T02:09:03.786 INFO:tasks.workunit.client.1.smithi112.stdout:9/234: dread d1/f5 [0,4194304] 0 2024-04-25T02:09:03.786 INFO:tasks.workunit.client.1.smithi112.stdout:9/235: fsync d1/d13/f26 0 2024-04-25T02:09:03.796 INFO:tasks.workunit.client.1.smithi112.stdout:6/264: dwrite d0/f1a [4194304,4194304] 0 2024-04-25T02:09:03.797 INFO:tasks.workunit.client.1.smithi112.stdout:0/397: read da/d1d/d2e/d40/d49/d4f/f51 [2853902,122908] 0 2024-04-25T02:09:03.802 INFO:tasks.workunit.client.1.smithi112.stdout:9/236: write d1/f10 [1369298,98643] 0 2024-04-25T02:09:03.803 INFO:tasks.workunit.client.1.smithi112.stdout:5/243: dwrite d1/f6 [0,4194304] 0 2024-04-25T02:09:03.804 INFO:tasks.workunit.client.1.smithi112.stdout:5/244: write d1/f3b [799949,4833] 0 2024-04-25T02:09:03.815 INFO:tasks.workunit.client.1.smithi112.stdout:6/265: rename d0/d2/d4/l12 to d0/d2/d2c/d41/l60 0 2024-04-25T02:09:03.817 INFO:tasks.workunit.client.1.smithi112.stdout:9/237: creat d1/df/d3c/d46/f54 x:0 0 0 2024-04-25T02:09:03.817 INFO:tasks.workunit.client.1.smithi112.stdout:9/238: read - d1/f2e zero size 2024-04-25T02:09:03.817 INFO:tasks.workunit.client.1.smithi112.stdout:9/239: dread - d1/d13/d41/f53 zero size 2024-04-25T02:09:03.819 INFO:tasks.workunit.client.1.smithi112.stdout:5/245: mkdir d1/d41/d5b 0 2024-04-25T02:09:03.819 INFO:tasks.workunit.client.1.smithi112.stdout:5/246: write d1/d16/f4d [523621,69660] 0 2024-04-25T02:09:03.820 INFO:tasks.workunit.client.1.smithi112.stdout:5/247: chown d1/d2/d4/c2b 11636 1 2024-04-25T02:09:03.820 INFO:tasks.workunit.client.1.smithi112.stdout:5/248: readlink d1/d16/d22/l49 0 2024-04-25T02:09:03.820 INFO:tasks.workunit.client.1.smithi112.stdout:4/198: dwrite d2/d1e/d1b/f21 [0,4194304] 0 2024-04-25T02:09:03.820 INFO:tasks.workunit.client.1.smithi112.stdout:6/266: mkdir d0/d61 0 2024-04-25T02:09:03.822 INFO:tasks.workunit.client.1.smithi112.stdout:9/240: mkdir d1/df/d51/d55 0 2024-04-25T02:09:03.822 INFO:tasks.workunit.client.1.smithi112.stdout:9/241: creat d1/df/d3c/d46/f56 x:0 0 0 2024-04-25T02:09:03.823 INFO:tasks.workunit.client.1.smithi112.stdout:5/249: symlink d1/d16/l5c 0 2024-04-25T02:09:03.825 INFO:tasks.workunit.client.1.smithi112.stdout:8/310: dwrite d15/d17/d1a/f44 [0,4194304] 0 2024-04-25T02:09:03.826 INFO:tasks.workunit.client.1.smithi112.stdout:2/118: dwrite d3/de/df/d25/f2a [0,4194304] 0 2024-04-25T02:09:03.826 INFO:tasks.workunit.client.1.smithi112.stdout:0/398: dwrite da/d13/d23/d2b/d24/f2c [0,4194304] 0 2024-04-25T02:09:03.826 INFO:tasks.workunit.client.1.smithi112.stdout:0/399: readlink da/l34 0 2024-04-25T02:09:03.826 INFO:tasks.workunit.client.1.smithi112.stdout:0/400: readlink da/d1d/d2e/d40/d49/d5f/l7d 0 2024-04-25T02:09:03.826 INFO:tasks.workunit.client.1.smithi112.stdout:0/401: truncate da/d1d/d2e/d40/d49/d4f/f71 1229270 0 2024-04-25T02:09:03.826 INFO:tasks.workunit.client.1.smithi112.stdout:9/242: fsync d1/f10 0 2024-04-25T02:09:03.827 INFO:tasks.workunit.client.1.smithi112.stdout:2/119: dread d3/da/f2c [0,4194304] 0 2024-04-25T02:09:03.827 INFO:tasks.workunit.client.1.smithi112.stdout:4/199: mknod d2/d17/c36 0 2024-04-25T02:09:03.827 INFO:tasks.workunit.client.1.smithi112.stdout:4/200: write d2/d17/d20/f23 [1048048,23875] 0 2024-04-25T02:09:03.828 INFO:tasks.workunit.client.1.smithi112.stdout:4/201: dread d2/f1f [0,4194304] 0 2024-04-25T02:09:03.829 INFO:tasks.workunit.client.1.smithi112.stdout:6/267: mknod d0/d61/c62 0 2024-04-25T02:09:03.831 INFO:tasks.workunit.client.1.smithi112.stdout:6/268: write d0/d2/d2c/d41/f5d [1065211,67862] 0 2024-04-25T02:09:03.832 INFO:tasks.workunit.client.1.smithi112.stdout:6/269: stat d0/d36/f5a 0 2024-04-25T02:09:03.837 INFO:tasks.workunit.client.1.smithi112.stdout:2/120: read d3/da/dc/d20/f21 [1713449,127980] 0 2024-04-25T02:09:03.838 INFO:tasks.workunit.client.1.smithi112.stdout:9/243: write d1/d13/f20 [1171612,18507] 0 2024-04-25T02:09:03.842 INFO:tasks.workunit.client.1.smithi112.stdout:8/311: dwrite d15/d17/d41/f45 [0,4194304] 0 2024-04-25T02:09:03.843 INFO:tasks.workunit.client.1.smithi112.stdout:5/250: creat d1/d2/d28/d4f/f5d x:0 0 0 2024-04-25T02:09:03.845 INFO:tasks.workunit.client.1.smithi112.stdout:0/402: truncate da/d13/d45/f5a 215390 0 2024-04-25T02:09:03.845 INFO:tasks.workunit.client.1.smithi112.stdout:0/403: creat da/d1d/d2e/d40/d49/d6b/f87 x:0 0 0 2024-04-25T02:09:03.845 INFO:tasks.workunit.client.1.smithi112.stdout:0/404: stat da/d1d/d2e/d40/d49/d6b/l6c 0 2024-04-25T02:09:03.847 INFO:tasks.workunit.client.1.smithi112.stdout:4/202: rename d2/c7 to d2/d1e/c37 0 2024-04-25T02:09:03.847 INFO:tasks.workunit.client.1.smithi112.stdout:4/203: write d2/d1e/f35 [285780,74591] 0 2024-04-25T02:09:03.849 INFO:tasks.workunit.client.1.smithi112.stdout:2/121: creat d3/da/f2d x:0 0 0 2024-04-25T02:09:03.849 INFO:tasks.workunit.client.1.smithi112.stdout:2/122: readlink d3/da/d18/l1f 0 2024-04-25T02:09:03.850 INFO:tasks.workunit.client.1.smithi112.stdout:9/244: rmdir d1/d13 39 2024-04-25T02:09:03.854 INFO:tasks.workunit.client.1.smithi112.stdout:8/312: mknod d15/d35/d5c/d5e/c66 0 2024-04-25T02:09:03.854 INFO:tasks.workunit.client.1.smithi112.stdout:8/313: chown d15/d26/f53 1 1 2024-04-25T02:09:03.858 INFO:tasks.workunit.client.1.smithi112.stdout:0/405: dwrite da/d13/d23/d2b/f60 [0,4194304] 0 2024-04-25T02:09:03.866 INFO:tasks.workunit.client.1.smithi112.stdout:4/204: rename d2/d1e/d1b/c2e to d2/d12/c38 0 2024-04-25T02:09:03.868 INFO:tasks.workunit.client.1.smithi112.stdout:2/123: creat d3/da/dc/f2e x:0 0 0 2024-04-25T02:09:03.870 INFO:tasks.workunit.client.1.smithi112.stdout:4/205: write d2/d17/d25/d2a/f34 [3652412,14696] 0 2024-04-25T02:09:03.873 INFO:tasks.workunit.client.1.smithi112.stdout:9/245: unlink d1/f5 0 2024-04-25T02:09:03.880 INFO:tasks.workunit.client.1.smithi112.stdout:2/124: rename d3/f4 to d3/da/d18/f2f 0 2024-04-25T02:09:03.880 INFO:tasks.workunit.client.1.smithi112.stdout:2/125: truncate d3/da/f29 1010891 0 2024-04-25T02:09:03.880 INFO:tasks.workunit.client.1.smithi112.stdout:5/251: dwrite d1/d2/f43 [0,4194304] 0 2024-04-25T02:09:03.884 INFO:tasks.workunit.client.1.smithi112.stdout:4/206: unlink d2/cf 0 2024-04-25T02:09:03.884 INFO:tasks.workunit.client.1.smithi112.stdout:4/207: fdatasync d2/d12/f16 0 2024-04-25T02:09:03.884 INFO:tasks.workunit.client.1.smithi112.stdout:4/208: readlink d2/d17/l29 0 2024-04-25T02:09:03.886 INFO:tasks.workunit.client.1.smithi112.stdout:9/246: unlink d1/df/f2d 0 2024-04-25T02:09:03.889 INFO:tasks.workunit.client.1.smithi112.stdout:2/126: rmdir d3/de/df 39 2024-04-25T02:09:03.890 INFO:tasks.workunit.client.1.smithi112.stdout:2/127: stat d3/l26 0 2024-04-25T02:09:03.890 INFO:tasks.workunit.client.1.smithi112.stdout:8/314: dwrite d15/d17/d1a/f1d [0,4194304] 0 2024-04-25T02:09:03.893 INFO:tasks.workunit.client.1.smithi112.stdout:4/209: mkdir d2/d17/d20/d26/d39 0 2024-04-25T02:09:03.894 INFO:tasks.workunit.client.1.smithi112.stdout:8/315: write d15/d17/d1a/f33 [78481,55900] 0 2024-04-25T02:09:03.894 INFO:tasks.workunit.client.1.smithi112.stdout:8/316: stat d15/d35/d5c/d5e 0 2024-04-25T02:09:03.894 INFO:tasks.workunit.client.1.smithi112.stdout:8/317: write d15/f18 [4088623,114846] 0 2024-04-25T02:09:03.896 INFO:tasks.workunit.client.1.smithi112.stdout:8/318: mkdir d15/d26/d4f/d67 0 2024-04-25T02:09:03.898 INFO:tasks.workunit.client.1.smithi112.stdout:4/210: mkdir d2/d3a 0 2024-04-25T02:09:03.900 INFO:tasks.workunit.client.1.smithi112.stdout:8/319: dread - d15/d17/d1a/f2f zero size 2024-04-25T02:09:03.902 INFO:tasks.workunit.client.1.smithi112.stdout:8/320: rename d15/d40/c50 to d15/d26/d37/c68 0 2024-04-25T02:09:03.905 INFO:tasks.workunit.client.1.smithi112.stdout:9/247: dwrite d1/df/f29 [0,4194304] 0 2024-04-25T02:09:03.905 INFO:tasks.workunit.client.1.smithi112.stdout:8/321: symlink d15/d17/d1a/l69 0 2024-04-25T02:09:03.907 INFO:tasks.workunit.client.1.smithi112.stdout:8/322: link d15/d17/d1a/f44 d15/d35/d56/f6a 0 2024-04-25T02:09:03.909 INFO:tasks.workunit.client.1.smithi112.stdout:4/211: dread d2/d1e/d1b/f21 [0,4194304] 0 2024-04-25T02:09:03.914 INFO:tasks.workunit.client.1.smithi112.stdout:4/212: rmdir d2 39 2024-04-25T02:09:03.920 INFO:tasks.workunit.client.1.smithi112.stdout:8/323: truncate f7 1593378 0 2024-04-25T02:09:03.931 INFO:tasks.workunit.client.1.smithi112.stdout:9/248: dwrite d1/df/f40 [4194304,4194304] 0 2024-04-25T02:09:03.934 INFO:tasks.workunit.client.1.smithi112.stdout:9/249: creat d1/df/d51/d55/f57 x:0 0 0 2024-04-25T02:09:03.938 INFO:tasks.workunit.client.1.smithi112.stdout:9/250: rmdir d1/d13/d41 39 2024-04-25T02:09:03.939 INFO:tasks.workunit.client.1.smithi112.stdout:9/251: readlink d1/d13/l2f 0 2024-04-25T02:09:03.939 INFO:tasks.workunit.client.1.smithi112.stdout:9/252: dread - d1/d13/d41/f53 zero size 2024-04-25T02:09:03.940 INFO:tasks.workunit.client.1.smithi112.stdout:8/324: dwrite d15/d17/d1a/f44 [0,4194304] 0 2024-04-25T02:09:03.940 INFO:tasks.workunit.client.1.smithi112.stdout:8/325: read fa [694583,70316] 0 2024-04-25T02:09:03.944 INFO:tasks.workunit.client.1.smithi112.stdout:4/213: dwrite d2/f2d [0,4194304] 0 2024-04-25T02:09:03.944 INFO:tasks.workunit.client.1.smithi112.stdout:9/253: dread d1/f1c [4194304,4194304] 0 2024-04-25T02:09:03.979 INFO:tasks.workunit.client.1.smithi112.stdout:8/326: creat d15/d17/f6b x:0 0 0 2024-04-25T02:09:03.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:03 smithi077 ceph-mon[26330]: pgmap v261: 65 pgs: 65 active+clean; 2.6 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 205 MiB/s rd, 276 MiB/s wr, 405 op/s 2024-04-25T02:09:03.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:03 smithi077 ceph-mon[26330]: mgrmap e20: smithi077.zpflzp(active, since 7m), standbys: smithi112.cswrxs 2024-04-25T02:09:03.983 INFO:tasks.workunit.client.1.smithi112.stdout:9/254: symlink d1/df/d51/d55/l58 0 2024-04-25T02:09:03.987 INFO:tasks.workunit.client.1.smithi112.stdout:8/327: rename f7 to d15/d35/d56/f6c 0 2024-04-25T02:09:03.992 INFO:tasks.workunit.client.1.smithi112.stdout:9/255: dread d1/f4 [0,4194304] 0 2024-04-25T02:09:03.993 INFO:tasks.workunit.client.1.smithi112.stdout:9/256: dread - d1/f3b zero size 2024-04-25T02:09:03.993 INFO:tasks.workunit.client.1.smithi112.stdout:9/257: dread - d1/df/f39 zero size 2024-04-25T02:09:03.994 INFO:tasks.workunit.client.1.smithi112.stdout:9/258: rmdir d1/d13 39 2024-04-25T02:09:03.994 INFO:tasks.workunit.client.1.smithi112.stdout:9/259: write d1/df/d3c/d46/f56 [935068,2187] 0 2024-04-25T02:09:03.995 INFO:tasks.workunit.client.1.smithi112.stdout:9/260: rename d1/c2a to d1/c59 0 2024-04-25T02:09:04.015 INFO:tasks.workunit.client.1.smithi112.stdout:4/214: dwrite d2/f2d [4194304,4194304] 0 2024-04-25T02:09:04.017 INFO:tasks.workunit.client.1.smithi112.stdout:9/261: dwrite d1/d13/f37 [0,4194304] 0 2024-04-25T02:09:04.017 INFO:tasks.workunit.client.1.smithi112.stdout:9/262: creat d1/df/f5a x:0 0 0 2024-04-25T02:09:04.017 INFO:tasks.workunit.client.1.smithi112.stdout:9/263: write d1/f21 [2478911,81859] 0 2024-04-25T02:09:04.017 INFO:tasks.workunit.client.1.smithi112.stdout:9/264: read d1/fd [3743456,69752] 0 2024-04-25T02:09:04.017 INFO:tasks.workunit.client.1.smithi112.stdout:8/328: dwrite d15/f42 [4194304,4194304] 0 2024-04-25T02:09:04.017 INFO:tasks.workunit.client.1.smithi112.stdout:4/215: creat d2/d17/d25/f3b x:0 0 0 2024-04-25T02:09:04.026 INFO:tasks.workunit.client.1.smithi112.stdout:8/329: unlink fa 0 2024-04-25T02:09:04.026 INFO:tasks.workunit.client.1.smithi112.stdout:8/330: chown d15/d26/f3a 108 1 2024-04-25T02:09:04.026 INFO:tasks.workunit.client.1.smithi112.stdout:8/331: write d15/d40/f49 [11880,52828] 0 2024-04-25T02:09:04.026 INFO:tasks.workunit.client.1.smithi112.stdout:8/332: write d15/d17/d1a/f33 [385300,18060] 0 2024-04-25T02:09:04.026 INFO:tasks.workunit.client.1.smithi112.stdout:8/333: write d15/d17/f23 [1897085,118362] 0 2024-04-25T02:09:04.027 INFO:tasks.workunit.client.1.smithi112.stdout:4/216: creat d2/d3a/f3c x:0 0 0 2024-04-25T02:09:04.027 INFO:tasks.workunit.client.1.smithi112.stdout:4/217: write d2/f1f [336141,37930] 0 2024-04-25T02:09:04.029 INFO:tasks.workunit.client.1.smithi112.stdout:9/265: rename d1/df/d51 to d1/d13/d5b 0 2024-04-25T02:09:04.029 INFO:tasks.workunit.client.1.smithi112.stdout:9/266: truncate d1/d13/f26 1382881 0 2024-04-25T02:09:04.029 INFO:tasks.workunit.client.1.smithi112.stdout:8/334: mkdir d15/d35/d5c/d5e/d6d 0 2024-04-25T02:09:04.030 INFO:tasks.workunit.client.1.smithi112.stdout:8/335: fsync d15/d26/f3a 0 2024-04-25T02:09:04.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:03 smithi112 ceph-mon[33313]: pgmap v261: 65 pgs: 65 active+clean; 2.6 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 205 MiB/s rd, 276 MiB/s wr, 405 op/s 2024-04-25T02:09:04.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:03 smithi112 ceph-mon[33313]: mgrmap e20: smithi077.zpflzp(active, since 7m), standbys: smithi112.cswrxs 2024-04-25T02:09:04.031 INFO:tasks.workunit.client.1.smithi112.stdout:9/267: creat d1/d48/f5c x:0 0 0 2024-04-25T02:09:04.032 INFO:tasks.workunit.client.1.smithi112.stdout:8/336: creat d15/d17/d41/d64/f6e x:0 0 0 2024-04-25T02:09:04.034 INFO:tasks.workunit.client.1.smithi112.stdout:9/268: rename d1/d13/f3f to d1/d13/d5b/d55/f5d 0 2024-04-25T02:09:04.034 INFO:tasks.workunit.client.1.smithi112.stdout:8/337: mknod d15/d17/c6f 0 2024-04-25T02:09:04.036 INFO:tasks.workunit.client.1.smithi112.stdout:9/269: symlink d1/d13/d5b/d55/l5e 0 2024-04-25T02:09:04.038 INFO:tasks.workunit.client.1.smithi112.stdout:8/338: dread d15/d17/f48 [0,4194304] 0 2024-04-25T02:09:04.041 INFO:tasks.workunit.client.1.smithi112.stdout:8/339: rename d15/d17/d41/l4a to d15/d35/d5c/d5e/l70 0 2024-04-25T02:09:04.041 INFO:tasks.workunit.client.1.smithi112.stdout:8/340: readlink d15/l21 0 2024-04-25T02:09:04.043 INFO:tasks.workunit.client.1.smithi112.stdout:4/218: dwrite d2/f2d [4194304,4194304] 0 2024-04-25T02:09:04.045 INFO:tasks.workunit.client.1.smithi112.stdout:4/219: write d2/d17/d20/f23 [804610,15543] 0 2024-04-25T02:09:04.046 INFO:tasks.workunit.client.1.smithi112.stdout:4/220: unlink d2/d17/d20/c2c 0 2024-04-25T02:09:04.047 INFO:tasks.workunit.client.1.smithi112.stdout:4/221: write d2/d17/d25/d2a/f34 [3713827,88216] 0 2024-04-25T02:09:04.048 INFO:tasks.workunit.client.1.smithi112.stdout:4/222: symlink d2/d12/d22/l3d 0 2024-04-25T02:09:04.050 INFO:tasks.workunit.client.1.smithi112.stdout:4/223: symlink d2/d17/d20/l3e 0 2024-04-25T02:09:04.051 INFO:tasks.workunit.client.1.smithi112.stdout:4/224: mkdir d2/d17/d25/d3f 0 2024-04-25T02:09:04.052 INFO:tasks.workunit.client.1.smithi112.stdout:4/225: mknod d2/d17/c40 0 2024-04-25T02:09:04.052 INFO:tasks.workunit.client.1.smithi112.stdout:4/226: read d2/d17/d25/d2a/f34 [3583121,74556] 0 2024-04-25T02:09:04.053 INFO:tasks.workunit.client.1.smithi112.stdout:9/270: getdents d1/d48 0 2024-04-25T02:09:04.054 INFO:tasks.workunit.client.1.smithi112.stdout:4/227: symlink d2/d17/l41 0 2024-04-25T02:09:04.055 INFO:tasks.workunit.client.1.smithi112.stdout:9/271: link d1/l34 d1/d48/l5f 0 2024-04-25T02:09:04.057 INFO:tasks.workunit.client.1.smithi112.stdout:9/272: creat d1/d13/d5b/f60 x:0 0 0 2024-04-25T02:09:04.057 INFO:tasks.workunit.client.1.smithi112.stdout:9/273: creat d1/d13/d5b/f61 x:0 0 0 2024-04-25T02:09:04.058 INFO:tasks.workunit.client.1.smithi112.stdout:9/274: truncate d1/d13/d41/f53 1987 0 2024-04-25T02:09:04.059 INFO:tasks.workunit.client.1.smithi112.stdout:8/341: dwrite d15/f42 [4194304,4194304] 0 2024-04-25T02:09:04.062 INFO:tasks.workunit.client.1.smithi112.stdout:8/342: getdents d15/d17/d24 0 2024-04-25T02:09:04.065 INFO:tasks.workunit.client.1.smithi112.stdout:8/343: rename d15/d17/d24/c55 to d15/d17/d24/c71 0 2024-04-25T02:09:04.068 INFO:tasks.workunit.client.1.smithi112.stdout:4/228: write d2/f2d [1660540,114409] 0 2024-04-25T02:09:04.068 INFO:tasks.workunit.client.1.smithi112.stdout:4/229: stat d2/d17/l24 0 2024-04-25T02:09:04.071 INFO:tasks.workunit.client.1.smithi112.stdout:4/230: mkdir d2/d1e/d42 0 2024-04-25T02:09:04.071 INFO:tasks.workunit.client.1.smithi112.stdout:4/231: readlink d2/d17/l29 0 2024-04-25T02:09:04.093 INFO:tasks.workunit.client.1.smithi112.stdout:8/344: dwrite f6 [0,4194304] 0 2024-04-25T02:09:04.093 INFO:tasks.workunit.client.1.smithi112.stdout:8/345: rename d15 to d15/d26/d4f/d67/d72 22 2024-04-25T02:09:04.094 INFO:tasks.workunit.client.1.smithi112.stdout:8/346: creat d15/d26/f73 x:0 0 0 2024-04-25T02:09:04.094 INFO:tasks.workunit.client.1.smithi112.stdout:8/347: mknod d15/d40/c74 0 2024-04-25T02:09:04.095 INFO:tasks.workunit.client.1.smithi112.stdout:9/275: dwrite d1/d13/f20 [4194304,4194304] 0 2024-04-25T02:09:04.095 INFO:tasks.workunit.client.1.smithi112.stdout:4/232: dwrite d2/f1d [0,4194304] 0 2024-04-25T02:09:04.096 INFO:tasks.workunit.client.1.smithi112.stdout:8/348: unlink d15/d35/d56/f59 0 2024-04-25T02:09:04.102 INFO:tasks.workunit.client.1.smithi112.stdout:9/276: write d1/d13/f47 [4153547,46549] 0 2024-04-25T02:09:04.158 INFO:tasks.workunit.client.1.smithi112.stdout:4/233: creat d2/d17/d20/d26/f43 x:0 0 0 2024-04-25T02:09:04.159 INFO:tasks.workunit.client.1.smithi112.stdout:8/349: symlink d15/l75 0 2024-04-25T02:09:04.160 INFO:tasks.workunit.client.1.smithi112.stdout:4/234: dread d2/d1e/f35 [0,4194304] 0 2024-04-25T02:09:04.162 INFO:tasks.workunit.client.1.smithi112.stdout:9/277: mknod d1/df/d3c/d46/c62 0 2024-04-25T02:09:04.165 INFO:tasks.workunit.client.1.smithi112.stdout:8/350: creat d15/d35/d5c/d5e/f76 x:0 0 0 2024-04-25T02:09:04.168 INFO:tasks.workunit.client.1.smithi112.stdout:8/351: symlink d15/d40/l77 0 2024-04-25T02:09:04.168 INFO:tasks.workunit.client.1.smithi112.stdout:9/278: rmdir d1/d13/d5b 39 2024-04-25T02:09:04.168 INFO:tasks.workunit.client.1.smithi112.stdout:9/279: read - d1/d13/d5b/f61 zero size 2024-04-25T02:09:04.170 INFO:tasks.workunit.client.1.smithi112.stdout:8/352: mkdir d15/d17/d41/d78 0 2024-04-25T02:09:04.170 INFO:tasks.workunit.client.1.smithi112.stdout:8/353: write d15/d26/f73 [562498,52078] 0 2024-04-25T02:09:04.170 INFO:tasks.workunit.client.1.smithi112.stdout:9/280: mkdir d1/d13/d5b/d55/d63 0 2024-04-25T02:09:04.198 INFO:tasks.workunit.client.1.smithi112.stdout:9/281: dwrite d1/f2b [0,4194304] 0 2024-04-25T02:09:04.205 INFO:tasks.workunit.client.1.smithi112.stdout:1/296: sync 2024-04-25T02:09:04.205 INFO:tasks.workunit.client.1.smithi112.stdout:1/297: dread - d7/d9/d4e/f4c zero size 2024-04-25T02:09:04.205 INFO:tasks.workunit.client.1.smithi112.stdout:1/298: write d7/d9/d4e/f37 [782578,108748] 0 2024-04-25T02:09:04.205 INFO:tasks.workunit.client.1.smithi112.stdout:1/299: dread - d7/d9/d1e/d40/f57 zero size 2024-04-25T02:09:04.208 INFO:tasks.workunit.client.1.smithi112.stdout:1/300: mkdir d7/d9/d1e/d5e 0 2024-04-25T02:09:04.213 INFO:tasks.workunit.client.1.smithi112.stdout:9/282: read d1/df/d3c/d43/f4a [6614323,43382] 0 2024-04-25T02:09:04.216 INFO:tasks.workunit.client.1.smithi112.stdout:9/283: mknod d1/df/d3c/d46/c64 0 2024-04-25T02:09:04.216 INFO:tasks.workunit.client.1.smithi112.stdout:9/284: chown d1/l42 169406 1 2024-04-25T02:09:04.219 INFO:tasks.workunit.client.1.smithi112.stdout:9/285: unlink d1/f2e 0 2024-04-25T02:09:04.219 INFO:tasks.workunit.client.1.smithi112.stdout:4/235: dwrite d2/fb [0,4194304] 0 2024-04-25T02:09:04.221 INFO:tasks.workunit.client.1.smithi112.stdout:8/354: dwrite d15/f2c [0,4194304] 0 2024-04-25T02:09:04.221 INFO:tasks.workunit.client.1.smithi112.stdout:8/355: fdatasync d15/d35/f5d 0 2024-04-25T02:09:04.222 INFO:tasks.workunit.client.1.smithi112.stdout:9/286: mkdir d1/d48/d65 0 2024-04-25T02:09:04.223 INFO:tasks.workunit.client.1.smithi112.stdout:4/236: link d2/d17/d20/d26/f43 d2/d12/f44 0 2024-04-25T02:09:04.227 INFO:tasks.workunit.client.1.smithi112.stdout:1/301: dwrite d7/f4d [0,4194304] 0 2024-04-25T02:09:04.229 INFO:tasks.workunit.client.1.smithi112.stdout:8/356: symlink d15/d26/d37/d52/l79 0 2024-04-25T02:09:04.234 INFO:tasks.workunit.client.1.smithi112.stdout:1/302: mknod d7/c5f 0 2024-04-25T02:09:04.234 INFO:tasks.workunit.client.1.smithi112.stdout:1/303: write d7/d9/d4e/f37 [1694047,5156] 0 2024-04-25T02:09:04.240 INFO:tasks.workunit.client.1.smithi112.stdout:8/357: unlink d15/d17/f48 0 2024-04-25T02:09:04.240 INFO:tasks.workunit.client.1.smithi112.stdout:8/358: stat d15/d17/d41/f45 0 2024-04-25T02:09:04.243 INFO:tasks.workunit.client.1.smithi112.stdout:4/237: dwrite d2/f2d [4194304,4194304] 0 2024-04-25T02:09:04.243 INFO:tasks.workunit.client.1.smithi112.stdout:4/238: truncate d2/d17/d25/d2a/f2b 1709909 0 2024-04-25T02:09:04.243 INFO:tasks.workunit.client.1.smithi112.stdout:1/304: rmdir d7/d9/d1e/d5e 0 2024-04-25T02:09:04.254 INFO:tasks.workunit.client.1.smithi112.stdout:1/305: mknod d7/d9/d1e/d40/c60 0 2024-04-25T02:09:04.256 INFO:tasks.workunit.client.1.smithi112.stdout:4/239: getdents d2/d12/d22 0 2024-04-25T02:09:04.257 INFO:tasks.workunit.client.1.smithi112.stdout:1/306: mknod d7/d9/d1e/c61 0 2024-04-25T02:09:04.257 INFO:tasks.workunit.client.1.smithi112.stdout:1/307: stat d7/d9/d1e/l29 0 2024-04-25T02:09:04.260 INFO:tasks.workunit.client.1.smithi112.stdout:8/359: dwrite d15/d17/f3b [0,4194304] 0 2024-04-25T02:09:04.263 INFO:tasks.workunit.client.1.smithi112.stdout:1/308: creat d7/d9/d4e/f62 x:0 0 0 2024-04-25T02:09:04.263 INFO:tasks.workunit.client.1.smithi112.stdout:1/309: write d7/d9/d1f/f3e [3401829,19948] 0 2024-04-25T02:09:04.263 INFO:tasks.workunit.client.1.smithi112.stdout:1/310: write d7/d9/fa [4332010,57625] 0 2024-04-25T02:09:04.268 INFO:tasks.workunit.client.1.smithi112.stdout:8/360: mkdir d15/d35/d56/d7a 0 2024-04-25T02:09:04.273 INFO:tasks.workunit.client.1.smithi112.stdout:8/361: getdents d15/d35/d5c/d5e 0 2024-04-25T02:09:04.273 INFO:tasks.workunit.client.1.smithi112.stdout:8/362: fsync fe 0 2024-04-25T02:09:04.273 INFO:tasks.workunit.client.1.smithi112.stdout:8/363: readlink d15/l21 0 2024-04-25T02:09:04.277 INFO:tasks.workunit.client.1.smithi112.stdout:8/364: symlink d15/d17/d41/d78/l7b 0 2024-04-25T02:09:04.277 INFO:tasks.workunit.client.1.smithi112.stdout:8/365: dread - d15/d40/f4d zero size 2024-04-25T02:09:04.286 INFO:tasks.workunit.client.1.smithi112.stdout:4/240: dwrite d2/f1f [0,4194304] 0 2024-04-25T02:09:04.287 INFO:tasks.workunit.client.1.smithi112.stdout:1/311: dwrite d7/d9/d4e/f4c [0,4194304] 0 2024-04-25T02:09:04.287 INFO:tasks.workunit.client.1.smithi112.stdout:1/312: creat d7/d9/d1f/f63 x:0 0 0 2024-04-25T02:09:04.287 INFO:tasks.workunit.client.1.smithi112.stdout:8/366: dread d15/d17/d1a/f4b [0,4194304] 0 2024-04-25T02:09:04.303 INFO:tasks.workunit.client.1.smithi112.stdout:4/241: dread d2/d12/f19 [0,4194304] 0 2024-04-25T02:09:04.304 INFO:tasks.workunit.client.1.smithi112.stdout:4/242: rename d2/d12/c38 to d2/d17/d20/c45 0 2024-04-25T02:09:04.305 INFO:tasks.workunit.client.1.smithi112.stdout:8/367: dwrite d15/d35/f61 [0,4194304] 0 2024-04-25T02:09:04.306 INFO:tasks.workunit.client.1.smithi112.stdout:4/243: write d2/d12/f16 [1758780,452] 0 2024-04-25T02:09:04.306 INFO:tasks.workunit.client.1.smithi112.stdout:4/244: read d2/d17/d25/d2a/f34 [2949898,60940] 0 2024-04-25T02:09:04.310 INFO:tasks.workunit.client.1.smithi112.stdout:8/368: symlink d15/d17/d24/l7c 0 2024-04-25T02:09:04.312 INFO:tasks.workunit.client.1.smithi112.stdout:8/369: symlink d15/d17/d24/l7d 0 2024-04-25T02:09:04.313 INFO:tasks.workunit.client.1.smithi112.stdout:8/370: write d15/f28 [2422586,35490] 0 2024-04-25T02:09:04.380 INFO:tasks.workunit.client.1.smithi112.stdout:4/245: dwrite d2/f1a [0,4194304] 0 2024-04-25T02:09:04.383 INFO:tasks.workunit.client.1.smithi112.stdout:4/246: truncate d2/d1e/d1b/f21 3593829 0 2024-04-25T02:09:04.399 INFO:tasks.workunit.client.1.smithi112.stdout:7/169: sync 2024-04-25T02:09:04.400 INFO:tasks.workunit.client.1.smithi112.stdout:7/170: mknod d7/dd/d20/d2c/c34 0 2024-04-25T02:09:04.400 INFO:tasks.workunit.client.1.smithi112.stdout:7/171: truncate d7/dd/f1c 629741 0 2024-04-25T02:09:04.401 INFO:tasks.workunit.client.1.smithi112.stdout:3/209: sync 2024-04-25T02:09:04.407 INFO:tasks.workunit.client.1.smithi112.stdout:4/247: dwrite d2/d17/d25/f3b [0,4194304] 0 2024-04-25T02:09:04.412 INFO:tasks.workunit.client.1.smithi112.stdout:4/248: creat d2/f46 x:0 0 0 2024-04-25T02:09:04.412 INFO:tasks.workunit.client.1.smithi112.stdout:4/249: chown d2/d1e/c31 159 1 2024-04-25T02:09:04.414 INFO:tasks.workunit.client.1.smithi112.stdout:4/250: creat d2/d1e/d42/f47 x:0 0 0 2024-04-25T02:09:04.417 INFO:tasks.workunit.client.1.smithi112.stdout:4/251: creat d2/d12/d22/f48 x:0 0 0 2024-04-25T02:09:04.427 INFO:tasks.workunit.client.1.smithi112.stdout:3/210: dwrite d12/d13/f2e [0,4194304] 0 2024-04-25T02:09:04.427 INFO:tasks.workunit.client.1.smithi112.stdout:7/172: dwrite d7/dd/f1d [0,4194304] 0 2024-04-25T02:09:04.433 INFO:tasks.workunit.client.1.smithi112.stdout:7/173: mknod d7/c35 0 2024-04-25T02:09:04.444 INFO:tasks.workunit.client.1.smithi112.stdout:4/252: dwrite d2/d12/f16 [0,4194304] 0 2024-04-25T02:09:04.445 INFO:tasks.workunit.client.1.smithi112.stdout:7/174: write d7/dd/f1d [3038477,128776] 0 2024-04-25T02:09:04.445 INFO:tasks.workunit.client.1.smithi112.stdout:3/211: dwrite d12/d13/f38 [0,4194304] 0 2024-04-25T02:09:04.448 INFO:tasks.workunit.client.1.smithi112.stdout:7/175: mkdir d7/dd/d20/d36 0 2024-04-25T02:09:04.451 INFO:tasks.workunit.client.1.smithi112.stdout:7/176: dread d7/f17 [0,4194304] 0 2024-04-25T02:09:04.453 INFO:tasks.workunit.client.1.smithi112.stdout:7/177: dread d7/dd/d20/f2b [0,4194304] 0 2024-04-25T02:09:04.457 INFO:tasks.workunit.client.1.smithi112.stdout:4/253: rename d2/d3a to d2/d17/d20/d26/d39/d49 0 2024-04-25T02:09:04.459 INFO:tasks.workunit.client.1.smithi112.stdout:3/212: rename d12/c23 to d12/d1f/d27/c3d 0 2024-04-25T02:09:04.460 INFO:tasks.workunit.client.1.smithi112.stdout:4/254: mknod d2/d17/d20/d26/d39/c4a 0 2024-04-25T02:09:04.460 INFO:tasks.workunit.client.1.smithi112.stdout:4/255: dread - d2/f46 zero size 2024-04-25T02:09:04.460 INFO:tasks.workunit.client.1.smithi112.stdout:4/256: write d2/d12/d22/f48 [410076,5442] 0 2024-04-25T02:09:04.465 INFO:tasks.workunit.client.1.smithi112.stdout:4/257: write d2/fb [415594,14242] 0 2024-04-25T02:09:04.466 INFO:tasks.workunit.client.1.smithi112.stdout:7/178: rename d7/dd/d20/d2c/d2e to d7/d25/d37 0 2024-04-25T02:09:04.468 INFO:tasks.workunit.client.1.smithi112.stdout:3/213: getdents d12/d1f/d27 0 2024-04-25T02:09:04.469 INFO:tasks.workunit.client.1.smithi112.stdout:4/258: mkdir d2/d1e/d4b 0 2024-04-25T02:09:04.469 INFO:tasks.workunit.client.1.smithi112.stdout:4/259: fdatasync d2/d12/f16 0 2024-04-25T02:09:04.469 INFO:tasks.workunit.client.1.smithi112.stdout:7/179: mkdir d7/d38 0 2024-04-25T02:09:04.471 INFO:tasks.workunit.client.1.smithi112.stdout:3/214: mknod d12/d1f/c3e 0 2024-04-25T02:09:04.471 INFO:tasks.workunit.client.1.smithi112.stdout:3/215: chown d12/f19 13182964 1 2024-04-25T02:09:04.471 INFO:tasks.workunit.client.1.smithi112.stdout:3/216: dread - d12/d13/f37 zero size 2024-04-25T02:09:04.472 INFO:tasks.workunit.client.1.smithi112.stdout:4/260: mkdir d2/d17/d20/d26/d39/d49/d4c 0 2024-04-25T02:09:04.472 INFO:tasks.workunit.client.1.smithi112.stdout:4/261: creat d2/d1e/d42/f4d x:0 0 0 2024-04-25T02:09:04.474 INFO:tasks.workunit.client.1.smithi112.stdout:3/217: truncate d12/d1f/f25 3327021 0 2024-04-25T02:09:04.474 INFO:tasks.workunit.client.1.smithi112.stdout:3/218: fdatasync d12/d13/f37 0 2024-04-25T02:09:04.479 INFO:tasks.workunit.client.1.smithi112.stdout:4/262: mkdir d2/d4e 0 2024-04-25T02:09:04.481 INFO:tasks.workunit.client.1.smithi112.stdout:4/263: truncate d2/d17/d25/d2a/f2b 1337347 0 2024-04-25T02:09:04.481 INFO:tasks.workunit.client.1.smithi112.stdout:4/264: stat d2/f15 0 2024-04-25T02:09:04.484 INFO:tasks.workunit.client.1.smithi112.stdout:7/180: dwrite d7/f13 [0,4194304] 0 2024-04-25T02:09:04.488 INFO:tasks.workunit.client.1.smithi112.stdout:4/265: getdents d2/d17/d20/d26 0 2024-04-25T02:09:04.488 INFO:tasks.workunit.client.1.smithi112.stdout:4/266: chown d2/d17/l41 0 1 2024-04-25T02:09:04.495 INFO:tasks.workunit.client.1.smithi112.stdout:7/181: dread d7/f1e [0,4194304] 0 2024-04-25T02:09:04.497 INFO:tasks.workunit.client.1.smithi112.stdout:3/219: dwrite d12/d1f/d27/f2b [0,4194304] 0 2024-04-25T02:09:04.497 INFO:tasks.workunit.client.1.smithi112.stdout:3/220: fdatasync d12/d1f/d27/f28 0 2024-04-25T02:09:04.498 INFO:tasks.workunit.client.1.smithi112.stdout:7/182: link d7/dd/c11 d7/c39 0 2024-04-25T02:09:04.498 INFO:tasks.workunit.client.1.smithi112.stdout:7/183: dread - d7/f23 zero size 2024-04-25T02:09:04.503 INFO:tasks.workunit.client.1.smithi112.stdout:7/184: dread d7/f1e [0,4194304] 0 2024-04-25T02:09:04.504 INFO:tasks.workunit.client.1.smithi112.stdout:4/267: dread d2/d12/f19 [0,4194304] 0 2024-04-25T02:09:04.515 INFO:tasks.workunit.client.1.smithi112.stdout:3/221: mknod d12/d13/d34/c3f 0 2024-04-25T02:09:04.516 INFO:tasks.workunit.client.1.smithi112.stdout:7/185: mkdir d7/dd/d20/d36/d3a 0 2024-04-25T02:09:04.518 INFO:tasks.workunit.client.1.smithi112.stdout:4/268: creat d2/d17/d20/f4f x:0 0 0 2024-04-25T02:09:04.520 INFO:tasks.workunit.client.1.smithi112.stdout:6/270: sync 2024-04-25T02:09:04.520 INFO:tasks.workunit.client.1.smithi112.stdout:2/128: sync 2024-04-25T02:09:04.520 INFO:tasks.workunit.client.1.smithi112.stdout:5/252: sync 2024-04-25T02:09:04.520 INFO:tasks.workunit.client.1.smithi112.stdout:6/271: read - d0/d2/d4/d28/f5c zero size 2024-04-25T02:09:04.520 INFO:tasks.workunit.client.1.smithi112.stdout:0/406: sync 2024-04-25T02:09:04.523 INFO:tasks.workunit.client.1.smithi112.stdout:4/269: dread d2/f27 [0,4194304] 0 2024-04-25T02:09:04.523 INFO:tasks.workunit.client.1.smithi112.stdout:4/270: stat d2/d1e/d1b 0 2024-04-25T02:09:04.523 INFO:tasks.workunit.client.1.smithi112.stdout:4/271: write d2/f46 [159574,71466] 0 2024-04-25T02:09:04.523 INFO:tasks.workunit.client.1.smithi112.stdout:4/272: stat d2/d12/f19 0 2024-04-25T02:09:04.524 INFO:tasks.workunit.client.1.smithi112.stdout:2/129: unlink d3/de/df/f12 0 2024-04-25T02:09:04.525 INFO:tasks.workunit.client.1.smithi112.stdout:7/186: dread d7/f8 [0,4194304] 0 2024-04-25T02:09:04.525 INFO:tasks.workunit.client.1.smithi112.stdout:7/187: truncate d7/dd/f21 1477887 0 2024-04-25T02:09:04.525 INFO:tasks.workunit.client.1.smithi112.stdout:7/188: getdents d7/dd/d20/d36/d3a 0 2024-04-25T02:09:04.526 INFO:tasks.workunit.client.1.smithi112.stdout:6/272: unlink d0/d2/d2c/f31 0 2024-04-25T02:09:04.530 INFO:tasks.workunit.client.1.smithi112.stdout:3/222: dwrite d12/d13/f37 [0,4194304] 0 2024-04-25T02:09:04.533 INFO:tasks.workunit.client.1.smithi112.stdout:5/253: rmdir d1/d16 39 2024-04-25T02:09:04.533 INFO:tasks.workunit.client.1.smithi112.stdout:5/254: dread - d1/d2/f5a zero size 2024-04-25T02:09:04.533 INFO:tasks.workunit.client.1.smithi112.stdout:4/273: getdents d2/d17/d20/d26/d39 0 2024-04-25T02:09:04.534 INFO:tasks.workunit.client.1.smithi112.stdout:4/274: write d2/d12/d22/f48 [1001597,2315] 0 2024-04-25T02:09:04.535 INFO:tasks.workunit.client.1.smithi112.stdout:2/130: mkdir d3/de/df/d30 0 2024-04-25T02:09:04.537 INFO:tasks.workunit.client.1.smithi112.stdout:6/273: mknod d0/c63 0 2024-04-25T02:09:04.541 INFO:tasks.workunit.client.1.smithi112.stdout:0/407: rename da/d13/d23/d2b to da/d1d/d88 0 2024-04-25T02:09:04.550 INFO:tasks.workunit.client.1.smithi112.stdout:6/274: dwrite d0/d2/d4/f11 [0,4194304] 0 2024-04-25T02:09:04.551 INFO:tasks.workunit.client.1.smithi112.stdout:4/275: mknod d2/d17/c50 0 2024-04-25T02:09:04.553 INFO:tasks.workunit.client.1.smithi112.stdout:2/131: creat d3/da/d18/f31 x:0 0 0 2024-04-25T02:09:04.555 INFO:tasks.workunit.client.1.smithi112.stdout:7/189: rmdir d7/d25 39 2024-04-25T02:09:04.557 INFO:tasks.workunit.client.1.smithi112.stdout:0/408: rename da/d1d/d2e/d40/l42 to da/d13/d45/d5e/l89 0 2024-04-25T02:09:04.559 INFO:tasks.workunit.client.1.smithi112.stdout:3/223: rmdir d12 39 2024-04-25T02:09:04.560 INFO:tasks.workunit.client.1.smithi112.stdout:5/255: mkdir d1/d2/d5e 0 2024-04-25T02:09:04.560 INFO:tasks.workunit.client.1.smithi112.stdout:5/256: write d1/d16/f19 [5007492,26206] 0 2024-04-25T02:09:04.569 INFO:tasks.workunit.client.1.smithi112.stdout:6/275: link d0/d2/d1f/c3c d0/d32/d45/c64 0 2024-04-25T02:09:04.570 INFO:tasks.workunit.client.1.smithi112.stdout:9/287: sync 2024-04-25T02:09:04.573 INFO:tasks.workunit.client.1.smithi112.stdout:4/276: symlink d2/d17/d25/l51 0 2024-04-25T02:09:04.573 INFO:tasks.workunit.client.1.smithi112.stdout:8/371: sync 2024-04-25T02:09:04.573 INFO:tasks.workunit.client.1.smithi112.stdout:1/313: sync 2024-04-25T02:09:04.574 INFO:tasks.workunit.client.1.smithi112.stdout:2/132: mkdir d3/de/df/d32 0 2024-04-25T02:09:04.574 INFO:tasks.workunit.client.1.smithi112.stdout:2/133: write d3/da/dc/d20/f21 [1713706,65087] 0 2024-04-25T02:09:04.574 INFO:tasks.workunit.client.1.smithi112.stdout:2/134: write d3/da/dc/d20/f21 [1265870,10200] 0 2024-04-25T02:09:04.575 INFO:tasks.workunit.client.1.smithi112.stdout:5/257: dwrite d1/d2/d4/fe [0,4194304] 0 2024-04-25T02:09:04.577 INFO:tasks.workunit.client.1.smithi112.stdout:7/190: truncate d7/f8 1955753 0 2024-04-25T02:09:04.580 INFO:tasks.workunit.client.1.smithi112.stdout:0/409: rename da/d1d/d2e/d40/d49/d4f/d58/l76 to da/d1d/d2e/d40/d49/d4f/l8a 0 2024-04-25T02:09:04.581 INFO:tasks.workunit.client.1.smithi112.stdout:3/224: unlink d12/d1f/l22 0 2024-04-25T02:09:04.583 INFO:tasks.workunit.client.1.smithi112.stdout:9/288: link d1/f4 d1/d13/d41/f66 0 2024-04-25T02:09:04.585 INFO:tasks.workunit.client.1.smithi112.stdout:1/314: creat d7/d9/d4e/d28/d32/f64 x:0 0 0 2024-04-25T02:09:04.585 INFO:tasks.workunit.client.1.smithi112.stdout:1/315: chown d7/d9/d1e/de/c35 12712 1 2024-04-25T02:09:04.586 INFO:tasks.workunit.client.1.smithi112.stdout:9/289: write d1/f31 [1012868,104392] 0 2024-04-25T02:09:04.586 INFO:tasks.workunit.client.1.smithi112.stdout:8/372: write d15/d40/f60 [4162954,52678] 0 2024-04-25T02:09:04.586 INFO:tasks.workunit.client.1.smithi112.stdout:8/373: write d15/d26/d37/f38 [5541324,64479] 0 2024-04-25T02:09:04.588 INFO:tasks.workunit.client.1.smithi112.stdout:5/258: write d1/d16/f19 [4050068,105192] 0 2024-04-25T02:09:04.589 INFO:tasks.workunit.client.1.smithi112.stdout:3/225: rename d12/d1f/d27/c3d to d12/d1f/d27/c40 0 2024-04-25T02:09:04.590 INFO:tasks.workunit.client.1.smithi112.stdout:1/316: unlink d7/d9/d4e/d28/d32/c5d 0 2024-04-25T02:09:04.591 INFO:tasks.workunit.client.1.smithi112.stdout:1/317: fsync d7/d9/d1f/f63 0 2024-04-25T02:09:04.594 INFO:tasks.workunit.client.1.smithi112.stdout:6/276: dwrite d0/d2/d4/dd/f24 [0,4194304] 0 2024-04-25T02:09:04.594 INFO:tasks.workunit.client.1.smithi112.stdout:9/290: symlink d1/df/d3c/l67 0 2024-04-25T02:09:04.600 INFO:tasks.workunit.client.1.smithi112.stdout:8/374: creat d15/f7e x:0 0 0 2024-04-25T02:09:04.605 INFO:tasks.workunit.client.1.smithi112.stdout:6/277: write d0/d2/d4/f5 [6900332,94348] 0 2024-04-25T02:09:04.607 INFO:tasks.workunit.client.1.smithi112.stdout:9/291: dread d1/f27 [0,4194304] 0 2024-04-25T02:09:04.611 INFO:tasks.workunit.client.1.smithi112.stdout:3/226: creat d12/f41 x:0 0 0 2024-04-25T02:09:04.611 INFO:tasks.workunit.client.1.smithi112.stdout:2/135: rename d3/da/f2d to d3/f33 0 2024-04-25T02:09:04.611 INFO:tasks.workunit.client.1.smithi112.stdout:3/227: chown d12/d13/f30 2 1 2024-04-25T02:09:04.613 INFO:tasks.workunit.client.1.smithi112.stdout:6/278: symlink d0/d2/d4/d28/l65 0 2024-04-25T02:09:04.613 INFO:tasks.workunit.client.1.smithi112.stdout:8/375: write f6 [1756711,12491] 0 2024-04-25T02:09:04.615 INFO:tasks.workunit.client.1.smithi112.stdout:1/318: rename d7/d9/fa to d7/d9/d1e/de/f65 0 2024-04-25T02:09:04.617 INFO:tasks.workunit.client.1.smithi112.stdout:6/279: mkdir d0/d2/d66 0 2024-04-25T02:09:04.618 INFO:tasks.workunit.client.1.smithi112.stdout:3/228: dread d12/d13/f1b [0,4194304] 0 2024-04-25T02:09:04.618 INFO:tasks.workunit.client.1.smithi112.stdout:1/319: truncate d7/d9/d1f/d25/f30 1524782 0 2024-04-25T02:09:04.618 INFO:tasks.workunit.client.1.smithi112.stdout:1/320: write d7/d9/d1e/d40/f57 [461860,108644] 0 2024-04-25T02:09:04.620 INFO:tasks.workunit.client.1.smithi112.stdout:6/280: mkdir d0/d2/d3b/d53/d67 0 2024-04-25T02:09:04.620 INFO:tasks.workunit.client.1.smithi112.stdout:6/281: read d0/d36/f37 [3286220,55955] 0 2024-04-25T02:09:04.620 INFO:tasks.workunit.client.1.smithi112.stdout:6/282: creat d0/d2/d3b/f68 x:0 0 0 2024-04-25T02:09:04.620 INFO:tasks.workunit.client.1.smithi112.stdout:6/283: truncate d0/d2/d4/f4f 1009511 0 2024-04-25T02:09:04.623 INFO:tasks.workunit.client.1.smithi112.stdout:3/229: creat d12/d13/f42 x:0 0 0 2024-04-25T02:09:04.625 INFO:tasks.workunit.client.1.smithi112.stdout:6/284: symlink d0/d2/l69 0 2024-04-25T02:09:04.626 INFO:tasks.workunit.client.1.smithi112.stdout:1/321: dread d7/d9/f16 [0,4194304] 0 2024-04-25T02:09:04.627 INFO:tasks.workunit.client.1.smithi112.stdout:1/322: chown d7/d9/d1f/l31 961 1 2024-04-25T02:09:04.628 INFO:tasks.workunit.client.1.smithi112.stdout:4/277: dwrite d2/f46 [0,4194304] 0 2024-04-25T02:09:04.628 INFO:tasks.workunit.client.1.smithi112.stdout:3/230: dread d12/d13/f1b [0,4194304] 0 2024-04-25T02:09:04.628 INFO:tasks.workunit.client.1.smithi112.stdout:3/231: creat d12/d13/f43 x:0 0 0 2024-04-25T02:09:04.629 INFO:tasks.workunit.client.1.smithi112.stdout:2/136: dread d3/da/f15 [0,4194304] 0 2024-04-25T02:09:04.630 INFO:tasks.workunit.client.1.smithi112.stdout:7/191: dwrite d7/f1e [0,4194304] 0 2024-04-25T02:09:04.630 INFO:tasks.workunit.client.1.smithi112.stdout:7/192: readlink d7/dd/d20/d2c/l2f 0 2024-04-25T02:09:04.631 INFO:tasks.workunit.client.1.smithi112.stdout:0/410: dwrite da/d1d/d2e/d40/d49/f61 [0,4194304] 0 2024-04-25T02:09:04.633 INFO:tasks.workunit.client.1.smithi112.stdout:1/323: dread d7/d9/f1b [0,4194304] 0 2024-04-25T02:09:04.633 INFO:tasks.workunit.client.1.smithi112.stdout:5/259: dwrite d1/d2/d28/d4f/f5d [0,4194304] 0 2024-04-25T02:09:04.639 INFO:tasks.workunit.client.1.smithi112.stdout:1/324: fsync d7/d9/d4e/d28/d32/f64 0 2024-04-25T02:09:04.640 INFO:tasks.workunit.client.1.smithi112.stdout:8/376: dwrite d15/d35/f5d [0,4194304] 0 2024-04-25T02:09:04.640 INFO:tasks.workunit.client.1.smithi112.stdout:4/278: mknod d2/d1e/d1b/c52 0 2024-04-25T02:09:04.643 INFO:tasks.workunit.client.1.smithi112.stdout:0/411: read da/f32 [256923,7458] 0 2024-04-25T02:09:04.644 INFO:tasks.workunit.client.1.smithi112.stdout:3/232: mkdir d12/d1f/d27/d44 0 2024-04-25T02:09:04.647 INFO:tasks.workunit.client.1.smithi112.stdout:1/325: write d7/d9/d1e/f1a [1819352,33337] 0 2024-04-25T02:09:04.647 INFO:tasks.workunit.client.1.smithi112.stdout:1/326: fsync d7/f24 0 2024-04-25T02:09:04.648 INFO:tasks.workunit.client.1.smithi112.stdout:1/327: dread - d7/d9/d4e/d28/f3c zero size 2024-04-25T02:09:04.648 INFO:tasks.workunit.client.1.smithi112.stdout:1/328: truncate d7/d9/d4e/f62 1020189 0 2024-04-25T02:09:04.648 INFO:tasks.workunit.client.1.smithi112.stdout:1/329: dread - d7/d9/d4e/d28/d3f/f53 zero size 2024-04-25T02:09:04.648 INFO:tasks.workunit.client.1.smithi112.stdout:1/330: fsync d7/d9/f10 0 2024-04-25T02:09:04.649 INFO:tasks.workunit.client.1.smithi112.stdout:2/137: rename d3/de/df/d25/f2a to d3/de/df/f34 0 2024-04-25T02:09:04.649 INFO:tasks.workunit.client.1.smithi112.stdout:2/138: dread - d3/f33 zero size 2024-04-25T02:09:04.653 INFO:tasks.workunit.client.1.smithi112.stdout:7/193: symlink d7/dd/d20/l3b 0 2024-04-25T02:09:04.660 INFO:tasks.workunit.client.1.smithi112.stdout:0/412: dwrite da/f81 [0,4194304] 0 2024-04-25T02:09:04.671 INFO:tasks.workunit.client.1.smithi112.stdout:2/139: dwrite d3/da/f29 [0,4194304] 0 2024-04-25T02:09:04.673 INFO:tasks.workunit.client.1.smithi112.stdout:7/194: dwrite d7/fc [0,4194304] 0 2024-04-25T02:09:04.677 INFO:tasks.workunit.client.1.smithi112.stdout:3/233: symlink d12/d13/d34/l45 0 2024-04-25T02:09:04.678 INFO:tasks.workunit.client.1.smithi112.stdout:1/331: mkdir d7/d9/d1e/d66 0 2024-04-25T02:09:04.682 INFO:tasks.workunit.client.1.smithi112.stdout:0/413: link da/d1d/d88/d78/f84 da/d1d/d2e/d40/d49/d4f/d58/d6d/f8b 0 2024-04-25T02:09:04.685 INFO:tasks.workunit.client.1.smithi112.stdout:2/140: link d3/da/d18/f2f d3/de/df/d32/f35 0 2024-04-25T02:09:04.686 INFO:tasks.workunit.client.1.smithi112.stdout:2/141: fdatasync d3/da/f1c 0 2024-04-25T02:09:04.687 INFO:tasks.workunit.client.1.smithi112.stdout:7/195: symlink d7/d25/l3c 0 2024-04-25T02:09:04.687 INFO:tasks.workunit.client.1.smithi112.stdout:7/196: rename d7/dd to d7/dd/d3d 22 2024-04-25T02:09:04.687 INFO:tasks.workunit.client.1.smithi112.stdout:5/260: dwrite d1/d2/f31 [0,4194304] 0 2024-04-25T02:09:04.688 INFO:tasks.workunit.client.1.smithi112.stdout:8/377: link d15/d17/d24/l7c d15/d17/d24/l7f 0 2024-04-25T02:09:04.690 INFO:tasks.workunit.client.1.smithi112.stdout:3/234: unlink d12/d13/f38 0 2024-04-25T02:09:04.690 INFO:tasks.workunit.client.1.smithi112.stdout:3/235: chown d12/d13/f43 173 1 2024-04-25T02:09:04.691 INFO:tasks.workunit.client.1.smithi112.stdout:1/332: truncate d7/d9/f1b 469722 0 2024-04-25T02:09:04.692 INFO:tasks.workunit.client.1.smithi112.stdout:0/414: rename da/d13/c5d to da/d13/c8c 0 2024-04-25T02:09:04.694 INFO:tasks.workunit.client.1.smithi112.stdout:7/197: truncate d7/f8 1452627 0 2024-04-25T02:09:04.696 INFO:tasks.workunit.client.1.smithi112.stdout:7/198: dread d7/dd/f21 [0,4194304] 0 2024-04-25T02:09:04.697 INFO:tasks.workunit.client.1.smithi112.stdout:5/261: link d1/d2/d4/f54 d1/d16/d51/f5f 0 2024-04-25T02:09:04.698 INFO:tasks.workunit.client.1.smithi112.stdout:8/378: mknod d15/d17/d41/d78/c80 0 2024-04-25T02:09:04.699 INFO:tasks.workunit.client.1.smithi112.stdout:3/236: rename d12/d13/f3a to d12/d1f/d27/f46 0 2024-04-25T02:09:04.701 INFO:tasks.workunit.client.1.smithi112.stdout:1/333: unlink d7/d9/d1e/l33 0 2024-04-25T02:09:04.702 INFO:tasks.workunit.client.1.smithi112.stdout:0/415: truncate da/f26 2628471 0 2024-04-25T02:09:04.702 INFO:tasks.workunit.client.1.smithi112.stdout:0/416: dread - da/d1d/d2e/d40/d49/d6b/f73 zero size 2024-04-25T02:09:04.705 INFO:tasks.workunit.client.1.smithi112.stdout:5/262: unlink d1/d2/d4/d1d/f34 0 2024-04-25T02:09:04.705 INFO:tasks.workunit.client.1.smithi112.stdout:5/263: write d1/d16/d51/f55 [535039,44449] 0 2024-04-25T02:09:04.710 INFO:tasks.workunit.client.1.smithi112.stdout:1/334: symlink d7/d9/d4e/d28/l67 0 2024-04-25T02:09:04.710 INFO:tasks.workunit.client.1.smithi112.stdout:1/335: creat d7/d9/d4e/d28/d32/f68 x:0 0 0 2024-04-25T02:09:04.710 INFO:tasks.workunit.client.1.smithi112.stdout:1/336: write d7/d9/d51/d58/f5b [522281,5990] 0 2024-04-25T02:09:04.710 INFO:tasks.workunit.client.1.smithi112.stdout:1/337: dread - d7/d9/d1e/de/f27 zero size 2024-04-25T02:09:04.711 INFO:tasks.workunit.client.1.smithi112.stdout:0/417: mknod da/d1d/d88/d24/c8d 0 2024-04-25T02:09:04.711 INFO:tasks.workunit.client.1.smithi112.stdout:0/418: creat da/f8e x:0 0 0 2024-04-25T02:09:04.713 INFO:tasks.workunit.client.1.smithi112.stdout:8/379: getdents d15/d26/d37 0 2024-04-25T02:09:04.713 INFO:tasks.workunit.client.1.smithi112.stdout:7/199: dwrite d7/f22 [0,4194304] 0 2024-04-25T02:09:04.714 INFO:tasks.workunit.client.1.smithi112.stdout:7/200: write d7/f27 [928733,63715] 0 2024-04-25T02:09:04.714 INFO:tasks.workunit.client.1.smithi112.stdout:7/201: chown d7/f1e 7 1 2024-04-25T02:09:04.714 INFO:tasks.workunit.client.1.smithi112.stdout:3/237: getdents d12/d1f 0 2024-04-25T02:09:04.714 INFO:tasks.workunit.client.1.smithi112.stdout:3/238: creat d12/d13/f47 x:0 0 0 2024-04-25T02:09:04.717 INFO:tasks.workunit.client.1.smithi112.stdout:1/338: creat d7/d4b/f69 x:0 0 0 2024-04-25T02:09:04.723 INFO:tasks.workunit.client.1.smithi112.stdout:8/380: mkdir d15/d81 0 2024-04-25T02:09:04.723 INFO:tasks.workunit.client.1.smithi112.stdout:8/381: getdents d15/d81 0 2024-04-25T02:09:04.726 INFO:tasks.workunit.client.1.smithi112.stdout:8/382: mknod d15/d26/d4f/d67/c82 0 2024-04-25T02:09:04.728 INFO:tasks.workunit.client.1.smithi112.stdout:8/383: link d15/d26/f29 d15/d35/d5c/f83 0 2024-04-25T02:09:04.729 INFO:tasks.workunit.client.1.smithi112.stdout:1/339: dread d7/d9/d1e/de/f3b [0,4194304] 0 2024-04-25T02:09:04.731 INFO:tasks.workunit.client.1.smithi112.stdout:8/384: creat d15/d35/d5c/d5e/d6d/f84 x:0 0 0 2024-04-25T02:09:04.733 INFO:tasks.workunit.client.1.smithi112.stdout:0/419: write da/d1d/d88/d24/f33 [6994020,7964] 0 2024-04-25T02:09:04.733 INFO:tasks.workunit.client.1.smithi112.stdout:0/420: readlink da/d1d/d2e/d40/d49/l5b 0 2024-04-25T02:09:04.733 INFO:tasks.workunit.client.1.smithi112.stdout:0/421: write da/d1d/d2e/d40/d49/d4f/d58/d6d/f8b [742818,75038] 0 2024-04-25T02:09:04.734 INFO:tasks.workunit.client.1.smithi112.stdout:0/422: chown da/d1d/d2e/d40/d49/d4f/d58/d6d/f8b 27949 1 2024-04-25T02:09:04.734 INFO:tasks.workunit.client.1.smithi112.stdout:0/423: creat da/d13/d45/f8f x:0 0 0 2024-04-25T02:09:04.735 INFO:tasks.workunit.client.1.smithi112.stdout:8/385: mkdir d15/d35/d5c/d5e/d85 0 2024-04-25T02:09:04.738 INFO:tasks.workunit.client.1.smithi112.stdout:0/424: unlink da/f18 0 2024-04-25T02:09:04.738 INFO:tasks.workunit.client.1.smithi112.stdout:0/425: chown da/l34 48394666 1 2024-04-25T02:09:04.739 INFO:tasks.workunit.client.1.smithi112.stdout:2/142: dwrite d3/da/f1c [0,4194304] 0 2024-04-25T02:09:04.739 INFO:tasks.workunit.client.1.smithi112.stdout:3/239: dwrite f5 [0,4194304] 0 2024-04-25T02:09:04.739 INFO:tasks.workunit.client.1.smithi112.stdout:5/264: dwrite d1/d2/d4/fe [0,4194304] 0 2024-04-25T02:09:04.741 INFO:tasks.workunit.client.1.smithi112.stdout:7/202: read d7/f8 [810022,18506] 0 2024-04-25T02:09:04.741 INFO:tasks.workunit.client.1.smithi112.stdout:7/203: fdatasync d7/dd/f30 0 2024-04-25T02:09:04.741 INFO:tasks.workunit.client.1.smithi112.stdout:7/204: dread - d7/d29/f2a zero size 2024-04-25T02:09:04.743 INFO:tasks.workunit.client.1.smithi112.stdout:5/265: dread d1/d16/f4d [0,4194304] 0 2024-04-25T02:09:04.746 INFO:tasks.workunit.client.1.smithi112.stdout:8/386: rename d15/d17/f3b to d15/d35/d5c/d5e/d85/f86 0 2024-04-25T02:09:04.749 INFO:tasks.workunit.client.1.smithi112.stdout:1/340: dwrite d7/d9/d1e/de/f27 [0,4194304] 0 2024-04-25T02:09:04.752 INFO:tasks.workunit.client.1.smithi112.stdout:2/143: rmdir d3/da/d18/d27 0 2024-04-25T02:09:04.753 INFO:tasks.workunit.client.1.smithi112.stdout:7/205: dread d7/dd/f30 [0,4194304] 0 2024-04-25T02:09:04.757 INFO:tasks.workunit.client.1.smithi112.stdout:5/266: dread d1/d2/d45/f4c [0,4194304] 0 2024-04-25T02:09:04.759 INFO:tasks.workunit.client.1.smithi112.stdout:3/240: creat d12/d13/d34/f48 x:0 0 0 2024-04-25T02:09:04.759 INFO:tasks.workunit.client.1.smithi112.stdout:3/241: write d12/d1f/f32 [102950,34328] 0 2024-04-25T02:09:04.762 INFO:tasks.workunit.client.1.smithi112.stdout:8/387: rename d15/d26/l2d to d15/d17/l87 0 2024-04-25T02:09:04.762 INFO:tasks.workunit.client.1.smithi112.stdout:8/388: write d15/d40/f60 [5102726,125242] 0 2024-04-25T02:09:04.764 INFO:tasks.workunit.client.1.smithi112.stdout:0/426: getdents da 0 2024-04-25T02:09:04.764 INFO:tasks.workunit.client.1.smithi112.stdout:0/427: chown da/d1d/d2e/d40/d49/d4f/l8a 662 1 2024-04-25T02:09:04.765 INFO:tasks.workunit.client.1.smithi112.stdout:7/206: read d7/f1e [1299360,119626] 0 2024-04-25T02:09:04.765 INFO:tasks.workunit.client.1.smithi112.stdout:7/207: read d7/dd/f1d [3376834,119075] 0 2024-04-25T02:09:04.765 INFO:tasks.workunit.client.1.smithi112.stdout:7/208: write d7/dd/f10 [815716,69893] 0 2024-04-25T02:09:04.769 INFO:tasks.workunit.client.1.smithi112.stdout:0/428: dread da/d1d/d88/d24/f2a [0,4194304] 0 2024-04-25T02:09:04.769 INFO:tasks.workunit.client.1.smithi112.stdout:0/429: dread - da/d1d/d2e/d40/d49/d4f/d58/f7b zero size 2024-04-25T02:09:04.777 INFO:tasks.workunit.client.1.smithi112.stdout:1/341: write d7/d9/d1f/f54 [148558,28457] 0 2024-04-25T02:09:04.779 INFO:tasks.workunit.client.1.smithi112.stdout:2/144: rmdir d3/da/dc/d20 39 2024-04-25T02:09:04.784 INFO:tasks.workunit.client.1.smithi112.stdout:8/389: mkdir d15/d40/d88 0 2024-04-25T02:09:04.788 INFO:tasks.workunit.client.1.smithi112.stdout:1/342: mkdir d7/d9/d4e/d28/d43/d6a 0 2024-04-25T02:09:04.790 INFO:tasks.workunit.client.1.smithi112.stdout:5/267: dwrite d1/f29 [0,4194304] 0 2024-04-25T02:09:04.791 INFO:tasks.workunit.client.1.smithi112.stdout:2/145: rename d3/f1b to d3/de/df/d25/f36 0 2024-04-25T02:09:04.791 INFO:tasks.workunit.client.1.smithi112.stdout:2/146: write d3/da/f29 [4471137,118148] 0 2024-04-25T02:09:04.791 INFO:tasks.workunit.client.1.smithi112.stdout:2/147: creat d3/de/df/d25/f37 x:0 0 0 2024-04-25T02:09:04.792 INFO:tasks.workunit.client.1.smithi112.stdout:0/430: dwrite da/d1d/d88/d24/f2c [0,4194304] 0 2024-04-25T02:09:04.793 INFO:tasks.workunit.client.1.smithi112.stdout:1/343: dread d7/d9/d1e/d40/f57 [0,4194304] 0 2024-04-25T02:09:04.793 INFO:tasks.workunit.client.1.smithi112.stdout:7/209: dwrite d7/dd/f26 [0,4194304] 0 2024-04-25T02:09:04.794 INFO:tasks.workunit.client.1.smithi112.stdout:3/242: symlink d12/l49 0 2024-04-25T02:09:04.802 INFO:tasks.workunit.client.1.smithi112.stdout:5/268: write d1/d16/d22/f4b [175240,8072] 0 2024-04-25T02:09:04.802 INFO:tasks.workunit.client.1.smithi112.stdout:0/431: mkdir da/d1d/d2e/d40/d49/d6b/d90 0 2024-04-25T02:09:04.808 INFO:tasks.workunit.client.1.smithi112.stdout:3/243: mkdir d12/d13/d34/d4a 0 2024-04-25T02:09:04.810 INFO:tasks.workunit.client.1.smithi112.stdout:8/390: mknod d15/d17/d24/c89 0 2024-04-25T02:09:04.810 INFO:tasks.workunit.client.1.smithi112.stdout:8/391: truncate d15/d40/f4d 117286 0 2024-04-25T02:09:04.818 INFO:tasks.workunit.client.1.smithi112.stdout:7/210: dwrite d7/f27 [0,4194304] 0 2024-04-25T02:09:04.821 INFO:tasks.workunit.client.1.smithi112.stdout:7/211: write d7/dd/f26 [5156405,129573] 0 2024-04-25T02:09:04.821 INFO:tasks.workunit.client.1.smithi112.stdout:7/212: stat d7/f17 0 2024-04-25T02:09:04.824 INFO:tasks.workunit.client.1.smithi112.stdout:2/148: mkdir d3/d38 0 2024-04-25T02:09:04.824 INFO:tasks.workunit.client.1.smithi112.stdout:2/149: dread - d3/de/df/d25/f37 zero size 2024-04-25T02:09:04.825 INFO:tasks.workunit.client.1.smithi112.stdout:5/269: unlink d1/d2/f2d 0 2024-04-25T02:09:04.827 INFO:tasks.workunit.client.1.smithi112.stdout:0/432: rename da/d1d/d2e/d40/d49/l5b to da/d1d/d88/d80/l91 0 2024-04-25T02:09:04.828 INFO:tasks.workunit.client.1.smithi112.stdout:3/244: link d12/d13/f30 d12/d1f/d27/f4b 0 2024-04-25T02:09:04.829 INFO:tasks.workunit.client.1.smithi112.stdout:7/213: rmdir d7/d25/d37 39 2024-04-25T02:09:04.831 INFO:tasks.workunit.client.1.smithi112.stdout:5/270: rmdir d1/d2/d5e 0 2024-04-25T02:09:04.831 INFO:tasks.workunit.client.1.smithi112.stdout:5/271: chown d1/d2/d4/cd 857 1 2024-04-25T02:09:04.831 INFO:tasks.workunit.client.1.smithi112.stdout:5/272: fdatasync d1/d2/d28/f57 0 2024-04-25T02:09:04.833 INFO:tasks.workunit.client.1.smithi112.stdout:8/392: rename d15/d17/c6f to d15/d35/d5c/d5e/d6d/c8a 0 2024-04-25T02:09:04.834 INFO:tasks.workunit.client.1.smithi112.stdout:0/433: symlink da/d13/d1e/l92 0 2024-04-25T02:09:04.834 INFO:tasks.workunit.client.1.smithi112.stdout:0/434: creat da/d1d/d2e/d40/d49/d4f/f93 x:0 0 0 2024-04-25T02:09:04.836 INFO:tasks.workunit.client.1.smithi112.stdout:3/245: link d12/f36 d12/d13/d34/d4a/f4c 0 2024-04-25T02:09:04.836 INFO:tasks.workunit.client.1.smithi112.stdout:3/246: chown d12/d1f 1215 1 2024-04-25T02:09:04.837 INFO:tasks.workunit.client.1.smithi112.stdout:2/150: mknod d3/c39 0 2024-04-25T02:09:04.837 INFO:tasks.workunit.client.1.smithi112.stdout:2/151: read - d3/de/f17 zero size 2024-04-25T02:09:04.837 INFO:tasks.workunit.client.1.smithi112.stdout:2/152: write d3/de/df/d25/f37 [277871,126937] 0 2024-04-25T02:09:04.837 INFO:tasks.workunit.client.1.smithi112.stdout:5/273: dread d1/d16/d22/f4b [0,4194304] 0 2024-04-25T02:09:04.839 INFO:tasks.workunit.client.1.smithi112.stdout:7/214: rename d7/c32 to d7/dd/d20/c3e 0 2024-04-25T02:09:04.843 INFO:tasks.workunit.client.1.smithi112.stdout:2/153: rename d3/de/df/d25/f36 to d3/da/f3a 0 2024-04-25T02:09:04.843 INFO:tasks.workunit.client.1.smithi112.stdout:2/154: write d3/da/f2b [473939,53095] 0 2024-04-25T02:09:04.843 INFO:tasks.workunit.client.1.smithi112.stdout:2/155: creat d3/de/df/d25/f3b x:0 0 0 2024-04-25T02:09:04.844 INFO:tasks.workunit.client.1.smithi112.stdout:8/393: dread d15/d26/f3a [0,4194304] 0 2024-04-25T02:09:04.844 INFO:tasks.workunit.client.1.smithi112.stdout:5/274: getdents d1/d41 0 2024-04-25T02:09:04.847 INFO:tasks.workunit.client.1.smithi112.stdout:2/156: rmdir d3/de/df/d32 39 2024-04-25T02:09:04.847 INFO:tasks.workunit.client.1.smithi112.stdout:8/394: mkdir d15/d17/d41/d64/d8b 0 2024-04-25T02:09:04.849 INFO:tasks.workunit.client.1.smithi112.stdout:8/395: dread d15/d26/f73 [0,4194304] 0 2024-04-25T02:09:04.855 INFO:tasks.workunit.client.1.smithi112.stdout:3/247: dread d12/d13/f31 [0,4194304] 0 2024-04-25T02:09:04.859 INFO:tasks.workunit.client.1.smithi112.stdout:5/275: dread d1/d2/d4/f9 [0,4194304] 0 2024-04-25T02:09:04.859 INFO:tasks.workunit.client.1.smithi112.stdout:8/396: write d15/d35/d56/f6a [2079846,93700] 0 2024-04-25T02:09:04.861 INFO:tasks.workunit.client.1.smithi112.stdout:5/276: mknod d1/d2/d4/d1d/c60 0 2024-04-25T02:09:04.863 INFO:tasks.workunit.client.1.smithi112.stdout:8/397: mkdir d15/d26/d8c 0 2024-04-25T02:09:04.866 INFO:tasks.workunit.client.1.smithi112.stdout:0/435: dwrite da/d13/d1e/f4e [0,4194304] 0 2024-04-25T02:09:04.866 INFO:tasks.workunit.client.1.smithi112.stdout:0/436: chown da/d13/d1e/l47 481178570 1 2024-04-25T02:09:04.866 INFO:tasks.workunit.client.1.smithi112.stdout:0/437: fdatasync da/d13/d1e/f4e 0 2024-04-25T02:09:04.866 INFO:tasks.workunit.client.1.smithi112.stdout:0/438: fsync da/d1d/d2e/d40/d49/d4f/f71 0 2024-04-25T02:09:04.867 INFO:tasks.workunit.client.1.smithi112.stdout:5/277: truncate d1/d2/f52 331227 0 2024-04-25T02:09:04.867 INFO:tasks.workunit.client.1.smithi112.stdout:5/278: fdatasync d1/d2/d4/ff 0 2024-04-25T02:09:04.867 INFO:tasks.workunit.client.1.smithi112.stdout:5/279: read d1/d16/d22/f4b [2855431,22512] 0 2024-04-25T02:09:04.869 INFO:tasks.workunit.client.1.smithi112.stdout:7/215: dwrite d7/f22 [0,4194304] 0 2024-04-25T02:09:04.869 INFO:tasks.workunit.client.1.smithi112.stdout:7/216: stat d7/l14 0 2024-04-25T02:09:04.869 INFO:tasks.workunit.client.1.smithi112.stdout:8/398: link d15/d26/f29 d15/d26/d4f/d67/f8d 0 2024-04-25T02:09:04.869 INFO:tasks.workunit.client.1.smithi112.stdout:8/399: chown d15/d35/d5c/d5e/f76 69181 1 2024-04-25T02:09:04.869 INFO:tasks.workunit.client.1.smithi112.stdout:8/400: truncate d15/d26/d4f/d67/f8d 1469964 0 2024-04-25T02:09:04.871 INFO:tasks.workunit.client.1.smithi112.stdout:7/217: dread d7/f8 [0,4194304] 0 2024-04-25T02:09:04.874 INFO:tasks.workunit.client.1.smithi112.stdout:3/248: dwrite d12/d1f/f32 [0,4194304] 0 2024-04-25T02:09:04.874 INFO:tasks.workunit.client.1.smithi112.stdout:3/249: creat d12/d13/f4d x:0 0 0 2024-04-25T02:09:04.874 INFO:tasks.workunit.client.1.smithi112.stdout:3/250: creat d12/d13/f4e x:0 0 0 2024-04-25T02:09:04.874 INFO:tasks.workunit.client.1.smithi112.stdout:3/251: write d12/d1f/d27/f35 [142257,23413] 0 2024-04-25T02:09:04.874 INFO:tasks.workunit.client.1.smithi112.stdout:3/252: stat d12/f19 0 2024-04-25T02:09:04.883 INFO:tasks.workunit.client.1.smithi112.stdout:7/218: write d7/dd/f18 [3113664,18842] 0 2024-04-25T02:09:04.884 INFO:tasks.workunit.client.1.smithi112.stdout:7/219: fsync d7/f23 0 2024-04-25T02:09:04.884 INFO:tasks.workunit.client.1.smithi112.stdout:0/439: dwrite da/d1d/d2e/d40/d49/d4f/d58/f6e [0,4194304] 0 2024-04-25T02:09:04.891 INFO:tasks.workunit.client.1.smithi112.stdout:8/401: rename d15/d17/d24 to d15/d26/d37/d8e 0 2024-04-25T02:09:04.898 INFO:tasks.workunit.client.1.smithi112.stdout:3/253: mkdir d12/d13/d34/d4a/d4f 0 2024-04-25T02:09:04.899 INFO:tasks.workunit.client.1.smithi112.stdout:3/254: chown d12/d1f/d27 50 1 2024-04-25T02:09:04.901 INFO:tasks.workunit.client.1.smithi112.stdout:7/220: mkdir d7/dd/d20/d3f 0 2024-04-25T02:09:04.902 INFO:tasks.workunit.client.1.smithi112.stdout:2/157: rmdir d3/da 39 2024-04-25T02:09:04.910 INFO:tasks.workunit.client.1.smithi112.stdout:0/440: link da/d1d/d2e/d40/d49/d6b/f73 da/f94 0 2024-04-25T02:09:04.910 INFO:tasks.workunit.client.1.smithi112.stdout:0/441: write da/f8e [1028396,93628] 0 2024-04-25T02:09:04.913 INFO:tasks.workunit.client.1.smithi112.stdout:3/255: rename d12/d1f/d27/c3c to d12/d1f/d27/d44/c50 0 2024-04-25T02:09:04.914 INFO:tasks.workunit.client.1.smithi112.stdout:8/402: dwrite d15/d35/d5c/d5e/f76 [0,4194304] 0 2024-04-25T02:09:04.915 INFO:tasks.workunit.client.1.smithi112.stdout:7/221: rmdir d7/dd 39 2024-04-25T02:09:04.917 INFO:tasks.workunit.client.1.smithi112.stdout:0/442: creat da/d13/d23/d77/f95 x:0 0 0 2024-04-25T02:09:04.920 INFO:tasks.workunit.client.1.smithi112.stdout:2/158: rename d3/de/df/d25/f3b to d3/de/f3c 0 2024-04-25T02:09:04.920 INFO:tasks.workunit.client.1.smithi112.stdout:3/256: dread d12/d13/f1b [0,4194304] 0 2024-04-25T02:09:04.923 INFO:tasks.workunit.client.1.smithi112.stdout:8/403: symlink d15/d17/d41/l8f 0 2024-04-25T02:09:04.924 INFO:tasks.workunit.client.1.smithi112.stdout:7/222: mkdir d7/d25/d40 0 2024-04-25T02:09:04.926 INFO:tasks.workunit.client.1.smithi112.stdout:0/443: mknod da/d1d/d2e/d40/d49/d4f/d82/c96 0 2024-04-25T02:09:04.927 INFO:tasks.workunit.client.1.smithi112.stdout:2/159: link d3/da/d18/l1f d3/de/df/d30/l3d 0 2024-04-25T02:09:04.931 INFO:tasks.workunit.client.1.smithi112.stdout:3/257: link l11 d12/d1f/d27/d44/l51 0 2024-04-25T02:09:04.936 INFO:tasks.workunit.client.1.smithi112.stdout:0/444: mkdir da/d1d/d88/d24/d97 0 2024-04-25T02:09:04.941 INFO:tasks.workunit.client.1.smithi112.stdout:3/258: rename d12/d13/f20 to d12/d1f/d27/f52 0 2024-04-25T02:09:04.944 INFO:tasks.workunit.client.1.smithi112.stdout:3/259: mkdir d12/d13/d34/d53 0 2024-04-25T02:09:04.946 INFO:tasks.workunit.client.1.smithi112.stdout:0/445: dread da/d1d/d2e/d40/d49/f61 [0,4194304] 0 2024-04-25T02:09:04.948 INFO:tasks.workunit.client.1.smithi112.stdout:3/260: symlink d12/d13/d34/d4a/l54 0 2024-04-25T02:09:04.949 INFO:tasks.workunit.client.1.smithi112.stdout:3/261: chown d12/d1f 47839 1 2024-04-25T02:09:04.949 INFO:tasks.workunit.client.1.smithi112.stdout:3/262: write d12/d13/f31 [4903162,62391] 0 2024-04-25T02:09:04.949 INFO:tasks.workunit.client.1.smithi112.stdout:3/263: readlink l4 0 2024-04-25T02:09:04.949 INFO:tasks.workunit.client.1.smithi112.stdout:3/264: fsync d12/d13/f2e 0 2024-04-25T02:09:04.949 INFO:tasks.workunit.client.1.smithi112.stdout:3/265: readlink d12/l2a 0 2024-04-25T02:09:04.950 INFO:tasks.workunit.client.1.smithi112.stdout:3/266: mknod d12/d13/d34/c55 0 2024-04-25T02:09:04.950 INFO:tasks.workunit.client.1.smithi112.stdout:0/446: dread da/f46 [0,4194304] 0 2024-04-25T02:09:04.954 INFO:tasks.workunit.client.1.smithi112.stdout:3/267: unlink d12/d1f/f25 0 2024-04-25T02:09:04.954 INFO:tasks.workunit.client.1.smithi112.stdout:3/268: getdents d12/d13/d34/d53 0 2024-04-25T02:09:04.963 INFO:tasks.workunit.client.1.smithi112.stdout:3/269: dread d12/d1f/f32 [0,4194304] 0 2024-04-25T02:09:04.963 INFO:tasks.workunit.client.1.smithi112.stdout:8/404: dwrite d15/d35/d5c/f83 [0,4194304] 0 2024-04-25T02:09:04.963 INFO:tasks.workunit.client.1.smithi112.stdout:2/160: dwrite d3/f33 [0,4194304] 0 2024-04-25T02:09:04.963 INFO:tasks.workunit.client.1.smithi112.stdout:8/405: fdatasync d15/d26/f53 0 2024-04-25T02:09:04.964 INFO:tasks.workunit.client.1.smithi112.stdout:2/161: dread - d3/da/dc/f2e zero size 2024-04-25T02:09:04.964 INFO:tasks.workunit.client.1.smithi112.stdout:7/223: dwrite d7/dd/f18 [0,4194304] 0 2024-04-25T02:09:04.964 INFO:tasks.workunit.client.1.smithi112.stdout:8/406: truncate d15/d17/f19 667937 0 2024-04-25T02:09:04.964 INFO:tasks.workunit.client.1.smithi112.stdout:2/162: write d3/da/f2b [407617,90146] 0 2024-04-25T02:09:04.967 INFO:tasks.workunit.client.1.smithi112.stdout:2/163: dread d3/da/d18/f2f [0,4194304] 0 2024-04-25T02:09:04.967 INFO:tasks.workunit.client.1.smithi112.stdout:2/164: truncate d3/de/f17 259595 0 2024-04-25T02:09:04.970 INFO:tasks.workunit.client.1.smithi112.stdout:3/270: dread d12/f1d [0,4194304] 0 2024-04-25T02:09:04.971 INFO:tasks.workunit.client.1.smithi112.stdout:0/447: dwrite da/d13/d1e/f3b [0,4194304] 0 2024-04-25T02:09:04.971 INFO:tasks.workunit.client.1.smithi112.stdout:0/448: stat da/d13 0 2024-04-25T02:09:05.008 INFO:tasks.workunit.client.1.smithi112.stdout:0/449: dwrite da/d13/f65 [4194304,4194304] 0 2024-04-25T02:09:05.009 INFO:tasks.workunit.client.1.smithi112.stdout:3/271: dwrite d12/d1f/d27/f52 [0,4194304] 0 2024-04-25T02:09:05.009 INFO:tasks.workunit.client.1.smithi112.stdout:8/407: mknod d15/d35/c90 0 2024-04-25T02:09:05.009 INFO:tasks.workunit.client.1.smithi112.stdout:8/408: truncate d15/d17/d1a/f2f 1110284 0 2024-04-25T02:09:05.011 INFO:tasks.workunit.client.1.smithi112.stdout:7/224: mkdir d7/d25/d37/d41 0 2024-04-25T02:09:05.011 INFO:tasks.workunit.client.1.smithi112.stdout:7/225: fsync d7/f1e 0 2024-04-25T02:09:05.026 INFO:tasks.workunit.client.1.smithi112.stdout:0/450: getdents da/d1d/d88/d80 0 2024-04-25T02:09:05.029 INFO:tasks.workunit.client.1.smithi112.stdout:3/272: unlink d12/d1f/d27/d44/l51 0 2024-04-25T02:09:05.031 INFO:tasks.workunit.client.1.smithi112.stdout:2/165: rename d3/de to d3/da/dc/d3e 0 2024-04-25T02:09:05.032 INFO:tasks.workunit.client.1.smithi112.stdout:7/226: dwrite d7/f27 [0,4194304] 0 2024-04-25T02:09:05.034 INFO:tasks.workunit.client.1.smithi112.stdout:3/273: rmdir d12/d1f/d27 39 2024-04-25T02:09:05.034 INFO:tasks.workunit.client.1.smithi112.stdout:3/274: readlink d12/d13/l39 0 2024-04-25T02:09:05.034 INFO:tasks.workunit.client.1.smithi112.stdout:0/451: dread da/d13/d1e/f3b [0,4194304] 0 2024-04-25T02:09:05.034 INFO:tasks.workunit.client.1.smithi112.stdout:2/166: read d3/da/dc/d3e/f17 [97925,20651] 0 2024-04-25T02:09:05.034 INFO:tasks.workunit.client.1.smithi112.stdout:0/452: write da/d13/d23/d77/f95 [537711,118413] 0 2024-04-25T02:09:05.039 INFO:tasks.workunit.client.1.smithi112.stdout:2/167: creat d3/da/d18/f3f x:0 0 0 2024-04-25T02:09:05.039 INFO:tasks.workunit.client.1.smithi112.stdout:0/453: truncate da/d1d/d88/f60 524767 0 2024-04-25T02:09:05.040 INFO:tasks.workunit.client.1.smithi112.stdout:7/227: dread d7/f27 [0,4194304] 0 2024-04-25T02:09:05.045 INFO:tasks.workunit.client.1.smithi112.stdout:0/454: creat da/d1d/d2e/d40/d49/f98 x:0 0 0 2024-04-25T02:09:05.051 INFO:tasks.workunit.client.1.smithi112.stdout:8/409: rename d15/d17/d41 to d15/d35/d5c/d91 0 2024-04-25T02:09:05.052 INFO:tasks.workunit.client.1.smithi112.stdout:8/410: chown d15/f2c 52241 1 2024-04-25T02:09:05.054 INFO:tasks.workunit.client.1.smithi112.stdout:0/455: creat da/d13/d45/d5e/d7a/f99 x:0 0 0 2024-04-25T02:09:05.055 INFO:tasks.workunit.client.1.smithi112.stdout:3/275: rename d12/d1f/d27/f35 to d12/d1f/d27/d44/f56 0 2024-04-25T02:09:05.056 INFO:tasks.workunit.client.1.smithi112.stdout:8/411: rmdir d15/d35/d5c/d91/d64 39 2024-04-25T02:09:05.059 INFO:tasks.workunit.client.1.smithi112.stdout:0/456: truncate da/d13/d45/f5a 168084 0 2024-04-25T02:09:05.060 INFO:tasks.workunit.client.1.smithi112.stdout:0/457: readlink da/d13/l37 0 2024-04-25T02:09:05.060 INFO:tasks.workunit.client.1.smithi112.stdout:8/412: unlink d15/d35/d56/f6c 0 2024-04-25T02:09:05.063 INFO:tasks.workunit.client.1.smithi112.stdout:0/458: creat da/d13/d45/d5e/f9a x:0 0 0 2024-04-25T02:09:05.063 INFO:tasks.workunit.client.1.smithi112.stdout:0/459: read - da/d1d/d2e/d40/d49/d4f/d58/f7c zero size 2024-04-25T02:09:05.064 INFO:tasks.workunit.client.1.smithi112.stdout:0/460: dread da/d13/d1e/f3c [0,4194304] 0 2024-04-25T02:09:05.067 INFO:tasks.workunit.client.1.smithi112.stdout:7/228: dwrite d7/dd/f10 [0,4194304] 0 2024-04-25T02:09:05.069 INFO:tasks.workunit.client.1.smithi112.stdout:0/461: write da/d13/d1e/f3b [2798779,114069] 0 2024-04-25T02:09:05.072 INFO:tasks.workunit.client.1.smithi112.stdout:0/462: symlink da/d1d/l9b 0 2024-04-25T02:09:05.077 INFO:tasks.workunit.client.1.smithi112.stdout:3/276: dwrite d12/d13/f4d [0,4194304] 0 2024-04-25T02:09:05.077 INFO:tasks.workunit.client.1.smithi112.stdout:3/277: readlink l4 0 2024-04-25T02:09:05.077 INFO:tasks.workunit.client.1.smithi112.stdout:3/278: readlink d12/d13/d34/d4a/l54 0 2024-04-25T02:09:05.077 INFO:tasks.workunit.client.1.smithi112.stdout:3/279: chown d12/d13/f31 63895 1 2024-04-25T02:09:05.079 INFO:tasks.workunit.client.1.smithi112.stdout:8/413: dwrite d15/f2c [0,4194304] 0 2024-04-25T02:09:05.079 INFO:tasks.workunit.client.1.smithi112.stdout:8/414: fdatasync d15/d35/f61 0 2024-04-25T02:09:05.083 INFO:tasks.workunit.client.1.smithi112.stdout:3/280: dread d12/d13/f1c [0,4194304] 0 2024-04-25T02:09:05.084 INFO:tasks.workunit.client.1.smithi112.stdout:3/281: truncate d12/d13/f30 3301969 0 2024-04-25T02:09:05.085 INFO:tasks.workunit.client.1.smithi112.stdout:0/463: read da/d13/f65 [7944761,56700] 0 2024-04-25T02:09:05.087 INFO:tasks.workunit.client.1.smithi112.stdout:3/282: truncate d12/d1f/d27/f2b 3026061 0 2024-04-25T02:09:05.103 INFO:tasks.workunit.client.1.smithi112.stdout:0/464: dwrite da/d1d/d88/d78/f79 [0,4194304] 0 2024-04-25T02:09:05.105 INFO:tasks.workunit.client.1.smithi112.stdout:0/465: truncate da/d1d/d88/d24/f48 1672793 0 2024-04-25T02:09:05.107 INFO:tasks.workunit.client.1.smithi112.stdout:0/466: link da/d13/d23/d77/f95 da/d1d/d88/d24/f9c 0 2024-04-25T02:09:05.110 INFO:tasks.workunit.client.1.smithi112.stdout:0/467: dread da/d1d/d88/f30 [0,4194304] 0 2024-04-25T02:09:05.111 INFO:tasks.workunit.client.1.smithi112.stdout:0/468: fsync da/d13/f65 0 2024-04-25T02:09:05.111 INFO:tasks.workunit.client.1.smithi112.stdout:0/469: chown da/d1d/d2e/d40/d49/f61 790872997 1 2024-04-25T02:09:05.117 INFO:tasks.workunit.client.1.smithi112.stdout:3/283: dwrite d12/f36 [0,4194304] 0 2024-04-25T02:09:05.119 INFO:tasks.workunit.client.1.smithi112.stdout:3/284: symlink d12/d1f/d27/d44/l57 0 2024-04-25T02:09:05.119 INFO:tasks.workunit.client.1.smithi112.stdout:3/285: write d12/f14 [1464337,52880] 0 2024-04-25T02:09:05.130 INFO:tasks.workunit.client.1.smithi112.stdout:0/470: dwrite da/d1d/d2e/d40/d49/f61 [0,4194304] 0 2024-04-25T02:09:05.130 INFO:tasks.workunit.client.1.smithi112.stdout:0/471: dread - da/d1d/d2e/d40/d49/d6b/f87 zero size 2024-04-25T02:09:05.131 INFO:tasks.workunit.client.1.smithi112.stdout:0/472: dread da/d1d/d88/f30 [0,4194304] 0 2024-04-25T02:09:05.131 INFO:tasks.workunit.client.1.smithi112.stdout:0/473: readlink da/d13/d1e/l68 0 2024-04-25T02:09:05.133 INFO:tasks.workunit.client.1.smithi112.stdout:0/474: creat da/d1d/d88/d78/f9d x:0 0 0 2024-04-25T02:09:05.169 INFO:tasks.workunit.client.1.smithi112.stdout:0/475: dwrite da/d1d/d2e/d40/d49/d4f/f51 [0,4194304] 0 2024-04-25T02:09:05.171 INFO:tasks.workunit.client.1.smithi112.stdout:0/476: link da/d13/f7e da/d1d/d88/d80/f9e 0 2024-04-25T02:09:05.171 INFO:tasks.workunit.client.1.smithi112.stdout:0/477: truncate da/d1d/d88/f50 4849431 0 2024-04-25T02:09:05.173 INFO:tasks.workunit.client.1.smithi112.stdout:0/478: rename da/d1d/d2e/d40/d49/d4f/f93 to da/d1d/d2e/f9f 0 2024-04-25T02:09:05.174 INFO:tasks.workunit.client.1.smithi112.stdout:0/479: write da/d1d/d88/f30 [2136304,130273] 0 2024-04-25T02:09:05.174 INFO:tasks.workunit.client.1.smithi112.stdout:0/480: chown da/d13/d23/c63 394 1 2024-04-25T02:09:05.176 INFO:tasks.workunit.client.1.smithi112.stdout:0/481: rename da/d13/f65 to da/d1d/d2e/d40/d49/d4f/d82/fa0 0 2024-04-25T02:09:05.193 INFO:tasks.workunit.client.1.smithi112.stdout:0/482: dwrite da/d13/d1e/f6a [0,4194304] 0 2024-04-25T02:09:05.193 INFO:tasks.workunit.client.1.smithi112.stdout:0/483: chown da/fb 2678389 1 2024-04-25T02:09:05.193 INFO:tasks.workunit.client.1.smithi112.stdout:0/484: read da/f52 [72858,102079] 0 2024-04-25T02:09:05.195 INFO:tasks.workunit.client.1.smithi112.stdout:0/485: mknod da/d13/d23/d77/ca1 0 2024-04-25T02:09:05.200 INFO:tasks.workunit.client.1.smithi112.stdout:0/486: getdents da/d13/d45/d5e 0 2024-04-25T02:09:05.200 INFO:tasks.workunit.client.1.smithi112.stdout:0/487: fsync da/d1d/d88/f60 0 2024-04-25T02:09:05.220 INFO:tasks.workunit.client.1.smithi112.stdout:0/488: dwrite da/d1d/d2e/d40/d49/d4f/d82/fa0 [4194304,4194304] 0 2024-04-25T02:09:05.221 INFO:tasks.workunit.client.1.smithi112.stdout:0/489: rename da/d1d/d2e/d40/d49/d4f to da/d1d/d2e/d40/d49/d4f/d58/da2 22 2024-04-25T02:09:05.234 INFO:tasks.workunit.client.1.smithi112.stdout:6/285: sync 2024-04-25T02:09:05.234 INFO:tasks.workunit.client.1.smithi112.stdout:9/292: sync 2024-04-25T02:09:05.235 INFO:tasks.workunit.client.1.smithi112.stdout:0/490: dwrite da/d1d/d2e/d40/d49/d4f/f51 [0,4194304] 0 2024-04-25T02:09:05.238 INFO:tasks.workunit.client.1.smithi112.stdout:6/286: dread d0/f17 [0,4194304] 0 2024-04-25T02:09:05.238 INFO:tasks.workunit.client.1.smithi112.stdout:6/287: write d0/d2/d4/f1d [1888794,97424] 0 2024-04-25T02:09:05.241 INFO:tasks.workunit.client.1.smithi112.stdout:6/288: dread d0/d2/d4/f4f [0,4194304] 0 2024-04-25T02:09:05.241 INFO:tasks.workunit.client.1.smithi112.stdout:6/289: write d0/d2/d4/f5 [4303191,3465] 0 2024-04-25T02:09:05.242 INFO:tasks.workunit.client.1.smithi112.stdout:6/290: rmdir d0 39 2024-04-25T02:09:05.242 INFO:tasks.workunit.client.1.smithi112.stdout:6/291: fsync d0/d2/d4/f11 0 2024-04-25T02:09:05.246 INFO:tasks.workunit.client.1.smithi112.stdout:0/491: read da/d1d/d2e/d40/d49/d4f/f51 [1152909,78566] 0 2024-04-25T02:09:05.246 INFO:tasks.workunit.client.1.smithi112.stdout:0/492: fdatasync da/f46 0 2024-04-25T02:09:05.246 INFO:tasks.workunit.client.1.smithi112.stdout:0/493: stat da/d1d/d2e/d40/d49/d4f/d58/f7c 0 2024-04-25T02:09:05.253 INFO:tasks.workunit.client.1.smithi112.stdout:6/292: dread d0/d2/d4/dd/f24 [0,4194304] 0 2024-04-25T02:09:05.254 INFO:tasks.workunit.client.1.smithi112.stdout:9/293: dwrite d1/f1c [4194304,4194304] 0 2024-04-25T02:09:05.254 INFO:tasks.workunit.client.1.smithi112.stdout:9/294: getdents d1/d48/d65 0 2024-04-25T02:09:05.257 INFO:tasks.workunit.client.1.smithi112.stdout:9/295: mknod d1/d13/d5b/d55/d63/c68 0 2024-04-25T02:09:05.262 INFO:tasks.workunit.client.1.smithi112.stdout:9/296: creat d1/df/d3c/f69 x:0 0 0 2024-04-25T02:09:05.269 INFO:tasks.workunit.client.1.smithi112.stdout:0/494: dwrite da/d1d/d2e/d40/d49/d4f/d58/f6e [0,4194304] 0 2024-04-25T02:09:05.269 INFO:tasks.workunit.client.1.smithi112.stdout:0/495: readlink da/d13/l37 0 2024-04-25T02:09:05.269 INFO:tasks.workunit.client.1.smithi112.stdout:0/496: chown da/f26 680811271 1 2024-04-25T02:09:05.279 INFO:tasks.workunit.client.1.smithi112.stdout:0/497: write da/d1d/d2e/d40/d49/d4f/d58/f6e [1002199,84945] 0 2024-04-25T02:09:05.281 INFO:tasks.workunit.client.1.smithi112.stdout:0/498: link da/d1d/d2e/d40/d49/d4f/d58/c69 da/d1d/d88/d80/ca3 0 2024-04-25T02:09:05.281 INFO:tasks.workunit.client.1.smithi112.stdout:6/293: dwrite d0/d2/d4/d28/f34 [0,4194304] 0 2024-04-25T02:09:05.281 INFO:tasks.workunit.client.1.smithi112.stdout:9/297: dwrite d1/d13/f26 [0,4194304] 0 2024-04-25T02:09:05.298 INFO:tasks.workunit.client.1.smithi112.stdout:0/499: dwrite da/d13/d45/d5e/f9a [0,4194304] 0 2024-04-25T02:09:05.298 INFO:tasks.workunit.client.1.smithi112.stdout:0/500: creat da/d13/d1e/fa4 x:0 0 0 2024-04-25T02:09:05.305 INFO:tasks.workunit.client.1.smithi112.stdout:6/294: dwrite d0/d2/d3b/f58 [0,4194304] 0 2024-04-25T02:09:05.311 INFO:tasks.workunit.client.1.smithi112.stdout:6/295: getdents d0/d2/d3b/d53 0 2024-04-25T02:09:05.311 INFO:tasks.workunit.client.1.smithi112.stdout:6/296: chown d0/d2/d4/d28/f57 1009 1 2024-04-25T02:09:05.311 INFO:tasks.workunit.client.1.smithi112.stdout:6/297: stat d0/d2/d2c/d41/f5d 0 2024-04-25T02:09:05.318 INFO:tasks.workunit.client.1.smithi112.stdout:0/501: dwrite f2 [0,4194304] 0 2024-04-25T02:09:05.318 INFO:tasks.workunit.client.1.smithi112.stdout:0/502: write da/d1d/d88/d24/f2a [1199114,103797] 0 2024-04-25T02:09:05.323 INFO:tasks.workunit.client.1.smithi112.stdout:6/298: dread d0/d2/d4/f5 [0,4194304] 0 2024-04-25T02:09:05.324 INFO:tasks.workunit.client.1.smithi112.stdout:6/299: mknod d0/d2/d4/c6a 0 2024-04-25T02:09:05.334 INFO:tasks.workunit.client.1.smithi112.stdout:0/503: dwrite da/f52 [0,4194304] 0 2024-04-25T02:09:05.337 INFO:tasks.workunit.client.1.smithi112.stdout:0/504: dread da/d1d/d2e/d40/d49/d4f/f51 [0,4194304] 0 2024-04-25T02:09:05.337 INFO:tasks.workunit.client.1.smithi112.stdout:0/505: creat da/d13/fa5 x:0 0 0 2024-04-25T02:09:05.337 INFO:tasks.workunit.client.1.smithi112.stdout:0/506: read da/f46 [1013983,123845] 0 2024-04-25T02:09:05.340 INFO:tasks.workunit.client.1.smithi112.stdout:0/507: mknod da/d13/d23/d77/ca6 0 2024-04-25T02:09:05.340 INFO:tasks.workunit.client.1.smithi112.stdout:0/508: write da/d13/d1e/f83 [857928,121378] 0 2024-04-25T02:09:05.340 INFO:tasks.workunit.client.1.smithi112.stdout:0/509: truncate da/f94 68925 0 2024-04-25T02:09:05.340 INFO:tasks.workunit.client.1.smithi112.stdout:0/510: dread - da/d1d/d88/d78/f9d zero size 2024-04-25T02:09:05.340 INFO:tasks.workunit.client.1.smithi112.stdout:0/511: getdents da/d1d/d2e/d40/d49/d5f 0 2024-04-25T02:09:05.342 INFO:tasks.workunit.client.1.smithi112.stdout:0/512: symlink da/d1d/d88/d78/la7 0 2024-04-25T02:09:05.358 INFO:tasks.workunit.client.1.smithi112.stdout:0/513: dwrite da/d1d/d88/d24/f33 [0,4194304] 0 2024-04-25T02:09:05.359 INFO:tasks.workunit.client.1.smithi112.stdout:0/514: readlink da/d1d/d2e/d40/l57 0 2024-04-25T02:09:05.369 INFO:tasks.workunit.client.1.smithi112.stdout:0/515: write da/f52 [2924426,123731] 0 2024-04-25T02:09:05.383 INFO:tasks.workunit.client.1.smithi112.stdout:0/516: dwrite da/f10 [0,4194304] 0 2024-04-25T02:09:05.385 INFO:tasks.workunit.client.1.smithi112.stdout:0/517: rename da/d1d/d2e/d40/d49/d4f/d58/f7b to da/d13/fa8 0 2024-04-25T02:09:05.385 INFO:tasks.workunit.client.1.smithi112.stdout:0/518: dread - da/d1d/d88/d80/f9e zero size 2024-04-25T02:09:05.386 INFO:tasks.workunit.client.1.smithi112.stdout:0/519: mknod da/d13/d45/ca9 0 2024-04-25T02:09:05.386 INFO:tasks.workunit.client.1.smithi112.stdout:0/520: readlink da/d1d/d2e/d40/d49/d4f/l56 0 2024-04-25T02:09:05.386 INFO:tasks.workunit.client.1.smithi112.stdout:0/521: write da/f52 [1097285,50416] 0 2024-04-25T02:09:05.387 INFO:tasks.workunit.client.1.smithi112.stdout:0/522: mknod da/d1d/d2e/d40/d49/d4f/d82/caa 0 2024-04-25T02:09:05.389 INFO:tasks.workunit.client.1.smithi112.stdout:0/523: truncate da/d1d/d2e/d40/d49/d4f/d58/d6d/f8b 375818 0 2024-04-25T02:09:05.389 INFO:tasks.workunit.client.1.smithi112.stdout:0/524: write da/d13/d1e/f3c [342817,36444] 0 2024-04-25T02:09:05.389 INFO:tasks.workunit.client.1.smithi112.stdout:0/525: stat da/d1d/d88/c2d 0 2024-04-25T02:09:05.389 INFO:tasks.workunit.client.1.smithi112.stdout:0/526: creat da/d1d/d88/d78/fab x:0 0 0 2024-04-25T02:09:05.393 INFO:tasks.workunit.client.1.smithi112.stdout:0/527: link da/d1d/d2e/d40/d49/d6b/f85 da/d1d/d2e/d40/d49/d6b/d90/fac 0 2024-04-25T02:09:05.394 INFO:tasks.workunit.client.1.smithi112.stdout:0/528: fdatasync da/d1d/d88/d24/f48 0 2024-04-25T02:09:05.394 INFO:tasks.workunit.client.1.smithi112.stdout:0/529: fsync da/d13/d45/d5e/d7a/f99 0 2024-04-25T02:09:05.394 INFO:tasks.workunit.client.1.smithi112.stdout:4/279: sync 2024-04-25T02:09:05.394 INFO:tasks.workunit.client.1.smithi112.stdout:1/344: sync 2024-04-25T02:09:05.398 INFO:tasks.workunit.client.1.smithi112.stdout:1/345: rename d7/d9/d1e/d40/c60 to d7/d9/d4e/d28/c6b 0 2024-04-25T02:09:05.400 INFO:tasks.workunit.client.1.smithi112.stdout:1/346: read d7/d9/d51/d58/f5b [435082,28314] 0 2024-04-25T02:09:05.401 INFO:tasks.workunit.client.1.smithi112.stdout:4/280: dread d2/d12/d22/f2f [0,4194304] 0 2024-04-25T02:09:05.408 INFO:tasks.workunit.client.1.smithi112.stdout:0/530: dwrite da/d13/d45/d5e/f9a [0,4194304] 0 2024-04-25T02:09:05.415 INFO:tasks.workunit.client.1.smithi112.stdout:1/347: write d7/d9/f10 [3049764,74615] 0 2024-04-25T02:09:05.424 INFO:tasks.workunit.client.1.smithi112.stdout:0/531: dwrite da/d1d/d2e/d40/d49/d4f/d58/d6d/f8b [0,4194304] 0 2024-04-25T02:09:05.424 INFO:tasks.workunit.client.1.smithi112.stdout:4/281: dwrite d2/d1e/d42/f4d [0,4194304] 0 2024-04-25T02:09:05.430 INFO:tasks.workunit.client.1.smithi112.stdout:4/282: symlink d2/d1e/l53 0 2024-04-25T02:09:05.432 INFO:tasks.workunit.client.1.smithi112.stdout:4/283: truncate d2/f46 2240211 0 2024-04-25T02:09:05.433 INFO:tasks.workunit.client.1.smithi112.stdout:1/348: dwrite d7/d9/d4e/d28/d32/f64 [0,4194304] 0 2024-04-25T02:09:05.436 INFO:tasks.workunit.client.1.smithi112.stdout:4/284: mknod d2/d17/d20/d26/d39/c54 0 2024-04-25T02:09:05.440 INFO:tasks.workunit.client.1.smithi112.stdout:4/285: rename d2 to d2/d12/d55 22 2024-04-25T02:09:05.441 INFO:tasks.workunit.client.1.smithi112.stdout:1/349: truncate d7/f4d 3585058 0 2024-04-25T02:09:05.441 INFO:tasks.workunit.client.1.smithi112.stdout:0/532: dwrite da/d1d/d2e/d40/d49/f61 [0,4194304] 0 2024-04-25T02:09:05.441 INFO:tasks.workunit.client.1.smithi112.stdout:0/533: fsync da/d1d/d88/f50 0 2024-04-25T02:09:05.443 INFO:tasks.workunit.client.1.smithi112.stdout:4/286: rename d2/d1e/d1b/f21 to d2/d17/d20/d26/d39/d49/f56 0 2024-04-25T02:09:05.445 INFO:tasks.workunit.client.1.smithi112.stdout:4/287: mkdir d2/d1e/d4b/d57 0 2024-04-25T02:09:05.450 INFO:tasks.workunit.client.1.smithi112.stdout:0/534: dread da/fb [0,4194304] 0 2024-04-25T02:09:05.453 INFO:tasks.workunit.client.1.smithi112.stdout:0/535: mkdir da/d1d/d2e/d40/dad 0 2024-04-25T02:09:05.453 INFO:tasks.workunit.client.1.smithi112.stdout:0/536: fsync da/d1d/d88/d78/f79 0 2024-04-25T02:09:05.460 INFO:tasks.workunit.client.1.smithi112.stdout:1/350: dread d7/f4d [0,4194304] 0 2024-04-25T02:09:05.476 INFO:tasks.workunit.client.1.smithi112.stdout:4/288: dwrite d2/d17/d20/f4f [0,4194304] 0 2024-04-25T02:09:05.476 INFO:tasks.workunit.client.1.smithi112.stdout:4/289: stat d2/d17/f28 0 2024-04-25T02:09:05.476 INFO:tasks.workunit.client.1.smithi112.stdout:1/351: dwrite d7/d9/d1e/de/f17 [0,4194304] 0 2024-04-25T02:09:05.477 INFO:tasks.workunit.client.1.smithi112.stdout:0/537: dwrite da/d1d/d88/d24/f2c [0,4194304] 0 2024-04-25T02:09:05.486 INFO:tasks.workunit.client.1.smithi112.stdout:1/352: write d7/d9/d4e/d28/d32/f4f [2985906,28245] 0 2024-04-25T02:09:05.488 INFO:tasks.workunit.client.1.smithi112.stdout:4/290: rmdir d2/d1e/d4b 39 2024-04-25T02:09:05.488 INFO:tasks.workunit.client.1.smithi112.stdout:4/291: truncate d2/d17/d20/f23 1443619 0 2024-04-25T02:09:05.489 INFO:tasks.workunit.client.1.smithi112.stdout:1/353: dread d7/d9/d1e/f12 [0,4194304] 0 2024-04-25T02:09:05.495 INFO:tasks.workunit.client.1.smithi112.stdout:0/538: getdents da/d1d/d88/d24 0 2024-04-25T02:09:05.495 INFO:tasks.workunit.client.1.smithi112.stdout:0/539: creat da/d1d/d2e/d40/d49/d6b/fae x:0 0 0 2024-04-25T02:09:05.499 INFO:tasks.workunit.client.1.smithi112.stdout:4/292: symlink d2/d17/d25/l58 0 2024-04-25T02:09:05.503 INFO:tasks.workunit.client.1.smithi112.stdout:0/540: mknod da/d1d/d88/caf 0 2024-04-25T02:09:05.514 INFO:tasks.workunit.client.1.smithi112.stdout:5/280: sync 2024-04-25T02:09:05.514 INFO:tasks.workunit.client.1.smithi112.stdout:2/168: sync 2024-04-25T02:09:05.515 INFO:tasks.workunit.client.1.smithi112.stdout:7/229: sync 2024-04-25T02:09:05.516 INFO:tasks.workunit.client.1.smithi112.stdout:1/354: getdents d7/d9/d4e/d28/d32 0 2024-04-25T02:09:05.517 INFO:tasks.workunit.client.1.smithi112.stdout:0/541: symlink da/d13/d45/d5e/d7a/lb0 0 2024-04-25T02:09:05.521 INFO:tasks.workunit.client.1.smithi112.stdout:2/169: dread d3/da/dc/d20/f21 [0,4194304] 0 2024-04-25T02:09:05.522 INFO:tasks.workunit.client.1.smithi112.stdout:2/170: readlink d3/da/l1d 0 2024-04-25T02:09:05.550 INFO:tasks.workunit.client.1.smithi112.stdout:6/300: sync 2024-04-25T02:09:05.550 INFO:tasks.workunit.client.1.smithi112.stdout:8/415: sync 2024-04-25T02:09:05.550 INFO:tasks.workunit.client.1.smithi112.stdout:3/286: sync 2024-04-25T02:09:05.551 INFO:tasks.workunit.client.1.smithi112.stdout:9/298: sync 2024-04-25T02:09:05.560 INFO:tasks.workunit.client.1.smithi112.stdout:7/230: truncate d7/fc 1927480 0 2024-04-25T02:09:05.561 INFO:tasks.workunit.client.1.smithi112.stdout:1/355: write d7/f24 [1359303,117514] 0 2024-04-25T02:09:05.564 INFO:tasks.workunit.client.1.smithi112.stdout:0/542: mkdir da/d13/d1e/db1 0 2024-04-25T02:09:05.564 INFO:tasks.workunit.client.1.smithi112.stdout:0/543: stat da/d1d/d2e/d40 0 2024-04-25T02:09:05.564 INFO:tasks.workunit.client.1.smithi112.stdout:0/544: write da/d1d/d2e/d40/d49/f98 [534348,64117] 0 2024-04-25T02:09:05.569 INFO:tasks.workunit.client.1.smithi112.stdout:9/299: creat d1/df/d3c/d43/f6a x:0 0 0 2024-04-25T02:09:05.571 INFO:tasks.workunit.client.1.smithi112.stdout:5/281: symlink d1/d2/d45/l61 0 2024-04-25T02:09:05.571 INFO:tasks.workunit.client.1.smithi112.stdout:5/282: fdatasync d1/f18 0 2024-04-25T02:09:05.574 INFO:tasks.workunit.client.1.smithi112.stdout:7/231: rename d7/f23 to d7/dd/d20/d3f/f42 0 2024-04-25T02:09:05.576 INFO:tasks.workunit.client.1.smithi112.stdout:6/301: dwrite d0/f30 [0,4194304] 0 2024-04-25T02:09:05.576 INFO:tasks.workunit.client.1.smithi112.stdout:8/416: dwrite d15/d17/d1a/f1d [0,4194304] 0 2024-04-25T02:09:05.576 INFO:tasks.workunit.client.1.smithi112.stdout:8/417: chown d15/d17/d1a/f33 216028950 1 2024-04-25T02:09:05.578 INFO:tasks.workunit.client.1.smithi112.stdout:1/356: rmdir d7/d9/d1e/de 39 2024-04-25T02:09:05.581 INFO:tasks.workunit.client.1.smithi112.stdout:0/545: unlink da/d13/l2f 0 2024-04-25T02:09:05.586 INFO:tasks.workunit.client.1.smithi112.stdout:3/287: mknod d12/c58 0 2024-04-25T02:09:05.587 INFO:tasks.workunit.client.1.smithi112.stdout:6/302: dread d0/d2/d2c/f33 [0,4194304] 0 2024-04-25T02:09:05.588 INFO:tasks.workunit.client.1.smithi112.stdout:9/300: dwrite d1/df/d3c/d43/f6a [0,4194304] 0 2024-04-25T02:09:05.588 INFO:tasks.workunit.client.1.smithi112.stdout:3/288: dread d12/f19 [0,4194304] 0 2024-04-25T02:09:05.589 INFO:tasks.workunit.client.1.smithi112.stdout:5/283: chown d1/d2/f52 53340107 1 2024-04-25T02:09:05.589 INFO:tasks.workunit.client.1.smithi112.stdout:5/284: readlink d1/d41/l58 0 2024-04-25T02:09:05.589 INFO:tasks.workunit.client.1.smithi112.stdout:8/418: dread d15/d17/d1a/f1d [0,4194304] 0 2024-04-25T02:09:05.594 INFO:tasks.workunit.client.1.smithi112.stdout:1/357: dwrite d7/d9/d4e/d28/d32/f68 [0,4194304] 0 2024-04-25T02:09:05.594 INFO:tasks.workunit.client.1.smithi112.stdout:1/358: stat d7/d9/d51/d58 0 2024-04-25T02:09:05.596 INFO:tasks.workunit.client.1.smithi112.stdout:0/546: symlink da/d1d/d88/d80/lb2 0 2024-04-25T02:09:05.596 INFO:tasks.workunit.client.1.smithi112.stdout:0/547: read da/d1d/d2e/d40/d49/d6b/f85 [8838,56694] 0 2024-04-25T02:09:05.596 INFO:tasks.workunit.client.1.smithi112.stdout:0/548: readlink da/d1d/d2e/d40/l57 0 2024-04-25T02:09:05.596 INFO:tasks.workunit.client.1.smithi112.stdout:0/549: dread - da/d13/d1e/fa4 zero size 2024-04-25T02:09:05.596 INFO:tasks.workunit.client.1.smithi112.stdout:0/550: fdatasync da/d13/f7e 0 2024-04-25T02:09:05.598 INFO:tasks.workunit.client.1.smithi112.stdout:6/303: mkdir d0/d2/d3b/d53/d67/d6b 0 2024-04-25T02:09:05.602 INFO:tasks.workunit.client.1.smithi112.stdout:9/301: getdents d1/d13 0 2024-04-25T02:09:05.605 INFO:tasks.workunit.client.1.smithi112.stdout:8/419: dwrite d15/d26/f53 [0,4194304] 0 2024-04-25T02:09:05.606 INFO:tasks.workunit.client.1.smithi112.stdout:3/289: link d12/d13/f43 d12/d13/d34/d53/f59 0 2024-04-25T02:09:05.608 INFO:tasks.workunit.client.1.smithi112.stdout:6/304: read d0/f30 [1422443,125160] 0 2024-04-25T02:09:05.608 INFO:tasks.workunit.client.1.smithi112.stdout:6/305: write d0/d2/d4/dd/f26 [4258685,59721] 0 2024-04-25T02:09:05.614 INFO:tasks.workunit.client.1.smithi112.stdout:1/359: chown d7/f2c 41537548 1 2024-04-25T02:09:05.615 INFO:tasks.workunit.client.1.smithi112.stdout:0/551: symlink da/lb3 0 2024-04-25T02:09:05.625 INFO:tasks.workunit.client.1.smithi112.stdout:6/306: dwrite d0/d2/d4/d28/f5c [0,4194304] 0 2024-04-25T02:09:05.626 INFO:tasks.workunit.client.1.smithi112.stdout:3/290: unlink l8 0 2024-04-25T02:09:05.626 INFO:tasks.workunit.client.1.smithi112.stdout:3/291: write d12/d13/f47 [729772,30458] 0 2024-04-25T02:09:05.626 INFO:tasks.workunit.client.1.smithi112.stdout:3/292: getdents d12/d13/d34/d4a/d4f 0 2024-04-25T02:09:05.628 INFO:tasks.workunit.client.1.smithi112.stdout:0/552: dread da/d1d/d88/d78/f84 [0,4194304] 0 2024-04-25T02:09:05.628 INFO:tasks.workunit.client.1.smithi112.stdout:0/553: write da/d13/fa8 [366340,2202] 0 2024-04-25T02:09:05.629 INFO:tasks.workunit.client.1.smithi112.stdout:7/232: rename d7/d29 to d7/d25/d43 0 2024-04-25T02:09:05.635 INFO:tasks.workunit.client.1.smithi112.stdout:1/360: unlink d7/d9/d1e/de/c35 0 2024-04-25T02:09:05.635 INFO:tasks.workunit.client.1.smithi112.stdout:3/293: dread d12/d1f/d27/f52 [0,4194304] 0 2024-04-25T02:09:05.638 INFO:tasks.workunit.client.1.smithi112.stdout:9/302: symlink d1/d48/l6b 0 2024-04-25T02:09:05.638 INFO:tasks.workunit.client.1.smithi112.stdout:9/303: getdents d1/d48/d65 0 2024-04-25T02:09:05.639 INFO:tasks.workunit.client.1.smithi112.stdout:7/233: dread d7/f13 [0,4194304] 0 2024-04-25T02:09:05.644 INFO:tasks.workunit.client.1.smithi112.stdout:0/554: mkdir da/d13/d45/d5e/db4 0 2024-04-25T02:09:05.644 INFO:tasks.workunit.client.1.smithi112.stdout:0/555: write da/d13/d45/f5a [342781,20680] 0 2024-04-25T02:09:05.644 INFO:tasks.workunit.client.1.smithi112.stdout:0/556: chown da/d1d/d88/f60 3029 1 2024-04-25T02:09:05.644 INFO:tasks.workunit.client.1.smithi112.stdout:0/557: stat da/d1d/d2e/d40/d49/d4f/d82/caa 0 2024-04-25T02:09:05.645 INFO:tasks.workunit.client.1.smithi112.stdout:0/558: chown da/d1d/d2e/d40/d49/d6b/fae 5303 1 2024-04-25T02:09:05.645 INFO:tasks.workunit.client.1.smithi112.stdout:5/285: rename d1 to d1/d2/d62 22 2024-04-25T02:09:05.646 INFO:tasks.workunit.client.1.smithi112.stdout:3/294: link d12/d13/d34/d4a/l54 d12/d1f/d27/d44/l5a 0 2024-04-25T02:09:05.652 INFO:tasks.workunit.client.1.smithi112.stdout:7/234: creat d7/dd/d20/d3f/f44 x:0 0 0 2024-04-25T02:09:05.652 INFO:tasks.workunit.client.1.smithi112.stdout:7/235: fdatasync d7/f22 0 2024-04-25T02:09:05.653 INFO:tasks.workunit.client.1.smithi112.stdout:7/236: truncate d7/dd/d20/f2b 1250943 0 2024-04-25T02:09:05.657 INFO:tasks.workunit.client.1.smithi112.stdout:6/307: getdents d0/d32/d45 0 2024-04-25T02:09:05.657 INFO:tasks.workunit.client.1.smithi112.stdout:6/308: chown d0/d2/d4/f5 3 1 2024-04-25T02:09:05.659 INFO:tasks.workunit.client.1.smithi112.stdout:0/559: truncate da/f10 7815052 0 2024-04-25T02:09:05.659 INFO:tasks.workunit.client.1.smithi112.stdout:0/560: fdatasync da/d1d/d88/d80/f9e 0 2024-04-25T02:09:05.659 INFO:tasks.workunit.client.1.smithi112.stdout:0/561: creat da/d1d/d2e/d40/d49/d4f/d58/fb5 x:0 0 0 2024-04-25T02:09:05.662 INFO:tasks.workunit.client.1.smithi112.stdout:5/286: creat d1/f63 x:0 0 0 2024-04-25T02:09:05.665 INFO:tasks.workunit.client.1.smithi112.stdout:3/295: rmdir d12/d13/d34/d53 39 2024-04-25T02:09:05.666 INFO:tasks.workunit.client.1.smithi112.stdout:3/296: write d12/f14 [2062827,23127] 0 2024-04-25T02:09:05.668 INFO:tasks.workunit.client.1.smithi112.stdout:6/309: symlink d0/d2/d3b/l6c 0 2024-04-25T02:09:05.668 INFO:tasks.workunit.client.1.smithi112.stdout:6/310: stat d0/d2/d3b/d53/d67/d6b 0 2024-04-25T02:09:05.683 INFO:tasks.workunit.client.1.smithi112.stdout:9/304: dwrite d1/df/d3c/d43/f4a [4194304,4194304] 0 2024-04-25T02:09:05.688 INFO:tasks.workunit.client.1.smithi112.stdout:7/237: dwrite d7/f16 [0,4194304] 0 2024-04-25T02:09:05.689 INFO:tasks.workunit.client.1.smithi112.stdout:7/238: chown d7/fc 212890245 1 2024-04-25T02:09:05.693 INFO:tasks.workunit.client.1.smithi112.stdout:7/239: unlink d7/dd/l1a 0 2024-04-25T02:09:05.697 INFO:tasks.workunit.client.1.smithi112.stdout:3/297: fsync d12/f14 0 2024-04-25T02:09:05.698 INFO:tasks.workunit.client.1.smithi112.stdout:7/240: rename d7/dd/d20/f2b to d7/dd/d20/d2c/f45 0 2024-04-25T02:09:05.704 INFO:tasks.workunit.client.1.smithi112.stdout:3/298: truncate f5 325235 0 2024-04-25T02:09:05.706 INFO:tasks.workunit.client.1.smithi112.stdout:0/562: dwrite da/d1d/d88/d78/f9d [0,4194304] 0 2024-04-25T02:09:05.707 INFO:tasks.workunit.client.1.smithi112.stdout:6/311: dwrite d0/d32/d45/f51 [0,4194304] 0 2024-04-25T02:09:05.707 INFO:tasks.workunit.client.1.smithi112.stdout:6/312: getdents d0/d32/d45 0 2024-04-25T02:09:05.707 INFO:tasks.workunit.client.1.smithi112.stdout:6/313: dread - d0/d2/d3b/f68 zero size 2024-04-25T02:09:05.707 INFO:tasks.workunit.client.1.smithi112.stdout:5/287: dwrite d1/f18 [0,4194304] 0 2024-04-25T02:09:05.707 INFO:tasks.workunit.client.1.smithi112.stdout:5/288: chown d1/d16/d51 905128 1 2024-04-25T02:09:05.708 INFO:tasks.workunit.client.1.smithi112.stdout:3/299: symlink d12/d1f/d27/d44/l5b 0 2024-04-25T02:09:05.709 INFO:tasks.workunit.client.1.smithi112.stdout:9/305: dwrite d1/d13/f26 [0,4194304] 0 2024-04-25T02:09:05.709 INFO:tasks.workunit.client.1.smithi112.stdout:9/306: truncate d1/df/f23 1042150 0 2024-04-25T02:09:05.711 INFO:tasks.workunit.client.1.smithi112.stdout:7/241: rename d7/dd/d20/d3f to d7/d25/d43/d46 0 2024-04-25T02:09:05.711 INFO:tasks.workunit.client.1.smithi112.stdout:7/242: fdatasync d7/f1e 0 2024-04-25T02:09:05.711 INFO:tasks.workunit.client.1.smithi112.stdout:7/243: readlink d7/l12 0 2024-04-25T02:09:05.711 INFO:tasks.workunit.client.1.smithi112.stdout:7/244: chown d7/c35 2547602 1 2024-04-25T02:09:05.713 INFO:tasks.workunit.client.1.smithi112.stdout:6/314: write d0/d2/d4/dd/f24 [1983544,67296] 0 2024-04-25T02:09:05.724 INFO:tasks.workunit.client.1.smithi112.stdout:3/300: getdents d12/d13/d34/d4a 0 2024-04-25T02:09:05.729 INFO:tasks.workunit.client.1.smithi112.stdout:9/307: mkdir d1/df/d3c/d6c 0 2024-04-25T02:09:05.729 INFO:tasks.workunit.client.1.smithi112.stdout:9/308: dread - d1/df/f39 zero size 2024-04-25T02:09:05.729 INFO:tasks.workunit.client.1.smithi112.stdout:9/309: readlink d1/l42 0 2024-04-25T02:09:05.729 INFO:tasks.workunit.client.1.smithi112.stdout:9/310: read d1/fd [578284,72643] 0 2024-04-25T02:09:05.731 INFO:tasks.workunit.client.1.smithi112.stdout:3/301: write d12/d13/f4d [567878,20690] 0 2024-04-25T02:09:05.731 INFO:tasks.workunit.client.1.smithi112.stdout:7/245: rename d7/f8 to d7/d25/d43/f47 0 2024-04-25T02:09:05.733 INFO:tasks.workunit.client.1.smithi112.stdout:6/315: mknod d0/d2/d3b/d53/d67/c6d 0 2024-04-25T02:09:05.733 INFO:tasks.workunit.client.1.smithi112.stdout:9/311: getdents d1/d13/d5b/d55/d63 0 2024-04-25T02:09:05.738 INFO:tasks.workunit.client.1.smithi112.stdout:6/316: rename d0/d2/d3b/c4e to d0/d32/d45/c6e 0 2024-04-25T02:09:05.739 INFO:tasks.workunit.client.1.smithi112.stdout:9/312: mknod d1/d48/d65/c6d 0 2024-04-25T02:09:05.740 INFO:tasks.workunit.client.1.smithi112.stdout:3/302: link d12/d13/d34/f48 d12/f5c 0 2024-04-25T02:09:05.742 INFO:tasks.workunit.client.1.smithi112.stdout:6/317: truncate d0/d2/d4/dd/f3d 6060801 0 2024-04-25T02:09:05.742 INFO:tasks.workunit.client.1.smithi112.stdout:7/246: write d7/f22 [1534761,88635] 0 2024-04-25T02:09:05.742 INFO:tasks.workunit.client.1.smithi112.stdout:7/247: write d7/d25/d43/f47 [2470696,64130] 0 2024-04-25T02:09:05.743 INFO:tasks.workunit.client.1.smithi112.stdout:7/248: dread - d7/d25/d43/d46/f44 zero size 2024-04-25T02:09:05.743 INFO:tasks.workunit.client.1.smithi112.stdout:9/313: symlink d1/d13/d5b/l6e 0 2024-04-25T02:09:05.746 INFO:tasks.workunit.client.1.smithi112.stdout:7/249: mknod d7/dd/d20/d36/d3a/c48 0 2024-04-25T02:09:05.746 INFO:tasks.workunit.client.1.smithi112.stdout:7/250: chown d7/dd/d20/l3b 525766608 1 2024-04-25T02:09:05.748 INFO:tasks.workunit.client.1.smithi112.stdout:9/314: mknod d1/df/d3c/d6c/c6f 0 2024-04-25T02:09:05.749 INFO:tasks.workunit.client.1.smithi112.stdout:3/303: mkdir d12/d5d 0 2024-04-25T02:09:05.753 INFO:tasks.workunit.client.1.smithi112.stdout:5/289: dwrite d1/d2/d4/f9 [0,4194304] 0 2024-04-25T02:09:05.754 INFO:tasks.workunit.client.1.smithi112.stdout:6/318: read d0/d2/d2c/f2e [591763,125046] 0 2024-04-25T02:09:05.754 INFO:tasks.workunit.client.1.smithi112.stdout:0/563: dwrite da/d1d/d2e/d40/d49/d4f/f71 [0,4194304] 0 2024-04-25T02:09:05.757 INFO:tasks.workunit.client.1.smithi112.stdout:7/251: rmdir d7/d25 39 2024-04-25T02:09:05.758 INFO:tasks.workunit.client.1.smithi112.stdout:9/315: write d1/d48/f5c [771245,5709] 0 2024-04-25T02:09:05.761 INFO:tasks.workunit.client.1.smithi112.stdout:3/304: link d12/l49 d12/d13/d34/l5e 0 2024-04-25T02:09:05.764 INFO:tasks.workunit.client.1.smithi112.stdout:6/319: dread d0/d2/d4/fb [0,4194304] 0 2024-04-25T02:09:05.764 INFO:tasks.workunit.client.1.smithi112.stdout:6/320: creat d0/d2/d3b/f6f x:0 0 0 2024-04-25T02:09:05.764 INFO:tasks.workunit.client.1.smithi112.stdout:6/321: write d0/d2/d4/f5 [4263047,51813] 0 2024-04-25T02:09:05.767 INFO:tasks.workunit.client.1.smithi112.stdout:0/564: rmdir da/d1d/d2e/d40/d49/d5f 39 2024-04-25T02:09:05.767 INFO:tasks.workunit.client.1.smithi112.stdout:0/565: creat da/d13/d23/d77/fb6 x:0 0 0 2024-04-25T02:09:05.769 INFO:tasks.workunit.client.1.smithi112.stdout:7/252: symlink d7/d25/d37/l49 0 2024-04-25T02:09:05.769 INFO:tasks.workunit.client.1.smithi112.stdout:7/253: chown d7/f1e 1970306 1 2024-04-25T02:09:05.770 INFO:tasks.workunit.client.1.smithi112.stdout:9/316: link d1/l42 d1/df/d3c/l70 0 2024-04-25T02:09:05.773 INFO:tasks.workunit.client.1.smithi112.stdout:3/305: unlink d12/d13/f43 0 2024-04-25T02:09:05.776 INFO:tasks.workunit.client.1.smithi112.stdout:7/254: write d7/dd/f26 [1466274,90762] 0 2024-04-25T02:09:05.778 INFO:tasks.workunit.client.1.smithi112.stdout:3/306: dread d12/d13/f31 [0,4194304] 0 2024-04-25T02:09:05.778 INFO:tasks.workunit.client.1.smithi112.stdout:6/322: creat d0/d2/f70 x:0 0 0 2024-04-25T02:09:05.778 INFO:tasks.workunit.client.1.smithi112.stdout:6/323: write d0/d32/d45/f52 [301295,108470] 0 2024-04-25T02:09:05.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:05 smithi112 ceph-mon[33313]: pgmap v262: 65 pgs: 65 active+clean; 2.6 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 175 MiB/s rd, 242 MiB/s wr, 330 op/s 2024-04-25T02:09:05.781 INFO:tasks.workunit.client.1.smithi112.stdout:5/290: rename d1/d16/d22/l44 to d1/d2/l64 0 2024-04-25T02:09:05.784 INFO:tasks.workunit.client.1.smithi112.stdout:0/566: symlink da/d1d/d2e/d40/d49/d5f/lb7 0 2024-04-25T02:09:05.784 INFO:tasks.workunit.client.1.smithi112.stdout:9/317: creat d1/df/d3c/d6c/f71 x:0 0 0 2024-04-25T02:09:05.785 INFO:tasks.workunit.client.1.smithi112.stdout:3/307: read d12/d1f/f33 [340478,16875] 0 2024-04-25T02:09:05.789 INFO:tasks.workunit.client.1.smithi112.stdout:7/255: link d7/f27 d7/dd/f4a 0 2024-04-25T02:09:05.791 INFO:tasks.workunit.client.1.smithi112.stdout:7/256: fsync d7/dd/f26 0 2024-04-25T02:09:05.791 INFO:tasks.workunit.client.1.smithi112.stdout:7/257: chown d7/f19 369412 1 2024-04-25T02:09:05.792 INFO:tasks.workunit.client.1.smithi112.stdout:6/324: unlink d0/d2/f70 0 2024-04-25T02:09:05.793 INFO:tasks.workunit.client.1.smithi112.stdout:6/325: truncate d0/d32/d45/f52 941589 0 2024-04-25T02:09:05.794 INFO:tasks.workunit.client.1.smithi112.stdout:0/567: dread da/f81 [0,4194304] 0 2024-04-25T02:09:05.795 INFO:tasks.workunit.client.1.smithi112.stdout:5/291: fdatasync d1/d2/d28/f57 0 2024-04-25T02:09:05.795 INFO:tasks.workunit.client.1.smithi112.stdout:5/292: truncate d1/d16/d22/f37 684246 0 2024-04-25T02:09:05.797 INFO:tasks.workunit.client.1.smithi112.stdout:7/258: symlink d7/dd/d20/d36/l4b 0 2024-04-25T02:09:05.797 INFO:tasks.workunit.client.1.smithi112.stdout:7/259: fdatasync d7/dd/f1d 0 2024-04-25T02:09:05.799 INFO:tasks.workunit.client.1.smithi112.stdout:5/293: mknod d1/d2/d4/c65 0 2024-04-25T02:09:05.800 INFO:tasks.workunit.client.1.smithi112.stdout:5/294: creat d1/d2/d28/d4f/f66 x:0 0 0 2024-04-25T02:09:05.800 INFO:tasks.workunit.client.1.smithi112.stdout:5/295: fdatasync d1/f46 0 2024-04-25T02:09:05.801 INFO:tasks.workunit.client.1.smithi112.stdout:7/260: link d7/f1e d7/d25/d37/f4c 0 2024-04-25T02:09:05.801 INFO:tasks.workunit.client.1.smithi112.stdout:9/318: dwrite d1/f38 [0,4194304] 0 2024-04-25T02:09:05.808 INFO:tasks.workunit.client.1.smithi112.stdout:7/261: creat d7/d25/d40/f4d x:0 0 0 2024-04-25T02:09:05.828 INFO:tasks.workunit.client.1.smithi112.stdout:9/319: dwrite d1/df/f39 [0,4194304] 0 2024-04-25T02:09:05.828 INFO:tasks.workunit.client.1.smithi112.stdout:9/320: stat d1/d13/d5b/d55/f57 0 2024-04-25T02:09:05.835 INFO:tasks.workunit.client.1.smithi112.stdout:6/326: dwrite d0/d2/d1f/f43 [0,4194304] 0 2024-04-25T02:09:05.835 INFO:tasks.workunit.client.1.smithi112.stdout:6/327: dread - d0/d2/d4/dd/f48 zero size 2024-04-25T02:09:05.835 INFO:tasks.workunit.client.1.smithi112.stdout:0/568: dwrite da/d13/d1e/f6a [0,4194304] 0 2024-04-25T02:09:05.835 INFO:tasks.workunit.client.1.smithi112.stdout:7/262: dwrite d7/d25/d43/f47 [0,4194304] 0 2024-04-25T02:09:05.835 INFO:tasks.workunit.client.1.smithi112.stdout:0/569: write da/d1d/d88/f60 [1263499,105128] 0 2024-04-25T02:09:05.860 INFO:tasks.workunit.client.1.smithi112.stdout:7/263: dwrite d7/d25/f2d [0,4194304] 0 2024-04-25T02:09:05.861 INFO:tasks.workunit.client.1.smithi112.stdout:6/328: dwrite d0/d2/d4/d28/f57 [0,4194304] 0 2024-04-25T02:09:05.861 INFO:tasks.workunit.client.1.smithi112.stdout:6/329: stat d0/l22 0 2024-04-25T02:09:05.861 INFO:tasks.workunit.client.1.smithi112.stdout:0/570: dwrite da/d1d/d88/d80/f9e [0,4194304] 0 2024-04-25T02:09:05.861 INFO:tasks.workunit.client.1.smithi112.stdout:0/571: chown da/d1d/d2e/d40 1666211 1 2024-04-25T02:09:05.861 INFO:tasks.workunit.client.1.smithi112.stdout:0/572: readlink da/d1d/d2e/d40/d49/d4f/l70 0 2024-04-25T02:09:05.863 INFO:tasks.workunit.client.1.smithi112.stdout:7/264: read d7/f13 [810540,24763] 0 2024-04-25T02:09:05.869 INFO:tasks.workunit.client.1.smithi112.stdout:6/330: link d0/d32/d45/l59 d0/d2/d3b/d53/d67/d6b/l71 0 2024-04-25T02:09:05.872 INFO:tasks.workunit.client.1.smithi112.stdout:7/265: rename d7/l12 to d7/dd/d20/d36/l4e 0 2024-04-25T02:09:05.872 INFO:tasks.workunit.client.1.smithi112.stdout:7/266: write d7/f1e [2698307,15574] 0 2024-04-25T02:09:05.872 INFO:tasks.workunit.client.1.smithi112.stdout:7/267: write d7/d25/d43/f2a [895495,91316] 0 2024-04-25T02:09:05.875 INFO:tasks.workunit.client.1.smithi112.stdout:6/331: unlink d0/d2/d1f/c3c 0 2024-04-25T02:09:05.877 INFO:tasks.workunit.client.1.smithi112.stdout:6/332: creat d0/d2/d3b/d53/f72 x:0 0 0 2024-04-25T02:09:05.878 INFO:tasks.workunit.client.1.smithi112.stdout:7/268: dread d7/dd/f30 [0,4194304] 0 2024-04-25T02:09:05.878 INFO:tasks.workunit.client.1.smithi112.stdout:6/333: write d0/d2/d4/dd/f24 [3018419,1952] 0 2024-04-25T02:09:05.878 INFO:tasks.workunit.client.1.smithi112.stdout:6/334: readlink d0/l39 0 2024-04-25T02:09:05.878 INFO:tasks.workunit.client.1.smithi112.stdout:7/269: symlink d7/d25/d43/d46/l4f 0 2024-04-25T02:09:05.879 INFO:tasks.workunit.client.1.smithi112.stdout:6/335: rename d0/d32/l54 to d0/d32/l73 0 2024-04-25T02:09:05.879 INFO:tasks.workunit.client.1.smithi112.stdout:6/336: write d0/d2/d2c/f2e [4712403,37030] 0 2024-04-25T02:09:05.881 INFO:tasks.workunit.client.1.smithi112.stdout:7/270: creat d7/d25/d43/f50 x:0 0 0 2024-04-25T02:09:05.881 INFO:tasks.workunit.client.1.smithi112.stdout:7/271: dread - d7/d25/d40/f4d zero size 2024-04-25T02:09:05.882 INFO:tasks.workunit.client.1.smithi112.stdout:7/272: chown d7/dd/d20/d2c/l2f 1098721 1 2024-04-25T02:09:05.884 INFO:tasks.workunit.client.1.smithi112.stdout:7/273: rename d7/d38 to d7/d25/d40/d51 0 2024-04-25T02:09:05.884 INFO:tasks.workunit.client.1.smithi112.stdout:7/274: truncate d7/f24 180609 0 2024-04-25T02:09:05.884 INFO:tasks.workunit.client.1.smithi112.stdout:7/275: write d7/d25/f2d [4553910,108520] 0 2024-04-25T02:09:05.887 INFO:tasks.workunit.client.1.smithi112.stdout:7/276: write d7/f27 [2656012,36900] 0 2024-04-25T02:09:05.888 INFO:tasks.workunit.client.1.smithi112.stdout:7/277: creat d7/dd/d20/d2c/f52 x:0 0 0 2024-04-25T02:09:05.890 INFO:tasks.workunit.client.1.smithi112.stdout:7/278: mkdir d7/d25/d37/d53 0 2024-04-25T02:09:05.891 INFO:tasks.workunit.client.1.smithi112.stdout:7/279: symlink d7/dd/d20/l54 0 2024-04-25T02:09:05.891 INFO:tasks.workunit.client.1.smithi112.stdout:7/280: chown d7/dd/l15 2379806 1 2024-04-25T02:09:05.894 INFO:tasks.workunit.client.1.smithi112.stdout:7/281: rename d7/dd/d20/l3b to d7/d25/l55 0 2024-04-25T02:09:05.894 INFO:tasks.workunit.client.1.smithi112.stdout:7/282: chown d7/d25/d40 511672 1 2024-04-25T02:09:05.896 INFO:tasks.workunit.client.1.smithi112.stdout:7/283: truncate d7/dd/f10 26823 0 2024-04-25T02:09:05.896 INFO:tasks.workunit.client.1.smithi112.stdout:6/337: dwrite d0/d2/d4/dd/f3d [4194304,4194304] 0 2024-04-25T02:09:05.897 INFO:tasks.workunit.client.1.smithi112.stdout:7/284: truncate d7/dd/d20/d2c/f45 554119 0 2024-04-25T02:09:05.899 INFO:tasks.workunit.client.1.smithi112.stdout:6/338: symlink d0/d2/d66/l74 0 2024-04-25T02:09:05.900 INFO:tasks.workunit.client.1.smithi112.stdout:7/285: creat d7/d25/d37/d53/f56 x:0 0 0 2024-04-25T02:09:05.903 INFO:tasks.workunit.client.1.smithi112.stdout:6/339: rename d0/d2/d4/dd/l49 to d0/d2/d66/l75 0 2024-04-25T02:09:05.908 INFO:tasks.workunit.client.1.smithi112.stdout:7/286: dread d7/f16 [0,4194304] 0 2024-04-25T02:09:05.910 INFO:tasks.workunit.client.1.smithi112.stdout:7/287: symlink d7/l57 0 2024-04-25T02:09:05.912 INFO:tasks.workunit.client.1.smithi112.stdout:6/340: dread d0/d2/d4/f4f [0,4194304] 0 2024-04-25T02:09:05.913 INFO:tasks.workunit.client.1.smithi112.stdout:7/288: unlink d7/dd/l15 0 2024-04-25T02:09:05.915 INFO:tasks.workunit.client.1.smithi112.stdout:6/341: mknod d0/c76 0 2024-04-25T02:09:05.917 INFO:tasks.workunit.client.1.smithi112.stdout:7/289: fsync d7/dd/d20/d2c/f52 0 2024-04-25T02:09:05.917 INFO:tasks.workunit.client.1.smithi112.stdout:7/290: dread - d7/d25/d43/d46/f44 zero size 2024-04-25T02:09:05.918 INFO:tasks.workunit.client.1.smithi112.stdout:6/342: mkdir d0/d2/d2c/d41/d77 0 2024-04-25T02:09:05.922 INFO:tasks.workunit.client.1.smithi112.stdout:7/291: rename d7/d25/d43/d46/f44 to d7/d25/d37/f58 0 2024-04-25T02:09:05.924 INFO:tasks.workunit.client.1.smithi112.stdout:7/292: fsync d7/f1e 0 2024-04-25T02:09:05.925 INFO:tasks.workunit.client.1.smithi112.stdout:6/343: mknod d0/d32/c78 0 2024-04-25T02:09:05.929 INFO:tasks.workunit.client.1.smithi112.stdout:7/293: symlink d7/d25/d40/d51/l59 0 2024-04-25T02:09:05.931 INFO:tasks.workunit.client.1.smithi112.stdout:6/344: mkdir d0/d2/d79 0 2024-04-25T02:09:05.933 INFO:tasks.workunit.client.1.smithi112.stdout:7/294: truncate d7/f17 169155 0 2024-04-25T02:09:05.933 INFO:tasks.workunit.client.1.smithi112.stdout:7/295: write d7/dd/d20/d2c/f45 [1592155,119908] 0 2024-04-25T02:09:05.934 INFO:tasks.workunit.client.1.smithi112.stdout:6/345: truncate d0/d2/d4/dd/f26 1714653 0 2024-04-25T02:09:05.934 INFO:tasks.workunit.client.1.smithi112.stdout:6/346: chown d0/d2/c9 8 1 2024-04-25T02:09:05.978 INFO:tasks.workunit.client.1.smithi112.stdout:7/296: rename d7/d25/l3c to d7/d25/d43/l5a 0 2024-04-25T02:09:05.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:05 smithi077 ceph-mon[26330]: pgmap v262: 65 pgs: 65 active+clean; 2.6 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 175 MiB/s rd, 242 MiB/s wr, 330 op/s 2024-04-25T02:09:05.980 INFO:tasks.workunit.client.1.smithi112.stdout:6/347: creat d0/d2/d4/f7a x:0 0 0 2024-04-25T02:09:05.984 INFO:tasks.workunit.client.1.smithi112.stdout:6/348: mkdir d0/d7b 0 2024-04-25T02:09:05.987 INFO:tasks.workunit.client.1.smithi112.stdout:6/349: creat d0/d2/d2c/d41/d77/f7c x:0 0 0 2024-04-25T02:09:05.990 INFO:tasks.workunit.client.1.smithi112.stdout:6/350: mkdir d0/d2/d66/d7d 0 2024-04-25T02:09:06.002 INFO:tasks.workunit.client.1.smithi112.stdout:7/297: rmdir d7/d25/d43 39 2024-04-25T02:09:06.002 INFO:tasks.workunit.client.1.smithi112.stdout:7/298: chown d7 0 1 2024-04-25T02:09:06.016 INFO:tasks.workunit.client.1.smithi112.stdout:7/299: dwrite d7/d25/d40/f4d [0,4194304] 0 2024-04-25T02:09:06.016 INFO:tasks.workunit.client.1.smithi112.stdout:7/300: write d7/dd/f1d [532059,92821] 0 2024-04-25T02:09:06.135 INFO:tasks.workunit.client.1.smithi112.stdout:2/171: sync 2024-04-25T02:09:06.135 INFO:tasks.workunit.client.1.smithi112.stdout:4/293: sync 2024-04-25T02:09:06.137 INFO:tasks.workunit.client.1.smithi112.stdout:4/294: mkdir d2/d17/d20/d26/d39/d49/d59 0 2024-04-25T02:09:06.145 INFO:tasks.workunit.client.1.smithi112.stdout:4/295: mknod d2/d17/d25/d2a/c5a 0 2024-04-25T02:09:06.145 INFO:tasks.workunit.client.1.smithi112.stdout:4/296: write d2/d17/d20/f23 [1277070,23732] 0 2024-04-25T02:09:06.147 INFO:tasks.workunit.client.1.smithi112.stdout:4/297: dread d2/d12/d22/f48 [0,4194304] 0 2024-04-25T02:09:06.147 INFO:tasks.workunit.client.1.smithi112.stdout:4/298: truncate d2/d17/d20/d26/f43 669896 0 2024-04-25T02:09:06.150 INFO:tasks.workunit.client.1.smithi112.stdout:4/299: rmdir d2/d1e/d42 39 2024-04-25T02:09:06.155 INFO:tasks.workunit.client.1.smithi112.stdout:4/300: creat d2/d17/d25/d2a/f5b x:0 0 0 2024-04-25T02:09:06.155 INFO:tasks.workunit.client.1.smithi112.stdout:4/301: chown d2/d17/d20/d26/f43 31742 1 2024-04-25T02:09:06.157 INFO:tasks.workunit.client.1.smithi112.stdout:4/302: mkdir d2/d1e/d5c 0 2024-04-25T02:09:06.162 INFO:tasks.workunit.client.1.smithi112.stdout:4/303: link d2/f1a d2/d17/d25/d2a/f5d 0 2024-04-25T02:09:06.172 INFO:tasks.workunit.client.1.smithi112.stdout:4/304: rename d2/d17/d25/d2a to d2/d17/d20/d5e 0 2024-04-25T02:09:06.173 INFO:tasks.workunit.client.1.smithi112.stdout:4/305: link d2/d1e/d42/f47 d2/f5f 0 2024-04-25T02:09:06.173 INFO:tasks.workunit.client.1.smithi112.stdout:4/306: chown d2/c3 1519 1 2024-04-25T02:09:06.176 INFO:tasks.workunit.client.1.smithi112.stdout:4/307: dread d2/d12/d22/f2f [0,4194304] 0 2024-04-25T02:09:06.178 INFO:tasks.workunit.client.1.smithi112.stdout:4/308: mkdir d2/d12/d22/d60 0 2024-04-25T02:09:06.179 INFO:tasks.workunit.client.1.smithi112.stdout:4/309: dread d2/d17/d20/d26/f43 [0,4194304] 0 2024-04-25T02:09:06.179 INFO:tasks.workunit.client.1.smithi112.stdout:4/310: symlink d2/d1e/d4b/l61 0 2024-04-25T02:09:06.180 INFO:tasks.workunit.client.1.smithi112.stdout:4/311: getdents d2/d12/d22/d60 0 2024-04-25T02:09:06.202 INFO:tasks.workunit.client.1.smithi112.stdout:4/312: dwrite d2/f15 [0,4194304] 0 2024-04-25T02:09:06.203 INFO:tasks.workunit.client.1.smithi112.stdout:4/313: readlink d2/d1e/l53 0 2024-04-25T02:09:06.203 INFO:tasks.workunit.client.1.smithi112.stdout:4/314: symlink d2/d17/d25/l62 0 2024-04-25T02:09:06.205 INFO:tasks.workunit.client.1.smithi112.stdout:4/315: mknod d2/d17/d20/d26/c63 0 2024-04-25T02:09:06.206 INFO:tasks.workunit.client.1.smithi112.stdout:4/316: rmdir d2/d17/d20/d5e 39 2024-04-25T02:09:06.207 INFO:tasks.workunit.client.1.smithi112.stdout:4/317: symlink d2/d1e/d1b/l64 0 2024-04-25T02:09:06.207 INFO:tasks.workunit.client.1.smithi112.stdout:4/318: fdatasync d2/fb 0 2024-04-25T02:09:06.207 INFO:tasks.workunit.client.1.smithi112.stdout:4/319: write d2/d17/d20/d26/d39/d49/f3c [155448,123646] 0 2024-04-25T02:09:06.209 INFO:tasks.workunit.client.1.smithi112.stdout:4/320: fdatasync d2/f5f 0 2024-04-25T02:09:06.210 INFO:tasks.workunit.client.1.smithi112.stdout:4/321: mkdir d2/d1e/d1b/d65 0 2024-04-25T02:09:06.210 INFO:tasks.workunit.client.1.smithi112.stdout:4/322: rename d2/d17/c50 to d2/d1e/d4b/d57/c66 0 2024-04-25T02:09:06.210 INFO:tasks.workunit.client.1.smithi112.stdout:4/323: chown d2/d17/d25/d3f 217488041 1 2024-04-25T02:09:06.211 INFO:tasks.workunit.client.1.smithi112.stdout:4/324: unlink d2/d17/d25/c32 0 2024-04-25T02:09:06.214 INFO:tasks.workunit.client.1.smithi112.stdout:4/325: dread d2/d17/d20/d5e/f5d [0,4194304] 0 2024-04-25T02:09:06.215 INFO:tasks.workunit.client.1.smithi112.stdout:4/326: mkdir d2/d1e/d1b/d67 0 2024-04-25T02:09:06.216 INFO:tasks.workunit.client.1.smithi112.stdout:4/327: truncate d2/d17/d20/d5e/f5d 4012903 0 2024-04-25T02:09:06.216 INFO:tasks.workunit.client.1.smithi112.stdout:4/328: fdatasync d2/d17/d20/d5e/f5b 0 2024-04-25T02:09:06.216 INFO:tasks.workunit.client.1.smithi112.stdout:4/329: readlink d2/d17/d25/l51 0 2024-04-25T02:09:06.222 INFO:tasks.workunit.client.1.smithi112.stdout:4/330: dread d2/d17/d20/f23 [0,4194304] 0 2024-04-25T02:09:06.222 INFO:tasks.workunit.client.1.smithi112.stdout:4/331: chown d2/d1e/d5c 22 1 2024-04-25T02:09:06.234 INFO:tasks.workunit.client.1.smithi112.stdout:4/332: read d2/d17/d25/f3b [2397703,73175] 0 2024-04-25T02:09:06.234 INFO:tasks.workunit.client.1.smithi112.stdout:4/333: read d2/d17/d20/d5e/f2b [1035000,55307] 0 2024-04-25T02:09:06.238 INFO:tasks.workunit.client.1.smithi112.stdout:4/334: rename d2/d17/d20/d26/f43 to d2/d17/d20/d26/d39/f68 0 2024-04-25T02:09:06.295 INFO:tasks.workunit.client.1.smithi112.stdout:4/335: truncate d2/d17/d20/d5e/f5d 430072 0 2024-04-25T02:09:06.296 INFO:tasks.workunit.client.1.smithi112.stdout:4/336: creat d2/d1e/d4b/d57/f69 x:0 0 0 2024-04-25T02:09:06.335 INFO:tasks.workunit.client.1.smithi112.stdout:8/420: sync 2024-04-25T02:09:06.336 INFO:tasks.workunit.client.1.smithi112.stdout:8/421: readlink d15/d26/d37/d8e/l7d 0 2024-04-25T02:09:06.336 INFO:tasks.workunit.client.1.smithi112.stdout:8/422: creat d15/d26/f92 x:0 0 0 2024-04-25T02:09:06.341 INFO:tasks.workunit.client.1.smithi112.stdout:8/423: unlink d15/d26/f73 0 2024-04-25T02:09:06.342 INFO:tasks.workunit.client.1.smithi112.stdout:8/424: readlink d15/d26/d37/d52/l79 0 2024-04-25T02:09:06.342 INFO:tasks.workunit.client.1.smithi112.stdout:8/425: fdatasync d15/d17/f2e 0 2024-04-25T02:09:06.350 INFO:tasks.workunit.client.1.smithi112.stdout:4/337: dwrite d2/d17/d20/f23 [0,4194304] 0 2024-04-25T02:09:06.350 INFO:tasks.workunit.client.1.smithi112.stdout:4/338: write d2/d1e/d4b/d57/f69 [488693,10096] 0 2024-04-25T02:09:06.351 INFO:tasks.workunit.client.1.smithi112.stdout:4/339: chown d2/d12/d22/l3d 533198 1 2024-04-25T02:09:06.372 INFO:tasks.workunit.client.1.smithi112.stdout:8/426: dwrite d15/d40/f49 [0,4194304] 0 2024-04-25T02:09:06.372 INFO:tasks.workunit.client.1.smithi112.stdout:4/340: dwrite d2/d17/d20/d26/d39/d49/f56 [0,4194304] 0 2024-04-25T02:09:06.372 INFO:tasks.workunit.client.1.smithi112.stdout:4/341: readlink d2/d1e/l53 0 2024-04-25T02:09:06.380 INFO:tasks.workunit.client.1.smithi112.stdout:4/342: dread d2/f46 [0,4194304] 0 2024-04-25T02:09:06.382 INFO:tasks.workunit.client.1.smithi112.stdout:8/427: rmdir d15/d35/d5c 39 2024-04-25T02:09:06.385 INFO:tasks.workunit.client.1.smithi112.stdout:8/428: write d15/d26/d37/f38 [4871210,99668] 0 2024-04-25T02:09:06.393 INFO:tasks.workunit.client.1.smithi112.stdout:4/343: symlink d2/d1e/d1b/d65/l6a 0 2024-04-25T02:09:06.409 INFO:tasks.workunit.client.1.smithi112.stdout:4/344: rename d2/d17/d20/d5e/f5d to d2/d17/d20/f6b 0 2024-04-25T02:09:06.410 INFO:tasks.workunit.client.1.smithi112.stdout:8/429: dwrite d15/d40/f49 [0,4194304] 0 2024-04-25T02:09:06.414 INFO:tasks.workunit.client.1.smithi112.stdout:4/345: creat d2/d17/d20/d5e/f6c x:0 0 0 2024-04-25T02:09:06.420 INFO:tasks.workunit.client.1.smithi112.stdout:1/361: sync 2024-04-25T02:09:06.421 INFO:tasks.workunit.client.1.smithi112.stdout:3/308: sync 2024-04-25T02:09:06.424 INFO:tasks.workunit.client.1.smithi112.stdout:8/430: rmdir d15/d35/d56 39 2024-04-25T02:09:06.425 INFO:tasks.workunit.client.1.smithi112.stdout:8/431: chown d15/d26/f29 7408299 1 2024-04-25T02:09:06.425 INFO:tasks.workunit.client.1.smithi112.stdout:8/432: creat d15/d40/f93 x:0 0 0 2024-04-25T02:09:06.425 INFO:tasks.workunit.client.1.smithi112.stdout:8/433: fsync d15/f42 0 2024-04-25T02:09:06.430 INFO:tasks.workunit.client.1.smithi112.stdout:1/362: creat d7/d9/d4e/d28/d32/f6c x:0 0 0 2024-04-25T02:09:06.430 INFO:tasks.workunit.client.1.smithi112.stdout:1/363: creat d7/d9/d4e/f6d x:0 0 0 2024-04-25T02:09:06.433 INFO:tasks.workunit.client.1.smithi112.stdout:3/309: dread d12/f14 [0,4194304] 0 2024-04-25T02:09:06.436 INFO:tasks.workunit.client.1.smithi112.stdout:1/364: rename d7/d9/d1e/l47 to d7/d9/d51/d58/l6e 0 2024-04-25T02:09:06.438 INFO:tasks.workunit.client.1.smithi112.stdout:3/310: symlink d12/d13/d34/l5f 0 2024-04-25T02:09:06.438 INFO:tasks.workunit.client.1.smithi112.stdout:3/311: chown d12/d1f/c3e 31456151 1 2024-04-25T02:09:06.438 INFO:tasks.workunit.client.1.smithi112.stdout:3/312: creat d12/d13/d34/f60 x:0 0 0 2024-04-25T02:09:06.439 INFO:tasks.workunit.client.1.smithi112.stdout:4/346: dwrite d2/fb [0,4194304] 0 2024-04-25T02:09:06.440 INFO:tasks.workunit.client.1.smithi112.stdout:3/313: dread - d12/d13/d34/d53/f59 zero size 2024-04-25T02:09:06.447 INFO:tasks.workunit.client.1.smithi112.stdout:8/434: dwrite d15/d35/d56/f6a [0,4194304] 0 2024-04-25T02:09:06.447 INFO:tasks.workunit.client.1.smithi112.stdout:8/435: truncate d15/f28 2946613 0 2024-04-25T02:09:06.453 INFO:tasks.workunit.client.1.smithi112.stdout:8/436: mkdir d15/d35/d5c/d5e/d94 0 2024-04-25T02:09:06.453 INFO:tasks.workunit.client.1.smithi112.stdout:3/314: dread d12/d1f/f32 [0,4194304] 0 2024-04-25T02:09:06.458 INFO:tasks.workunit.client.1.smithi112.stdout:3/315: mknod d12/d1f/d27/d44/c61 0 2024-04-25T02:09:06.462 INFO:tasks.workunit.client.1.smithi112.stdout:3/316: symlink d12/d1f/l62 0 2024-04-25T02:09:06.462 INFO:tasks.workunit.client.1.smithi112.stdout:3/317: stat d12/d1f/d27/f4b 0 2024-04-25T02:09:06.467 INFO:tasks.workunit.client.1.smithi112.stdout:4/347: dwrite d2/d1e/d4b/d57/f69 [0,4194304] 0 2024-04-25T02:09:06.467 INFO:tasks.workunit.client.1.smithi112.stdout:5/296: sync 2024-04-25T02:09:06.467 INFO:tasks.workunit.client.1.smithi112.stdout:9/321: sync 2024-04-25T02:09:06.467 INFO:tasks.workunit.client.1.smithi112.stdout:3/318: dread d12/d1f/f32 [0,4194304] 0 2024-04-25T02:09:06.468 INFO:tasks.workunit.client.1.smithi112.stdout:3/319: fsync d12/f41 0 2024-04-25T02:09:06.469 INFO:tasks.workunit.client.1.smithi112.stdout:8/437: write d15/d40/f49 [1919695,19107] 0 2024-04-25T02:09:06.470 INFO:tasks.workunit.client.1.smithi112.stdout:4/348: creat d2/d17/d20/d26/d39/d49/d4c/f6d x:0 0 0 2024-04-25T02:09:06.470 INFO:tasks.workunit.client.1.smithi112.stdout:4/349: fdatasync d2/d12/f16 0 2024-04-25T02:09:06.475 INFO:tasks.workunit.client.1.smithi112.stdout:9/322: unlink d1/df/d3c/c4b 0 2024-04-25T02:09:06.475 INFO:tasks.workunit.client.1.smithi112.stdout:9/323: chown d1/d13/d5b/d55 86470568 1 2024-04-25T02:09:06.475 INFO:tasks.workunit.client.1.smithi112.stdout:5/297: dread d1/d2/f11 [0,4194304] 0 2024-04-25T02:09:06.477 INFO:tasks.workunit.client.1.smithi112.stdout:8/438: dread d15/d40/f60 [0,4194304] 0 2024-04-25T02:09:06.478 INFO:tasks.workunit.client.1.smithi112.stdout:3/320: creat d12/f63 x:0 0 0 2024-04-25T02:09:06.478 INFO:tasks.workunit.client.1.smithi112.stdout:3/321: creat d12/d13/d34/f64 x:0 0 0 2024-04-25T02:09:06.481 INFO:tasks.workunit.client.1.smithi112.stdout:4/350: symlink d2/d1e/d4b/d57/l6e 0 2024-04-25T02:09:06.481 INFO:tasks.workunit.client.1.smithi112.stdout:4/351: fsync d2/d1e/d4b/d57/f69 0 2024-04-25T02:09:06.482 INFO:tasks.workunit.client.1.smithi112.stdout:9/324: truncate d1/df/d3c/d43/f6a 4193117 0 2024-04-25T02:09:06.484 INFO:tasks.workunit.client.1.smithi112.stdout:5/298: rmdir d1/d16 39 2024-04-25T02:09:06.484 INFO:tasks.workunit.client.1.smithi112.stdout:5/299: chown d1/f8 886924 1 2024-04-25T02:09:06.486 INFO:tasks.workunit.client.1.smithi112.stdout:8/439: mknod d15/d26/c95 0 2024-04-25T02:09:06.490 INFO:tasks.workunit.client.1.smithi112.stdout:3/322: rename d12/d13/d34/l45 to d12/d1f/d27/d44/l65 0 2024-04-25T02:09:06.490 INFO:tasks.workunit.client.1.smithi112.stdout:3/323: fdatasync d12/d13/d34/f60 0 2024-04-25T02:09:06.490 INFO:tasks.workunit.client.1.smithi112.stdout:3/324: fdatasync d12/d1f/d27/f2b 0 2024-04-25T02:09:06.494 INFO:tasks.workunit.client.1.smithi112.stdout:4/352: write d2/fb [759422,47688] 0 2024-04-25T02:09:06.494 INFO:tasks.workunit.client.1.smithi112.stdout:9/325: creat d1/d13/f72 x:0 0 0 2024-04-25T02:09:06.494 INFO:tasks.workunit.client.1.smithi112.stdout:9/326: chown d1 64698220 1 2024-04-25T02:09:06.495 INFO:tasks.workunit.client.1.smithi112.stdout:8/440: rename d15/d40/f58 to d15/d35/d56/f96 0 2024-04-25T02:09:06.499 INFO:tasks.workunit.client.1.smithi112.stdout:4/353: symlink d2/d12/d22/l6f 0 2024-04-25T02:09:06.499 INFO:tasks.workunit.client.1.smithi112.stdout:4/354: chown d2/d17/d25/l58 31 1 2024-04-25T02:09:06.500 INFO:tasks.workunit.client.1.smithi112.stdout:8/441: dread d15/d17/d1a/f1d [0,4194304] 0 2024-04-25T02:09:06.501 INFO:tasks.workunit.client.1.smithi112.stdout:9/327: mkdir d1/d48/d65/d73 0 2024-04-25T02:09:06.501 INFO:tasks.workunit.client.1.smithi112.stdout:9/328: creat d1/df/d3c/d46/f74 x:0 0 0 2024-04-25T02:09:06.501 INFO:tasks.workunit.client.1.smithi112.stdout:9/329: write d1/df/d3c/f69 [192305,64586] 0 2024-04-25T02:09:06.501 INFO:tasks.workunit.client.1.smithi112.stdout:9/330: readlink d1/df/l3a 0 2024-04-25T02:09:06.501 INFO:tasks.workunit.client.1.smithi112.stdout:9/331: creat d1/df/d3c/d6c/f75 x:0 0 0 2024-04-25T02:09:06.507 INFO:tasks.workunit.client.1.smithi112.stdout:3/325: rename d12/d1f/d27/c40 to d12/d5d/c66 0 2024-04-25T02:09:06.507 INFO:tasks.workunit.client.1.smithi112.stdout:3/326: chown d12/d13/l16 5 1 2024-04-25T02:09:06.507 INFO:tasks.workunit.client.1.smithi112.stdout:3/327: fsync d12/f14 0 2024-04-25T02:09:06.507 INFO:tasks.workunit.client.1.smithi112.stdout:3/328: write d12/d13/f42 [810463,22603] 0 2024-04-25T02:09:06.512 INFO:tasks.workunit.client.1.smithi112.stdout:9/332: getdents d1/d48 0 2024-04-25T02:09:06.516 INFO:tasks.workunit.client.1.smithi112.stdout:9/333: truncate d1/f38 1437768 0 2024-04-25T02:09:06.516 INFO:tasks.workunit.client.1.smithi112.stdout:9/334: write d1/d13/f18 [2502755,76609] 0 2024-04-25T02:09:06.516 INFO:tasks.workunit.client.1.smithi112.stdout:9/335: truncate d1/df/d3c/d46/f54 762732 0 2024-04-25T02:09:06.520 INFO:tasks.workunit.client.1.smithi112.stdout:4/355: dwrite d2/d17/f28 [0,4194304] 0 2024-04-25T02:09:06.520 INFO:tasks.workunit.client.1.smithi112.stdout:4/356: fdatasync d2/f1d 0 2024-04-25T02:09:06.521 INFO:tasks.workunit.client.1.smithi112.stdout:5/300: dwrite d1/d2/f11 [0,4194304] 0 2024-04-25T02:09:06.522 INFO:tasks.workunit.client.1.smithi112.stdout:3/329: write d12/f36 [3761793,11564] 0 2024-04-25T02:09:06.522 INFO:tasks.workunit.client.1.smithi112.stdout:3/330: write d12/d13/f4e [425848,2823] 0 2024-04-25T02:09:06.543 INFO:tasks.workunit.client.1.smithi112.stdout:9/336: dwrite d1/df/d3c/f69 [0,4194304] 0 2024-04-25T02:09:06.543 INFO:tasks.workunit.client.1.smithi112.stdout:5/301: creat d1/d2/d28/f67 x:0 0 0 2024-04-25T02:09:06.545 INFO:tasks.workunit.client.1.smithi112.stdout:4/357: dwrite d2/f27 [0,4194304] 0 2024-04-25T02:09:06.551 INFO:tasks.workunit.client.1.smithi112.stdout:4/358: unlink d2/d17/d20/f23 0 2024-04-25T02:09:06.554 INFO:tasks.workunit.client.1.smithi112.stdout:3/331: mkdir d12/d67 0 2024-04-25T02:09:06.557 INFO:tasks.workunit.client.1.smithi112.stdout:5/302: unlink d1/d2/l1c 0 2024-04-25T02:09:06.557 INFO:tasks.workunit.client.1.smithi112.stdout:5/303: write d1/d2/d28/d4f/f66 [330001,102638] 0 2024-04-25T02:09:06.558 INFO:tasks.workunit.client.1.smithi112.stdout:2/172: sync 2024-04-25T02:09:06.558 INFO:tasks.workunit.client.1.smithi112.stdout:0/573: sync 2024-04-25T02:09:06.559 INFO:tasks.workunit.client.1.smithi112.stdout:0/574: write da/d13/d1e/f3b [2550744,4369] 0 2024-04-25T02:09:06.559 INFO:tasks.workunit.client.1.smithi112.stdout:0/575: fdatasync da/d1d/d2e/d40/f41 0 2024-04-25T02:09:06.559 INFO:tasks.workunit.client.1.smithi112.stdout:9/337: dwrite d1/d13/d5b/f61 [0,4194304] 0 2024-04-25T02:09:06.563 INFO:tasks.workunit.client.1.smithi112.stdout:2/173: rename d3/d38 to d3/da/dc/d20/d40 0 2024-04-25T02:09:06.563 INFO:tasks.workunit.client.1.smithi112.stdout:7/301: sync 2024-04-25T02:09:06.563 INFO:tasks.workunit.client.1.smithi112.stdout:7/302: stat d7/fc 0 2024-04-25T02:09:06.566 INFO:tasks.workunit.client.1.smithi112.stdout:6/351: sync 2024-04-25T02:09:06.568 INFO:tasks.workunit.client.1.smithi112.stdout:9/338: write d1/d13/f26 [2540707,118445] 0 2024-04-25T02:09:06.568 INFO:tasks.workunit.client.1.smithi112.stdout:9/339: fdatasync d1/f3b 0 2024-04-25T02:09:06.569 INFO:tasks.workunit.client.1.smithi112.stdout:0/576: rename da/d1d/d88/d80/f9e to da/d13/d45/d5e/fb8 0 2024-04-25T02:09:06.570 INFO:tasks.workunit.client.1.smithi112.stdout:7/303: unlink d7/dd/d20/d2c/f52 0 2024-04-25T02:09:06.571 INFO:tasks.workunit.client.1.smithi112.stdout:6/352: symlink d0/d2/d1f/l7e 0 2024-04-25T02:09:06.572 INFO:tasks.workunit.client.1.smithi112.stdout:9/340: symlink d1/df/d3c/d46/l76 0 2024-04-25T02:09:06.573 INFO:tasks.workunit.client.1.smithi112.stdout:6/353: symlink d0/d2/d2c/d41/d77/l7f 0 2024-04-25T02:09:06.575 INFO:tasks.workunit.client.1.smithi112.stdout:6/354: creat d0/d32/d45/f80 x:0 0 0 2024-04-25T02:09:06.575 INFO:tasks.workunit.client.1.smithi112.stdout:6/355: write d0/d2/d4/fb [821469,49347] 0 2024-04-25T02:09:06.576 INFO:tasks.workunit.client.1.smithi112.stdout:6/356: mkdir d0/d2/d79/d81 0 2024-04-25T02:09:06.580 INFO:tasks.workunit.client.1.smithi112.stdout:6/357: dread d0/d32/d45/f52 [0,4194304] 0 2024-04-25T02:09:06.580 INFO:tasks.workunit.client.1.smithi112.stdout:6/358: write d0/f1a [8802388,55972] 0 2024-04-25T02:09:06.580 INFO:tasks.workunit.client.1.smithi112.stdout:6/359: truncate d0/d2/f15 1338924 0 2024-04-25T02:09:06.581 INFO:tasks.workunit.client.1.smithi112.stdout:6/360: unlink d0/d32/d45/c64 0 2024-04-25T02:09:06.582 INFO:tasks.workunit.client.1.smithi112.stdout:6/361: truncate d0/d2/d2c/d41/f5d 1090301 0 2024-04-25T02:09:06.582 INFO:tasks.workunit.client.1.smithi112.stdout:6/362: creat d0/d2/f82 x:0 0 0 2024-04-25T02:09:06.588 INFO:tasks.workunit.client.1.smithi112.stdout:0/577: dread da/d13/d1e/f6a [0,4194304] 0 2024-04-25T02:09:06.589 INFO:tasks.workunit.client.1.smithi112.stdout:0/578: unlink da/f81 0 2024-04-25T02:09:06.590 INFO:tasks.workunit.client.1.smithi112.stdout:4/359: dwrite d2/f1f [0,4194304] 0 2024-04-25T02:09:06.592 INFO:tasks.workunit.client.1.smithi112.stdout:4/360: readlink d2/d12/l33 0 2024-04-25T02:09:06.592 INFO:tasks.workunit.client.1.smithi112.stdout:9/341: write d1/f2b [3054889,95468] 0 2024-04-25T02:09:06.593 INFO:tasks.workunit.client.1.smithi112.stdout:9/342: write d1/df/d3c/f52 [1718724,123748] 0 2024-04-25T02:09:06.593 INFO:tasks.workunit.client.1.smithi112.stdout:4/361: symlink d2/d1e/d1b/l70 0 2024-04-25T02:09:06.595 INFO:tasks.workunit.client.1.smithi112.stdout:9/343: link d1/d13/f72 d1/d13/d5b/d55/d63/f77 0 2024-04-25T02:09:06.595 INFO:tasks.workunit.client.1.smithi112.stdout:4/362: mknod d2/d1e/d1b/c71 0 2024-04-25T02:09:06.596 INFO:tasks.workunit.client.1.smithi112.stdout:4/363: fdatasync d2/f27 0 2024-04-25T02:09:06.596 INFO:tasks.workunit.client.1.smithi112.stdout:4/364: stat d2/d1e/d1b/c71 0 2024-04-25T02:09:06.596 INFO:tasks.workunit.client.1.smithi112.stdout:4/365: chown d2/d17/l29 22 1 2024-04-25T02:09:06.599 INFO:tasks.workunit.client.1.smithi112.stdout:9/344: rename d1/df/f5a to d1/df/d3c/d46/f78 0 2024-04-25T02:09:06.599 INFO:tasks.workunit.client.1.smithi112.stdout:9/345: write d1/f31 [596379,26000] 0 2024-04-25T02:09:06.600 INFO:tasks.workunit.client.1.smithi112.stdout:9/346: creat d1/d48/d65/f79 x:0 0 0 2024-04-25T02:09:06.600 INFO:tasks.workunit.client.1.smithi112.stdout:9/347: creat d1/f7a x:0 0 0 2024-04-25T02:09:06.601 INFO:tasks.workunit.client.1.smithi112.stdout:9/348: mknod d1/d48/c7b 0 2024-04-25T02:09:06.606 INFO:tasks.workunit.client.1.smithi112.stdout:6/363: dread d0/d2/d4/dd/f24 [0,4194304] 0 2024-04-25T02:09:06.606 INFO:tasks.workunit.client.1.smithi112.stdout:6/364: dread - d0/d2/d3b/f6f zero size 2024-04-25T02:09:06.607 INFO:tasks.workunit.client.1.smithi112.stdout:3/332: dwrite d12/d1f/d27/f46 [0,4194304] 0 2024-04-25T02:09:06.608 INFO:tasks.workunit.client.1.smithi112.stdout:2/174: dwrite d3/da/f1c [4194304,4194304] 0 2024-04-25T02:09:06.608 INFO:tasks.workunit.client.1.smithi112.stdout:2/175: readlink d3/da/dc/l1a 0 2024-04-25T02:09:06.608 INFO:tasks.workunit.client.1.smithi112.stdout:6/365: rename d0/d2/c1b to d0/d32/d45/c83 0 2024-04-25T02:09:06.608 INFO:tasks.workunit.client.1.smithi112.stdout:6/366: creat d0/d2/d4/f84 x:0 0 0 2024-04-25T02:09:06.608 INFO:tasks.workunit.client.1.smithi112.stdout:6/367: stat d0/d36/f5a 0 2024-04-25T02:09:06.611 INFO:tasks.workunit.client.1.smithi112.stdout:3/333: creat d12/d1f/d27/d44/f68 x:0 0 0 2024-04-25T02:09:06.611 INFO:tasks.workunit.client.1.smithi112.stdout:0/579: dread da/d1d/d2e/d40/d49/d4f/d82/fa0 [4194304,4194304] 0 2024-04-25T02:09:06.611 INFO:tasks.workunit.client.1.smithi112.stdout:0/580: dread - da/d13/d45/f8f zero size 2024-04-25T02:09:06.611 INFO:tasks.workunit.client.1.smithi112.stdout:0/581: chown da/d1d/d88/f30 228767436 1 2024-04-25T02:09:06.611 INFO:tasks.workunit.client.1.smithi112.stdout:0/582: chown da/d13/d45 29025938 1 2024-04-25T02:09:06.611 INFO:tasks.workunit.client.1.smithi112.stdout:5/304: dwrite d1/f8 [4194304,4194304] 0 2024-04-25T02:09:06.611 INFO:tasks.workunit.client.1.smithi112.stdout:5/305: chown d1/d2/d4 885321427 1 2024-04-25T02:09:06.612 INFO:tasks.workunit.client.1.smithi112.stdout:5/306: write d1/d2/d45/f4c [4309788,45605] 0 2024-04-25T02:09:06.612 INFO:tasks.workunit.client.1.smithi112.stdout:5/307: truncate d1/d16/d51/f55 1201930 0 2024-04-25T02:09:06.612 INFO:tasks.workunit.client.1.smithi112.stdout:5/308: fdatasync d1/d2/d4/f54 0 2024-04-25T02:09:06.612 INFO:tasks.workunit.client.1.smithi112.stdout:5/309: read - d1/f50 zero size 2024-04-25T02:09:06.612 INFO:tasks.workunit.client.1.smithi112.stdout:5/310: fsync d1/d2/d4/d1d/f25 0 2024-04-25T02:09:06.612 INFO:tasks.workunit.client.1.smithi112.stdout:5/311: chown d1/d16/l1b 4 1 2024-04-25T02:09:06.612 INFO:tasks.workunit.client.1.smithi112.stdout:7/304: dwrite d7/d25/d37/f4c [0,4194304] 0 2024-04-25T02:09:06.612 INFO:tasks.workunit.client.1.smithi112.stdout:7/305: stat d7/f17 0 2024-04-25T02:09:06.613 INFO:tasks.workunit.client.1.smithi112.stdout:2/176: link d3/da/dc/d3e/df/l22 d3/da/dc/d3e/df/d30/l41 0 2024-04-25T02:09:06.614 INFO:tasks.workunit.client.1.smithi112.stdout:2/177: dread d3/da/dc/d3e/f17 [0,4194304] 0 2024-04-25T02:09:06.615 INFO:tasks.workunit.client.1.smithi112.stdout:2/178: write d3/da/dc/d3e/f3c [546623,86229] 0 2024-04-25T02:09:06.615 INFO:tasks.workunit.client.1.smithi112.stdout:2/179: readlink d3/da/dc/d3e/df/d30/l3d 0 2024-04-25T02:09:06.615 INFO:tasks.workunit.client.1.smithi112.stdout:2/180: chown d3/da/dc/d3e/df/d30/l41 10018387 1 2024-04-25T02:09:06.618 INFO:tasks.workunit.client.1.smithi112.stdout:9/349: dwrite d1/d13/d5b/d55/f5d [0,4194304] 0 2024-04-25T02:09:06.621 INFO:tasks.workunit.client.1.smithi112.stdout:3/334: truncate d12/d1f/d27/f4b 1057272 0 2024-04-25T02:09:06.626 INFO:tasks.workunit.client.1.smithi112.stdout:7/306: creat d7/d25/d43/d46/f5b x:0 0 0 2024-04-25T02:09:06.638 INFO:tasks.workunit.client.1.smithi112.stdout:2/181: getdents d3/da/dc/d3e/df/d25 0 2024-04-25T02:09:06.641 INFO:tasks.workunit.client.1.smithi112.stdout:7/307: write d7/d25/d40/f4d [1627591,32112] 0 2024-04-25T02:09:06.641 INFO:tasks.workunit.client.1.smithi112.stdout:7/308: chown d7/d25/d40/d51/l59 0 1 2024-04-25T02:09:06.641 INFO:tasks.workunit.client.1.smithi112.stdout:7/309: fsync d7/dd/f4a 0 2024-04-25T02:09:06.644 INFO:tasks.workunit.client.1.smithi112.stdout:9/350: mknod d1/d13/d41/c7c 0 2024-04-25T02:09:06.645 INFO:tasks.workunit.client.1.smithi112.stdout:9/351: dread d1/df/d3c/d46/f54 [0,4194304] 0 2024-04-25T02:09:06.647 INFO:tasks.workunit.client.1.smithi112.stdout:2/182: mkdir d3/da/dc/d3e/df/d42 0 2024-04-25T02:09:06.649 INFO:tasks.workunit.client.1.smithi112.stdout:5/312: dwrite d1/d2/d4/ff [0,4194304] 0 2024-04-25T02:09:06.649 INFO:tasks.workunit.client.1.smithi112.stdout:0/583: dwrite da/f94 [0,4194304] 0 2024-04-25T02:09:06.649 INFO:tasks.workunit.client.1.smithi112.stdout:0/584: creat da/d13/d45/d5e/d7a/fb9 x:0 0 0 2024-04-25T02:09:06.649 INFO:tasks.workunit.client.1.smithi112.stdout:5/313: write d1/f3b [3117658,65966] 0 2024-04-25T02:09:06.652 INFO:tasks.workunit.client.1.smithi112.stdout:2/183: mkdir d3/da/dc/d20/d43 0 2024-04-25T02:09:06.658 INFO:tasks.workunit.client.1.smithi112.stdout:9/352: dread d1/f4 [0,4194304] 0 2024-04-25T02:09:06.658 INFO:tasks.workunit.client.1.smithi112.stdout:7/310: dwrite d7/d25/d43/d46/f5b [0,4194304] 0 2024-04-25T02:09:06.658 INFO:tasks.workunit.client.1.smithi112.stdout:5/314: symlink d1/d16/l68 0 2024-04-25T02:09:06.671 INFO:tasks.workunit.client.1.smithi112.stdout:2/184: rename d3/da/l10 to d3/da/dc/d3e/l44 0 2024-04-25T02:09:06.671 INFO:tasks.workunit.client.1.smithi112.stdout:2/185: truncate d3/f33 5153323 0 2024-04-25T02:09:06.674 INFO:tasks.workunit.client.1.smithi112.stdout:7/311: creat d7/dd/d20/f5c x:0 0 0 2024-04-25T02:09:06.675 INFO:tasks.workunit.client.1.smithi112.stdout:9/353: mknod d1/d48/d65/d73/c7d 0 2024-04-25T02:09:06.675 INFO:tasks.workunit.client.1.smithi112.stdout:9/354: chown d1/df/d3c/d6c/c6f 1504801 1 2024-04-25T02:09:06.675 INFO:tasks.workunit.client.1.smithi112.stdout:9/355: chown d1/fd 9972 1 2024-04-25T02:09:06.676 INFO:tasks.workunit.client.1.smithi112.stdout:5/315: symlink d1/d2/d28/d4f/l69 0 2024-04-25T02:09:06.678 INFO:tasks.workunit.client.1.smithi112.stdout:3/335: dwrite d12/d13/f30 [0,4194304] 0 2024-04-25T02:09:06.678 INFO:tasks.workunit.client.1.smithi112.stdout:7/312: symlink d7/dd/d20/d2c/l5d 0 2024-04-25T02:09:06.679 INFO:tasks.workunit.client.1.smithi112.stdout:9/356: rename d1/d13/c49 to d1/d13/d41/c7e 0 2024-04-25T02:09:06.681 INFO:tasks.workunit.client.1.smithi112.stdout:5/316: mknod d1/d2/d4/d1d/c6a 0 2024-04-25T02:09:06.684 INFO:tasks.workunit.client.1.smithi112.stdout:9/357: unlink d1/f12 0 2024-04-25T02:09:06.686 INFO:tasks.workunit.client.1.smithi112.stdout:5/317: mkdir d1/d41/d5b/d6b 0 2024-04-25T02:09:06.686 INFO:tasks.workunit.client.1.smithi112.stdout:5/318: chown d1/d16/d51/f5f 8 1 2024-04-25T02:09:06.688 INFO:tasks.workunit.client.1.smithi112.stdout:3/336: rename d12/d1f/d27/d44/l57 to d12/l69 0 2024-04-25T02:09:06.692 INFO:tasks.workunit.client.1.smithi112.stdout:7/313: rename d7/d25/d43/f50 to d7/d25/d37/f5e 0 2024-04-25T02:09:06.692 INFO:tasks.workunit.client.1.smithi112.stdout:7/314: chown d7/d25/d43/l31 31848 1 2024-04-25T02:09:06.692 INFO:tasks.workunit.client.1.smithi112.stdout:7/315: write d7/f13 [4978163,74841] 0 2024-04-25T02:09:06.693 INFO:tasks.workunit.client.1.smithi112.stdout:7/316: creat d7/dd/d20/d36/d3a/f5f x:0 0 0 2024-04-25T02:09:06.694 INFO:tasks.workunit.client.1.smithi112.stdout:2/186: dwrite d3/da/f2b [0,4194304] 0 2024-04-25T02:09:06.699 INFO:tasks.workunit.client.1.smithi112.stdout:3/337: dread d12/f36 [0,4194304] 0 2024-04-25T02:09:06.701 INFO:tasks.workunit.client.1.smithi112.stdout:3/338: getdents d12/d5d 0 2024-04-25T02:09:06.704 INFO:tasks.workunit.client.1.smithi112.stdout:3/339: symlink d12/d13/l6a 0 2024-04-25T02:09:06.704 INFO:tasks.workunit.client.1.smithi112.stdout:3/340: chown d12/d13/d34/d4a/l54 67767505 1 2024-04-25T02:09:06.735 INFO:tasks.workunit.client.1.smithi112.stdout:9/358: dwrite d1/df/d3c/d6c/f75 [0,4194304] 0 2024-04-25T02:09:06.735 INFO:tasks.workunit.client.1.smithi112.stdout:9/359: dread - d1/d13/d5b/f60 zero size 2024-04-25T02:09:06.735 INFO:tasks.workunit.client.1.smithi112.stdout:2/187: dwrite d3/da/f2c [0,4194304] 0 2024-04-25T02:09:06.735 INFO:tasks.workunit.client.1.smithi112.stdout:2/188: readlink d3/da/dc/d3e/df/l22 0 2024-04-25T02:09:06.735 INFO:tasks.workunit.client.1.smithi112.stdout:5/319: dwrite d1/d16/f20 [0,4194304] 0 2024-04-25T02:09:06.737 INFO:tasks.workunit.client.1.smithi112.stdout:3/341: dwrite d12/f14 [0,4194304] 0 2024-04-25T02:09:06.739 INFO:tasks.workunit.client.1.smithi112.stdout:2/189: mknod d3/da/dc/d3e/df/d30/c45 0 2024-04-25T02:09:06.747 INFO:tasks.workunit.client.1.smithi112.stdout:5/320: stat d1/d2/f33 0 2024-04-25T02:09:06.748 INFO:tasks.workunit.client.1.smithi112.stdout:5/321: fdatasync d1/d16/f20 0 2024-04-25T02:09:06.749 INFO:tasks.workunit.client.1.smithi112.stdout:9/360: write d1/df/d3c/d43/f4a [7090785,11895] 0 2024-04-25T02:09:06.749 INFO:tasks.workunit.client.1.smithi112.stdout:9/361: creat d1/df/d3c/f7f x:0 0 0 2024-04-25T02:09:06.754 INFO:tasks.workunit.client.1.smithi112.stdout:3/342: rename d12/d13/d34/d53/f59 to d12/d13/d34/d4a/f6b 0 2024-04-25T02:09:06.755 INFO:tasks.workunit.client.1.smithi112.stdout:2/190: creat d3/da/dc/d3e/df/d25/f46 x:0 0 0 2024-04-25T02:09:06.762 INFO:tasks.workunit.client.1.smithi112.stdout:5/322: mkdir d1/d6c 0 2024-04-25T02:09:06.770 INFO:tasks.workunit.client.1.smithi112.stdout:9/362: mknod d1/df/c80 0 2024-04-25T02:09:06.772 INFO:tasks.workunit.client.1.smithi112.stdout:3/343: rename d12/d13/l3b to d12/d13/d34/d4a/d4f/l6c 0 2024-04-25T02:09:06.776 INFO:tasks.workunit.client.1.smithi112.stdout:9/363: truncate d1/df/d3c/f52 2675409 0 2024-04-25T02:09:06.776 INFO:tasks.workunit.client.1.smithi112.stdout:9/364: stat d1/df/d3c/d43 0 2024-04-25T02:09:06.799 INFO:tasks.workunit.client.1.smithi112.stdout:5/323: dwrite d1/d16/d22/f4e [0,4194304] 0 2024-04-25T02:09:06.801 INFO:tasks.workunit.client.1.smithi112.stdout:2/191: dwrite d3/f9 [4194304,4194304] 0 2024-04-25T02:09:06.802 INFO:tasks.workunit.client.1.smithi112.stdout:3/344: dwrite d12/d1f/d27/f46 [0,4194304] 0 2024-04-25T02:09:06.802 INFO:tasks.workunit.client.1.smithi112.stdout:3/345: chown d12/d13/d34/c3f 7 1 2024-04-25T02:09:06.803 INFO:tasks.workunit.client.1.smithi112.stdout:2/192: link d3/da/f2c d3/da/dc/d3e/f47 0 2024-04-25T02:09:06.831 INFO:tasks.workunit.client.1.smithi112.stdout:5/324: dwrite d1/d2/d4/d1d/f2a [0,4194304] 0 2024-04-25T02:09:06.852 INFO:tasks.workunit.client.1.smithi112.stdout:5/325: dwrite d1/d16/f20 [0,4194304] 0 2024-04-25T02:09:06.857 INFO:tasks.workunit.client.1.smithi112.stdout:3/346: creat d12/d13/d34/d53/f6d x:0 0 0 2024-04-25T02:09:06.858 INFO:tasks.workunit.client.1.smithi112.stdout:2/193: truncate d3/da/dc/d3e/df/d32/f35 4464510 0 2024-04-25T02:09:06.868 INFO:tasks.workunit.client.1.smithi112.stdout:2/194: dread d3/da/f1c [4194304,4194304] 0 2024-04-25T02:09:06.869 INFO:tasks.workunit.client.1.smithi112.stdout:2/195: fsync d3/da/f2c 0 2024-04-25T02:09:06.898 INFO:tasks.workunit.client.1.smithi112.stdout:5/326: creat d1/d41/f6d x:0 0 0 2024-04-25T02:09:06.929 INFO:tasks.workunit.client.1.smithi112.stdout:3/347: rename d12/d1f/l62 to d12/d13/l6e 0 2024-04-25T02:09:06.930 INFO:tasks.workunit.client.1.smithi112.stdout:3/348: readlink d12/d1f/d27/d44/l5b 0 2024-04-25T02:09:06.934 INFO:tasks.workunit.client.1.smithi112.stdout:5/327: link d1/d2/d4/d1d/l1f d1/d41/d5b/l6e 0 2024-04-25T02:09:06.938 INFO:tasks.workunit.client.1.smithi112.stdout:3/349: link d12/d1f/d27/f52 d12/d1f/d27/f6f 0 2024-04-25T02:09:06.940 INFO:tasks.workunit.client.1.smithi112.stdout:2/196: link d3/c6 d3/da/dc/d20/c48 0 2024-04-25T02:09:06.942 INFO:tasks.workunit.client.1.smithi112.stdout:5/328: symlink d1/d41/d5b/l6f 0 2024-04-25T02:09:06.943 INFO:tasks.workunit.client.1.smithi112.stdout:3/350: creat d12/d67/f70 x:0 0 0 2024-04-25T02:09:06.944 INFO:tasks.workunit.client.1.smithi112.stdout:3/351: chown d12/d13/d34/d53 0 1 2024-04-25T02:09:06.949 INFO:tasks.workunit.client.1.smithi112.stdout:2/197: read d3/da/dc/d3e/df/f34 [3604124,90118] 0 2024-04-25T02:09:06.965 INFO:tasks.workunit.client.1.smithi112.stdout:2/198: dwrite d3/da/dc/d3e/df/d25/f37 [0,4194304] 0 2024-04-25T02:09:06.965 INFO:tasks.workunit.client.1.smithi112.stdout:2/199: readlink d3/l24 0 2024-04-25T02:09:06.979 INFO:tasks.workunit.client.1.smithi112.stdout:3/352: mknod d12/d13/d34/d53/c71 0 2024-04-25T02:09:06.983 INFO:tasks.workunit.client.1.smithi112.stdout:3/353: dread d12/d1f/f33 [0,4194304] 0 2024-04-25T02:09:06.983 INFO:tasks.workunit.client.1.smithi112.stdout:3/354: write d12/d1f/d27/d44/f68 [803981,101431] 0 2024-04-25T02:09:06.983 INFO:tasks.workunit.client.1.smithi112.stdout:3/355: chown d12/c26 221245 1 2024-04-25T02:09:06.983 INFO:tasks.workunit.client.1.smithi112.stdout:3/356: truncate d12/f41 258011 0 2024-04-25T02:09:07.081 INFO:tasks.workunit.client.1.smithi112.stdout:2/200: mknod d3/da/dc/d20/c49 0 2024-04-25T02:09:07.083 INFO:tasks.workunit.client.1.smithi112.stdout:3/357: mknod d12/d1f/c72 0 2024-04-25T02:09:07.094 INFO:tasks.workunit.client.1.smithi112.stdout:2/201: symlink d3/da/dc/d3e/df/d32/l4a 0 2024-04-25T02:09:07.096 INFO:tasks.workunit.client.1.smithi112.stdout:3/358: mkdir d12/d1f/d27/d44/d73 0 2024-04-25T02:09:07.124 INFO:tasks.workunit.client.1.smithi112.stdout:2/202: dwrite d3/da/f29 [4194304,4194304] 0 2024-04-25T02:09:07.124 INFO:tasks.workunit.client.1.smithi112.stdout:3/359: dwrite d12/d1f/d27/f6f [0,4194304] 0 2024-04-25T02:09:07.125 INFO:tasks.workunit.client.1.smithi112.stdout:2/203: symlink d3/da/dc/d3e/df/d32/l4b 0 2024-04-25T02:09:07.137 INFO:tasks.workunit.client.1.smithi112.stdout:1/365: sync 2024-04-25T02:09:07.143 INFO:tasks.workunit.client.1.smithi112.stdout:8/442: sync 2024-04-25T02:09:07.143 INFO:tasks.workunit.client.1.smithi112.stdout:4/366: sync 2024-04-25T02:09:07.143 INFO:tasks.workunit.client.1.smithi112.stdout:7/317: sync 2024-04-25T02:09:07.143 INFO:tasks.workunit.client.1.smithi112.stdout:0/585: sync 2024-04-25T02:09:07.143 INFO:tasks.workunit.client.1.smithi112.stdout:6/368: sync 2024-04-25T02:09:07.143 INFO:tasks.workunit.client.1.smithi112.stdout:6/369: stat d0/d2/d3b/f58 0 2024-04-25T02:09:07.144 INFO:tasks.workunit.client.1.smithi112.stdout:7/318: readlink d7/dd/d20/d2c/l2f 0 2024-04-25T02:09:07.144 INFO:tasks.workunit.client.1.smithi112.stdout:9/365: sync 2024-04-25T02:09:07.144 INFO:tasks.workunit.client.1.smithi112.stdout:0/586: write da/d13/d23/d77/f95 [718311,14979] 0 2024-04-25T02:09:07.144 INFO:tasks.workunit.client.1.smithi112.stdout:7/319: write d7/dd/f1c [1535146,51738] 0 2024-04-25T02:09:07.144 INFO:tasks.workunit.client.1.smithi112.stdout:9/366: dread - d1/d13/d5b/d55/f57 zero size 2024-04-25T02:09:07.144 INFO:tasks.workunit.client.1.smithi112.stdout:9/367: dread - d1/f7a zero size 2024-04-25T02:09:07.145 INFO:tasks.workunit.client.1.smithi112.stdout:8/443: getdents d15/d35/d5c 0 2024-04-25T02:09:07.146 INFO:tasks.workunit.client.1.smithi112.stdout:1/366: dread d7/d9/d1e/de/f65 [0,4194304] 0 2024-04-25T02:09:07.151 INFO:tasks.workunit.client.1.smithi112.stdout:4/367: dread d2/f27 [0,4194304] 0 2024-04-25T02:09:07.151 INFO:tasks.workunit.client.1.smithi112.stdout:4/368: fsync d2/d17/d20/d5e/f6c 0 2024-04-25T02:09:07.156 INFO:tasks.workunit.client.1.smithi112.stdout:7/320: truncate d7/d25/d43/f47 1858204 0 2024-04-25T02:09:07.160 INFO:tasks.workunit.client.1.smithi112.stdout:8/444: mknod d15/d35/d5c/d5e/c97 0 2024-04-25T02:09:07.160 INFO:tasks.workunit.client.1.smithi112.stdout:8/445: truncate d15/d26/f92 141324 0 2024-04-25T02:09:07.162 INFO:tasks.workunit.client.1.smithi112.stdout:4/369: dread d2/d17/d25/f3b [0,4194304] 0 2024-04-25T02:09:07.165 INFO:tasks.workunit.client.1.smithi112.stdout:4/370: unlink d2/d17/d25/l62 0 2024-04-25T02:09:07.170 INFO:tasks.workunit.client.1.smithi112.stdout:7/321: dread d7/d25/d37/f4c [0,4194304] 0 2024-04-25T02:09:07.173 INFO:tasks.workunit.client.1.smithi112.stdout:8/446: write d15/d35/d56/f6a [47949,76506] 0 2024-04-25T02:09:07.173 INFO:tasks.workunit.client.1.smithi112.stdout:8/447: creat d15/d35/f98 x:0 0 0 2024-04-25T02:09:07.175 INFO:tasks.workunit.client.1.smithi112.stdout:7/322: rename d7/d25/d40/f4d to d7/d25/d43/f60 0 2024-04-25T02:09:07.180 INFO:tasks.workunit.client.1.smithi112.stdout:8/448: creat d15/d35/d56/f99 x:0 0 0 2024-04-25T02:09:07.180 INFO:tasks.workunit.client.1.smithi112.stdout:8/449: chown d15/d17/d1a/f1d 684 1 2024-04-25T02:09:07.192 INFO:tasks.workunit.client.1.smithi112.stdout:6/370: dwrite d0/d2/d4/f5 [4194304,4194304] 0 2024-04-25T02:09:07.192 INFO:tasks.workunit.client.1.smithi112.stdout:6/371: write d0/f17 [4146513,43260] 0 2024-04-25T02:09:07.198 INFO:tasks.workunit.client.1.smithi112.stdout:0/587: dwrite da/d13/d1e/f6a [0,4194304] 0 2024-04-25T02:09:07.199 INFO:tasks.workunit.client.1.smithi112.stdout:1/367: dwrite d7/d9/d4e/d28/d32/f64 [0,4194304] 0 2024-04-25T02:09:07.207 INFO:tasks.workunit.client.1.smithi112.stdout:7/323: dwrite d7/d25/d43/f60 [0,4194304] 0 2024-04-25T02:09:07.207 INFO:tasks.workunit.client.1.smithi112.stdout:4/371: dwrite d2/f2d [0,4194304] 0 2024-04-25T02:09:07.209 INFO:tasks.workunit.client.1.smithi112.stdout:8/450: dwrite d15/d26/f29 [0,4194304] 0 2024-04-25T02:09:07.232 INFO:tasks.workunit.client.1.smithi112.stdout:6/372: unlink d0/d2/d3b/l6c 0 2024-04-25T02:09:07.234 INFO:tasks.workunit.client.1.smithi112.stdout:0/588: symlink da/d1d/d2e/lba 0 2024-04-25T02:09:07.234 INFO:tasks.workunit.client.1.smithi112.stdout:0/589: chown da/d13/d45/f74 417541 1 2024-04-25T02:09:07.234 INFO:tasks.workunit.client.1.smithi112.stdout:0/590: fsync da/d13/d45/f8f 0 2024-04-25T02:09:07.234 INFO:tasks.workunit.client.1.smithi112.stdout:0/591: fsync da/d1d/d88/d24/f48 0 2024-04-25T02:09:07.234 INFO:tasks.workunit.client.1.smithi112.stdout:0/592: write da/d13/d1e/f83 [1929518,44433] 0 2024-04-25T02:09:07.234 INFO:tasks.workunit.client.1.smithi112.stdout:0/593: chown da/d1d/d2e/d40/d49/d4f 53386721 1 2024-04-25T02:09:07.234 INFO:tasks.workunit.client.1.smithi112.stdout:0/594: chown da/d1d/d88/d78/la7 984 1 2024-04-25T02:09:07.235 INFO:tasks.workunit.client.1.smithi112.stdout:0/595: chown da/d1d/d2e/d40/d49 1675427031 1 2024-04-25T02:09:07.235 INFO:tasks.workunit.client.1.smithi112.stdout:1/368: rename d7/d9/d4e/d28/l67 to d7/d9/l6f 0 2024-04-25T02:09:07.237 INFO:tasks.workunit.client.1.smithi112.stdout:1/369: dread d7/d9/d1e/de/f17 [4194304,4194304] 0 2024-04-25T02:09:07.237 INFO:tasks.workunit.client.1.smithi112.stdout:1/370: stat d7/d9/d4e/d28/d43 0 2024-04-25T02:09:07.241 INFO:tasks.workunit.client.1.smithi112.stdout:7/324: creat d7/f61 x:0 0 0 2024-04-25T02:09:07.242 INFO:tasks.workunit.client.1.smithi112.stdout:7/325: write d7/d25/d37/f58 [1029862,41445] 0 2024-04-25T02:09:07.242 INFO:tasks.workunit.client.1.smithi112.stdout:7/326: truncate d7/d25/d43/f47 2061030 0 2024-04-25T02:09:07.244 INFO:tasks.workunit.client.1.smithi112.stdout:4/372: link d2/d1e/d42/f4d d2/d17/d20/d26/d39/d49/d4c/f72 0 2024-04-25T02:09:07.248 INFO:tasks.workunit.client.1.smithi112.stdout:0/596: symlink da/d1d/d2e/d40/d49/d4f/d82/lbb 0 2024-04-25T02:09:07.251 INFO:tasks.workunit.client.1.smithi112.stdout:4/373: symlink d2/d17/l73 0 2024-04-25T02:09:07.253 INFO:tasks.workunit.client.1.smithi112.stdout:0/597: mknod da/d13/cbc 0 2024-04-25T02:09:07.256 INFO:tasks.workunit.client.1.smithi112.stdout:8/451: read d15/d17/d1a/f43 [498625,66861] 0 2024-04-25T02:09:07.256 INFO:tasks.workunit.client.1.smithi112.stdout:8/452: dread - d15/d17/f6b zero size 2024-04-25T02:09:07.256 INFO:tasks.workunit.client.1.smithi112.stdout:0/598: mkdir da/d1d/d2e/dbd 0 2024-04-25T02:09:07.259 INFO:tasks.workunit.client.1.smithi112.stdout:0/599: mkdir da/d1d/dbe 0 2024-04-25T02:09:07.259 INFO:tasks.workunit.client.1.smithi112.stdout:0/600: write da/d1d/d88/d24/f48 [2260450,9396] 0 2024-04-25T02:09:07.259 INFO:tasks.workunit.client.1.smithi112.stdout:0/601: readlink da/d1d/d2e/d40/d49/d5f/l7d 0 2024-04-25T02:09:07.260 INFO:tasks.workunit.client.1.smithi112.stdout:8/453: mknod d15/d26/d37/d8e/c9a 0 2024-04-25T02:09:07.263 INFO:tasks.workunit.client.1.smithi112.stdout:6/373: dwrite d0/d2/d2c/d41/f5d [0,4194304] 0 2024-04-25T02:09:07.265 INFO:tasks.workunit.client.1.smithi112.stdout:8/454: rename d15/d26/d4f/d67/c82 to d15/d35/c9b 0 2024-04-25T02:09:07.265 INFO:tasks.workunit.client.1.smithi112.stdout:8/455: stat f10 0 2024-04-25T02:09:07.269 INFO:tasks.workunit.client.1.smithi112.stdout:1/371: dwrite d7/d9/d1f/f3e [0,4194304] 0 2024-04-25T02:09:07.269 INFO:tasks.workunit.client.1.smithi112.stdout:1/372: fdatasync f2 0 2024-04-25T02:09:07.269 INFO:tasks.workunit.client.1.smithi112.stdout:7/327: dwrite d7/d25/d37/d53/f56 [0,4194304] 0 2024-04-25T02:09:07.270 INFO:tasks.workunit.client.1.smithi112.stdout:7/328: write d7/dd/d20/d2c/f45 [162517,56432] 0 2024-04-25T02:09:07.270 INFO:tasks.workunit.client.1.smithi112.stdout:7/329: truncate d7/d25/d37/f33 596602 0 2024-04-25T02:09:07.274 INFO:tasks.workunit.client.1.smithi112.stdout:6/374: mkdir d0/d2/d3b/d53/d85 0 2024-04-25T02:09:07.284 INFO:tasks.workunit.client.1.smithi112.stdout:7/330: truncate d7/d25/d43/d46/f5b 4087604 0 2024-04-25T02:09:07.286 INFO:tasks.workunit.client.1.smithi112.stdout:6/375: rename d0/d2/d2c/d41/d77/l7f to d0/d2/d2c/d41/d77/l86 0 2024-04-25T02:09:07.288 INFO:tasks.workunit.client.1.smithi112.stdout:6/376: symlink d0/l87 0 2024-04-25T02:09:07.293 INFO:tasks.workunit.client.1.smithi112.stdout:1/373: dwrite d7/d9/d1e/de/f65 [0,4194304] 0 2024-04-25T02:09:07.296 INFO:tasks.workunit.client.1.smithi112.stdout:7/331: dread d7/dd/f18 [0,4194304] 0 2024-04-25T02:09:07.296 INFO:tasks.workunit.client.1.smithi112.stdout:8/456: dwrite d15/f2c [0,4194304] 0 2024-04-25T02:09:07.297 INFO:tasks.workunit.client.1.smithi112.stdout:7/332: read d7/dd/f10 [9868,1416] 0 2024-04-25T02:09:07.297 INFO:tasks.workunit.client.1.smithi112.stdout:6/377: dread d0/d2/d2c/f33 [0,4194304] 0 2024-04-25T02:09:07.301 INFO:tasks.workunit.client.1.smithi112.stdout:8/457: rename d15/d17/l1f to d15/d35/d5c/d91/d78/l9c 0 2024-04-25T02:09:07.301 INFO:tasks.workunit.client.1.smithi112.stdout:8/458: getdents d15/d81 0 2024-04-25T02:09:07.301 INFO:tasks.workunit.client.1.smithi112.stdout:8/459: fdatasync d15/f42 0 2024-04-25T02:09:07.302 INFO:tasks.workunit.client.1.smithi112.stdout:7/333: rename d7/f22 to d7/d25/d40/f62 0 2024-04-25T02:09:07.303 INFO:tasks.workunit.client.1.smithi112.stdout:7/334: symlink d7/d25/d37/l63 0 2024-04-25T02:09:07.304 INFO:tasks.workunit.client.1.smithi112.stdout:7/335: rename d7/d25/d37/f58 to d7/d25/d37/d53/f64 0 2024-04-25T02:09:07.305 INFO:tasks.workunit.client.1.smithi112.stdout:0/602: getdents da/d13 0 2024-04-25T02:09:07.305 INFO:tasks.workunit.client.1.smithi112.stdout:0/603: chown da/d13/c5c 129222351 1 2024-04-25T02:09:07.309 INFO:tasks.workunit.client.1.smithi112.stdout:6/378: write d0/d2/d4/f1d [2563525,113055] 0 2024-04-25T02:09:07.313 INFO:tasks.workunit.client.1.smithi112.stdout:8/460: dread fd [0,4194304] 0 2024-04-25T02:09:07.314 INFO:tasks.workunit.client.1.smithi112.stdout:6/379: creat d0/d7b/f88 x:0 0 0 2024-04-25T02:09:07.314 INFO:tasks.workunit.client.1.smithi112.stdout:6/380: write d0/f30 [4815525,90159] 0 2024-04-25T02:09:07.315 INFO:tasks.workunit.client.1.smithi112.stdout:7/336: read d7/f1e [2612488,78505] 0 2024-04-25T02:09:07.315 INFO:tasks.workunit.client.1.smithi112.stdout:7/337: read d7/dd/f1d [2540682,6621] 0 2024-04-25T02:09:07.315 INFO:tasks.workunit.client.1.smithi112.stdout:8/461: rmdir d15/d26/d4f/d67 39 2024-04-25T02:09:07.315 INFO:tasks.workunit.client.1.smithi112.stdout:8/462: fdatasync d15/d17/f23 0 2024-04-25T02:09:07.318 INFO:tasks.workunit.client.1.smithi112.stdout:7/338: unlink d7/dd/d20/d36/d3a/f5f 0 2024-04-25T02:09:07.320 INFO:tasks.workunit.client.1.smithi112.stdout:8/463: symlink d15/d35/d5c/d91/l9d 0 2024-04-25T02:09:07.320 INFO:tasks.workunit.client.1.smithi112.stdout:8/464: chown d15/d26/d37/c68 406366 1 2024-04-25T02:09:07.320 INFO:tasks.workunit.client.1.smithi112.stdout:8/465: chown d15/d40/f4d 12489144 1 2024-04-25T02:09:07.321 INFO:tasks.workunit.client.1.smithi112.stdout:0/604: dwrite da/f10 [4194304,4194304] 0 2024-04-25T02:09:07.322 INFO:tasks.workunit.client.1.smithi112.stdout:8/466: creat d15/d35/d5c/f9e x:0 0 0 2024-04-25T02:09:07.323 INFO:tasks.workunit.client.1.smithi112.stdout:8/467: fsync d15/d17/d1a/f4b 0 2024-04-25T02:09:07.323 INFO:tasks.workunit.client.1.smithi112.stdout:8/468: stat d15/d26/l51 0 2024-04-25T02:09:07.323 INFO:tasks.workunit.client.1.smithi112.stdout:8/469: stat d15/d26/d37/f38 0 2024-04-25T02:09:07.324 INFO:tasks.workunit.client.1.smithi112.stdout:8/470: creat d15/d26/f9f x:0 0 0 2024-04-25T02:09:07.326 INFO:tasks.workunit.client.1.smithi112.stdout:8/471: creat d15/d35/d5f/fa0 x:0 0 0 2024-04-25T02:09:07.333 INFO:tasks.workunit.client.1.smithi112.stdout:6/381: dwrite d0/d36/f5a [0,4194304] 0 2024-04-25T02:09:07.339 INFO:tasks.workunit.client.1.smithi112.stdout:6/382: mknod d0/d2/d3b/d53/d85/c89 0 2024-04-25T02:09:07.339 INFO:tasks.workunit.client.1.smithi112.stdout:6/383: creat d0/d2/d2c/d41/d77/f8a x:0 0 0 2024-04-25T02:09:07.340 INFO:tasks.workunit.client.1.smithi112.stdout:6/384: chown d0/l87 21821 1 2024-04-25T02:09:07.343 INFO:tasks.workunit.client.1.smithi112.stdout:0/605: dwrite f2 [0,4194304] 0 2024-04-25T02:09:07.347 INFO:tasks.workunit.client.1.smithi112.stdout:0/606: mknod da/d1d/d88/cbf 0 2024-04-25T02:09:07.350 INFO:tasks.workunit.client.1.smithi112.stdout:8/472: dwrite d15/d26/f53 [0,4194304] 0 2024-04-25T02:09:07.350 INFO:tasks.workunit.client.1.smithi112.stdout:8/473: write d15/d17/d1a/f2f [304136,46404] 0 2024-04-25T02:09:07.360 INFO:tasks.workunit.client.1.smithi112.stdout:7/339: dwrite d7/d25/d43/d46/f5b [0,4194304] 0 2024-04-25T02:09:07.362 INFO:tasks.workunit.client.1.smithi112.stdout:6/385: dwrite d0/d2/d2c/d41/d77/f8a [0,4194304] 0 2024-04-25T02:09:07.365 INFO:tasks.workunit.client.1.smithi112.stdout:7/340: dread d7/fc [0,4194304] 0 2024-04-25T02:09:07.371 INFO:tasks.workunit.client.1.smithi112.stdout:8/474: dread d15/d17/d1a/f2f [0,4194304] 0 2024-04-25T02:09:07.372 INFO:tasks.workunit.client.1.smithi112.stdout:7/341: link d7/l14 d7/d25/d43/l65 0 2024-04-25T02:09:07.372 INFO:tasks.workunit.client.1.smithi112.stdout:0/607: dwrite da/d13/fa5 [0,4194304] 0 2024-04-25T02:09:07.372 INFO:tasks.workunit.client.1.smithi112.stdout:0/608: creat da/d13/d23/d77/fc0 x:0 0 0 2024-04-25T02:09:07.373 INFO:tasks.workunit.client.1.smithi112.stdout:0/609: fsync da/d13/d45/f74 0 2024-04-25T02:09:07.373 INFO:tasks.workunit.client.1.smithi112.stdout:0/610: fsync da/d1d/d2e/d40/d49/d4f/f51 0 2024-04-25T02:09:07.373 INFO:tasks.workunit.client.1.smithi112.stdout:0/611: chown da/d1d/d88/d24/d97 197696 1 2024-04-25T02:09:07.376 INFO:tasks.workunit.client.1.smithi112.stdout:8/475: mknod d15/d26/d37/ca1 0 2024-04-25T02:09:07.377 INFO:tasks.workunit.client.1.smithi112.stdout:8/476: chown d15/d26/d37/ca1 1 1 2024-04-25T02:09:07.377 INFO:tasks.workunit.client.1.smithi112.stdout:8/477: chown d15/d35/d5c/d5e/c66 2 1 2024-04-25T02:09:07.382 INFO:tasks.workunit.client.1.smithi112.stdout:7/342: dread d7/d25/d40/f62 [0,4194304] 0 2024-04-25T02:09:07.395 INFO:tasks.workunit.client.1.smithi112.stdout:0/612: mkdir da/d1d/d2e/d40/d49/d6b/dc1 0 2024-04-25T02:09:07.395 INFO:tasks.workunit.client.1.smithi112.stdout:0/613: readlink l9 0 2024-04-25T02:09:07.395 INFO:tasks.workunit.client.1.smithi112.stdout:0/614: write da/d1d/d2e/f9f [911782,81582] 0 2024-04-25T02:09:07.403 INFO:tasks.workunit.client.1.smithi112.stdout:7/343: dwrite d7/f61 [0,4194304] 0 2024-04-25T02:09:07.415 INFO:tasks.workunit.client.1.smithi112.stdout:7/344: write d7/d25/f2d [3200466,16127] 0 2024-04-25T02:09:07.419 INFO:tasks.workunit.client.1.smithi112.stdout:5/329: sync 2024-04-25T02:09:07.420 INFO:tasks.workunit.client.1.smithi112.stdout:8/478: dwrite d15/d35/d5c/d91/f45 [0,4194304] 0 2024-04-25T02:09:07.420 INFO:tasks.workunit.client.1.smithi112.stdout:8/479: truncate d15/d17/f1e 150135 0 2024-04-25T02:09:07.421 INFO:tasks.workunit.client.1.smithi112.stdout:5/330: readlink d1/d2/l40 0 2024-04-25T02:09:07.425 INFO:tasks.workunit.client.1.smithi112.stdout:8/480: creat d15/d17/fa2 x:0 0 0 2024-04-25T02:09:07.425 INFO:tasks.workunit.client.1.smithi112.stdout:8/481: chown d15/d26/d4f/d67 615 1 2024-04-25T02:09:07.432 INFO:tasks.workunit.client.1.smithi112.stdout:8/482: symlink d15/d26/d37/la3 0 2024-04-25T02:09:07.443 INFO:tasks.workunit.client.1.smithi112.stdout:8/483: dread d15/d35/d5c/d91/f45 [0,4194304] 0 2024-04-25T02:09:07.443 INFO:tasks.workunit.client.1.smithi112.stdout:8/484: chown d15 27247 1 2024-04-25T02:09:07.452 INFO:tasks.workunit.client.1.smithi112.stdout:5/331: dwrite d1/d2/f36 [0,4194304] 0 2024-04-25T02:09:07.463 INFO:tasks.workunit.client.1.smithi112.stdout:5/332: write d1/d16/d22/f4e [4132971,69429] 0 2024-04-25T02:09:07.463 INFO:tasks.workunit.client.1.smithi112.stdout:5/333: readlink d1/d2/l40 0 2024-04-25T02:09:07.549 INFO:tasks.workunit.client.1.smithi112.stdout:5/334: creat d1/d2/d4/d1d/f70 x:0 0 0 2024-04-25T02:09:07.549 INFO:tasks.workunit.client.1.smithi112.stdout:5/335: creat d1/d2/d28/d4f/f71 x:0 0 0 2024-04-25T02:09:07.549 INFO:tasks.workunit.client.1.smithi112.stdout:5/336: chown d1/d41/d5b/d6b 229 1 2024-04-25T02:09:07.549 INFO:tasks.workunit.client.1.smithi112.stdout:5/337: fsync d1/d2/d4/d1d/f25 0 2024-04-25T02:09:07.553 INFO:tasks.workunit.client.1.smithi112.stdout:8/485: link d15/d17/d1a/f62 d15/d17/fa4 0 2024-04-25T02:09:07.557 INFO:tasks.workunit.client.1.smithi112.stdout:8/486: symlink d15/d35/d5f/la5 0 2024-04-25T02:09:07.557 INFO:tasks.workunit.client.1.smithi112.stdout:8/487: read - d15/d35/d56/f96 zero size 2024-04-25T02:09:07.560 INFO:tasks.workunit.client.1.smithi112.stdout:8/488: mknod d15/d35/d5c/d91/d78/ca6 0 2024-04-25T02:09:07.560 INFO:tasks.workunit.client.1.smithi112.stdout:8/489: creat d15/d35/d5c/fa7 x:0 0 0 2024-04-25T02:09:07.565 INFO:tasks.workunit.client.1.smithi112.stdout:8/490: mkdir d15/d26/d37/da8 0 2024-04-25T02:09:07.567 INFO:tasks.workunit.client.1.smithi112.stdout:8/491: symlink d15/d35/d5c/d5e/d94/la9 0 2024-04-25T02:09:07.570 INFO:tasks.workunit.client.1.smithi112.stdout:5/338: dwrite d1/d2/d4/fe [0,4194304] 0 2024-04-25T02:09:07.572 INFO:tasks.workunit.client.1.smithi112.stdout:5/339: mknod d1/d41/d5b/d6b/c72 0 2024-04-25T02:09:07.584 INFO:tasks.workunit.client.1.smithi112.stdout:8/492: dwrite d15/d17/f23 [4194304,4194304] 0 2024-04-25T02:09:07.585 INFO:tasks.workunit.client.1.smithi112.stdout:8/493: stat d15/d17/d1a/l25 0 2024-04-25T02:09:07.585 INFO:tasks.workunit.client.1.smithi112.stdout:8/494: chown d15/d35/d5c/d91/d64/d8b 2 1 2024-04-25T02:09:07.586 INFO:tasks.workunit.client.1.smithi112.stdout:8/495: write d15/d26/d37/f65 [122818,29030] 0 2024-04-25T02:09:07.595 INFO:tasks.workunit.client.1.smithi112.stdout:2/204: sync 2024-04-25T02:09:07.595 INFO:tasks.workunit.client.1.smithi112.stdout:3/360: sync 2024-04-25T02:09:07.595 INFO:tasks.workunit.client.1.smithi112.stdout:9/368: sync 2024-04-25T02:09:07.598 INFO:tasks.workunit.client.1.smithi112.stdout:8/496: dwrite d15/d17/d1a/f43 [4194304,4194304] 0 2024-04-25T02:09:07.598 INFO:tasks.workunit.client.1.smithi112.stdout:8/497: write d15/d17/d1a/f33 [10981,116333] 0 2024-04-25T02:09:07.601 INFO:tasks.workunit.client.1.smithi112.stdout:2/205: truncate d3/f9 6050041 0 2024-04-25T02:09:07.602 INFO:tasks.workunit.client.1.smithi112.stdout:9/369: symlink d1/df/d3c/d6c/l81 0 2024-04-25T02:09:07.605 INFO:tasks.workunit.client.1.smithi112.stdout:8/498: dread d15/d17/f19 [0,4194304] 0 2024-04-25T02:09:07.605 INFO:tasks.workunit.client.1.smithi112.stdout:3/361: symlink d12/l74 0 2024-04-25T02:09:07.605 INFO:tasks.workunit.client.1.smithi112.stdout:3/362: getdents d12/d5d 0 2024-04-25T02:09:07.606 INFO:tasks.workunit.client.1.smithi112.stdout:2/206: truncate d3/da/f3a 933978 0 2024-04-25T02:09:07.607 INFO:tasks.workunit.client.1.smithi112.stdout:9/370: stat d1/d13/l35 0 2024-04-25T02:09:07.610 INFO:tasks.workunit.client.1.smithi112.stdout:8/499: unlink d15/d17/d1a/l25 0 2024-04-25T02:09:07.610 INFO:tasks.workunit.client.1.smithi112.stdout:8/500: readlink d15/d35/d5f/la5 0 2024-04-25T02:09:07.611 INFO:tasks.workunit.client.1.smithi112.stdout:3/363: creat d12/d5d/f75 x:0 0 0 2024-04-25T02:09:07.612 INFO:tasks.workunit.client.1.smithi112.stdout:9/371: unlink d1/d13/d41/f50 0 2024-04-25T02:09:07.614 INFO:tasks.workunit.client.1.smithi112.stdout:2/207: write d3/da/dc/d3e/df/d25/f37 [2601724,74071] 0 2024-04-25T02:09:07.615 INFO:tasks.workunit.client.1.smithi112.stdout:8/501: symlink d15/d35/d5c/d5e/d94/laa 0 2024-04-25T02:09:07.616 INFO:tasks.workunit.client.1.smithi112.stdout:3/364: mknod d12/d1f/d27/d44/c76 0 2024-04-25T02:09:07.619 INFO:tasks.workunit.client.1.smithi112.stdout:9/372: rename d1/d13/d5b/f60 to d1/df/f82 0 2024-04-25T02:09:07.622 INFO:tasks.workunit.client.1.smithi112.stdout:2/208: creat d3/da/dc/d20/d40/f4c x:0 0 0 2024-04-25T02:09:07.624 INFO:tasks.workunit.client.1.smithi112.stdout:8/502: symlink d15/d81/lab 0 2024-04-25T02:09:07.625 INFO:tasks.workunit.client.1.smithi112.stdout:8/503: dread d15/d26/f92 [0,4194304] 0 2024-04-25T02:09:07.626 INFO:tasks.workunit.client.1.smithi112.stdout:3/365: mknod d12/d5d/c77 0 2024-04-25T02:09:07.627 INFO:tasks.workunit.client.1.smithi112.stdout:9/373: chown d1/df/d3c/d43/f6a 13907787 1 2024-04-25T02:09:07.629 INFO:tasks.workunit.client.1.smithi112.stdout:8/504: symlink d15/d35/d5c/d5e/lac 0 2024-04-25T02:09:07.629 INFO:tasks.workunit.client.1.smithi112.stdout:8/505: truncate d15/d35/d5c/f9e 153534 0 2024-04-25T02:09:07.635 INFO:tasks.workunit.client.1.smithi112.stdout:3/366: read d12/d13/f30 [4154761,81032] 0 2024-04-25T02:09:07.635 INFO:tasks.workunit.client.1.smithi112.stdout:9/374: rmdir d1/df/d3c 39 2024-04-25T02:09:07.638 INFO:tasks.workunit.client.1.smithi112.stdout:2/209: dwrite d3/f33 [0,4194304] 0 2024-04-25T02:09:07.660 INFO:tasks.workunit.client.1.smithi112.stdout:9/375: dwrite d1/f3b [0,4194304] 0 2024-04-25T02:09:07.660 INFO:tasks.workunit.client.1.smithi112.stdout:3/367: dwrite d12/d1f/d27/d44/f68 [0,4194304] 0 2024-04-25T02:09:07.660 INFO:tasks.workunit.client.1.smithi112.stdout:9/376: chown d1/df/d3c/f7f 5 1 2024-04-25T02:09:07.662 INFO:tasks.workunit.client.1.smithi112.stdout:2/210: dwrite d3/da/f2b [4194304,4194304] 0 2024-04-25T02:09:07.670 INFO:tasks.workunit.client.1.smithi112.stdout:3/368: mkdir d12/d13/d34/d78 0 2024-04-25T02:09:07.671 INFO:tasks.workunit.client.1.smithi112.stdout:2/211: write d3/da/f2c [2161665,14679] 0 2024-04-25T02:09:07.674 INFO:tasks.workunit.client.1.smithi112.stdout:3/369: dread d12/d13/f4d [0,4194304] 0 2024-04-25T02:09:07.678 INFO:tasks.workunit.client.1.smithi112.stdout:9/377: mknod d1/df/d3c/d43/c83 0 2024-04-25T02:09:07.681 INFO:tasks.workunit.client.1.smithi112.stdout:3/370: dread d12/f14 [0,4194304] 0 2024-04-25T02:09:07.681 INFO:tasks.workunit.client.1.smithi112.stdout:3/371: fsync d12/d13/f42 0 2024-04-25T02:09:07.682 INFO:tasks.workunit.client.1.smithi112.stdout:3/372: fsync d12/f5c 0 2024-04-25T02:09:07.682 INFO:tasks.workunit.client.1.smithi112.stdout:2/212: symlink d3/da/dc/d3e/df/d42/l4d 0 2024-04-25T02:09:07.683 INFO:tasks.workunit.client.1.smithi112.stdout:9/378: mkdir d1/d13/d41/d84 0 2024-04-25T02:09:07.685 INFO:tasks.workunit.client.1.smithi112.stdout:3/373: rename d12/f41 to d12/d1f/f79 0 2024-04-25T02:09:07.685 INFO:tasks.workunit.client.1.smithi112.stdout:1/374: sync 2024-04-25T02:09:07.685 INFO:tasks.workunit.client.1.smithi112.stdout:4/374: sync 2024-04-25T02:09:07.685 INFO:tasks.workunit.client.1.smithi112.stdout:1/375: dread - d7/d9/d4e/d28/d32/f6c zero size 2024-04-25T02:09:07.690 INFO:tasks.workunit.client.1.smithi112.stdout:9/379: creat d1/d13/d5b/f85 x:0 0 0 2024-04-25T02:09:07.690 INFO:tasks.workunit.client.1.smithi112.stdout:2/213: dread d3/f9 [0,4194304] 0 2024-04-25T02:09:07.691 INFO:tasks.workunit.client.1.smithi112.stdout:1/376: creat d7/d9/d4e/d28/f70 x:0 0 0 2024-04-25T02:09:07.693 INFO:tasks.workunit.client.1.smithi112.stdout:9/380: dread d1/f38 [0,4194304] 0 2024-04-25T02:09:07.693 INFO:tasks.workunit.client.1.smithi112.stdout:2/214: link d3/da/dc/l1a d3/da/dc/d3e/l4e 0 2024-04-25T02:09:07.694 INFO:tasks.workunit.client.1.smithi112.stdout:1/377: rmdir d7 39 2024-04-25T02:09:07.694 INFO:tasks.workunit.client.1.smithi112.stdout:1/378: write f4 [5643319,46634] 0 2024-04-25T02:09:07.697 INFO:tasks.workunit.client.1.smithi112.stdout:2/215: symlink d3/da/dc/d3e/l4f 0 2024-04-25T02:09:07.697 INFO:tasks.workunit.client.1.smithi112.stdout:3/374: dread d12/d13/f1c [0,4194304] 0 2024-04-25T02:09:07.698 INFO:tasks.workunit.client.1.smithi112.stdout:2/216: mknod d3/da/dc/c50 0 2024-04-25T02:09:07.699 INFO:tasks.workunit.client.1.smithi112.stdout:3/375: mkdir d12/d1f/d27/d7a 0 2024-04-25T02:09:07.699 INFO:tasks.workunit.client.1.smithi112.stdout:3/376: truncate d12/f19 1792996 0 2024-04-25T02:09:07.700 INFO:tasks.workunit.client.1.smithi112.stdout:1/379: link d7/c8 d7/d9/d4e/d28/d32/c71 0 2024-04-25T02:09:07.701 INFO:tasks.workunit.client.1.smithi112.stdout:1/380: chown d7/d9/d1e/l41 814526147 1 2024-04-25T02:09:07.701 INFO:tasks.workunit.client.1.smithi112.stdout:3/377: mknod d12/d1f/d27/d44/d73/c7b 0 2024-04-25T02:09:07.703 INFO:tasks.workunit.client.1.smithi112.stdout:1/381: mkdir d7/d9/d4e/d72 0 2024-04-25T02:09:07.705 INFO:tasks.workunit.client.1.smithi112.stdout:3/378: unlink d12/d1f/d27/f4b 0 2024-04-25T02:09:07.705 INFO:tasks.workunit.client.1.smithi112.stdout:9/381: write d1/df/d3c/d6c/f75 [3350232,101810] 0 2024-04-25T02:09:07.706 INFO:tasks.workunit.client.1.smithi112.stdout:1/382: mkdir d7/d9/d4e/d72/d73 0 2024-04-25T02:09:07.707 INFO:tasks.workunit.client.1.smithi112.stdout:4/375: dwrite d2/d1e/d42/f4d [0,4194304] 0 2024-04-25T02:09:07.708 INFO:tasks.workunit.client.1.smithi112.stdout:2/217: write d3/da/f2b [5522144,49205] 0 2024-04-25T02:09:07.708 INFO:tasks.workunit.client.1.smithi112.stdout:9/382: symlink d1/d48/d65/l86 0 2024-04-25T02:09:07.711 INFO:tasks.workunit.client.1.smithi112.stdout:2/218: mknod d3/da/dc/d3e/df/d32/c51 0 2024-04-25T02:09:07.711 INFO:tasks.workunit.client.1.smithi112.stdout:2/219: dread - d3/da/d18/f31 zero size 2024-04-25T02:09:07.713 INFO:tasks.workunit.client.1.smithi112.stdout:9/383: rename d1/df/d3c/d43/f6a to d1/d48/f87 0 2024-04-25T02:09:07.713 INFO:tasks.workunit.client.1.smithi112.stdout:9/384: write d1/df/d3c/d46/f78 [765093,8819] 0 2024-04-25T02:09:07.715 INFO:tasks.workunit.client.1.smithi112.stdout:1/383: write d7/d9/d1e/de/f3b [3063417,3350] 0 2024-04-25T02:09:07.715 INFO:tasks.workunit.client.1.smithi112.stdout:2/220: symlink d3/da/dc/d3e/df/d32/l52 0 2024-04-25T02:09:07.716 INFO:tasks.workunit.client.1.smithi112.stdout:9/385: mknod d1/c88 0 2024-04-25T02:09:07.717 INFO:tasks.workunit.client.1.smithi112.stdout:4/376: write d2/d17/d20/d26/d39/d49/f56 [3087325,53173] 0 2024-04-25T02:09:07.718 INFO:tasks.workunit.client.1.smithi112.stdout:1/384: truncate d7/d9/d4e/f62 292529 0 2024-04-25T02:09:07.720 INFO:tasks.workunit.client.1.smithi112.stdout:4/377: creat d2/d1e/f74 x:0 0 0 2024-04-25T02:09:07.720 INFO:tasks.workunit.client.1.smithi112.stdout:4/378: fdatasync d2/d17/d20/d26/d39/d49/f3c 0 2024-04-25T02:09:07.720 INFO:tasks.workunit.client.1.smithi112.stdout:4/379: read d2/d17/d20/d26/d39/d49/f56 [740909,29627] 0 2024-04-25T02:09:07.720 INFO:tasks.workunit.client.1.smithi112.stdout:4/380: write d2/d17/d20/d26/d39/d49/d4c/f6d [287679,58898] 0 2024-04-25T02:09:07.720 INFO:tasks.workunit.client.1.smithi112.stdout:3/379: dwrite d12/f63 [0,4194304] 0 2024-04-25T02:09:07.721 INFO:tasks.workunit.client.1.smithi112.stdout:1/385: creat d7/d9/d1f/d25/f74 x:0 0 0 2024-04-25T02:09:07.723 INFO:tasks.workunit.client.1.smithi112.stdout:4/381: truncate d2/d1e/d4b/d57/f69 925217 0 2024-04-25T02:09:07.729 INFO:tasks.workunit.client.1.smithi112.stdout:3/380: mknod d12/d13/d34/d78/c7c 0 2024-04-25T02:09:07.729 INFO:tasks.workunit.client.1.smithi112.stdout:1/386: rmdir d7/d9/d1e/d40 39 2024-04-25T02:09:07.729 INFO:tasks.workunit.client.1.smithi112.stdout:2/221: dread d3/da/f15 [0,4194304] 0 2024-04-25T02:09:07.731 INFO:tasks.workunit.client.1.smithi112.stdout:3/381: mkdir d12/d13/d34/d4a/d4f/d7d 0 2024-04-25T02:09:07.732 INFO:tasks.workunit.client.1.smithi112.stdout:1/387: rmdir d7/d9/d1f 39 2024-04-25T02:09:07.736 INFO:tasks.workunit.client.1.smithi112.stdout:2/222: mknod d3/da/dc/d3e/df/d32/c53 0 2024-04-25T02:09:07.736 INFO:tasks.workunit.client.1.smithi112.stdout:2/223: creat d3/da/dc/d3e/df/d25/f54 x:0 0 0 2024-04-25T02:09:07.738 INFO:tasks.workunit.client.1.smithi112.stdout:9/386: dwrite d1/d13/d5b/d55/f57 [0,4194304] 0 2024-04-25T02:09:07.740 INFO:tasks.workunit.client.1.smithi112.stdout:3/382: dread d12/f36 [0,4194304] 0 2024-04-25T02:09:07.745 INFO:tasks.workunit.client.1.smithi112.stdout:1/388: dread f6 [0,4194304] 0 2024-04-25T02:09:07.745 INFO:tasks.workunit.client.1.smithi112.stdout:1/389: fdatasync f4 0 2024-04-25T02:09:07.751 INFO:tasks.workunit.client.1.smithi112.stdout:2/224: creat d3/da/dc/d20/d43/f55 x:0 0 0 2024-04-25T02:09:07.755 INFO:tasks.workunit.client.1.smithi112.stdout:9/387: link d1/d13/d5b/l6e d1/d48/d65/d73/l89 0 2024-04-25T02:09:07.756 INFO:tasks.workunit.client.1.smithi112.stdout:3/383: mkdir d12/d1f/d27/d44/d7e 0 2024-04-25T02:09:07.757 INFO:tasks.workunit.client.1.smithi112.stdout:1/390: mknod d7/d9/d4e/d28/d43/c75 0 2024-04-25T02:09:07.758 INFO:tasks.workunit.client.1.smithi112.stdout:2/225: write d3/f9 [5967572,75611] 0 2024-04-25T02:09:07.758 INFO:tasks.workunit.client.1.smithi112.stdout:2/226: stat d3/da/dc/f2e 0 2024-04-25T02:09:07.758 INFO:tasks.workunit.client.1.smithi112.stdout:2/227: creat d3/da/dc/d20/d43/f56 x:0 0 0 2024-04-25T02:09:07.759 INFO:tasks.workunit.client.1.smithi112.stdout:3/384: write d12/f14 [2822389,11489] 0 2024-04-25T02:09:07.760 INFO:tasks.workunit.client.1.smithi112.stdout:3/385: fsync d12/d67/f70 0 2024-04-25T02:09:07.761 INFO:tasks.workunit.client.1.smithi112.stdout:2/228: rename d3/da/d18/l1f to d3/da/dc/d3e/l57 0 2024-04-25T02:09:07.762 INFO:tasks.workunit.client.1.smithi112.stdout:1/391: dread d7/d9/d4e/d28/d32/f4f [0,4194304] 0 2024-04-25T02:09:07.763 INFO:tasks.workunit.client.1.smithi112.stdout:9/388: rmdir d1/d13/d41 39 2024-04-25T02:09:07.766 INFO:tasks.workunit.client.1.smithi112.stdout:3/386: creat d12/d13/d34/d78/f7f x:0 0 0 2024-04-25T02:09:07.768 INFO:tasks.workunit.client.1.smithi112.stdout:1/392: rename d7/d9/d1f/d25/f74 to d7/d9/d51/d58/f76 0 2024-04-25T02:09:07.769 INFO:tasks.workunit.client.1.smithi112.stdout:1/393: write f4 [4974789,55429] 0 2024-04-25T02:09:07.769 INFO:tasks.workunit.client.1.smithi112.stdout:1/394: creat d7/d9/d1f/d25/f77 x:0 0 0 2024-04-25T02:09:07.773 INFO:tasks.workunit.client.1.smithi112.stdout:1/395: mknod d7/d9/d4e/d72/d73/c78 0 2024-04-25T02:09:07.776 INFO:tasks.workunit.client.1.smithi112.stdout:9/389: rmdir d1/d13 39 2024-04-25T02:09:07.776 INFO:tasks.workunit.client.1.smithi112.stdout:9/390: write d1/d13/f72 [987034,49296] 0 2024-04-25T02:09:07.777 INFO:tasks.workunit.client.1.smithi112.stdout:9/391: write d1/d13/d5b/d55/d63/f77 [198170,45099] 0 2024-04-25T02:09:07.777 INFO:tasks.workunit.client.1.smithi112.stdout:3/387: rmdir d12/d67 39 2024-04-25T02:09:07.779 INFO:tasks.workunit.client.1.smithi112.stdout:9/392: symlink d1/d48/l8a 0 2024-04-25T02:09:07.780 INFO:tasks.workunit.client.1.smithi112.stdout:9/393: chown d1/d13/d5b 1782361205 1 2024-04-25T02:09:07.781 INFO:tasks.workunit.client.1.smithi112.stdout:9/394: creat d1/df/d3c/d46/f8b x:0 0 0 2024-04-25T02:09:07.782 INFO:tasks.workunit.client.1.smithi112.stdout:2/229: dwrite d3/da/dc/d3e/df/d25/f54 [0,4194304] 0 2024-04-25T02:09:07.782 INFO:tasks.workunit.client.1.smithi112.stdout:2/230: creat d3/da/d18/f58 x:0 0 0 2024-04-25T02:09:07.782 INFO:tasks.workunit.client.1.smithi112.stdout:3/388: getdents d12/d1f/d27/d44 0 2024-04-25T02:09:07.782 INFO:tasks.workunit.client.1.smithi112.stdout:3/389: dread - d12/d13/d34/f60 zero size 2024-04-25T02:09:07.784 INFO:tasks.workunit.client.1.smithi112.stdout:9/395: rename d1/d13/d41/l4f to d1/d13/d5b/d55/d63/l8c 0 2024-04-25T02:09:07.784 INFO:tasks.workunit.client.1.smithi112.stdout:9/396: creat d1/df/f8d x:0 0 0 2024-04-25T02:09:07.789 INFO:tasks.workunit.client.1.smithi112.stdout:2/231: creat d3/f59 x:0 0 0 2024-04-25T02:09:07.789 INFO:tasks.workunit.client.1.smithi112.stdout:2/232: dread - d3/da/dc/d20/d43/f55 zero size 2024-04-25T02:09:07.789 INFO:tasks.workunit.client.1.smithi112.stdout:2/233: chown d3/da/dc/d20/c48 29 1 2024-04-25T02:09:07.790 INFO:tasks.workunit.client.1.smithi112.stdout:1/396: dwrite d7/d9/d4e/d28/d32/f64 [0,4194304] 0 2024-04-25T02:09:07.790 INFO:tasks.workunit.client.1.smithi112.stdout:3/390: rmdir d12/d1f/d27/d7a 0 2024-04-25T02:09:07.792 INFO:tasks.workunit.client.1.smithi112.stdout:9/397: chown d1/df/d3c/d43/c4e 8527 1 2024-04-25T02:09:07.794 INFO:tasks.workunit.client.1.smithi112.stdout:2/234: rename d3/da/dc/c50 to d3/da/dc/d3e/c5a 0 2024-04-25T02:09:07.797 INFO:tasks.workunit.client.1.smithi112.stdout:1/397: link d7/d9/d1e/d40/c5a d7/d9/d46/c79 0 2024-04-25T02:09:07.802 INFO:tasks.workunit.client.1.smithi112.stdout:1/398: link d7/d9/d4e/d28/d32/l38 d7/d9/d46/l7a 0 2024-04-25T02:09:07.804 INFO:tasks.workunit.client.1.smithi112.stdout:3/391: rmdir d12/d13/d34 39 2024-04-25T02:09:07.804 INFO:tasks.workunit.client.1.smithi112.stdout:3/392: readlink d12/d1f/d27/d44/l65 0 2024-04-25T02:09:07.809 INFO:tasks.workunit.client.1.smithi112.stdout:3/393: unlink d12/c26 0 2024-04-25T02:09:07.815 INFO:tasks.workunit.client.1.smithi112.stdout:1/399: write d7/d9/d1e/de/f65 [251361,96082] 0 2024-04-25T02:09:07.815 INFO:tasks.workunit.client.1.smithi112.stdout:9/398: dwrite d1/f10 [4194304,4194304] 0 2024-04-25T02:09:07.815 INFO:tasks.workunit.client.1.smithi112.stdout:2/235: dwrite d3/da/d18/f3f [0,4194304] 0 2024-04-25T02:09:07.815 INFO:tasks.workunit.client.1.smithi112.stdout:2/236: dread - d3/da/dc/d20/d43/f55 zero size 2024-04-25T02:09:07.817 INFO:tasks.workunit.client.1.smithi112.stdout:9/399: mkdir d1/d13/d5b/d55/d8e 0 2024-04-25T02:09:07.819 INFO:tasks.workunit.client.1.smithi112.stdout:1/400: getdents d7/d9/d51/d58 0 2024-04-25T02:09:07.821 INFO:tasks.workunit.client.1.smithi112.stdout:1/401: dread d7/f24 [0,4194304] 0 2024-04-25T02:09:07.826 INFO:tasks.workunit.client.1.smithi112.stdout:3/394: dwrite d12/d13/d34/d4a/f4c [0,4194304] 0 2024-04-25T02:09:07.826 INFO:tasks.workunit.client.1.smithi112.stdout:3/395: write d12/d13/f21 [2100880,41636] 0 2024-04-25T02:09:07.826 INFO:tasks.workunit.client.1.smithi112.stdout:2/237: rename d3/da/dc/d3e/df/d32/f35 to d3/da/dc/d20/d40/f5b 0 2024-04-25T02:09:07.828 INFO:tasks.workunit.client.1.smithi112.stdout:9/400: mkdir d1/df/d8f 0 2024-04-25T02:09:07.834 INFO:tasks.workunit.client.1.smithi112.stdout:3/396: dread d12/d13/f2e [0,4194304] 0 2024-04-25T02:09:07.834 INFO:tasks.workunit.client.1.smithi112.stdout:3/397: readlink d12/d13/d34/l5e 0 2024-04-25T02:09:07.845 INFO:tasks.workunit.client.1.smithi112.stdout:9/401: creat d1/df/d8f/f90 x:0 0 0 2024-04-25T02:09:07.845 INFO:tasks.workunit.client.1.smithi112.stdout:2/238: dwrite d3/da/d18/f3f [0,4194304] 0 2024-04-25T02:09:07.845 INFO:tasks.workunit.client.1.smithi112.stdout:1/402: mkdir d7/d4b/d7b 0 2024-04-25T02:09:07.848 INFO:tasks.workunit.client.1.smithi112.stdout:2/239: fsync d3/da/dc/d20/d40/f5b 0 2024-04-25T02:09:07.849 INFO:tasks.workunit.client.1.smithi112.stdout:3/398: mknod d12/d13/c80 0 2024-04-25T02:09:07.853 INFO:tasks.workunit.client.1.smithi112.stdout:9/402: creat d1/f91 x:0 0 0 2024-04-25T02:09:07.858 INFO:tasks.workunit.client.1.smithi112.stdout:2/240: truncate d3/da/f29 2277250 0 2024-04-25T02:09:07.859 INFO:tasks.workunit.client.1.smithi112.stdout:2/241: write d3/da/dc/d3e/f3c [56885,38984] 0 2024-04-25T02:09:07.860 INFO:tasks.workunit.client.1.smithi112.stdout:3/399: rename d12/d1f/d27/d44/c76 to d12/d13/d34/d4a/c81 0 2024-04-25T02:09:07.860 INFO:tasks.workunit.client.1.smithi112.stdout:3/400: read d12/d13/f21 [2063170,120265] 0 2024-04-25T02:09:07.860 INFO:tasks.workunit.client.1.smithi112.stdout:3/401: readlink d12/d13/d34/l5e 0 2024-04-25T02:09:07.860 INFO:tasks.workunit.client.1.smithi112.stdout:9/403: symlink d1/d13/d41/l92 0 2024-04-25T02:09:07.862 INFO:tasks.workunit.client.1.smithi112.stdout:1/403: dwrite d7/d9/d1f/f36 [0,4194304] 0 2024-04-25T02:09:07.863 INFO:tasks.workunit.client.1.smithi112.stdout:2/242: creat d3/da/dc/d3e/df/d30/f5c x:0 0 0 2024-04-25T02:09:07.863 INFO:tasks.workunit.client.1.smithi112.stdout:2/243: chown d3/da/dc/d3e/l44 887639 1 2024-04-25T02:09:07.864 INFO:tasks.workunit.client.1.smithi112.stdout:3/402: symlink d12/d13/d34/d4a/d4f/d7d/l82 0 2024-04-25T02:09:07.867 INFO:tasks.workunit.client.1.smithi112.stdout:2/244: rename d3/c11 to d3/da/dc/d20/d43/c5d 0 2024-04-25T02:09:07.868 INFO:tasks.workunit.client.1.smithi112.stdout:2/245: readlink d3/da/dc/d3e/df/d32/l4b 0 2024-04-25T02:09:07.873 INFO:tasks.workunit.client.1.smithi112.stdout:2/246: dread d3/da/f2c [0,4194304] 0 2024-04-25T02:09:07.880 INFO:tasks.workunit.client.1.smithi112.stdout:7/345: sync 2024-04-25T02:09:07.880 INFO:tasks.workunit.client.1.smithi112.stdout:0/615: sync 2024-04-25T02:09:07.880 INFO:tasks.workunit.client.1.smithi112.stdout:0/616: fsync da/d13/fa5 0 2024-04-25T02:09:07.880 INFO:tasks.workunit.client.1.smithi112.stdout:8/506: sync 2024-04-25T02:09:07.880 INFO:tasks.workunit.client.1.smithi112.stdout:5/340: sync 2024-04-25T02:09:07.880 INFO:tasks.workunit.client.1.smithi112.stdout:4/382: sync 2024-04-25T02:09:07.880 INFO:tasks.workunit.client.1.smithi112.stdout:6/386: sync 2024-04-25T02:09:07.883 INFO:tasks.workunit.client.1.smithi112.stdout:2/247: mkdir d3/da/dc/d20/d43/d5e 0 2024-04-25T02:09:07.883 INFO:tasks.workunit.client.1.smithi112.stdout:2/248: chown d3/da/dc/d3e/f3c 906799 1 2024-04-25T02:09:07.883 INFO:tasks.workunit.client.1.smithi112.stdout:2/249: creat d3/da/dc/d3e/df/d25/f5f x:0 0 0 2024-04-25T02:09:07.884 INFO:tasks.workunit.client.1.smithi112.stdout:7/346: mknod d7/d25/d43/d46/c66 0 2024-04-25T02:09:07.887 INFO:tasks.workunit.client.1.smithi112.stdout:0/617: mknod da/d1d/d2e/d40/cc2 0 2024-04-25T02:09:07.887 INFO:tasks.workunit.client.1.smithi112.stdout:0/618: chown da/d1d/d2e/d40/d49/d4f/f51 383001 1 2024-04-25T02:09:07.889 INFO:tasks.workunit.client.1.smithi112.stdout:3/403: dwrite d12/d13/f42 [0,4194304] 0 2024-04-25T02:09:07.889 INFO:tasks.workunit.client.1.smithi112.stdout:1/404: dwrite d7/d9/d4e/d28/d3f/f53 [0,4194304] 0 2024-04-25T02:09:07.889 INFO:tasks.workunit.client.1.smithi112.stdout:1/405: write d7/d9/d1f/d25/f77 [475127,122496] 0 2024-04-25T02:09:07.890 INFO:tasks.workunit.client.1.smithi112.stdout:8/507: mknod d15/cad 0 2024-04-25T02:09:07.890 INFO:tasks.workunit.client.1.smithi112.stdout:8/508: creat d15/d35/fae x:0 0 0 2024-04-25T02:09:07.893 INFO:tasks.workunit.client.1.smithi112.stdout:5/341: creat d1/d16/f73 x:0 0 0 2024-04-25T02:09:07.894 INFO:tasks.workunit.client.1.smithi112.stdout:4/383: rename d2/c3 to d2/d17/d25/d3f/c75 0 2024-04-25T02:09:07.894 INFO:tasks.workunit.client.1.smithi112.stdout:1/406: dread d7/d9/d4e/f37 [0,4194304] 0 2024-04-25T02:09:07.896 INFO:tasks.workunit.client.1.smithi112.stdout:6/387: dread d0/d2/d4/f4f [0,4194304] 0 2024-04-25T02:09:07.908 INFO:tasks.workunit.client.1.smithi112.stdout:5/342: creat d1/d2/f74 x:0 0 0 2024-04-25T02:09:07.912 INFO:tasks.workunit.client.1.smithi112.stdout:2/250: rename d3/da/dc/d3e/df/c13 to d3/da/dc/d3e/df/d25/c60 0 2024-04-25T02:09:07.914 INFO:tasks.workunit.client.1.smithi112.stdout:4/384: link d2/d1e/f74 d2/d1e/d5c/f76 0 2024-04-25T02:09:07.916 INFO:tasks.workunit.client.1.smithi112.stdout:4/385: dread d2/d12/d22/f48 [0,4194304] 0 2024-04-25T02:09:07.916 INFO:tasks.workunit.client.1.smithi112.stdout:4/386: fsync d2/d17/d20/d26/d39/f68 0 2024-04-25T02:09:07.916 INFO:tasks.workunit.client.1.smithi112.stdout:3/404: dwrite d12/d1f/f79 [0,4194304] 0 2024-04-25T02:09:07.916 INFO:tasks.workunit.client.1.smithi112.stdout:8/509: dwrite d15/d17/d1a/f62 [0,4194304] 0 2024-04-25T02:09:07.918 INFO:tasks.workunit.client.1.smithi112.stdout:1/407: unlink d7/d9/d1f/f54 0 2024-04-25T02:09:07.919 INFO:tasks.workunit.client.1.smithi112.stdout:6/388: unlink d0/d2/d2c/c55 0 2024-04-25T02:09:07.920 INFO:tasks.workunit.client.1.smithi112.stdout:7/347: rmdir d7/d25/d40 39 2024-04-25T02:09:07.921 INFO:tasks.workunit.client.1.smithi112.stdout:0/619: getdents da 0 2024-04-25T02:09:07.922 INFO:tasks.workunit.client.1.smithi112.stdout:0/620: readlink da/d1d/d88/d78/la7 0 2024-04-25T02:09:07.922 INFO:tasks.workunit.client.1.smithi112.stdout:0/621: readlink da/d1d/d2e/d40/d49/d4f/l66 0 2024-04-25T02:09:07.923 INFO:tasks.workunit.client.1.smithi112.stdout:5/343: rename d1/d16/f20 to d1/d16/f75 0 2024-04-25T02:09:07.924 INFO:tasks.workunit.client.1.smithi112.stdout:7/348: read d7/f16 [1093009,34855] 0 2024-04-25T02:09:07.924 INFO:tasks.workunit.client.1.smithi112.stdout:2/251: symlink d3/da/dc/d20/l61 0 2024-04-25T02:09:07.924 INFO:tasks.workunit.client.1.smithi112.stdout:2/252: fsync d3/da/d18/f2f 0 2024-04-25T02:09:07.925 INFO:tasks.workunit.client.1.smithi112.stdout:1/408: dread d7/d9/f16 [0,4194304] 0 2024-04-25T02:09:07.926 INFO:tasks.workunit.client.1.smithi112.stdout:4/387: mknod d2/d1e/d4b/c77 0 2024-04-25T02:09:07.926 INFO:tasks.workunit.client.1.smithi112.stdout:7/349: write d7/d25/d37/d53/f64 [861099,99958] 0 2024-04-25T02:09:07.926 INFO:tasks.workunit.client.1.smithi112.stdout:7/350: write d7/f13 [241752,20577] 0 2024-04-25T02:09:07.927 INFO:tasks.workunit.client.1.smithi112.stdout:7/351: write d7/f17 [536081,110812] 0 2024-04-25T02:09:07.929 INFO:tasks.workunit.client.1.smithi112.stdout:4/388: dread d2/d17/d20/d5e/f2b [0,4194304] 0 2024-04-25T02:09:07.929 INFO:tasks.workunit.client.1.smithi112.stdout:4/389: write d2/d12/f19 [5009406,106112] 0 2024-04-25T02:09:07.934 INFO:tasks.workunit.client.1.smithi112.stdout:6/389: mknod d0/d7b/c8b 0 2024-04-25T02:09:07.936 INFO:tasks.workunit.client.1.smithi112.stdout:1/409: write f2 [1658516,32193] 0 2024-04-25T02:09:07.938 INFO:tasks.workunit.client.1.smithi112.stdout:0/622: unlink da/d1d/d88/d78/f79 0 2024-04-25T02:09:07.939 INFO:tasks.workunit.client.1.smithi112.stdout:5/344: mkdir d1/d3f/d76 0 2024-04-25T02:09:07.944 INFO:tasks.workunit.client.1.smithi112.stdout:4/390: dwrite d2/d1e/d42/f47 [0,4194304] 0 2024-04-25T02:09:07.946 INFO:tasks.workunit.client.1.smithi112.stdout:7/352: truncate d7/f27 1768572 0 2024-04-25T02:09:07.949 INFO:tasks.workunit.client.1.smithi112.stdout:8/510: rmdir d15/d17/d1a 39 2024-04-25T02:09:07.949 INFO:tasks.workunit.client.1.smithi112.stdout:8/511: stat d15/d35/d5c/d5e/d94/laa 0 2024-04-25T02:09:07.950 INFO:tasks.workunit.client.1.smithi112.stdout:3/405: truncate d12/d13/f30 4091566 0 2024-04-25T02:09:07.951 INFO:tasks.workunit.client.1.smithi112.stdout:3/406: write d12/d1f/d27/d44/f68 [4608983,1284] 0 2024-04-25T02:09:07.954 INFO:tasks.workunit.client.1.smithi112.stdout:6/390: mknod d0/d32/c8c 0 2024-04-25T02:09:07.956 INFO:tasks.workunit.client.1.smithi112.stdout:5/345: dwrite d1/f6 [0,4194304] 0 2024-04-25T02:09:07.961 INFO:tasks.workunit.client.1.smithi112.stdout:5/346: dread d1/f3b [0,4194304] 0 2024-04-25T02:09:07.961 INFO:tasks.workunit.client.1.smithi112.stdout:1/410: link d7/d9/d1f/f36 d7/d9/d4e/d28/d3f/f7c 0 2024-04-25T02:09:07.961 INFO:tasks.workunit.client.1.smithi112.stdout:1/411: write f4 [6343973,95631] 0 2024-04-25T02:09:07.965 INFO:tasks.workunit.client.1.smithi112.stdout:0/623: creat da/d1d/d2e/dbd/fc3 x:0 0 0 2024-04-25T02:09:07.965 INFO:tasks.workunit.client.1.smithi112.stdout:0/624: write da/f32 [292807,67411] 0 2024-04-25T02:09:07.969 INFO:tasks.workunit.client.1.smithi112.stdout:1/412: dread d7/d9/d4e/d28/d32/f68 [0,4194304] 0 2024-04-25T02:09:07.969 INFO:tasks.workunit.client.1.smithi112.stdout:1/413: chown d7/d9/d46/l7a 5380 1 2024-04-25T02:09:07.969 INFO:tasks.workunit.client.1.smithi112.stdout:1/414: chown d7/d4b/d7b 73 1 2024-04-25T02:09:07.971 INFO:tasks.workunit.client.1.smithi112.stdout:4/391: unlink d2/d17/c40 0 2024-04-25T02:09:07.971 INFO:tasks.workunit.client.1.smithi112.stdout:5/347: write d1/d16/f75 [2394832,106617] 0 2024-04-25T02:09:07.972 INFO:tasks.workunit.client.1.smithi112.stdout:0/625: dread da/d1d/d2e/d40/f41 [0,4194304] 0 2024-04-25T02:09:07.975 INFO:tasks.workunit.client.1.smithi112.stdout:2/253: mkdir d3/d62 0 2024-04-25T02:09:07.977 INFO:tasks.workunit.client.1.smithi112.stdout:7/353: symlink d7/dd/d20/l67 0 2024-04-25T02:09:07.977 INFO:tasks.workunit.client.1.smithi112.stdout:7/354: chown d7/d25/d40/f62 46 1 2024-04-25T02:09:07.977 INFO:tasks.workunit.client.1.smithi112.stdout:7/355: creat d7/d25/d43/d46/f68 x:0 0 0 2024-04-25T02:09:07.977 INFO:tasks.workunit.client.1.smithi112.stdout:7/356: chown d7/ca 457564088 1 2024-04-25T02:09:07.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:07 smithi077 ceph-mon[26330]: pgmap v263: 65 pgs: 65 active+clean; 2.5 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 167 MiB/s rd, 221 MiB/s wr, 343 op/s 2024-04-25T02:09:07.980 INFO:tasks.workunit.client.1.smithi112.stdout:8/512: symlink d15/d35/d5c/d91/d78/laf 0 2024-04-25T02:09:07.982 INFO:tasks.workunit.client.1.smithi112.stdout:3/407: rmdir d12/d1f/d27/d44/d73 39 2024-04-25T02:09:07.986 INFO:tasks.workunit.client.1.smithi112.stdout:6/391: symlink d0/d32/d45/l8d 0 2024-04-25T02:09:07.986 INFO:tasks.workunit.client.1.smithi112.stdout:6/392: fsync d0/d2/d4/f7a 0 2024-04-25T02:09:07.993 INFO:tasks.workunit.client.1.smithi112.stdout:8/513: write d15/d26/f29 [4175391,1966] 0 2024-04-25T02:09:07.993 INFO:tasks.workunit.client.1.smithi112.stdout:1/415: mknod d7/d9/d4e/c7d 0 2024-04-25T02:09:07.993 INFO:tasks.workunit.client.1.smithi112.stdout:1/416: truncate d7/d9/d1e/d40/f57 1537578 0 2024-04-25T02:09:07.993 INFO:tasks.workunit.client.1.smithi112.stdout:0/626: dwrite da/d13/d1e/f3f [0,4194304] 0 2024-04-25T02:09:07.993 INFO:tasks.workunit.client.1.smithi112.stdout:0/627: write da/f26 [2982549,53033] 0 2024-04-25T02:09:07.996 INFO:tasks.workunit.client.1.smithi112.stdout:6/393: write d0/f2b [7193786,7433] 0 2024-04-25T02:09:07.996 INFO:tasks.workunit.client.1.smithi112.stdout:6/394: write d0/d2/d3b/f6f [752537,14183] 0 2024-04-25T02:09:07.997 INFO:tasks.workunit.client.1.smithi112.stdout:4/392: symlink d2/d1e/d1b/d65/l78 0 2024-04-25T02:09:08.002 INFO:tasks.workunit.client.1.smithi112.stdout:3/408: dwrite d12/d1f/f32 [0,4194304] 0 2024-04-25T02:09:08.002 INFO:tasks.workunit.client.1.smithi112.stdout:3/409: chown d12/d13/d34/d4a/f6b 346056331 1 2024-04-25T02:09:08.002 INFO:tasks.workunit.client.1.smithi112.stdout:3/410: write d12/d13/f4e [591647,103824] 0 2024-04-25T02:09:08.002 INFO:tasks.workunit.client.1.smithi112.stdout:2/254: rename d3/da/dc/d3e/df/d42/l4d to d3/da/dc/d20/d40/l63 0 2024-04-25T02:09:08.013 INFO:tasks.workunit.client.1.smithi112.stdout:7/357: symlink d7/dd/d20/d2c/l69 0 2024-04-25T02:09:08.017 INFO:tasks.workunit.client.1.smithi112.stdout:7/358: write d7/dd/f18 [2765875,20154] 0 2024-04-25T02:09:08.018 INFO:tasks.workunit.client.1.smithi112.stdout:4/393: dwrite d2/d12/f44 [0,4194304] 0 2024-04-25T02:09:08.018 INFO:tasks.workunit.client.1.smithi112.stdout:2/255: dwrite d3/da/dc/d3e/df/d25/f5f [0,4194304] 0 2024-04-25T02:09:08.019 INFO:tasks.workunit.client.1.smithi112.stdout:2/256: write d3/da/dc/d3e/df/d25/f37 [4685803,128806] 0 2024-04-25T02:09:08.021 INFO:tasks.workunit.client.1.smithi112.stdout:8/514: unlink d15/l21 0 2024-04-25T02:09:08.023 INFO:tasks.workunit.client.1.smithi112.stdout:1/417: creat d7/d9/d1e/d66/f7e x:0 0 0 2024-04-25T02:09:08.026 INFO:tasks.workunit.client.1.smithi112.stdout:6/395: creat d0/d2/d2c/f8e x:0 0 0 2024-04-25T02:09:08.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:07 smithi112 ceph-mon[33313]: pgmap v263: 65 pgs: 65 active+clean; 2.5 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 167 MiB/s rd, 221 MiB/s wr, 343 op/s 2024-04-25T02:09:08.032 INFO:tasks.workunit.client.1.smithi112.stdout:3/411: mkdir d12/d13/d34/d78/d83 0 2024-04-25T02:09:08.033 INFO:tasks.workunit.client.1.smithi112.stdout:8/515: write d15/d26/d37/f38 [1850899,125386] 0 2024-04-25T02:09:08.033 INFO:tasks.workunit.client.1.smithi112.stdout:8/516: write d15/d35/d56/f96 [702899,34513] 0 2024-04-25T02:09:08.033 INFO:tasks.workunit.client.1.smithi112.stdout:8/517: readlink d15/d40/l77 0 2024-04-25T02:09:08.033 INFO:tasks.workunit.client.1.smithi112.stdout:8/518: readlink d15/d35/d5c/d5e/lac 0 2024-04-25T02:09:08.034 INFO:tasks.workunit.client.1.smithi112.stdout:7/359: mknod d7/d25/d40/d51/c6a 0 2024-04-25T02:09:08.037 INFO:tasks.workunit.client.1.smithi112.stdout:2/257: dwrite d3/da/f29 [0,4194304] 0 2024-04-25T02:09:08.039 INFO:tasks.workunit.client.1.smithi112.stdout:4/394: rename d2/d17/d25/d3f/c75 to d2/d1e/d1b/d67/c79 0 2024-04-25T02:09:08.039 INFO:tasks.workunit.client.1.smithi112.stdout:4/395: chown d2/d17/d20/d5e/f2b 68 1 2024-04-25T02:09:08.050 INFO:tasks.workunit.client.1.smithi112.stdout:1/418: mkdir d7/d4b/d7b/d7f 0 2024-04-25T02:09:08.050 INFO:tasks.workunit.client.1.smithi112.stdout:7/360: dwrite d7/dd/d20/d2c/f45 [0,4194304] 0 2024-04-25T02:09:08.050 INFO:tasks.workunit.client.1.smithi112.stdout:7/361: write d7/d25/d37/f5e [102330,99465] 0 2024-04-25T02:09:08.052 INFO:tasks.workunit.client.1.smithi112.stdout:2/258: truncate d3/da/dc/d3e/f47 3323682 0 2024-04-25T02:09:08.052 INFO:tasks.workunit.client.1.smithi112.stdout:2/259: dread - d3/da/d18/f31 zero size 2024-04-25T02:09:08.054 INFO:tasks.workunit.client.1.smithi112.stdout:6/396: rename d0/d32/c44 to d0/d2/d66/d7d/c8f 0 2024-04-25T02:09:08.054 INFO:tasks.workunit.client.1.smithi112.stdout:6/397: read d0/f30 [953517,85690] 0 2024-04-25T02:09:08.055 INFO:tasks.workunit.client.1.smithi112.stdout:4/396: unlink d2/d1e/d1b/l70 0 2024-04-25T02:09:08.057 INFO:tasks.workunit.client.1.smithi112.stdout:1/419: mknod d7/d9/d1e/d40/c80 0 2024-04-25T02:09:08.057 INFO:tasks.workunit.client.1.smithi112.stdout:3/412: getdents d12/d5d 0 2024-04-25T02:09:08.057 INFO:tasks.workunit.client.1.smithi112.stdout:3/413: readlink d12/l69 0 2024-04-25T02:09:08.063 INFO:tasks.workunit.client.1.smithi112.stdout:8/519: symlink d15/d17/d1a/lb0 0 2024-04-25T02:09:08.067 INFO:tasks.workunit.client.1.smithi112.stdout:4/397: dread d2/d17/d20/d26/d39/d49/d4c/f72 [0,4194304] 0 2024-04-25T02:09:08.069 INFO:tasks.workunit.client.1.smithi112.stdout:1/420: mknod d7/d9/d4e/c81 0 2024-04-25T02:09:08.069 INFO:tasks.workunit.client.1.smithi112.stdout:1/421: write f2 [2527757,1498] 0 2024-04-25T02:09:08.072 INFO:tasks.workunit.client.1.smithi112.stdout:4/398: mknod d2/d17/d20/d5e/c7a 0 2024-04-25T02:09:08.074 INFO:tasks.workunit.client.1.smithi112.stdout:8/520: getdents d15/d26 0 2024-04-25T02:09:08.105 INFO:tasks.workunit.client.1.smithi112.stdout:2/260: dread d3/da/dc/d3e/df/d25/f5f [0,4194304] 0 2024-04-25T02:09:08.105 INFO:tasks.workunit.client.1.smithi112.stdout:2/261: write d3/da/dc/d3e/df/d25/f5f [4981099,9078] 0 2024-04-25T02:09:08.106 INFO:tasks.workunit.client.1.smithi112.stdout:2/262: stat d3/da/f15 0 2024-04-25T02:09:08.112 INFO:tasks.workunit.client.1.smithi112.stdout:2/263: unlink d3/da/dc/d20/d40/f4c 0 2024-04-25T02:09:08.123 INFO:tasks.workunit.client.1.smithi112.stdout:2/264: dread d3/da/dc/d3e/df/d25/f54 [0,4194304] 0 2024-04-25T02:09:08.129 INFO:tasks.workunit.client.1.smithi112.stdout:3/414: dwrite d12/d67/f70 [0,4194304] 0 2024-04-25T02:09:08.129 INFO:tasks.workunit.client.1.smithi112.stdout:8/521: dwrite d15/d17/f23 [4194304,4194304] 0 2024-04-25T02:09:08.129 INFO:tasks.workunit.client.1.smithi112.stdout:7/362: dwrite d7/d25/d37/f5e [0,4194304] 0 2024-04-25T02:09:08.133 INFO:tasks.workunit.client.1.smithi112.stdout:3/415: creat d12/d13/d34/d4a/f84 x:0 0 0 2024-04-25T02:09:08.133 INFO:tasks.workunit.client.1.smithi112.stdout:3/416: fsync d12/d13/f30 0 2024-04-25T02:09:08.133 INFO:tasks.workunit.client.1.smithi112.stdout:2/265: dread d3/da/f15 [0,4194304] 0 2024-04-25T02:09:08.133 INFO:tasks.workunit.client.1.smithi112.stdout:2/266: fdatasync d3/da/f2c 0 2024-04-25T02:09:08.134 INFO:tasks.workunit.client.1.smithi112.stdout:8/522: mkdir d15/d26/d37/db1 0 2024-04-25T02:09:08.135 INFO:tasks.workunit.client.1.smithi112.stdout:7/363: mkdir d7/d25/d40/d6b 0 2024-04-25T02:09:08.138 INFO:tasks.workunit.client.1.smithi112.stdout:2/267: unlink d3/da/f29 0 2024-04-25T02:09:08.138 INFO:tasks.workunit.client.1.smithi112.stdout:2/268: stat d3/f9 0 2024-04-25T02:09:08.142 INFO:tasks.workunit.client.1.smithi112.stdout:8/523: getdents d15/d35/d5c/d5e 0 2024-04-25T02:09:08.143 INFO:tasks.workunit.client.1.smithi112.stdout:7/364: creat d7/d25/d40/d51/f6c x:0 0 0 2024-04-25T02:09:08.145 INFO:tasks.workunit.client.1.smithi112.stdout:3/417: link d12/d1f/f33 d12/d13/d34/d53/f85 0 2024-04-25T02:09:08.148 INFO:tasks.workunit.client.1.smithi112.stdout:2/269: mknod d3/da/dc/d3e/c64 0 2024-04-25T02:09:08.148 INFO:tasks.workunit.client.1.smithi112.stdout:2/270: chown d3/da/d18/f58 4095623 1 2024-04-25T02:09:08.149 INFO:tasks.workunit.client.1.smithi112.stdout:8/524: creat d15/d26/d4f/fb2 x:0 0 0 2024-04-25T02:09:08.152 INFO:tasks.workunit.client.1.smithi112.stdout:7/365: link d7/dd/f18 d7/d25/d37/f6d 0 2024-04-25T02:09:08.153 INFO:tasks.workunit.client.1.smithi112.stdout:2/271: symlink d3/d62/l65 0 2024-04-25T02:09:08.161 INFO:tasks.workunit.client.1.smithi112.stdout:8/525: rename d15/d35/f5d to d15/d17/d1a/fb3 0 2024-04-25T02:09:08.165 INFO:tasks.workunit.client.1.smithi112.stdout:2/272: rename d3/da/dc/l23 to d3/da/dc/d20/l66 0 2024-04-25T02:09:08.165 INFO:tasks.workunit.client.1.smithi112.stdout:2/273: write d3/da/dc/d3e/f3c [171916,1112] 0 2024-04-25T02:09:08.166 INFO:tasks.workunit.client.1.smithi112.stdout:8/526: truncate d15/d40/f60 1116501 0 2024-04-25T02:09:08.168 INFO:tasks.workunit.client.1.smithi112.stdout:3/418: dwrite d12/d1f/f79 [0,4194304] 0 2024-04-25T02:09:08.168 INFO:tasks.workunit.client.1.smithi112.stdout:3/419: readlink d12/d13/d34/l5f 0 2024-04-25T02:09:08.168 INFO:tasks.workunit.client.1.smithi112.stdout:3/420: truncate d12/d13/d34/f48 439153 0 2024-04-25T02:09:08.168 INFO:tasks.workunit.client.1.smithi112.stdout:2/274: unlink d3/l26 0 2024-04-25T02:09:08.170 INFO:tasks.workunit.client.1.smithi112.stdout:8/527: rmdir d15/d26/d37/db1 0 2024-04-25T02:09:08.170 INFO:tasks.workunit.client.1.smithi112.stdout:8/528: chown d15/d26/d37/d8e/l7c 364658377 1 2024-04-25T02:09:08.170 INFO:tasks.workunit.client.1.smithi112.stdout:7/366: dwrite d7/dd/f10 [0,4194304] 0 2024-04-25T02:09:08.172 INFO:tasks.workunit.client.1.smithi112.stdout:3/421: mkdir d12/d13/d86 0 2024-04-25T02:09:08.174 INFO:tasks.workunit.client.1.smithi112.stdout:2/275: unlink d3/da/dc/d3e/f17 0 2024-04-25T02:09:08.178 INFO:tasks.workunit.client.1.smithi112.stdout:2/276: symlink d3/d62/l67 0 2024-04-25T02:09:08.179 INFO:tasks.workunit.client.1.smithi112.stdout:2/277: creat d3/da/dc/d20/d43/f68 x:0 0 0 2024-04-25T02:09:08.183 INFO:tasks.workunit.client.1.smithi112.stdout:2/278: creat d3/da/dc/d3e/f69 x:0 0 0 2024-04-25T02:09:08.185 INFO:tasks.workunit.client.1.smithi112.stdout:2/279: mknod d3/da/dc/c6a 0 2024-04-25T02:09:08.189 INFO:tasks.workunit.client.1.smithi112.stdout:2/280: read d3/da/dc/d3e/df/d25/f5f [2684233,51309] 0 2024-04-25T02:09:08.211 INFO:tasks.workunit.client.1.smithi112.stdout:7/367: dwrite d7/d25/d43/d46/f42 [0,4194304] 0 2024-04-25T02:09:08.211 INFO:tasks.workunit.client.1.smithi112.stdout:7/368: fdatasync d7/f61 0 2024-04-25T02:09:08.213 INFO:tasks.workunit.client.1.smithi112.stdout:3/422: dwrite d12/d13/d34/d4a/f4c [0,4194304] 0 2024-04-25T02:09:08.213 INFO:tasks.workunit.client.1.smithi112.stdout:8/529: dwrite d15/d26/f53 [4194304,4194304] 0 2024-04-25T02:09:08.214 INFO:tasks.workunit.client.1.smithi112.stdout:8/530: readlink d15/d26/d37/d8e/l7c 0 2024-04-25T02:09:08.214 INFO:tasks.workunit.client.1.smithi112.stdout:8/531: fdatasync d15/f42 0 2024-04-25T02:09:08.218 INFO:tasks.workunit.client.1.smithi112.stdout:2/281: dwrite d3/da/dc/d20/d43/f55 [0,4194304] 0 2024-04-25T02:09:08.218 INFO:tasks.workunit.client.1.smithi112.stdout:2/282: write d3/f59 [817122,62359] 0 2024-04-25T02:09:08.219 INFO:tasks.workunit.client.1.smithi112.stdout:8/532: truncate d15/d17/d1a/f33 255062 0 2024-04-25T02:09:08.219 INFO:tasks.workunit.client.1.smithi112.stdout:3/423: dread d12/d13/f1c [0,4194304] 0 2024-04-25T02:09:08.219 INFO:tasks.workunit.client.1.smithi112.stdout:3/424: stat d12/d13/d34/f60 0 2024-04-25T02:09:08.222 INFO:tasks.workunit.client.1.smithi112.stdout:2/283: rmdir d3/da/dc/d20 39 2024-04-25T02:09:08.224 INFO:tasks.workunit.client.1.smithi112.stdout:8/533: mknod d15/d40/cb4 0 2024-04-25T02:09:08.224 INFO:tasks.workunit.client.1.smithi112.stdout:8/534: fdatasync d15/d40/f49 0 2024-04-25T02:09:08.226 INFO:tasks.workunit.client.1.smithi112.stdout:3/425: rmdir d12/d1f/d27/d44 39 2024-04-25T02:09:08.227 INFO:tasks.workunit.client.1.smithi112.stdout:8/535: truncate d15/d35/d5c/f83 405761 0 2024-04-25T02:09:08.227 INFO:tasks.workunit.client.1.smithi112.stdout:8/536: write d15/d35/f98 [683119,6430] 0 2024-04-25T02:09:08.228 INFO:tasks.workunit.client.1.smithi112.stdout:3/426: mkdir d12/d13/d34/d4a/d87 0 2024-04-25T02:09:08.229 INFO:tasks.workunit.client.1.smithi112.stdout:8/537: mkdir d15/d35/d5f/db5 0 2024-04-25T02:09:08.230 INFO:tasks.workunit.client.1.smithi112.stdout:3/427: creat d12/d1f/d27/d44/d7e/f88 x:0 0 0 2024-04-25T02:09:08.231 INFO:tasks.workunit.client.1.smithi112.stdout:7/369: dwrite d7/f61 [0,4194304] 0 2024-04-25T02:09:08.231 INFO:tasks.workunit.client.1.smithi112.stdout:7/370: chown d7/d25/d43/d46/f68 840807 1 2024-04-25T02:09:08.231 INFO:tasks.workunit.client.1.smithi112.stdout:8/538: symlink d15/d35/d5c/d91/lb6 0 2024-04-25T02:09:08.234 INFO:tasks.workunit.client.1.smithi112.stdout:7/371: symlink d7/dd/d20/d36/l6e 0 2024-04-25T02:09:08.235 INFO:tasks.workunit.client.1.smithi112.stdout:7/372: write d7/dd/d20/f5c [779257,95359] 0 2024-04-25T02:09:08.235 INFO:tasks.workunit.client.1.smithi112.stdout:7/373: readlink d7/d25/d43/l5a 0 2024-04-25T02:09:08.238 INFO:tasks.workunit.client.1.smithi112.stdout:7/374: rmdir d7/d25/d43/d46 39 2024-04-25T02:09:08.242 INFO:tasks.workunit.client.1.smithi112.stdout:3/428: dread d12/f14 [0,4194304] 0 2024-04-25T02:09:08.245 INFO:tasks.workunit.client.1.smithi112.stdout:2/284: dread d3/da/dc/d3e/df/d25/f5f [0,4194304] 0 2024-04-25T02:09:08.245 INFO:tasks.workunit.client.1.smithi112.stdout:2/285: read d3/da/dc/d3e/df/d25/f5f [533984,29425] 0 2024-04-25T02:09:08.250 INFO:tasks.workunit.client.1.smithi112.stdout:3/429: rename d12/c58 to d12/d13/d34/d78/d83/c89 0 2024-04-25T02:09:08.250 INFO:tasks.workunit.client.1.smithi112.stdout:3/430: chown d12/d1f/d27/d44/f68 5934 1 2024-04-25T02:09:08.250 INFO:tasks.workunit.client.1.smithi112.stdout:3/431: write d12/d13/f2e [4225524,20582] 0 2024-04-25T02:09:08.250 INFO:tasks.workunit.client.1.smithi112.stdout:3/432: write d12/d13/f1c [1132648,105966] 0 2024-04-25T02:09:08.252 INFO:tasks.workunit.client.1.smithi112.stdout:2/286: symlink d3/da/dc/d3e/df/l6b 0 2024-04-25T02:09:08.259 INFO:tasks.workunit.client.1.smithi112.stdout:7/375: dread d7/dd/d20/f5c [0,4194304] 0 2024-04-25T02:09:08.259 INFO:tasks.workunit.client.1.smithi112.stdout:3/433: symlink d12/d13/d34/d78/l8a 0 2024-04-25T02:09:08.263 INFO:tasks.workunit.client.1.smithi112.stdout:7/376: creat d7/d25/d37/d41/f6f x:0 0 0 2024-04-25T02:09:08.265 INFO:tasks.workunit.client.1.smithi112.stdout:3/434: link d12/f19 d12/d13/d86/f8b 0 2024-04-25T02:09:08.291 INFO:tasks.workunit.client.1.smithi112.stdout:2/287: dwrite d3/da/f2b [4194304,4194304] 0 2024-04-25T02:09:08.292 INFO:tasks.workunit.client.1.smithi112.stdout:2/288: rename d3/da/dc/d3e/df/d30/f5c to d3/da/dc/d3e/df/d30/f6c 0 2024-04-25T02:09:08.292 INFO:tasks.workunit.client.1.smithi112.stdout:7/377: dwrite d7/dd/f21 [0,4194304] 0 2024-04-25T02:09:08.293 INFO:tasks.workunit.client.1.smithi112.stdout:3/435: dwrite d12/d1f/f79 [0,4194304] 0 2024-04-25T02:09:08.293 INFO:tasks.workunit.client.1.smithi112.stdout:3/436: chown d12/d1f/d27/d44/d73 37385 1 2024-04-25T02:09:08.293 INFO:tasks.workunit.client.1.smithi112.stdout:3/437: fsync d12/d1f/d27/d44/f68 0 2024-04-25T02:09:08.293 INFO:tasks.workunit.client.1.smithi112.stdout:3/438: fsync d12/d1f/d27/f28 0 2024-04-25T02:09:08.294 INFO:tasks.workunit.client.1.smithi112.stdout:7/378: creat d7/d25/d40/d6b/f70 x:0 0 0 2024-04-25T02:09:08.294 INFO:tasks.workunit.client.1.smithi112.stdout:7/379: fdatasync d7/dd/f1c 0 2024-04-25T02:09:08.295 INFO:tasks.workunit.client.1.smithi112.stdout:7/380: dread - d7/d25/d40/d6b/f70 zero size 2024-04-25T02:09:08.303 INFO:tasks.workunit.client.1.smithi112.stdout:2/289: write d3/da/d18/f3f [3144398,53860] 0 2024-04-25T02:09:08.356 INFO:tasks.workunit.client.1.smithi112.stdout:3/439: symlink d12/d1f/d27/l8c 0 2024-04-25T02:09:08.360 INFO:tasks.workunit.client.1.smithi112.stdout:7/381: creat d7/d25/d37/f71 x:0 0 0 2024-04-25T02:09:08.362 INFO:tasks.workunit.client.1.smithi112.stdout:2/290: truncate d3/da/dc/d3e/df/d25/f37 1155251 0 2024-04-25T02:09:08.368 INFO:tasks.workunit.client.1.smithi112.stdout:7/382: truncate d7/f27 500189 0 2024-04-25T02:09:08.370 INFO:tasks.workunit.client.1.smithi112.stdout:2/291: link d3/da/f15 d3/da/dc/d20/d43/d5e/f6d 0 2024-04-25T02:09:08.374 INFO:tasks.workunit.client.1.smithi112.stdout:3/440: dwrite d12/d13/f2e [0,4194304] 0 2024-04-25T02:09:08.385 INFO:tasks.workunit.client.1.smithi112.stdout:2/292: dwrite d3/da/d18/f2f [4194304,4194304] 0 2024-04-25T02:09:08.385 INFO:tasks.workunit.client.1.smithi112.stdout:2/293: write d3/da/f3a [1283082,108265] 0 2024-04-25T02:09:08.387 INFO:tasks.workunit.client.1.smithi112.stdout:2/294: rmdir d3/da/dc/d3e/df/d32 39 2024-04-25T02:09:08.388 INFO:tasks.workunit.client.1.smithi112.stdout:2/295: chown d3/da/d18/f3f 4959525 1 2024-04-25T02:09:08.388 INFO:tasks.workunit.client.1.smithi112.stdout:2/296: fsync d3/da/f1c 0 2024-04-25T02:09:08.388 INFO:tasks.workunit.client.1.smithi112.stdout:7/383: write d7/f27 [423973,60519] 0 2024-04-25T02:09:08.389 INFO:tasks.workunit.client.1.smithi112.stdout:2/297: creat d3/da/dc/d20/d40/f6e x:0 0 0 2024-04-25T02:09:08.389 INFO:tasks.workunit.client.1.smithi112.stdout:2/298: truncate d3/da/dc/f2e 916130 0 2024-04-25T02:09:08.394 INFO:tasks.workunit.client.1.smithi112.stdout:2/299: dread d3/da/dc/d3e/f3c [0,4194304] 0 2024-04-25T02:09:08.394 INFO:tasks.workunit.client.1.smithi112.stdout:2/300: truncate d3/da/dc/d3e/df/d25/f37 1455720 0 2024-04-25T02:09:08.394 INFO:tasks.workunit.client.1.smithi112.stdout:2/301: write d3/f33 [4722674,77704] 0 2024-04-25T02:09:08.398 INFO:tasks.workunit.client.1.smithi112.stdout:2/302: unlink d3/da/dc/d3e/f47 0 2024-04-25T02:09:08.400 INFO:tasks.workunit.client.1.smithi112.stdout:2/303: mknod d3/da/c6f 0 2024-04-25T02:09:08.400 INFO:tasks.workunit.client.1.smithi112.stdout:2/304: dread - d3/da/dc/d3e/df/d30/f6c zero size 2024-04-25T02:09:08.400 INFO:tasks.workunit.client.1.smithi112.stdout:7/384: dread d7/dd/f30 [0,4194304] 0 2024-04-25T02:09:08.426 INFO:tasks.workunit.client.1.smithi112.stdout:2/305: dwrite d3/da/dc/d3e/df/d25/f46 [0,4194304] 0 2024-04-25T02:09:08.426 INFO:tasks.workunit.client.1.smithi112.stdout:7/385: dwrite d7/dd/f10 [0,4194304] 0 2024-04-25T02:09:08.428 INFO:tasks.workunit.client.1.smithi112.stdout:2/306: fdatasync d3/f33 0 2024-04-25T02:09:08.428 INFO:tasks.workunit.client.1.smithi112.stdout:2/307: write d3/da/dc/d20/d43/f56 [305885,93708] 0 2024-04-25T02:09:08.428 INFO:tasks.workunit.client.1.smithi112.stdout:2/308: write d3/da/d18/f58 [244398,59900] 0 2024-04-25T02:09:08.436 INFO:tasks.workunit.client.1.smithi112.stdout:2/309: rmdir d3/da/dc/d3e 39 2024-04-25T02:09:08.436 INFO:tasks.workunit.client.1.smithi112.stdout:2/310: chown d3/da/f1c 7792 1 2024-04-25T02:09:08.441 INFO:tasks.workunit.client.1.smithi112.stdout:2/311: fdatasync d3/da/f3a 0 2024-04-25T02:09:08.441 INFO:tasks.workunit.client.1.smithi112.stdout:7/386: dwrite d7/d25/d43/f60 [0,4194304] 0 2024-04-25T02:09:08.454 INFO:tasks.workunit.client.1.smithi112.stdout:7/387: dwrite d7/f16 [0,4194304] 0 2024-04-25T02:09:08.462 INFO:tasks.workunit.client.1.smithi112.stdout:2/312: creat d3/da/f70 x:0 0 0 2024-04-25T02:09:08.481 INFO:tasks.workunit.client.1.smithi112.stdout:7/388: link d7/dd/f21 d7/f72 0 2024-04-25T02:09:08.483 INFO:tasks.workunit.client.1.smithi112.stdout:2/313: rmdir d3/da/dc/d3e/df/d25 39 2024-04-25T02:09:08.487 INFO:tasks.workunit.client.1.smithi112.stdout:2/314: mkdir d3/da/dc/d3e/df/d71 0 2024-04-25T02:09:08.496 INFO:tasks.workunit.client.1.smithi112.stdout:7/389: dwrite d7/dd/f1c [0,4194304] 0 2024-04-25T02:09:08.498 INFO:tasks.workunit.client.1.smithi112.stdout:2/315: rmdir d3/da/dc/d3e/df/d42 0 2024-04-25T02:09:08.514 INFO:tasks.workunit.client.1.smithi112.stdout:2/316: dwrite d3/da/dc/d20/d40/f6e [0,4194304] 0 2024-04-25T02:09:08.516 INFO:tasks.workunit.client.1.smithi112.stdout:2/317: truncate d3/da/f2b 3609920 0 2024-04-25T02:09:08.521 INFO:tasks.workunit.client.1.smithi112.stdout:7/390: dwrite d7/d25/d43/d46/f42 [0,4194304] 0 2024-04-25T02:09:08.542 INFO:tasks.workunit.client.1.smithi112.stdout:2/318: dwrite d3/da/d18/f3f [0,4194304] 0 2024-04-25T02:09:08.542 INFO:tasks.workunit.client.1.smithi112.stdout:2/319: write d3/da/f1c [4580547,93130] 0 2024-04-25T02:09:08.543 INFO:tasks.workunit.client.1.smithi112.stdout:7/391: dwrite d7/d25/d40/d6b/f70 [0,4194304] 0 2024-04-25T02:09:08.544 INFO:tasks.workunit.client.1.smithi112.stdout:2/320: fdatasync d3/da/f1c 0 2024-04-25T02:09:08.544 INFO:tasks.workunit.client.1.smithi112.stdout:2/321: chown d3/da/dc/d3e/df/d32/l4b 2 1 2024-04-25T02:09:08.547 INFO:tasks.workunit.client.1.smithi112.stdout:7/392: dread d7/f19 [0,4194304] 0 2024-04-25T02:09:08.547 INFO:tasks.workunit.client.1.smithi112.stdout:7/393: chown d7/d25/d40/d51/f6c 771 1 2024-04-25T02:09:08.547 INFO:tasks.workunit.client.1.smithi112.stdout:7/394: chown d7/dd/f4a 29895 1 2024-04-25T02:09:08.547 INFO:tasks.workunit.client.1.smithi112.stdout:2/322: rmdir d3/d62 39 2024-04-25T02:09:08.548 INFO:tasks.workunit.client.1.smithi112.stdout:7/395: mknod d7/d25/d40/d6b/c73 0 2024-04-25T02:09:08.550 INFO:tasks.workunit.client.1.smithi112.stdout:2/323: mkdir d3/da/dc/d3e/df/d25/d72 0 2024-04-25T02:09:08.551 INFO:tasks.workunit.client.1.smithi112.stdout:2/324: creat d3/f73 x:0 0 0 2024-04-25T02:09:08.563 INFO:tasks.workunit.client.1.smithi112.stdout:7/396: dwrite d7/d25/d37/f6d [0,4194304] 0 2024-04-25T02:09:08.564 INFO:tasks.workunit.client.1.smithi112.stdout:7/397: mkdir d7/d25/d37/d74 0 2024-04-25T02:09:08.564 INFO:tasks.workunit.client.1.smithi112.stdout:7/398: fsync d7/d25/d43/f47 0 2024-04-25T02:09:08.565 INFO:tasks.workunit.client.1.smithi112.stdout:7/399: creat d7/d25/d43/f75 x:0 0 0 2024-04-25T02:09:08.565 INFO:tasks.workunit.client.1.smithi112.stdout:7/400: write d7/d25/d40/d51/f6c [4912,87006] 0 2024-04-25T02:09:08.565 INFO:tasks.workunit.client.1.smithi112.stdout:7/401: creat d7/f76 x:0 0 0 2024-04-25T02:09:08.579 INFO:tasks.workunit.client.1.smithi112.stdout:7/402: dwrite d7/d25/d37/f5e [0,4194304] 0 2024-04-25T02:09:08.585 INFO:tasks.workunit.client.1.smithi112.stdout:7/403: dread d7/dd/f30 [0,4194304] 0 2024-04-25T02:09:08.585 INFO:tasks.workunit.client.1.smithi112.stdout:7/404: stat d7/dd/f4a 0 2024-04-25T02:09:08.587 INFO:tasks.workunit.client.1.smithi112.stdout:7/405: mkdir d7/d25/d40/d51/d77 0 2024-04-25T02:09:08.587 INFO:tasks.workunit.client.1.smithi112.stdout:7/406: stat d7 0 2024-04-25T02:09:08.587 INFO:tasks.workunit.client.1.smithi112.stdout:7/407: chown d7/d25/f2d 157 1 2024-04-25T02:09:08.590 INFO:tasks.workunit.client.1.smithi112.stdout:7/408: rmdir d7/d25/d37/d53 39 2024-04-25T02:09:08.591 INFO:tasks.workunit.client.1.smithi112.stdout:7/409: symlink d7/dd/d20/d36/l78 0 2024-04-25T02:09:08.593 INFO:tasks.workunit.client.1.smithi112.stdout:7/410: mkdir d7/d79 0 2024-04-25T02:09:08.593 INFO:tasks.workunit.client.1.smithi112.stdout:7/411: stat d7/d25/d37/d53/f56 0 2024-04-25T02:09:08.593 INFO:tasks.workunit.client.1.smithi112.stdout:7/412: fsync d7/f76 0 2024-04-25T02:09:08.593 INFO:tasks.workunit.client.1.smithi112.stdout:7/413: chown d7/dd/f1d 12188 1 2024-04-25T02:09:08.593 INFO:tasks.workunit.client.1.smithi112.stdout:7/414: write d7/d25/d37/d53/f64 [730941,109554] 0 2024-04-25T02:09:08.594 INFO:tasks.workunit.client.1.smithi112.stdout:7/415: mknod d7/dd/c7a 0 2024-04-25T02:09:08.596 INFO:tasks.workunit.client.1.smithi112.stdout:7/416: getdents d7/dd/d20/d36/d3a 0 2024-04-25T02:09:08.597 INFO:tasks.workunit.client.1.smithi112.stdout:7/417: write d7/fc [407385,102986] 0 2024-04-25T02:09:08.597 INFO:tasks.workunit.client.1.smithi112.stdout:7/418: chown d7/dd/d20/d2c/l69 183 1 2024-04-25T02:09:08.597 INFO:tasks.workunit.client.1.smithi112.stdout:7/419: chown d7/f19 8034 1 2024-04-25T02:09:08.599 INFO:tasks.workunit.client.1.smithi112.stdout:7/420: rename d7/f24 to d7/d25/d40/d6b/f7b 0 2024-04-25T02:09:08.599 INFO:tasks.workunit.client.1.smithi112.stdout:7/421: chown d7/d25/d43/d46 0 1 2024-04-25T02:09:08.601 INFO:tasks.workunit.client.1.smithi112.stdout:7/422: rename d7/f1f to d7/dd/d20/d36/f7c 0 2024-04-25T02:09:08.601 INFO:tasks.workunit.client.1.smithi112.stdout:7/423: write d7/fc [119610,58566] 0 2024-04-25T02:09:08.603 INFO:tasks.workunit.client.1.smithi112.stdout:7/424: symlink d7/d25/d37/d41/l7d 0 2024-04-25T02:09:08.603 INFO:tasks.workunit.client.1.smithi112.stdout:7/425: fdatasync d7/dd/d20/d2c/f45 0 2024-04-25T02:09:08.603 INFO:tasks.workunit.client.1.smithi112.stdout:7/426: readlink d7/dd/d20/d36/l78 0 2024-04-25T02:09:08.604 INFO:tasks.workunit.client.1.smithi112.stdout:7/427: mknod d7/dd/d20/d36/c7e 0 2024-04-25T02:09:08.606 INFO:tasks.workunit.client.1.smithi112.stdout:7/428: fdatasync d7/f17 0 2024-04-25T02:09:08.608 INFO:tasks.workunit.client.1.smithi112.stdout:7/429: getdents d7/d25/d43 0 2024-04-25T02:09:08.611 INFO:tasks.workunit.client.1.smithi112.stdout:7/430: mkdir d7/d25/d37/d7f 0 2024-04-25T02:09:08.620 INFO:tasks.workunit.client.1.smithi112.stdout:7/431: dread d7/d25/d40/d6b/f70 [0,4194304] 0 2024-04-25T02:09:08.639 INFO:tasks.workunit.client.1.smithi112.stdout:7/432: dwrite d7/f27 [0,4194304] 0 2024-04-25T02:09:08.728 INFO:tasks.workunit.client.1.smithi112.stdout:0/628: sync 2024-04-25T02:09:08.728 INFO:tasks.workunit.client.1.smithi112.stdout:9/404: sync 2024-04-25T02:09:08.729 INFO:tasks.workunit.client.1.smithi112.stdout:5/348: sync 2024-04-25T02:09:08.729 INFO:tasks.workunit.client.1.smithi112.stdout:5/349: creat d1/d2/d28/f77 x:0 0 0 2024-04-25T02:09:08.729 INFO:tasks.workunit.client.1.smithi112.stdout:9/405: write d1/d13/d41/f4c [531572,116310] 0 2024-04-25T02:09:08.729 INFO:tasks.workunit.client.1.smithi112.stdout:5/350: fsync d1/d16/d22/f4b 0 2024-04-25T02:09:08.734 INFO:tasks.workunit.client.1.smithi112.stdout:9/406: mkdir d1/d93 0 2024-04-25T02:09:08.734 INFO:tasks.workunit.client.1.smithi112.stdout:9/407: readlink d1/d48/l5f 0 2024-04-25T02:09:08.738 INFO:tasks.workunit.client.1.smithi112.stdout:5/351: mkdir d1/d2/d78 0 2024-04-25T02:09:08.742 INFO:tasks.workunit.client.1.smithi112.stdout:5/352: chown d1/d2/f43 958357882 1 2024-04-25T02:09:08.742 INFO:tasks.workunit.client.1.smithi112.stdout:5/353: fdatasync d1/f3b 0 2024-04-25T02:09:08.742 INFO:tasks.workunit.client.1.smithi112.stdout:5/354: write d1/d41/f6d [250843,48566] 0 2024-04-25T02:09:08.743 INFO:tasks.workunit.client.1.smithi112.stdout:9/408: read d1/f10 [7364988,76808] 0 2024-04-25T02:09:08.743 INFO:tasks.workunit.client.1.smithi112.stdout:9/409: truncate d1/f7a 445728 0 2024-04-25T02:09:08.744 INFO:tasks.workunit.client.1.smithi112.stdout:0/629: dwrite da/d1d/d2e/d40/d49/d6b/d90/fac [0,4194304] 0 2024-04-25T02:09:08.744 INFO:tasks.workunit.client.1.smithi112.stdout:0/630: chown da/d1d/d2e/d40/d49/d4f/d82/fa0 0 1 2024-04-25T02:09:08.744 INFO:tasks.workunit.client.1.smithi112.stdout:0/631: getdents da/d1d/d2e/d40/d49/d6b/dc1 0 2024-04-25T02:09:08.744 INFO:tasks.workunit.client.1.smithi112.stdout:9/410: read d1/d13/f18 [153664,77104] 0 2024-04-25T02:09:08.745 INFO:tasks.workunit.client.1.smithi112.stdout:5/355: dread d1/d16/f4d [0,4194304] 0 2024-04-25T02:09:08.745 INFO:tasks.workunit.client.1.smithi112.stdout:5/356: readlink d1/d2/l40 0 2024-04-25T02:09:08.745 INFO:tasks.workunit.client.1.smithi112.stdout:5/357: fdatasync d1/f8 0 2024-04-25T02:09:08.751 INFO:tasks.workunit.client.1.smithi112.stdout:0/632: read da/d13/d45/d5e/f9a [3687636,106601] 0 2024-04-25T02:09:08.751 INFO:tasks.workunit.client.1.smithi112.stdout:0/633: truncate da/d1d/d2e/d40/d49/d4f/d58/f7c 89150 0 2024-04-25T02:09:08.850 INFO:tasks.workunit.client.1.smithi112.stdout:9/411: rmdir d1/d13/d5b/d55 39 2024-04-25T02:09:08.850 INFO:tasks.workunit.client.1.smithi112.stdout:9/412: read d1/df/d3c/f52 [65419,31850] 0 2024-04-25T02:09:08.856 INFO:tasks.workunit.client.1.smithi112.stdout:5/358: mkdir d1/d41/d5b/d79 0 2024-04-25T02:09:08.856 INFO:tasks.workunit.client.1.smithi112.stdout:5/359: write d1/d2/d4/f54 [123825,95830] 0 2024-04-25T02:09:08.865 INFO:tasks.workunit.client.1.smithi112.stdout:5/360: mkdir d1/d41/d5b/d79/d7a 0 2024-04-25T02:09:08.865 INFO:tasks.workunit.client.1.smithi112.stdout:6/398: sync 2024-04-25T02:09:08.865 INFO:tasks.workunit.client.1.smithi112.stdout:6/399: creat d0/d7b/f90 x:0 0 0 2024-04-25T02:09:08.865 INFO:tasks.workunit.client.1.smithi112.stdout:6/400: read - d0/d2/d3b/f68 zero size 2024-04-25T02:09:08.865 INFO:tasks.workunit.client.1.smithi112.stdout:6/401: chown d0/d2/d66/l74 942008 1 2024-04-25T02:09:08.867 INFO:tasks.workunit.client.1.smithi112.stdout:6/402: mkdir d0/d2/d2c/d41/d77/d91 0 2024-04-25T02:09:08.877 INFO:tasks.workunit.client.1.smithi112.stdout:6/403: dread d0/d2/d4/f1d [0,4194304] 0 2024-04-25T02:09:08.879 INFO:tasks.workunit.client.1.smithi112.stdout:6/404: rename d0/d2/d3b/d53/d85 to d0/d2/d66/d7d/d92 0 2024-04-25T02:09:08.880 INFO:tasks.workunit.client.1.smithi112.stdout:6/405: link d0/d32/c4d d0/d2/d79/c93 0 2024-04-25T02:09:08.881 INFO:tasks.workunit.client.1.smithi112.stdout:6/406: unlink d0/d32/d45/l50 0 2024-04-25T02:09:08.881 INFO:tasks.workunit.client.1.smithi112.stdout:6/407: chown d0/d2/d4/d28 677 1 2024-04-25T02:09:08.888 INFO:tasks.workunit.client.1.smithi112.stdout:9/413: dwrite d1/df/d3c/d43/f4a [0,4194304] 0 2024-04-25T02:09:08.888 INFO:tasks.workunit.client.1.smithi112.stdout:9/414: chown d1/d13/d5b/d55/f57 31797791 1 2024-04-25T02:09:08.888 INFO:tasks.workunit.client.1.smithi112.stdout:9/415: creat d1/df/d8f/f94 x:0 0 0 2024-04-25T02:09:08.889 INFO:tasks.workunit.client.1.smithi112.stdout:5/361: dwrite d1/d2/d4/d1d/f25 [0,4194304] 0 2024-04-25T02:09:08.891 INFO:tasks.workunit.client.1.smithi112.stdout:9/416: rename d1/d13/f72 to d1/d13/d41/d84/f95 0 2024-04-25T02:09:08.898 INFO:tasks.workunit.client.1.smithi112.stdout:6/408: dwrite d0/d2/d2c/d41/d77/f7c [0,4194304] 0 2024-04-25T02:09:08.903 INFO:tasks.workunit.client.1.smithi112.stdout:9/417: rmdir d1/df/d8f 39 2024-04-25T02:09:08.903 INFO:tasks.workunit.client.1.smithi112.stdout:9/418: chown d1/f1c 0 1 2024-04-25T02:09:08.906 INFO:tasks.workunit.client.1.smithi112.stdout:6/409: symlink d0/d2/d2c/d41/d77/l94 0 2024-04-25T02:09:08.907 INFO:tasks.workunit.client.1.smithi112.stdout:6/410: truncate d0/d7b/f88 163420 0 2024-04-25T02:09:08.907 INFO:tasks.workunit.client.1.smithi112.stdout:9/419: mknod d1/d13/d41/d84/c96 0 2024-04-25T02:09:08.908 INFO:tasks.workunit.client.1.smithi112.stdout:5/362: dwrite d1/d41/f47 [0,4194304] 0 2024-04-25T02:09:08.909 INFO:tasks.workunit.client.1.smithi112.stdout:9/420: dread d1/df/d3c/d46/f56 [0,4194304] 0 2024-04-25T02:09:08.909 INFO:tasks.workunit.client.1.smithi112.stdout:9/421: dread - d1/d48/d65/f79 zero size 2024-04-25T02:09:08.909 INFO:tasks.workunit.client.1.smithi112.stdout:9/422: readlink d1/df/l22 0 2024-04-25T02:09:08.912 INFO:tasks.workunit.client.1.smithi112.stdout:6/411: mkdir d0/d2/d66/d7d/d95 0 2024-04-25T02:09:08.912 INFO:tasks.workunit.client.1.smithi112.stdout:6/412: write d0/d2/d4/dd/f26 [1870629,113503] 0 2024-04-25T02:09:08.912 INFO:tasks.workunit.client.1.smithi112.stdout:6/413: chown d0/d2/d79/c93 2 1 2024-04-25T02:09:08.912 INFO:tasks.workunit.client.1.smithi112.stdout:6/414: fdatasync d0/d2/d4/f1d 0 2024-04-25T02:09:08.912 INFO:tasks.workunit.client.1.smithi112.stdout:6/415: creat d0/d2/d3b/d53/f96 x:0 0 0 2024-04-25T02:09:08.919 INFO:tasks.workunit.client.1.smithi112.stdout:5/363: mkdir d1/d41/d5b/d7b 0 2024-04-25T02:09:08.920 INFO:tasks.workunit.client.1.smithi112.stdout:9/423: getdents d1/d13 0 2024-04-25T02:09:08.924 INFO:tasks.workunit.client.1.smithi112.stdout:5/364: creat d1/d2/d78/f7c x:0 0 0 2024-04-25T02:09:08.926 INFO:tasks.workunit.client.1.smithi112.stdout:9/424: creat d1/df/d3c/d6c/f97 x:0 0 0 2024-04-25T02:09:08.926 INFO:tasks.workunit.client.1.smithi112.stdout:9/425: write d1/d13/d5b/d55/f5d [4416988,43556] 0 2024-04-25T02:09:08.928 INFO:tasks.workunit.client.1.smithi112.stdout:6/416: dwrite d0/d7b/f90 [0,4194304] 0 2024-04-25T02:09:08.928 INFO:tasks.workunit.client.1.smithi112.stdout:6/417: fdatasync d0/d2/d2c/d41/d77/f8a 0 2024-04-25T02:09:08.929 INFO:tasks.workunit.client.1.smithi112.stdout:5/365: mkdir d1/d2/d7d 0 2024-04-25T02:09:08.933 INFO:tasks.workunit.client.1.smithi112.stdout:6/418: symlink d0/d2/d66/d7d/d92/l97 0 2024-04-25T02:09:08.935 INFO:tasks.workunit.client.1.smithi112.stdout:5/366: creat d1/d2/f7e x:0 0 0 2024-04-25T02:09:08.936 INFO:tasks.workunit.client.1.smithi112.stdout:6/419: mkdir d0/d61/d98 0 2024-04-25T02:09:08.936 INFO:tasks.workunit.client.1.smithi112.stdout:6/420: creat d0/d2/d2c/d41/d77/f99 x:0 0 0 2024-04-25T02:09:08.939 INFO:tasks.workunit.client.1.smithi112.stdout:6/421: rename d0/d2/d2c/d41/l60 to d0/d32/d45/l9a 0 2024-04-25T02:09:08.941 INFO:tasks.workunit.client.1.smithi112.stdout:6/422: rename d0/d2/d4/f13 to d0/d2/d79/d81/f9b 0 2024-04-25T02:09:08.941 INFO:tasks.workunit.client.1.smithi112.stdout:6/423: chown d0/d2/d2c/d41/d77/f99 7157367 1 2024-04-25T02:09:08.943 INFO:tasks.workunit.client.1.smithi112.stdout:6/424: creat d0/d2/d66/d7d/f9c x:0 0 0 2024-04-25T02:09:08.944 INFO:tasks.workunit.client.1.smithi112.stdout:6/425: creat d0/d2/d66/d7d/d92/f9d x:0 0 0 2024-04-25T02:09:08.946 INFO:tasks.workunit.client.1.smithi112.stdout:6/426: link d0/d2/d4/d28/f34 d0/d61/f9e 0 2024-04-25T02:09:08.947 INFO:tasks.workunit.client.1.smithi112.stdout:6/427: mknod d0/d2/d2c/d41/c9f 0 2024-04-25T02:09:08.954 INFO:tasks.workunit.client.1.smithi112.stdout:4/399: sync 2024-04-25T02:09:08.954 INFO:tasks.workunit.client.1.smithi112.stdout:1/422: sync 2024-04-25T02:09:08.954 INFO:tasks.workunit.client.1.smithi112.stdout:8/539: sync 2024-04-25T02:09:08.954 INFO:tasks.workunit.client.1.smithi112.stdout:1/423: fdatasync d7/f2c 0 2024-04-25T02:09:08.954 INFO:tasks.workunit.client.1.smithi112.stdout:4/400: creat d2/d17/d25/f7b x:0 0 0 2024-04-25T02:09:08.954 INFO:tasks.workunit.client.1.smithi112.stdout:4/401: fdatasync d2/d17/d25/f3b 0 2024-04-25T02:09:08.954 INFO:tasks.workunit.client.1.smithi112.stdout:4/402: write d2/d1e/d42/f47 [5032319,58352] 0 2024-04-25T02:09:08.955 INFO:tasks.workunit.client.1.smithi112.stdout:8/540: mknod d15/d26/d37/d52/cb7 0 2024-04-25T02:09:08.956 INFO:tasks.workunit.client.1.smithi112.stdout:1/424: link d7/d9/d4e/d28/d43/c56 d7/d9/d4e/d28/d3f/c82 0 2024-04-25T02:09:08.956 INFO:tasks.workunit.client.1.smithi112.stdout:1/425: dread - d7/d4b/f69 zero size 2024-04-25T02:09:08.959 INFO:tasks.workunit.client.1.smithi112.stdout:4/403: mkdir d2/d17/d7c 0 2024-04-25T02:09:08.962 INFO:tasks.workunit.client.1.smithi112.stdout:8/541: mkdir d15/d35/d5c/db8 0 2024-04-25T02:09:08.964 INFO:tasks.workunit.client.1.smithi112.stdout:8/542: rmdir d15/d26/d4f/d67 39 2024-04-25T02:09:08.966 INFO:tasks.workunit.client.1.smithi112.stdout:8/543: symlink d15/lb9 0 2024-04-25T02:09:08.968 INFO:tasks.workunit.client.1.smithi112.stdout:8/544: truncate d15/d35/d5c/d5e/f76 364293 0 2024-04-25T02:09:08.969 INFO:tasks.workunit.client.1.smithi112.stdout:8/545: getdents d15/d35/d5c/d5e/d94 0 2024-04-25T02:09:08.972 INFO:tasks.workunit.client.1.smithi112.stdout:8/546: unlink d15/f18 0 2024-04-25T02:09:08.972 INFO:tasks.workunit.client.1.smithi112.stdout:8/547: chown d15/d35/d5c/d91/d78/ca6 97960 1 2024-04-25T02:09:08.972 INFO:tasks.workunit.client.1.smithi112.stdout:8/548: chown d15/d35/d5c/d5e/d6d 0 1 2024-04-25T02:09:08.972 INFO:tasks.workunit.client.1.smithi112.stdout:6/428: dwrite d0/d2/d2c/d41/f5d [0,4194304] 0 2024-04-25T02:09:08.972 INFO:tasks.workunit.client.1.smithi112.stdout:6/429: fsync d0/d2/d4/f1d 0 2024-04-25T02:09:08.974 INFO:tasks.workunit.client.1.smithi112.stdout:8/549: mkdir d15/d17/dba 0 2024-04-25T02:09:08.989 INFO:tasks.workunit.client.1.smithi112.stdout:1/426: dwrite d7/d9/d51/d58/f5b [0,4194304] 0 2024-04-25T02:09:08.995 INFO:tasks.workunit.client.1.smithi112.stdout:1/427: mkdir d7/d9/d51/d83 0 2024-04-25T02:09:08.995 INFO:tasks.workunit.client.1.smithi112.stdout:1/428: dread - d7/d9/d4e/d28/d32/f6c zero size 2024-04-25T02:09:08.995 INFO:tasks.workunit.client.1.smithi112.stdout:1/429: stat d7/d9/d4e/d28/d32/f64 0 2024-04-25T02:09:08.996 INFO:tasks.workunit.client.1.smithi112.stdout:1/430: mkdir d7/d9/d1e/de/d84 0 2024-04-25T02:09:09.048 INFO:tasks.workunit.client.1.smithi112.stdout:4/404: dwrite d2/f1f [0,4194304] 0 2024-04-25T02:09:09.048 INFO:tasks.workunit.client.1.smithi112.stdout:4/405: fsync d2/d12/d22/f2f 0 2024-04-25T02:09:09.051 INFO:tasks.workunit.client.1.smithi112.stdout:4/406: dread d2/f46 [0,4194304] 0 2024-04-25T02:09:09.051 INFO:tasks.workunit.client.1.smithi112.stdout:8/550: dread fe [0,4194304] 0 2024-04-25T02:09:09.052 INFO:tasks.workunit.client.1.smithi112.stdout:4/407: symlink d2/d17/d25/d3f/l7d 0 2024-04-25T02:09:09.054 INFO:tasks.workunit.client.1.smithi112.stdout:8/551: creat d15/d35/d5c/d91/d78/fbb x:0 0 0 2024-04-25T02:09:09.058 INFO:tasks.workunit.client.1.smithi112.stdout:8/552: creat d15/d40/d88/fbc x:0 0 0 2024-04-25T02:09:09.059 INFO:tasks.workunit.client.1.smithi112.stdout:6/430: dwrite d0/d2/d3b/f6f [0,4194304] 0 2024-04-25T02:09:09.059 INFO:tasks.workunit.client.1.smithi112.stdout:6/431: readlink d0/d2/d4/dd/l18 0 2024-04-25T02:09:09.059 INFO:tasks.workunit.client.1.smithi112.stdout:1/431: dwrite d7/d9/d4e/d28/d3f/f7c [0,4194304] 0 2024-04-25T02:09:09.063 INFO:tasks.workunit.client.1.smithi112.stdout:8/553: dread fe [0,4194304] 0 2024-04-25T02:09:09.063 INFO:tasks.workunit.client.1.smithi112.stdout:8/554: creat d15/d35/d5c/d91/d78/fbd x:0 0 0 2024-04-25T02:09:09.066 INFO:tasks.workunit.client.1.smithi112.stdout:6/432: rename d0/d2/d4/dd/c21 to d0/d36/ca0 0 2024-04-25T02:09:09.067 INFO:tasks.workunit.client.1.smithi112.stdout:6/433: write d0/d2/d2c/f3f [296865,10653] 0 2024-04-25T02:09:09.067 INFO:tasks.workunit.client.1.smithi112.stdout:4/408: dwrite d2/d17/d20/d26/d39/f68 [0,4194304] 0 2024-04-25T02:09:09.070 INFO:tasks.workunit.client.1.smithi112.stdout:1/432: mkdir d7/d9/d4e/d85 0 2024-04-25T02:09:09.078 INFO:tasks.workunit.client.1.smithi112.stdout:8/555: link d15/d17/d1a/f4b d15/d26/fbe 0 2024-04-25T02:09:09.080 INFO:tasks.workunit.client.1.smithi112.stdout:1/433: dread d7/d9/d4e/d28/d32/f64 [0,4194304] 0 2024-04-25T02:09:09.085 INFO:tasks.workunit.client.1.smithi112.stdout:1/434: dread d7/d9/d1e/de/f65 [0,4194304] 0 2024-04-25T02:09:09.086 INFO:tasks.workunit.client.1.smithi112.stdout:6/434: mkdir d0/d2/da1 0 2024-04-25T02:09:09.086 INFO:tasks.workunit.client.1.smithi112.stdout:4/409: getdents d2/d1e/d1b/d65 0 2024-04-25T02:09:09.087 INFO:tasks.workunit.client.1.smithi112.stdout:4/410: chown d2/d12/d22/l3d 12568 1 2024-04-25T02:09:09.089 INFO:tasks.workunit.client.1.smithi112.stdout:4/411: rename d2/d17/d20/d26/d39/c4a to d2/c7e 0 2024-04-25T02:09:09.089 INFO:tasks.workunit.client.1.smithi112.stdout:4/412: truncate d2/d1e/d4b/d57/f69 1459493 0 2024-04-25T02:09:09.091 INFO:tasks.workunit.client.1.smithi112.stdout:1/435: dread f4 [0,4194304] 0 2024-04-25T02:09:09.091 INFO:tasks.workunit.client.1.smithi112.stdout:1/436: fdatasync d7/d9/d1e/de/f65 0 2024-04-25T02:09:09.091 INFO:tasks.workunit.client.1.smithi112.stdout:1/437: getdents d7/d9/d4e/d85 0 2024-04-25T02:09:09.091 INFO:tasks.workunit.client.1.smithi112.stdout:4/413: creat d2/d12/d22/d60/f7f x:0 0 0 2024-04-25T02:09:09.094 INFO:tasks.workunit.client.1.smithi112.stdout:1/438: rename d7/d9/d4e/d28/d32/l38 to d7/d9/l86 0 2024-04-25T02:09:09.094 INFO:tasks.workunit.client.1.smithi112.stdout:1/439: write d7/d9/d1e/d66/f7e [379493,51455] 0 2024-04-25T02:09:09.094 INFO:tasks.workunit.client.1.smithi112.stdout:1/440: write d7/d9/d1f/f63 [61543,89218] 0 2024-04-25T02:09:09.095 INFO:tasks.workunit.client.1.smithi112.stdout:8/556: dwrite d15/d17/d1a/f2f [0,4194304] 0 2024-04-25T02:09:09.095 INFO:tasks.workunit.client.1.smithi112.stdout:6/435: dread d0/f1a [4194304,4194304] 0 2024-04-25T02:09:09.096 INFO:tasks.workunit.client.1.smithi112.stdout:1/441: mknod d7/d9/d1e/d40/c87 0 2024-04-25T02:09:09.096 INFO:tasks.workunit.client.1.smithi112.stdout:1/442: chown d7/d9/d1f/f36 4247328 1 2024-04-25T02:09:09.096 INFO:tasks.workunit.client.1.smithi112.stdout:1/443: fsync d7/d9/d1e/f1a 0 2024-04-25T02:09:09.096 INFO:tasks.workunit.client.1.smithi112.stdout:6/436: creat d0/d2/d4/d28/fa2 x:0 0 0 2024-04-25T02:09:09.096 INFO:tasks.workunit.client.1.smithi112.stdout:4/414: dread d2/d1e/d4b/d57/f69 [0,4194304] 0 2024-04-25T02:09:09.096 INFO:tasks.workunit.client.1.smithi112.stdout:4/415: dread - d2/d17/d25/f7b zero size 2024-04-25T02:09:09.098 INFO:tasks.workunit.client.1.smithi112.stdout:8/557: link d15/d35/d5c/d91/d78/l9c d15/d35/lbf 0 2024-04-25T02:09:09.100 INFO:tasks.workunit.client.1.smithi112.stdout:6/437: creat d0/d2/d66/fa3 x:0 0 0 2024-04-25T02:09:09.100 INFO:tasks.workunit.client.1.smithi112.stdout:6/438: creat d0/d2/d2c/d41/d77/fa4 x:0 0 0 2024-04-25T02:09:09.102 INFO:tasks.workunit.client.1.smithi112.stdout:1/444: symlink d7/d9/d4e/d85/l88 0 2024-04-25T02:09:09.104 INFO:tasks.workunit.client.1.smithi112.stdout:8/558: unlink d15/d17/d1a/f43 0 2024-04-25T02:09:09.108 INFO:tasks.workunit.client.1.smithi112.stdout:4/416: read d2/d17/d20/d26/d39/f68 [1387409,4350] 0 2024-04-25T02:09:09.108 INFO:tasks.workunit.client.1.smithi112.stdout:8/559: dread fe [0,4194304] 0 2024-04-25T02:09:09.108 INFO:tasks.workunit.client.1.smithi112.stdout:8/560: stat f6 0 2024-04-25T02:09:09.110 INFO:tasks.workunit.client.1.smithi112.stdout:1/445: link d7/d9/d1e/de/f17 d7/d9/d46/f89 0 2024-04-25T02:09:09.110 INFO:tasks.workunit.client.1.smithi112.stdout:1/446: truncate d7/d9/d4e/d28/d32/f6c 332750 0 2024-04-25T02:09:09.112 INFO:tasks.workunit.client.1.smithi112.stdout:4/417: mkdir d2/d17/d20/d26/d80 0 2024-04-25T02:09:09.112 INFO:tasks.workunit.client.1.smithi112.stdout:4/418: chown d2/d1e/l53 27393861 1 2024-04-25T02:09:09.112 INFO:tasks.workunit.client.1.smithi112.stdout:4/419: creat d2/d1e/f81 x:0 0 0 2024-04-25T02:09:09.113 INFO:tasks.workunit.client.1.smithi112.stdout:8/561: mknod d15/d17/dba/cc0 0 2024-04-25T02:09:09.113 INFO:tasks.workunit.client.1.smithi112.stdout:6/439: dwrite d0/d2/d4/d28/f34 [0,4194304] 0 2024-04-25T02:09:09.114 INFO:tasks.workunit.client.1.smithi112.stdout:1/447: mknod d7/d9/d51/d58/c8a 0 2024-04-25T02:09:09.115 INFO:tasks.workunit.client.1.smithi112.stdout:3/441: sync 2024-04-25T02:09:09.115 INFO:tasks.workunit.client.1.smithi112.stdout:1/448: dread d7/d9/d4e/f62 [0,4194304] 0 2024-04-25T02:09:09.117 INFO:tasks.workunit.client.1.smithi112.stdout:4/420: unlink d2/d17/f28 0 2024-04-25T02:09:09.119 INFO:tasks.workunit.client.1.smithi112.stdout:8/562: unlink d15/d35/d5c/d91/f47 0 2024-04-25T02:09:09.119 INFO:tasks.workunit.client.1.smithi112.stdout:8/563: read - d15/d35/f4c zero size 2024-04-25T02:09:09.123 INFO:tasks.workunit.client.1.smithi112.stdout:6/440: rename d0/d2/d4/c6a to d0/d2/d2c/d41/d77/ca5 0 2024-04-25T02:09:09.123 INFO:tasks.workunit.client.1.smithi112.stdout:6/441: dread - d0/d2/d2c/d41/d77/f99 zero size 2024-04-25T02:09:09.123 INFO:tasks.workunit.client.1.smithi112.stdout:6/442: write d0/d2/d66/fa3 [842017,123216] 0 2024-04-25T02:09:09.125 INFO:tasks.workunit.client.1.smithi112.stdout:1/449: link d7/d9/d1e/c61 d7/d9/d4e/d28/d43/c8b 0 2024-04-25T02:09:09.125 INFO:tasks.workunit.client.1.smithi112.stdout:4/421: dread d2/d17/d20/d26/d39/d49/f56 [0,4194304] 0 2024-04-25T02:09:09.129 INFO:tasks.workunit.client.1.smithi112.stdout:4/422: read d2/f27 [2326525,1985] 0 2024-04-25T02:09:09.131 INFO:tasks.workunit.client.1.smithi112.stdout:6/443: write d0/d2/d4/f1d [2580374,113311] 0 2024-04-25T02:09:09.131 INFO:tasks.workunit.client.1.smithi112.stdout:6/444: fdatasync d0/d2/d4/dd/f26 0 2024-04-25T02:09:09.131 INFO:tasks.workunit.client.1.smithi112.stdout:6/445: stat d0/d2/d2c/d41/d77/fa4 0 2024-04-25T02:09:09.131 INFO:tasks.workunit.client.1.smithi112.stdout:6/446: stat d0/d2/d2c/f33 0 2024-04-25T02:09:09.131 INFO:tasks.workunit.client.1.smithi112.stdout:6/447: stat d0/d2/d2c/d41/d77/f7c 0 2024-04-25T02:09:09.132 INFO:tasks.workunit.client.1.smithi112.stdout:6/448: dread - d0/d2/d3b/f68 zero size 2024-04-25T02:09:09.133 INFO:tasks.workunit.client.1.smithi112.stdout:8/564: mknod d15/d17/cc1 0 2024-04-25T02:09:09.133 INFO:tasks.workunit.client.1.smithi112.stdout:8/565: read - d15/d35/d5f/fa0 zero size 2024-04-25T02:09:09.134 INFO:tasks.workunit.client.1.smithi112.stdout:1/450: creat d7/d9/f8c x:0 0 0 2024-04-25T02:09:09.137 INFO:tasks.workunit.client.1.smithi112.stdout:4/423: mknod d2/d17/d20/d26/c82 0 2024-04-25T02:09:09.138 INFO:tasks.workunit.client.1.smithi112.stdout:8/566: mkdir d15/d35/d5f/db5/dc2 0 2024-04-25T02:09:09.140 INFO:tasks.workunit.client.1.smithi112.stdout:6/449: dread d0/d7b/f90 [0,4194304] 0 2024-04-25T02:09:09.142 INFO:tasks.workunit.client.1.smithi112.stdout:8/567: rename d15/d17/d1a/l69 to d15/d35/d5c/d5e/lc3 0 2024-04-25T02:09:09.144 INFO:tasks.workunit.client.1.smithi112.stdout:6/450: read d0/d2/d4/dd/f26 [1557922,56442] 0 2024-04-25T02:09:09.144 INFO:tasks.workunit.client.1.smithi112.stdout:4/424: getdents d2/d12/d22 0 2024-04-25T02:09:09.147 INFO:tasks.workunit.client.1.smithi112.stdout:8/568: creat d15/d35/d5f/db5/fc4 x:0 0 0 2024-04-25T02:09:09.151 INFO:tasks.workunit.client.1.smithi112.stdout:6/451: unlink d0/d32/d45/l59 0 2024-04-25T02:09:09.152 INFO:tasks.workunit.client.1.smithi112.stdout:1/451: dwrite d7/d9/d51/d58/f5b [0,4194304] 0 2024-04-25T02:09:09.153 INFO:tasks.workunit.client.1.smithi112.stdout:8/569: unlink d15/d17/d1a/lb0 0 2024-04-25T02:09:09.153 INFO:tasks.workunit.client.1.smithi112.stdout:8/570: truncate d15/f2c 4824318 0 2024-04-25T02:09:09.153 INFO:tasks.workunit.client.1.smithi112.stdout:1/452: read d7/d9/d4e/f37 [1318076,75353] 0 2024-04-25T02:09:09.156 INFO:tasks.workunit.client.1.smithi112.stdout:6/452: symlink d0/d2/d2c/d41/la6 0 2024-04-25T02:09:09.156 INFO:tasks.workunit.client.1.smithi112.stdout:6/453: chown d0/d2/d4/f84 550327261 1 2024-04-25T02:09:09.160 INFO:tasks.workunit.client.1.smithi112.stdout:1/453: link d7/d9/d1e/d66/f7e d7/d9/d4e/d28/d3f/f8d 0 2024-04-25T02:09:09.160 INFO:tasks.workunit.client.1.smithi112.stdout:1/454: chown d7/d9/d1e/de/f17 1815 1 2024-04-25T02:09:09.162 INFO:tasks.workunit.client.1.smithi112.stdout:4/425: dwrite d2/d17/d20/d26/d39/d49/d4c/f72 [0,4194304] 0 2024-04-25T02:09:09.162 INFO:tasks.workunit.client.1.smithi112.stdout:4/426: fdatasync d2/d17/d20/d26/d39/d49/f3c 0 2024-04-25T02:09:09.163 INFO:tasks.workunit.client.1.smithi112.stdout:6/454: rmdir d0/d2/d2c/d41/d77/d91 0 2024-04-25T02:09:09.163 INFO:tasks.workunit.client.1.smithi112.stdout:6/455: read - d0/d2/d4/f19 zero size 2024-04-25T02:09:09.164 INFO:tasks.workunit.client.1.smithi112.stdout:1/455: symlink d7/d9/l8e 0 2024-04-25T02:09:09.166 INFO:tasks.workunit.client.1.smithi112.stdout:1/456: creat d7/d9/d1e/d40/f8f x:0 0 0 2024-04-25T02:09:09.168 INFO:tasks.workunit.client.1.smithi112.stdout:8/571: getdents d15/d17 0 2024-04-25T02:09:09.168 INFO:tasks.workunit.client.1.smithi112.stdout:8/572: dread d15/d35/d5c/f9e [0,4194304] 0 2024-04-25T02:09:09.174 INFO:tasks.workunit.client.1.smithi112.stdout:8/573: rename d15/d35/d5c/d5e/d6d to d15/d35/d5c/d91/d78/dc5 0 2024-04-25T02:09:09.175 INFO:tasks.workunit.client.1.smithi112.stdout:8/574: mkdir d15/d35/d5f/db5/dc6 0 2024-04-25T02:09:09.178 INFO:tasks.workunit.client.1.smithi112.stdout:8/575: mknod d15/d35/d5c/d5e/cc7 0 2024-04-25T02:09:09.178 INFO:tasks.workunit.client.1.smithi112.stdout:8/576: chown d15/d35/d5c/d91/c54 198372 1 2024-04-25T02:09:09.178 INFO:tasks.workunit.client.1.smithi112.stdout:8/577: truncate f10 9314231 0 2024-04-25T02:09:09.179 INFO:tasks.workunit.client.1.smithi112.stdout:4/427: dwrite d2/d17/d20/d5e/f2b [0,4194304] 0 2024-04-25T02:09:09.179 INFO:tasks.workunit.client.1.smithi112.stdout:4/428: write d2/d12/d22/f48 [1637916,109336] 0 2024-04-25T02:09:09.181 INFO:tasks.workunit.client.1.smithi112.stdout:8/578: unlink d15/d35/d5c/d91/d64/f6e 0 2024-04-25T02:09:09.181 INFO:tasks.workunit.client.1.smithi112.stdout:8/579: dread - d15/d17/f6b zero size 2024-04-25T02:09:09.181 INFO:tasks.workunit.client.1.smithi112.stdout:8/580: truncate d15/d40/d88/fbc 952507 0 2024-04-25T02:09:09.184 INFO:tasks.workunit.client.1.smithi112.stdout:8/581: dread fe [0,4194304] 0 2024-04-25T02:09:09.186 INFO:tasks.workunit.client.1.smithi112.stdout:4/429: mkdir d2/d1e/d1b/d83 0 2024-04-25T02:09:09.186 INFO:tasks.workunit.client.1.smithi112.stdout:4/430: write d2/d17/d20/d5e/f6c [178011,906] 0 2024-04-25T02:09:09.186 INFO:tasks.workunit.client.1.smithi112.stdout:4/431: chown d2/d1e/d5c/f76 10 1 2024-04-25T02:09:09.190 INFO:tasks.workunit.client.1.smithi112.stdout:8/582: rename d15/d26/d8c to d15/d35/d5c/d91/dc8 0 2024-04-25T02:09:09.190 INFO:tasks.workunit.client.1.smithi112.stdout:8/583: chown d15/d40/c74 229 1 2024-04-25T02:09:09.191 INFO:tasks.workunit.client.1.smithi112.stdout:8/584: dread d15/d26/d4f/d67/f8d [0,4194304] 0 2024-04-25T02:09:09.191 INFO:tasks.workunit.client.1.smithi112.stdout:8/585: write fe [1711893,117623] 0 2024-04-25T02:09:09.193 INFO:tasks.workunit.client.1.smithi112.stdout:8/586: getdents d15/d26/d37/d52 0 2024-04-25T02:09:09.196 INFO:tasks.workunit.client.1.smithi112.stdout:8/587: creat d15/d26/d37/fc9 x:0 0 0 2024-04-25T02:09:09.196 INFO:tasks.workunit.client.1.smithi112.stdout:8/588: creat d15/d26/d4f/fca x:0 0 0 2024-04-25T02:09:09.196 INFO:tasks.workunit.client.1.smithi112.stdout:8/589: dread - d15/d35/d5c/d91/d78/dc5/f84 zero size 2024-04-25T02:09:09.196 INFO:tasks.workunit.client.1.smithi112.stdout:6/456: dwrite d0/d2/d4/f1d [0,4194304] 0 2024-04-25T02:09:09.197 INFO:tasks.workunit.client.1.smithi112.stdout:4/432: dread d2/d17/d20/d5e/f2b [0,4194304] 0 2024-04-25T02:09:09.197 INFO:tasks.workunit.client.1.smithi112.stdout:1/457: dwrite d7/d9/d1e/de/f17 [4194304,4194304] 0 2024-04-25T02:09:09.203 INFO:tasks.workunit.client.1.smithi112.stdout:8/590: rename d15/d17/d1a/f44 to d15/d35/d5c/d91/d64/fcb 0 2024-04-25T02:09:09.203 INFO:tasks.workunit.client.1.smithi112.stdout:8/591: fsync d15/d35/d5c/d91/d78/fbb 0 2024-04-25T02:09:09.209 INFO:tasks.workunit.client.1.smithi112.stdout:6/457: dwrite d0/d32/d45/f80 [0,4194304] 0 2024-04-25T02:09:09.219 INFO:tasks.workunit.client.1.smithi112.stdout:4/433: getdents d2/d17/d20/d26 0 2024-04-25T02:09:09.223 INFO:tasks.workunit.client.1.smithi112.stdout:1/458: rename d7/d9/d51/d58/l6e to d7/d4b/d7b/d7f/l90 0 2024-04-25T02:09:09.224 INFO:tasks.workunit.client.1.smithi112.stdout:1/459: fdatasync d7/d4b/f69 0 2024-04-25T02:09:09.224 INFO:tasks.workunit.client.1.smithi112.stdout:1/460: read d7/d9/f10 [3492794,105588] 0 2024-04-25T02:09:09.227 INFO:tasks.workunit.client.1.smithi112.stdout:6/458: dwrite d0/d2/d4/dd/f3d [4194304,4194304] 0 2024-04-25T02:09:09.237 INFO:tasks.workunit.client.1.smithi112.stdout:1/461: rename d7/d9/d4e/c81 to d7/d9/d4e/d72/d73/c91 0 2024-04-25T02:09:09.238 INFO:tasks.workunit.client.1.smithi112.stdout:4/434: rmdir d2/d17/d20/d5e 39 2024-04-25T02:09:09.238 INFO:tasks.workunit.client.1.smithi112.stdout:4/435: truncate d2/d1e/d4b/d57/f69 1564710 0 2024-04-25T02:09:09.240 INFO:tasks.workunit.client.1.smithi112.stdout:6/459: dwrite d0/d2/d3b/f40 [0,4194304] 0 2024-04-25T02:09:09.240 INFO:tasks.workunit.client.1.smithi112.stdout:1/462: link d7/d9/d4e/d28/d43/c8b d7/d9/d1e/de/c92 0 2024-04-25T02:09:09.241 INFO:tasks.workunit.client.1.smithi112.stdout:1/463: stat d7/d9/d51/d58/l59 0 2024-04-25T02:09:09.246 INFO:tasks.workunit.client.1.smithi112.stdout:6/460: link d0/d32/d45/l9a d0/d2/d3b/la7 0 2024-04-25T02:09:09.247 INFO:tasks.workunit.client.1.smithi112.stdout:4/436: dread d2/d12/f16 [0,4194304] 0 2024-04-25T02:09:09.249 INFO:tasks.workunit.client.1.smithi112.stdout:1/464: rename d7/d9/d4e/d28/d3f/c82 to d7/d9/d1f/d25/d39/c93 0 2024-04-25T02:09:09.249 INFO:tasks.workunit.client.1.smithi112.stdout:1/465: fsync d7/d9/d1f/f3e 0 2024-04-25T02:09:09.249 INFO:tasks.workunit.client.1.smithi112.stdout:1/466: chown d7/d9/d4e/f62 8 1 2024-04-25T02:09:09.249 INFO:tasks.workunit.client.1.smithi112.stdout:1/467: write d7/d9/f1b [415924,55544] 0 2024-04-25T02:09:09.253 INFO:tasks.workunit.client.1.smithi112.stdout:4/437: symlink d2/d1e/d1b/l84 0 2024-04-25T02:09:09.253 INFO:tasks.workunit.client.1.smithi112.stdout:4/438: stat d2/d1e/d42 0 2024-04-25T02:09:09.254 INFO:tasks.workunit.client.1.smithi112.stdout:6/461: dread d0/d2/d4/d28/f34 [0,4194304] 0 2024-04-25T02:09:09.254 INFO:tasks.workunit.client.1.smithi112.stdout:6/462: dread - d0/d2/d3b/d53/f72 zero size 2024-04-25T02:09:09.256 INFO:tasks.workunit.client.1.smithi112.stdout:7/433: sync 2024-04-25T02:09:09.256 INFO:tasks.workunit.client.1.smithi112.stdout:2/325: sync 2024-04-25T02:09:09.259 INFO:tasks.workunit.client.1.smithi112.stdout:2/326: mkdir d3/da/dc/d20/d43/d74 0 2024-04-25T02:09:09.279 INFO:tasks.workunit.client.1.smithi112.stdout:4/439: dwrite d2/d17/d20/d5e/f6c [0,4194304] 0 2024-04-25T02:09:09.280 INFO:tasks.workunit.client.1.smithi112.stdout:6/463: dwrite d0/d2/d4/f1d [0,4194304] 0 2024-04-25T02:09:09.280 INFO:tasks.workunit.client.1.smithi112.stdout:6/464: chown d0/c38 100022734 1 2024-04-25T02:09:09.373 INFO:tasks.workunit.client.1.smithi112.stdout:7/434: creat d7/d25/d40/f80 x:0 0 0 2024-04-25T02:09:09.373 INFO:tasks.workunit.client.1.smithi112.stdout:2/327: getdents d3/da/dc/d20/d43/d5e 0 2024-04-25T02:09:09.373 INFO:tasks.workunit.client.1.smithi112.stdout:2/328: stat d3/da/dc/d20/d43 0 2024-04-25T02:09:09.376 INFO:tasks.workunit.client.1.smithi112.stdout:4/440: symlink d2/d1e/d4b/d57/l85 0 2024-04-25T02:09:09.377 INFO:tasks.workunit.client.1.smithi112.stdout:6/465: getdents d0/d32 0 2024-04-25T02:09:09.380 INFO:tasks.workunit.client.1.smithi112.stdout:2/329: dread d3/da/dc/d3e/df/d25/f54 [0,4194304] 0 2024-04-25T02:09:09.384 INFO:tasks.workunit.client.1.smithi112.stdout:7/435: write d7/d25/d37/d53/f56 [1359242,29505] 0 2024-04-25T02:09:09.385 INFO:tasks.workunit.client.1.smithi112.stdout:7/436: chown d7/d25/d43/d46/c66 46715142 1 2024-04-25T02:09:09.385 INFO:tasks.workunit.client.1.smithi112.stdout:7/437: write d7/d25/d43/f47 [2426510,128377] 0 2024-04-25T02:09:09.386 INFO:tasks.workunit.client.1.smithi112.stdout:2/330: unlink d3/da/f3a 0 2024-04-25T02:09:09.386 INFO:tasks.workunit.client.1.smithi112.stdout:2/331: fsync d3/da/d18/f3f 0 2024-04-25T02:09:09.391 INFO:tasks.workunit.client.1.smithi112.stdout:7/438: creat d7/dd/d20/d36/f81 x:0 0 0 2024-04-25T02:09:09.395 INFO:tasks.workunit.client.1.smithi112.stdout:2/332: mknod d3/da/dc/d3e/c75 0 2024-04-25T02:09:09.397 INFO:tasks.workunit.client.1.smithi112.stdout:4/441: rename d2/d17/d20/d26/d39/d49/d4c to d2/d1e/d1b/d86 0 2024-04-25T02:09:09.397 INFO:tasks.workunit.client.1.smithi112.stdout:4/442: truncate d2/d1e/f74 478864 0 2024-04-25T02:09:09.399 INFO:tasks.workunit.client.1.smithi112.stdout:7/439: dread d7/d25/d37/f6d [0,4194304] 0 2024-04-25T02:09:09.399 INFO:tasks.workunit.client.1.smithi112.stdout:4/443: truncate d2/d17/d20/d26/d39/f68 198779 0 2024-04-25T02:09:09.400 INFO:tasks.workunit.client.1.smithi112.stdout:7/440: truncate d7/d25/f2d 3571104 0 2024-04-25T02:09:09.402 INFO:tasks.workunit.client.1.smithi112.stdout:7/441: rename d7/d25/d37/d53/f64 to d7/d25/d43/d46/f82 0 2024-04-25T02:09:09.405 INFO:tasks.workunit.client.1.smithi112.stdout:6/466: dwrite d0/d2/d3b/d53/f96 [0,4194304] 0 2024-04-25T02:09:09.408 INFO:tasks.workunit.client.1.smithi112.stdout:2/333: write d3/da/dc/d20/d40/f5b [7540118,37197] 0 2024-04-25T02:09:09.410 INFO:tasks.workunit.client.1.smithi112.stdout:2/334: creat d3/da/dc/d20/f76 x:0 0 0 2024-04-25T02:09:09.411 INFO:tasks.workunit.client.1.smithi112.stdout:4/444: dread d2/f2d [4194304,4194304] 0 2024-04-25T02:09:09.412 INFO:tasks.workunit.client.1.smithi112.stdout:0/634: sync 2024-04-25T02:09:09.412 INFO:tasks.workunit.client.1.smithi112.stdout:9/426: sync 2024-04-25T02:09:09.412 INFO:tasks.workunit.client.1.smithi112.stdout:5/367: sync 2024-04-25T02:09:09.412 INFO:tasks.workunit.client.1.smithi112.stdout:9/427: fsync d1/df/f23 0 2024-04-25T02:09:09.412 INFO:tasks.workunit.client.1.smithi112.stdout:2/335: rmdir d3/da/dc/d20/d43/d5e 39 2024-04-25T02:09:09.414 INFO:tasks.workunit.client.1.smithi112.stdout:4/445: truncate d2/d17/d20/d5e/f2b 1467903 0 2024-04-25T02:09:09.414 INFO:tasks.workunit.client.1.smithi112.stdout:4/446: getdents d2/d12/d22 0 2024-04-25T02:09:09.418 INFO:tasks.workunit.client.1.smithi112.stdout:6/467: write d0/d2/d2c/d41/f5d [1500076,91731] 0 2024-04-25T02:09:09.418 INFO:tasks.workunit.client.1.smithi112.stdout:0/635: stat da/d1d/d2e/c7f 0 2024-04-25T02:09:09.420 INFO:tasks.workunit.client.1.smithi112.stdout:2/336: creat d3/da/dc/d3e/df/d25/f77 x:0 0 0 2024-04-25T02:09:09.420 INFO:tasks.workunit.client.1.smithi112.stdout:2/337: dread - d3/da/f70 zero size 2024-04-25T02:09:09.421 INFO:tasks.workunit.client.1.smithi112.stdout:6/468: rmdir d0/d2/d4 39 2024-04-25T02:09:09.422 INFO:tasks.workunit.client.1.smithi112.stdout:2/338: symlink d3/d62/l78 0 2024-04-25T02:09:09.422 INFO:tasks.workunit.client.1.smithi112.stdout:2/339: write d3/da/dc/d3e/df/f34 [648040,54506] 0 2024-04-25T02:09:09.423 INFO:tasks.workunit.client.1.smithi112.stdout:6/469: stat d0/d2/d3b/la7 0 2024-04-25T02:09:09.423 INFO:tasks.workunit.client.1.smithi112.stdout:6/470: chown d0/d2/d4/f11 36 1 2024-04-25T02:09:09.424 INFO:tasks.workunit.client.1.smithi112.stdout:0/636: dread da/f46 [0,4194304] 0 2024-04-25T02:09:09.426 INFO:tasks.workunit.client.1.smithi112.stdout:2/340: creat d3/da/dc/d20/d40/f79 x:0 0 0 2024-04-25T02:09:09.430 INFO:tasks.workunit.client.1.smithi112.stdout:5/368: read d1/d2/d4/d1d/f25 [3730383,2904] 0 2024-04-25T02:09:09.430 INFO:tasks.workunit.client.1.smithi112.stdout:5/369: read d1/d2/f33 [2096631,107839] 0 2024-04-25T02:09:09.430 INFO:tasks.workunit.client.1.smithi112.stdout:5/370: dread - d1/d2/d28/f77 zero size 2024-04-25T02:09:09.432 INFO:tasks.workunit.client.1.smithi112.stdout:0/637: mknod da/d1d/d88/d80/cc4 0 2024-04-25T02:09:09.432 INFO:tasks.workunit.client.1.smithi112.stdout:7/442: dwrite d7/dd/f4a [4194304,4194304] 0 2024-04-25T02:09:09.433 INFO:tasks.workunit.client.1.smithi112.stdout:7/443: readlink d7/d25/d43/l31 0 2024-04-25T02:09:09.433 INFO:tasks.workunit.client.1.smithi112.stdout:9/428: dread d1/d13/d41/f66 [0,4194304] 0 2024-04-25T02:09:09.433 INFO:tasks.workunit.client.1.smithi112.stdout:9/429: dread - d1/df/d3c/d46/f74 zero size 2024-04-25T02:09:09.433 INFO:tasks.workunit.client.1.smithi112.stdout:9/430: creat d1/df/d3c/d46/f98 x:0 0 0 2024-04-25T02:09:09.434 INFO:tasks.workunit.client.1.smithi112.stdout:2/341: rmdir d3/da/dc/d3e/df/d25/d72 0 2024-04-25T02:09:09.438 INFO:tasks.workunit.client.1.smithi112.stdout:4/447: dwrite d2/d17/d20/d5e/f5b [0,4194304] 0 2024-04-25T02:09:09.438 INFO:tasks.workunit.client.1.smithi112.stdout:7/444: dread d7/d25/d40/d6b/f70 [0,4194304] 0 2024-04-25T02:09:09.440 INFO:tasks.workunit.client.1.smithi112.stdout:6/471: rmdir d0/d2/d2c 39 2024-04-25T02:09:09.440 INFO:tasks.workunit.client.1.smithi112.stdout:6/472: fdatasync d0/d7b/f88 0 2024-04-25T02:09:09.440 INFO:tasks.workunit.client.1.smithi112.stdout:6/473: truncate d0/d2/d4/f1d 4446168 0 2024-04-25T02:09:09.440 INFO:tasks.workunit.client.1.smithi112.stdout:6/474: chown d0/d2/d66/d7d 2419 1 2024-04-25T02:09:09.442 INFO:tasks.workunit.client.1.smithi112.stdout:4/448: dread d2/d1e/d1b/d86/f6d [0,4194304] 0 2024-04-25T02:09:09.447 INFO:tasks.workunit.client.1.smithi112.stdout:5/371: unlink d1/f29 0 2024-04-25T02:09:09.452 INFO:tasks.workunit.client.1.smithi112.stdout:9/431: link d1/d13/d41/f66 d1/df/d3c/d46/f99 0 2024-04-25T02:09:09.456 INFO:tasks.workunit.client.1.smithi112.stdout:0/638: dwrite da/d1d/d88/d24/f48 [0,4194304] 0 2024-04-25T02:09:09.456 INFO:tasks.workunit.client.1.smithi112.stdout:7/445: symlink d7/d25/d40/d6b/l83 0 2024-04-25T02:09:09.460 INFO:tasks.workunit.client.1.smithi112.stdout:4/449: rename d2/d17/d20/d26/d39/d49/d59 to d2/d17/d20/d5e/d87 0 2024-04-25T02:09:09.461 INFO:tasks.workunit.client.1.smithi112.stdout:4/450: creat d2/d12/d22/d60/f88 x:0 0 0 2024-04-25T02:09:09.461 INFO:tasks.workunit.client.1.smithi112.stdout:4/451: dread - d2/d17/d25/f7b zero size 2024-04-25T02:09:09.461 INFO:tasks.workunit.client.1.smithi112.stdout:4/452: readlink d2/d17/l41 0 2024-04-25T02:09:09.462 INFO:tasks.workunit.client.1.smithi112.stdout:5/372: truncate d1/d2/d28/d4f/f5d 233113 0 2024-04-25T02:09:09.464 INFO:tasks.workunit.client.1.smithi112.stdout:9/432: symlink d1/df/d3c/d6c/l9a 0 2024-04-25T02:09:09.467 INFO:tasks.workunit.client.1.smithi112.stdout:7/446: rename d7/d25/d40/d51/f6c to d7/d25/d40/d6b/f84 0 2024-04-25T02:09:09.469 INFO:tasks.workunit.client.1.smithi112.stdout:4/453: dread d2/d17/d20/f4f [0,4194304] 0 2024-04-25T02:09:09.471 INFO:tasks.workunit.client.1.smithi112.stdout:5/373: creat d1/d41/d5b/d7b/f7f x:0 0 0 2024-04-25T02:09:09.471 INFO:tasks.workunit.client.1.smithi112.stdout:5/374: readlink d1/d41/d5b/l6f 0 2024-04-25T02:09:09.472 INFO:tasks.workunit.client.1.smithi112.stdout:6/475: dwrite d0/d2/d3b/d53/f96 [0,4194304] 0 2024-04-25T02:09:09.472 INFO:tasks.workunit.client.1.smithi112.stdout:0/639: dwrite da/d13/d45/d5e/d7a/f99 [0,4194304] 0 2024-04-25T02:09:09.472 INFO:tasks.workunit.client.1.smithi112.stdout:0/640: write da/d1d/d2e/d40/d49/d6b/f85 [4382388,6862] 0 2024-04-25T02:09:09.474 INFO:tasks.workunit.client.1.smithi112.stdout:9/433: unlink d1/d13/f18 0 2024-04-25T02:09:09.478 INFO:tasks.workunit.client.1.smithi112.stdout:4/454: symlink d2/d17/d20/d26/d39/l89 0 2024-04-25T02:09:09.483 INFO:tasks.workunit.client.1.smithi112.stdout:4/455: dread d2/f27 [0,4194304] 0 2024-04-25T02:09:09.488 INFO:tasks.workunit.client.1.smithi112.stdout:5/375: creat d1/d41/d5b/f80 x:0 0 0 2024-04-25T02:09:09.488 INFO:tasks.workunit.client.1.smithi112.stdout:5/376: dread - d1/f46 zero size 2024-04-25T02:09:09.497 INFO:tasks.workunit.client.1.smithi112.stdout:0/641: symlink da/d1d/lc5 0 2024-04-25T02:09:09.499 INFO:tasks.workunit.client.1.smithi112.stdout:4/456: dwrite d2/d1e/f74 [0,4194304] 0 2024-04-25T02:09:09.500 INFO:tasks.workunit.client.1.smithi112.stdout:9/434: rename d1/l3e to d1/d13/d5b/d55/d8e/l9b 0 2024-04-25T02:09:09.506 INFO:tasks.workunit.client.1.smithi112.stdout:7/447: rmdir d7 39 2024-04-25T02:09:09.510 INFO:tasks.workunit.client.1.smithi112.stdout:5/377: rename d1/d16/d51/f55 to d1/d2/d78/f81 0 2024-04-25T02:09:09.511 INFO:tasks.workunit.client.1.smithi112.stdout:7/448: rmdir d7/dd/d20/d36 39 2024-04-25T02:09:09.513 INFO:tasks.workunit.client.1.smithi112.stdout:4/457: rename d2/d12/d22/l3d to d2/d17/d25/d3f/l8a 0 2024-04-25T02:09:09.515 INFO:tasks.workunit.client.1.smithi112.stdout:5/378: link d1/d41/d5b/l6f d1/d41/d5b/d6b/l82 0 2024-04-25T02:09:09.515 INFO:tasks.workunit.client.1.smithi112.stdout:5/379: write d1/f3b [3797482,12535] 0 2024-04-25T02:09:09.515 INFO:tasks.workunit.client.1.smithi112.stdout:5/380: stat d1/d16/f73 0 2024-04-25T02:09:09.515 INFO:tasks.workunit.client.1.smithi112.stdout:5/381: creat d1/d2/d28/d4f/f83 x:0 0 0 2024-04-25T02:09:09.515 INFO:tasks.workunit.client.1.smithi112.stdout:5/382: chown d1/d2/d28/f67 85528767 1 2024-04-25T02:09:09.516 INFO:tasks.workunit.client.1.smithi112.stdout:7/449: creat d7/d25/f85 x:0 0 0 2024-04-25T02:09:09.517 INFO:tasks.workunit.client.1.smithi112.stdout:4/458: mknod d2/d1e/d1b/d86/c8b 0 2024-04-25T02:09:09.517 INFO:tasks.workunit.client.1.smithi112.stdout:3/442: sync 2024-04-25T02:09:09.518 INFO:tasks.workunit.client.1.smithi112.stdout:7/450: getdents d7/d25/d40/d51 0 2024-04-25T02:09:09.521 INFO:tasks.workunit.client.1.smithi112.stdout:4/459: mknod d2/d17/d20/c8c 0 2024-04-25T02:09:09.522 INFO:tasks.workunit.client.1.smithi112.stdout:4/460: dread d2/d1e/d1b/d86/f6d [0,4194304] 0 2024-04-25T02:09:09.522 INFO:tasks.workunit.client.1.smithi112.stdout:4/461: chown d2/d17/d20/d26/d80 6 1 2024-04-25T02:09:09.523 INFO:tasks.workunit.client.1.smithi112.stdout:3/443: creat d12/d13/d34/d53/f8d x:0 0 0 2024-04-25T02:09:09.524 INFO:tasks.workunit.client.1.smithi112.stdout:7/451: mknod d7/d25/d37/c86 0 2024-04-25T02:09:09.526 INFO:tasks.workunit.client.1.smithi112.stdout:4/462: truncate d2/f5f 2445626 0 2024-04-25T02:09:09.527 INFO:tasks.workunit.client.1.smithi112.stdout:4/463: write d2/d12/f19 [436096,122943] 0 2024-04-25T02:09:09.527 INFO:tasks.workunit.client.1.smithi112.stdout:4/464: readlink d2/d17/l73 0 2024-04-25T02:09:09.527 INFO:tasks.workunit.client.1.smithi112.stdout:3/444: link d12/d13/d34/d53/f8d d12/d13/f8e 0 2024-04-25T02:09:09.532 INFO:tasks.workunit.client.1.smithi112.stdout:4/465: mknod d2/d1e/d4b/c8d 0 2024-04-25T02:09:09.534 INFO:tasks.workunit.client.1.smithi112.stdout:7/452: getdents d7/d25 0 2024-04-25T02:09:09.536 INFO:tasks.workunit.client.1.smithi112.stdout:7/453: creat d7/dd/f87 x:0 0 0 2024-04-25T02:09:09.541 INFO:tasks.workunit.client.1.smithi112.stdout:4/466: dread d2/d17/d25/f3b [0,4194304] 0 2024-04-25T02:09:09.542 INFO:tasks.workunit.client.1.smithi112.stdout:4/467: rmdir d2/d1e/d1b/d65 39 2024-04-25T02:09:09.548 INFO:tasks.workunit.client.1.smithi112.stdout:3/445: dwrite d12/d13/f1c [0,4194304] 0 2024-04-25T02:09:09.570 INFO:tasks.workunit.client.1.smithi112.stdout:7/454: dwrite d7/f13 [4194304,4194304] 0 2024-04-25T02:09:09.570 INFO:tasks.workunit.client.1.smithi112.stdout:3/446: dwrite d12/d13/f8e [0,4194304] 0 2024-04-25T02:09:09.570 INFO:tasks.workunit.client.1.smithi112.stdout:3/447: stat d12/d1f/d27/d44/f56 0 2024-04-25T02:09:09.570 INFO:tasks.workunit.client.1.smithi112.stdout:3/448: chown d12/d13/d34/d78/c7c 2754464 1 2024-04-25T02:09:09.570 INFO:tasks.workunit.client.1.smithi112.stdout:3/449: fdatasync d12/f63 0 2024-04-25T02:09:09.571 INFO:tasks.workunit.client.1.smithi112.stdout:4/468: dwrite d2/d1e/d1b/d86/f6d [0,4194304] 0 2024-04-25T02:09:09.574 INFO:tasks.workunit.client.1.smithi112.stdout:3/450: mkdir d12/d67/d8f 0 2024-04-25T02:09:09.574 INFO:tasks.workunit.client.1.smithi112.stdout:3/451: readlink d12/d13/d34/l5f 0 2024-04-25T02:09:09.577 INFO:tasks.workunit.client.1.smithi112.stdout:3/452: rmdir d12/d1f/d27 39 2024-04-25T02:09:09.579 INFO:tasks.workunit.client.1.smithi112.stdout:3/453: dread d12/d1f/d27/d44/f56 [0,4194304] 0 2024-04-25T02:09:09.582 INFO:tasks.workunit.client.1.smithi112.stdout:3/454: rmdir d12/d1f/d27/d44/d7e 39 2024-04-25T02:09:09.582 INFO:tasks.workunit.client.1.smithi112.stdout:3/455: chown d12/d13/d34/d4a/d87 75 1 2024-04-25T02:09:09.586 INFO:tasks.workunit.client.1.smithi112.stdout:3/456: creat d12/d5d/f90 x:0 0 0 2024-04-25T02:09:09.589 INFO:tasks.workunit.client.1.smithi112.stdout:3/457: mkdir d12/d13/d34/d78/d91 0 2024-04-25T02:09:09.591 INFO:tasks.workunit.client.1.smithi112.stdout:3/458: truncate d12/d1f/f79 2511544 0 2024-04-25T02:09:09.598 INFO:tasks.workunit.client.1.smithi112.stdout:4/469: dwrite d2/f5f [0,4194304] 0 2024-04-25T02:09:09.598 INFO:tasks.workunit.client.1.smithi112.stdout:4/470: chown d2/d17/d20/d26/d39/d49 114 1 2024-04-25T02:09:09.599 INFO:tasks.workunit.client.1.smithi112.stdout:7/455: dwrite d7/dd/f87 [0,4194304] 0 2024-04-25T02:09:09.605 INFO:tasks.workunit.client.1.smithi112.stdout:4/471: write d2/f2d [4514778,125352] 0 2024-04-25T02:09:09.607 INFO:tasks.workunit.client.1.smithi112.stdout:3/459: write d12/d13/f31 [2186744,88827] 0 2024-04-25T02:09:09.607 INFO:tasks.workunit.client.1.smithi112.stdout:3/460: fdatasync d12/f36 0 2024-04-25T02:09:09.607 INFO:tasks.workunit.client.1.smithi112.stdout:3/461: write d12/d13/d34/f48 [698664,19006] 0 2024-04-25T02:09:09.609 INFO:tasks.workunit.client.1.smithi112.stdout:7/456: mkdir d7/dd/d88 0 2024-04-25T02:09:09.609 INFO:tasks.workunit.client.1.smithi112.stdout:7/457: chown d7 631 1 2024-04-25T02:09:09.609 INFO:tasks.workunit.client.1.smithi112.stdout:7/458: write d7/d25/d40/f80 [612647,118362] 0 2024-04-25T02:09:09.611 INFO:tasks.workunit.client.1.smithi112.stdout:4/472: mknod d2/d17/d7c/c8e 0 2024-04-25T02:09:09.613 INFO:tasks.workunit.client.1.smithi112.stdout:7/459: creat d7/d25/d37/f89 x:0 0 0 2024-04-25T02:09:09.613 INFO:tasks.workunit.client.1.smithi112.stdout:7/460: chown d7/d25/d37/d41 8 1 2024-04-25T02:09:09.615 INFO:tasks.workunit.client.1.smithi112.stdout:4/473: symlink d2/d1e/d1b/d86/l8f 0 2024-04-25T02:09:09.615 INFO:tasks.workunit.client.1.smithi112.stdout:3/462: getdents d12/d5d 0 2024-04-25T02:09:09.618 INFO:tasks.workunit.client.1.smithi112.stdout:4/474: rmdir d2/d17/d20/d26 39 2024-04-25T02:09:09.622 INFO:tasks.workunit.client.1.smithi112.stdout:3/463: creat d12/d1f/d27/d44/f92 x:0 0 0 2024-04-25T02:09:09.623 INFO:tasks.workunit.client.1.smithi112.stdout:4/475: creat d2/d1e/d1b/d83/f90 x:0 0 0 2024-04-25T02:09:09.627 INFO:tasks.workunit.client.1.smithi112.stdout:3/464: rename d12/d13/d34/d53/f6d to d12/d13/d34/d78/d83/f93 0 2024-04-25T02:09:09.629 INFO:tasks.workunit.client.1.smithi112.stdout:7/461: dwrite d7/f61 [0,4194304] 0 2024-04-25T02:09:09.629 INFO:tasks.workunit.client.1.smithi112.stdout:7/462: fsync d7/d25/d40/d6b/f7b 0 2024-04-25T02:09:09.629 INFO:tasks.workunit.client.1.smithi112.stdout:3/465: fdatasync d12/d13/f31 0 2024-04-25T02:09:09.636 INFO:tasks.workunit.client.1.smithi112.stdout:8/592: sync 2024-04-25T02:09:09.636 INFO:tasks.workunit.client.1.smithi112.stdout:1/468: sync 2024-04-25T02:09:09.636 INFO:tasks.workunit.client.1.smithi112.stdout:8/593: read - d15/d35/fae zero size 2024-04-25T02:09:09.636 INFO:tasks.workunit.client.1.smithi112.stdout:1/469: stat d7/d9/l6f 0 2024-04-25T02:09:09.636 INFO:tasks.workunit.client.1.smithi112.stdout:8/594: truncate d15/d35/d5c/d91/f45 3253840 0 2024-04-25T02:09:09.640 INFO:tasks.workunit.client.1.smithi112.stdout:4/476: dwrite d2/d17/d20/d26/d39/f68 [0,4194304] 0 2024-04-25T02:09:09.640 INFO:tasks.workunit.client.1.smithi112.stdout:4/477: creat d2/d17/d25/f91 x:0 0 0 2024-04-25T02:09:09.642 INFO:tasks.workunit.client.1.smithi112.stdout:7/463: dread d7/dd/d20/d2c/f45 [0,4194304] 0 2024-04-25T02:09:09.642 INFO:tasks.workunit.client.1.smithi112.stdout:7/464: stat d7/dd/d20/d36/l78 0 2024-04-25T02:09:09.643 INFO:tasks.workunit.client.1.smithi112.stdout:4/478: mknod d2/d17/d20/d5e/c92 0 2024-04-25T02:09:09.643 INFO:tasks.workunit.client.1.smithi112.stdout:4/479: dread - d2/d17/d25/f7b zero size 2024-04-25T02:09:09.647 INFO:tasks.workunit.client.1.smithi112.stdout:7/465: truncate d7/dd/f4a 5909086 0 2024-04-25T02:09:09.651 INFO:tasks.workunit.client.1.smithi112.stdout:7/466: rename d7/f72 to d7/dd/d88/f8a 0 2024-04-25T02:09:09.654 INFO:tasks.workunit.client.1.smithi112.stdout:7/467: rename d7/d25/d40/d6b/f7b to d7/dd/d20/d36/f8b 0 2024-04-25T02:09:09.655 INFO:tasks.workunit.client.1.smithi112.stdout:7/468: write d7/d25/d40/f80 [241070,101551] 0 2024-04-25T02:09:09.655 INFO:tasks.workunit.client.1.smithi112.stdout:7/469: chown d7/d25/d37/d74 1 1 2024-04-25T02:09:09.657 INFO:tasks.workunit.client.1.smithi112.stdout:7/470: unlink d7/dd/d20/d36/f81 0 2024-04-25T02:09:09.659 INFO:tasks.workunit.client.1.smithi112.stdout:7/471: creat d7/dd/d20/d2c/f8c x:0 0 0 2024-04-25T02:09:09.659 INFO:tasks.workunit.client.1.smithi112.stdout:7/472: write d7/f1e [1096323,54273] 0 2024-04-25T02:09:09.659 INFO:tasks.workunit.client.1.smithi112.stdout:7/473: write d7/fc [1259895,50530] 0 2024-04-25T02:09:09.661 INFO:tasks.workunit.client.1.smithi112.stdout:7/474: truncate d7/d25/d37/f5e 2676839 0 2024-04-25T02:09:09.661 INFO:tasks.workunit.client.1.smithi112.stdout:7/475: write d7/dd/d20/d2c/f8c [554122,75419] 0 2024-04-25T02:09:09.663 INFO:tasks.workunit.client.1.smithi112.stdout:7/476: symlink d7/d25/d40/l8d 0 2024-04-25T02:09:09.663 INFO:tasks.workunit.client.1.smithi112.stdout:7/477: chown d7/c35 0 1 2024-04-25T02:09:09.664 INFO:tasks.workunit.client.1.smithi112.stdout:7/478: creat d7/d25/d43/d46/f8e x:0 0 0 2024-04-25T02:09:09.665 INFO:tasks.workunit.client.1.smithi112.stdout:7/479: truncate d7/d25/d43/d46/f42 1260893 0 2024-04-25T02:09:09.666 INFO:tasks.workunit.client.1.smithi112.stdout:7/480: creat d7/d25/d43/f8f x:0 0 0 2024-04-25T02:09:09.666 INFO:tasks.workunit.client.1.smithi112.stdout:1/470: dwrite d7/d9/d4e/d28/d32/f68 [0,4194304] 0 2024-04-25T02:09:09.666 INFO:tasks.workunit.client.1.smithi112.stdout:7/481: symlink d7/dd/d20/l90 0 2024-04-25T02:09:09.668 INFO:tasks.workunit.client.1.smithi112.stdout:8/595: dwrite d15/d26/f29 [0,4194304] 0 2024-04-25T02:09:09.669 INFO:tasks.workunit.client.1.smithi112.stdout:1/471: mkdir d7/d4b/d94 0 2024-04-25T02:09:09.670 INFO:tasks.workunit.client.1.smithi112.stdout:4/480: dwrite d2/d17/d20/d26/d39/d49/f56 [0,4194304] 0 2024-04-25T02:09:09.670 INFO:tasks.workunit.client.1.smithi112.stdout:7/482: mkdir d7/d25/d40/d6b/d91 0 2024-04-25T02:09:09.670 INFO:tasks.workunit.client.1.smithi112.stdout:7/483: creat d7/d25/d43/d46/f92 x:0 0 0 2024-04-25T02:09:09.671 INFO:tasks.workunit.client.1.smithi112.stdout:8/596: symlink d15/d26/d37/da8/lcc 0 2024-04-25T02:09:09.672 INFO:tasks.workunit.client.1.smithi112.stdout:1/472: symlink d7/d9/d46/l95 0 2024-04-25T02:09:09.673 INFO:tasks.workunit.client.1.smithi112.stdout:4/481: creat d2/d1e/d1b/f93 x:0 0 0 2024-04-25T02:09:09.673 INFO:tasks.workunit.client.1.smithi112.stdout:4/482: getdents d2/d17/d20/d5e/d87 0 2024-04-25T02:09:09.674 INFO:tasks.workunit.client.1.smithi112.stdout:4/483: chown d2/d1e/f35 51646032 1 2024-04-25T02:09:09.675 INFO:tasks.workunit.client.1.smithi112.stdout:8/597: mkdir d15/d26/d4f/d67/dcd 0 2024-04-25T02:09:09.676 INFO:tasks.workunit.client.1.smithi112.stdout:4/484: symlink d2/d17/l94 0 2024-04-25T02:09:09.678 INFO:tasks.workunit.client.1.smithi112.stdout:8/598: mkdir d15/d81/dce 0 2024-04-25T02:09:09.678 INFO:tasks.workunit.client.1.smithi112.stdout:8/599: write d15/d35/f98 [843934,48369] 0 2024-04-25T02:09:09.679 INFO:tasks.workunit.client.1.smithi112.stdout:4/485: getdents d2/d17/d25/d3f 0 2024-04-25T02:09:09.680 INFO:tasks.workunit.client.1.smithi112.stdout:4/486: truncate d2/d12/d22/d60/f7f 151440 0 2024-04-25T02:09:09.681 INFO:tasks.workunit.client.1.smithi112.stdout:7/484: write d7/dd/f21 [1047358,104052] 0 2024-04-25T02:09:09.682 INFO:tasks.workunit.client.1.smithi112.stdout:1/473: dread d7/d9/f10 [0,4194304] 0 2024-04-25T02:09:09.683 INFO:tasks.workunit.client.1.smithi112.stdout:4/487: mkdir d2/d17/d20/d26/d39/d49/d95 0 2024-04-25T02:09:09.686 INFO:tasks.workunit.client.1.smithi112.stdout:7/485: mknod d7/d25/d37/d7f/c93 0 2024-04-25T02:09:09.690 INFO:tasks.workunit.client.1.smithi112.stdout:8/600: rename d15/d40/l77 to d15/d17/d1a/lcf 0 2024-04-25T02:09:09.691 INFO:tasks.workunit.client.1.smithi112.stdout:7/486: creat d7/d25/d37/d74/f94 x:0 0 0 2024-04-25T02:09:09.691 INFO:tasks.workunit.client.1.smithi112.stdout:7/487: write d7/f61 [4649559,27243] 0 2024-04-25T02:09:09.691 INFO:tasks.workunit.client.1.smithi112.stdout:7/488: readlink d7/d25/d40/d6b/l83 0 2024-04-25T02:09:09.697 INFO:tasks.workunit.client.1.smithi112.stdout:1/474: dwrite d7/d9/d46/f89 [0,4194304] 0 2024-04-25T02:09:09.697 INFO:tasks.workunit.client.1.smithi112.stdout:4/488: rename d2/d17/d20/f4f to d2/d17/d20/d26/f96 0 2024-04-25T02:09:09.700 INFO:tasks.workunit.client.1.smithi112.stdout:7/489: mknod d7/d25/c95 0 2024-04-25T02:09:09.701 INFO:tasks.workunit.client.1.smithi112.stdout:8/601: write d15/f42 [5462464,82555] 0 2024-04-25T02:09:09.709 INFO:tasks.workunit.client.1.smithi112.stdout:4/489: dread d2/d1e/f74 [0,4194304] 0 2024-04-25T02:09:09.712 INFO:tasks.workunit.client.1.smithi112.stdout:1/475: truncate d7/d9/d1f/f36 388343 0 2024-04-25T02:09:09.713 INFO:tasks.workunit.client.1.smithi112.stdout:7/490: unlink d7/c35 0 2024-04-25T02:09:09.716 INFO:tasks.workunit.client.1.smithi112.stdout:4/490: rmdir d2/d17/d20/d26/d39 39 2024-04-25T02:09:09.718 INFO:tasks.workunit.client.1.smithi112.stdout:1/476: link d7/d4b/f69 d7/d9/d1f/d25/d39/f96 0 2024-04-25T02:09:09.720 INFO:tasks.workunit.client.1.smithi112.stdout:4/491: rename d2/d1e/d4b/c8d to d2/d1e/d4b/d57/c97 0 2024-04-25T02:09:09.720 INFO:tasks.workunit.client.1.smithi112.stdout:4/492: chown d2/d17/d20/c45 8279874 1 2024-04-25T02:09:09.723 INFO:tasks.workunit.client.1.smithi112.stdout:1/477: dread d7/f24 [0,4194304] 0 2024-04-25T02:09:09.725 INFO:tasks.workunit.client.1.smithi112.stdout:1/478: getdents d7/d9/d1e/de 0 2024-04-25T02:09:09.726 INFO:tasks.workunit.client.1.smithi112.stdout:1/479: dread d7/d9/d4e/f62 [0,4194304] 0 2024-04-25T02:09:09.728 INFO:tasks.workunit.client.1.smithi112.stdout:1/480: rename f2 to d7/d9/d4e/d28/d3f/f97 0 2024-04-25T02:09:09.743 INFO:tasks.workunit.client.1.smithi112.stdout:7/491: dwrite d7/d25/d43/f47 [0,4194304] 0 2024-04-25T02:09:09.745 INFO:tasks.workunit.client.1.smithi112.stdout:7/492: rmdir d7/dd/d20/d36/d3a 39 2024-04-25T02:09:09.745 INFO:tasks.workunit.client.1.smithi112.stdout:4/493: dwrite d2/d17/d20/f6b [0,4194304] 0 2024-04-25T02:09:09.745 INFO:tasks.workunit.client.1.smithi112.stdout:1/481: dwrite d7/d9/d1e/d40/f57 [0,4194304] 0 2024-04-25T02:09:09.745 INFO:tasks.workunit.client.1.smithi112.stdout:1/482: chown d7/d9/d1f/d25/f30 20854023 1 2024-04-25T02:09:09.750 INFO:tasks.workunit.client.1.smithi112.stdout:1/483: creat d7/d9/d4e/d72/d73/f98 x:0 0 0 2024-04-25T02:09:09.756 INFO:tasks.workunit.client.1.smithi112.stdout:1/484: symlink d7/d9/d4e/d72/l99 0 2024-04-25T02:09:09.758 INFO:tasks.workunit.client.1.smithi112.stdout:1/485: mkdir d7/d9/d1e/de/d9a 0 2024-04-25T02:09:09.760 INFO:tasks.workunit.client.1.smithi112.stdout:1/486: mknod d7/d9/d1e/de/c9b 0 2024-04-25T02:09:09.768 INFO:tasks.workunit.client.1.smithi112.stdout:7/493: dwrite d7/d25/d37/f71 [0,4194304] 0 2024-04-25T02:09:09.768 INFO:tasks.workunit.client.1.smithi112.stdout:4/494: dwrite d2/f27 [0,4194304] 0 2024-04-25T02:09:09.769 INFO:tasks.workunit.client.1.smithi112.stdout:6/476: sync 2024-04-25T02:09:09.769 INFO:tasks.workunit.client.1.smithi112.stdout:2/342: sync 2024-04-25T02:09:09.769 INFO:tasks.workunit.client.1.smithi112.stdout:2/343: read d3/f9 [5761172,43183] 0 2024-04-25T02:09:09.772 INFO:tasks.workunit.client.1.smithi112.stdout:7/494: link d7/d25/d43/d46/f8e d7/dd/d20/f96 0 2024-04-25T02:09:09.774 INFO:tasks.workunit.client.1.smithi112.stdout:6/477: dread d0/d2/d4/f1d [0,4194304] 0 2024-04-25T02:09:09.774 INFO:tasks.workunit.client.1.smithi112.stdout:4/495: symlink d2/d4e/l98 0 2024-04-25T02:09:09.775 INFO:tasks.workunit.client.1.smithi112.stdout:7/495: dread d7/d25/d43/f2a [0,4194304] 0 2024-04-25T02:09:09.777 INFO:tasks.workunit.client.1.smithi112.stdout:6/478: mkdir d0/d2/d66/da8 0 2024-04-25T02:09:09.777 INFO:tasks.workunit.client.1.smithi112.stdout:6/479: fdatasync d0/d2/d4/d28/f57 0 2024-04-25T02:09:09.778 INFO:tasks.workunit.client.1.smithi112.stdout:4/496: mkdir d2/d1e/d1b/d86/d99 0 2024-04-25T02:09:09.778 INFO:tasks.workunit.client.1.smithi112.stdout:4/497: chown d2/d1e/d1b/d86/l8f 287726 1 2024-04-25T02:09:09.780 INFO:tasks.workunit.client.1.smithi112.stdout:7/496: link d7/d25/d43/d46/c66 d7/d25/d40/d6b/c97 0 2024-04-25T02:09:09.782 INFO:tasks.workunit.client.1.smithi112.stdout:4/498: mknod d2/d1e/d1b/c9a 0 2024-04-25T02:09:09.782 INFO:tasks.workunit.client.1.smithi112.stdout:4/499: fdatasync d2/d17/d20/d26/f96 0 2024-04-25T02:09:09.783 INFO:tasks.workunit.client.1.smithi112.stdout:7/497: creat d7/d25/d40/d6b/d91/f98 x:0 0 0 2024-04-25T02:09:09.784 INFO:tasks.workunit.client.1.smithi112.stdout:7/498: rmdir d7/d25/d40/d6b 39 2024-04-25T02:09:09.786 INFO:tasks.workunit.client.1.smithi112.stdout:7/499: rename d7/c39 to d7/d25/d37/d7f/c99 0 2024-04-25T02:09:09.786 INFO:tasks.workunit.client.1.smithi112.stdout:7/500: write d7/f1e [783754,59091] 0 2024-04-25T02:09:09.791 INFO:tasks.workunit.client.1.smithi112.stdout:4/500: dread d2/d17/d20/d5e/f6c [0,4194304] 0 2024-04-25T02:09:09.791 INFO:tasks.workunit.client.1.smithi112.stdout:4/501: dread - d2/d17/d25/f91 zero size 2024-04-25T02:09:09.799 INFO:tasks.workunit.client.1.smithi112.stdout:7/501: dwrite d7/dd/d20/f5c [0,4194304] 0 2024-04-25T02:09:09.799 INFO:tasks.workunit.client.1.smithi112.stdout:7/502: stat d7/dd/d88 0 2024-04-25T02:09:09.810 INFO:tasks.workunit.client.1.smithi112.stdout:7/503: dread d7/f1e [0,4194304] 0 2024-04-25T02:09:09.814 INFO:tasks.workunit.client.1.smithi112.stdout:7/504: write d7/d25/d37/f5e [337982,114677] 0 2024-04-25T02:09:09.886 INFO:tasks.workunit.client.1.smithi112.stdout:4/502: creat d2/d17/d20/d26/f9b x:0 0 0 2024-04-25T02:09:09.888 INFO:tasks.workunit.client.1.smithi112.stdout:7/505: mknod d7/d25/d40/d51/c9a 0 2024-04-25T02:09:09.891 INFO:tasks.workunit.client.1.smithi112.stdout:4/503: rename d2/d1e/d1b/d86/d99 to d2/d17/d7c/d9c 0 2024-04-25T02:09:09.892 INFO:tasks.workunit.client.1.smithi112.stdout:7/506: creat d7/dd/d20/d36/f9b x:0 0 0 2024-04-25T02:09:09.894 INFO:tasks.workunit.client.1.smithi112.stdout:4/504: creat d2/d17/d7c/d9c/f9d x:0 0 0 2024-04-25T02:09:09.895 INFO:tasks.workunit.client.1.smithi112.stdout:7/507: link d7/f61 d7/d25/d37/d53/f9c 0 2024-04-25T02:09:09.897 INFO:tasks.workunit.client.1.smithi112.stdout:7/508: creat d7/dd/d20/d36/d3a/f9d x:0 0 0 2024-04-25T02:09:09.897 INFO:tasks.workunit.client.1.smithi112.stdout:7/509: stat d7/dd/d20/d36/c7e 0 2024-04-25T02:09:09.898 INFO:tasks.workunit.client.1.smithi112.stdout:4/505: getdents d2/d17 0 2024-04-25T02:09:09.901 INFO:tasks.workunit.client.1.smithi112.stdout:4/506: unlink d2/d4e/l98 0 2024-04-25T02:09:09.903 INFO:tasks.workunit.client.1.smithi112.stdout:4/507: symlink d2/d1e/d1b/d65/l9e 0 2024-04-25T02:09:09.910 INFO:tasks.workunit.client.1.smithi112.stdout:4/508: dread d2/d12/f44 [0,4194304] 0 2024-04-25T02:09:09.912 INFO:tasks.workunit.client.1.smithi112.stdout:4/509: symlink d2/d17/d20/d26/d39/d49/l9f 0 2024-04-25T02:09:09.914 INFO:tasks.workunit.client.1.smithi112.stdout:7/510: dwrite d7/dd/d20/d2c/f45 [0,4194304] 0 2024-04-25T02:09:09.914 INFO:tasks.workunit.client.1.smithi112.stdout:7/511: chown d7/f16 60316 1 2024-04-25T02:09:09.914 INFO:tasks.workunit.client.1.smithi112.stdout:4/510: unlink d2/f1f 0 2024-04-25T02:09:09.919 INFO:tasks.workunit.client.1.smithi112.stdout:7/512: dread d7/dd/f21 [0,4194304] 0 2024-04-25T02:09:09.920 INFO:tasks.workunit.client.1.smithi112.stdout:7/513: dread - d7/d25/d40/d6b/d91/f98 zero size 2024-04-25T02:09:09.920 INFO:tasks.workunit.client.1.smithi112.stdout:7/514: rmdir d7/d25/d40 39 2024-04-25T02:09:09.922 INFO:tasks.workunit.client.1.smithi112.stdout:4/511: dread d2/d17/d20/f6b [0,4194304] 0 2024-04-25T02:09:09.922 INFO:tasks.workunit.client.1.smithi112.stdout:0/642: sync 2024-04-25T02:09:09.922 INFO:tasks.workunit.client.1.smithi112.stdout:9/435: sync 2024-04-25T02:09:09.924 INFO:tasks.workunit.client.1.smithi112.stdout:7/515: stat d7/dd/d20/d36/l4e 0 2024-04-25T02:09:09.924 INFO:tasks.workunit.client.1.smithi112.stdout:7/516: readlink d7/d25/l55 0 2024-04-25T02:09:09.929 INFO:tasks.workunit.client.1.smithi112.stdout:4/512: link d2/d17/d20/d26/f9b d2/d1e/d4b/d57/fa0 0 2024-04-25T02:09:09.930 INFO:tasks.workunit.client.1.smithi112.stdout:7/517: truncate d7/d25/d37/d53/f9c 1125860 0 2024-04-25T02:09:09.941 INFO:tasks.workunit.client.1.smithi112.stdout:0/643: dwrite da/d1d/d2e/d40/d49/d6b/fae [0,4194304] 0 2024-04-25T02:09:09.941 INFO:tasks.workunit.client.1.smithi112.stdout:0/644: fdatasync da/d1d/d88/d78/fab 0 2024-04-25T02:09:09.942 INFO:tasks.workunit.client.1.smithi112.stdout:9/436: dwrite d1/df/d3c/d6c/f97 [0,4194304] 0 2024-04-25T02:09:09.948 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:09 smithi112 ceph-mon[33313]: pgmap v264: 65 pgs: 65 active+clean; 2.6 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 160 MiB/s rd, 214 MiB/s wr, 351 op/s 2024-04-25T02:09:09.952 INFO:tasks.workunit.client.1.smithi112.stdout:9/437: truncate d1/fd 1954604 0 2024-04-25T02:09:09.952 INFO:tasks.workunit.client.1.smithi112.stdout:9/438: write d1/df/d3c/d46/f78 [1743317,24468] 0 2024-04-25T02:09:09.955 INFO:tasks.workunit.client.1.smithi112.stdout:0/645: dwrite da/d1d/d2e/d40/d49/d6b/d90/fac [0,4194304] 0 2024-04-25T02:09:09.955 INFO:tasks.workunit.client.1.smithi112.stdout:9/439: symlink d1/d13/d5b/l9c 0 2024-04-25T02:09:09.955 INFO:tasks.workunit.client.1.smithi112.stdout:9/440: fdatasync d1/d13/f47 0 2024-04-25T02:09:09.964 INFO:tasks.workunit.client.1.smithi112.stdout:0/646: creat da/d1d/d2e/d40/d49/d6b/d90/fc6 x:0 0 0 2024-04-25T02:09:09.966 INFO:tasks.workunit.client.1.smithi112.stdout:9/441: creat d1/d13/f9d x:0 0 0 2024-04-25T02:09:09.966 INFO:tasks.workunit.client.1.smithi112.stdout:9/442: creat d1/df/d3c/d6c/f9e x:0 0 0 2024-04-25T02:09:09.966 INFO:tasks.workunit.client.1.smithi112.stdout:9/443: creat d1/d13/f9f x:0 0 0 2024-04-25T02:09:09.966 INFO:tasks.workunit.client.1.smithi112.stdout:9/444: stat d1/d13/l16 0 2024-04-25T02:09:09.967 INFO:tasks.workunit.client.1.smithi112.stdout:0/647: symlink da/d13/d23/lc7 0 2024-04-25T02:09:09.972 INFO:tasks.workunit.client.1.smithi112.stdout:0/648: dread da/d1d/d88/d24/f33 [4194304,4194304] 0 2024-04-25T02:09:09.975 INFO:tasks.workunit.client.1.smithi112.stdout:9/445: rmdir d1/d13 39 2024-04-25T02:09:09.978 INFO:tasks.workunit.client.1.smithi112.stdout:9/446: mknod d1/d13/d5b/d55/d63/ca0 0 2024-04-25T02:09:09.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:09 smithi077 ceph-mon[26330]: pgmap v264: 65 pgs: 65 active+clean; 2.6 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 160 MiB/s rd, 214 MiB/s wr, 351 op/s 2024-04-25T02:09:09.981 INFO:tasks.workunit.client.1.smithi112.stdout:0/649: write da/d13/d45/d5e/d7a/f99 [36430,34059] 0 2024-04-25T02:09:09.981 INFO:tasks.workunit.client.1.smithi112.stdout:0/650: fdatasync da/d1d/d88/d78/fab 0 2024-04-25T02:09:09.982 INFO:tasks.workunit.client.1.smithi112.stdout:0/651: mknod da/d13/d45/cc8 0 2024-04-25T02:09:09.984 INFO:tasks.workunit.client.1.smithi112.stdout:0/652: creat da/d1d/d2e/d40/fc9 x:0 0 0 2024-04-25T02:09:09.984 INFO:tasks.workunit.client.1.smithi112.stdout:0/653: chown da/d1d/d2e/d40/f41 34092 1 2024-04-25T02:09:09.988 INFO:tasks.workunit.client.1.smithi112.stdout:0/654: creat da/d13/d45/d5e/fca x:0 0 0 2024-04-25T02:09:09.994 INFO:tasks.workunit.client.1.smithi112.stdout:9/447: dwrite d1/d13/f9f [0,4194304] 0 2024-04-25T02:09:09.997 INFO:tasks.workunit.client.1.smithi112.stdout:9/448: mknod d1/d13/d41/ca1 0 2024-04-25T02:09:10.003 INFO:tasks.workunit.client.1.smithi112.stdout:9/449: dread d1/d13/d5b/f61 [0,4194304] 0 2024-04-25T02:09:10.004 INFO:tasks.workunit.client.1.smithi112.stdout:0/655: dwrite da/d1d/d2e/d40/d49/d6b/f87 [0,4194304] 0 2024-04-25T02:09:10.004 INFO:tasks.workunit.client.1.smithi112.stdout:0/656: write da/d1d/d2e/d40/d49/d6b/d90/fc6 [942603,125201] 0 2024-04-25T02:09:10.005 INFO:tasks.workunit.client.1.smithi112.stdout:9/450: mknod d1/df/ca2 0 2024-04-25T02:09:10.007 INFO:tasks.workunit.client.1.smithi112.stdout:0/657: mkdir da/d1d/dcb 0 2024-04-25T02:09:10.009 INFO:tasks.workunit.client.1.smithi112.stdout:0/658: creat da/d1d/dbe/fcc x:0 0 0 2024-04-25T02:09:10.010 INFO:tasks.workunit.client.1.smithi112.stdout:0/659: mknod da/d1d/d88/d80/ccd 0 2024-04-25T02:09:10.012 INFO:tasks.workunit.client.1.smithi112.stdout:0/660: creat da/d1d/d2e/d40/d49/d4f/d58/d6d/fce x:0 0 0 2024-04-25T02:09:10.016 INFO:tasks.workunit.client.1.smithi112.stdout:3/466: sync 2024-04-25T02:09:10.016 INFO:tasks.workunit.client.1.smithi112.stdout:5/383: sync 2024-04-25T02:09:10.017 INFO:tasks.workunit.client.1.smithi112.stdout:3/467: stat d12/d13/f47 0 2024-04-25T02:09:10.017 INFO:tasks.workunit.client.1.smithi112.stdout:5/384: chown d1/d2/d4/d1d/f70 495 1 2024-04-25T02:09:10.018 INFO:tasks.workunit.client.1.smithi112.stdout:3/468: truncate d12/d1f/d27/f2b 1675613 0 2024-04-25T02:09:10.019 INFO:tasks.workunit.client.1.smithi112.stdout:5/385: symlink d1/d2/d4/l84 0 2024-04-25T02:09:10.020 INFO:tasks.workunit.client.1.smithi112.stdout:0/661: dread da/d1d/d2e/d40/d49/d6b/d90/fac [0,4194304] 0 2024-04-25T02:09:10.021 INFO:tasks.workunit.client.1.smithi112.stdout:3/469: creat d12/d13/d34/d78/d83/f94 x:0 0 0 2024-04-25T02:09:10.021 INFO:tasks.workunit.client.1.smithi112.stdout:3/470: readlink d12/d13/d34/l5f 0 2024-04-25T02:09:10.021 INFO:tasks.workunit.client.1.smithi112.stdout:9/451: dwrite d1/d13/d41/d84/f95 [0,4194304] 0 2024-04-25T02:09:10.022 INFO:tasks.workunit.client.1.smithi112.stdout:5/386: dread d1/d2/d28/d4f/f66 [0,4194304] 0 2024-04-25T02:09:10.024 INFO:tasks.workunit.client.1.smithi112.stdout:0/662: creat da/d13/fcf x:0 0 0 2024-04-25T02:09:10.027 INFO:tasks.workunit.client.1.smithi112.stdout:3/471: mkdir d12/d1f/d27/d44/d73/d95 0 2024-04-25T02:09:10.027 INFO:tasks.workunit.client.1.smithi112.stdout:3/472: write d12/d13/d34/d4a/f6b [46305,56604] 0 2024-04-25T02:09:10.027 INFO:tasks.workunit.client.1.smithi112.stdout:3/473: chown d12/d13/f30 88 1 2024-04-25T02:09:10.034 INFO:tasks.workunit.client.1.smithi112.stdout:3/474: dread d12/f63 [0,4194304] 0 2024-04-25T02:09:10.034 INFO:tasks.workunit.client.1.smithi112.stdout:3/475: stat d12/d13/d34/d53 0 2024-04-25T02:09:10.034 INFO:tasks.workunit.client.1.smithi112.stdout:9/452: rename d1/f10 to d1/d93/fa3 0 2024-04-25T02:09:10.039 INFO:tasks.workunit.client.1.smithi112.stdout:5/387: dwrite d1/d2/d78/f81 [0,4194304] 0 2024-04-25T02:09:10.040 INFO:tasks.workunit.client.1.smithi112.stdout:0/663: creat da/d13/d23/fd0 x:0 0 0 2024-04-25T02:09:10.047 INFO:tasks.workunit.client.1.smithi112.stdout:3/476: dread d12/d1f/d27/f28 [0,4194304] 0 2024-04-25T02:09:10.052 INFO:tasks.workunit.client.1.smithi112.stdout:9/453: dwrite d1/df/d8f/f94 [0,4194304] 0 2024-04-25T02:09:10.052 INFO:tasks.workunit.client.1.smithi112.stdout:9/454: write d1/d48/f5c [1007352,33889] 0 2024-04-25T02:09:10.055 INFO:tasks.workunit.client.1.smithi112.stdout:5/388: write d1/d2/d78/f81 [2528097,110392] 0 2024-04-25T02:09:10.055 INFO:tasks.workunit.client.1.smithi112.stdout:0/664: write da/d1d/d2e/d40/d49/d6b/f87 [787507,18547] 0 2024-04-25T02:09:10.058 INFO:tasks.workunit.client.1.smithi112.stdout:3/477: write d12/d13/d34/d53/f8d [1157777,86120] 0 2024-04-25T02:09:10.058 INFO:tasks.workunit.client.1.smithi112.stdout:9/455: write d1/df/d3c/d43/f4a [6612600,104768] 0 2024-04-25T02:09:10.059 INFO:tasks.workunit.client.1.smithi112.stdout:5/389: creat d1/d3f/f85 x:0 0 0 2024-04-25T02:09:10.059 INFO:tasks.workunit.client.1.smithi112.stdout:5/390: write d1/d16/f4d [1262980,44374] 0 2024-04-25T02:09:10.059 INFO:tasks.workunit.client.1.smithi112.stdout:5/391: creat d1/d2/d28/f86 x:0 0 0 2024-04-25T02:09:10.059 INFO:tasks.workunit.client.1.smithi112.stdout:5/392: write d1/d2/d4/d1d/f2a [4892303,110671] 0 2024-04-25T02:09:10.062 INFO:tasks.workunit.client.1.smithi112.stdout:0/665: rmdir da/d1d/d2e 39 2024-04-25T02:09:10.063 INFO:tasks.workunit.client.1.smithi112.stdout:3/478: truncate d12/d1f/d27/d44/f68 3741554 0 2024-04-25T02:09:10.063 INFO:tasks.workunit.client.1.smithi112.stdout:3/479: write d12/d13/d34/d4a/f6b [1027540,105211] 0 2024-04-25T02:09:10.067 INFO:tasks.workunit.client.1.smithi112.stdout:8/602: sync 2024-04-25T02:09:10.067 INFO:tasks.workunit.client.1.smithi112.stdout:1/487: sync 2024-04-25T02:09:10.067 INFO:tasks.workunit.client.1.smithi112.stdout:2/344: sync 2024-04-25T02:09:10.067 INFO:tasks.workunit.client.1.smithi112.stdout:1/488: write d7/d9/d1e/de/f65 [1615497,87827] 0 2024-04-25T02:09:10.067 INFO:tasks.workunit.client.1.smithi112.stdout:1/489: readlink d7/d9/l86 0 2024-04-25T02:09:10.069 INFO:tasks.workunit.client.1.smithi112.stdout:9/456: dread d1/f2b [0,4194304] 0 2024-04-25T02:09:10.069 INFO:tasks.workunit.client.1.smithi112.stdout:9/457: fdatasync d1/d93/fa3 0 2024-04-25T02:09:10.070 INFO:tasks.workunit.client.1.smithi112.stdout:0/666: creat da/d1d/dcb/fd1 x:0 0 0 2024-04-25T02:09:10.070 INFO:tasks.workunit.client.1.smithi112.stdout:0/667: creat da/d1d/d2e/d40/d49/d6b/fd2 x:0 0 0 2024-04-25T02:09:10.076 INFO:tasks.workunit.client.1.smithi112.stdout:8/603: symlink d15/d40/ld0 0 2024-04-25T02:09:10.076 INFO:tasks.workunit.client.1.smithi112.stdout:8/604: read - d15/d17/fa2 zero size 2024-04-25T02:09:10.076 INFO:tasks.workunit.client.1.smithi112.stdout:8/605: truncate d15/d26/f9f 302770 0 2024-04-25T02:09:10.076 INFO:tasks.workunit.client.1.smithi112.stdout:8/606: write d15/d35/d56/f99 [534685,75929] 0 2024-04-25T02:09:10.077 INFO:tasks.workunit.client.1.smithi112.stdout:2/345: creat d3/da/dc/f7a x:0 0 0 2024-04-25T02:09:10.078 INFO:tasks.workunit.client.1.smithi112.stdout:1/490: mknod d7/d9/d1e/d40/c9c 0 2024-04-25T02:09:10.080 INFO:tasks.workunit.client.1.smithi112.stdout:9/458: rename d1/d13/d5b/d55/f57 to d1/d13/d5b/d55/fa4 0 2024-04-25T02:09:10.082 INFO:tasks.workunit.client.1.smithi112.stdout:9/459: dread d1/f38 [0,4194304] 0 2024-04-25T02:09:10.085 INFO:tasks.workunit.client.1.smithi112.stdout:8/607: rename d15/d35/d5c/d5e/d85/f86 to d15/fd1 0 2024-04-25T02:09:10.085 INFO:tasks.workunit.client.1.smithi112.stdout:8/608: dread - d15/d26/d4f/fb2 zero size 2024-04-25T02:09:10.085 INFO:tasks.workunit.client.1.smithi112.stdout:8/609: chown d15/d26/d37/d8e/c71 368749 1 2024-04-25T02:09:10.086 INFO:tasks.workunit.client.1.smithi112.stdout:2/346: mknod d3/da/dc/d20/d43/d5e/c7b 0 2024-04-25T02:09:10.089 INFO:tasks.workunit.client.1.smithi112.stdout:1/491: symlink d7/d9/d1e/de/d84/l9d 0 2024-04-25T02:09:10.089 INFO:tasks.workunit.client.1.smithi112.stdout:1/492: chown d7/d9/d1e/de/c92 138 1 2024-04-25T02:09:10.089 INFO:tasks.workunit.client.1.smithi112.stdout:1/493: readlink d7/d9/d1e/l41 0 2024-04-25T02:09:10.091 INFO:tasks.workunit.client.1.smithi112.stdout:9/460: creat d1/d13/d41/fa5 x:0 0 0 2024-04-25T02:09:10.093 INFO:tasks.workunit.client.1.smithi112.stdout:8/610: symlink d15/d26/d37/ld2 0 2024-04-25T02:09:10.097 INFO:tasks.workunit.client.1.smithi112.stdout:2/347: mkdir d3/da/dc/d3e/df/d30/d7c 0 2024-04-25T02:09:10.097 INFO:tasks.workunit.client.1.smithi112.stdout:2/348: readlink d3/da/dc/l1a 0 2024-04-25T02:09:10.097 INFO:tasks.workunit.client.1.smithi112.stdout:2/349: chown d3/da/dc/d3e/l4f 1218090 1 2024-04-25T02:09:10.097 INFO:tasks.workunit.client.1.smithi112.stdout:2/350: write d3/da/dc/d20/d40/f79 [572136,39059] 0 2024-04-25T02:09:10.098 INFO:tasks.workunit.client.1.smithi112.stdout:9/461: dread d1/d48/f5c [0,4194304] 0 2024-04-25T02:09:10.098 INFO:tasks.workunit.client.1.smithi112.stdout:2/351: rmdir d3/da/dc/d20/d40 39 2024-04-25T02:09:10.100 INFO:tasks.workunit.client.1.smithi112.stdout:8/611: dread d15/f2c [0,4194304] 0 2024-04-25T02:09:10.100 INFO:tasks.workunit.client.1.smithi112.stdout:8/612: write d15/f42 [5666929,56292] 0 2024-04-25T02:09:10.101 INFO:tasks.workunit.client.1.smithi112.stdout:8/613: write d15/f7e [195333,82088] 0 2024-04-25T02:09:10.101 INFO:tasks.workunit.client.1.smithi112.stdout:8/614: stat d15/d35/d5c/db8 0 2024-04-25T02:09:10.101 INFO:tasks.workunit.client.1.smithi112.stdout:3/480: dwrite d12/d13/f47 [0,4194304] 0 2024-04-25T02:09:10.101 INFO:tasks.workunit.client.1.smithi112.stdout:2/352: truncate d3/f9 4849129 0 2024-04-25T02:09:10.105 INFO:tasks.workunit.client.1.smithi112.stdout:8/615: creat d15/d35/d5c/d5e/d85/fd3 x:0 0 0 2024-04-25T02:09:10.105 INFO:tasks.workunit.client.1.smithi112.stdout:8/616: truncate f10 9732510 0 2024-04-25T02:09:10.105 INFO:tasks.workunit.client.1.smithi112.stdout:8/617: fsync d15/d35/f4c 0 2024-04-25T02:09:10.105 INFO:tasks.workunit.client.1.smithi112.stdout:8/618: write d15/f28 [3226105,6819] 0 2024-04-25T02:09:10.106 INFO:tasks.workunit.client.1.smithi112.stdout:3/481: symlink d12/d1f/d27/d44/d73/l96 0 2024-04-25T02:09:10.108 INFO:tasks.workunit.client.1.smithi112.stdout:1/494: dwrite f4 [0,4194304] 0 2024-04-25T02:09:10.109 INFO:tasks.workunit.client.1.smithi112.stdout:2/353: creat d3/da/dc/d3e/df/d30/d7c/f7d x:0 0 0 2024-04-25T02:09:10.109 INFO:tasks.workunit.client.1.smithi112.stdout:2/354: chown d3/da/dc/d20/d43/c5d 51866280 1 2024-04-25T02:09:10.109 INFO:tasks.workunit.client.1.smithi112.stdout:2/355: fsync d3/da/dc/d3e/f3c 0 2024-04-25T02:09:10.114 INFO:tasks.workunit.client.1.smithi112.stdout:9/462: fsync d1/d13/d41/fa5 0 2024-04-25T02:09:10.120 INFO:tasks.workunit.client.1.smithi112.stdout:2/356: dread d3/f33 [0,4194304] 0 2024-04-25T02:09:10.122 INFO:tasks.workunit.client.1.smithi112.stdout:1/495: unlink d7/d9/d46/l7a 0 2024-04-25T02:09:10.122 INFO:tasks.workunit.client.1.smithi112.stdout:1/496: fsync d7/d9/d1f/f63 0 2024-04-25T02:09:10.124 INFO:tasks.workunit.client.1.smithi112.stdout:2/357: mkdir d3/da/dc/d20/d43/d7e 0 2024-04-25T02:09:10.125 INFO:tasks.workunit.client.1.smithi112.stdout:1/497: symlink d7/d9/d46/l9e 0 2024-04-25T02:09:10.127 INFO:tasks.workunit.client.1.smithi112.stdout:2/358: creat d3/d62/f7f x:0 0 0 2024-04-25T02:09:10.127 INFO:tasks.workunit.client.1.smithi112.stdout:2/359: read - d3/da/dc/d3e/df/d25/f77 zero size 2024-04-25T02:09:10.128 INFO:tasks.workunit.client.1.smithi112.stdout:1/498: link d7/d9/d1e/de/f3b d7/d9/d1e/de/d84/f9f 0 2024-04-25T02:09:10.128 INFO:tasks.workunit.client.1.smithi112.stdout:1/499: fdatasync d7/d9/d4e/d28/d32/f4f 0 2024-04-25T02:09:10.130 INFO:tasks.workunit.client.1.smithi112.stdout:2/360: rename d3/da/dc/d3e/f69 to d3/da/dc/d20/d43/d74/f80 0 2024-04-25T02:09:10.133 INFO:tasks.workunit.client.1.smithi112.stdout:1/500: rename d7/d9/d4e/c44 to d7/d9/d4e/d72/ca0 0 2024-04-25T02:09:10.133 INFO:tasks.workunit.client.1.smithi112.stdout:8/619: dwrite d15/d26/f92 [0,4194304] 0 2024-04-25T02:09:10.134 INFO:tasks.workunit.client.1.smithi112.stdout:3/482: dwrite d12/f63 [0,4194304] 0 2024-04-25T02:09:10.134 INFO:tasks.workunit.client.1.smithi112.stdout:9/463: dwrite d1/f1c [8388608,4194304] 0 2024-04-25T02:09:10.135 INFO:tasks.workunit.client.1.smithi112.stdout:9/464: dread - d1/d48/d65/f79 zero size 2024-04-25T02:09:10.136 INFO:tasks.workunit.client.1.smithi112.stdout:2/361: mkdir d3/d62/d81 0 2024-04-25T02:09:10.136 INFO:tasks.workunit.client.1.smithi112.stdout:2/362: creat d3/da/dc/d20/f82 x:0 0 0 2024-04-25T02:09:10.136 INFO:tasks.workunit.client.1.smithi112.stdout:2/363: fdatasync d3/da/dc/d20/f82 0 2024-04-25T02:09:10.136 INFO:tasks.workunit.client.1.smithi112.stdout:2/364: chown d3/da/dc/d3e/df/l22 23378 1 2024-04-25T02:09:10.142 INFO:tasks.workunit.client.1.smithi112.stdout:1/501: dread d7/d9/d1e/de/f27 [0,4194304] 0 2024-04-25T02:09:10.145 INFO:tasks.workunit.client.1.smithi112.stdout:8/620: truncate d15/d26/d4f/d67/f8d 2361945 0 2024-04-25T02:09:10.153 INFO:tasks.workunit.client.1.smithi112.stdout:3/483: mknod d12/c97 0 2024-04-25T02:09:10.153 INFO:tasks.workunit.client.1.smithi112.stdout:1/502: read d7/f4d [2621533,80638] 0 2024-04-25T02:09:10.155 INFO:tasks.workunit.client.1.smithi112.stdout:3/484: getdents d12/d13/d86 0 2024-04-25T02:09:10.155 INFO:tasks.workunit.client.1.smithi112.stdout:3/485: chown d12/d1f/d27/d44/f56 68048504 1 2024-04-25T02:09:10.156 INFO:tasks.workunit.client.1.smithi112.stdout:1/503: dread d7/d9/d4e/d28/d3f/f8d [0,4194304] 0 2024-04-25T02:09:10.156 INFO:tasks.workunit.client.1.smithi112.stdout:1/504: creat d7/d9/fa1 x:0 0 0 2024-04-25T02:09:10.157 INFO:tasks.workunit.client.1.smithi112.stdout:8/621: dread d15/d17/d1a/fb3 [0,4194304] 0 2024-04-25T02:09:10.157 INFO:tasks.workunit.client.1.smithi112.stdout:3/486: truncate d12/f1d 1648807 0 2024-04-25T02:09:10.161 INFO:tasks.workunit.client.1.smithi112.stdout:1/505: creat d7/d9/d46/fa2 x:0 0 0 2024-04-25T02:09:10.164 INFO:tasks.workunit.client.1.smithi112.stdout:9/465: dwrite d1/d13/d5b/f85 [0,4194304] 0 2024-04-25T02:09:10.165 INFO:tasks.workunit.client.1.smithi112.stdout:2/365: dwrite d3/da/dc/d20/d43/f56 [0,4194304] 0 2024-04-25T02:09:10.165 INFO:tasks.workunit.client.1.smithi112.stdout:2/366: write d3/da/dc/d3e/df/d25/f5f [5197013,32848] 0 2024-04-25T02:09:10.171 INFO:tasks.workunit.client.1.smithi112.stdout:3/487: creat d12/d1f/d27/d44/d73/f98 x:0 0 0 2024-04-25T02:09:10.174 INFO:tasks.workunit.client.1.smithi112.stdout:1/506: rename d7/d9/fa1 to d7/d9/d4e/d28/d3f/fa3 0 2024-04-25T02:09:10.176 INFO:tasks.workunit.client.1.smithi112.stdout:8/622: dwrite f6 [0,4194304] 0 2024-04-25T02:09:10.176 INFO:tasks.workunit.client.1.smithi112.stdout:8/623: stat d15/d35 0 2024-04-25T02:09:10.176 INFO:tasks.workunit.client.1.smithi112.stdout:8/624: creat d15/d26/d4f/fd4 x:0 0 0 2024-04-25T02:09:10.177 INFO:tasks.workunit.client.1.smithi112.stdout:8/625: dread - d15/d17/fa2 zero size 2024-04-25T02:09:10.177 INFO:tasks.workunit.client.1.smithi112.stdout:8/626: fsync d15/d35/d5c/f9e 0 2024-04-25T02:09:10.177 INFO:tasks.workunit.client.1.smithi112.stdout:8/627: read - d15/d17/fa2 zero size 2024-04-25T02:09:10.179 INFO:tasks.workunit.client.1.smithi112.stdout:9/466: truncate d1/fa 219681 0 2024-04-25T02:09:10.183 INFO:tasks.workunit.client.1.smithi112.stdout:9/467: read d1/d13/d5b/f61 [3224276,110625] 0 2024-04-25T02:09:10.185 INFO:tasks.workunit.client.1.smithi112.stdout:3/488: creat d12/d13/d86/f99 x:0 0 0 2024-04-25T02:09:10.185 INFO:tasks.workunit.client.1.smithi112.stdout:3/489: fsync d12/f14 0 2024-04-25T02:09:10.188 INFO:tasks.workunit.client.1.smithi112.stdout:8/628: mknod d15/d26/d4f/d67/cd5 0 2024-04-25T02:09:10.190 INFO:tasks.workunit.client.1.smithi112.stdout:1/507: dwrite d7/d9/d46/fa2 [0,4194304] 0 2024-04-25T02:09:10.191 INFO:tasks.workunit.client.1.smithi112.stdout:9/468: creat d1/d13/d41/d84/fa6 x:0 0 0 2024-04-25T02:09:10.193 INFO:tasks.workunit.client.1.smithi112.stdout:2/367: symlink d3/l83 0 2024-04-25T02:09:10.193 INFO:tasks.workunit.client.1.smithi112.stdout:2/368: creat d3/d62/f84 x:0 0 0 2024-04-25T02:09:10.193 INFO:tasks.workunit.client.1.smithi112.stdout:2/369: chown d3/da/dc/d20/f76 39 1 2024-04-25T02:09:10.194 INFO:tasks.workunit.client.1.smithi112.stdout:3/490: creat d12/d13/d34/f9a x:0 0 0 2024-04-25T02:09:10.201 INFO:tasks.workunit.client.1.smithi112.stdout:1/508: rename d7/f2c to d7/d4b/fa4 0 2024-04-25T02:09:10.202 INFO:tasks.workunit.client.1.smithi112.stdout:9/469: creat d1/df/d3c/d43/fa7 x:0 0 0 2024-04-25T02:09:10.205 INFO:tasks.workunit.client.1.smithi112.stdout:3/491: mknod d12/d13/d34/d4a/d87/c9b 0 2024-04-25T02:09:10.207 INFO:tasks.workunit.client.1.smithi112.stdout:1/509: link d7/d9/d4e/l4a d7/d9/d51/d83/la5 0 2024-04-25T02:09:10.207 INFO:tasks.workunit.client.1.smithi112.stdout:1/510: chown d7/d9/d51/d58/c8a 82566 1 2024-04-25T02:09:10.209 INFO:tasks.workunit.client.1.smithi112.stdout:9/470: creat d1/d13/d5b/fa8 x:0 0 0 2024-04-25T02:09:10.211 INFO:tasks.workunit.client.1.smithi112.stdout:3/492: unlink d12/d1f/f33 0 2024-04-25T02:09:10.211 INFO:tasks.workunit.client.1.smithi112.stdout:8/629: dwrite d15/d17/fa4 [0,4194304] 0 2024-04-25T02:09:10.211 INFO:tasks.workunit.client.1.smithi112.stdout:8/630: creat d15/d35/d5c/fd6 x:0 0 0 2024-04-25T02:09:10.211 INFO:tasks.workunit.client.1.smithi112.stdout:8/631: fdatasync d15/d26/d4f/d67/f8d 0 2024-04-25T02:09:10.211 INFO:tasks.workunit.client.1.smithi112.stdout:8/632: fsync d15/d40/d88/fbc 0 2024-04-25T02:09:10.213 INFO:tasks.workunit.client.1.smithi112.stdout:1/511: link l5 d7/d9/d4e/d85/la6 0 2024-04-25T02:09:10.216 INFO:tasks.workunit.client.1.smithi112.stdout:9/471: mkdir d1/d13/da9 0 2024-04-25T02:09:10.230 INFO:tasks.workunit.client.1.smithi112.stdout:9/472: dread d1/df/d3c/d6c/f97 [0,4194304] 0 2024-04-25T02:09:10.230 INFO:tasks.workunit.client.1.smithi112.stdout:9/473: fdatasync d1/df/d8f/f90 0 2024-04-25T02:09:10.243 INFO:tasks.workunit.client.1.smithi112.stdout:9/474: dread d1/df/d3c/d46/f99 [0,4194304] 0 2024-04-25T02:09:10.256 INFO:tasks.workunit.client.1.smithi112.stdout:2/370: dwrite d3/f73 [0,4194304] 0 2024-04-25T02:09:10.256 INFO:tasks.workunit.client.1.smithi112.stdout:8/633: dwrite d15/d35/d5c/f9e [0,4194304] 0 2024-04-25T02:09:10.256 INFO:tasks.workunit.client.1.smithi112.stdout:3/493: dwrite d12/d13/d86/f8b [0,4194304] 0 2024-04-25T02:09:10.256 INFO:tasks.workunit.client.1.smithi112.stdout:1/512: dwrite d7/d9/d4e/f62 [0,4194304] 0 2024-04-25T02:09:10.257 INFO:tasks.workunit.client.1.smithi112.stdout:1/513: creat d7/d9/d4e/d28/d3f/fa7 x:0 0 0 2024-04-25T02:09:10.258 INFO:tasks.workunit.client.1.smithi112.stdout:2/371: unlink d3/da/dc/d20/d43/f68 0 2024-04-25T02:09:10.259 INFO:tasks.workunit.client.1.smithi112.stdout:2/372: truncate d3/da/dc/d3e/f3c 1169542 0 2024-04-25T02:09:10.261 INFO:tasks.workunit.client.1.smithi112.stdout:9/475: dwrite d1/d48/f87 [0,4194304] 0 2024-04-25T02:09:10.262 INFO:tasks.workunit.client.1.smithi112.stdout:9/476: truncate d1/d13/d41/fa5 286584 0 2024-04-25T02:09:10.264 INFO:tasks.workunit.client.1.smithi112.stdout:1/514: mkdir d7/d4b/d7b/da8 0 2024-04-25T02:09:10.264 INFO:tasks.workunit.client.1.smithi112.stdout:1/515: chown d7/d9/d51/d58/c8a 188242490 1 2024-04-25T02:09:10.264 INFO:tasks.workunit.client.1.smithi112.stdout:2/373: mkdir d3/da/dc/d20/d85 0 2024-04-25T02:09:10.265 INFO:tasks.workunit.client.1.smithi112.stdout:3/494: mkdir d12/d13/d34/d53/d9c 0 2024-04-25T02:09:10.265 INFO:tasks.workunit.client.1.smithi112.stdout:3/495: fdatasync d12/d13/f4d 0 2024-04-25T02:09:10.269 INFO:tasks.workunit.client.1.smithi112.stdout:1/516: mkdir d7/d9/d4e/d28/d3f/da9 0 2024-04-25T02:09:10.269 INFO:tasks.workunit.client.1.smithi112.stdout:1/517: dread - d7/d9/d4e/d28/d3f/fa3 zero size 2024-04-25T02:09:10.269 INFO:tasks.workunit.client.1.smithi112.stdout:1/518: write d7/d9/d4e/d28/d3f/f8d [463289,44953] 0 2024-04-25T02:09:10.269 INFO:tasks.workunit.client.1.smithi112.stdout:1/519: creat d7/d4b/faa x:0 0 0 2024-04-25T02:09:10.269 INFO:tasks.workunit.client.1.smithi112.stdout:1/520: read - d7/d9/d4e/d28/f70 zero size 2024-04-25T02:09:10.269 INFO:tasks.workunit.client.1.smithi112.stdout:1/521: read d7/f4d [3290858,50806] 0 2024-04-25T02:09:10.269 INFO:tasks.workunit.client.1.smithi112.stdout:1/522: dread - d7/d4b/faa zero size 2024-04-25T02:09:10.269 INFO:tasks.workunit.client.1.smithi112.stdout:1/523: write d7/d9/d1e/f1a [4229832,87261] 0 2024-04-25T02:09:10.269 INFO:tasks.workunit.client.1.smithi112.stdout:1/524: chown d7/d9/d4e/d28/d32 16615011 1 2024-04-25T02:09:10.270 INFO:tasks.workunit.client.1.smithi112.stdout:2/374: mknod d3/da/dc/d20/d43/d7e/c86 0 2024-04-25T02:09:10.270 INFO:tasks.workunit.client.1.smithi112.stdout:2/375: write d3/da/dc/d20/d40/f79 [1497596,27915] 0 2024-04-25T02:09:10.284 INFO:tasks.workunit.client.1.smithi112.stdout:2/376: dread d3/da/f1c [0,4194304] 0 2024-04-25T02:09:10.285 INFO:tasks.workunit.client.1.smithi112.stdout:9/477: dwrite d1/df/f29 [4194304,4194304] 0 2024-04-25T02:09:10.285 INFO:tasks.workunit.client.1.smithi112.stdout:9/478: write d1/fd [1750314,16061] 0 2024-04-25T02:09:10.285 INFO:tasks.workunit.client.1.smithi112.stdout:2/377: creat d3/d62/d81/f87 x:0 0 0 2024-04-25T02:09:10.288 INFO:tasks.workunit.client.1.smithi112.stdout:7/518: sync 2024-04-25T02:09:10.288 INFO:tasks.workunit.client.1.smithi112.stdout:6/480: sync 2024-04-25T02:09:10.288 INFO:tasks.workunit.client.1.smithi112.stdout:4/513: sync 2024-04-25T02:09:10.288 INFO:tasks.workunit.client.1.smithi112.stdout:7/519: chown d7/d25/d43/l5a 10906276 1 2024-04-25T02:09:10.290 INFO:tasks.workunit.client.1.smithi112.stdout:3/496: dwrite d12/d13/d34/f60 [0,4194304] 0 2024-04-25T02:09:10.290 INFO:tasks.workunit.client.1.smithi112.stdout:3/497: chown d12/d13/d34/f48 1896651783 1 2024-04-25T02:09:10.291 INFO:tasks.workunit.client.1.smithi112.stdout:9/479: symlink d1/d48/laa 0 2024-04-25T02:09:10.291 INFO:tasks.workunit.client.1.smithi112.stdout:9/480: write d1/d13/d41/f66 [4366459,103766] 0 2024-04-25T02:09:10.292 INFO:tasks.workunit.client.1.smithi112.stdout:2/378: truncate d3/da/dc/d3e/df/d25/f5f 3135474 0 2024-04-25T02:09:10.292 INFO:tasks.workunit.client.1.smithi112.stdout:2/379: read - d3/da/f70 zero size 2024-04-25T02:09:10.292 INFO:tasks.workunit.client.1.smithi112.stdout:1/525: dwrite f4 [4194304,4194304] 0 2024-04-25T02:09:10.294 INFO:tasks.workunit.client.1.smithi112.stdout:4/514: rename d2/c7e to d2/d1e/ca1 0 2024-04-25T02:09:10.297 INFO:tasks.workunit.client.1.smithi112.stdout:3/498: write d12/d13/f2e [1875017,102087] 0 2024-04-25T02:09:10.301 INFO:tasks.workunit.client.1.smithi112.stdout:6/481: read d0/d7b/f90 [1962573,42650] 0 2024-04-25T02:09:10.301 INFO:tasks.workunit.client.1.smithi112.stdout:6/482: write d0/d2/d4/dd/f3d [1023641,20280] 0 2024-04-25T02:09:10.302 INFO:tasks.workunit.client.1.smithi112.stdout:6/483: stat d0/d7b/f88 0 2024-04-25T02:09:10.302 INFO:tasks.workunit.client.1.smithi112.stdout:9/481: creat d1/df/d3c/fab x:0 0 0 2024-04-25T02:09:10.302 INFO:tasks.workunit.client.1.smithi112.stdout:2/380: mkdir d3/da/dc/d3e/df/d25/d88 0 2024-04-25T02:09:10.304 INFO:tasks.workunit.client.1.smithi112.stdout:1/526: mkdir d7/d9/d1e/dab 0 2024-04-25T02:09:10.305 INFO:tasks.workunit.client.1.smithi112.stdout:1/527: readlink d7/d9/l86 0 2024-04-25T02:09:10.312 INFO:tasks.workunit.client.1.smithi112.stdout:4/515: dwrite d2/f1d [0,4194304] 0 2024-04-25T02:09:10.312 INFO:tasks.workunit.client.1.smithi112.stdout:4/516: write d2/d12/d22/d60/f88 [782319,95789] 0 2024-04-25T02:09:10.312 INFO:tasks.workunit.client.1.smithi112.stdout:4/517: creat d2/d17/d20/fa2 x:0 0 0 2024-04-25T02:09:10.312 INFO:tasks.workunit.client.1.smithi112.stdout:4/518: fsync d2/f1d 0 2024-04-25T02:09:10.312 INFO:tasks.workunit.client.1.smithi112.stdout:4/519: write d2/d1e/d1b/f93 [15281,27935] 0 2024-04-25T02:09:10.313 INFO:tasks.workunit.client.1.smithi112.stdout:7/520: rename d7/f27 to d7/d25/d40/d6b/f9e 0 2024-04-25T02:09:10.321 INFO:tasks.workunit.client.1.smithi112.stdout:2/381: dwrite d3/da/dc/d3e/df/d25/f54 [4194304,4194304] 0 2024-04-25T02:09:10.327 INFO:tasks.workunit.client.1.smithi112.stdout:3/499: link d12/d1f/d27/f46 d12/d13/d34/d4a/d4f/f9d 0 2024-04-25T02:09:10.327 INFO:tasks.workunit.client.1.smithi112.stdout:3/500: chown d12/l69 1274 1 2024-04-25T02:09:10.327 INFO:tasks.workunit.client.1.smithi112.stdout:3/501: creat d12/d13/d34/d78/d83/f9e x:0 0 0 2024-04-25T02:09:10.327 INFO:tasks.workunit.client.1.smithi112.stdout:3/502: creat d12/d13/d34/d78/d83/f9f x:0 0 0 2024-04-25T02:09:10.332 INFO:tasks.workunit.client.1.smithi112.stdout:6/484: mknod d0/d2/ca9 0 2024-04-25T02:09:10.332 INFO:tasks.workunit.client.1.smithi112.stdout:6/485: creat d0/d2/d4/d28/faa x:0 0 0 2024-04-25T02:09:10.335 INFO:tasks.workunit.client.1.smithi112.stdout:1/528: truncate d7/d9/d1e/de/d84/f9f 3556242 0 2024-04-25T02:09:10.336 INFO:tasks.workunit.client.1.smithi112.stdout:1/529: creat d7/d4b/fac x:0 0 0 2024-04-25T02:09:10.336 INFO:tasks.workunit.client.1.smithi112.stdout:1/530: write d7/d4b/fac [438671,128809] 0 2024-04-25T02:09:10.336 INFO:tasks.workunit.client.1.smithi112.stdout:1/531: write d7/d9/d1f/f63 [761972,101089] 0 2024-04-25T02:09:10.344 INFO:tasks.workunit.client.1.smithi112.stdout:4/520: creat d2/fa3 x:0 0 0 2024-04-25T02:09:10.353 INFO:tasks.workunit.client.1.smithi112.stdout:4/521: dread d2/d17/d25/f3b [0,4194304] 0 2024-04-25T02:09:10.353 INFO:tasks.workunit.client.1.smithi112.stdout:7/521: truncate d7/f17 91045 0 2024-04-25T02:09:10.353 INFO:tasks.workunit.client.1.smithi112.stdout:7/522: readlink d7/dd/d20/d36/l4e 0 2024-04-25T02:09:10.359 INFO:tasks.workunit.client.1.smithi112.stdout:2/382: unlink d3/da/dc/d3e/l57 0 2024-04-25T02:09:10.363 INFO:tasks.workunit.client.1.smithi112.stdout:2/383: dread d3/da/d18/f58 [0,4194304] 0 2024-04-25T02:09:10.363 INFO:tasks.workunit.client.1.smithi112.stdout:2/384: chown d3 42959 1 2024-04-25T02:09:10.366 INFO:tasks.workunit.client.1.smithi112.stdout:7/523: dread d7/d25/d43/f47 [0,4194304] 0 2024-04-25T02:09:10.377 INFO:tasks.workunit.client.1.smithi112.stdout:9/482: getdents d1/df/d3c/d43 0 2024-04-25T02:09:10.377 INFO:tasks.workunit.client.1.smithi112.stdout:9/483: write d1/df/d3c/d46/f8b [880480,83844] 0 2024-04-25T02:09:10.386 INFO:tasks.workunit.client.1.smithi112.stdout:1/532: rename d7/d9/f16 to d7/d9/d4e/fad 0 2024-04-25T02:09:10.392 INFO:tasks.workunit.client.1.smithi112.stdout:4/522: link d2/f46 d2/d17/d25/d3f/fa4 0 2024-04-25T02:09:10.393 INFO:tasks.workunit.client.1.smithi112.stdout:2/385: link d3/da/dc/d20/c49 d3/da/dc/d20/d43/d7e/c89 0 2024-04-25T02:09:10.395 INFO:tasks.workunit.client.1.smithi112.stdout:7/524: truncate d7/d25/d37/f4c 1100651 0 2024-04-25T02:09:10.395 INFO:tasks.workunit.client.1.smithi112.stdout:7/525: write d7/dd/d20/d36/f8b [808419,14420] 0 2024-04-25T02:09:10.395 INFO:tasks.workunit.client.1.smithi112.stdout:7/526: creat d7/dd/f9f x:0 0 0 2024-04-25T02:09:10.396 INFO:tasks.workunit.client.1.smithi112.stdout:3/503: rmdir d12/d13/d86 39 2024-04-25T02:09:10.399 INFO:tasks.workunit.client.1.smithi112.stdout:9/484: dwrite d1/f1c [8388608,4194304] 0 2024-04-25T02:09:10.399 INFO:tasks.workunit.client.1.smithi112.stdout:1/533: mkdir d7/d9/d4e/d28/d3f/da9/dae 0 2024-04-25T02:09:10.406 INFO:tasks.workunit.client.1.smithi112.stdout:2/386: rename d3/l19 to d3/da/dc/d20/d43/l8a 0 2024-04-25T02:09:10.407 INFO:tasks.workunit.client.1.smithi112.stdout:1/534: dread d7/d9/d4e/d28/d32/f64 [0,4194304] 0 2024-04-25T02:09:10.410 INFO:tasks.workunit.client.1.smithi112.stdout:7/527: dread d7/dd/f1c [0,4194304] 0 2024-04-25T02:09:10.411 INFO:tasks.workunit.client.1.smithi112.stdout:7/528: creat d7/d25/d37/d74/fa0 x:0 0 0 2024-04-25T02:09:10.412 INFO:tasks.workunit.client.1.smithi112.stdout:9/485: rmdir d1/d13/da9 0 2024-04-25T02:09:10.412 INFO:tasks.workunit.client.1.smithi112.stdout:9/486: creat d1/d13/d41/d84/fac x:0 0 0 2024-04-25T02:09:10.413 INFO:tasks.workunit.client.1.smithi112.stdout:4/523: getdents d2/d17/d20/d26 0 2024-04-25T02:09:10.420 INFO:tasks.workunit.client.1.smithi112.stdout:7/529: symlink d7/d25/d40/d6b/d91/la1 0 2024-04-25T02:09:10.422 INFO:tasks.workunit.client.1.smithi112.stdout:4/524: symlink d2/d17/d20/d26/d39/d49/la5 0 2024-04-25T02:09:10.422 INFO:tasks.workunit.client.1.smithi112.stdout:4/525: stat d2/d1e/d1b/l64 0 2024-04-25T02:09:10.423 INFO:tasks.workunit.client.1.smithi112.stdout:7/530: unlink d7/d25/d40/d6b/c97 0 2024-04-25T02:09:10.425 INFO:tasks.workunit.client.1.smithi112.stdout:9/487: write d1/d13/d5b/d55/fa4 [2048003,48680] 0 2024-04-25T02:09:10.425 INFO:tasks.workunit.client.1.smithi112.stdout:1/535: dwrite d7/d4b/fa4 [0,4194304] 0 2024-04-25T02:09:10.433 INFO:tasks.workunit.client.1.smithi112.stdout:1/536: symlink d7/d4b/laf 0 2024-04-25T02:09:10.433 INFO:tasks.workunit.client.1.smithi112.stdout:1/537: chown d7/d9/d1f/d25/c3a 18 1 2024-04-25T02:09:10.440 INFO:tasks.workunit.client.1.smithi112.stdout:7/531: rename d7/dd/d20/d36 to d7/d79/da2 0 2024-04-25T02:09:10.446 INFO:tasks.workunit.client.1.smithi112.stdout:7/532: write d7/d25/d43/d46/f42 [706529,124100] 0 2024-04-25T02:09:10.446 INFO:tasks.workunit.client.1.smithi112.stdout:7/533: write d7/d25/d43/d46/f82 [996276,51912] 0 2024-04-25T02:09:10.449 INFO:tasks.workunit.client.1.smithi112.stdout:7/534: rename d7/d25/d37/d53 to d7/d25/d40/da3 0 2024-04-25T02:09:10.450 INFO:tasks.workunit.client.1.smithi112.stdout:9/488: dwrite d1/f7a [0,4194304] 0 2024-04-25T02:09:10.450 INFO:tasks.workunit.client.1.smithi112.stdout:9/489: write d1/fd [509633,124500] 0 2024-04-25T02:09:10.450 INFO:tasks.workunit.client.1.smithi112.stdout:4/526: dwrite d2/d17/d7c/d9c/f9d [0,4194304] 0 2024-04-25T02:09:10.451 INFO:tasks.workunit.client.1.smithi112.stdout:1/538: dwrite d7/d9/d1f/f36 [0,4194304] 0 2024-04-25T02:09:10.451 INFO:tasks.workunit.client.1.smithi112.stdout:1/539: fsync d7/d9/d1e/de/d84/f9f 0 2024-04-25T02:09:10.451 INFO:tasks.workunit.client.1.smithi112.stdout:1/540: write d7/d9/f8c [574873,94086] 0 2024-04-25T02:09:10.451 INFO:tasks.workunit.client.1.smithi112.stdout:1/541: readlink d7/d9/d4e/d72/l99 0 2024-04-25T02:09:10.462 INFO:tasks.workunit.client.1.smithi112.stdout:4/527: creat d2/d17/fa6 x:0 0 0 2024-04-25T02:09:10.463 INFO:tasks.workunit.client.1.smithi112.stdout:1/542: write d7/d9/d1e/de/f65 [5349007,77880] 0 2024-04-25T02:09:10.470 INFO:tasks.workunit.client.1.smithi112.stdout:4/528: rename d2/d1e/d1b/f93 to d2/d17/d20/fa7 0 2024-04-25T02:09:10.470 INFO:tasks.workunit.client.1.smithi112.stdout:4/529: write d2/d1e/f81 [787758,44480] 0 2024-04-25T02:09:10.470 INFO:tasks.workunit.client.1.smithi112.stdout:4/530: fdatasync d2/d1e/d1b/d86/f72 0 2024-04-25T02:09:10.477 INFO:tasks.workunit.client.1.smithi112.stdout:4/531: unlink d2/d12/d22/c30 0 2024-04-25T02:09:10.477 INFO:tasks.workunit.client.1.smithi112.stdout:4/532: fdatasync d2/d17/d20/d26/f9b 0 2024-04-25T02:09:10.485 INFO:tasks.workunit.client.1.smithi112.stdout:7/535: dwrite d7/dd/f10 [0,4194304] 0 2024-04-25T02:09:10.485 INFO:tasks.workunit.client.1.smithi112.stdout:7/536: read - d7/d25/d37/d74/f94 zero size 2024-04-25T02:09:10.485 INFO:tasks.workunit.client.1.smithi112.stdout:9/490: dwrite d1/df/d3c/d43/fa7 [0,4194304] 0 2024-04-25T02:09:10.493 INFO:tasks.workunit.client.1.smithi112.stdout:4/533: dread d2/d1e/d42/f4d [0,4194304] 0 2024-04-25T02:09:10.501 INFO:tasks.workunit.client.1.smithi112.stdout:4/534: dread d2/d1e/d1b/d86/f72 [0,4194304] 0 2024-04-25T02:09:10.502 INFO:tasks.workunit.client.1.smithi112.stdout:7/537: dread d7/d25/d43/f47 [0,4194304] 0 2024-04-25T02:09:10.502 INFO:tasks.workunit.client.1.smithi112.stdout:7/538: fdatasync d7/d25/d43/d46/f5b 0 2024-04-25T02:09:10.502 INFO:tasks.workunit.client.1.smithi112.stdout:7/539: read - d7/d25/f85 zero size 2024-04-25T02:09:10.502 INFO:tasks.workunit.client.1.smithi112.stdout:7/540: truncate d7/f19 842899 0 2024-04-25T02:09:10.506 INFO:tasks.workunit.client.1.smithi112.stdout:4/535: dread d2/f1a [0,4194304] 0 2024-04-25T02:09:10.506 INFO:tasks.workunit.client.1.smithi112.stdout:4/536: read - d2/d1e/d1b/d83/f90 zero size 2024-04-25T02:09:10.506 INFO:tasks.workunit.client.1.smithi112.stdout:4/537: stat d2/d17/d20/d5e/f5b 0 2024-04-25T02:09:10.507 INFO:tasks.workunit.client.1.smithi112.stdout:4/538: unlink d2/d1e/d4b/l61 0 2024-04-25T02:09:10.511 INFO:tasks.workunit.client.1.smithi112.stdout:9/491: dwrite d1/d13/d5b/d55/fa4 [0,4194304] 0 2024-04-25T02:09:10.511 INFO:tasks.workunit.client.1.smithi112.stdout:9/492: write d1/df/d3c/d46/f98 [196217,794] 0 2024-04-25T02:09:10.511 INFO:tasks.workunit.client.1.smithi112.stdout:4/539: dread d2/d1e/f81 [0,4194304] 0 2024-04-25T02:09:10.511 INFO:tasks.workunit.client.1.smithi112.stdout:4/540: fsync d2/d17/d25/f91 0 2024-04-25T02:09:10.526 INFO:tasks.workunit.client.1.smithi112.stdout:5/393: sync 2024-04-25T02:09:10.546 INFO:tasks.workunit.client.1.smithi112.stdout:9/493: symlink d1/d13/d5b/d55/d63/lad 0 2024-04-25T02:09:10.546 INFO:tasks.workunit.client.1.smithi112.stdout:9/494: chown d1/df/d3c/d43/c83 1 1 2024-04-25T02:09:10.549 INFO:tasks.workunit.client.1.smithi112.stdout:4/541: rename d2/d1e/d1b/d86/l8f to d2/d17/d7c/d9c/la8 0 2024-04-25T02:09:10.550 INFO:tasks.workunit.client.1.smithi112.stdout:4/542: write d2/d17/d20/fa2 [650173,75469] 0 2024-04-25T02:09:10.550 INFO:tasks.workunit.client.1.smithi112.stdout:4/543: chown d2/d17/l41 7362729 1 2024-04-25T02:09:10.550 INFO:tasks.workunit.client.1.smithi112.stdout:4/544: fsync d2/d17/d20/d5e/f5b 0 2024-04-25T02:09:10.559 INFO:tasks.workunit.client.1.smithi112.stdout:5/394: unlink d1/d2/f52 0 2024-04-25T02:09:10.562 INFO:tasks.workunit.client.1.smithi112.stdout:9/495: link d1/d48/l6b d1/d13/d5b/lae 0 2024-04-25T02:09:10.563 INFO:tasks.workunit.client.1.smithi112.stdout:4/545: creat d2/d12/fa9 x:0 0 0 2024-04-25T02:09:10.565 INFO:tasks.workunit.client.1.smithi112.stdout:9/496: rename d1/d13/d5b/d55 to d1/d48/d65/d73/daf 0 2024-04-25T02:09:10.567 INFO:tasks.workunit.client.1.smithi112.stdout:4/546: symlink d2/d12/d22/d60/laa 0 2024-04-25T02:09:10.568 INFO:tasks.workunit.client.1.smithi112.stdout:5/395: rmdir d1/d2/d78 39 2024-04-25T02:09:10.568 INFO:tasks.workunit.client.1.smithi112.stdout:5/396: readlink d1/d41/d5b/l6e 0 2024-04-25T02:09:10.570 INFO:tasks.workunit.client.1.smithi112.stdout:9/497: symlink d1/lb0 0 2024-04-25T02:09:10.570 INFO:tasks.workunit.client.1.smithi112.stdout:4/547: symlink d2/d1e/d5c/lab 0 2024-04-25T02:09:10.570 INFO:tasks.workunit.client.1.smithi112.stdout:4/548: fdatasync d2/d1e/d42/f4d 0 2024-04-25T02:09:10.572 INFO:tasks.workunit.client.1.smithi112.stdout:5/397: mkdir d1/d41/d5b/d7b/d87 0 2024-04-25T02:09:10.573 INFO:tasks.workunit.client.1.smithi112.stdout:9/498: symlink d1/d13/d5b/lb1 0 2024-04-25T02:09:10.574 INFO:tasks.workunit.client.1.smithi112.stdout:9/499: unlink d1/df/d8f/f90 0 2024-04-25T02:09:10.576 INFO:tasks.workunit.client.1.smithi112.stdout:9/500: symlink d1/d48/d65/lb2 0 2024-04-25T02:09:10.577 INFO:tasks.workunit.client.1.smithi112.stdout:9/501: write d1/d48/d65/d73/daf/d63/f77 [5049131,52931] 0 2024-04-25T02:09:10.577 INFO:tasks.workunit.client.1.smithi112.stdout:9/502: chown d1/d13/d5b/lb1 6498 1 2024-04-25T02:09:10.578 INFO:tasks.workunit.client.1.smithi112.stdout:9/503: truncate d1/d13/f47 2760821 0 2024-04-25T02:09:10.579 INFO:tasks.workunit.client.1.smithi112.stdout:9/504: unlink d1/df/f29 0 2024-04-25T02:09:10.579 INFO:tasks.workunit.client.1.smithi112.stdout:9/505: write d1/f91 [874958,98984] 0 2024-04-25T02:09:10.580 INFO:tasks.workunit.client.1.smithi112.stdout:9/506: mknod d1/d48/d65/d73/daf/d63/cb3 0 2024-04-25T02:09:10.582 INFO:tasks.workunit.client.1.smithi112.stdout:5/398: read d1/d2/d4/ff [3665481,112563] 0 2024-04-25T02:09:10.583 INFO:tasks.workunit.client.1.smithi112.stdout:5/399: mknod d1/d16/d22/c88 0 2024-04-25T02:09:10.584 INFO:tasks.workunit.client.1.smithi112.stdout:5/400: mknod d1/d41/d5b/d7b/d87/c89 0 2024-04-25T02:09:10.585 INFO:tasks.workunit.client.1.smithi112.stdout:5/401: unlink d1/d2/f43 0 2024-04-25T02:09:10.591 INFO:tasks.workunit.client.1.smithi112.stdout:4/549: dwrite d2/d12/d22/d60/f88 [0,4194304] 0 2024-04-25T02:09:10.596 INFO:tasks.workunit.client.1.smithi112.stdout:9/507: dread d1/d48/f87 [0,4194304] 0 2024-04-25T02:09:10.596 INFO:tasks.workunit.client.1.smithi112.stdout:9/508: chown d1/d13/d5b 15365570 1 2024-04-25T02:09:10.598 INFO:tasks.workunit.client.1.smithi112.stdout:5/402: read d1/f18 [119576,38353] 0 2024-04-25T02:09:10.598 INFO:tasks.workunit.client.1.smithi112.stdout:5/403: chown d1/d2/f7e 7904127 1 2024-04-25T02:09:10.598 INFO:tasks.workunit.client.1.smithi112.stdout:4/550: getdents d2/d1e 0 2024-04-25T02:09:10.601 INFO:tasks.workunit.client.1.smithi112.stdout:4/551: creat d2/d4e/fac x:0 0 0 2024-04-25T02:09:10.605 INFO:tasks.workunit.client.1.smithi112.stdout:4/552: rename d2/d1e/l53 to d2/d12/lad 0 2024-04-25T02:09:10.605 INFO:tasks.workunit.client.1.smithi112.stdout:4/553: fsync d2/d17/d25/f91 0 2024-04-25T02:09:10.606 INFO:tasks.workunit.client.1.smithi112.stdout:4/554: creat d2/d17/d20/d26/d39/d49/d95/fae x:0 0 0 2024-04-25T02:09:10.609 INFO:tasks.workunit.client.1.smithi112.stdout:4/555: write d2/d17/d25/d3f/fa4 [1118552,78549] 0 2024-04-25T02:09:10.611 INFO:tasks.workunit.client.1.smithi112.stdout:5/404: dwrite d1/f46 [0,4194304] 0 2024-04-25T02:09:10.611 INFO:tasks.workunit.client.1.smithi112.stdout:5/405: stat d1/d16 0 2024-04-25T02:09:10.612 INFO:tasks.workunit.client.1.smithi112.stdout:9/509: getdents d1/d48/d65/d73/daf/d63 0 2024-04-25T02:09:10.617 INFO:tasks.workunit.client.1.smithi112.stdout:9/510: dread d1/df/d3c/f52 [0,4194304] 0 2024-04-25T02:09:10.617 INFO:tasks.workunit.client.1.smithi112.stdout:9/511: readlink d1/lb0 0 2024-04-25T02:09:10.625 INFO:tasks.workunit.client.1.smithi112.stdout:5/406: mkdir d1/d41/d8a 0 2024-04-25T02:09:10.625 INFO:tasks.workunit.client.1.smithi112.stdout:5/407: creat d1/d41/d5b/d7b/f8b x:0 0 0 2024-04-25T02:09:10.625 INFO:tasks.workunit.client.1.smithi112.stdout:4/556: dwrite d2/fb [0,4194304] 0 2024-04-25T02:09:10.626 INFO:tasks.workunit.client.1.smithi112.stdout:9/512: symlink d1/lb4 0 2024-04-25T02:09:10.630 INFO:tasks.workunit.client.1.smithi112.stdout:5/408: creat d1/d41/d5b/d6b/f8c x:0 0 0 2024-04-25T02:09:10.632 INFO:tasks.workunit.client.1.smithi112.stdout:4/557: mkdir d2/d17/d20/d5e/daf 0 2024-04-25T02:09:10.635 INFO:tasks.workunit.client.1.smithi112.stdout:9/513: link d1/d13/d41/d84/c96 d1/df/d3c/d6c/cb5 0 2024-04-25T02:09:10.637 INFO:tasks.workunit.client.1.smithi112.stdout:5/409: symlink d1/d16/l8d 0 2024-04-25T02:09:10.637 INFO:tasks.workunit.client.1.smithi112.stdout:5/410: chown d1/d16/d51 823 1 2024-04-25T02:09:10.639 INFO:tasks.workunit.client.1.smithi112.stdout:9/514: getdents d1/d13 0 2024-04-25T02:09:10.641 INFO:tasks.workunit.client.1.smithi112.stdout:4/558: write d2/d17/d20/d5e/f6c [648920,87463] 0 2024-04-25T02:09:10.641 INFO:tasks.workunit.client.1.smithi112.stdout:9/515: symlink d1/d48/lb6 0 2024-04-25T02:09:10.643 INFO:tasks.workunit.client.1.smithi112.stdout:5/411: unlink d1/d2/f5a 0 2024-04-25T02:09:10.643 INFO:tasks.workunit.client.1.smithi112.stdout:5/412: write d1/d16/f75 [2273450,25942] 0 2024-04-25T02:09:10.645 INFO:tasks.workunit.client.1.smithi112.stdout:4/559: symlink d2/d1e/d5c/lb0 0 2024-04-25T02:09:10.648 INFO:tasks.workunit.client.1.smithi112.stdout:5/413: link d1/f50 d1/d41/d8a/f8e 0 2024-04-25T02:09:10.655 INFO:tasks.workunit.client.1.smithi112.stdout:4/560: write d2/d17/d20/d26/f96 [1956048,95714] 0 2024-04-25T02:09:10.655 INFO:tasks.workunit.client.1.smithi112.stdout:4/561: dread - d2/d17/d25/f91 zero size 2024-04-25T02:09:10.657 INFO:tasks.workunit.client.1.smithi112.stdout:4/562: symlink d2/d1e/d1b/d86/lb1 0 2024-04-25T02:09:10.664 INFO:tasks.workunit.client.1.smithi112.stdout:9/516: dwrite d1/d48/f5c [0,4194304] 0 2024-04-25T02:09:10.665 INFO:tasks.workunit.client.1.smithi112.stdout:5/414: dwrite d1/d2/d28/f86 [0,4194304] 0 2024-04-25T02:09:10.665 INFO:tasks.workunit.client.1.smithi112.stdout:5/415: write d1/d16/d22/f4e [1291996,52831] 0 2024-04-25T02:09:10.667 INFO:tasks.workunit.client.1.smithi112.stdout:9/517: creat d1/d48/d65/d73/fb7 x:0 0 0 2024-04-25T02:09:10.671 INFO:tasks.workunit.client.1.smithi112.stdout:4/563: dread d2/d17/d20/d5e/f6c [0,4194304] 0 2024-04-25T02:09:10.671 INFO:tasks.workunit.client.1.smithi112.stdout:4/564: write d2/d17/d20/d26/d39/d49/f3c [872762,49709] 0 2024-04-25T02:09:10.673 INFO:tasks.workunit.client.1.smithi112.stdout:5/416: mkdir d1/d16/d8f 0 2024-04-25T02:09:10.676 INFO:tasks.workunit.client.1.smithi112.stdout:4/565: rmdir d2/d17/d20/d26/d39 39 2024-04-25T02:09:10.676 INFO:tasks.workunit.client.1.smithi112.stdout:4/566: fdatasync d2/d12/d22/d60/f88 0 2024-04-25T02:09:10.676 INFO:tasks.workunit.client.1.smithi112.stdout:4/567: chown d2/d12/f19 4 1 2024-04-25T02:09:10.681 INFO:tasks.workunit.client.1.smithi112.stdout:5/417: creat d1/d41/d8a/f90 x:0 0 0 2024-04-25T02:09:10.682 INFO:tasks.workunit.client.1.smithi112.stdout:5/418: stat d1/l56 0 2024-04-25T02:09:10.684 INFO:tasks.workunit.client.1.smithi112.stdout:0/668: sync 2024-04-25T02:09:10.684 INFO:tasks.workunit.client.1.smithi112.stdout:8/634: sync 2024-04-25T02:09:10.685 INFO:tasks.workunit.client.1.smithi112.stdout:6/486: sync 2024-04-25T02:09:10.685 INFO:tasks.workunit.client.1.smithi112.stdout:6/487: readlink d0/d2/d4/la 0 2024-04-25T02:09:10.690 INFO:tasks.workunit.client.1.smithi112.stdout:6/488: write d0/d2/d4/f4f [2838781,50244] 0 2024-04-25T02:09:10.692 INFO:tasks.workunit.client.1.smithi112.stdout:8/635: creat d15/d81/dce/fd7 x:0 0 0 2024-04-25T02:09:10.696 INFO:tasks.workunit.client.1.smithi112.stdout:0/669: mknod da/d1d/d2e/d40/d49/d4f/d58/d6d/cd3 0 2024-04-25T02:09:10.696 INFO:tasks.workunit.client.1.smithi112.stdout:4/568: dwrite d2/d4e/fac [0,4194304] 0 2024-04-25T02:09:10.697 INFO:tasks.workunit.client.1.smithi112.stdout:4/569: chown d2/d1e/d4b/d57 41765 1 2024-04-25T02:09:10.700 INFO:tasks.workunit.client.1.smithi112.stdout:5/419: dwrite d1/f50 [0,4194304] 0 2024-04-25T02:09:10.702 INFO:tasks.workunit.client.1.smithi112.stdout:0/670: mkdir da/d1d/d2e/d40/d49/d4f/d58/d6d/dd4 0 2024-04-25T02:09:10.702 INFO:tasks.workunit.client.1.smithi112.stdout:0/671: chown da/d1d/d2e/d40/d49/d6b/dc1 116 1 2024-04-25T02:09:10.707 INFO:tasks.workunit.client.1.smithi112.stdout:8/636: write d15/d26/f3a [480316,128740] 0 2024-04-25T02:09:10.707 INFO:tasks.workunit.client.1.smithi112.stdout:5/420: mknod d1/d16/d8f/c91 0 2024-04-25T02:09:10.709 INFO:tasks.workunit.client.1.smithi112.stdout:6/489: dwrite d0/d2/d4/dd/f26 [0,4194304] 0 2024-04-25T02:09:10.710 INFO:tasks.workunit.client.1.smithi112.stdout:6/490: creat d0/d36/fab x:0 0 0 2024-04-25T02:09:10.710 INFO:tasks.workunit.client.1.smithi112.stdout:6/491: fsync d0/f1a 0 2024-04-25T02:09:10.710 INFO:tasks.workunit.client.1.smithi112.stdout:0/672: mknod da/d13/d1e/db1/cd5 0 2024-04-25T02:09:10.715 INFO:tasks.workunit.client.1.smithi112.stdout:5/421: symlink d1/d2/d28/l92 0 2024-04-25T02:09:10.717 INFO:tasks.workunit.client.1.smithi112.stdout:4/570: dwrite d2/d17/d25/f3b [0,4194304] 0 2024-04-25T02:09:10.719 INFO:tasks.workunit.client.1.smithi112.stdout:0/673: rename da/d13/d1e/db1/cd5 to da/d1d/d2e/d40/d49/d4f/d58/d6d/cd6 0 2024-04-25T02:09:10.722 INFO:tasks.workunit.client.1.smithi112.stdout:4/571: mkdir d2/d17/db2 0 2024-04-25T02:09:10.724 INFO:tasks.workunit.client.1.smithi112.stdout:0/674: symlink da/d1d/dbe/ld7 0 2024-04-25T02:09:10.724 INFO:tasks.workunit.client.1.smithi112.stdout:0/675: readlink da/d1d/d2e/d40/l57 0 2024-04-25T02:09:10.724 INFO:tasks.workunit.client.1.smithi112.stdout:0/676: write da/f52 [4643930,10041] 0 2024-04-25T02:09:10.726 INFO:tasks.workunit.client.1.smithi112.stdout:0/677: link da/d13/d1e/l68 da/d1d/d2e/d40/dad/ld8 0 2024-04-25T02:09:10.730 INFO:tasks.workunit.client.1.smithi112.stdout:0/678: mknod da/d1d/dcb/cd9 0 2024-04-25T02:09:10.732 INFO:tasks.workunit.client.1.smithi112.stdout:0/679: unlink da/d1d/d88/caf 0 2024-04-25T02:09:10.734 INFO:tasks.workunit.client.1.smithi112.stdout:0/680: mknod da/d13/d45/d5e/cda 0 2024-04-25T02:09:10.736 INFO:tasks.workunit.client.1.smithi112.stdout:8/637: dwrite d15/d35/d56/f99 [0,4194304] 0 2024-04-25T02:09:10.736 INFO:tasks.workunit.client.1.smithi112.stdout:6/492: dwrite d0/d2/d4/d28/faa [0,4194304] 0 2024-04-25T02:09:10.737 INFO:tasks.workunit.client.1.smithi112.stdout:0/681: creat da/d1d/d2e/d40/d49/d4f/d82/fdb x:0 0 0 2024-04-25T02:09:10.743 INFO:tasks.workunit.client.1.smithi112.stdout:8/638: rename d15/d17/d1a/f1d to d15/d26/d4f/fd8 0 2024-04-25T02:09:10.745 INFO:tasks.workunit.client.1.smithi112.stdout:4/572: truncate d2/d17/d25/f3b 2969807 0 2024-04-25T02:09:10.746 INFO:tasks.workunit.client.1.smithi112.stdout:0/682: read da/d13/d1e/f6a [321691,26448] 0 2024-04-25T02:09:10.747 INFO:tasks.workunit.client.1.smithi112.stdout:6/493: symlink d0/d7b/lac 0 2024-04-25T02:09:10.748 INFO:tasks.workunit.client.1.smithi112.stdout:6/494: truncate d0/d2/d4/d28/fa2 252364 0 2024-04-25T02:09:10.748 INFO:tasks.workunit.client.1.smithi112.stdout:6/495: creat d0/d32/d45/fad x:0 0 0 2024-04-25T02:09:10.755 INFO:tasks.workunit.client.1.smithi112.stdout:8/639: rename d15/d26/d37/fc9 to d15/d35/d5c/d91/d78/fd9 0 2024-04-25T02:09:10.756 INFO:tasks.workunit.client.1.smithi112.stdout:4/573: mkdir d2/d1e/db3 0 2024-04-25T02:09:10.757 INFO:tasks.workunit.client.1.smithi112.stdout:0/683: getdents da/d1d/d88/d80 0 2024-04-25T02:09:10.757 INFO:tasks.workunit.client.1.smithi112.stdout:0/684: fdatasync da/d1d/d88/d78/fab 0 2024-04-25T02:09:10.758 INFO:tasks.workunit.client.1.smithi112.stdout:0/685: fdatasync da/d1d/dcb/fd1 0 2024-04-25T02:09:10.761 INFO:tasks.workunit.client.1.smithi112.stdout:6/496: link d0/l25 d0/d2/d3b/d53/lae 0 2024-04-25T02:09:10.764 INFO:tasks.workunit.client.1.smithi112.stdout:8/640: link d15/d35/fae d15/d40/fda 0 2024-04-25T02:09:10.766 INFO:tasks.workunit.client.1.smithi112.stdout:6/497: getdents d0/d2/d3b/d53/d67 0 2024-04-25T02:09:10.767 INFO:tasks.workunit.client.1.smithi112.stdout:8/641: mknod d15/d17/dba/cdb 0 2024-04-25T02:09:10.768 INFO:tasks.workunit.client.1.smithi112.stdout:4/574: link d2/d17/l24 d2/lb4 0 2024-04-25T02:09:10.770 INFO:tasks.workunit.client.1.smithi112.stdout:6/498: creat d0/d2/da1/faf x:0 0 0 2024-04-25T02:09:10.770 INFO:tasks.workunit.client.1.smithi112.stdout:6/499: readlink d0/l87 0 2024-04-25T02:09:10.770 INFO:tasks.workunit.client.1.smithi112.stdout:6/500: dread - d0/d2/d2c/d41/d77/fa4 zero size 2024-04-25T02:09:10.773 INFO:tasks.workunit.client.1.smithi112.stdout:8/642: rmdir d15/d35/d5c/db8 0 2024-04-25T02:09:10.776 INFO:tasks.workunit.client.1.smithi112.stdout:6/501: mkdir d0/d61/db0 0 2024-04-25T02:09:10.776 INFO:tasks.workunit.client.1.smithi112.stdout:6/502: stat d0/d2/d3b/d53/d67 0 2024-04-25T02:09:10.777 INFO:tasks.workunit.client.1.smithi112.stdout:4/575: read d2/f5f [1016087,57887] 0 2024-04-25T02:09:10.778 INFO:tasks.workunit.client.1.smithi112.stdout:8/643: rename d15/d26/d4f/d67/f8d to d15/d35/d5c/d91/d64/d8b/fdc 0 2024-04-25T02:09:10.780 INFO:tasks.workunit.client.1.smithi112.stdout:4/576: symlink d2/d1e/d4b/lb5 0 2024-04-25T02:09:10.781 INFO:tasks.workunit.client.1.smithi112.stdout:8/644: mknod d15/d35/d5c/d5e/cdd 0 2024-04-25T02:09:10.784 INFO:tasks.workunit.client.1.smithi112.stdout:6/503: dread d0/d2/d4/f5 [0,4194304] 0 2024-04-25T02:09:10.784 INFO:tasks.workunit.client.1.smithi112.stdout:8/645: symlink d15/d26/d37/lde 0 2024-04-25T02:09:10.785 INFO:tasks.workunit.client.1.smithi112.stdout:8/646: stat d15/d17/d1a/c34 0 2024-04-25T02:09:10.785 INFO:tasks.workunit.client.1.smithi112.stdout:8/647: stat d15/d35/d56/l57 0 2024-04-25T02:09:10.803 INFO:tasks.workunit.client.1.smithi112.stdout:6/504: dwrite d0/d2/d3b/d53/f72 [0,4194304] 0 2024-04-25T02:09:10.803 INFO:tasks.workunit.client.1.smithi112.stdout:4/577: dwrite d2/d12/f16 [0,4194304] 0 2024-04-25T02:09:10.818 INFO:tasks.workunit.client.1.smithi112.stdout:3/504: sync 2024-04-25T02:09:10.838 INFO:tasks.workunit.client.1.smithi112.stdout:3/505: dwrite d12/d13/f47 [0,4194304] 0 2024-04-25T02:09:10.852 INFO:tasks.workunit.client.1.smithi112.stdout:8/648: link d15/d26/d37/f38 d15/d40/d88/fdf 0 2024-04-25T02:09:10.852 INFO:tasks.workunit.client.1.smithi112.stdout:8/649: dread - d15/d35/d5c/d91/d78/fbd zero size 2024-04-25T02:09:10.861 INFO:tasks.workunit.client.1.smithi112.stdout:6/505: mknod d0/d2/d66/d7d/d92/cb1 0 2024-04-25T02:09:10.863 INFO:tasks.workunit.client.1.smithi112.stdout:4/578: symlink d2/d17/d20/d5e/d87/lb6 0 2024-04-25T02:09:10.869 INFO:tasks.workunit.client.1.smithi112.stdout:8/650: mkdir d15/d26/d4f/d67/de0 0 2024-04-25T02:09:10.870 INFO:tasks.workunit.client.1.smithi112.stdout:6/506: symlink d0/d7b/lb2 0 2024-04-25T02:09:10.870 INFO:tasks.workunit.client.1.smithi112.stdout:6/507: write d0/d2/d79/d81/f9b [5165762,52336] 0 2024-04-25T02:09:10.871 INFO:tasks.workunit.client.1.smithi112.stdout:3/506: getdents d12/d13/d34/d78/d83 0 2024-04-25T02:09:10.873 INFO:tasks.workunit.client.1.smithi112.stdout:8/651: link d15/d35/d5c/d91/d78/l9c d15/d35/d5c/d91/d78/dc5/le1 0 2024-04-25T02:09:10.876 INFO:tasks.workunit.client.1.smithi112.stdout:6/508: creat d0/d2/fb3 x:0 0 0 2024-04-25T02:09:10.879 INFO:tasks.workunit.client.1.smithi112.stdout:3/507: mkdir d12/d13/d86/da0 0 2024-04-25T02:09:10.880 INFO:tasks.workunit.client.1.smithi112.stdout:6/509: creat d0/d2/d1f/fb4 x:0 0 0 2024-04-25T02:09:10.881 INFO:tasks.workunit.client.1.smithi112.stdout:4/579: dwrite d2/d17/d20/d5e/f5b [0,4194304] 0 2024-04-25T02:09:10.881 INFO:tasks.workunit.client.1.smithi112.stdout:4/580: fdatasync d2/d1e/d1b/d86/f6d 0 2024-04-25T02:09:10.882 INFO:tasks.workunit.client.1.smithi112.stdout:3/508: mkdir d12/d13/d34/d4a/d4f/da1 0 2024-04-25T02:09:10.886 INFO:tasks.workunit.client.1.smithi112.stdout:3/509: creat d12/d13/d34/d4a/d4f/fa2 x:0 0 0 2024-04-25T02:09:10.890 INFO:tasks.workunit.client.1.smithi112.stdout:3/510: rename d12/d13/f47 to d12/d1f/d27/d44/d7e/fa3 0 2024-04-25T02:09:10.892 INFO:tasks.workunit.client.1.smithi112.stdout:3/511: truncate d12/d1f/d27/d44/f68 1336568 0 2024-04-25T02:09:10.893 INFO:tasks.workunit.client.1.smithi112.stdout:4/581: write d2/d1e/d5c/f76 [1333021,37381] 0 2024-04-25T02:09:10.893 INFO:tasks.workunit.client.1.smithi112.stdout:4/582: fdatasync d2/d17/d20/fa7 0 2024-04-25T02:09:10.893 INFO:tasks.workunit.client.1.smithi112.stdout:4/583: fsync d2/f1d 0 2024-04-25T02:09:10.893 INFO:tasks.workunit.client.1.smithi112.stdout:3/512: mknod d12/d13/d34/ca4 0 2024-04-25T02:09:10.896 INFO:tasks.workunit.client.1.smithi112.stdout:4/584: link d2/f1d d2/d1e/d1b/d83/fb7 0 2024-04-25T02:09:10.898 INFO:tasks.workunit.client.1.smithi112.stdout:4/585: creat d2/d17/d20/d5e/fb8 x:0 0 0 2024-04-25T02:09:10.898 INFO:tasks.workunit.client.1.smithi112.stdout:4/586: stat d2/d1e/d4b/lb5 0 2024-04-25T02:09:10.900 INFO:tasks.workunit.client.1.smithi112.stdout:3/513: dread d12/d13/f8e [0,4194304] 0 2024-04-25T02:09:10.902 INFO:tasks.workunit.client.1.smithi112.stdout:8/652: dwrite d15/d17/d1a/f2f [0,4194304] 0 2024-04-25T02:09:10.903 INFO:tasks.workunit.client.1.smithi112.stdout:8/653: write d15/d40/f4d [670398,72827] 0 2024-04-25T02:09:10.903 INFO:tasks.workunit.client.1.smithi112.stdout:8/654: readlink d15/d17/d1a/lcf 0 2024-04-25T02:09:10.903 INFO:tasks.workunit.client.1.smithi112.stdout:8/655: dread - d15/d26/d4f/fd4 zero size 2024-04-25T02:09:10.903 INFO:tasks.workunit.client.1.smithi112.stdout:8/656: dread - d15/d35/f4c zero size 2024-04-25T02:09:10.903 INFO:tasks.workunit.client.1.smithi112.stdout:8/657: write d15/d17/f2e [1007878,2036] 0 2024-04-25T02:09:10.903 INFO:tasks.workunit.client.1.smithi112.stdout:6/510: dwrite d0/d2/d4/dd/f48 [0,4194304] 0 2024-04-25T02:09:10.904 INFO:tasks.workunit.client.1.smithi112.stdout:8/658: creat d15/d26/fe2 x:0 0 0 2024-04-25T02:09:10.913 INFO:tasks.workunit.client.1.smithi112.stdout:6/511: mkdir d0/d61/d98/db5 0 2024-04-25T02:09:10.913 INFO:tasks.workunit.client.1.smithi112.stdout:8/659: link d15/d26/d4f/fca d15/fe3 0 2024-04-25T02:09:10.917 INFO:tasks.workunit.client.1.smithi112.stdout:3/514: unlink d12/d1f/d27/d44/f68 0 2024-04-25T02:09:10.917 INFO:tasks.workunit.client.1.smithi112.stdout:3/515: dread - d12/d1f/d27/d44/d73/f98 zero size 2024-04-25T02:09:10.917 INFO:tasks.workunit.client.1.smithi112.stdout:3/516: fdatasync d12/d5d/f75 0 2024-04-25T02:09:10.917 INFO:tasks.workunit.client.1.smithi112.stdout:4/587: dwrite d2/d1e/d1b/d86/f72 [0,4194304] 0 2024-04-25T02:09:10.918 INFO:tasks.workunit.client.1.smithi112.stdout:4/588: creat d2/d1e/d1b/d83/fb9 x:0 0 0 2024-04-25T02:09:10.920 INFO:tasks.workunit.client.1.smithi112.stdout:8/660: rmdir d15/d35/d5f/db5/dc6 0 2024-04-25T02:09:10.922 INFO:tasks.workunit.client.1.smithi112.stdout:3/517: mkdir d12/d1f/d27/d44/d73/d95/da5 0 2024-04-25T02:09:10.927 INFO:tasks.workunit.client.1.smithi112.stdout:6/512: dwrite d0/d36/fab [0,4194304] 0 2024-04-25T02:09:10.927 INFO:tasks.workunit.client.1.smithi112.stdout:6/513: stat d0/f30 0 2024-04-25T02:09:10.931 INFO:tasks.workunit.client.1.smithi112.stdout:3/518: unlink d12/d1f/d27/f6f 0 2024-04-25T02:09:10.931 INFO:tasks.workunit.client.1.smithi112.stdout:3/519: creat d12/d13/d34/d4a/fa6 x:0 0 0 2024-04-25T02:09:10.931 INFO:tasks.workunit.client.1.smithi112.stdout:3/520: truncate d12/d13/f1c 4880798 0 2024-04-25T02:09:10.935 INFO:tasks.workunit.client.1.smithi112.stdout:6/514: symlink d0/d2/d3b/lb6 0 2024-04-25T02:09:10.944 INFO:tasks.workunit.client.1.smithi112.stdout:4/589: dwrite d2/f1d [0,4194304] 0 2024-04-25T02:09:10.944 INFO:tasks.workunit.client.1.smithi112.stdout:8/661: dwrite d15/d26/d4f/fd4 [0,4194304] 0 2024-04-25T02:09:10.944 INFO:tasks.workunit.client.1.smithi112.stdout:8/662: readlink d15/d26/d37/d8e/l7f 0 2024-04-25T02:09:10.944 INFO:tasks.workunit.client.1.smithi112.stdout:8/663: chown fe 71347702 1 2024-04-25T02:09:10.944 INFO:tasks.workunit.client.1.smithi112.stdout:8/664: chown d15/d26/d37/d52/l79 809 1 2024-04-25T02:09:10.944 INFO:tasks.workunit.client.1.smithi112.stdout:8/665: readlink d15/d81/lab 0 2024-04-25T02:09:10.946 INFO:tasks.workunit.client.1.smithi112.stdout:2/387: sync 2024-04-25T02:09:10.946 INFO:tasks.workunit.client.1.smithi112.stdout:2/388: chown d3/l83 535200029 1 2024-04-25T02:09:10.951 INFO:tasks.workunit.client.1.smithi112.stdout:8/666: rename d15/d35/d56/d7a to d15/d35/d5c/de4 0 2024-04-25T02:09:10.955 INFO:tasks.workunit.client.1.smithi112.stdout:6/515: dwrite d0/d2/f82 [0,4194304] 0 2024-04-25T02:09:10.957 INFO:tasks.workunit.client.1.smithi112.stdout:6/516: mkdir d0/d2/d4/dd/db7 0 2024-04-25T02:09:10.963 INFO:tasks.workunit.client.1.smithi112.stdout:6/517: mknod d0/d2/d3b/d53/cb8 0 2024-04-25T02:09:10.968 INFO:tasks.workunit.client.1.smithi112.stdout:6/518: dread d0/d2/d1f/f43 [0,4194304] 0 2024-04-25T02:09:10.968 INFO:tasks.workunit.client.1.smithi112.stdout:6/519: truncate d0/d2/d2c/f33 4367451 0 2024-04-25T02:09:10.968 INFO:tasks.workunit.client.1.smithi112.stdout:6/520: creat d0/d7b/fb9 x:0 0 0 2024-04-25T02:09:10.968 INFO:tasks.workunit.client.1.smithi112.stdout:6/521: fdatasync d0/d2/da1/faf 0 2024-04-25T02:09:10.968 INFO:tasks.workunit.client.1.smithi112.stdout:6/522: creat d0/d2/fba x:0 0 0 2024-04-25T02:09:10.971 INFO:tasks.workunit.client.1.smithi112.stdout:2/389: write d3/da/dc/d20/d43/d5e/f6d [3526744,79306] 0 2024-04-25T02:09:10.971 INFO:tasks.workunit.client.1.smithi112.stdout:6/523: dread d0/d7b/f88 [0,4194304] 0 2024-04-25T02:09:10.971 INFO:tasks.workunit.client.1.smithi112.stdout:6/524: chown d0/d32/d45/c6e 333467649 1 2024-04-25T02:09:10.973 INFO:tasks.workunit.client.1.smithi112.stdout:6/525: unlink d0/d2/da1/faf 0 2024-04-25T02:09:10.979 INFO:tasks.workunit.client.1.smithi112.stdout:3/521: dwrite d12/d1f/d27/f52 [0,4194304] 0 2024-04-25T02:09:10.979 INFO:tasks.workunit.client.1.smithi112.stdout:3/522: read - d12/d13/d34/d78/d83/f93 zero size 2024-04-25T02:09:10.979 INFO:tasks.workunit.client.1.smithi112.stdout:4/590: dwrite d2/d1e/f35 [0,4194304] 0 2024-04-25T02:09:10.979 INFO:tasks.workunit.client.1.smithi112.stdout:4/591: fsync d2/d17/d20/fa7 0 2024-04-25T02:09:10.980 INFO:tasks.workunit.client.1.smithi112.stdout:4/592: fsync d2/d1e/d1b/d86/f6d 0 2024-04-25T02:09:10.982 INFO:tasks.workunit.client.1.smithi112.stdout:3/523: mkdir d12/d13/d34/d4a/d4f/da1/da7 0 2024-04-25T02:09:10.988 INFO:tasks.workunit.client.1.smithi112.stdout:3/524: unlink d12/d1f/f32 0 2024-04-25T02:09:10.994 INFO:tasks.workunit.client.1.smithi112.stdout:3/525: dread d12/f1d [0,4194304] 0 2024-04-25T02:09:11.000 INFO:tasks.workunit.client.1.smithi112.stdout:7/541: sync 2024-04-25T02:09:11.000 INFO:tasks.workunit.client.1.smithi112.stdout:5/422: sync 2024-04-25T02:09:11.000 INFO:tasks.workunit.client.1.smithi112.stdout:5/423: getdents d1/d6c 0 2024-04-25T02:09:11.000 INFO:tasks.workunit.client.1.smithi112.stdout:5/424: chown d1/d2/d4/fe 8160 1 2024-04-25T02:09:11.000 INFO:tasks.workunit.client.1.smithi112.stdout:1/543: sync 2024-04-25T02:09:11.000 INFO:tasks.workunit.client.1.smithi112.stdout:0/686: sync 2024-04-25T02:09:11.000 INFO:tasks.workunit.client.1.smithi112.stdout:9/518: sync 2024-04-25T02:09:11.001 INFO:tasks.workunit.client.1.smithi112.stdout:2/390: dwrite d3/d62/f84 [0,4194304] 0 2024-04-25T02:09:11.001 INFO:tasks.workunit.client.1.smithi112.stdout:2/391: chown d3/da/dc/d3e/df/l22 15085083 1 2024-04-25T02:09:11.001 INFO:tasks.workunit.client.1.smithi112.stdout:3/526: write d12/d13/d34/f60 [175030,93136] 0 2024-04-25T02:09:11.003 INFO:tasks.workunit.client.1.smithi112.stdout:7/542: rename d7/d79/da2/l4b to d7/d25/d40/d6b/d91/la4 0 2024-04-25T02:09:11.004 INFO:tasks.workunit.client.1.smithi112.stdout:0/687: mkdir da/d13/d45/d5e/db4/ddc 0 2024-04-25T02:09:11.004 INFO:tasks.workunit.client.1.smithi112.stdout:0/688: write da/f52 [2547876,63479] 0 2024-04-25T02:09:11.004 INFO:tasks.workunit.client.1.smithi112.stdout:0/689: readlink da/d13/d23/lc7 0 2024-04-25T02:09:11.005 INFO:tasks.workunit.client.1.smithi112.stdout:4/593: dwrite d2/d17/d20/fa7 [0,4194304] 0 2024-04-25T02:09:11.005 INFO:tasks.workunit.client.1.smithi112.stdout:4/594: write d2/d17/d7c/d9c/f9d [4610810,2426] 0 2024-04-25T02:09:11.005 INFO:tasks.workunit.client.1.smithi112.stdout:4/595: write d2/d12/fa9 [112248,130137] 0 2024-04-25T02:09:11.006 INFO:tasks.workunit.client.1.smithi112.stdout:9/519: creat d1/d48/d65/d73/daf/fb8 x:0 0 0 2024-04-25T02:09:11.008 INFO:tasks.workunit.client.1.smithi112.stdout:2/392: symlink d3/da/dc/d20/d43/d5e/l8b 0 2024-04-25T02:09:11.014 INFO:tasks.workunit.client.1.smithi112.stdout:3/527: rename d12/d13/d34/c55 to d12/d67/ca8 0 2024-04-25T02:09:11.014 INFO:tasks.workunit.client.1.smithi112.stdout:3/528: chown d12/d13/f4e 56072 1 2024-04-25T02:09:11.015 INFO:tasks.workunit.client.1.smithi112.stdout:3/529: chown d12/d13/d34/f9a 9000815 1 2024-04-25T02:09:11.015 INFO:tasks.workunit.client.1.smithi112.stdout:3/530: dread - d12/d5d/f90 zero size 2024-04-25T02:09:11.021 INFO:tasks.workunit.client.1.smithi112.stdout:4/596: dwrite d2/d12/d22/f48 [0,4194304] 0 2024-04-25T02:09:11.021 INFO:tasks.workunit.client.1.smithi112.stdout:4/597: dread - d2/d17/d25/f91 zero size 2024-04-25T02:09:11.021 INFO:tasks.workunit.client.1.smithi112.stdout:9/520: symlink d1/d48/d65/d73/daf/lb9 0 2024-04-25T02:09:11.021 INFO:tasks.workunit.client.1.smithi112.stdout:9/521: write d1/d48/d65/f79 [473333,50782] 0 2024-04-25T02:09:11.021 INFO:tasks.workunit.client.1.smithi112.stdout:1/544: write d7/d9/d1e/de/f27 [1105815,67739] 0 2024-04-25T02:09:11.022 INFO:tasks.workunit.client.1.smithi112.stdout:2/393: mknod d3/da/dc/d3e/df/c8c 0 2024-04-25T02:09:11.024 INFO:tasks.workunit.client.1.smithi112.stdout:5/425: dread d1/d2/f11 [0,4194304] 0 2024-04-25T02:09:11.024 INFO:tasks.workunit.client.1.smithi112.stdout:3/531: truncate d12/d13/d34/f48 596787 0 2024-04-25T02:09:11.024 INFO:tasks.workunit.client.1.smithi112.stdout:3/532: fsync d12/f19 0 2024-04-25T02:09:11.024 INFO:tasks.workunit.client.1.smithi112.stdout:0/690: rmdir da/d1d/d2e/d40/d49/d4f/d58/d6d 39 2024-04-25T02:09:11.031 INFO:tasks.workunit.client.1.smithi112.stdout:4/598: creat d2/d12/fba x:0 0 0 2024-04-25T02:09:11.031 INFO:tasks.workunit.client.1.smithi112.stdout:4/599: readlink d2/d1e/d1b/d65/l9e 0 2024-04-25T02:09:11.033 INFO:tasks.workunit.client.1.smithi112.stdout:9/522: mknod d1/d13/d41/cba 0 2024-04-25T02:09:11.035 INFO:tasks.workunit.client.1.smithi112.stdout:7/543: dwrite d7/d25/f85 [0,4194304] 0 2024-04-25T02:09:11.037 INFO:tasks.workunit.client.1.smithi112.stdout:3/533: write d12/d13/f42 [2761393,41072] 0 2024-04-25T02:09:11.039 INFO:tasks.workunit.client.1.smithi112.stdout:2/394: rename d3/da/dc/d3e/df/f34 to d3/da/dc/d20/d85/f8d 0 2024-04-25T02:09:11.042 INFO:tasks.workunit.client.1.smithi112.stdout:5/426: mkdir d1/d16/d51/d93 0 2024-04-25T02:09:11.042 INFO:tasks.workunit.client.1.smithi112.stdout:9/523: write d1/df/d3c/f69 [1217789,3861] 0 2024-04-25T02:09:11.043 INFO:tasks.workunit.client.1.smithi112.stdout:9/524: dread - d1/df/f8d zero size 2024-04-25T02:09:11.043 INFO:tasks.workunit.client.1.smithi112.stdout:9/525: readlink d1/d13/l16 0 2024-04-25T02:09:11.045 INFO:tasks.workunit.client.1.smithi112.stdout:3/534: dread d12/d13/f1b [0,4194304] 0 2024-04-25T02:09:11.045 INFO:tasks.workunit.client.1.smithi112.stdout:0/691: unlink da/d1d/d2e/c7f 0 2024-04-25T02:09:11.045 INFO:tasks.workunit.client.1.smithi112.stdout:3/535: fdatasync d12/d13/d34/d78/f7f 0 2024-04-25T02:09:11.045 INFO:tasks.workunit.client.1.smithi112.stdout:0/692: write da/d13/d23/d77/fb6 [331266,66089] 0 2024-04-25T02:09:11.046 INFO:tasks.workunit.client.1.smithi112.stdout:0/693: chown da/d1d/d88/d80/lb2 79 1 2024-04-25T02:09:11.046 INFO:tasks.workunit.client.1.smithi112.stdout:0/694: fdatasync da/d13/d45/d5e/fca 0 2024-04-25T02:09:11.046 INFO:tasks.workunit.client.1.smithi112.stdout:0/695: creat da/d1d/d2e/d40/d49/d6b/fdd x:0 0 0 2024-04-25T02:09:11.046 INFO:tasks.workunit.client.1.smithi112.stdout:7/544: write d7/d25/d37/f71 [459006,29194] 0 2024-04-25T02:09:11.049 INFO:tasks.workunit.client.1.smithi112.stdout:4/600: symlink d2/d17/d25/lbb 0 2024-04-25T02:09:11.052 INFO:tasks.workunit.client.1.smithi112.stdout:9/526: dread d1/d13/d41/d84/f95 [0,4194304] 0 2024-04-25T02:09:11.054 INFO:tasks.workunit.client.1.smithi112.stdout:1/545: mkdir d7/db0 0 2024-04-25T02:09:11.054 INFO:tasks.workunit.client.1.smithi112.stdout:1/546: creat d7/d9/d1e/d66/fb1 x:0 0 0 2024-04-25T02:09:11.061 INFO:tasks.workunit.client.1.smithi112.stdout:5/427: rename d1/d41/d5b/l6f to d1/d41/d5b/d6b/l94 0 2024-04-25T02:09:11.063 INFO:tasks.workunit.client.1.smithi112.stdout:5/428: dread d1/d16/f4d [0,4194304] 0 2024-04-25T02:09:11.066 INFO:tasks.workunit.client.1.smithi112.stdout:4/601: creat d2/d1e/d5c/fbc x:0 0 0 2024-04-25T02:09:11.066 INFO:tasks.workunit.client.1.smithi112.stdout:4/602: fdatasync d2/fa3 0 2024-04-25T02:09:11.067 INFO:tasks.workunit.client.1.smithi112.stdout:9/527: mknod d1/d93/cbb 0 2024-04-25T02:09:11.069 INFO:tasks.workunit.client.1.smithi112.stdout:9/528: dread d1/df/d3c/d46/f98 [0,4194304] 0 2024-04-25T02:09:11.070 INFO:tasks.workunit.client.1.smithi112.stdout:5/429: creat d1/d2/d45/f95 x:0 0 0 2024-04-25T02:09:11.071 INFO:tasks.workunit.client.1.smithi112.stdout:7/545: getdents d7/d25/d43 0 2024-04-25T02:09:11.071 INFO:tasks.workunit.client.1.smithi112.stdout:7/546: read - d7/dd/f9f zero size 2024-04-25T02:09:11.072 INFO:tasks.workunit.client.1.smithi112.stdout:4/603: creat d2/d1e/fbd x:0 0 0 2024-04-25T02:09:11.073 INFO:tasks.workunit.client.1.smithi112.stdout:5/430: mkdir d1/d41/d5b/d96 0 2024-04-25T02:09:11.075 INFO:tasks.workunit.client.1.smithi112.stdout:4/604: mkdir d2/d17/d20/dbe 0 2024-04-25T02:09:11.077 INFO:tasks.workunit.client.1.smithi112.stdout:0/696: dwrite da/f46 [0,4194304] 0 2024-04-25T02:09:11.077 INFO:tasks.workunit.client.1.smithi112.stdout:4/605: rename d2/d1e/d4b/d57/l85 to d2/d1e/d4b/d57/lbf 0 2024-04-25T02:09:11.077 INFO:tasks.workunit.client.1.smithi112.stdout:4/606: dread - d2/d12/fba zero size 2024-04-25T02:09:11.077 INFO:tasks.workunit.client.1.smithi112.stdout:4/607: truncate d2/d17/d25/f91 81163 0 2024-04-25T02:09:11.079 INFO:tasks.workunit.client.1.smithi112.stdout:0/697: unlink da/d13/d1e/f3b 0 2024-04-25T02:09:11.080 INFO:tasks.workunit.client.1.smithi112.stdout:4/608: mknod d2/d1e/d1b/d65/cc0 0 2024-04-25T02:09:11.081 INFO:tasks.workunit.client.1.smithi112.stdout:0/698: mknod da/d1d/d2e/d40/d49/d6b/d90/cde 0 2024-04-25T02:09:11.093 INFO:tasks.workunit.client.1.smithi112.stdout:5/431: write d1/d2/f31 [1883190,50684] 0 2024-04-25T02:09:11.106 INFO:tasks.workunit.client.1.smithi112.stdout:1/547: getdents d7/d9/d1e/d66 0 2024-04-25T02:09:11.110 INFO:tasks.workunit.client.1.smithi112.stdout:1/548: rename d7/c5f to d7/d4b/cb2 0 2024-04-25T02:09:11.110 INFO:tasks.workunit.client.1.smithi112.stdout:1/549: fdatasync d7/d4b/fa4 0 2024-04-25T02:09:11.112 INFO:tasks.workunit.client.1.smithi112.stdout:1/550: creat d7/d9/d51/fb3 x:0 0 0 2024-04-25T02:09:11.124 INFO:tasks.workunit.client.1.smithi112.stdout:3/536: dwrite d12/d13/f42 [0,4194304] 0 2024-04-25T02:09:11.125 INFO:tasks.workunit.client.1.smithi112.stdout:3/537: mknod d12/d13/d34/d78/d91/ca9 0 2024-04-25T02:09:11.127 INFO:tasks.workunit.client.1.smithi112.stdout:3/538: mkdir d12/d1f/daa 0 2024-04-25T02:09:11.129 INFO:tasks.workunit.client.1.smithi112.stdout:3/539: rename d12/d13/c80 to d12/d67/d8f/cab 0 2024-04-25T02:09:11.129 INFO:tasks.workunit.client.1.smithi112.stdout:9/529: dwrite d1/d13/d41/f66 [0,4194304] 0 2024-04-25T02:09:11.129 INFO:tasks.workunit.client.1.smithi112.stdout:9/530: rename d1/d48 to d1/d48/dbc 22 2024-04-25T02:09:11.131 INFO:tasks.workunit.client.1.smithi112.stdout:7/547: dwrite d7/d79/da2/f8b [0,4194304] 0 2024-04-25T02:09:11.132 INFO:tasks.workunit.client.1.smithi112.stdout:2/395: dwrite d3/da/f2c [0,4194304] 0 2024-04-25T02:09:11.133 INFO:tasks.workunit.client.1.smithi112.stdout:4/609: dwrite d2/d12/d22/f2f [4194304,4194304] 0 2024-04-25T02:09:11.135 INFO:tasks.workunit.client.1.smithi112.stdout:5/432: dwrite d1/f3b [0,4194304] 0 2024-04-25T02:09:11.136 INFO:tasks.workunit.client.1.smithi112.stdout:7/548: symlink d7/dd/d20/la5 0 2024-04-25T02:09:11.137 INFO:tasks.workunit.client.1.smithi112.stdout:2/396: truncate d3/f9 2070143 0 2024-04-25T02:09:11.137 INFO:tasks.workunit.client.1.smithi112.stdout:2/397: chown d3/da/dc/d3e/f3c 6 1 2024-04-25T02:09:11.138 INFO:tasks.workunit.client.1.smithi112.stdout:2/398: read d3/da/dc/d20/f21 [828146,84347] 0 2024-04-25T02:09:11.141 INFO:tasks.workunit.client.1.smithi112.stdout:4/610: unlink d2/d12/d22/d60/f88 0 2024-04-25T02:09:11.141 INFO:tasks.workunit.client.1.smithi112.stdout:9/531: write d1/d13/f37 [2502093,63125] 0 2024-04-25T02:09:11.142 INFO:tasks.workunit.client.1.smithi112.stdout:5/433: unlink d1/d41/d8a/f8e 0 2024-04-25T02:09:11.142 INFO:tasks.workunit.client.1.smithi112.stdout:7/549: mknod d7/d25/d43/ca6 0 2024-04-25T02:09:11.144 INFO:tasks.workunit.client.1.smithi112.stdout:2/399: mkdir d3/da/dc/d3e/df/d25/d88/d8e 0 2024-04-25T02:09:11.145 INFO:tasks.workunit.client.1.smithi112.stdout:2/400: write d3/da/dc/d20/d40/f79 [1707729,117641] 0 2024-04-25T02:09:11.146 INFO:tasks.workunit.client.1.smithi112.stdout:3/540: dwrite d12/d13/d34/d4a/f84 [0,4194304] 0 2024-04-25T02:09:11.148 INFO:tasks.workunit.client.1.smithi112.stdout:4/611: mknod d2/d17/d20/cc1 0 2024-04-25T02:09:11.151 INFO:tasks.workunit.client.1.smithi112.stdout:5/434: symlink d1/d16/d8f/l97 0 2024-04-25T02:09:11.154 INFO:tasks.workunit.client.1.smithi112.stdout:2/401: truncate d3/da/f2b 958920 0 2024-04-25T02:09:11.154 INFO:tasks.workunit.client.1.smithi112.stdout:2/402: stat d3/da/dc/d20/d85/f8d 0 2024-04-25T02:09:11.154 INFO:tasks.workunit.client.1.smithi112.stdout:2/403: read d3/da/dc/d20/d85/f8d [114781,16162] 0 2024-04-25T02:09:11.154 INFO:tasks.workunit.client.1.smithi112.stdout:2/404: truncate d3/da/dc/d20/d43/d74/f80 875484 0 2024-04-25T02:09:11.158 INFO:tasks.workunit.client.1.smithi112.stdout:3/541: symlink d12/d67/d8f/lac 0 2024-04-25T02:09:11.173 INFO:tasks.workunit.client.1.smithi112.stdout:4/612: rename d2/d1e/f81 to d2/d17/fc2 0 2024-04-25T02:09:11.175 INFO:tasks.workunit.client.1.smithi112.stdout:9/532: getdents d1/d13/d41 0 2024-04-25T02:09:11.175 INFO:tasks.workunit.client.1.smithi112.stdout:9/533: fdatasync d1/f3b 0 2024-04-25T02:09:11.176 INFO:tasks.workunit.client.1.smithi112.stdout:5/435: mkdir d1/d16/d98 0 2024-04-25T02:09:11.176 INFO:tasks.workunit.client.1.smithi112.stdout:5/436: stat d1/c21 0 2024-04-25T02:09:11.176 INFO:tasks.workunit.client.1.smithi112.stdout:5/437: fsync d1/d2/f33 0 2024-04-25T02:09:11.179 INFO:tasks.workunit.client.1.smithi112.stdout:2/405: mknod d3/da/d18/c8f 0 2024-04-25T02:09:11.185 INFO:tasks.workunit.client.1.smithi112.stdout:3/542: rename d12/d13/l6e to d12/d67/lad 0 2024-04-25T02:09:11.190 INFO:tasks.workunit.client.1.smithi112.stdout:5/438: mkdir d1/d16/d99 0 2024-04-25T02:09:11.191 INFO:tasks.workunit.client.1.smithi112.stdout:3/543: creat d12/d13/d34/d53/fae x:0 0 0 2024-04-25T02:09:11.192 INFO:tasks.workunit.client.1.smithi112.stdout:4/613: mknod d2/d12/cc3 0 2024-04-25T02:09:11.194 INFO:tasks.workunit.client.1.smithi112.stdout:5/439: link d1/d2/d28/l92 d1/d16/d51/d93/l9a 0 2024-04-25T02:09:11.194 INFO:tasks.workunit.client.1.smithi112.stdout:3/544: getdents d12/d13/d34/d4a/d4f/d7d 0 2024-04-25T02:09:11.195 INFO:tasks.workunit.client.1.smithi112.stdout:4/614: creat d2/d1e/db3/fc4 x:0 0 0 2024-04-25T02:09:11.196 INFO:tasks.workunit.client.1.smithi112.stdout:9/534: dwrite d1/d48/d65/d73/daf/d63/f77 [4194304,4194304] 0 2024-04-25T02:09:11.196 INFO:tasks.workunit.client.1.smithi112.stdout:2/406: dwrite d3/da/dc/d3e/df/d25/f77 [0,4194304] 0 2024-04-25T02:09:11.198 INFO:tasks.workunit.client.1.smithi112.stdout:5/440: unlink d1/d16/f19 0 2024-04-25T02:09:11.198 INFO:tasks.workunit.client.1.smithi112.stdout:5/441: truncate d1/d16/f73 420455 0 2024-04-25T02:09:11.198 INFO:tasks.workunit.client.1.smithi112.stdout:3/545: rmdir d12/d13/d34/d78/d91 39 2024-04-25T02:09:11.200 INFO:tasks.workunit.client.1.smithi112.stdout:4/615: rename d2/f1a to d2/d1e/fc5 0 2024-04-25T02:09:11.200 INFO:tasks.workunit.client.1.smithi112.stdout:4/616: creat d2/d17/d25/fc6 x:0 0 0 2024-04-25T02:09:11.201 INFO:tasks.workunit.client.1.smithi112.stdout:9/535: mkdir d1/d48/dbd 0 2024-04-25T02:09:11.201 INFO:tasks.workunit.client.1.smithi112.stdout:9/536: creat d1/df/d3c/d46/fbe x:0 0 0 2024-04-25T02:09:11.201 INFO:tasks.workunit.client.1.smithi112.stdout:9/537: write d1/d48/d65/f79 [974493,128628] 0 2024-04-25T02:09:11.205 INFO:tasks.workunit.client.1.smithi112.stdout:2/407: write d3/da/dc/d3e/df/d25/f54 [545407,95204] 0 2024-04-25T02:09:11.207 INFO:tasks.workunit.client.1.smithi112.stdout:4/617: mkdir d2/d17/d20/d26/d39/d49/d95/dc7 0 2024-04-25T02:09:11.207 INFO:tasks.workunit.client.1.smithi112.stdout:4/618: fdatasync d2/d12/fa9 0 2024-04-25T02:09:11.210 INFO:tasks.workunit.client.1.smithi112.stdout:9/538: rename d1/d48/d65/d73/fb7 to d1/df/d3c/d43/fbf 0 2024-04-25T02:09:11.210 INFO:tasks.workunit.client.1.smithi112.stdout:9/539: readlink d1/d13/d5b/lb1 0 2024-04-25T02:09:11.214 INFO:tasks.workunit.client.1.smithi112.stdout:5/442: dwrite d1/d41/d5b/d7b/f7f [0,4194304] 0 2024-04-25T02:09:11.215 INFO:tasks.workunit.client.1.smithi112.stdout:2/408: creat d3/da/dc/d3e/df/d32/f90 x:0 0 0 2024-04-25T02:09:11.216 INFO:tasks.workunit.client.1.smithi112.stdout:4/619: creat d2/d17/d20/d26/d39/d49/fc8 x:0 0 0 2024-04-25T02:09:11.217 INFO:tasks.workunit.client.1.smithi112.stdout:4/620: write d2/d17/d20/d26/d39/d49/f3c [1116139,119762] 0 2024-04-25T02:09:11.217 INFO:tasks.workunit.client.1.smithi112.stdout:4/621: readlink d2/d17/d25/l51 0 2024-04-25T02:09:11.217 INFO:tasks.workunit.client.1.smithi112.stdout:4/622: truncate d2/d17/d25/f91 896751 0 2024-04-25T02:09:11.217 INFO:tasks.workunit.client.1.smithi112.stdout:4/623: truncate d2/d17/d20/d5e/fb8 50773 0 2024-04-25T02:09:11.218 INFO:tasks.workunit.client.1.smithi112.stdout:1/551: dwrite d7/d9/f1b [0,4194304] 0 2024-04-25T02:09:11.223 INFO:tasks.workunit.client.1.smithi112.stdout:5/443: creat d1/d2/d78/f9b x:0 0 0 2024-04-25T02:09:11.224 INFO:tasks.workunit.client.1.smithi112.stdout:2/409: mknod d3/da/dc/d20/d85/c91 0 2024-04-25T02:09:11.235 INFO:tasks.workunit.client.1.smithi112.stdout:9/540: dwrite d1/d13/d5b/f85 [4194304,4194304] 0 2024-04-25T02:09:11.236 INFO:tasks.workunit.client.1.smithi112.stdout:8/667: dwrite d15/d26/f92 [0,4194304] 0 2024-04-25T02:09:11.236 INFO:tasks.workunit.client.1.smithi112.stdout:4/624: creat d2/d1e/d1b/d65/fc9 x:0 0 0 2024-04-25T02:09:11.236 INFO:tasks.workunit.client.1.smithi112.stdout:0/699: dwrite da/d13/d23/d77/fb6 [0,4194304] 0 2024-04-25T02:09:11.237 INFO:tasks.workunit.client.1.smithi112.stdout:0/700: readlink da/d1d/d2e/d40/d49/d4f/l8a 0 2024-04-25T02:09:11.263 INFO:tasks.workunit.client.1.smithi112.stdout:9/541: rename d1/f91 to d1/d13/d5b/fc0 0 2024-04-25T02:09:11.267 INFO:tasks.workunit.client.1.smithi112.stdout:8/668: link d15/l75 d15/d35/d5c/d91/d78/le5 0 2024-04-25T02:09:11.267 INFO:tasks.workunit.client.1.smithi112.stdout:8/669: chown d15/d26/d37/d8e/l7c 990175 1 2024-04-25T02:09:11.267 INFO:tasks.workunit.client.1.smithi112.stdout:8/670: chown d15/d35/d5c/d91/d78/fbd 1864290 1 2024-04-25T02:09:11.267 INFO:tasks.workunit.client.1.smithi112.stdout:8/671: fdatasync d15/d35/d5c/d91/d78/fbb 0 2024-04-25T02:09:11.269 INFO:tasks.workunit.client.1.smithi112.stdout:4/625: creat d2/d12/fca x:0 0 0 2024-04-25T02:09:11.271 INFO:tasks.workunit.client.1.smithi112.stdout:0/701: symlink da/d1d/d2e/d40/d49/d6b/ldf 0 2024-04-25T02:09:11.271 INFO:tasks.workunit.client.1.smithi112.stdout:0/702: dread - da/d1d/d2e/d40/fc9 zero size 2024-04-25T02:09:11.271 INFO:tasks.workunit.client.1.smithi112.stdout:0/703: chown da/d1d/d2e/d40/d49/d6b/d90 0 1 2024-04-25T02:09:11.273 INFO:tasks.workunit.client.1.smithi112.stdout:9/542: truncate d1/df/f11 507917 0 2024-04-25T02:09:11.273 INFO:tasks.workunit.client.1.smithi112.stdout:3/546: write d12/f1d [1383183,42846] 0 2024-04-25T02:09:11.273 INFO:tasks.workunit.client.1.smithi112.stdout:8/672: mkdir d15/d35/d5c/d91/dc8/de6 0 2024-04-25T02:09:11.275 INFO:tasks.workunit.client.1.smithi112.stdout:0/704: mkdir da/d13/d1e/de0 0 2024-04-25T02:09:11.277 INFO:tasks.workunit.client.1.smithi112.stdout:3/547: rename d12/d1f/d27/d44/d73/l96 to d12/d13/d34/d78/d83/laf 0 2024-04-25T02:09:11.278 INFO:tasks.workunit.client.1.smithi112.stdout:8/673: creat d15/d26/d4f/d67/fe7 x:0 0 0 2024-04-25T02:09:11.278 INFO:tasks.workunit.client.1.smithi112.stdout:8/674: fsync d15/d26/fe2 0 2024-04-25T02:09:11.279 INFO:tasks.workunit.client.1.smithi112.stdout:0/705: symlink da/d13/d45/d5e/db4/ddc/le1 0 2024-04-25T02:09:11.281 INFO:tasks.workunit.client.1.smithi112.stdout:3/548: mkdir d12/d1f/db0 0 2024-04-25T02:09:11.284 INFO:tasks.workunit.client.1.smithi112.stdout:0/706: mknod da/d13/d1e/db1/ce2 0 2024-04-25T02:09:11.284 INFO:tasks.workunit.client.1.smithi112.stdout:0/707: chown da/d13/d45/d5e/db4/ddc 85 1 2024-04-25T02:09:11.287 INFO:tasks.workunit.client.1.smithi112.stdout:3/549: creat d12/d13/d86/da0/fb1 x:0 0 0 2024-04-25T02:09:11.290 INFO:tasks.workunit.client.1.smithi112.stdout:4/626: write d2/d12/f44 [323111,92979] 0 2024-04-25T02:09:11.290 INFO:tasks.workunit.client.1.smithi112.stdout:0/708: symlink da/d1d/dcb/le3 0 2024-04-25T02:09:11.292 INFO:tasks.workunit.client.1.smithi112.stdout:3/550: creat d12/d67/fb2 x:0 0 0 2024-04-25T02:09:11.294 INFO:tasks.workunit.client.1.smithi112.stdout:4/627: creat d2/d17/d20/d5e/daf/fcb x:0 0 0 2024-04-25T02:09:11.295 INFO:tasks.workunit.client.1.smithi112.stdout:0/709: mknod da/d1d/dbe/ce4 0 2024-04-25T02:09:11.295 INFO:tasks.workunit.client.1.smithi112.stdout:0/710: fsync da/d13/d1e/f3c 0 2024-04-25T02:09:11.299 INFO:tasks.workunit.client.1.smithi112.stdout:0/711: rename da/d1d/d2e/d40/d49/d4f/d82/fdb to da/d1d/dbe/fe5 0 2024-04-25T02:09:11.304 INFO:tasks.workunit.client.1.smithi112.stdout:4/628: write d2/d17/d7c/d9c/f9d [4113651,61746] 0 2024-04-25T02:09:11.304 INFO:tasks.workunit.client.1.smithi112.stdout:4/629: creat d2/d12/d22/d60/fcc x:0 0 0 2024-04-25T02:09:11.305 INFO:tasks.workunit.client.1.smithi112.stdout:3/551: dread d12/f14 [0,4194304] 0 2024-04-25T02:09:11.305 INFO:tasks.workunit.client.1.smithi112.stdout:3/552: truncate d12/d13/d34/f9a 86717 0 2024-04-25T02:09:11.306 INFO:tasks.workunit.client.1.smithi112.stdout:0/712: dread da/d1d/f43 [0,4194304] 0 2024-04-25T02:09:11.308 INFO:tasks.workunit.client.1.smithi112.stdout:0/713: getdents da/d13 0 2024-04-25T02:09:11.308 INFO:tasks.workunit.client.1.smithi112.stdout:0/714: creat da/d1d/dcb/fe6 x:0 0 0 2024-04-25T02:09:11.311 INFO:tasks.workunit.client.1.smithi112.stdout:0/715: mkdir da/d1d/d88/d78/de7 0 2024-04-25T02:09:11.316 INFO:tasks.workunit.client.1.smithi112.stdout:2/410: dwrite d3/da/dc/d3e/df/d25/f77 [4194304,4194304] 0 2024-04-25T02:09:11.316 INFO:tasks.workunit.client.1.smithi112.stdout:4/630: write d2/d12/d22/f2f [3716698,107458] 0 2024-04-25T02:09:11.317 INFO:tasks.workunit.client.1.smithi112.stdout:8/675: dwrite d15/d35/d5f/db5/fc4 [0,4194304] 0 2024-04-25T02:09:11.317 INFO:tasks.workunit.client.1.smithi112.stdout:8/676: fdatasync d15/d35/d56/f96 0 2024-04-25T02:09:11.323 INFO:tasks.workunit.client.1.smithi112.stdout:9/543: dwrite d1/d13/d41/d84/f95 [0,4194304] 0 2024-04-25T02:09:11.323 INFO:tasks.workunit.client.1.smithi112.stdout:9/544: fdatasync d1/d13/d41/d84/fa6 0 2024-04-25T02:09:11.323 INFO:tasks.workunit.client.1.smithi112.stdout:9/545: chown d1/df/d8f/f94 18 1 2024-04-25T02:09:11.323 INFO:tasks.workunit.client.1.smithi112.stdout:3/553: dwrite d12/d1f/d27/d44/d7e/f88 [0,4194304] 0 2024-04-25T02:09:11.324 INFO:tasks.workunit.client.1.smithi112.stdout:3/554: read - d12/d13/d34/d78/d83/f94 zero size 2024-04-25T02:09:11.326 INFO:tasks.workunit.client.1.smithi112.stdout:2/411: dread d3/da/f1c [0,4194304] 0 2024-04-25T02:09:11.330 INFO:tasks.workunit.client.1.smithi112.stdout:9/546: dread d1/df/d3c/d6c/f97 [0,4194304] 0 2024-04-25T02:09:11.331 INFO:tasks.workunit.client.1.smithi112.stdout:2/412: creat d3/da/dc/d20/d43/d5e/f92 x:0 0 0 2024-04-25T02:09:11.331 INFO:tasks.workunit.client.1.smithi112.stdout:2/413: readlink d3/da/dc/l1a 0 2024-04-25T02:09:11.332 INFO:tasks.workunit.client.1.smithi112.stdout:9/547: mkdir d1/d13/d41/dc1 0 2024-04-25T02:09:11.334 INFO:tasks.workunit.client.1.smithi112.stdout:9/548: mkdir d1/d93/dc2 0 2024-04-25T02:09:11.334 INFO:tasks.workunit.client.1.smithi112.stdout:9/549: chown d1/lb0 317314 1 2024-04-25T02:09:11.335 INFO:tasks.workunit.client.1.smithi112.stdout:9/550: getdents d1/d48/dbd 0 2024-04-25T02:09:11.335 INFO:tasks.workunit.client.1.smithi112.stdout:2/414: getdents d3/da 0 2024-04-25T02:09:11.351 INFO:tasks.workunit.client.1.smithi112.stdout:2/415: write d3/da/dc/d3e/df/d25/f54 [4318761,121964] 0 2024-04-25T02:09:11.356 INFO:tasks.workunit.client.1.smithi112.stdout:0/716: dwrite da/d1d/d2e/d40/d49/f61 [0,4194304] 0 2024-04-25T02:09:11.356 INFO:tasks.workunit.client.1.smithi112.stdout:0/717: fsync da/d1d/d2e/d40/d49/d6b/d90/fac 0 2024-04-25T02:09:11.356 INFO:tasks.workunit.client.1.smithi112.stdout:0/718: fsync da/d1d/f43 0 2024-04-25T02:09:11.356 INFO:tasks.workunit.client.1.smithi112.stdout:0/719: write da/fb [1377071,96053] 0 2024-04-25T02:09:11.356 INFO:tasks.workunit.client.1.smithi112.stdout:4/631: dwrite d2/f1d [0,4194304] 0 2024-04-25T02:09:11.356 INFO:tasks.workunit.client.1.smithi112.stdout:8/677: dwrite d15/d35/d5f/fa0 [0,4194304] 0 2024-04-25T02:09:11.356 INFO:tasks.workunit.client.1.smithi112.stdout:4/632: creat d2/d1e/d1b/fcd x:0 0 0 2024-04-25T02:09:11.357 INFO:tasks.workunit.client.1.smithi112.stdout:3/555: dwrite d12/d13/d34/d78/f7f [0,4194304] 0 2024-04-25T02:09:11.361 INFO:tasks.workunit.client.1.smithi112.stdout:9/551: dwrite d1/d13/f26 [0,4194304] 0 2024-04-25T02:09:11.361 INFO:tasks.workunit.client.1.smithi112.stdout:9/552: chown d1/f38 40600664 1 2024-04-25T02:09:11.361 INFO:tasks.workunit.client.1.smithi112.stdout:9/553: readlink d1/d13/d5b/lb1 0 2024-04-25T02:09:11.361 INFO:tasks.workunit.client.1.smithi112.stdout:9/554: chown d1/df/l28 267 1 2024-04-25T02:09:11.361 INFO:tasks.workunit.client.1.smithi112.stdout:9/555: readlink d1/d48/l8a 0 2024-04-25T02:09:11.361 INFO:tasks.workunit.client.1.smithi112.stdout:9/556: write d1/d13/f9d [5275,52699] 0 2024-04-25T02:09:11.367 INFO:tasks.workunit.client.1.smithi112.stdout:0/720: rmdir da/d1d/d2e/dbd 39 2024-04-25T02:09:11.368 INFO:tasks.workunit.client.1.smithi112.stdout:0/721: write da/d1d/d2e/f9f [126658,24110] 0 2024-04-25T02:09:11.372 INFO:tasks.workunit.client.1.smithi112.stdout:3/556: mkdir d12/d1f/d27/d44/d73/d95/da5/db3 0 2024-04-25T02:09:11.372 INFO:tasks.workunit.client.1.smithi112.stdout:3/557: creat d12/d1f/d27/d44/d73/fb4 x:0 0 0 2024-04-25T02:09:11.375 INFO:tasks.workunit.client.1.smithi112.stdout:9/557: write d1/d13/f20 [7997242,40103] 0 2024-04-25T02:09:11.375 INFO:tasks.workunit.client.1.smithi112.stdout:9/558: chown d1/d48/d65/c6d 4869 1 2024-04-25T02:09:11.379 INFO:tasks.workunit.client.1.smithi112.stdout:8/678: dwrite d15/d35/fae [0,4194304] 0 2024-04-25T02:09:11.379 INFO:tasks.workunit.client.1.smithi112.stdout:2/416: dwrite d3/da/dc/d20/d43/d5e/f92 [0,4194304] 0 2024-04-25T02:09:11.380 INFO:tasks.workunit.client.1.smithi112.stdout:8/679: fsync d15/d26/d4f/fca 0 2024-04-25T02:09:11.380 INFO:tasks.workunit.client.1.smithi112.stdout:2/417: creat d3/da/dc/f93 x:0 0 0 2024-04-25T02:09:11.386 INFO:tasks.workunit.client.1.smithi112.stdout:4/633: rmdir d2/d1e/d1b/d65 39 2024-04-25T02:09:11.386 INFO:tasks.workunit.client.1.smithi112.stdout:4/634: readlink d2/d17/d20/l3e 0 2024-04-25T02:09:11.386 INFO:tasks.workunit.client.1.smithi112.stdout:9/559: dread d1/d13/d41/f66 [0,4194304] 0 2024-04-25T02:09:11.388 INFO:tasks.workunit.client.1.smithi112.stdout:0/722: creat da/d1d/d2e/d40/dad/fe8 x:0 0 0 2024-04-25T02:09:11.388 INFO:tasks.workunit.client.1.smithi112.stdout:0/723: fdatasync da/d1d/f43 0 2024-04-25T02:09:11.391 INFO:tasks.workunit.client.1.smithi112.stdout:3/558: mknod d12/d13/d34/cb5 0 2024-04-25T02:09:11.391 INFO:tasks.workunit.client.1.smithi112.stdout:3/559: write d12/d13/f1b [4507241,17378] 0 2024-04-25T02:09:11.397 INFO:tasks.workunit.client.1.smithi112.stdout:8/680: mknod d15/d35/d5c/d91/d78/ce8 0 2024-04-25T02:09:11.399 INFO:tasks.workunit.client.1.smithi112.stdout:2/418: symlink d3/da/dc/d20/d43/d5e/l94 0 2024-04-25T02:09:11.399 INFO:tasks.workunit.client.1.smithi112.stdout:2/419: chown d3/da/dc/d3e/df 1449 1 2024-04-25T02:09:11.399 INFO:tasks.workunit.client.1.smithi112.stdout:2/420: stat d3/da/dc/d20/d40 0 2024-04-25T02:09:11.399 INFO:tasks.workunit.client.1.smithi112.stdout:0/724: write da/d13/d23/d77/fb6 [1668311,91092] 0 2024-04-25T02:09:11.400 INFO:tasks.workunit.client.1.smithi112.stdout:4/635: unlink d2/d17/l29 0 2024-04-25T02:09:11.400 INFO:tasks.workunit.client.1.smithi112.stdout:4/636: fdatasync d2/d17/d20/d26/d39/d49/f3c 0 2024-04-25T02:09:11.400 INFO:tasks.workunit.client.1.smithi112.stdout:4/637: chown d2/d17/d25/l51 584 1 2024-04-25T02:09:11.401 INFO:tasks.workunit.client.1.smithi112.stdout:4/638: chown d2/d12/d22/d60/f7f 79 1 2024-04-25T02:09:11.402 INFO:tasks.workunit.client.1.smithi112.stdout:9/560: symlink d1/df/lc3 0 2024-04-25T02:09:11.403 INFO:tasks.workunit.client.1.smithi112.stdout:3/560: rename d12/d1f/d27/d44/f92 to d12/d1f/d27/d44/fb6 0 2024-04-25T02:09:11.409 INFO:tasks.workunit.client.1.smithi112.stdout:8/681: symlink d15/d26/d4f/d67/le9 0 2024-04-25T02:09:11.410 INFO:tasks.workunit.client.1.smithi112.stdout:2/421: getdents d3/da/dc/d20/d43/d74 0 2024-04-25T02:09:11.410 INFO:tasks.workunit.client.1.smithi112.stdout:2/422: write d3/da/dc/d20/d40/f5b [6464001,60867] 0 2024-04-25T02:09:11.411 INFO:tasks.workunit.client.1.smithi112.stdout:4/639: write d2/d12/f19 [388066,122929] 0 2024-04-25T02:09:11.411 INFO:tasks.workunit.client.1.smithi112.stdout:0/725: mkdir da/d1d/d2e/d40/d49/d4f/d58/de9 0 2024-04-25T02:09:11.413 INFO:tasks.workunit.client.1.smithi112.stdout:9/561: truncate d1/d13/d5b/f85 2481601 0 2024-04-25T02:09:11.414 INFO:tasks.workunit.client.1.smithi112.stdout:4/640: fsync d2/fb 0 2024-04-25T02:09:11.414 INFO:tasks.workunit.client.1.smithi112.stdout:4/641: creat d2/d1e/fce x:0 0 0 2024-04-25T02:09:11.415 INFO:tasks.workunit.client.1.smithi112.stdout:0/726: write da/d1d/d2e/d40/d49/d4f/d58/d6d/f8b [710636,55072] 0 2024-04-25T02:09:11.415 INFO:tasks.workunit.client.1.smithi112.stdout:0/727: chown da/d1d/d2e/d40/d49/d6b/f73 697 1 2024-04-25T02:09:11.416 INFO:tasks.workunit.client.1.smithi112.stdout:3/561: creat d12/d1f/d27/d44/d73/d95/da5/db3/fb7 x:0 0 0 2024-04-25T02:09:11.416 INFO:tasks.workunit.client.1.smithi112.stdout:8/682: getdents d15/d26/d37/d8e 0 2024-04-25T02:09:11.419 INFO:tasks.workunit.client.1.smithi112.stdout:2/423: mknod d3/da/dc/d3e/df/d25/d88/d8e/c95 0 2024-04-25T02:09:11.419 INFO:tasks.workunit.client.1.smithi112.stdout:2/424: chown d3/da/d18/f3f 48767579 1 2024-04-25T02:09:11.423 INFO:tasks.workunit.client.1.smithi112.stdout:4/642: write d2/f27 [1955562,59430] 0 2024-04-25T02:09:11.428 INFO:tasks.workunit.client.1.smithi112.stdout:9/562: truncate d1/df/d3c/d46/f56 873554 0 2024-04-25T02:09:11.434 INFO:tasks.workunit.client.1.smithi112.stdout:0/728: mkdir da/d1d/d88/d24/dea 0 2024-04-25T02:09:11.450 INFO:tasks.workunit.client.1.smithi112.stdout:6/526: sync 2024-04-25T02:09:11.450 INFO:tasks.workunit.client.1.smithi112.stdout:6/527: write d0/d36/f37 [4261603,13611] 0 2024-04-25T02:09:11.450 INFO:tasks.workunit.client.1.smithi112.stdout:7/550: sync 2024-04-25T02:09:11.450 INFO:tasks.workunit.client.1.smithi112.stdout:5/444: sync 2024-04-25T02:09:11.450 INFO:tasks.workunit.client.1.smithi112.stdout:5/445: getdents d1/d2/d7d 0 2024-04-25T02:09:11.450 INFO:tasks.workunit.client.1.smithi112.stdout:1/552: sync 2024-04-25T02:09:11.450 INFO:tasks.workunit.client.1.smithi112.stdout:1/553: chown d7/d9/d4e/d28/d32/f68 32203497 1 2024-04-25T02:09:11.450 INFO:tasks.workunit.client.1.smithi112.stdout:1/554: fdatasync d7/d9/d1f/f3e 0 2024-04-25T02:09:11.450 INFO:tasks.workunit.client.1.smithi112.stdout:1/555: write d7/d9/d1e/d66/f7e [1368828,67137] 0 2024-04-25T02:09:11.451 INFO:tasks.workunit.client.1.smithi112.stdout:8/683: rename d15/d35/d5c/d91/d78/laf to d15/d35/d5c/de4/lea 0 2024-04-25T02:09:11.454 INFO:tasks.workunit.client.1.smithi112.stdout:2/425: mkdir d3/da/dc/d3e/df/d30/d7c/d96 0 2024-04-25T02:09:11.454 INFO:tasks.workunit.client.1.smithi112.stdout:1/556: write f6 [2292894,59928] 0 2024-04-25T02:09:11.454 INFO:tasks.workunit.client.1.smithi112.stdout:1/557: write d7/d9/f10 [1211144,3778] 0 2024-04-25T02:09:11.460 INFO:tasks.workunit.client.1.smithi112.stdout:4/643: mknod d2/d1e/d1b/d65/ccf 0 2024-04-25T02:09:11.465 INFO:tasks.workunit.client.1.smithi112.stdout:0/729: mkdir da/d13/d1e/de0/deb 0 2024-04-25T02:09:11.466 INFO:tasks.workunit.client.1.smithi112.stdout:0/730: creat da/d1d/d2e/d40/dad/fec x:0 0 0 2024-04-25T02:09:11.467 INFO:tasks.workunit.client.1.smithi112.stdout:3/562: getdents d12 0 2024-04-25T02:09:11.469 INFO:tasks.workunit.client.1.smithi112.stdout:6/528: creat d0/d2/d4/fbb x:0 0 0 2024-04-25T02:09:11.471 INFO:tasks.workunit.client.1.smithi112.stdout:7/551: creat d7/d25/d43/fa7 x:0 0 0 2024-04-25T02:09:11.471 INFO:tasks.workunit.client.1.smithi112.stdout:7/552: chown d7/dd/d20/d2c/l2f 46680172 1 2024-04-25T02:09:11.473 INFO:tasks.workunit.client.1.smithi112.stdout:8/684: creat d15/d35/d5c/d91/d78/dc5/feb x:0 0 0 2024-04-25T02:09:11.476 INFO:tasks.workunit.client.1.smithi112.stdout:3/563: read d12/f36 [144230,70729] 0 2024-04-25T02:09:11.476 INFO:tasks.workunit.client.1.smithi112.stdout:1/558: mknod d7/d9/d4e/d28/d43/d6a/cb4 0 2024-04-25T02:09:11.477 INFO:tasks.workunit.client.1.smithi112.stdout:4/644: mknod d2/d17/d20/d26/d39/d49/d95/dc7/cd0 0 2024-04-25T02:09:11.479 INFO:tasks.workunit.client.1.smithi112.stdout:0/731: truncate da/f8e 1069283 0 2024-04-25T02:09:11.479 INFO:tasks.workunit.client.1.smithi112.stdout:6/529: mkdir d0/d2/d66/d7d/d95/dbc 0 2024-04-25T02:09:11.480 INFO:tasks.workunit.client.1.smithi112.stdout:7/553: dread d7/dd/d20/d2c/f45 [0,4194304] 0 2024-04-25T02:09:11.480 INFO:tasks.workunit.client.1.smithi112.stdout:8/685: mkdir d15/d81/dec 0 2024-04-25T02:09:11.481 INFO:tasks.workunit.client.1.smithi112.stdout:8/686: chown d15/cad 34933 1 2024-04-25T02:09:11.482 INFO:tasks.workunit.client.1.smithi112.stdout:1/559: creat d7/d9/d1e/fb5 x:0 0 0 2024-04-25T02:09:11.482 INFO:tasks.workunit.client.1.smithi112.stdout:1/560: creat d7/d9/d46/fb6 x:0 0 0 2024-04-25T02:09:11.483 INFO:tasks.workunit.client.1.smithi112.stdout:3/564: mknod d12/d5d/cb8 0 2024-04-25T02:09:11.485 INFO:tasks.workunit.client.1.smithi112.stdout:6/530: rename d0/c14 to d0/d2/d4/dd/db7/cbd 0 2024-04-25T02:09:11.486 INFO:tasks.workunit.client.1.smithi112.stdout:7/554: symlink d7/d25/d37/d7f/la8 0 2024-04-25T02:09:11.487 INFO:tasks.workunit.client.1.smithi112.stdout:7/555: truncate d7/d25/d43/f75 1038586 0 2024-04-25T02:09:11.488 INFO:tasks.workunit.client.1.smithi112.stdout:8/687: unlink d15/d17/d1a/c34 0 2024-04-25T02:09:11.493 INFO:tasks.workunit.client.1.smithi112.stdout:3/565: symlink d12/d1f/daa/lb9 0 2024-04-25T02:09:11.494 INFO:tasks.workunit.client.1.smithi112.stdout:4/645: dwrite d2/d1e/d1b/d86/f72 [0,4194304] 0 2024-04-25T02:09:11.495 INFO:tasks.workunit.client.1.smithi112.stdout:4/646: dread - d2/d17/d25/fc6 zero size 2024-04-25T02:09:11.495 INFO:tasks.workunit.client.1.smithi112.stdout:4/647: chown d2/d17/fc2 253045 1 2024-04-25T02:09:11.496 INFO:tasks.workunit.client.1.smithi112.stdout:0/732: getdents da/d1d/dcb 0 2024-04-25T02:09:11.497 INFO:tasks.workunit.client.1.smithi112.stdout:3/566: dread d12/f14 [0,4194304] 0 2024-04-25T02:09:11.500 INFO:tasks.workunit.client.1.smithi112.stdout:3/567: dread d12/d13/d34/d53/f8d [0,4194304] 0 2024-04-25T02:09:11.502 INFO:tasks.workunit.client.1.smithi112.stdout:8/688: unlink d15/d35/d56/f99 0 2024-04-25T02:09:11.502 INFO:tasks.workunit.client.1.smithi112.stdout:8/689: chown d15/d17/fa2 2 1 2024-04-25T02:09:11.502 INFO:tasks.workunit.client.1.smithi112.stdout:1/561: rmdir d7/d9/d51 39 2024-04-25T02:09:11.503 INFO:tasks.workunit.client.1.smithi112.stdout:1/562: write d7/d9/d1e/f12 [1826401,57084] 0 2024-04-25T02:09:11.503 INFO:tasks.workunit.client.1.smithi112.stdout:8/690: write d15/d35/d56/f96 [666223,67229] 0 2024-04-25T02:09:11.503 INFO:tasks.workunit.client.1.smithi112.stdout:8/691: read - d15/d26/d4f/d67/fe7 zero size 2024-04-25T02:09:11.507 INFO:tasks.workunit.client.1.smithi112.stdout:4/648: write d2/d12/d22/d60/f7f [8601,120377] 0 2024-04-25T02:09:11.508 INFO:tasks.workunit.client.1.smithi112.stdout:0/733: symlink da/d1d/d2e/d40/d49/d4f/d58/d6d/led 0 2024-04-25T02:09:11.515 INFO:tasks.workunit.client.1.smithi112.stdout:8/692: symlink d15/d35/d5c/d5e/led 0 2024-04-25T02:09:11.515 INFO:tasks.workunit.client.1.smithi112.stdout:8/693: write d15/d17/f6b [526439,11094] 0 2024-04-25T02:09:11.515 INFO:tasks.workunit.client.1.smithi112.stdout:4/649: symlink d2/d17/d20/d26/d39/d49/d95/dc7/ld1 0 2024-04-25T02:09:11.516 INFO:tasks.workunit.client.1.smithi112.stdout:4/650: fdatasync d2/f5f 0 2024-04-25T02:09:11.517 INFO:tasks.workunit.client.1.smithi112.stdout:7/556: rename d7/d25/d37 to d7/dd/da9 0 2024-04-25T02:09:11.518 INFO:tasks.workunit.client.1.smithi112.stdout:8/694: rmdir d15/d26/d37/da8 39 2024-04-25T02:09:11.518 INFO:tasks.workunit.client.1.smithi112.stdout:8/695: truncate d15/d17/fa2 436301 0 2024-04-25T02:09:11.520 INFO:tasks.workunit.client.1.smithi112.stdout:3/568: rename d12/d13/d34/d4a/d4f/da1/da7 to d12/d13/d34/d4a/d4f/d7d/dba 0 2024-04-25T02:09:11.523 INFO:tasks.workunit.client.1.smithi112.stdout:7/557: truncate d7/dd/da9/f6d 4014568 0 2024-04-25T02:09:11.524 INFO:tasks.workunit.client.1.smithi112.stdout:8/696: mknod d15/d35/d5c/d5e/cee 0 2024-04-25T02:09:11.524 INFO:tasks.workunit.client.1.smithi112.stdout:7/558: dread d7/dd/da9/f33 [0,4194304] 0 2024-04-25T02:09:11.524 INFO:tasks.workunit.client.1.smithi112.stdout:7/559: dread - d7/d79/da2/d3a/f9d zero size 2024-04-25T02:09:11.524 INFO:tasks.workunit.client.1.smithi112.stdout:7/560: fsync d7/dd/d20/d2c/f8c 0 2024-04-25T02:09:11.524 INFO:tasks.workunit.client.1.smithi112.stdout:7/561: chown d7/d25/d40/l8d 110 1 2024-04-25T02:09:11.525 INFO:tasks.workunit.client.1.smithi112.stdout:7/562: chown d7/dd/da9/f33 4 1 2024-04-25T02:09:11.525 INFO:tasks.workunit.client.1.smithi112.stdout:0/734: dwrite da/d13/d23/d77/f95 [0,4194304] 0 2024-04-25T02:09:11.532 INFO:tasks.workunit.client.1.smithi112.stdout:4/651: rmdir d2/d17 39 2024-04-25T02:09:11.537 INFO:tasks.workunit.client.1.smithi112.stdout:1/563: rename d7/d9/d4e/d28/d32/f6c to d7/d9/d1e/fb7 0 2024-04-25T02:09:11.537 INFO:tasks.workunit.client.1.smithi112.stdout:1/564: readlink d7/d9/d51/d58/l59 0 2024-04-25T02:09:11.537 INFO:tasks.workunit.client.1.smithi112.stdout:3/569: dwrite d12/d13/d34/d78/d83/f93 [0,4194304] 0 2024-04-25T02:09:11.538 INFO:tasks.workunit.client.1.smithi112.stdout:8/697: getdents d15/d35/d5c/d91/dc8 0 2024-04-25T02:09:11.538 INFO:tasks.workunit.client.1.smithi112.stdout:8/698: write fe [2651378,59666] 0 2024-04-25T02:09:11.538 INFO:tasks.workunit.client.1.smithi112.stdout:8/699: truncate d15/d26/d4f/fca 102547 0 2024-04-25T02:09:11.542 INFO:tasks.workunit.client.1.smithi112.stdout:7/563: mknod d7/d79/caa 0 2024-04-25T02:09:11.544 INFO:tasks.workunit.client.1.smithi112.stdout:0/735: mkdir da/d13/d23/dee 0 2024-04-25T02:09:11.547 INFO:tasks.workunit.client.1.smithi112.stdout:4/652: creat d2/d17/d20/d5e/d87/fd2 x:0 0 0 2024-04-25T02:09:11.550 INFO:tasks.workunit.client.1.smithi112.stdout:1/565: symlink d7/d9/d4e/d28/lb8 0 2024-04-25T02:09:11.550 INFO:tasks.workunit.client.1.smithi112.stdout:1/566: stat d7/d9/d1e/dab 0 2024-04-25T02:09:11.559 INFO:tasks.workunit.client.1.smithi112.stdout:8/700: rename d15/d40/f4d to d15/d35/d5f/fef 0 2024-04-25T02:09:11.566 INFO:tasks.workunit.client.1.smithi112.stdout:7/564: link d7/dd/da9/f6d d7/fab 0 2024-04-25T02:09:11.566 INFO:tasks.workunit.client.1.smithi112.stdout:7/565: write d7/dd/da9/d41/f6f [61756,16095] 0 2024-04-25T02:09:11.567 INFO:tasks.workunit.client.1.smithi112.stdout:0/736: link da/d13/d45/cc8 da/d1d/d2e/d40/d49/d4f/d58/cef 0 2024-04-25T02:09:11.569 INFO:tasks.workunit.client.1.smithi112.stdout:4/653: creat d2/d1e/d1b/d65/fd3 x:0 0 0 2024-04-25T02:09:11.569 INFO:tasks.workunit.client.1.smithi112.stdout:4/654: write d2/d17/d25/f91 [1066273,128962] 0 2024-04-25T02:09:11.570 INFO:tasks.workunit.client.1.smithi112.stdout:1/567: getdents d7/d9/d4e/d28/d43 0 2024-04-25T02:09:11.570 INFO:tasks.workunit.client.1.smithi112.stdout:1/568: write d7/d9/f8c [801544,19250] 0 2024-04-25T02:09:11.570 INFO:tasks.workunit.client.1.smithi112.stdout:1/569: chown d7/d9/l86 235 1 2024-04-25T02:09:11.570 INFO:tasks.workunit.client.1.smithi112.stdout:1/570: truncate d7/f24 1852345 0 2024-04-25T02:09:11.571 INFO:tasks.workunit.client.1.smithi112.stdout:1/571: readlink d7/d9/d4e/d28/d3f/l55 0 2024-04-25T02:09:11.573 INFO:tasks.workunit.client.1.smithi112.stdout:8/701: rename d15/d26/f92 to d15/d26/d4f/d67/de0/ff0 0 2024-04-25T02:09:11.576 INFO:tasks.workunit.client.1.smithi112.stdout:0/737: write da/d1d/d2e/d40/d49/d6b/fae [3830435,90978] 0 2024-04-25T02:09:11.582 INFO:tasks.workunit.client.1.smithi112.stdout:7/566: symlink d7/d25/d40/d6b/d91/lac 0 2024-04-25T02:09:11.582 INFO:tasks.workunit.client.1.smithi112.stdout:7/567: chown d7/l14 26 1 2024-04-25T02:09:11.582 INFO:tasks.workunit.client.1.smithi112.stdout:7/568: chown d7/d25/d43/l65 4 1 2024-04-25T02:09:11.583 INFO:tasks.workunit.client.1.smithi112.stdout:7/569: read d7/f17 [382796,14695] 0 2024-04-25T02:09:11.585 INFO:tasks.workunit.client.1.smithi112.stdout:4/655: symlink d2/d1e/d42/ld4 0 2024-04-25T02:09:11.587 INFO:tasks.workunit.client.1.smithi112.stdout:1/572: creat d7/d9/d51/d83/fb9 x:0 0 0 2024-04-25T02:09:11.587 INFO:tasks.workunit.client.1.smithi112.stdout:1/573: chown d7/d9/d4e/d72/l99 84622 1 2024-04-25T02:09:11.587 INFO:tasks.workunit.client.1.smithi112.stdout:1/574: fsync d7/d9/d1f/f3e 0 2024-04-25T02:09:11.596 INFO:tasks.workunit.client.1.smithi112.stdout:7/570: link d7/d25/d43/f2a d7/d79/da2/fad 0 2024-04-25T02:09:11.596 INFO:tasks.workunit.client.1.smithi112.stdout:7/571: write d7/f76 [617880,13803] 0 2024-04-25T02:09:11.597 INFO:tasks.workunit.client.1.smithi112.stdout:1/575: creat d7/d9/d1e/de/d9a/fba x:0 0 0 2024-04-25T02:09:11.599 INFO:tasks.workunit.client.1.smithi112.stdout:7/572: dread d7/dd/da9/f5e [0,4194304] 0 2024-04-25T02:09:11.605 INFO:tasks.workunit.client.1.smithi112.stdout:1/576: dread d7/d4b/fa4 [0,4194304] 0 2024-04-25T02:09:11.606 INFO:tasks.workunit.client.1.smithi112.stdout:1/577: write d7/d9/d1e/de/f3b [2686051,55678] 0 2024-04-25T02:09:11.619 INFO:tasks.workunit.client.1.smithi112.stdout:8/702: dwrite d15/d17/f1e [0,4194304] 0 2024-04-25T02:09:11.619 INFO:tasks.workunit.client.1.smithi112.stdout:8/703: stat d15/d35/d5c/d91/d78 0 2024-04-25T02:09:11.624 INFO:tasks.workunit.client.1.smithi112.stdout:8/704: rmdir d15/d35/d5c/d5e/d94 39 2024-04-25T02:09:11.627 INFO:tasks.workunit.client.1.smithi112.stdout:8/705: mkdir d15/d17/df1 0 2024-04-25T02:09:11.627 INFO:tasks.workunit.client.1.smithi112.stdout:8/706: fsync d15/d26/f9f 0 2024-04-25T02:09:11.636 INFO:tasks.workunit.client.1.smithi112.stdout:0/738: dwrite da/d1d/d88/f50 [0,4194304] 0 2024-04-25T02:09:11.637 INFO:tasks.workunit.client.1.smithi112.stdout:0/739: chown da/d1d/d2e/d40/d49/d6b/d90/cde 336 1 2024-04-25T02:09:11.638 INFO:tasks.workunit.client.1.smithi112.stdout:0/740: rename da/d1d/d2e/d40/d49/d4f/f71 to da/d13/d45/d5e/ff0 0 2024-04-25T02:09:11.639 INFO:tasks.workunit.client.1.smithi112.stdout:4/656: dwrite d2/d1e/d1b/d83/f90 [0,4194304] 0 2024-04-25T02:09:11.639 INFO:tasks.workunit.client.1.smithi112.stdout:7/573: dwrite d7/dd/f4a [0,4194304] 0 2024-04-25T02:09:11.639 INFO:tasks.workunit.client.1.smithi112.stdout:4/657: fsync d2/d12/d22/d60/f7f 0 2024-04-25T02:09:11.639 INFO:tasks.workunit.client.1.smithi112.stdout:1/578: dwrite d7/d9/d1f/d25/d39/f96 [0,4194304] 0 2024-04-25T02:09:11.643 INFO:tasks.workunit.client.1.smithi112.stdout:0/741: rmdir da/d13 39 2024-04-25T02:09:11.643 INFO:tasks.workunit.client.1.smithi112.stdout:0/742: write da/d1d/dcb/fe6 [924519,19041] 0 2024-04-25T02:09:11.643 INFO:tasks.workunit.client.1.smithi112.stdout:0/743: chown da/d1d/dbe/ce4 364558 1 2024-04-25T02:09:11.643 INFO:tasks.workunit.client.1.smithi112.stdout:0/744: write da/f10 [8781130,33344] 0 2024-04-25T02:09:11.643 INFO:tasks.workunit.client.1.smithi112.stdout:0/745: write da/d13/d45/f74 [66101,65717] 0 2024-04-25T02:09:11.643 INFO:tasks.workunit.client.1.smithi112.stdout:8/707: dwrite d15/f28 [0,4194304] 0 2024-04-25T02:09:11.647 INFO:tasks.workunit.client.1.smithi112.stdout:7/574: rename d7/fab to d7/d79/fae 0 2024-04-25T02:09:11.654 INFO:tasks.workunit.client.1.smithi112.stdout:0/746: rmdir da/d1d/d88/d24/dea 0 2024-04-25T02:09:11.658 INFO:tasks.workunit.client.1.smithi112.stdout:8/708: creat d15/d17/df1/ff2 x:0 0 0 2024-04-25T02:09:11.658 INFO:tasks.workunit.client.1.smithi112.stdout:8/709: creat d15/d26/d4f/d67/ff3 x:0 0 0 2024-04-25T02:09:11.661 INFO:tasks.workunit.client.1.smithi112.stdout:7/575: dwrite d7/dd/d20/f96 [0,4194304] 0 2024-04-25T02:09:11.672 INFO:tasks.workunit.client.1.smithi112.stdout:4/658: rename d2/d17/d20/d26/d39/d49/d95/dc7/ld1 to d2/d17/d20/d5e/ld5 0 2024-04-25T02:09:11.674 INFO:tasks.workunit.client.1.smithi112.stdout:8/710: mkdir d15/d26/d37/d52/df4 0 2024-04-25T02:09:11.677 INFO:tasks.workunit.client.1.smithi112.stdout:7/576: mknod d7/d25/d43/caf 0 2024-04-25T02:09:11.678 INFO:tasks.workunit.client.1.smithi112.stdout:0/747: dwrite da/d1d/d88/d24/f48 [0,4194304] 0 2024-04-25T02:09:11.678 INFO:tasks.workunit.client.1.smithi112.stdout:0/748: chown da/f26 19492 1 2024-04-25T02:09:11.679 INFO:tasks.workunit.client.1.smithi112.stdout:4/659: rename d2/d1e/db3/fc4 to d2/d1e/d5c/fd6 0 2024-04-25T02:09:11.682 INFO:tasks.workunit.client.1.smithi112.stdout:8/711: truncate fe 23578 0 2024-04-25T02:09:11.683 INFO:tasks.workunit.client.1.smithi112.stdout:0/749: unlink f2 0 2024-04-25T02:09:11.686 INFO:tasks.workunit.client.1.smithi112.stdout:4/660: creat d2/d17/db2/fd7 x:0 0 0 2024-04-25T02:09:11.686 INFO:tasks.workunit.client.1.smithi112.stdout:7/577: write d7/f13 [6352302,24954] 0 2024-04-25T02:09:11.688 INFO:tasks.workunit.client.1.smithi112.stdout:8/712: mkdir d15/d26/d4f/d67/de0/df5 0 2024-04-25T02:09:11.688 INFO:tasks.workunit.client.1.smithi112.stdout:8/713: chown d15/d26/d37/d8e/l7d 230 1 2024-04-25T02:09:11.690 INFO:tasks.workunit.client.1.smithi112.stdout:7/578: mkdir d7/d25/d40/db0 0 2024-04-25T02:09:11.695 INFO:tasks.workunit.client.1.smithi112.stdout:8/714: mkdir d15/d35/d5c/d91/dc8/de6/df6 0 2024-04-25T02:09:11.695 INFO:tasks.workunit.client.1.smithi112.stdout:8/715: creat d15/d17/df1/ff7 x:0 0 0 2024-04-25T02:09:11.695 INFO:tasks.workunit.client.1.smithi112.stdout:8/716: getdents d15/d35/d5f/db5/dc2 0 2024-04-25T02:09:11.698 INFO:tasks.workunit.client.1.smithi112.stdout:7/579: write d7/dd/f30 [4086211,119188] 0 2024-04-25T02:09:11.698 INFO:tasks.workunit.client.1.smithi112.stdout:7/580: chown d7/d79/da2/f7c 242 1 2024-04-25T02:09:11.700 INFO:tasks.workunit.client.1.smithi112.stdout:8/717: creat d15/d17/dba/ff8 x:0 0 0 2024-04-25T02:09:11.700 INFO:tasks.workunit.client.1.smithi112.stdout:8/718: truncate d15/d40/f60 1220397 0 2024-04-25T02:09:11.700 INFO:tasks.workunit.client.1.smithi112.stdout:8/719: write d15/d35/d56/f6a [2070939,4690] 0 2024-04-25T02:09:11.703 INFO:tasks.workunit.client.1.smithi112.stdout:0/750: dwrite da/d13/d45/f74 [0,4194304] 0 2024-04-25T02:09:11.703 INFO:tasks.workunit.client.1.smithi112.stdout:0/751: fsync da/d1d/f43 0 2024-04-25T02:09:11.709 INFO:tasks.workunit.client.1.smithi112.stdout:8/720: write d15/d35/d5c/d91/d64/d8b/fdc [1001253,113479] 0 2024-04-25T02:09:11.709 INFO:tasks.workunit.client.1.smithi112.stdout:8/721: chown d15/d40/ld0 5984 1 2024-04-25T02:09:11.709 INFO:tasks.workunit.client.1.smithi112.stdout:8/722: getdents d15/d35/d5c/d91/dc8/de6/df6 0 2024-04-25T02:09:11.711 INFO:tasks.workunit.client.1.smithi112.stdout:7/581: rename d7/dd/f4a to d7/d25/d40/d51/d77/fb1 0 2024-04-25T02:09:11.715 INFO:tasks.workunit.client.1.smithi112.stdout:8/723: creat d15/d35/d5f/ff9 x:0 0 0 2024-04-25T02:09:11.715 INFO:tasks.workunit.client.1.smithi112.stdout:8/724: fdatasync d15/d26/fbe 0 2024-04-25T02:09:11.715 INFO:tasks.workunit.client.1.smithi112.stdout:8/725: fdatasync d15/d17/fa4 0 2024-04-25T02:09:11.719 INFO:tasks.workunit.client.1.smithi112.stdout:7/582: dread d7/d25/d40/d6b/f70 [0,4194304] 0 2024-04-25T02:09:11.720 INFO:tasks.workunit.client.1.smithi112.stdout:0/752: rename da/f52 to da/d1d/dcb/ff1 0 2024-04-25T02:09:11.720 INFO:tasks.workunit.client.1.smithi112.stdout:0/753: readlink da/d1d/d2e/d40/d49/d4f/l66 0 2024-04-25T02:09:11.720 INFO:tasks.workunit.client.1.smithi112.stdout:7/583: read d7/dd/d20/d2c/f8c [222343,107172] 0 2024-04-25T02:09:11.726 INFO:tasks.workunit.client.1.smithi112.stdout:8/726: dread d15/d35/d56/f6a [0,4194304] 0 2024-04-25T02:09:11.734 INFO:tasks.workunit.client.1.smithi112.stdout:8/727: dread d15/d40/fda [0,4194304] 0 2024-04-25T02:09:11.734 INFO:tasks.workunit.client.1.smithi112.stdout:8/728: truncate d15/d35/d5c/d5e/f76 828397 0 2024-04-25T02:09:11.741 INFO:tasks.workunit.client.1.smithi112.stdout:8/729: write d15/d35/d5c/d91/f45 [2708222,126120] 0 2024-04-25T02:09:11.741 INFO:tasks.workunit.client.1.smithi112.stdout:8/730: creat d15/d81/dce/ffa x:0 0 0 2024-04-25T02:09:11.743 INFO:tasks.workunit.client.1.smithi112.stdout:7/584: dwrite d7/dd/f87 [0,4194304] 0 2024-04-25T02:09:11.744 INFO:tasks.workunit.client.1.smithi112.stdout:8/731: symlink d15/d35/d5c/lfb 0 2024-04-25T02:09:11.745 INFO:tasks.workunit.client.1.smithi112.stdout:7/585: rmdir d7/d25/d40/d51 39 2024-04-25T02:09:11.745 INFO:tasks.workunit.client.1.smithi112.stdout:7/586: chown d7/d25/d40/d51/d77/fb1 5807553 1 2024-04-25T02:09:11.747 INFO:tasks.workunit.client.1.smithi112.stdout:8/732: link d15/d35/d5f/db5/fc4 d15/d26/d4f/ffc 0 2024-04-25T02:09:11.748 INFO:tasks.workunit.client.1.smithi112.stdout:7/587: rename d7/dd/da9/d41 to d7/dd/d20/db2 0 2024-04-25T02:09:11.750 INFO:tasks.workunit.client.1.smithi112.stdout:8/733: unlink fd 0 2024-04-25T02:09:11.751 INFO:tasks.workunit.client.1.smithi112.stdout:7/588: rename d7/dd/f87 to d7/d25/d40/db0/fb3 0 2024-04-25T02:09:11.752 INFO:tasks.workunit.client.1.smithi112.stdout:7/589: symlink d7/dd/lb4 0 2024-04-25T02:09:11.756 INFO:tasks.workunit.client.1.smithi112.stdout:7/590: creat d7/d79/da2/fb5 x:0 0 0 2024-04-25T02:09:11.756 INFO:tasks.workunit.client.1.smithi112.stdout:7/591: fsync d7/d25/d43/d46/f42 0 2024-04-25T02:09:11.756 INFO:tasks.workunit.client.1.smithi112.stdout:7/592: write d7/dd/f30 [2257408,71111] 0 2024-04-25T02:09:11.756 INFO:tasks.workunit.client.1.smithi112.stdout:7/593: chown d7/d25/d43 21 1 2024-04-25T02:09:11.756 INFO:tasks.workunit.client.1.smithi112.stdout:7/594: truncate d7/f61 1810332 0 2024-04-25T02:09:11.775 INFO:tasks.workunit.client.1.smithi112.stdout:8/734: dwrite d15/d35/d5f/fa0 [0,4194304] 0 2024-04-25T02:09:11.775 INFO:tasks.workunit.client.1.smithi112.stdout:8/735: truncate d15/d40/f49 3303251 0 2024-04-25T02:09:11.775 INFO:tasks.workunit.client.1.smithi112.stdout:8/736: chown d15/d26/f9f 22355186 1 2024-04-25T02:09:11.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:11 smithi112 ceph-mon[33313]: pgmap v265: 65 pgs: 65 active+clean; 2.5 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 150 MiB/s rd, 204 MiB/s wr, 345 op/s 2024-04-25T02:09:11.783 INFO:tasks.workunit.client.1.smithi112.stdout:7/595: dwrite d7/d25/d43/fa7 [0,4194304] 0 2024-04-25T02:09:11.787 INFO:tasks.workunit.client.1.smithi112.stdout:8/737: dread d15/d26/d4f/ffc [0,4194304] 0 2024-04-25T02:09:11.789 INFO:tasks.workunit.client.1.smithi112.stdout:7/596: mkdir d7/dd/d88/db6 0 2024-04-25T02:09:11.791 INFO:tasks.workunit.client.1.smithi112.stdout:8/738: mkdir d15/d35/d5c/de4/dfd 0 2024-04-25T02:09:11.792 INFO:tasks.workunit.client.1.smithi112.stdout:7/597: rmdir d7/d79 39 2024-04-25T02:09:11.794 INFO:tasks.workunit.client.1.smithi112.stdout:7/598: dread d7/d79/da2/fad [0,4194304] 0 2024-04-25T02:09:11.794 INFO:tasks.workunit.client.1.smithi112.stdout:8/739: symlink d15/d35/d5c/d5e/d94/lfe 0 2024-04-25T02:09:11.797 INFO:tasks.workunit.client.1.smithi112.stdout:8/740: mkdir d15/d26/d4f/d67/dff 0 2024-04-25T02:09:11.797 INFO:tasks.workunit.client.1.smithi112.stdout:8/741: truncate d15/d35/d5c/d91/d64/fcb 4619589 0 2024-04-25T02:09:11.800 INFO:tasks.workunit.client.1.smithi112.stdout:8/742: read d15/d40/fda [3761172,101900] 0 2024-04-25T02:09:11.800 INFO:tasks.workunit.client.1.smithi112.stdout:8/743: truncate d15/d26/d4f/d67/ff3 937497 0 2024-04-25T02:09:11.802 INFO:tasks.workunit.client.1.smithi112.stdout:8/744: mknod d15/d26/d37/d52/df4/c100 0 2024-04-25T02:09:11.804 INFO:tasks.workunit.client.1.smithi112.stdout:8/745: mknod d15/d35/d5c/d91/d64/c101 0 2024-04-25T02:09:11.805 INFO:tasks.workunit.client.1.smithi112.stdout:8/746: mkdir d15/d26/d37/d52/d102 0 2024-04-25T02:09:11.806 INFO:tasks.workunit.client.1.smithi112.stdout:8/747: mkdir d15/d26/d4f/d67/dcd/d103 0 2024-04-25T02:09:11.814 INFO:tasks.workunit.client.1.smithi112.stdout:8/748: read d15/d17/d1a/fb3 [3043385,119135] 0 2024-04-25T02:09:11.835 INFO:tasks.workunit.client.1.smithi112.stdout:8/749: symlink d15/d17/dba/l104 0 2024-04-25T02:09:11.842 INFO:tasks.workunit.client.1.smithi112.stdout:8/750: write d15/d26/d4f/fd4 [1361781,108911] 0 2024-04-25T02:09:11.897 INFO:tasks.workunit.client.1.smithi112.stdout:8/751: rename d15/d35/d5c/d5e/lc3 to d15/d26/d4f/d67/dcd/d103/l105 0 2024-04-25T02:09:11.898 INFO:tasks.workunit.client.1.smithi112.stdout:8/752: mknod d15/d17/df1/c106 0 2024-04-25T02:09:11.899 INFO:tasks.workunit.client.1.smithi112.stdout:8/753: symlink d15/d81/l107 0 2024-04-25T02:09:11.899 INFO:tasks.workunit.client.1.smithi112.stdout:8/754: chown d15/d35/d5f 16833158 1 2024-04-25T02:09:11.901 INFO:tasks.workunit.client.1.smithi112.stdout:8/755: truncate d15/d17/fa4 1807383 0 2024-04-25T02:09:11.901 INFO:tasks.workunit.client.1.smithi112.stdout:8/756: write d15/fe3 [708544,28993] 0 2024-04-25T02:09:11.903 INFO:tasks.workunit.client.1.smithi112.stdout:8/757: creat d15/d81/dec/f108 x:0 0 0 2024-04-25T02:09:11.905 INFO:tasks.workunit.client.1.smithi112.stdout:8/758: mkdir d15/d35/d5f/db5/dc2/d109 0 2024-04-25T02:09:11.905 INFO:tasks.workunit.client.1.smithi112.stdout:8/759: chown d15/d35/d5c/d91/d78/dc5 897723596 1 2024-04-25T02:09:11.905 INFO:tasks.workunit.client.1.smithi112.stdout:8/760: write d15/d17/f23 [2146513,51801] 0 2024-04-25T02:09:11.912 INFO:tasks.workunit.client.1.smithi112.stdout:8/761: dread d15/d35/f61 [0,4194304] 0 2024-04-25T02:09:11.914 INFO:tasks.workunit.client.1.smithi112.stdout:8/762: mknod d15/d35/d5c/d91/d78/dc5/c10a 0 2024-04-25T02:09:11.920 INFO:tasks.workunit.client.1.smithi112.stdout:8/763: write d15/d26/fbe [2651633,63685] 0 2024-04-25T02:09:11.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:11 smithi077 ceph-mon[26330]: pgmap v265: 65 pgs: 65 active+clean; 2.5 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 150 MiB/s rd, 204 MiB/s wr, 345 op/s 2024-04-25T02:09:12.066 INFO:tasks.workunit.client.1.smithi112.stdout:8/764: creat d15/d35/d5c/f10b x:0 0 0 2024-04-25T02:09:12.074 INFO:tasks.workunit.client.1.smithi112.stdout:8/765: link d15/d26/d37/c68 d15/d26/d4f/c10c 0 2024-04-25T02:09:12.074 INFO:tasks.workunit.client.1.smithi112.stdout:8/766: dread - d15/d81/dce/fd7 zero size 2024-04-25T02:09:12.078 INFO:tasks.workunit.client.1.smithi112.stdout:8/767: dread f6 [0,4194304] 0 2024-04-25T02:09:12.078 INFO:tasks.workunit.client.1.smithi112.stdout:8/768: read d15/d35/d56/f96 [105377,77616] 0 2024-04-25T02:09:12.080 INFO:tasks.workunit.client.1.smithi112.stdout:8/769: mkdir d15/d35/d5c/d10d 0 2024-04-25T02:09:12.083 INFO:tasks.workunit.client.1.smithi112.stdout:8/770: getdents d15/d35/d5c/d5e 0 2024-04-25T02:09:12.083 INFO:tasks.workunit.client.1.smithi112.stdout:8/771: readlink d15/l75 0 2024-04-25T02:09:12.083 INFO:tasks.workunit.client.1.smithi112.stdout:8/772: chown d15/d40/cb4 4 1 2024-04-25T02:09:12.090 INFO:tasks.workunit.client.1.smithi112.stdout:8/773: write d15/f28 [3856503,56148] 0 2024-04-25T02:09:12.091 INFO:tasks.workunit.client.1.smithi112.stdout:8/774: symlink d15/d35/d5c/l10e 0 2024-04-25T02:09:12.094 INFO:tasks.workunit.client.1.smithi112.stdout:9/563: sync 2024-04-25T02:09:12.094 INFO:tasks.workunit.client.1.smithi112.stdout:5/446: sync 2024-04-25T02:09:12.094 INFO:tasks.workunit.client.1.smithi112.stdout:8/775: unlink d15/d17/df1/ff7 0 2024-04-25T02:09:12.096 INFO:tasks.workunit.client.1.smithi112.stdout:5/447: mkdir d1/d3f/d9c 0 2024-04-25T02:09:12.096 INFO:tasks.workunit.client.1.smithi112.stdout:8/776: dread d15/d35/d5f/fef [0,4194304] 0 2024-04-25T02:09:12.099 INFO:tasks.workunit.client.1.smithi112.stdout:5/448: mkdir d1/d41/d5b/d79/d7a/d9d 0 2024-04-25T02:09:12.099 INFO:tasks.workunit.client.1.smithi112.stdout:5/449: readlink d1/d2/d28/l53 0 2024-04-25T02:09:12.106 INFO:tasks.workunit.client.1.smithi112.stdout:8/777: write d15/d17/f1e [2954342,59995] 0 2024-04-25T02:09:12.106 INFO:tasks.workunit.client.1.smithi112.stdout:8/778: chown d15 114555 1 2024-04-25T02:09:12.109 INFO:tasks.workunit.client.1.smithi112.stdout:5/450: dread d1/d2/f33 [0,4194304] 0 2024-04-25T02:09:12.109 INFO:tasks.workunit.client.1.smithi112.stdout:5/451: stat d1/d41 0 2024-04-25T02:09:12.110 INFO:tasks.workunit.client.1.smithi112.stdout:5/452: getdents d1/d16/d99 0 2024-04-25T02:09:12.111 INFO:tasks.workunit.client.1.smithi112.stdout:5/453: rename d1/d16/l5c to d1/d41/d5b/d79/d7a/l9e 0 2024-04-25T02:09:12.113 INFO:tasks.workunit.client.1.smithi112.stdout:5/454: symlink d1/d2/d4/d1d/l9f 0 2024-04-25T02:09:12.113 INFO:tasks.workunit.client.1.smithi112.stdout:5/455: readlink d1/d2/d4/l84 0 2024-04-25T02:09:12.114 INFO:tasks.workunit.client.1.smithi112.stdout:8/779: write d15/d35/d5c/f9e [722239,73534] 0 2024-04-25T02:09:12.115 INFO:tasks.workunit.client.1.smithi112.stdout:9/564: dwrite d1/d48/f5c [4194304,4194304] 0 2024-04-25T02:09:12.119 INFO:tasks.workunit.client.1.smithi112.stdout:8/780: unlink d15/d35/d5f/fa0 0 2024-04-25T02:09:12.119 INFO:tasks.workunit.client.1.smithi112.stdout:8/781: chown d15/d35/d5c/d91/l8f 121 1 2024-04-25T02:09:12.119 INFO:tasks.workunit.client.1.smithi112.stdout:8/782: readlink d15/d35/d5c/d5e/led 0 2024-04-25T02:09:12.119 INFO:tasks.workunit.client.1.smithi112.stdout:8/783: rename d15/d26 to d15/d26/d37/d8e/d10f 22 2024-04-25T02:09:12.120 INFO:tasks.workunit.client.1.smithi112.stdout:5/456: dread d1/d2/d4/ff [0,4194304] 0 2024-04-25T02:09:12.120 INFO:tasks.workunit.client.1.smithi112.stdout:5/457: dread - d1/d2/d28/f57 zero size 2024-04-25T02:09:12.121 INFO:tasks.workunit.client.1.smithi112.stdout:5/458: fsync d1/d41/d8a/f90 0 2024-04-25T02:09:12.121 INFO:tasks.workunit.client.1.smithi112.stdout:9/565: creat d1/d13/d5b/fc4 x:0 0 0 2024-04-25T02:09:12.122 INFO:tasks.workunit.client.1.smithi112.stdout:9/566: chown d1 7978752 1 2024-04-25T02:09:12.122 INFO:tasks.workunit.client.1.smithi112.stdout:8/784: dread d15/d35/d5f/db5/fc4 [0,4194304] 0 2024-04-25T02:09:12.124 INFO:tasks.workunit.client.1.smithi112.stdout:5/459: mkdir d1/d41/d5b/d79/d7a/da0 0 2024-04-25T02:09:12.126 INFO:tasks.workunit.client.1.smithi112.stdout:9/567: creat d1/d48/fc5 x:0 0 0 2024-04-25T02:09:12.126 INFO:tasks.workunit.client.1.smithi112.stdout:9/568: truncate d1/f31 1455968 0 2024-04-25T02:09:12.130 INFO:tasks.workunit.client.1.smithi112.stdout:8/785: truncate d15/f28 494155 0 2024-04-25T02:09:12.132 INFO:tasks.workunit.client.1.smithi112.stdout:5/460: creat d1/d3f/d9c/fa1 x:0 0 0 2024-04-25T02:09:12.132 INFO:tasks.workunit.client.1.smithi112.stdout:5/461: dread - d1/d2/d78/f9b zero size 2024-04-25T02:09:12.145 INFO:tasks.workunit.client.1.smithi112.stdout:5/462: rmdir d1/d41 39 2024-04-25T02:09:12.145 INFO:tasks.workunit.client.1.smithi112.stdout:8/786: dwrite d15/d17/f1e [0,4194304] 0 2024-04-25T02:09:12.146 INFO:tasks.workunit.client.1.smithi112.stdout:8/787: truncate d15/d35/d5c/d91/d78/fbb 390739 0 2024-04-25T02:09:12.149 INFO:tasks.workunit.client.1.smithi112.stdout:5/463: link d1/f46 d1/fa2 0 2024-04-25T02:09:12.151 INFO:tasks.workunit.client.1.smithi112.stdout:8/788: rmdir d15/d35/d5c/d10d 0 2024-04-25T02:09:12.153 INFO:tasks.workunit.client.1.smithi112.stdout:5/464: link d1/d2/d78/f9b d1/d41/d5b/fa3 0 2024-04-25T02:09:12.156 INFO:tasks.workunit.client.1.smithi112.stdout:5/465: creat d1/d3f/d76/fa4 x:0 0 0 2024-04-25T02:09:12.165 INFO:tasks.workunit.client.1.smithi112.stdout:8/789: dwrite d15/d26/d4f/fd8 [0,4194304] 0 2024-04-25T02:09:12.165 INFO:tasks.workunit.client.1.smithi112.stdout:8/790: write d15/d35/d5c/d91/d78/fbb [197767,18511] 0 2024-04-25T02:09:12.165 INFO:tasks.workunit.client.1.smithi112.stdout:5/466: write d1/d2/f36 [1775737,83699] 0 2024-04-25T02:09:12.166 INFO:tasks.workunit.client.1.smithi112.stdout:8/791: creat d15/d81/f110 x:0 0 0 2024-04-25T02:09:12.169 INFO:tasks.workunit.client.1.smithi112.stdout:5/467: creat d1/d41/d5b/d6b/fa5 x:0 0 0 2024-04-25T02:09:12.171 INFO:tasks.workunit.client.1.smithi112.stdout:5/468: getdents d1/d16/d51/d93 0 2024-04-25T02:09:12.174 INFO:tasks.workunit.client.1.smithi112.stdout:5/469: rename d1/d2/d4/l59 to d1/d3f/la6 0 2024-04-25T02:09:12.175 INFO:tasks.workunit.client.1.smithi112.stdout:8/792: dread d15/d17/f1e [0,4194304] 0 2024-04-25T02:09:12.175 INFO:tasks.workunit.client.1.smithi112.stdout:8/793: write d15/d81/dec/f108 [440799,19823] 0 2024-04-25T02:09:12.175 INFO:tasks.workunit.client.1.smithi112.stdout:8/794: chown d15/d26/f53 6270 1 2024-04-25T02:09:12.183 INFO:tasks.workunit.client.1.smithi112.stdout:5/470: creat d1/d16/d8f/fa7 x:0 0 0 2024-04-25T02:09:12.185 INFO:tasks.workunit.client.1.smithi112.stdout:5/471: creat d1/d41/d5b/d7b/fa8 x:0 0 0 2024-04-25T02:09:12.186 INFO:tasks.workunit.client.1.smithi112.stdout:5/472: mknod d1/d16/d51/d93/ca9 0 2024-04-25T02:09:12.188 INFO:tasks.workunit.client.1.smithi112.stdout:5/473: link d1/d2/f31 d1/faa 0 2024-04-25T02:09:12.189 INFO:tasks.workunit.client.1.smithi112.stdout:8/795: dwrite d15/d17/f2e [4194304,4194304] 0 2024-04-25T02:09:12.191 INFO:tasks.workunit.client.1.smithi112.stdout:5/474: creat d1/d41/d5b/d96/fab x:0 0 0 2024-04-25T02:09:12.191 INFO:tasks.workunit.client.1.smithi112.stdout:5/475: write d1/faa [4799252,74783] 0 2024-04-25T02:09:12.191 INFO:tasks.workunit.client.1.smithi112.stdout:5/476: truncate d1/d41/d5b/d96/fab 118793 0 2024-04-25T02:09:12.205 INFO:tasks.workunit.client.1.smithi112.stdout:8/796: dwrite d15/d26/d4f/d67/de0/ff0 [4194304,4194304] 0 2024-04-25T02:09:12.205 INFO:tasks.workunit.client.1.smithi112.stdout:8/797: getdents d15/d26/d4f/d67/dff 0 2024-04-25T02:09:12.216 INFO:tasks.workunit.client.1.smithi112.stdout:8/798: rename d15/d81/dec/f108 to d15/d17/d1a/f111 0 2024-04-25T02:09:12.218 INFO:tasks.workunit.client.1.smithi112.stdout:8/799: stat d15/d35/d5c/d91/d78/dc5/c8a 0 2024-04-25T02:09:12.220 INFO:tasks.workunit.client.1.smithi112.stdout:8/800: symlink d15/d35/d5c/d91/dc8/l112 0 2024-04-25T02:09:12.220 INFO:tasks.workunit.client.1.smithi112.stdout:8/801: chown d15/d26/d37/lde 14002805 1 2024-04-25T02:09:12.221 INFO:tasks.workunit.client.1.smithi112.stdout:8/802: mknod d15/d35/d5c/d5e/c113 0 2024-04-25T02:09:12.221 INFO:tasks.workunit.client.1.smithi112.stdout:8/803: fdatasync d15/d17/f19 0 2024-04-25T02:09:12.223 INFO:tasks.workunit.client.1.smithi112.stdout:8/804: rename d15/d26/d4f/d67/le9 to d15/d35/d5c/d91/d64/l114 0 2024-04-25T02:09:12.223 INFO:tasks.workunit.client.1.smithi112.stdout:8/805: write d15/d26/d4f/fb2 [772994,38507] 0 2024-04-25T02:09:12.223 INFO:tasks.workunit.client.1.smithi112.stdout:8/806: fsync d15/d35/d5f/db5/fc4 0 2024-04-25T02:09:12.223 INFO:tasks.workunit.client.1.smithi112.stdout:8/807: write d15/d35/d5c/d5e/d85/fd3 [371991,42753] 0 2024-04-25T02:09:12.223 INFO:tasks.workunit.client.1.smithi112.stdout:8/808: dread - d15/d35/d5f/ff9 zero size 2024-04-25T02:09:12.224 INFO:tasks.workunit.client.1.smithi112.stdout:8/809: link d15/f7e d15/d40/f115 0 2024-04-25T02:09:12.225 INFO:tasks.workunit.client.1.smithi112.stdout:8/810: dread d15/d17/f6b [0,4194304] 0 2024-04-25T02:09:12.226 INFO:tasks.workunit.client.1.smithi112.stdout:8/811: mknod d15/d81/dec/c116 0 2024-04-25T02:09:12.226 INFO:tasks.workunit.client.1.smithi112.stdout:8/812: write d15/d81/f110 [723804,96890] 0 2024-04-25T02:09:12.228 INFO:tasks.workunit.client.1.smithi112.stdout:8/813: truncate d15/d17/d1a/fb3 631103 0 2024-04-25T02:09:12.228 INFO:tasks.workunit.client.1.smithi112.stdout:8/814: write d15/fd1 [4597144,3968] 0 2024-04-25T02:09:12.235 INFO:tasks.workunit.client.1.smithi112.stdout:8/815: write d15/d40/d88/fdf [4969888,8606] 0 2024-04-25T02:09:12.235 INFO:tasks.workunit.client.1.smithi112.stdout:8/816: truncate d15/d35/d5c/d5e/d85/fd3 576273 0 2024-04-25T02:09:12.251 INFO:tasks.workunit.client.1.smithi112.stdout:8/817: dwrite d15/d35/d5c/d5e/d85/fd3 [0,4194304] 0 2024-04-25T02:09:12.255 INFO:tasks.workunit.client.1.smithi112.stdout:8/818: mkdir d15/d35/d5f/db5/d117 0 2024-04-25T02:09:12.261 INFO:tasks.workunit.client.1.smithi112.stdout:8/819: write d15/d40/f49 [3285075,77310] 0 2024-04-25T02:09:12.261 INFO:tasks.workunit.client.1.smithi112.stdout:8/820: truncate d15/d17/fa4 2213954 0 2024-04-25T02:09:12.261 INFO:tasks.workunit.client.1.smithi112.stdout:8/821: readlink d15/lb9 0 2024-04-25T02:09:12.271 INFO:tasks.workunit.client.1.smithi112.stdout:8/822: rmdir d15/d40 39 2024-04-25T02:09:12.272 INFO:tasks.workunit.client.1.smithi112.stdout:8/823: mknod d15/d81/dec/c118 0 2024-04-25T02:09:12.273 INFO:tasks.workunit.client.1.smithi112.stdout:8/824: mkdir d15/d35/d5c/de4/dfd/d119 0 2024-04-25T02:09:12.277 INFO:tasks.workunit.client.1.smithi112.stdout:2/426: sync 2024-04-25T02:09:12.277 INFO:tasks.workunit.client.1.smithi112.stdout:6/531: sync 2024-04-25T02:09:12.277 INFO:tasks.workunit.client.1.smithi112.stdout:8/825: dread d15/d17/f1e [0,4194304] 0 2024-04-25T02:09:12.277 INFO:tasks.workunit.client.1.smithi112.stdout:8/826: stat d15/d35/d5c/d91/f45 0 2024-04-25T02:09:12.279 INFO:tasks.workunit.client.1.smithi112.stdout:2/427: getdents d3/da/dc/d3e/df/d32 0 2024-04-25T02:09:12.279 INFO:tasks.workunit.client.1.smithi112.stdout:2/428: dread - d3/d62/f7f zero size 2024-04-25T02:09:12.279 INFO:tasks.workunit.client.1.smithi112.stdout:2/429: write d3/da/dc/d20/d85/f8d [3509358,9958] 0 2024-04-25T02:09:12.280 INFO:tasks.workunit.client.1.smithi112.stdout:2/430: chown d3/da/dc/d3e/df/d30 112 1 2024-04-25T02:09:12.282 INFO:tasks.workunit.client.1.smithi112.stdout:6/532: getdents d0/d2/d66 0 2024-04-25T02:09:12.290 INFO:tasks.workunit.client.1.smithi112.stdout:6/533: write d0/d2/d2c/d41/d77/f8a [3411503,116092] 0 2024-04-25T02:09:12.305 INFO:tasks.workunit.client.1.smithi112.stdout:8/827: dwrite d15/d26/f53 [4194304,4194304] 0 2024-04-25T02:09:12.310 INFO:tasks.workunit.client.1.smithi112.stdout:8/828: mknod d15/d26/d4f/d67/dff/c11a 0 2024-04-25T02:09:12.310 INFO:tasks.workunit.client.1.smithi112.stdout:2/431: dwrite d3/da/dc/d3e/df/d32/f90 [0,4194304] 0 2024-04-25T02:09:12.323 INFO:tasks.workunit.client.1.smithi112.stdout:2/432: creat d3/da/dc/d20/d43/d74/f97 x:0 0 0 2024-04-25T02:09:12.323 INFO:tasks.workunit.client.1.smithi112.stdout:2/433: write d3/da/dc/f2e [1331981,59402] 0 2024-04-25T02:09:12.323 INFO:tasks.workunit.client.1.smithi112.stdout:2/434: readlink d3/da/dc/d20/d40/l63 0 2024-04-25T02:09:12.328 INFO:tasks.workunit.client.1.smithi112.stdout:2/435: creat d3/da/dc/d3e/df/d32/f98 x:0 0 0 2024-04-25T02:09:12.336 INFO:tasks.workunit.client.1.smithi112.stdout:8/829: dwrite d15/f42 [0,4194304] 0 2024-04-25T02:09:12.336 INFO:tasks.workunit.client.1.smithi112.stdout:8/830: creat d15/d17/df1/f11b x:0 0 0 2024-04-25T02:09:12.336 INFO:tasks.workunit.client.1.smithi112.stdout:8/831: fsync d15/d17/f19 0 2024-04-25T02:09:12.342 INFO:tasks.workunit.client.1.smithi112.stdout:8/832: dread d15/d26/d4f/ffc [0,4194304] 0 2024-04-25T02:09:12.345 INFO:tasks.workunit.client.1.smithi112.stdout:2/436: write d3/da/dc/d3e/df/d25/f77 [1597356,115709] 0 2024-04-25T02:09:12.376 INFO:tasks.workunit.client.1.smithi112.stdout:8/833: getdents d15/d26/d37/da8 0 2024-04-25T02:09:12.395 INFO:tasks.workunit.client.1.smithi112.stdout:8/834: dwrite d15/d26/fe2 [0,4194304] 0 2024-04-25T02:09:12.404 INFO:tasks.workunit.client.1.smithi112.stdout:8/835: creat d15/f11c x:0 0 0 2024-04-25T02:09:12.405 INFO:tasks.workunit.client.1.smithi112.stdout:8/836: symlink d15/d35/d5c/d91/dc8/de6/df6/l11d 0 2024-04-25T02:09:12.419 INFO:tasks.workunit.client.1.smithi112.stdout:3/570: sync 2024-04-25T02:09:12.419 INFO:tasks.workunit.client.1.smithi112.stdout:0/754: sync 2024-04-25T02:09:12.419 INFO:tasks.workunit.client.1.smithi112.stdout:1/579: sync 2024-04-25T02:09:12.419 INFO:tasks.workunit.client.1.smithi112.stdout:7/599: sync 2024-04-25T02:09:12.419 INFO:tasks.workunit.client.1.smithi112.stdout:3/571: creat d12/d1f/d27/d44/d73/fbb x:0 0 0 2024-04-25T02:09:12.419 INFO:tasks.workunit.client.1.smithi112.stdout:7/600: stat d7/dd/f26 0 2024-04-25T02:09:12.419 INFO:tasks.workunit.client.1.smithi112.stdout:3/572: chown d12/d13/d34/d78/c7c 29720 1 2024-04-25T02:09:12.419 INFO:tasks.workunit.client.1.smithi112.stdout:4/661: sync 2024-04-25T02:09:12.419 INFO:tasks.workunit.client.1.smithi112.stdout:4/662: write d2/f46 [3075243,30633] 0 2024-04-25T02:09:12.422 INFO:tasks.workunit.client.1.smithi112.stdout:1/580: truncate d7/d9/d4e/f37 1279545 0 2024-04-25T02:09:12.422 INFO:tasks.workunit.client.1.smithi112.stdout:1/581: write d7/d9/d1f/d25/f30 [2431399,84802] 0 2024-04-25T02:09:12.426 INFO:tasks.workunit.client.1.smithi112.stdout:3/573: rename d12/l49 to d12/lbc 0 2024-04-25T02:09:12.427 INFO:tasks.workunit.client.1.smithi112.stdout:4/663: link d2/d1e/d5c/fd6 d2/d1e/db3/fd8 0 2024-04-25T02:09:12.436 INFO:tasks.workunit.client.1.smithi112.stdout:3/574: mknod d12/d67/d8f/cbd 0 2024-04-25T02:09:12.436 INFO:tasks.workunit.client.1.smithi112.stdout:3/575: fsync d12/d13/f2e 0 2024-04-25T02:09:12.438 INFO:tasks.workunit.client.1.smithi112.stdout:3/576: link d12/d13/d34/d78/c7c d12/d13/d34/d53/cbe 0 2024-04-25T02:09:12.439 INFO:tasks.workunit.client.1.smithi112.stdout:3/577: rmdir d12/d1f/d27/d44/d73/d95 39 2024-04-25T02:09:12.456 INFO:tasks.workunit.client.1.smithi112.stdout:7/601: dwrite d7/dd/f9f [0,4194304] 0 2024-04-25T02:09:12.459 INFO:tasks.workunit.client.1.smithi112.stdout:0/755: dwrite da/f46 [0,4194304] 0 2024-04-25T02:09:12.459 INFO:tasks.workunit.client.1.smithi112.stdout:1/582: dwrite d7/d9/d1f/f3e [0,4194304] 0 2024-04-25T02:09:12.459 INFO:tasks.workunit.client.1.smithi112.stdout:3/578: dwrite d12/d13/f30 [4194304,4194304] 0 2024-04-25T02:09:12.460 INFO:tasks.workunit.client.1.smithi112.stdout:1/583: stat d7/d9/d4e/d85/la6 0 2024-04-25T02:09:12.460 INFO:tasks.workunit.client.1.smithi112.stdout:1/584: chown d7/d9/d1f/d25/d39/c93 177059 1 2024-04-25T02:09:12.460 INFO:tasks.workunit.client.1.smithi112.stdout:1/585: creat d7/d9/d1f/d25/fbb x:0 0 0 2024-04-25T02:09:12.470 INFO:tasks.workunit.client.1.smithi112.stdout:3/579: dread d12/d1f/d27/f28 [0,4194304] 0 2024-04-25T02:09:12.473 INFO:tasks.workunit.client.1.smithi112.stdout:3/580: unlink d12/d1f/c3e 0 2024-04-25T02:09:12.473 INFO:tasks.workunit.client.1.smithi112.stdout:3/581: stat d12/d1f/d27/d44/d73 0 2024-04-25T02:09:12.481 INFO:tasks.workunit.client.1.smithi112.stdout:1/586: dwrite d7/d9/d4e/f37 [0,4194304] 0 2024-04-25T02:09:12.481 INFO:tasks.workunit.client.1.smithi112.stdout:0/756: dwrite da/d1d/dbe/fe5 [0,4194304] 0 2024-04-25T02:09:12.481 INFO:tasks.workunit.client.1.smithi112.stdout:1/587: write d7/d9/d4e/d28/d3f/fa7 [171629,115992] 0 2024-04-25T02:09:12.484 INFO:tasks.workunit.client.1.smithi112.stdout:0/757: creat da/d13/d1e/de0/deb/ff2 x:0 0 0 2024-04-25T02:09:12.487 INFO:tasks.workunit.client.1.smithi112.stdout:0/758: symlink da/lf3 0 2024-04-25T02:09:12.488 INFO:tasks.workunit.client.1.smithi112.stdout:3/582: write d12/d13/f1c [4147533,88358] 0 2024-04-25T02:09:12.491 INFO:tasks.workunit.client.1.smithi112.stdout:1/588: getdents d7/d9/d4e/d28/d32 0 2024-04-25T02:09:12.495 INFO:tasks.workunit.client.1.smithi112.stdout:3/583: mkdir d12/d67/dbf 0 2024-04-25T02:09:12.497 INFO:tasks.workunit.client.1.smithi112.stdout:1/589: read d7/d4b/fa4 [4111457,8447] 0 2024-04-25T02:09:12.497 INFO:tasks.workunit.client.1.smithi112.stdout:1/590: truncate d7/d9/d4e/d28/f3c 1036116 0 2024-04-25T02:09:12.497 INFO:tasks.workunit.client.1.smithi112.stdout:1/591: dread - d7/d9/d1f/d25/fbb zero size 2024-04-25T02:09:12.497 INFO:tasks.workunit.client.1.smithi112.stdout:1/592: write d7/d9/d1e/d66/fb1 [487128,118302] 0 2024-04-25T02:09:12.498 INFO:tasks.workunit.client.1.smithi112.stdout:3/584: rmdir d12/d1f/d27 39 2024-04-25T02:09:12.502 INFO:tasks.workunit.client.1.smithi112.stdout:3/585: link d12/d5d/f90 d12/d5d/fc0 0 2024-04-25T02:09:12.502 INFO:tasks.workunit.client.1.smithi112.stdout:3/586: write d12/d13/d34/d78/d83/f9f [135133,22242] 0 2024-04-25T02:09:12.502 INFO:tasks.workunit.client.1.smithi112.stdout:1/593: dread d7/d9/d1f/d25/f77 [0,4194304] 0 2024-04-25T02:09:12.502 INFO:tasks.workunit.client.1.smithi112.stdout:0/759: dwrite da/f10 [0,4194304] 0 2024-04-25T02:09:12.502 INFO:tasks.workunit.client.1.smithi112.stdout:0/760: truncate da/d1d/dbe/fcc 915798 0 2024-04-25T02:09:12.505 INFO:tasks.workunit.client.1.smithi112.stdout:3/587: link d12/f14 d12/d13/fc1 0 2024-04-25T02:09:12.506 INFO:tasks.workunit.client.1.smithi112.stdout:1/594: rmdir d7/d9/d1f/d25/d39 39 2024-04-25T02:09:12.507 INFO:tasks.workunit.client.1.smithi112.stdout:3/588: creat d12/d5d/fc2 x:0 0 0 2024-04-25T02:09:12.512 INFO:tasks.workunit.client.1.smithi112.stdout:3/589: dread d12/d13/d34/d53/f8d [0,4194304] 0 2024-04-25T02:09:12.517 INFO:tasks.workunit.client.1.smithi112.stdout:3/590: symlink d12/d13/d34/d78/d91/lc3 0 2024-04-25T02:09:12.523 INFO:tasks.workunit.client.1.smithi112.stdout:3/591: dread d12/d13/f1b [0,4194304] 0 2024-04-25T02:09:12.524 INFO:tasks.workunit.client.1.smithi112.stdout:3/592: link d12/d1f/d27/d44/d73/c7b d12/d1f/d27/d44/d73/d95/da5/cc4 0 2024-04-25T02:09:12.527 INFO:tasks.workunit.client.1.smithi112.stdout:3/593: unlink d12/d1f/d27/f28 0 2024-04-25T02:09:12.605 INFO:tasks.workunit.client.1.smithi112.stdout:9/569: sync 2024-04-25T02:09:12.606 INFO:tasks.workunit.client.1.smithi112.stdout:9/570: symlink d1/df/d3c/d46/lc6 0 2024-04-25T02:09:12.606 INFO:tasks.workunit.client.1.smithi112.stdout:9/571: write d1/df/f23 [1068223,77797] 0 2024-04-25T02:09:12.607 INFO:tasks.workunit.client.1.smithi112.stdout:9/572: mkdir d1/d48/dbd/dc7 0 2024-04-25T02:09:12.615 INFO:tasks.workunit.client.1.smithi112.stdout:1/595: dwrite d7/d9/d46/f89 [4194304,4194304] 0 2024-04-25T02:09:12.617 INFO:tasks.workunit.client.1.smithi112.stdout:1/596: unlink d7/d9/d4e/l4a 0 2024-04-25T02:09:12.619 INFO:tasks.workunit.client.1.smithi112.stdout:1/597: creat d7/d9/d1e/de/fbc x:0 0 0 2024-04-25T02:09:12.619 INFO:tasks.workunit.client.1.smithi112.stdout:1/598: chown d7/d9/l8e 3799686 1 2024-04-25T02:09:12.622 INFO:tasks.workunit.client.1.smithi112.stdout:1/599: symlink d7/d9/lbd 0 2024-04-25T02:09:12.622 INFO:tasks.workunit.client.1.smithi112.stdout:1/600: chown d7/d9/d1e/d40/c87 253595 1 2024-04-25T02:09:12.636 INFO:tasks.workunit.client.1.smithi112.stdout:1/601: dwrite d7/d9/d4e/f37 [4194304,4194304] 0 2024-04-25T02:09:12.639 INFO:tasks.workunit.client.1.smithi112.stdout:1/602: creat d7/d4b/d94/fbe x:0 0 0 2024-04-25T02:09:12.642 INFO:tasks.workunit.client.1.smithi112.stdout:1/603: rename d7/d9/d51/d58/l59 to d7/d9/d51/d83/lbf 0 2024-04-25T02:09:12.642 INFO:tasks.workunit.client.1.smithi112.stdout:1/604: truncate d7/d9/d51/d58/f5b 5234693 0 2024-04-25T02:09:12.651 INFO:tasks.workunit.client.1.smithi112.stdout:1/605: dread d7/d9/d4e/f4c [0,4194304] 0 2024-04-25T02:09:12.659 INFO:tasks.workunit.client.1.smithi112.stdout:1/606: dread d7/d9/d4e/f37 [4194304,4194304] 0 2024-04-25T02:09:12.659 INFO:tasks.workunit.client.1.smithi112.stdout:1/607: creat d7/d9/d1e/de/fc0 x:0 0 0 2024-04-25T02:09:12.680 INFO:tasks.workunit.client.1.smithi112.stdout:9/573: dwrite d1/df/f11 [0,4194304] 0 2024-04-25T02:09:12.680 INFO:tasks.workunit.client.1.smithi112.stdout:9/574: chown d1/d13/l16 216 1 2024-04-25T02:09:12.685 INFO:tasks.workunit.client.1.smithi112.stdout:9/575: rmdir d1/df/d3c/d46 39 2024-04-25T02:09:12.692 INFO:tasks.workunit.client.1.smithi112.stdout:1/608: dwrite d7/d9/d4e/f6d [0,4194304] 0 2024-04-25T02:09:12.700 INFO:tasks.workunit.client.1.smithi112.stdout:1/609: truncate d7/d9/d1e/d40/f57 1469720 0 2024-04-25T02:09:12.705 INFO:tasks.workunit.client.1.smithi112.stdout:9/576: dwrite d1/df/d3c/d43/fbf [0,4194304] 0 2024-04-25T02:09:12.707 INFO:tasks.workunit.client.1.smithi112.stdout:1/610: dread d7/d9/d4e/f4c [0,4194304] 0 2024-04-25T02:09:12.713 INFO:tasks.workunit.client.1.smithi112.stdout:9/577: unlink d1/df/f39 0 2024-04-25T02:09:12.720 INFO:tasks.workunit.client.1.smithi112.stdout:1/611: dwrite d7/f24 [0,4194304] 0 2024-04-25T02:09:12.722 INFO:tasks.workunit.client.1.smithi112.stdout:1/612: rmdir d7/d9/d51/d58 39 2024-04-25T02:09:12.722 INFO:tasks.workunit.client.1.smithi112.stdout:1/613: readlink d7/d9/d51/d83/lbf 0 2024-04-25T02:09:12.722 INFO:tasks.workunit.client.1.smithi112.stdout:9/578: write d1/d48/d65/d73/daf/fa4 [784523,28141] 0 2024-04-25T02:09:12.724 INFO:tasks.workunit.client.1.smithi112.stdout:1/614: mkdir d7/d9/d4e/d85/dc1 0 2024-04-25T02:09:12.724 INFO:tasks.workunit.client.1.smithi112.stdout:1/615: chown d7/d4b/f69 114479 1 2024-04-25T02:09:12.724 INFO:tasks.workunit.client.1.smithi112.stdout:1/616: chown d7/d9/d51/d58/c8a 1510458 1 2024-04-25T02:09:12.726 INFO:tasks.workunit.client.1.smithi112.stdout:9/579: rmdir d1/df/d3c 39 2024-04-25T02:09:12.726 INFO:tasks.workunit.client.1.smithi112.stdout:9/580: creat d1/d13/d41/d84/fc8 x:0 0 0 2024-04-25T02:09:12.728 INFO:tasks.workunit.client.1.smithi112.stdout:1/617: mknod d7/d9/d1e/cc2 0 2024-04-25T02:09:12.731 INFO:tasks.workunit.client.1.smithi112.stdout:1/618: mkdir d7/d9/d4e/d28/d43/dc3 0 2024-04-25T02:09:12.739 INFO:tasks.workunit.client.1.smithi112.stdout:1/619: write d7/d9/d4e/d28/f3c [1806614,43926] 0 2024-04-25T02:09:12.741 INFO:tasks.workunit.client.1.smithi112.stdout:1/620: symlink d7/d9/d4e/d28/d43/dc3/lc4 0 2024-04-25T02:09:12.741 INFO:tasks.workunit.client.1.smithi112.stdout:1/621: chown d7/d9/l8e 8 1 2024-04-25T02:09:12.741 INFO:tasks.workunit.client.1.smithi112.stdout:1/622: read d7/d9/f10 [1476635,35931] 0 2024-04-25T02:09:12.754 INFO:tasks.workunit.client.1.smithi112.stdout:1/623: dwrite d7/d9/d1f/f36 [4194304,4194304] 0 2024-04-25T02:09:12.758 INFO:tasks.workunit.client.1.smithi112.stdout:1/624: rename f4 to d7/d9/d4e/d72/fc5 0 2024-04-25T02:09:12.760 INFO:tasks.workunit.client.1.smithi112.stdout:1/625: mkdir d7/d9/d1e/d66/dc6 0 2024-04-25T02:09:12.760 INFO:tasks.workunit.client.1.smithi112.stdout:1/626: chown d7/d9/d1f/f63 2506 1 2024-04-25T02:09:12.783 INFO:tasks.workunit.client.1.smithi112.stdout:1/627: dwrite f6 [8388608,4194304] 0 2024-04-25T02:09:12.783 INFO:tasks.workunit.client.1.smithi112.stdout:1/628: fsync d7/d9/f10 0 2024-04-25T02:09:12.783 INFO:tasks.workunit.client.1.smithi112.stdout:1/629: dread - d7/d9/d51/fb3 zero size 2024-04-25T02:09:12.783 INFO:tasks.workunit.client.1.smithi112.stdout:1/630: mkdir d7/d9/d4e/d28/dc7 0 2024-04-25T02:09:12.786 INFO:tasks.workunit.client.1.smithi112.stdout:1/631: rename d7/d9/d1f/f63 to d7/d9/d1f/fc8 0 2024-04-25T02:09:12.786 INFO:tasks.workunit.client.1.smithi112.stdout:1/632: fsync d7/d9/d4e/fad 0 2024-04-25T02:09:12.786 INFO:tasks.workunit.client.1.smithi112.stdout:1/633: chown d7/d9/d1e/de/d84/l9d 99193 1 2024-04-25T02:09:12.786 INFO:tasks.workunit.client.1.smithi112.stdout:1/634: fdatasync d7/f4d 0 2024-04-25T02:09:12.786 INFO:tasks.workunit.client.1.smithi112.stdout:1/635: chown d7/d9/d4e/d28/f70 479656386 1 2024-04-25T02:09:12.840 INFO:tasks.workunit.client.1.smithi112.stdout:2/437: sync 2024-04-25T02:09:12.840 INFO:tasks.workunit.client.1.smithi112.stdout:5/477: sync 2024-04-25T02:09:12.840 INFO:tasks.workunit.client.1.smithi112.stdout:6/534: sync 2024-04-25T02:09:12.840 INFO:tasks.workunit.client.1.smithi112.stdout:5/478: readlink d1/d16/d22/l49 0 2024-04-25T02:09:12.840 INFO:tasks.workunit.client.1.smithi112.stdout:5/479: fsync d1/d2/d4/d1d/f2a 0 2024-04-25T02:09:12.840 INFO:tasks.workunit.client.1.smithi112.stdout:5/480: dread - d1/d41/d5b/d7b/fa8 zero size 2024-04-25T02:09:12.840 INFO:tasks.workunit.client.1.smithi112.stdout:5/481: chown d1/d41/d5b/d6b/c72 226133579 1 2024-04-25T02:09:12.840 INFO:tasks.workunit.client.1.smithi112.stdout:2/438: creat d3/da/dc/d20/d43/d74/f99 x:0 0 0 2024-04-25T02:09:12.840 INFO:tasks.workunit.client.1.smithi112.stdout:2/439: chown d3/da/dc/d3e/df/d30/c45 24334513 1 2024-04-25T02:09:12.840 INFO:tasks.workunit.client.1.smithi112.stdout:2/440: creat d3/d62/f9a x:0 0 0 2024-04-25T02:09:12.840 INFO:tasks.workunit.client.1.smithi112.stdout:5/482: write d1/d16/d22/f37 [986478,63306] 0 2024-04-25T02:09:12.841 INFO:tasks.workunit.client.1.smithi112.stdout:2/441: write d3/da/dc/d20/f21 [2359704,37166] 0 2024-04-25T02:09:12.841 INFO:tasks.workunit.client.1.smithi112.stdout:5/483: write d1/d16/d22/f37 [889006,44051] 0 2024-04-25T02:09:12.842 INFO:tasks.workunit.client.1.smithi112.stdout:2/442: symlink d3/da/dc/d20/d85/l9b 0 2024-04-25T02:09:12.842 INFO:tasks.workunit.client.1.smithi112.stdout:2/443: dread - d3/da/dc/d3e/df/d32/f98 zero size 2024-04-25T02:09:12.842 INFO:tasks.workunit.client.1.smithi112.stdout:2/444: chown d3/d62/d81 3 1 2024-04-25T02:09:12.842 INFO:tasks.workunit.client.1.smithi112.stdout:2/445: chown d3/da/dc/d3e/df/d25/d88/d8e/c95 40 1 2024-04-25T02:09:12.842 INFO:tasks.workunit.client.1.smithi112.stdout:5/484: rename d1/d41/d8a/f90 to d1/d2/d28/d4f/fac 0 2024-04-25T02:09:12.843 INFO:tasks.workunit.client.1.smithi112.stdout:5/485: chown d1/d41/d5b/d79 244543 1 2024-04-25T02:09:12.848 INFO:tasks.workunit.client.1.smithi112.stdout:6/535: dread d0/d7b/f90 [0,4194304] 0 2024-04-25T02:09:12.848 INFO:tasks.workunit.client.1.smithi112.stdout:6/536: write d0/d2/d4/f7a [29693,54233] 0 2024-04-25T02:09:12.848 INFO:tasks.workunit.client.1.smithi112.stdout:6/537: write d0/d2/fba [431940,7166] 0 2024-04-25T02:09:12.848 INFO:tasks.workunit.client.1.smithi112.stdout:6/538: write d0/d2/d2c/f3f [50370,128848] 0 2024-04-25T02:09:12.848 INFO:tasks.workunit.client.1.smithi112.stdout:6/539: fdatasync d0/d2/d4/d28/f5c 0 2024-04-25T02:09:12.852 INFO:tasks.workunit.client.1.smithi112.stdout:2/446: dread d3/da/dc/d20/d85/f8d [0,4194304] 0 2024-04-25T02:09:12.852 INFO:tasks.workunit.client.1.smithi112.stdout:2/447: chown d3/da/dc/d20/d43/f55 42 1 2024-04-25T02:09:12.852 INFO:tasks.workunit.client.1.smithi112.stdout:2/448: chown d3/d62/f7f 11182 1 2024-04-25T02:09:12.852 INFO:tasks.workunit.client.1.smithi112.stdout:2/449: stat d3/da/d18 0 2024-04-25T02:09:12.855 INFO:tasks.workunit.client.1.smithi112.stdout:5/486: symlink d1/d16/d51/lad 0 2024-04-25T02:09:12.857 INFO:tasks.workunit.client.1.smithi112.stdout:6/540: creat d0/d61/d98/fbe x:0 0 0 2024-04-25T02:09:12.858 INFO:tasks.workunit.client.1.smithi112.stdout:2/450: rename d3/da/l1d to d3/da/dc/d20/d43/d5e/l9c 0 2024-04-25T02:09:12.863 INFO:tasks.workunit.client.1.smithi112.stdout:5/487: symlink d1/d3f/d9c/lae 0 2024-04-25T02:09:12.864 INFO:tasks.workunit.client.1.smithi112.stdout:5/488: dread - d1/d41/d5b/fa3 zero size 2024-04-25T02:09:12.864 INFO:tasks.workunit.client.1.smithi112.stdout:5/489: fsync d1/d2/d4/fe 0 2024-04-25T02:09:12.867 INFO:tasks.workunit.client.1.smithi112.stdout:5/490: mknod d1/d2/d78/caf 0 2024-04-25T02:09:12.868 INFO:tasks.workunit.client.1.smithi112.stdout:2/451: link d3/da/dc/d3e/df/d25/f46 d3/f9d 0 2024-04-25T02:09:12.873 INFO:tasks.workunit.client.1.smithi112.stdout:6/541: dwrite d0/d36/f37 [0,4194304] 0 2024-04-25T02:09:12.874 INFO:tasks.workunit.client.1.smithi112.stdout:5/491: dread d1/f18 [0,4194304] 0 2024-04-25T02:09:12.880 INFO:tasks.workunit.client.1.smithi112.stdout:6/542: truncate d0/d2/d1f/f43 2085060 0 2024-04-25T02:09:12.881 INFO:tasks.workunit.client.1.smithi112.stdout:2/452: rename d3/d62 to d3/da/dc/d3e/df/d25/d9e 0 2024-04-25T02:09:12.883 INFO:tasks.workunit.client.1.smithi112.stdout:6/543: rename d0/d2/d4/f11 to d0/d61/db0/fbf 0 2024-04-25T02:09:12.884 INFO:tasks.workunit.client.1.smithi112.stdout:2/453: mkdir d3/da/dc/d3e/df/d25/d9e/d81/d9f 0 2024-04-25T02:09:12.884 INFO:tasks.workunit.client.1.smithi112.stdout:2/454: readlink d3/l83 0 2024-04-25T02:09:12.888 INFO:tasks.workunit.client.1.smithi112.stdout:5/492: dwrite d1/f46 [4194304,4194304] 0 2024-04-25T02:09:12.889 INFO:tasks.workunit.client.1.smithi112.stdout:5/493: creat d1/d41/d5b/d96/fb0 x:0 0 0 2024-04-25T02:09:12.889 INFO:tasks.workunit.client.1.smithi112.stdout:5/494: dread - d1/d2/f7e zero size 2024-04-25T02:09:12.889 INFO:tasks.workunit.client.1.smithi112.stdout:5/495: stat d1/d16/d22/f4e 0 2024-04-25T02:09:12.889 INFO:tasks.workunit.client.1.smithi112.stdout:5/496: write d1/d16/d51/f5f [171708,83478] 0 2024-04-25T02:09:12.889 INFO:tasks.workunit.client.1.smithi112.stdout:5/497: stat d1/d16/f4d 0 2024-04-25T02:09:12.889 INFO:tasks.workunit.client.1.smithi112.stdout:5/498: fdatasync d1/d41/d5b/f80 0 2024-04-25T02:09:12.889 INFO:tasks.workunit.client.1.smithi112.stdout:5/499: creat d1/d2/d78/fb1 x:0 0 0 2024-04-25T02:09:12.891 INFO:tasks.workunit.client.1.smithi112.stdout:6/544: rename d0/d2/d66/d7d/d92 to d0/d32/dc0 0 2024-04-25T02:09:12.892 INFO:tasks.workunit.client.1.smithi112.stdout:2/455: dread d3/da/dc/d3e/df/d25/f77 [0,4194304] 0 2024-04-25T02:09:12.892 INFO:tasks.workunit.client.1.smithi112.stdout:2/456: chown d3/da/dc/d20/d43/f56 39055550 1 2024-04-25T02:09:12.892 INFO:tasks.workunit.client.1.smithi112.stdout:2/457: stat d3/c39 0 2024-04-25T02:09:12.903 INFO:tasks.workunit.client.1.smithi112.stdout:2/458: symlink d3/da/dc/d3e/df/d25/la0 0 2024-04-25T02:09:12.914 INFO:tasks.workunit.client.1.smithi112.stdout:5/500: dwrite d1/d41/f6d [0,4194304] 0 2024-04-25T02:09:12.915 INFO:tasks.workunit.client.1.smithi112.stdout:6/545: dwrite d0/d2/d2c/d41/d77/fa4 [0,4194304] 0 2024-04-25T02:09:12.918 INFO:tasks.workunit.client.1.smithi112.stdout:5/501: truncate d1/faa 1388409 0 2024-04-25T02:09:12.924 INFO:tasks.workunit.client.1.smithi112.stdout:5/502: unlink d1/d3f/d76/fa4 0 2024-04-25T02:09:12.924 INFO:tasks.workunit.client.1.smithi112.stdout:5/503: write d1/d3f/d9c/fa1 [57800,62365] 0 2024-04-25T02:09:12.924 INFO:tasks.workunit.client.1.smithi112.stdout:5/504: write d1/d2/d28/f57 [193418,109126] 0 2024-04-25T02:09:12.924 INFO:tasks.workunit.client.1.smithi112.stdout:5/505: write d1/d2/d28/f57 [553259,3146] 0 2024-04-25T02:09:12.925 INFO:tasks.workunit.client.1.smithi112.stdout:5/506: write d1/d3f/f85 [404469,45049] 0 2024-04-25T02:09:12.925 INFO:tasks.workunit.client.1.smithi112.stdout:5/507: write d1/d3f/f85 [1084110,71141] 0 2024-04-25T02:09:12.926 INFO:tasks.workunit.client.1.smithi112.stdout:5/508: mkdir d1/d41/d5b/d7b/db2 0 2024-04-25T02:09:12.928 INFO:tasks.workunit.client.1.smithi112.stdout:2/459: dwrite d3/da/dc/d20/f76 [0,4194304] 0 2024-04-25T02:09:12.933 INFO:tasks.workunit.client.1.smithi112.stdout:2/460: write d3/da/f2b [144719,104506] 0 2024-04-25T02:09:13.168 INFO:tasks.workunit.client.1.smithi112.stdout:8/837: sync 2024-04-25T02:09:13.168 INFO:tasks.workunit.client.1.smithi112.stdout:8/838: truncate d15/d17/df1/f11b 892425 0 2024-04-25T02:09:13.169 INFO:tasks.workunit.client.1.smithi112.stdout:8/839: mkdir d15/d81/dec/d11e 0 2024-04-25T02:09:13.170 INFO:tasks.workunit.client.1.smithi112.stdout:8/840: unlink d15/f11c 0 2024-04-25T02:09:13.171 INFO:tasks.workunit.client.1.smithi112.stdout:8/841: mknod d15/d26/c11f 0 2024-04-25T02:09:13.172 INFO:tasks.workunit.client.1.smithi112.stdout:8/842: symlink d15/d35/l120 0 2024-04-25T02:09:13.172 INFO:tasks.workunit.client.1.smithi112.stdout:8/843: fdatasync d15/d35/d5c/fd6 0 2024-04-25T02:09:13.174 INFO:tasks.workunit.client.1.smithi112.stdout:8/844: rename d15/d17/d1a/f111 to d15/f121 0 2024-04-25T02:09:13.175 INFO:tasks.workunit.client.1.smithi112.stdout:8/845: rmdir d15/d40 39 2024-04-25T02:09:13.175 INFO:tasks.workunit.client.1.smithi112.stdout:8/846: write fe [840331,108931] 0 2024-04-25T02:09:13.175 INFO:tasks.workunit.client.1.smithi112.stdout:8/847: creat d15/d26/d4f/d67/f122 x:0 0 0 2024-04-25T02:09:13.178 INFO:tasks.workunit.client.1.smithi112.stdout:8/848: creat d15/d26/d4f/d67/dcd/f123 x:0 0 0 2024-04-25T02:09:13.179 INFO:tasks.workunit.client.1.smithi112.stdout:8/849: symlink d15/d35/l124 0 2024-04-25T02:09:13.181 INFO:tasks.workunit.client.1.smithi112.stdout:8/850: mkdir d15/d26/d37/d52/df4/d125 0 2024-04-25T02:09:13.181 INFO:tasks.workunit.client.1.smithi112.stdout:8/851: stat d15/d35/d5c/d5e/d94/laa 0 2024-04-25T02:09:13.188 INFO:tasks.workunit.client.1.smithi112.stdout:8/852: creat d15/d35/d5c/d91/d64/f126 x:0 0 0 2024-04-25T02:09:13.188 INFO:tasks.workunit.client.1.smithi112.stdout:8/853: fdatasync d15/d17/df1/ff2 0 2024-04-25T02:09:13.189 INFO:tasks.workunit.client.1.smithi112.stdout:8/854: mknod d15/d81/dce/c127 0 2024-04-25T02:09:13.189 INFO:tasks.workunit.client.1.smithi112.stdout:8/855: chown d15/d35/d5f/db5/dc2/d109 1245 1 2024-04-25T02:09:13.206 INFO:tasks.workunit.client.1.smithi112.stdout:8/856: dwrite d15/f2c [4194304,4194304] 0 2024-04-25T02:09:13.208 INFO:tasks.workunit.client.1.smithi112.stdout:8/857: getdents d15/d35/d56 0 2024-04-25T02:09:13.211 INFO:tasks.workunit.client.1.smithi112.stdout:8/858: mknod d15/d26/d37/d52/df4/d125/c128 0 2024-04-25T02:09:13.211 INFO:tasks.workunit.client.1.smithi112.stdout:8/859: getdents d15/d35/d5f/db5/dc2/d109 0 2024-04-25T02:09:13.211 INFO:tasks.workunit.client.1.smithi112.stdout:8/860: truncate d15/d35/d5c/d91/d78/fd9 102476 0 2024-04-25T02:09:13.212 INFO:tasks.workunit.client.1.smithi112.stdout:8/861: symlink d15/d40/d88/l129 0 2024-04-25T02:09:13.221 INFO:tasks.workunit.client.1.smithi112.stdout:8/862: dread d15/f42 [0,4194304] 0 2024-04-25T02:09:13.225 INFO:tasks.workunit.client.1.smithi112.stdout:8/863: rmdir d15/d26/d4f/d67/dcd 39 2024-04-25T02:09:13.226 INFO:tasks.workunit.client.1.smithi112.stdout:8/864: dread d15/d40/f115 [0,4194304] 0 2024-04-25T02:09:13.228 INFO:tasks.workunit.client.1.smithi112.stdout:8/865: getdents d15/d35/d5c/d91/d64/d8b 0 2024-04-25T02:09:13.228 INFO:tasks.workunit.client.1.smithi112.stdout:8/866: fdatasync d15/f121 0 2024-04-25T02:09:13.228 INFO:tasks.workunit.client.1.smithi112.stdout:8/867: chown d15/d35/d5f/db5 2545 1 2024-04-25T02:09:13.229 INFO:tasks.workunit.client.1.smithi112.stdout:8/868: dread d15/d35/d56/f6a [4194304,4194304] 0 2024-04-25T02:09:13.229 INFO:tasks.workunit.client.1.smithi112.stdout:8/869: write d15/d26/f3a [2748544,44580] 0 2024-04-25T02:09:13.231 INFO:tasks.workunit.client.1.smithi112.stdout:8/870: creat d15/d26/d37/d52/df4/f12a x:0 0 0 2024-04-25T02:09:13.326 INFO:tasks.workunit.client.1.smithi112.stdout:4/664: sync 2024-04-25T02:09:13.326 INFO:tasks.workunit.client.1.smithi112.stdout:4/665: write d2/d17/d20/d5e/f2b [2063247,98540] 0 2024-04-25T02:09:13.334 INFO:tasks.workunit.client.1.smithi112.stdout:4/666: creat d2/d1e/fd9 x:0 0 0 2024-04-25T02:09:13.355 INFO:tasks.workunit.client.1.smithi112.stdout:4/667: dwrite d2/d12/d22/d60/f7f [0,4194304] 0 2024-04-25T02:09:13.355 INFO:tasks.workunit.client.1.smithi112.stdout:4/668: fdatasync d2/d1e/f35 0 2024-04-25T02:09:13.361 INFO:tasks.workunit.client.1.smithi112.stdout:4/669: dread d2/d17/d25/d3f/fa4 [0,4194304] 0 2024-04-25T02:09:13.378 INFO:tasks.workunit.client.1.smithi112.stdout:4/670: dwrite d2/d12/fba [0,4194304] 0 2024-04-25T02:09:13.381 INFO:tasks.workunit.client.1.smithi112.stdout:4/671: mknod d2/d1e/d4b/d57/cda 0 2024-04-25T02:09:13.381 INFO:tasks.workunit.client.1.smithi112.stdout:4/672: truncate d2/d1e/d4b/d57/fa0 829223 0 2024-04-25T02:09:13.383 INFO:tasks.workunit.client.1.smithi112.stdout:4/673: symlink d2/d17/d7c/ldb 0 2024-04-25T02:09:13.384 INFO:tasks.workunit.client.1.smithi112.stdout:3/594: sync 2024-04-25T02:09:13.384 INFO:tasks.workunit.client.1.smithi112.stdout:2/461: sync 2024-04-25T02:09:13.384 INFO:tasks.workunit.client.1.smithi112.stdout:0/761: sync 2024-04-25T02:09:13.384 INFO:tasks.workunit.client.1.smithi112.stdout:7/602: sync 2024-04-25T02:09:13.384 INFO:tasks.workunit.client.1.smithi112.stdout:6/546: sync 2024-04-25T02:09:13.385 INFO:tasks.workunit.client.1.smithi112.stdout:6/547: chown d0/d32/l73 41296560 1 2024-04-25T02:09:13.387 INFO:tasks.workunit.client.1.smithi112.stdout:4/674: mknod d2/d1e/d4b/cdc 0 2024-04-25T02:09:13.387 INFO:tasks.workunit.client.1.smithi112.stdout:4/675: stat d2/d1e/d5c/fd6 0 2024-04-25T02:09:13.389 INFO:tasks.workunit.client.1.smithi112.stdout:9/581: sync 2024-04-25T02:09:13.389 INFO:tasks.workunit.client.1.smithi112.stdout:1/636: sync 2024-04-25T02:09:13.389 INFO:tasks.workunit.client.1.smithi112.stdout:5/509: sync 2024-04-25T02:09:13.389 INFO:tasks.workunit.client.1.smithi112.stdout:1/637: read - d7/d4b/faa zero size 2024-04-25T02:09:13.390 INFO:tasks.workunit.client.1.smithi112.stdout:3/595: creat d12/d1f/d27/fc5 x:0 0 0 2024-04-25T02:09:13.392 INFO:tasks.workunit.client.1.smithi112.stdout:4/676: truncate d2/d1e/f35 477706 0 2024-04-25T02:09:13.393 INFO:tasks.workunit.client.1.smithi112.stdout:6/548: dread d0/d36/f37 [0,4194304] 0 2024-04-25T02:09:13.393 INFO:tasks.workunit.client.1.smithi112.stdout:6/549: stat d0/d2/d4/c4c 0 2024-04-25T02:09:13.393 INFO:tasks.workunit.client.1.smithi112.stdout:6/550: readlink d0/l25 0 2024-04-25T02:09:13.394 INFO:tasks.workunit.client.1.smithi112.stdout:5/510: rmdir d1/d2 39 2024-04-25T02:09:13.395 INFO:tasks.workunit.client.1.smithi112.stdout:5/511: write d1/d16/d22/f37 [1902991,47953] 0 2024-04-25T02:09:13.395 INFO:tasks.workunit.client.1.smithi112.stdout:5/512: read - d1/d2/d78/f7c zero size 2024-04-25T02:09:13.395 INFO:tasks.workunit.client.1.smithi112.stdout:9/582: symlink d1/d48/d65/d73/daf/d8e/lc9 0 2024-04-25T02:09:13.395 INFO:tasks.workunit.client.1.smithi112.stdout:9/583: readlink d1/df/d3c/l70 0 2024-04-25T02:09:13.399 INFO:tasks.workunit.client.1.smithi112.stdout:1/638: mkdir d7/d9/d4e/d28/d32/dc9 0 2024-04-25T02:09:13.400 INFO:tasks.workunit.client.1.smithi112.stdout:3/596: rename d12/d13/d34/d4a/fa6 to d12/d1f/fc6 0 2024-04-25T02:09:13.402 INFO:tasks.workunit.client.1.smithi112.stdout:5/513: link d1/d2/d4/d1d/f70 d1/d2/d45/fb3 0 2024-04-25T02:09:13.403 INFO:tasks.workunit.client.1.smithi112.stdout:1/639: creat d7/d9/d1e/de/d84/fca x:0 0 0 2024-04-25T02:09:13.403 INFO:tasks.workunit.client.1.smithi112.stdout:1/640: truncate d7/d9/d1e/de/d9a/fba 914874 0 2024-04-25T02:09:13.404 INFO:tasks.workunit.client.1.smithi112.stdout:4/677: read d2/d17/d25/f3b [270160,95375] 0 2024-04-25T02:09:13.405 INFO:tasks.workunit.client.1.smithi112.stdout:3/597: getdents d12/d1f/d27/d44/d73/d95 0 2024-04-25T02:09:13.407 INFO:tasks.workunit.client.1.smithi112.stdout:6/551: read d0/d36/f5a [2537409,121681] 0 2024-04-25T02:09:13.407 INFO:tasks.workunit.client.1.smithi112.stdout:6/552: chown d0/d2/d2c 2924 1 2024-04-25T02:09:13.408 INFO:tasks.workunit.client.1.smithi112.stdout:5/514: creat d1/d41/d5b/d79/d7a/da0/fb4 x:0 0 0 2024-04-25T02:09:13.409 INFO:tasks.workunit.client.1.smithi112.stdout:5/515: chown d1/d41/l58 7 1 2024-04-25T02:09:13.409 INFO:tasks.workunit.client.1.smithi112.stdout:3/598: dread d12/f1d [0,4194304] 0 2024-04-25T02:09:13.410 INFO:tasks.workunit.client.1.smithi112.stdout:1/641: dread d7/d9/d1e/f12 [0,4194304] 0 2024-04-25T02:09:13.410 INFO:tasks.workunit.client.1.smithi112.stdout:7/603: dwrite d7/dd/d20/d2c/f45 [4194304,4194304] 0 2024-04-25T02:09:13.411 INFO:tasks.workunit.client.1.smithi112.stdout:3/599: symlink d12/d13/d34/d78/d91/lc7 0 2024-04-25T02:09:13.413 INFO:tasks.workunit.client.1.smithi112.stdout:4/678: dread d2/d12/f19 [4194304,4194304] 0 2024-04-25T02:09:13.413 INFO:tasks.workunit.client.1.smithi112.stdout:4/679: dread - d2/d1e/d5c/fbc zero size 2024-04-25T02:09:13.414 INFO:tasks.workunit.client.1.smithi112.stdout:2/462: dwrite d3/da/dc/d3e/df/d32/f98 [0,4194304] 0 2024-04-25T02:09:13.414 INFO:tasks.workunit.client.1.smithi112.stdout:2/463: readlink d3/da/dc/l1a 0 2024-04-25T02:09:13.414 INFO:tasks.workunit.client.1.smithi112.stdout:2/464: creat d3/da/dc/d20/d43/d5e/fa1 x:0 0 0 2024-04-25T02:09:13.415 INFO:tasks.workunit.client.1.smithi112.stdout:9/584: dwrite d1/df/d3c/d46/f74 [0,4194304] 0 2024-04-25T02:09:13.415 INFO:tasks.workunit.client.1.smithi112.stdout:1/642: unlink d7/d9/d1f/f3e 0 2024-04-25T02:09:13.415 INFO:tasks.workunit.client.1.smithi112.stdout:1/643: dread - d7/d9/d4e/d72/d73/f98 zero size 2024-04-25T02:09:13.418 INFO:tasks.workunit.client.1.smithi112.stdout:7/604: mknod d7/dd/da9/d7f/cb7 0 2024-04-25T02:09:13.420 INFO:tasks.workunit.client.1.smithi112.stdout:5/516: dread d1/d2/d78/f81 [0,4194304] 0 2024-04-25T02:09:13.420 INFO:tasks.workunit.client.1.smithi112.stdout:5/517: readlink d1/d16/l68 0 2024-04-25T02:09:13.420 INFO:tasks.workunit.client.1.smithi112.stdout:5/518: stat d1/d41/d5b/d7b/f8b 0 2024-04-25T02:09:13.420 INFO:tasks.workunit.client.1.smithi112.stdout:5/519: readlink d1/d16/l3e 0 2024-04-25T02:09:13.420 INFO:tasks.workunit.client.1.smithi112.stdout:5/520: fdatasync d1/d2/d78/fb1 0 2024-04-25T02:09:13.420 INFO:tasks.workunit.client.1.smithi112.stdout:3/600: symlink d12/d13/d34/d4a/d4f/da1/lc8 0 2024-04-25T02:09:13.421 INFO:tasks.workunit.client.1.smithi112.stdout:5/521: dread d1/d2/d28/f57 [0,4194304] 0 2024-04-25T02:09:13.421 INFO:tasks.workunit.client.1.smithi112.stdout:5/522: write d1/d16/f73 [567512,24081] 0 2024-04-25T02:09:13.428 INFO:tasks.workunit.client.1.smithi112.stdout:3/601: dread d12/d13/d34/d78/f7f [0,4194304] 0 2024-04-25T02:09:13.428 INFO:tasks.workunit.client.1.smithi112.stdout:7/605: dread d7/d25/d43/fa7 [0,4194304] 0 2024-04-25T02:09:13.429 INFO:tasks.workunit.client.1.smithi112.stdout:7/606: fsync d7/d79/da2/f7c 0 2024-04-25T02:09:13.433 INFO:tasks.workunit.client.1.smithi112.stdout:2/465: dwrite d3/da/dc/d3e/df/d25/f54 [4194304,4194304] 0 2024-04-25T02:09:13.435 INFO:tasks.workunit.client.1.smithi112.stdout:9/585: truncate d1/d13/d41/f66 3191164 0 2024-04-25T02:09:13.437 INFO:tasks.workunit.client.1.smithi112.stdout:1/644: rename d7/d9/d1f/fc8 to d7/d9/d4e/d28/d43/dc3/fcb 0 2024-04-25T02:09:13.437 INFO:tasks.workunit.client.1.smithi112.stdout:1/645: write d7/d9/d1e/f1a [2250261,130148] 0 2024-04-25T02:09:13.447 INFO:tasks.workunit.client.1.smithi112.stdout:4/680: getdents d2/d4e 0 2024-04-25T02:09:13.449 INFO:tasks.workunit.client.1.smithi112.stdout:3/602: creat d12/d13/d34/d4a/fc9 x:0 0 0 2024-04-25T02:09:13.449 INFO:tasks.workunit.client.1.smithi112.stdout:3/603: fsync d12/d13/d34/d4a/f84 0 2024-04-25T02:09:13.452 INFO:tasks.workunit.client.1.smithi112.stdout:7/607: stat d7/dd/d20/c3e 0 2024-04-25T02:09:13.455 INFO:tasks.workunit.client.1.smithi112.stdout:2/466: getdents d3/da/dc/d20/d85 0 2024-04-25T02:09:13.455 INFO:tasks.workunit.client.1.smithi112.stdout:2/467: fsync d3/da/dc/f2e 0 2024-04-25T02:09:13.455 INFO:tasks.workunit.client.1.smithi112.stdout:2/468: creat d3/da/dc/d20/d43/d5e/fa2 x:0 0 0 2024-04-25T02:09:13.456 INFO:tasks.workunit.client.1.smithi112.stdout:9/586: symlink d1/df/lca 0 2024-04-25T02:09:13.456 INFO:tasks.workunit.client.1.smithi112.stdout:2/469: dread d3/da/dc/d3e/f3c [0,4194304] 0 2024-04-25T02:09:13.456 INFO:tasks.workunit.client.1.smithi112.stdout:2/470: stat d3/da/dc/d3e/df/d32 0 2024-04-25T02:09:13.457 INFO:tasks.workunit.client.1.smithi112.stdout:1/646: link d7/d9/d4e/d28/d43/d6a/cb4 d7/d9/d1e/de/ccc 0 2024-04-25T02:09:13.460 INFO:tasks.workunit.client.1.smithi112.stdout:4/681: creat d2/d1e/d42/fdd x:0 0 0 2024-04-25T02:09:13.461 INFO:tasks.workunit.client.1.smithi112.stdout:3/604: mkdir d12/d67/d8f/dca 0 2024-04-25T02:09:13.462 INFO:tasks.workunit.client.1.smithi112.stdout:7/608: mkdir d7/d79/db8 0 2024-04-25T02:09:13.468 INFO:tasks.workunit.client.1.smithi112.stdout:2/471: dwrite d3/da/dc/d20/d43/d5e/fa2 [0,4194304] 0 2024-04-25T02:09:13.469 INFO:tasks.workunit.client.1.smithi112.stdout:9/587: rmdir d1/d48/dbd/dc7 0 2024-04-25T02:09:13.469 INFO:tasks.workunit.client.1.smithi112.stdout:9/588: write d1/df/d3c/d46/f78 [2352171,91190] 0 2024-04-25T02:09:13.470 INFO:tasks.workunit.client.1.smithi112.stdout:1/647: unlink d7/d9/d4e/d28/d3f/f7c 0 2024-04-25T02:09:13.471 INFO:tasks.workunit.client.1.smithi112.stdout:1/648: creat d7/d9/d1f/d25/fcd x:0 0 0 2024-04-25T02:09:13.471 INFO:tasks.workunit.client.1.smithi112.stdout:4/682: getdents d2/d17/d20 0 2024-04-25T02:09:13.473 INFO:tasks.workunit.client.1.smithi112.stdout:3/605: rmdir d12/d13/d34 39 2024-04-25T02:09:13.473 INFO:tasks.workunit.client.1.smithi112.stdout:3/606: creat d12/d1f/d27/d44/fcb x:0 0 0 2024-04-25T02:09:13.473 INFO:tasks.workunit.client.1.smithi112.stdout:3/607: read d12/f36 [3489333,119791] 0 2024-04-25T02:09:13.474 INFO:tasks.workunit.client.1.smithi112.stdout:7/609: mknod d7/dd/d88/db6/cb9 0 2024-04-25T02:09:13.474 INFO:tasks.workunit.client.1.smithi112.stdout:7/610: write d7/d79/da2/d3a/f9d [369395,124222] 0 2024-04-25T02:09:13.475 INFO:tasks.workunit.client.1.smithi112.stdout:2/472: dread d3/da/f15 [0,4194304] 0 2024-04-25T02:09:13.477 INFO:tasks.workunit.client.1.smithi112.stdout:9/589: symlink d1/df/lcb 0 2024-04-25T02:09:13.477 INFO:tasks.workunit.client.1.smithi112.stdout:9/590: read - d1/d13/d41/d84/fac zero size 2024-04-25T02:09:13.480 INFO:tasks.workunit.client.1.smithi112.stdout:1/649: creat d7/d9/d51/fce x:0 0 0 2024-04-25T02:09:13.485 INFO:tasks.workunit.client.1.smithi112.stdout:4/683: truncate d2/d17/d20/f6b 2444127 0 2024-04-25T02:09:13.492 INFO:tasks.workunit.client.1.smithi112.stdout:3/608: rmdir d12/d67/d8f/dca 0 2024-04-25T02:09:13.492 INFO:tasks.workunit.client.1.smithi112.stdout:3/609: stat d12/d1f/d27/d44/d7e 0 2024-04-25T02:09:13.492 INFO:tasks.workunit.client.1.smithi112.stdout:3/610: chown d12/c97 0 1 2024-04-25T02:09:13.493 INFO:tasks.workunit.client.1.smithi112.stdout:7/611: unlink d7/f61 0 2024-04-25T02:09:13.495 INFO:tasks.workunit.client.1.smithi112.stdout:4/684: write d2/d12/fa9 [457384,91913] 0 2024-04-25T02:09:13.495 INFO:tasks.workunit.client.1.smithi112.stdout:3/611: dread d12/d13/f1b [0,4194304] 0 2024-04-25T02:09:13.495 INFO:tasks.workunit.client.1.smithi112.stdout:7/612: creat d7/dd/fba x:0 0 0 2024-04-25T02:09:13.496 INFO:tasks.workunit.client.1.smithi112.stdout:4/685: creat d2/d17/d20/d5e/d87/fde x:0 0 0 2024-04-25T02:09:13.497 INFO:tasks.workunit.client.1.smithi112.stdout:3/612: symlink d12/d13/d34/d4a/lcc 0 2024-04-25T02:09:13.499 INFO:tasks.workunit.client.1.smithi112.stdout:7/613: link d7/d79/da2/f9b d7/dd/d20/fbb 0 2024-04-25T02:09:13.500 INFO:tasks.workunit.client.1.smithi112.stdout:4/686: unlink d2/d1e/d1b/d67/c79 0 2024-04-25T02:09:13.502 INFO:tasks.workunit.client.1.smithi112.stdout:7/614: mkdir d7/d25/d43/dbc 0 2024-04-25T02:09:13.502 INFO:tasks.workunit.client.1.smithi112.stdout:7/615: fdatasync d7/f1e 0 2024-04-25T02:09:13.502 INFO:tasks.workunit.client.1.smithi112.stdout:7/616: chown d7/d25/d43/d46/f68 601422 1 2024-04-25T02:09:13.503 INFO:tasks.workunit.client.1.smithi112.stdout:4/687: symlink d2/d17/d20/d26/d80/ldf 0 2024-04-25T02:09:13.504 INFO:tasks.workunit.client.1.smithi112.stdout:7/617: symlink d7/d79/da2/d3a/lbd 0 2024-04-25T02:09:13.505 INFO:tasks.workunit.client.1.smithi112.stdout:2/473: dwrite d3/da/dc/f2e [0,4194304] 0 2024-04-25T02:09:13.505 INFO:tasks.workunit.client.1.smithi112.stdout:2/474: readlink d3/da/dc/d3e/l44 0 2024-04-25T02:09:13.505 INFO:tasks.workunit.client.1.smithi112.stdout:9/591: dwrite d1/df/f23 [0,4194304] 0 2024-04-25T02:09:13.505 INFO:tasks.workunit.client.1.smithi112.stdout:1/650: dwrite d7/d9/d1e/fb7 [0,4194304] 0 2024-04-25T02:09:13.507 INFO:tasks.workunit.client.1.smithi112.stdout:4/688: truncate d2/d1e/d1b/d83/fb7 1693270 0 2024-04-25T02:09:13.512 INFO:tasks.workunit.client.1.smithi112.stdout:7/618: write d7/d25/d40/d6b/f70 [3297330,6691] 0 2024-04-25T02:09:13.513 INFO:tasks.workunit.client.1.smithi112.stdout:3/613: read d12/d1f/d27/d44/d7e/fa3 [456280,35823] 0 2024-04-25T02:09:13.513 INFO:tasks.workunit.client.1.smithi112.stdout:3/614: getdents d12/d13/d34/d53/d9c 0 2024-04-25T02:09:13.519 INFO:tasks.workunit.client.1.smithi112.stdout:2/475: unlink d3/c39 0 2024-04-25T02:09:13.522 INFO:tasks.workunit.client.1.smithi112.stdout:9/592: dwrite d1/d13/f37 [4194304,4194304] 0 2024-04-25T02:09:13.524 INFO:tasks.workunit.client.1.smithi112.stdout:1/651: mkdir d7/d9/d1e/de/dcf 0 2024-04-25T02:09:13.527 INFO:tasks.workunit.client.1.smithi112.stdout:4/689: link d2/d17/d25/l58 d2/d12/d22/le0 0 2024-04-25T02:09:13.529 INFO:tasks.workunit.client.1.smithi112.stdout:7/619: creat d7/d25/d40/d51/fbe x:0 0 0 2024-04-25T02:09:13.531 INFO:tasks.workunit.client.1.smithi112.stdout:2/476: mkdir d3/da/dc/d20/d43/d7e/da3 0 2024-04-25T02:09:13.531 INFO:tasks.workunit.client.1.smithi112.stdout:2/477: stat d3/da/dc/d3e/df/d32/l52 0 2024-04-25T02:09:13.531 INFO:tasks.workunit.client.1.smithi112.stdout:2/478: stat d3/da/f2c 0 2024-04-25T02:09:13.531 INFO:tasks.workunit.client.1.smithi112.stdout:2/479: write d3/da/f2c [4747821,54306] 0 2024-04-25T02:09:13.532 INFO:tasks.workunit.client.1.smithi112.stdout:3/615: dwrite d12/d13/f1c [0,4194304] 0 2024-04-25T02:09:13.532 INFO:tasks.workunit.client.1.smithi112.stdout:3/616: chown d12/d13/d34/d53/f8d 4855 1 2024-04-25T02:09:13.533 INFO:tasks.workunit.client.1.smithi112.stdout:3/617: write d12/d1f/d27/fc5 [66954,73857] 0 2024-04-25T02:09:13.533 INFO:tasks.workunit.client.1.smithi112.stdout:3/618: fsync d12/d13/d34/d78/d83/f93 0 2024-04-25T02:09:13.545 INFO:tasks.workunit.client.1.smithi112.stdout:1/652: dwrite d7/d4b/fa4 [0,4194304] 0 2024-04-25T02:09:13.546 INFO:tasks.workunit.client.1.smithi112.stdout:1/653: fsync d7/d9/d1e/de/f17 0 2024-04-25T02:09:13.547 INFO:tasks.workunit.client.1.smithi112.stdout:3/619: mknod d12/d13/d34/d78/d91/ccd 0 2024-04-25T02:09:13.548 INFO:tasks.workunit.client.1.smithi112.stdout:8/871: sync 2024-04-25T02:09:13.548 INFO:tasks.workunit.client.1.smithi112.stdout:8/872: chown d15/d40/d88/fdf 875 1 2024-04-25T02:09:13.553 INFO:tasks.workunit.client.1.smithi112.stdout:1/654: creat d7/db0/fd0 x:0 0 0 2024-04-25T02:09:13.554 INFO:tasks.workunit.client.1.smithi112.stdout:3/620: unlink d12/d1f/d27/f46 0 2024-04-25T02:09:13.556 INFO:tasks.workunit.client.1.smithi112.stdout:8/873: link d15/d26/d37/d52/l79 d15/d35/l12b 0 2024-04-25T02:09:13.560 INFO:tasks.workunit.client.1.smithi112.stdout:1/655: link d7/d9/d4e/d28/d32/c71 d7/d9/d4e/cd1 0 2024-04-25T02:09:13.562 INFO:tasks.workunit.client.1.smithi112.stdout:1/656: dread d7/d9/d1e/de/d9a/fba [0,4194304] 0 2024-04-25T02:09:13.562 INFO:tasks.workunit.client.1.smithi112.stdout:1/657: dread - d7/d9/d1f/d25/fbb zero size 2024-04-25T02:09:13.562 INFO:tasks.workunit.client.1.smithi112.stdout:1/658: fsync d7/d9/d4e/f37 0 2024-04-25T02:09:13.566 INFO:tasks.workunit.client.1.smithi112.stdout:3/621: link d12/d1f/d27/d44/d73/d95/da5/db3/fb7 d12/d13/d34/d4a/fce 0 2024-04-25T02:09:13.568 INFO:tasks.workunit.client.1.smithi112.stdout:8/874: creat d15/d26/d37/d52/f12c x:0 0 0 2024-04-25T02:09:13.569 INFO:tasks.workunit.client.1.smithi112.stdout:8/875: read d15/f42 [8762391,61299] 0 2024-04-25T02:09:13.569 INFO:tasks.workunit.client.1.smithi112.stdout:8/876: readlink d15/d26/d37/d8e/l7f 0 2024-04-25T02:09:13.569 INFO:tasks.workunit.client.1.smithi112.stdout:8/877: chown d15/d35/d5c/d91/f45 23429 1 2024-04-25T02:09:13.569 INFO:tasks.workunit.client.1.smithi112.stdout:1/659: dread d7/d9/d46/fa2 [0,4194304] 0 2024-04-25T02:09:13.570 INFO:tasks.workunit.client.1.smithi112.stdout:4/690: rename d2/d12/d22/d60 to d2/d12/de1 0 2024-04-25T02:09:13.570 INFO:tasks.workunit.client.1.smithi112.stdout:4/691: write d2/d17/db2/fd7 [732806,90992] 0 2024-04-25T02:09:13.572 INFO:tasks.workunit.client.1.smithi112.stdout:3/622: mknod d12/ccf 0 2024-04-25T02:09:13.572 INFO:tasks.workunit.client.1.smithi112.stdout:3/623: truncate d12/d13/d86/f99 114310 0 2024-04-25T02:09:13.572 INFO:tasks.workunit.client.1.smithi112.stdout:3/624: write d12/d5d/f90 [461922,59740] 0 2024-04-25T02:09:13.572 INFO:tasks.workunit.client.1.smithi112.stdout:3/625: readlink d12/d13/d34/d78/l8a 0 2024-04-25T02:09:13.572 INFO:tasks.workunit.client.1.smithi112.stdout:3/626: read d12/d13/d34/f9a [80178,49576] 0 2024-04-25T02:09:13.579 INFO:tasks.workunit.client.1.smithi112.stdout:8/878: mknod d15/d26/d37/da8/c12d 0 2024-04-25T02:09:13.579 INFO:tasks.workunit.client.1.smithi112.stdout:8/879: fdatasync d15/d81/dce/fd7 0 2024-04-25T02:09:13.579 INFO:tasks.workunit.client.1.smithi112.stdout:8/880: fsync d15/d26/d4f/d67/fe7 0 2024-04-25T02:09:13.588 INFO:tasks.workunit.client.1.smithi112.stdout:2/480: rename d3/da/dc/d20/d43/d5e/f6d to d3/da/dc/d3e/df/d25/d88/d8e/fa4 0 2024-04-25T02:09:13.590 INFO:tasks.workunit.client.1.smithi112.stdout:3/627: getdents d12/d1f/d27/d44/d73/d95/da5 0 2024-04-25T02:09:13.591 INFO:tasks.workunit.client.1.smithi112.stdout:3/628: write d12/d13/d34/d78/d83/f9e [97659,81191] 0 2024-04-25T02:09:13.591 INFO:tasks.workunit.client.1.smithi112.stdout:3/629: truncate d12/d13/d34/f60 4938249 0 2024-04-25T02:09:13.595 INFO:tasks.workunit.client.1.smithi112.stdout:1/660: getdents d7/d9 0 2024-04-25T02:09:13.595 INFO:tasks.workunit.client.1.smithi112.stdout:2/481: symlink d3/da/dc/d20/d43/la5 0 2024-04-25T02:09:13.597 INFO:tasks.workunit.client.1.smithi112.stdout:4/692: symlink d2/d1e/d1b/d83/le2 0 2024-04-25T02:09:13.598 INFO:tasks.workunit.client.1.smithi112.stdout:3/630: creat d12/d67/dbf/fd0 x:0 0 0 2024-04-25T02:09:13.600 INFO:tasks.workunit.client.1.smithi112.stdout:2/482: rmdir d3/da/dc/d3e/df/d30 39 2024-04-25T02:09:13.600 INFO:tasks.workunit.client.1.smithi112.stdout:2/483: chown d3/da/dc/d3e/df/d25/d9e/l67 70 1 2024-04-25T02:09:13.600 INFO:tasks.workunit.client.1.smithi112.stdout:2/484: chown d3/da/dc/d3e/l44 310605 1 2024-04-25T02:09:13.601 INFO:tasks.workunit.client.1.smithi112.stdout:4/693: creat d2/d17/d20/d5e/d87/fe3 x:0 0 0 2024-04-25T02:09:13.602 INFO:tasks.workunit.client.1.smithi112.stdout:3/631: unlink d12/f14 0 2024-04-25T02:09:13.604 INFO:tasks.workunit.client.1.smithi112.stdout:2/485: creat d3/da/fa6 x:0 0 0 2024-04-25T02:09:13.604 INFO:tasks.workunit.client.1.smithi112.stdout:2/486: truncate d3/f59 1292552 0 2024-04-25T02:09:13.605 INFO:tasks.workunit.client.1.smithi112.stdout:4/694: creat d2/d17/d25/fe4 x:0 0 0 2024-04-25T02:09:13.607 INFO:tasks.workunit.client.1.smithi112.stdout:3/632: truncate d12/f1d 568718 0 2024-04-25T02:09:13.607 INFO:tasks.workunit.client.1.smithi112.stdout:3/633: dread - d12/d13/d86/da0/fb1 zero size 2024-04-25T02:09:13.609 INFO:tasks.workunit.client.1.smithi112.stdout:3/634: getdents d12/d13/d34/d78/d91 0 2024-04-25T02:09:13.614 INFO:tasks.workunit.client.1.smithi112.stdout:4/695: dread d2/d17/d20/d5e/f6c [0,4194304] 0 2024-04-25T02:09:13.616 INFO:tasks.workunit.client.1.smithi112.stdout:4/696: symlink d2/d17/d20/d26/le5 0 2024-04-25T02:09:13.624 INFO:tasks.workunit.client.1.smithi112.stdout:3/635: read d12/d67/f70 [393480,7484] 0 2024-04-25T02:09:13.624 INFO:tasks.workunit.client.1.smithi112.stdout:2/487: dwrite d3/f33 [0,4194304] 0 2024-04-25T02:09:13.625 INFO:tasks.workunit.client.1.smithi112.stdout:2/488: mknod d3/da/dc/ca7 0 2024-04-25T02:09:13.627 INFO:tasks.workunit.client.1.smithi112.stdout:2/489: symlink d3/da/dc/d20/d40/la8 0 2024-04-25T02:09:13.628 INFO:tasks.workunit.client.1.smithi112.stdout:3/636: dread d12/d67/f70 [0,4194304] 0 2024-04-25T02:09:13.628 INFO:tasks.workunit.client.1.smithi112.stdout:3/637: write d12/d5d/fc0 [733212,123021] 0 2024-04-25T02:09:13.630 INFO:tasks.workunit.client.1.smithi112.stdout:3/638: mknod d12/d1f/daa/cd1 0 2024-04-25T02:09:13.633 INFO:tasks.workunit.client.1.smithi112.stdout:3/639: mkdir d12/d13/d86/dd2 0 2024-04-25T02:09:13.636 INFO:tasks.workunit.client.1.smithi112.stdout:4/697: dwrite d2/d1e/d1b/d83/fb7 [0,4194304] 0 2024-04-25T02:09:13.637 INFO:tasks.workunit.client.1.smithi112.stdout:2/490: write d3/da/d18/f2f [3307143,27788] 0 2024-04-25T02:09:13.639 INFO:tasks.workunit.client.1.smithi112.stdout:3/640: mkdir d12/d67/dd3 0 2024-04-25T02:09:13.642 INFO:tasks.workunit.client.1.smithi112.stdout:4/698: truncate d2/d1e/fd9 987992 0 2024-04-25T02:09:13.642 INFO:tasks.workunit.client.1.smithi112.stdout:4/699: read - d2/d1e/d1b/d65/fc9 zero size 2024-04-25T02:09:13.642 INFO:tasks.workunit.client.1.smithi112.stdout:4/700: truncate d2/d17/d20/d26/f9b 882784 0 2024-04-25T02:09:13.645 INFO:tasks.workunit.client.1.smithi112.stdout:2/491: write d3/f33 [2269776,71024] 0 2024-04-25T02:09:13.645 INFO:tasks.workunit.client.1.smithi112.stdout:2/492: truncate d3/da/dc/d20/d43/d74/f97 344271 0 2024-04-25T02:09:13.647 INFO:tasks.workunit.client.1.smithi112.stdout:4/701: mknod d2/d1e/d1b/d67/ce6 0 2024-04-25T02:09:13.650 INFO:tasks.workunit.client.1.smithi112.stdout:4/702: mknod d2/d17/ce7 0 2024-04-25T02:09:13.652 INFO:tasks.workunit.client.1.smithi112.stdout:2/493: dread d3/da/d18/f3f [0,4194304] 0 2024-04-25T02:09:13.653 INFO:tasks.workunit.client.1.smithi112.stdout:4/703: dread d2/d17/d25/f91 [0,4194304] 0 2024-04-25T02:09:13.655 INFO:tasks.workunit.client.1.smithi112.stdout:3/641: link d12/d13/l16 d12/d13/d34/d4a/d87/ld4 0 2024-04-25T02:09:13.658 INFO:tasks.workunit.client.1.smithi112.stdout:2/494: unlink d3/da/dc/d20/d43/c5d 0 2024-04-25T02:09:13.666 INFO:tasks.workunit.client.1.smithi112.stdout:2/495: getdents d3/da/dc/d20/d40 0 2024-04-25T02:09:13.669 INFO:tasks.workunit.client.1.smithi112.stdout:4/704: dwrite d2/d4e/fac [4194304,4194304] 0 2024-04-25T02:09:13.669 INFO:tasks.workunit.client.1.smithi112.stdout:4/705: chown d2/d12/f19 0 1 2024-04-25T02:09:13.669 INFO:tasks.workunit.client.1.smithi112.stdout:4/706: write d2/d1e/fc5 [422657,50232] 0 2024-04-25T02:09:13.671 INFO:tasks.workunit.client.1.smithi112.stdout:4/707: chown d2/d1e/d5c/fbc 6 1 2024-04-25T02:09:13.673 INFO:tasks.workunit.client.1.smithi112.stdout:4/708: dread - d2/d1e/fce zero size 2024-04-25T02:09:13.696 INFO:tasks.workunit.client.1.smithi112.stdout:2/496: dwrite d3/da/dc/d3e/df/d25/d88/d8e/fa4 [0,4194304] 0 2024-04-25T02:09:13.697 INFO:tasks.workunit.client.1.smithi112.stdout:2/497: rename d3/da/dc/d3e/df/d25/c28 to d3/da/dc/d3e/df/d71/ca9 0 2024-04-25T02:09:13.700 INFO:tasks.workunit.client.1.smithi112.stdout:2/498: read d3/f9 [589578,90879] 0 2024-04-25T02:09:13.700 INFO:tasks.workunit.client.1.smithi112.stdout:4/709: dwrite d2/d17/d25/f7b [0,4194304] 0 2024-04-25T02:09:13.705 INFO:tasks.workunit.client.1.smithi112.stdout:4/710: getdents d2/d17/d20/d5e/d87 0 2024-04-25T02:09:13.706 INFO:tasks.workunit.client.1.smithi112.stdout:4/711: write d2/d1e/d42/fdd [119808,8941] 0 2024-04-25T02:09:13.708 INFO:tasks.workunit.client.1.smithi112.stdout:4/712: creat d2/d17/d25/d3f/fe8 x:0 0 0 2024-04-25T02:09:13.708 INFO:tasks.workunit.client.1.smithi112.stdout:4/713: read - d2/d12/de1/fcc zero size 2024-04-25T02:09:13.709 INFO:tasks.workunit.client.1.smithi112.stdout:4/714: symlink d2/d17/d20/le9 0 2024-04-25T02:09:13.722 INFO:tasks.workunit.client.1.smithi112.stdout:2/499: dwrite d3/f9d [0,4194304] 0 2024-04-25T02:09:13.722 INFO:tasks.workunit.client.1.smithi112.stdout:4/715: dread d2/d1e/d1b/d86/f6d [0,4194304] 0 2024-04-25T02:09:13.722 INFO:tasks.workunit.client.1.smithi112.stdout:2/500: truncate d3/da/dc/d3e/df/d32/f90 4372262 0 2024-04-25T02:09:13.722 INFO:tasks.workunit.client.1.smithi112.stdout:2/501: creat d3/da/dc/d3e/df/d30/d7c/faa x:0 0 0 2024-04-25T02:09:13.723 INFO:tasks.workunit.client.1.smithi112.stdout:4/716: rename d2/d17/d20/d26/le5 to d2/d17/d20/d26/d39/lea 0 2024-04-25T02:09:13.724 INFO:tasks.workunit.client.1.smithi112.stdout:2/502: mknod d3/da/dc/d3e/df/d25/cab 0 2024-04-25T02:09:13.725 INFO:tasks.workunit.client.1.smithi112.stdout:4/717: rmdir d2/d17/d20/d5e/daf 39 2024-04-25T02:09:13.726 INFO:tasks.workunit.client.1.smithi112.stdout:4/718: getdents d2/d17/db2 0 2024-04-25T02:09:13.727 INFO:tasks.workunit.client.1.smithi112.stdout:4/719: rename d2/d17/d20/d5e/d87 to d2/d17/d20/deb 0 2024-04-25T02:09:13.728 INFO:tasks.workunit.client.1.smithi112.stdout:2/503: dread d3/da/d18/f3f [0,4194304] 0 2024-04-25T02:09:13.728 INFO:tasks.workunit.client.1.smithi112.stdout:4/720: symlink d2/d1e/d1b/d86/lec 0 2024-04-25T02:09:13.729 INFO:tasks.workunit.client.1.smithi112.stdout:4/721: symlink d2/d1e/d1b/d83/led 0 2024-04-25T02:09:13.729 INFO:tasks.workunit.client.1.smithi112.stdout:4/722: chown d2/d1e/f74 2443 1 2024-04-25T02:09:13.731 INFO:tasks.workunit.client.1.smithi112.stdout:4/723: rename d2/d17/d20/deb/fe3 to d2/d17/d20/d26/d39/fee 0 2024-04-25T02:09:13.732 INFO:tasks.workunit.client.1.smithi112.stdout:4/724: creat d2/d17/d20/deb/fef x:0 0 0 2024-04-25T02:09:13.733 INFO:tasks.workunit.client.1.smithi112.stdout:4/725: symlink d2/d17/db2/lf0 0 2024-04-25T02:09:13.733 INFO:tasks.workunit.client.1.smithi112.stdout:4/726: getdents d2/d17 0 2024-04-25T02:09:13.733 INFO:tasks.workunit.client.1.smithi112.stdout:4/727: write d2/d1e/d5c/fd6 [152255,55691] 0 2024-04-25T02:09:13.735 INFO:tasks.workunit.client.1.smithi112.stdout:4/728: write d2/d17/d20/fa2 [186676,3232] 0 2024-04-25T02:09:13.735 INFO:tasks.workunit.client.1.smithi112.stdout:4/729: fdatasync d2/d1e/d5c/f76 0 2024-04-25T02:09:13.735 INFO:tasks.workunit.client.1.smithi112.stdout:4/730: truncate d2/d1e/d5c/fbc 894154 0 2024-04-25T02:09:13.736 INFO:tasks.workunit.client.1.smithi112.stdout:4/731: creat d2/d12/d22/ff1 x:0 0 0 2024-04-25T02:09:13.761 INFO:tasks.workunit.client.1.smithi112.stdout:4/732: rmdir d2/d17/d20/deb 39 2024-04-25T02:09:13.761 INFO:tasks.workunit.client.1.smithi112.stdout:4/733: truncate d2/d17/db2/fd7 926839 0 2024-04-25T02:09:13.762 INFO:tasks.workunit.client.1.smithi112.stdout:2/504: dwrite d3/da/f2c [4194304,4194304] 0 2024-04-25T02:09:13.765 INFO:tasks.workunit.client.1.smithi112.stdout:2/505: mkdir d3/da/dac 0 2024-04-25T02:09:13.765 INFO:tasks.workunit.client.1.smithi112.stdout:2/506: chown d3/da/dc/d20/d40/l63 220 1 2024-04-25T02:09:13.765 INFO:tasks.workunit.client.1.smithi112.stdout:2/507: read - d3/da/fa6 zero size 2024-04-25T02:09:13.767 INFO:tasks.workunit.client.1.smithi112.stdout:4/734: dread d2/d17/d20/d5e/f6c [0,4194304] 0 2024-04-25T02:09:13.767 INFO:tasks.workunit.client.1.smithi112.stdout:2/508: truncate d3/f33 23723 0 2024-04-25T02:09:13.768 INFO:tasks.workunit.client.1.smithi112.stdout:2/509: fdatasync d3/da/dc/d20/d43/d5e/fa1 0 2024-04-25T02:09:13.773 INFO:tasks.workunit.client.1.smithi112.stdout:4/735: mknod d2/d17/d20/d5e/cf2 0 2024-04-25T02:09:13.801 INFO:tasks.workunit.client.1.smithi112.stdout:2/510: dwrite d3/f73 [0,4194304] 0 2024-04-25T02:09:13.801 INFO:tasks.workunit.client.1.smithi112.stdout:2/511: chown d3/f73 0 1 2024-04-25T02:09:13.801 INFO:tasks.workunit.client.1.smithi112.stdout:4/736: dwrite d2/d17/d20/fa2 [0,4194304] 0 2024-04-25T02:09:13.801 INFO:tasks.workunit.client.1.smithi112.stdout:4/737: truncate d2/d17/d25/f7b 4666795 0 2024-04-25T02:09:13.801 INFO:tasks.workunit.client.1.smithi112.stdout:4/738: write d2/f27 [4878735,39582] 0 2024-04-25T02:09:13.801 INFO:tasks.workunit.client.1.smithi112.stdout:4/739: readlink d2/d1e/d1b/d83/le2 0 2024-04-25T02:09:13.801 INFO:tasks.workunit.client.1.smithi112.stdout:4/740: truncate d2/d17/d20/d26/d39/fee 812947 0 2024-04-25T02:09:13.802 INFO:tasks.workunit.client.1.smithi112.stdout:2/512: unlink d3/f33 0 2024-04-25T02:09:13.803 INFO:tasks.workunit.client.1.smithi112.stdout:2/513: dread d3/da/dc/d20/d43/d74/f97 [0,4194304] 0 2024-04-25T02:09:13.806 INFO:tasks.workunit.client.1.smithi112.stdout:4/741: creat d2/d1e/d1b/d67/ff3 x:0 0 0 2024-04-25T02:09:13.812 INFO:tasks.workunit.client.1.smithi112.stdout:2/514: write d3/f9d [2137516,80411] 0 2024-04-25T02:09:13.812 INFO:tasks.workunit.client.1.smithi112.stdout:2/515: chown d3/da/dc/d3e/df/d25/d88 98490 1 2024-04-25T02:09:13.813 INFO:tasks.workunit.client.1.smithi112.stdout:2/516: symlink d3/da/dc/d3e/df/d30/lad 0 2024-04-25T02:09:13.814 INFO:tasks.workunit.client.1.smithi112.stdout:4/742: dread d2/d17/d20/d5e/f34 [0,4194304] 0 2024-04-25T02:09:13.814 INFO:tasks.workunit.client.1.smithi112.stdout:4/743: readlink d2/d17/l24 0 2024-04-25T02:09:13.816 INFO:tasks.workunit.client.1.smithi112.stdout:4/744: link d2/d17/d20/d5e/c5a d2/d1e/d1b/d83/cf4 0 2024-04-25T02:09:13.817 INFO:tasks.workunit.client.1.smithi112.stdout:4/745: read d2/f27 [171148,105559] 0 2024-04-25T02:09:13.817 INFO:tasks.workunit.client.1.smithi112.stdout:2/517: dread d3/da/dc/d20/d40/f79 [0,4194304] 0 2024-04-25T02:09:13.817 INFO:tasks.workunit.client.1.smithi112.stdout:2/518: write d3/da/dc/f93 [791884,31212] 0 2024-04-25T02:09:13.818 INFO:tasks.workunit.client.1.smithi112.stdout:2/519: creat d3/da/dc/d20/d43/d7e/da3/fae x:0 0 0 2024-04-25T02:09:13.818 INFO:tasks.workunit.client.1.smithi112.stdout:2/520: read - d3/da/dc/d3e/df/d25/d9e/f7f zero size 2024-04-25T02:09:13.820 INFO:tasks.workunit.client.1.smithi112.stdout:2/521: unlink d3/da/dc/d20/f82 0 2024-04-25T02:09:13.820 INFO:tasks.workunit.client.1.smithi112.stdout:2/522: creat d3/da/dc/d20/d43/faf x:0 0 0 2024-04-25T02:09:13.837 INFO:tasks.workunit.client.1.smithi112.stdout:2/523: dwrite d3/da/dc/d3e/df/d25/f37 [0,4194304] 0 2024-04-25T02:09:13.838 INFO:tasks.workunit.client.1.smithi112.stdout:2/524: truncate d3/da/dc/d20/d43/d74/f80 786927 0 2024-04-25T02:09:13.840 INFO:tasks.workunit.client.1.smithi112.stdout:2/525: mknod d3/da/dc/d3e/df/d25/cb0 0 2024-04-25T02:09:13.841 INFO:tasks.workunit.client.1.smithi112.stdout:2/526: mknod d3/da/dc/d20/d40/cb1 0 2024-04-25T02:09:13.843 INFO:tasks.workunit.client.1.smithi112.stdout:2/527: creat d3/da/dc/d3e/df/d25/d88/d8e/fb2 x:0 0 0 2024-04-25T02:09:13.844 INFO:tasks.workunit.client.1.smithi112.stdout:2/528: symlink d3/da/dc/d20/lb3 0 2024-04-25T02:09:13.845 INFO:tasks.workunit.client.1.smithi112.stdout:2/529: link d3/da/dc/d20/l61 d3/da/dc/d3e/df/d25/d9e/lb4 0 2024-04-25T02:09:13.850 INFO:tasks.workunit.client.1.smithi112.stdout:2/530: dread d3/da/dc/d3e/df/d25/f5f [0,4194304] 0 2024-04-25T02:09:13.852 INFO:tasks.workunit.client.1.smithi112.stdout:2/531: creat d3/da/dc/d3e/df/fb5 x:0 0 0 2024-04-25T02:09:13.854 INFO:tasks.workunit.client.1.smithi112.stdout:2/532: rename d3/da/d18/f3f to d3/da/dc/d3e/df/d25/d9e/d81/fb6 0 2024-04-25T02:09:13.854 INFO:tasks.workunit.client.1.smithi112.stdout:2/533: chown d3/da/dc/d3e/df/d30/d7c 0 1 2024-04-25T02:09:13.861 INFO:tasks.workunit.client.1.smithi112.stdout:2/534: write d3/da/dc/d20/d40/f6e [927024,75049] 0 2024-04-25T02:09:13.861 INFO:tasks.workunit.client.1.smithi112.stdout:2/535: readlink d3/da/dc/d20/d40/la8 0 2024-04-25T02:09:13.861 INFO:tasks.workunit.client.1.smithi112.stdout:2/536: mknod d3/da/dc/d3e/df/d25/d9e/d81/d9f/cb7 0 2024-04-25T02:09:13.864 INFO:tasks.workunit.client.1.smithi112.stdout:2/537: link d3/da/f15 d3/da/dc/d3e/df/d30/d7c/d96/fb8 0 2024-04-25T02:09:13.864 INFO:tasks.workunit.client.1.smithi112.stdout:2/538: readlink d3/l83 0 2024-04-25T02:09:13.865 INFO:tasks.workunit.client.1.smithi112.stdout:2/539: unlink d3/da/dc/d3e/df/l6b 0 2024-04-25T02:09:13.866 INFO:tasks.workunit.client.1.smithi112.stdout:2/540: readlink d3/da/dc/d3e/l4f 0 2024-04-25T02:09:13.866 INFO:tasks.workunit.client.1.smithi112.stdout:2/541: chown d3/da/dc/d3e/df/d30 107 1 2024-04-25T02:09:13.866 INFO:tasks.workunit.client.1.smithi112.stdout:2/542: write d3/da/dc/d20/f21 [3675400,115586] 0 2024-04-25T02:09:13.867 INFO:tasks.workunit.client.1.smithi112.stdout:2/543: creat d3/da/dc/fb9 x:0 0 0 2024-04-25T02:09:13.868 INFO:tasks.workunit.client.1.smithi112.stdout:2/544: mkdir d3/da/dc/d20/d85/dba 0 2024-04-25T02:09:13.868 INFO:tasks.workunit.client.1.smithi112.stdout:2/545: fdatasync d3/da/dc/d3e/df/d25/f37 0 2024-04-25T02:09:13.869 INFO:tasks.workunit.client.1.smithi112.stdout:2/546: mknod d3/da/dc/d3e/cbb 0 2024-04-25T02:09:13.875 INFO:tasks.workunit.client.1.smithi112.stdout:2/547: read d3/da/dc/f2e [3112773,125919] 0 2024-04-25T02:09:13.877 INFO:tasks.workunit.client.1.smithi112.stdout:2/548: mknod d3/da/cbc 0 2024-04-25T02:09:13.877 INFO:tasks.workunit.client.1.smithi112.stdout:2/549: dread - d3/da/dc/d20/d43/faf zero size 2024-04-25T02:09:13.895 INFO:tasks.workunit.client.1.smithi112.stdout:2/550: dwrite d3/da/dc/d20/d43/d7e/da3/fae [0,4194304] 0 2024-04-25T02:09:13.895 INFO:tasks.workunit.client.1.smithi112.stdout:2/551: write d3/da/dc/d3e/df/fb5 [867884,121597] 0 2024-04-25T02:09:13.897 INFO:tasks.workunit.client.1.smithi112.stdout:2/552: dread d3/da/dc/d3e/f3c [0,4194304] 0 2024-04-25T02:09:13.897 INFO:tasks.workunit.client.1.smithi112.stdout:2/553: stat d3/da/dc/d3e/df/c8c 0 2024-04-25T02:09:13.899 INFO:tasks.workunit.client.1.smithi112.stdout:2/554: symlink d3/da/dc/d3e/df/d30/d7c/lbd 0 2024-04-25T02:09:13.899 INFO:tasks.workunit.client.1.smithi112.stdout:2/555: chown d3/da/d18/f58 5 1 2024-04-25T02:09:13.900 INFO:tasks.workunit.client.1.smithi112.stdout:2/556: rmdir d3/da/dc/d3e/df/d25/d88 39 2024-04-25T02:09:13.902 INFO:tasks.workunit.client.1.smithi112.stdout:2/557: symlink d3/da/dc/d20/d43/d7e/da3/lbe 0 2024-04-25T02:09:13.927 INFO:tasks.workunit.client.1.smithi112.stdout:2/558: write d3/f59 [1348087,23237] 0 2024-04-25T02:09:13.927 INFO:tasks.workunit.client.1.smithi112.stdout:2/559: dread - d3/da/d18/f31 zero size 2024-04-25T02:09:13.943 INFO:tasks.workunit.client.1.smithi112.stdout:2/560: rename d3/da/d18 to d3/da/dac/dbf 0 2024-04-25T02:09:13.943 INFO:tasks.workunit.client.1.smithi112.stdout:2/561: write d3/da/dc/d3e/df/d32/f90 [4571338,78694] 0 2024-04-25T02:09:13.946 INFO:tasks.workunit.client.1.smithi112.stdout:2/562: getdents d3/da/dc/d3e/df/d25/d9e/d81/d9f 0 2024-04-25T02:09:13.947 INFO:tasks.workunit.client.1.smithi112.stdout:0/762: sync 2024-04-25T02:09:13.949 INFO:tasks.workunit.client.1.smithi112.stdout:2/563: rename d3/da/dc/d20/d43/d5e/fa1 to d3/da/dc/d3e/df/d71/fc0 0 2024-04-25T02:09:13.951 INFO:tasks.workunit.client.1.smithi112.stdout:0/763: symlink da/d1d/dcb/lf4 0 2024-04-25T02:09:13.952 INFO:tasks.workunit.client.1.smithi112.stdout:2/564: symlink d3/da/dc/d3e/df/d30/lc1 0 2024-04-25T02:09:13.956 INFO:tasks.workunit.client.1.smithi112.stdout:0/764: symlink da/d13/lf5 0 2024-04-25T02:09:13.956 INFO:tasks.workunit.client.1.smithi112.stdout:0/765: fdatasync da/d1d/d2e/d40/f41 0 2024-04-25T02:09:13.962 INFO:tasks.workunit.client.1.smithi112.stdout:0/766: getdents da/d13/d23/d77 0 2024-04-25T02:09:13.962 INFO:tasks.workunit.client.1.smithi112.stdout:0/767: fdatasync da/d1d/d2e/d40/f41 0 2024-04-25T02:09:13.968 INFO:tasks.workunit.client.1.smithi112.stdout:2/565: dwrite d3/da/dc/d3e/f3c [0,4194304] 0 2024-04-25T02:09:13.975 INFO:tasks.workunit.client.1.smithi112.stdout:2/566: mkdir d3/da/dc/d3e/df/d30/dc2 0 2024-04-25T02:09:13.975 INFO:tasks.workunit.client.1.smithi112.stdout:0/768: write da/f46 [1996860,68817] 0 2024-04-25T02:09:13.979 INFO:tasks.workunit.client.1.smithi112.stdout:0/769: symlink da/d13/d23/lf6 0 2024-04-25T02:09:13.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:13 smithi077 ceph-mon[26330]: pgmap v266: 65 pgs: 65 active+clean; 2.5 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 141 MiB/s rd, 186 MiB/s wr, 349 op/s 2024-04-25T02:09:13.983 INFO:tasks.workunit.client.1.smithi112.stdout:0/770: symlink da/d13/d45/lf7 0 2024-04-25T02:09:13.983 INFO:tasks.workunit.client.1.smithi112.stdout:0/771: readlink da/d1d/d88/l36 0 2024-04-25T02:09:13.983 INFO:tasks.workunit.client.1.smithi112.stdout:0/772: rmdir da/d13/d45/d5e 39 2024-04-25T02:09:13.983 INFO:tasks.workunit.client.1.smithi112.stdout:0/773: chown da/d1d/d2e/lba 226755009 1 2024-04-25T02:09:13.983 INFO:tasks.workunit.client.1.smithi112.stdout:2/567: dread d3/da/dc/d20/f76 [0,4194304] 0 2024-04-25T02:09:13.983 INFO:tasks.workunit.client.1.smithi112.stdout:0/774: symlink da/d13/d45/d5e/db4/lf8 0 2024-04-25T02:09:13.984 INFO:tasks.workunit.client.1.smithi112.stdout:2/568: unlink d3/da/dc/d20/d43/d5e/fa2 0 2024-04-25T02:09:13.984 INFO:tasks.workunit.client.1.smithi112.stdout:2/569: truncate d3/da/dc/d3e/df/d30/d7c/faa 572936 0 2024-04-25T02:09:13.984 INFO:tasks.workunit.client.1.smithi112.stdout:2/570: write d3/f9d [3788234,53282] 0 2024-04-25T02:09:13.985 INFO:tasks.workunit.client.1.smithi112.stdout:0/775: mknod da/d1d/d2e/cf9 0 2024-04-25T02:09:13.985 INFO:tasks.workunit.client.1.smithi112.stdout:0/776: truncate da/d13/fcf 499709 0 2024-04-25T02:09:13.988 INFO:tasks.workunit.client.1.smithi112.stdout:0/777: rename da/d1d/d2e/d40/d49/d4f/l70 to da/d1d/d2e/d40/d49/d4f/d58/d6d/dd4/lfa 0 2024-04-25T02:09:13.990 INFO:tasks.workunit.client.1.smithi112.stdout:0/778: mknod da/d13/d1e/de0/deb/cfb 0 2024-04-25T02:09:13.996 INFO:tasks.workunit.client.1.smithi112.stdout:2/571: dwrite d3/da/dc/d20/d40/f79 [0,4194304] 0 2024-04-25T02:09:14.006 INFO:tasks.workunit.client.1.smithi112.stdout:2/572: dread d3/da/f2c [4194304,4194304] 0 2024-04-25T02:09:14.011 INFO:tasks.workunit.client.1.smithi112.stdout:0/779: dwrite da/d1d/d2e/d40/d49/d6b/d90/fac [0,4194304] 0 2024-04-25T02:09:14.011 INFO:tasks.workunit.client.1.smithi112.stdout:0/780: chown da/d1d/dcb/fd1 15550 1 2024-04-25T02:09:14.020 INFO:tasks.workunit.client.1.smithi112.stdout:0/781: dread da/d1d/d2e/d40/d49/d6b/f85 [0,4194304] 0 2024-04-25T02:09:14.023 INFO:tasks.workunit.client.1.smithi112.stdout:2/573: dwrite d3/da/dc/d3e/df/d71/fc0 [0,4194304] 0 2024-04-25T02:09:14.023 INFO:tasks.workunit.client.1.smithi112.stdout:0/782: rename da/d1d/d2e/d40/cc2 to da/d1d/d88/d78/de7/cfc 0 2024-04-25T02:09:14.023 INFO:tasks.workunit.client.1.smithi112.stdout:0/783: fsync da/d1d/d2e/d40/d49/d6b/fae 0 2024-04-25T02:09:14.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:13 smithi112 ceph-mon[33313]: pgmap v266: 65 pgs: 65 active+clean; 2.5 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 141 MiB/s rd, 186 MiB/s wr, 349 op/s 2024-04-25T02:09:14.034 INFO:tasks.workunit.client.1.smithi112.stdout:2/574: rename d3/da/dc/d3e/df/d32/c51 to d3/da/dc/d20/d85/dba/cc3 0 2024-04-25T02:09:14.036 INFO:tasks.workunit.client.1.smithi112.stdout:0/784: mkdir da/d13/d1e/db1/dfd 0 2024-04-25T02:09:14.041 INFO:tasks.workunit.client.1.smithi112.stdout:2/575: creat d3/da/dc/d3e/fc4 x:0 0 0 2024-04-25T02:09:14.042 INFO:tasks.workunit.client.1.smithi112.stdout:0/785: rename da/d13/d45/d5e/d7a/f99 to da/d1d/d88/d24/d97/ffe 0 2024-04-25T02:09:14.045 INFO:tasks.workunit.client.1.smithi112.stdout:2/576: mkdir d3/da/dc/d3e/df/d71/dc5 0 2024-04-25T02:09:14.045 INFO:tasks.workunit.client.1.smithi112.stdout:2/577: stat d3/da/dc/d20/d43 0 2024-04-25T02:09:14.045 INFO:tasks.workunit.client.1.smithi112.stdout:2/578: truncate d3/da/f2c 9201654 0 2024-04-25T02:09:14.045 INFO:tasks.workunit.client.1.smithi112.stdout:2/579: fsync d3/f9 0 2024-04-25T02:09:14.045 INFO:tasks.workunit.client.1.smithi112.stdout:2/580: chown d3/da/dc/d3e/df/d32/l4a 2 1 2024-04-25T02:09:14.046 INFO:tasks.workunit.client.1.smithi112.stdout:0/786: mknod da/d13/cff 0 2024-04-25T02:09:14.046 INFO:tasks.workunit.client.1.smithi112.stdout:0/787: write da/d1d/dcb/ff1 [2347011,15873] 0 2024-04-25T02:09:14.047 INFO:tasks.workunit.client.1.smithi112.stdout:2/581: creat d3/da/dc/d3e/df/d30/fc6 x:0 0 0 2024-04-25T02:09:14.048 INFO:tasks.workunit.client.1.smithi112.stdout:0/788: rename da/d1d/dcb/cd9 to da/d13/d23/dee/c100 0 2024-04-25T02:09:14.050 INFO:tasks.workunit.client.1.smithi112.stdout:2/582: rename d3/da/dac/dbf/f2f to d3/da/dc/d20/fc7 0 2024-04-25T02:09:14.051 INFO:tasks.workunit.client.1.smithi112.stdout:0/789: getdents da/d13/d45 0 2024-04-25T02:09:14.054 INFO:tasks.workunit.client.1.smithi112.stdout:6/553: sync 2024-04-25T02:09:14.055 INFO:tasks.workunit.client.1.smithi112.stdout:0/790: rename da/d1d/d2e/d40/c54 to da/d13/d45/d5e/db4/ddc/c101 0 2024-04-25T02:09:14.055 INFO:tasks.workunit.client.1.smithi112.stdout:0/791: readlink da/d1d/d88/d80/l91 0 2024-04-25T02:09:14.058 INFO:tasks.workunit.client.1.smithi112.stdout:6/554: rename d0/d2/d4/c35 to d0/d2/d79/cc1 0 2024-04-25T02:09:14.059 INFO:tasks.workunit.client.1.smithi112.stdout:2/583: write d3/da/f15 [3223567,102709] 0 2024-04-25T02:09:14.059 INFO:tasks.workunit.client.1.smithi112.stdout:2/584: chown d3/da/dc/d20/d40/f5b 71 1 2024-04-25T02:09:14.062 INFO:tasks.workunit.client.1.smithi112.stdout:0/792: rename da/d13/d45/f74 to da/d13/d23/dee/f102 0 2024-04-25T02:09:14.063 INFO:tasks.workunit.client.1.smithi112.stdout:0/793: dread da/d13/fcf [0,4194304] 0 2024-04-25T02:09:14.063 INFO:tasks.workunit.client.1.smithi112.stdout:0/794: fsync da/d13/d23/d77/fc0 0 2024-04-25T02:09:14.065 INFO:tasks.workunit.client.1.smithi112.stdout:6/555: rename d0/d32/d45/f51 to d0/d2/d4/dd/db7/fc2 0 2024-04-25T02:09:14.069 INFO:tasks.workunit.client.1.smithi112.stdout:2/585: rename d3/da/dc/d3e/df/d32/l52 to d3/da/lc8 0 2024-04-25T02:09:14.069 INFO:tasks.workunit.client.1.smithi112.stdout:2/586: write d3/da/dc/f7a [358699,45387] 0 2024-04-25T02:09:14.069 INFO:tasks.workunit.client.1.smithi112.stdout:2/587: truncate d3/da/dc/d20/d43/d5e/f92 4594189 0 2024-04-25T02:09:14.069 INFO:tasks.workunit.client.1.smithi112.stdout:2/588: chown d3/da/dc/d20/f21 2 1 2024-04-25T02:09:14.071 INFO:tasks.workunit.client.1.smithi112.stdout:6/556: mknod d0/cc3 0 2024-04-25T02:09:14.073 INFO:tasks.workunit.client.1.smithi112.stdout:0/795: rename da/d1d/d2e/d40/d49/d5f/l7d to da/d1d/d2e/d40/d49/d4f/d58/d6d/l103 0 2024-04-25T02:09:14.073 INFO:tasks.workunit.client.1.smithi112.stdout:0/796: write da/d13/d1e/fa4 [865524,81950] 0 2024-04-25T02:09:14.073 INFO:tasks.workunit.client.1.smithi112.stdout:0/797: dread - da/d13/d45/f8f zero size 2024-04-25T02:09:14.074 INFO:tasks.workunit.client.1.smithi112.stdout:6/557: mknod d0/d2/d66/da8/cc4 0 2024-04-25T02:09:14.075 INFO:tasks.workunit.client.1.smithi112.stdout:2/589: rename d3/da/dc/d3e/df/d32/l4b to d3/da/dc/d20/d43/lc9 0 2024-04-25T02:09:14.078 INFO:tasks.workunit.client.1.smithi112.stdout:6/558: rmdir d0/d32 39 2024-04-25T02:09:14.081 INFO:tasks.workunit.client.1.smithi112.stdout:6/559: mkdir d0/d32/d45/dc5 0 2024-04-25T02:09:14.083 INFO:tasks.workunit.client.1.smithi112.stdout:6/560: mkdir d0/d2/d66/d7d/dc6 0 2024-04-25T02:09:14.084 INFO:tasks.workunit.client.1.smithi112.stdout:6/561: symlink d0/d2/d4/d28/lc7 0 2024-04-25T02:09:14.086 INFO:tasks.workunit.client.1.smithi112.stdout:6/562: creat d0/d2/d66/da8/fc8 x:0 0 0 2024-04-25T02:09:14.095 INFO:tasks.workunit.client.1.smithi112.stdout:6/563: write d0/d2/d3b/d53/f72 [1649218,59707] 0 2024-04-25T02:09:14.096 INFO:tasks.workunit.client.1.smithi112.stdout:2/590: dwrite d3/da/dac/dbf/f31 [0,4194304] 0 2024-04-25T02:09:14.097 INFO:tasks.workunit.client.1.smithi112.stdout:0/798: dwrite da/d1d/d88/d78/f9d [4194304,4194304] 0 2024-04-25T02:09:14.097 INFO:tasks.workunit.client.1.smithi112.stdout:0/799: write da/d1d/d2e/d40/d49/d6b/fae [185886,52291] 0 2024-04-25T02:09:14.098 INFO:tasks.workunit.client.1.smithi112.stdout:0/800: write da/d13/fcf [372985,41539] 0 2024-04-25T02:09:14.098 INFO:tasks.workunit.client.1.smithi112.stdout:0/801: truncate da/d1d/d2e/d40/d49/f98 1137678 0 2024-04-25T02:09:14.098 INFO:tasks.workunit.client.1.smithi112.stdout:0/802: chown da/d13/d1e/f3c 61616 1 2024-04-25T02:09:14.098 INFO:tasks.workunit.client.1.smithi112.stdout:0/803: stat da/d13/d1e/l59 0 2024-04-25T02:09:14.099 INFO:tasks.workunit.client.1.smithi112.stdout:3/642: sync 2024-04-25T02:09:14.099 INFO:tasks.workunit.client.1.smithi112.stdout:7/620: sync 2024-04-25T02:09:14.099 INFO:tasks.workunit.client.1.smithi112.stdout:8/881: sync 2024-04-25T02:09:14.099 INFO:tasks.workunit.client.1.smithi112.stdout:5/523: sync 2024-04-25T02:09:14.099 INFO:tasks.workunit.client.1.smithi112.stdout:1/661: sync 2024-04-25T02:09:14.099 INFO:tasks.workunit.client.1.smithi112.stdout:9/593: sync 2024-04-25T02:09:14.099 INFO:tasks.workunit.client.1.smithi112.stdout:1/662: chown d7/d9/d1e/de/d84 44093 1 2024-04-25T02:09:14.099 INFO:tasks.workunit.client.1.smithi112.stdout:4/746: sync 2024-04-25T02:09:14.099 INFO:tasks.workunit.client.1.smithi112.stdout:6/564: unlink d0/d32/d45/l9a 0 2024-04-25T02:09:14.100 INFO:tasks.workunit.client.1.smithi112.stdout:6/565: read d0/d7b/f90 [3916953,8516] 0 2024-04-25T02:09:14.104 INFO:tasks.workunit.client.1.smithi112.stdout:2/591: dread d3/da/dc/d3e/df/d25/f46 [0,4194304] 0 2024-04-25T02:09:14.105 INFO:tasks.workunit.client.1.smithi112.stdout:0/804: rename da/d1d/d88/d24/f48 to da/d1d/d2e/d40/d49/d4f/d82/f104 0 2024-04-25T02:09:14.109 INFO:tasks.workunit.client.1.smithi112.stdout:7/621: getdents d7/dd/d20/db2 0 2024-04-25T02:09:14.109 INFO:tasks.workunit.client.1.smithi112.stdout:7/622: readlink d7/dd/d20/d2c/l2f 0 2024-04-25T02:09:14.109 INFO:tasks.workunit.client.1.smithi112.stdout:7/623: write d7/d25/d40/f80 [461202,18560] 0 2024-04-25T02:09:14.111 INFO:tasks.workunit.client.1.smithi112.stdout:3/643: mkdir d12/d13/d34/d78/d83/dd5 0 2024-04-25T02:09:14.111 INFO:tasks.workunit.client.1.smithi112.stdout:0/805: dread da/fb [0,4194304] 0 2024-04-25T02:09:14.112 INFO:tasks.workunit.client.1.smithi112.stdout:0/806: fdatasync da/d1d/d2e/d40/d49/d4f/d82/fa0 0 2024-04-25T02:09:14.112 INFO:tasks.workunit.client.1.smithi112.stdout:0/807: chown da/f10 100 1 2024-04-25T02:09:14.115 INFO:tasks.workunit.client.1.smithi112.stdout:8/882: symlink d15/d35/d5c/d91/d78/l12e 0 2024-04-25T02:09:14.118 INFO:tasks.workunit.client.1.smithi112.stdout:5/524: getdents d1/d16/d51 0 2024-04-25T02:09:14.120 INFO:tasks.workunit.client.1.smithi112.stdout:1/663: mkdir d7/d9/d1e/d66/dc6/dd2 0 2024-04-25T02:09:14.120 INFO:tasks.workunit.client.1.smithi112.stdout:1/664: readlink d7/d9/l8e 0 2024-04-25T02:09:14.120 INFO:tasks.workunit.client.1.smithi112.stdout:6/566: dwrite d0/d2/d79/d81/f9b [4194304,4194304] 0 2024-04-25T02:09:14.123 INFO:tasks.workunit.client.1.smithi112.stdout:4/747: mknod d2/d17/d20/d26/cf5 0 2024-04-25T02:09:14.125 INFO:tasks.workunit.client.1.smithi112.stdout:2/592: creat d3/fca x:0 0 0 2024-04-25T02:09:14.127 INFO:tasks.workunit.client.1.smithi112.stdout:9/594: rename d1/f7a to d1/d13/d41/d84/fcc 0 2024-04-25T02:09:14.130 INFO:tasks.workunit.client.1.smithi112.stdout:7/624: symlink d7/dd/d20/lbf 0 2024-04-25T02:09:14.130 INFO:tasks.workunit.client.1.smithi112.stdout:7/625: dread - d7/d25/d43/d46/f68 zero size 2024-04-25T02:09:14.133 INFO:tasks.workunit.client.1.smithi112.stdout:3/644: dread d12/d13/d86/f99 [0,4194304] 0 2024-04-25T02:09:14.133 INFO:tasks.workunit.client.1.smithi112.stdout:0/808: mknod da/d13/d1e/db1/c105 0 2024-04-25T02:09:14.133 INFO:tasks.workunit.client.1.smithi112.stdout:0/809: chown da/d1d/d88/d78/la7 0 1 2024-04-25T02:09:14.133 INFO:tasks.workunit.client.1.smithi112.stdout:0/810: creat da/d1d/d2e/d40/d49/d4f/d82/f106 x:0 0 0 2024-04-25T02:09:14.134 INFO:tasks.workunit.client.1.smithi112.stdout:5/525: dwrite d1/d3f/d9c/fa1 [0,4194304] 0 2024-04-25T02:09:14.135 INFO:tasks.workunit.client.1.smithi112.stdout:8/883: mkdir d15/d17/d12f 0 2024-04-25T02:09:14.138 INFO:tasks.workunit.client.1.smithi112.stdout:0/811: dread da/d1d/d88/d24/f2a [0,4194304] 0 2024-04-25T02:09:14.138 INFO:tasks.workunit.client.1.smithi112.stdout:0/812: chown da/d1d/d2e/d40/d49/d6b/d90/fac 23832621 1 2024-04-25T02:09:14.141 INFO:tasks.workunit.client.1.smithi112.stdout:0/813: dread da/d1d/d2e/d40/d49/d6b/d90/fac [0,4194304] 0 2024-04-25T02:09:14.141 INFO:tasks.workunit.client.1.smithi112.stdout:6/567: rmdir d0/d2/d4/dd/db7 39 2024-04-25T02:09:14.145 INFO:tasks.workunit.client.1.smithi112.stdout:4/748: creat d2/d1e/db3/ff6 x:0 0 0 2024-04-25T02:09:14.145 INFO:tasks.workunit.client.1.smithi112.stdout:4/749: dread - d2/d17/d20/d5e/daf/fcb zero size 2024-04-25T02:09:14.145 INFO:tasks.workunit.client.1.smithi112.stdout:4/750: write d2/d17/d25/d3f/fa4 [3625915,39380] 0 2024-04-25T02:09:14.145 INFO:tasks.workunit.client.1.smithi112.stdout:6/568: dread d0/d36/f5a [0,4194304] 0 2024-04-25T02:09:14.145 INFO:tasks.workunit.client.1.smithi112.stdout:6/569: read - d0/d2/d1f/fb4 zero size 2024-04-25T02:09:14.145 INFO:tasks.workunit.client.1.smithi112.stdout:6/570: write d0/f17 [4353566,56995] 0 2024-04-25T02:09:14.145 INFO:tasks.workunit.client.1.smithi112.stdout:6/571: stat d0/d61 0 2024-04-25T02:09:14.145 INFO:tasks.workunit.client.1.smithi112.stdout:6/572: chown d0/l22 66014595 1 2024-04-25T02:09:14.145 INFO:tasks.workunit.client.1.smithi112.stdout:6/573: creat d0/d2/d1f/fc9 x:0 0 0 2024-04-25T02:09:14.146 INFO:tasks.workunit.client.1.smithi112.stdout:2/593: truncate d3/da/dc/d20/f76 903429 0 2024-04-25T02:09:14.152 INFO:tasks.workunit.client.1.smithi112.stdout:7/626: creat d7/fc0 x:0 0 0 2024-04-25T02:09:14.155 INFO:tasks.workunit.client.1.smithi112.stdout:9/595: dread d1/fa [0,4194304] 0 2024-04-25T02:09:14.165 INFO:tasks.workunit.client.1.smithi112.stdout:6/574: dwrite d0/d7b/fb9 [0,4194304] 0 2024-04-25T02:09:14.165 INFO:tasks.workunit.client.1.smithi112.stdout:6/575: write d0/d2/d4/d28/fa2 [1067039,46377] 0 2024-04-25T02:09:14.165 INFO:tasks.workunit.client.1.smithi112.stdout:6/576: fdatasync d0/d2/d2c/d41/d77/f7c 0 2024-04-25T02:09:14.166 INFO:tasks.workunit.client.1.smithi112.stdout:5/526: symlink d1/d41/d5b/lb5 0 2024-04-25T02:09:14.170 INFO:tasks.workunit.client.1.smithi112.stdout:8/884: mkdir d15/d17/d130 0 2024-04-25T02:09:14.170 INFO:tasks.workunit.client.1.smithi112.stdout:8/885: chown d15/d35/l12b 10053 1 2024-04-25T02:09:14.171 INFO:tasks.workunit.client.1.smithi112.stdout:1/665: rmdir d7/d4b/d94 39 2024-04-25T02:09:14.172 INFO:tasks.workunit.client.1.smithi112.stdout:1/666: write d7/d9/d1e/de/fbc [326769,36267] 0 2024-04-25T02:09:14.172 INFO:tasks.workunit.client.1.smithi112.stdout:1/667: read - d7/d9/d1e/de/fc0 zero size 2024-04-25T02:09:14.172 INFO:tasks.workunit.client.1.smithi112.stdout:1/668: read - d7/d9/d46/fb6 zero size 2024-04-25T02:09:14.172 INFO:tasks.workunit.client.1.smithi112.stdout:1/669: creat d7/d9/d4e/d72/d73/fd3 x:0 0 0 2024-04-25T02:09:14.172 INFO:tasks.workunit.client.1.smithi112.stdout:1/670: write d7/f4d [4589923,89066] 0 2024-04-25T02:09:14.172 INFO:tasks.workunit.client.1.smithi112.stdout:1/671: truncate d7/d9/d4e/f37 9220517 0 2024-04-25T02:09:14.172 INFO:tasks.workunit.client.1.smithi112.stdout:1/672: write d7/d9/d51/fb3 [155798,47048] 0 2024-04-25T02:09:14.172 INFO:tasks.workunit.client.1.smithi112.stdout:1/673: stat d7/d9/d4e/d28/lb8 0 2024-04-25T02:09:14.172 INFO:tasks.workunit.client.1.smithi112.stdout:3/645: dwrite d12/d13/f4e [0,4194304] 0 2024-04-25T02:09:14.176 INFO:tasks.workunit.client.1.smithi112.stdout:0/814: truncate da/d1d/d2e/d40/d49/d4f/d58/d6d/f8b 984314 0 2024-04-25T02:09:14.176 INFO:tasks.workunit.client.1.smithi112.stdout:0/815: write da/d13/fcf [149514,128648] 0 2024-04-25T02:09:14.176 INFO:tasks.workunit.client.1.smithi112.stdout:0/816: readlink da/d1d/d2e/d40/d49/d6b/ldf 0 2024-04-25T02:09:14.186 INFO:tasks.workunit.client.1.smithi112.stdout:2/594: unlink d3/da/dc/d20/d43/d74/f97 0 2024-04-25T02:09:14.188 INFO:tasks.workunit.client.1.smithi112.stdout:7/627: creat d7/d79/da2/fc1 x:0 0 0 2024-04-25T02:09:14.189 INFO:tasks.workunit.client.1.smithi112.stdout:2/595: dread d3/da/dc/f2e [0,4194304] 0 2024-04-25T02:09:14.191 INFO:tasks.workunit.client.1.smithi112.stdout:0/817: dread da/d13/d23/d77/f95 [0,4194304] 0 2024-04-25T02:09:14.199 INFO:tasks.workunit.client.1.smithi112.stdout:1/674: getdents d7/d9/d4e/d28/d32 0 2024-04-25T02:09:14.201 INFO:tasks.workunit.client.1.smithi112.stdout:7/628: symlink d7/dd/d88/db6/lc2 0 2024-04-25T02:09:14.201 INFO:tasks.workunit.client.1.smithi112.stdout:7/629: stat d7/d25/d43/f2a 0 2024-04-25T02:09:14.201 INFO:tasks.workunit.client.1.smithi112.stdout:6/577: dwrite d0/d2/d4/d28/fa2 [0,4194304] 0 2024-04-25T02:09:14.201 INFO:tasks.workunit.client.1.smithi112.stdout:6/578: write d0/d2/d4/f5 [183451,49682] 0 2024-04-25T02:09:14.202 INFO:tasks.workunit.client.1.smithi112.stdout:5/527: dwrite d1/d16/d22/f4e [0,4194304] 0 2024-04-25T02:09:14.202 INFO:tasks.workunit.client.1.smithi112.stdout:5/528: stat d1/d16/d98 0 2024-04-25T02:09:14.202 INFO:tasks.workunit.client.1.smithi112.stdout:5/529: fsync d1/d16/d22/f4b 0 2024-04-25T02:09:14.202 INFO:tasks.workunit.client.1.smithi112.stdout:3/646: dwrite d12/d1f/d27/d44/d73/fbb [0,4194304] 0 2024-04-25T02:09:14.202 INFO:tasks.workunit.client.1.smithi112.stdout:2/596: mknod d3/da/dac/ccb 0 2024-04-25T02:09:14.203 INFO:tasks.workunit.client.1.smithi112.stdout:4/751: dwrite d2/d1e/d4b/d57/f69 [0,4194304] 0 2024-04-25T02:09:14.204 INFO:tasks.workunit.client.1.smithi112.stdout:7/630: creat d7/dd/d20/db2/fc3 x:0 0 0 2024-04-25T02:09:14.205 INFO:tasks.workunit.client.1.smithi112.stdout:6/579: link d0/c46 d0/d2/d4/dd/cca 0 2024-04-25T02:09:14.208 INFO:tasks.workunit.client.1.smithi112.stdout:5/530: mkdir d1/d41/d5b/d6b/db6 0 2024-04-25T02:09:14.208 INFO:tasks.workunit.client.1.smithi112.stdout:5/531: dread - d1/d2/d45/fb3 zero size 2024-04-25T02:09:14.208 INFO:tasks.workunit.client.1.smithi112.stdout:5/532: creat d1/d2/d28/d4f/fb7 x:0 0 0 2024-04-25T02:09:14.211 INFO:tasks.workunit.client.1.smithi112.stdout:3/647: creat d12/d1f/db0/fd6 x:0 0 0 2024-04-25T02:09:14.211 INFO:tasks.workunit.client.1.smithi112.stdout:3/648: write d12/d13/d86/f8b [5027380,76559] 0 2024-04-25T02:09:14.211 INFO:tasks.workunit.client.1.smithi112.stdout:3/649: fdatasync d12/d13/d34/f64 0 2024-04-25T02:09:14.213 INFO:tasks.workunit.client.1.smithi112.stdout:2/597: truncate d3/da/f2b 65284 0 2024-04-25T02:09:14.215 INFO:tasks.workunit.client.1.smithi112.stdout:4/752: mknod d2/d17/d20/d26/d80/cf7 0 2024-04-25T02:09:14.216 INFO:tasks.workunit.client.1.smithi112.stdout:6/580: dread d0/f2b [4194304,4194304] 0 2024-04-25T02:09:14.228 INFO:tasks.workunit.client.1.smithi112.stdout:5/533: rename d1/d2/d4/d1d/f2a to d1/d16/d99/fb8 0 2024-04-25T02:09:14.228 INFO:tasks.workunit.client.1.smithi112.stdout:5/534: write d1/d2/d45/fb3 [135934,10985] 0 2024-04-25T02:09:14.232 INFO:tasks.workunit.client.1.smithi112.stdout:3/650: stat d12/c29 0 2024-04-25T02:09:14.236 INFO:tasks.workunit.client.1.smithi112.stdout:6/581: link d0/d32/l73 d0/d32/lcb 0 2024-04-25T02:09:14.238 INFO:tasks.workunit.client.1.smithi112.stdout:1/675: fsync d7/d9/d4e/d72/d73/fd3 0 2024-04-25T02:09:14.239 INFO:tasks.workunit.client.1.smithi112.stdout:5/535: dread d1/d2/d4/fe [0,4194304] 0 2024-04-25T02:09:14.239 INFO:tasks.workunit.client.1.smithi112.stdout:5/536: readlink d1/d3f/l4a 0 2024-04-25T02:09:14.240 INFO:tasks.workunit.client.1.smithi112.stdout:2/598: dwrite d3/da/dc/d20/d40/f5b [4194304,4194304] 0 2024-04-25T02:09:14.241 INFO:tasks.workunit.client.1.smithi112.stdout:4/753: dwrite d2/d17/d20/d26/d39/d49/f56 [0,4194304] 0 2024-04-25T02:09:14.241 INFO:tasks.workunit.client.1.smithi112.stdout:3/651: link lf d12/d13/d34/d53/d9c/ld7 0 2024-04-25T02:09:14.242 INFO:tasks.workunit.client.1.smithi112.stdout:1/676: creat d7/fd4 x:0 0 0 2024-04-25T02:09:14.243 INFO:tasks.workunit.client.1.smithi112.stdout:1/677: creat d7/d9/d4e/d72/d73/fd5 x:0 0 0 2024-04-25T02:09:14.243 INFO:tasks.workunit.client.1.smithi112.stdout:1/678: chown d7/d9/d4e/d28/d3f/fa3 36 1 2024-04-25T02:09:14.244 INFO:tasks.workunit.client.1.smithi112.stdout:5/537: rmdir d1/d16/d51 39 2024-04-25T02:09:14.244 INFO:tasks.workunit.client.1.smithi112.stdout:5/538: fdatasync d1/d2/f7e 0 2024-04-25T02:09:14.244 INFO:tasks.workunit.client.1.smithi112.stdout:5/539: readlink d1/d16/d51/lad 0 2024-04-25T02:09:14.249 INFO:tasks.workunit.client.1.smithi112.stdout:2/599: mkdir d3/da/dc/d3e/df/d71/dc5/dcc 0 2024-04-25T02:09:14.249 INFO:tasks.workunit.client.1.smithi112.stdout:2/600: write d3/da/dc/d20/d40/f6e [290981,78073] 0 2024-04-25T02:09:14.249 INFO:tasks.workunit.client.1.smithi112.stdout:2/601: creat d3/da/dc/d20/d43/d5e/fcd x:0 0 0 2024-04-25T02:09:14.249 INFO:tasks.workunit.client.1.smithi112.stdout:2/602: dread - d3/da/dc/d3e/df/d25/d9e/f7f zero size 2024-04-25T02:09:14.252 INFO:tasks.workunit.client.1.smithi112.stdout:4/754: creat d2/d17/d20/d26/d39/d49/d95/dc7/ff8 x:0 0 0 2024-04-25T02:09:14.252 INFO:tasks.workunit.client.1.smithi112.stdout:4/755: readlink d2/d17/d20/l3e 0 2024-04-25T02:09:14.253 INFO:tasks.workunit.client.1.smithi112.stdout:6/582: dwrite d0/d2/d3b/f6f [0,4194304] 0 2024-04-25T02:09:14.256 INFO:tasks.workunit.client.1.smithi112.stdout:5/540: symlink d1/d41/d5b/d7b/lb9 0 2024-04-25T02:09:14.259 INFO:tasks.workunit.client.1.smithi112.stdout:6/583: link d0/d2/d3b/f58 d0/d2/da1/fcc 0 2024-04-25T02:09:14.260 INFO:tasks.workunit.client.1.smithi112.stdout:3/652: rmdir d12/d67 39 2024-04-25T02:09:14.260 INFO:tasks.workunit.client.1.smithi112.stdout:3/653: truncate d12/d5d/fc0 1047450 0 2024-04-25T02:09:14.260 INFO:tasks.workunit.client.1.smithi112.stdout:5/541: mkdir d1/dba 0 2024-04-25T02:09:14.261 INFO:tasks.workunit.client.1.smithi112.stdout:4/756: getdents d2/d12/d22 0 2024-04-25T02:09:14.262 INFO:tasks.workunit.client.1.smithi112.stdout:2/603: write d3/da/dac/dbf/f31 [1506751,6052] 0 2024-04-25T02:09:14.262 INFO:tasks.workunit.client.1.smithi112.stdout:2/604: fdatasync d3/da/dc/f93 0 2024-04-25T02:09:14.263 INFO:tasks.workunit.client.1.smithi112.stdout:6/584: mknod d0/d2/ccd 0 2024-04-25T02:09:14.264 INFO:tasks.workunit.client.1.smithi112.stdout:3/654: unlink d12/d1f/d27/d44/c61 0 2024-04-25T02:09:14.264 INFO:tasks.workunit.client.1.smithi112.stdout:5/542: rmdir d1/d2/d28 39 2024-04-25T02:09:14.266 INFO:tasks.workunit.client.1.smithi112.stdout:1/679: dwrite d7/d9/d1e/fb7 [4194304,4194304] 0 2024-04-25T02:09:14.266 INFO:tasks.workunit.client.1.smithi112.stdout:1/680: getdents d7/d9/d4e/d28/d3f/da9/dae 0 2024-04-25T02:09:14.266 INFO:tasks.workunit.client.1.smithi112.stdout:4/757: truncate d2/f2d 3595226 0 2024-04-25T02:09:14.267 INFO:tasks.workunit.client.1.smithi112.stdout:2/605: unlink d3/da/dc/d3e/df/d25/d9e/l65 0 2024-04-25T02:09:14.268 INFO:tasks.workunit.client.1.smithi112.stdout:6/585: mkdir d0/d2/d2c/d41/dce 0 2024-04-25T02:09:14.268 INFO:tasks.workunit.client.1.smithi112.stdout:3/655: mknod d12/d67/dbf/cd8 0 2024-04-25T02:09:14.278 INFO:tasks.workunit.client.1.smithi112.stdout:6/586: dread d0/d36/fab [0,4194304] 0 2024-04-25T02:09:14.281 INFO:tasks.workunit.client.1.smithi112.stdout:5/543: dread d1/d16/d22/f4e [0,4194304] 0 2024-04-25T02:09:14.282 INFO:tasks.workunit.client.1.smithi112.stdout:2/606: read d3/da/dc/d3e/df/d32/f98 [1868254,95776] 0 2024-04-25T02:09:14.286 INFO:tasks.workunit.client.1.smithi112.stdout:1/681: creat d7/d9/fd6 x:0 0 0 2024-04-25T02:09:14.294 INFO:tasks.workunit.client.1.smithi112.stdout:3/656: creat d12/d1f/d27/d44/d73/d95/da5/fd9 x:0 0 0 2024-04-25T02:09:14.308 INFO:tasks.workunit.client.1.smithi112.stdout:5/544: dwrite d1/f8 [4194304,4194304] 0 2024-04-25T02:09:14.308 INFO:tasks.workunit.client.1.smithi112.stdout:5/545: fdatasync d1/d16/f75 0 2024-04-25T02:09:14.308 INFO:tasks.workunit.client.1.smithi112.stdout:2/607: dwrite d3/da/dc/d3e/df/d30/d7c/faa [0,4194304] 0 2024-04-25T02:09:14.315 INFO:tasks.workunit.client.1.smithi112.stdout:2/608: write d3/da/dc/d3e/f3c [4171271,118124] 0 2024-04-25T02:09:14.321 INFO:tasks.workunit.client.1.smithi112.stdout:6/587: unlink d0/d7b/lac 0 2024-04-25T02:09:14.334 INFO:tasks.workunit.client.1.smithi112.stdout:6/588: read d0/d2/f82 [859842,108853] 0 2024-04-25T02:09:14.337 INFO:tasks.workunit.client.1.smithi112.stdout:1/682: rename d7/d9/d4e/d72/fc5 to d7/d9/d4e/d28/fd7 0 2024-04-25T02:09:14.347 INFO:tasks.workunit.client.1.smithi112.stdout:3/657: getdents d12/d13/d34/d78 0 2024-04-25T02:09:14.347 INFO:tasks.workunit.client.1.smithi112.stdout:1/683: dread d7/d9/d1e/de/f17 [4194304,4194304] 0 2024-04-25T02:09:14.347 INFO:tasks.workunit.client.1.smithi112.stdout:1/684: write d7/d9/d4e/d28/d3f/f97 [2209527,99380] 0 2024-04-25T02:09:14.348 INFO:tasks.workunit.client.1.smithi112.stdout:5/546: link d1/d16/l8d d1/d16/d98/lbb 0 2024-04-25T02:09:14.351 INFO:tasks.workunit.client.1.smithi112.stdout:2/609: unlink d3/da/dc/d3e/df/d30/d7c/lbd 0 2024-04-25T02:09:14.351 INFO:tasks.workunit.client.1.smithi112.stdout:6/589: dwrite d0/d32/d45/f52 [0,4194304] 0 2024-04-25T02:09:14.354 INFO:tasks.workunit.client.1.smithi112.stdout:3/658: truncate d12/d13/d34/f60 4711662 0 2024-04-25T02:09:14.354 INFO:tasks.workunit.client.1.smithi112.stdout:3/659: creat d12/d13/d34/d4a/fda x:0 0 0 2024-04-25T02:09:14.354 INFO:tasks.workunit.client.1.smithi112.stdout:3/660: fdatasync d12/d13/d34/d78/d83/f93 0 2024-04-25T02:09:14.354 INFO:tasks.workunit.client.1.smithi112.stdout:3/661: write d12/d67/fb2 [1026772,97367] 0 2024-04-25T02:09:14.357 INFO:tasks.workunit.client.1.smithi112.stdout:1/685: mkdir d7/d9/d4e/d72/dd8 0 2024-04-25T02:09:14.357 INFO:tasks.workunit.client.1.smithi112.stdout:1/686: truncate d7/d9/d1e/de/fc0 34446 0 2024-04-25T02:09:14.366 INFO:tasks.workunit.client.1.smithi112.stdout:6/590: dread d0/d2/f15 [0,4194304] 0 2024-04-25T02:09:14.366 INFO:tasks.workunit.client.1.smithi112.stdout:6/591: write d0/d36/f5a [396073,44741] 0 2024-04-25T02:09:14.369 INFO:tasks.workunit.client.1.smithi112.stdout:5/547: write d1/f50 [1391921,8872] 0 2024-04-25T02:09:14.370 INFO:tasks.workunit.client.1.smithi112.stdout:3/662: creat d12/d1f/d27/d44/d7e/fdb x:0 0 0 2024-04-25T02:09:14.370 INFO:tasks.workunit.client.1.smithi112.stdout:3/663: readlink d12/d13/d34/d4a/lcc 0 2024-04-25T02:09:14.371 INFO:tasks.workunit.client.1.smithi112.stdout:1/687: creat d7/d9/d4e/d72/fd9 x:0 0 0 2024-04-25T02:09:14.373 INFO:tasks.workunit.client.1.smithi112.stdout:6/592: unlink d0/d2/d4/dd/db7/fc2 0 2024-04-25T02:09:14.376 INFO:tasks.workunit.client.1.smithi112.stdout:2/610: dwrite d3/da/dc/d20/d43/f55 [0,4194304] 0 2024-04-25T02:09:14.376 INFO:tasks.workunit.client.1.smithi112.stdout:2/611: creat d3/da/dc/d20/d43/d74/fce x:0 0 0 2024-04-25T02:09:14.377 INFO:tasks.workunit.client.1.smithi112.stdout:2/612: truncate d3/da/dc/fb9 706798 0 2024-04-25T02:09:14.377 INFO:tasks.workunit.client.1.smithi112.stdout:2/613: truncate d3/f59 1648919 0 2024-04-25T02:09:14.378 INFO:tasks.workunit.client.1.smithi112.stdout:5/548: unlink d1/d2/d28/f86 0 2024-04-25T02:09:14.378 INFO:tasks.workunit.client.1.smithi112.stdout:3/664: dread d12/d67/f70 [0,4194304] 0 2024-04-25T02:09:14.382 INFO:tasks.workunit.client.1.smithi112.stdout:6/593: symlink d0/d32/d45/lcf 0 2024-04-25T02:09:14.382 INFO:tasks.workunit.client.1.smithi112.stdout:6/594: dread - d0/d32/dc0/f9d zero size 2024-04-25T02:09:14.384 INFO:tasks.workunit.client.1.smithi112.stdout:4/758: rmdir d2 39 2024-04-25T02:09:14.386 INFO:tasks.workunit.client.1.smithi112.stdout:1/688: dread d7/d9/d4e/f37 [0,4194304] 0 2024-04-25T02:09:14.386 INFO:tasks.workunit.client.1.smithi112.stdout:1/689: read d7/d9/d1e/de/f27 [464371,89236] 0 2024-04-25T02:09:14.388 INFO:tasks.workunit.client.1.smithi112.stdout:2/614: mkdir d3/da/dc/d20/d43/dcf 0 2024-04-25T02:09:14.389 INFO:tasks.workunit.client.1.smithi112.stdout:3/665: chown d12/d13/d34/d4a/d4f/d7d/l82 108 1 2024-04-25T02:09:14.391 INFO:tasks.workunit.client.1.smithi112.stdout:6/595: link d0/d2/d1f/l7e d0/d32/d45/ld0 0 2024-04-25T02:09:14.391 INFO:tasks.workunit.client.1.smithi112.stdout:6/596: stat d0/d2/d4/f1d 0 2024-04-25T02:09:14.391 INFO:tasks.workunit.client.1.smithi112.stdout:6/597: readlink d0/d32/d45/l8d 0 2024-04-25T02:09:14.393 INFO:tasks.workunit.client.1.smithi112.stdout:4/759: mknod d2/d4e/cf9 0 2024-04-25T02:09:14.394 INFO:tasks.workunit.client.1.smithi112.stdout:1/690: creat d7/d9/d1e/d66/dc6/fda x:0 0 0 2024-04-25T02:09:14.395 INFO:tasks.workunit.client.1.smithi112.stdout:2/615: symlink d3/da/dc/d3e/df/d71/dc5/dcc/ld0 0 2024-04-25T02:09:14.398 INFO:tasks.workunit.client.1.smithi112.stdout:1/691: creat d7/d9/d1e/de/dcf/fdb x:0 0 0 2024-04-25T02:09:14.424 INFO:tasks.workunit.client.1.smithi112.stdout:4/760: dwrite d2/d1e/d42/f47 [0,4194304] 0 2024-04-25T02:09:14.424 INFO:tasks.workunit.client.1.smithi112.stdout:6/598: dwrite d0/d2/da1/fcc [0,4194304] 0 2024-04-25T02:09:14.425 INFO:tasks.workunit.client.1.smithi112.stdout:1/692: dwrite d7/d9/f10 [0,4194304] 0 2024-04-25T02:09:14.440 INFO:tasks.workunit.client.1.smithi112.stdout:6/599: dwrite d0/d2/fba [0,4194304] 0 2024-04-25T02:09:14.478 INFO:tasks.workunit.client.1.smithi112.stdout:3/666: truncate d12/d13/d34/d53/f85 719641 0 2024-04-25T02:09:14.478 INFO:tasks.workunit.client.1.smithi112.stdout:3/667: fdatasync d12/d5d/f75 0 2024-04-25T02:09:14.479 INFO:tasks.workunit.client.1.smithi112.stdout:2/616: getdents d3/da/dc/d3e/df/d30 0 2024-04-25T02:09:14.479 INFO:tasks.workunit.client.1.smithi112.stdout:2/617: dread - d3/da/dc/d3e/df/d30/f6c zero size 2024-04-25T02:09:14.479 INFO:tasks.workunit.client.1.smithi112.stdout:2/618: write d3/da/dc/d3e/df/d25/d9e/d81/f87 [131636,39265] 0 2024-04-25T02:09:14.480 INFO:tasks.workunit.client.1.smithi112.stdout:4/761: creat d2/d1e/d1b/d65/ffa x:0 0 0 2024-04-25T02:09:14.481 INFO:tasks.workunit.client.1.smithi112.stdout:1/693: mknod d7/d9/d4e/d28/d3f/da9/dae/cdc 0 2024-04-25T02:09:14.484 INFO:tasks.workunit.client.1.smithi112.stdout:6/600: creat d0/d2/d2c/d41/dce/fd1 x:0 0 0 2024-04-25T02:09:14.484 INFO:tasks.workunit.client.1.smithi112.stdout:6/601: fsync d0/d2/d2c/f3f 0 2024-04-25T02:09:14.490 INFO:tasks.workunit.client.1.smithi112.stdout:2/619: mkdir d3/da/dac/dbf/dd1 0 2024-04-25T02:09:14.491 INFO:tasks.workunit.client.1.smithi112.stdout:4/762: mkdir d2/d4e/dfb 0 2024-04-25T02:09:14.491 INFO:tasks.workunit.client.1.smithi112.stdout:4/763: write d2/d17/d25/d3f/fe8 [620871,24053] 0 2024-04-25T02:09:14.491 INFO:tasks.workunit.client.1.smithi112.stdout:4/764: read - d2/d12/d22/ff1 zero size 2024-04-25T02:09:14.492 INFO:tasks.workunit.client.1.smithi112.stdout:1/694: mknod d7/d9/d4e/d28/d43/d6a/cdd 0 2024-04-25T02:09:14.494 INFO:tasks.workunit.client.1.smithi112.stdout:6/602: creat d0/d2/d79/d81/fd2 x:0 0 0 2024-04-25T02:09:14.494 INFO:tasks.workunit.client.1.smithi112.stdout:6/603: chown d0/d2/d2c/f8e 0 1 2024-04-25T02:09:14.495 INFO:tasks.workunit.client.1.smithi112.stdout:2/620: mknod d3/da/dc/d20/d43/dcf/cd2 0 2024-04-25T02:09:14.495 INFO:tasks.workunit.client.1.smithi112.stdout:2/621: truncate d3/da/dc/d20/d43/d5e/fcd 570648 0 2024-04-25T02:09:14.495 INFO:tasks.workunit.client.1.smithi112.stdout:1/695: mkdir d7/d9/d1e/de/d84/dde 0 2024-04-25T02:09:14.496 INFO:tasks.workunit.client.1.smithi112.stdout:2/622: dread d3/da/f2b [0,4194304] 0 2024-04-25T02:09:14.497 INFO:tasks.workunit.client.1.smithi112.stdout:1/696: mknod d7/d9/d1e/d66/cdf 0 2024-04-25T02:09:14.500 INFO:tasks.workunit.client.1.smithi112.stdout:3/668: dwrite d12/d13/f4e [0,4194304] 0 2024-04-25T02:09:14.500 INFO:tasks.workunit.client.1.smithi112.stdout:3/669: chown d12/d1f/d27/d44/d73/fbb 86778 1 2024-04-25T02:09:14.501 INFO:tasks.workunit.client.1.smithi112.stdout:1/697: rename d7/d9/d51/d58/c8a to d7/ce0 0 2024-04-25T02:09:14.501 INFO:tasks.workunit.client.1.smithi112.stdout:1/698: readlink d7/d9/d1f/l31 0 2024-04-25T02:09:14.501 INFO:tasks.workunit.client.1.smithi112.stdout:4/765: dread d2/d17/d20/d26/d39/f68 [0,4194304] 0 2024-04-25T02:09:14.502 INFO:tasks.workunit.client.1.smithi112.stdout:3/670: fdatasync d12/d13/f8e 0 2024-04-25T02:09:14.503 INFO:tasks.workunit.client.1.smithi112.stdout:6/604: read d0/d61/db0/fbf [3729489,87869] 0 2024-04-25T02:09:14.504 INFO:tasks.workunit.client.1.smithi112.stdout:6/605: truncate d0/d32/dc0/f9d 585106 0 2024-04-25T02:09:14.504 INFO:tasks.workunit.client.1.smithi112.stdout:3/671: mknod d12/d13/d86/da0/cdc 0 2024-04-25T02:09:14.506 INFO:tasks.workunit.client.1.smithi112.stdout:6/606: unlink d0/d7b/f88 0 2024-04-25T02:09:14.506 INFO:tasks.workunit.client.1.smithi112.stdout:6/607: chown d0/d2/d66/fa3 20 1 2024-04-25T02:09:14.506 INFO:tasks.workunit.client.1.smithi112.stdout:6/608: fsync d0/d61/d98/fbe 0 2024-04-25T02:09:14.508 INFO:tasks.workunit.client.1.smithi112.stdout:6/609: creat d0/d2/d3b/d53/d67/fd3 x:0 0 0 2024-04-25T02:09:14.508 INFO:tasks.workunit.client.1.smithi112.stdout:6/610: dread - d0/d2/d1f/fb4 zero size 2024-04-25T02:09:14.510 INFO:tasks.workunit.client.1.smithi112.stdout:4/766: dread d2/d1e/d42/f47 [0,4194304] 0 2024-04-25T02:09:14.511 INFO:tasks.workunit.client.1.smithi112.stdout:3/672: write d12/f5c [356478,14067] 0 2024-04-25T02:09:14.511 INFO:tasks.workunit.client.1.smithi112.stdout:3/673: chown d12/d13/d34/l5f 9976511 1 2024-04-25T02:09:14.511 INFO:tasks.workunit.client.1.smithi112.stdout:3/674: chown d12/d1f/d27/d44/d73/d95/da5 9760 1 2024-04-25T02:09:14.515 INFO:tasks.workunit.client.1.smithi112.stdout:1/699: write d7/d9/d4e/fad [1197915,31674] 0 2024-04-25T02:09:14.516 INFO:tasks.workunit.client.1.smithi112.stdout:3/675: symlink d12/d13/d34/d78/d83/ldd 0 2024-04-25T02:09:14.520 INFO:tasks.workunit.client.1.smithi112.stdout:3/676: creat d12/d13/d34/d78/d91/fde x:0 0 0 2024-04-25T02:09:14.520 INFO:tasks.workunit.client.1.smithi112.stdout:2/623: dwrite d3/da/dc/d3e/df/d25/d9e/f84 [0,4194304] 0 2024-04-25T02:09:14.522 INFO:tasks.workunit.client.1.smithi112.stdout:3/677: rename d12/d1f/c72 to d12/d13/d86/dd2/cdf 0 2024-04-25T02:09:14.526 INFO:tasks.workunit.client.1.smithi112.stdout:2/624: rename d3/da/dac/dbf/f31 to d3/da/dc/d20/d43/fd3 0 2024-04-25T02:09:14.529 INFO:tasks.workunit.client.1.smithi112.stdout:3/678: unlink d12/l69 0 2024-04-25T02:09:14.531 INFO:tasks.workunit.client.1.smithi112.stdout:6/611: dwrite d0/d2/d1f/fc9 [0,4194304] 0 2024-04-25T02:09:14.531 INFO:tasks.workunit.client.1.smithi112.stdout:6/612: chown d0/d2/d4/f84 0 1 2024-04-25T02:09:14.531 INFO:tasks.workunit.client.1.smithi112.stdout:6/613: chown d0/d2/d2c/d41/d77/fa4 1 1 2024-04-25T02:09:14.531 INFO:tasks.workunit.client.1.smithi112.stdout:6/614: creat d0/d2/d3b/d53/d67/fd4 x:0 0 0 2024-04-25T02:09:14.531 INFO:tasks.workunit.client.1.smithi112.stdout:4/767: dwrite d2/d1e/d1b/d65/fc9 [0,4194304] 0 2024-04-25T02:09:14.537 INFO:tasks.workunit.client.1.smithi112.stdout:6/615: mknod d0/d2/d79/d81/cd5 0 2024-04-25T02:09:14.537 INFO:tasks.workunit.client.1.smithi112.stdout:6/616: dread - d0/d2/d3b/f68 zero size 2024-04-25T02:09:14.543 INFO:tasks.workunit.client.1.smithi112.stdout:9/596: sync 2024-04-25T02:09:14.543 INFO:tasks.workunit.client.1.smithi112.stdout:9/597: fsync d1/d13/d5b/fa8 0 2024-04-25T02:09:14.544 INFO:tasks.workunit.client.1.smithi112.stdout:4/768: mkdir d2/d1e/d1b/d67/dfc 0 2024-04-25T02:09:14.546 INFO:tasks.workunit.client.1.smithi112.stdout:9/598: creat d1/df/d3c/fcd x:0 0 0 2024-04-25T02:09:14.547 INFO:tasks.workunit.client.1.smithi112.stdout:9/599: creat d1/d48/fce x:0 0 0 2024-04-25T02:09:14.547 INFO:tasks.workunit.client.1.smithi112.stdout:4/769: mkdir d2/d17/d25/d3f/dfd 0 2024-04-25T02:09:14.548 INFO:tasks.workunit.client.1.smithi112.stdout:6/617: dread d0/d2/d4/f5 [0,4194304] 0 2024-04-25T02:09:14.548 INFO:tasks.workunit.client.1.smithi112.stdout:6/618: write d0/f17 [3541263,15083] 0 2024-04-25T02:09:14.548 INFO:tasks.workunit.client.1.smithi112.stdout:6/619: chown d0/d2/d4/fb 1433992 1 2024-04-25T02:09:14.548 INFO:tasks.workunit.client.1.smithi112.stdout:6/620: truncate d0/d2/d2c/d41/f5d 4790586 0 2024-04-25T02:09:14.550 INFO:tasks.workunit.client.1.smithi112.stdout:9/600: rename d1/df/d3c/l70 to d1/d93/lcf 0 2024-04-25T02:09:14.550 INFO:tasks.workunit.client.1.smithi112.stdout:9/601: write d1/df/d3c/f52 [1831765,26932] 0 2024-04-25T02:09:14.550 INFO:tasks.workunit.client.1.smithi112.stdout:9/602: dread - d1/df/f8d zero size 2024-04-25T02:09:14.551 INFO:tasks.workunit.client.1.smithi112.stdout:4/770: rmdir d2/d17/d7c 39 2024-04-25T02:09:14.552 INFO:tasks.workunit.client.1.smithi112.stdout:3/679: dwrite d12/d1f/d27/f52 [0,4194304] 0 2024-04-25T02:09:14.552 INFO:tasks.workunit.client.1.smithi112.stdout:3/680: write d12/d13/d34/d4a/fc9 [156667,74094] 0 2024-04-25T02:09:14.552 INFO:tasks.workunit.client.1.smithi112.stdout:3/681: write d12/d67/dbf/fd0 [713400,130913] 0 2024-04-25T02:09:14.552 INFO:tasks.workunit.client.1.smithi112.stdout:3/682: readlink d12/d13/l16 0 2024-04-25T02:09:14.553 INFO:tasks.workunit.client.1.smithi112.stdout:6/621: unlink d0/d61/f9e 0 2024-04-25T02:09:14.555 INFO:tasks.workunit.client.1.smithi112.stdout:4/771: creat d2/d17/d20/d26/ffe x:0 0 0 2024-04-25T02:09:14.555 INFO:tasks.workunit.client.1.smithi112.stdout:4/772: stat d2/d17/d20/fa2 0 2024-04-25T02:09:14.555 INFO:tasks.workunit.client.1.smithi112.stdout:4/773: stat d2/d17/d20/d5e 0 2024-04-25T02:09:14.556 INFO:tasks.workunit.client.1.smithi112.stdout:3/683: creat d12/d13/d34/d53/d9c/fe0 x:0 0 0 2024-04-25T02:09:14.557 INFO:tasks.workunit.client.1.smithi112.stdout:2/625: dwrite d3/da/dc/d3e/df/d25/d9e/f84 [0,4194304] 0 2024-04-25T02:09:14.560 INFO:tasks.workunit.client.1.smithi112.stdout:9/603: dread d1/df/f40 [4194304,4194304] 0 2024-04-25T02:09:14.560 INFO:tasks.workunit.client.1.smithi112.stdout:9/604: readlink d1/d48/d65/lb2 0 2024-04-25T02:09:14.560 INFO:tasks.workunit.client.1.smithi112.stdout:9/605: readlink d1/d48/l8a 0 2024-04-25T02:09:14.560 INFO:tasks.workunit.client.1.smithi112.stdout:4/774: truncate d2/d17/d25/f3b 1489431 0 2024-04-25T02:09:14.561 INFO:tasks.workunit.client.1.smithi112.stdout:3/684: creat d12/d13/d34/d53/fe1 x:0 0 0 2024-04-25T02:09:14.563 INFO:tasks.workunit.client.1.smithi112.stdout:2/626: symlink d3/da/ld4 0 2024-04-25T02:09:14.563 INFO:tasks.workunit.client.1.smithi112.stdout:2/627: chown d3/da/dac/dbf 22505 1 2024-04-25T02:09:14.563 INFO:tasks.workunit.client.1.smithi112.stdout:2/628: fdatasync d3/f73 0 2024-04-25T02:09:14.566 INFO:tasks.workunit.client.1.smithi112.stdout:6/622: unlink d0/d2/d3b/d53/d67/d6b/l71 0 2024-04-25T02:09:14.569 INFO:tasks.workunit.client.1.smithi112.stdout:9/606: creat d1/d13/fd0 x:0 0 0 2024-04-25T02:09:14.572 INFO:tasks.workunit.client.1.smithi112.stdout:3/685: creat d12/d13/d34/fe2 x:0 0 0 2024-04-25T02:09:14.572 INFO:tasks.workunit.client.1.smithi112.stdout:9/607: dread d1/df/d3c/d46/f98 [0,4194304] 0 2024-04-25T02:09:14.579 INFO:tasks.workunit.client.1.smithi112.stdout:6/623: dread d0/d2/d4/d28/f5c [0,4194304] 0 2024-04-25T02:09:14.579 INFO:tasks.workunit.client.1.smithi112.stdout:6/624: write d0/d2/d2c/f3f [338030,118213] 0 2024-04-25T02:09:14.579 INFO:tasks.workunit.client.1.smithi112.stdout:6/625: write d0/d2/d2c/f8e [892171,110473] 0 2024-04-25T02:09:14.582 INFO:tasks.workunit.client.1.smithi112.stdout:3/686: dread d12/d13/fc1 [0,4194304] 0 2024-04-25T02:09:14.584 INFO:tasks.workunit.client.1.smithi112.stdout:6/626: write d0/f2b [7258703,87830] 0 2024-04-25T02:09:14.584 INFO:tasks.workunit.client.1.smithi112.stdout:6/627: fdatasync d0/f1a 0 2024-04-25T02:09:14.587 INFO:tasks.workunit.client.1.smithi112.stdout:9/608: read d1/df/f23 [3137335,98089] 0 2024-04-25T02:09:14.587 INFO:tasks.workunit.client.1.smithi112.stdout:2/629: dwrite d3/da/dc/d20/d40/f5b [0,4194304] 0 2024-04-25T02:09:14.588 INFO:tasks.workunit.client.1.smithi112.stdout:2/630: fsync d3/da/dc/d20/d43/f55 0 2024-04-25T02:09:14.588 INFO:tasks.workunit.client.1.smithi112.stdout:4/775: dwrite d2/d17/d20/fa2 [4194304,4194304] 0 2024-04-25T02:09:14.590 INFO:tasks.workunit.client.1.smithi112.stdout:6/628: symlink d0/d2/d3b/ld6 0 2024-04-25T02:09:14.590 INFO:tasks.workunit.client.1.smithi112.stdout:6/629: creat d0/d2/d3b/d53/d67/fd7 x:0 0 0 2024-04-25T02:09:14.593 INFO:tasks.workunit.client.1.smithi112.stdout:9/609: truncate d1/df/d8f/f94 2121352 0 2024-04-25T02:09:14.594 INFO:tasks.workunit.client.1.smithi112.stdout:9/610: creat d1/fd1 x:0 0 0 2024-04-25T02:09:14.594 INFO:tasks.workunit.client.1.smithi112.stdout:9/611: write d1/d13/d41/d84/fac [801788,104654] 0 2024-04-25T02:09:14.598 INFO:tasks.workunit.client.1.smithi112.stdout:2/631: dread d3/da/dc/d20/d43/d5e/f92 [0,4194304] 0 2024-04-25T02:09:14.598 INFO:tasks.workunit.client.1.smithi112.stdout:2/632: write d3/da/dc/f7a [1266598,30741] 0 2024-04-25T02:09:14.598 INFO:tasks.workunit.client.1.smithi112.stdout:2/633: write d3/f59 [1566735,27689] 0 2024-04-25T02:09:14.602 INFO:tasks.workunit.client.1.smithi112.stdout:4/776: getdents d2/d1e/d1b/d86 0 2024-04-25T02:09:14.603 INFO:tasks.workunit.client.1.smithi112.stdout:2/634: dread d3/f9d [0,4194304] 0 2024-04-25T02:09:14.605 INFO:tasks.workunit.client.1.smithi112.stdout:6/630: symlink d0/d2/d3b/d53/d67/ld8 0 2024-04-25T02:09:14.607 INFO:tasks.workunit.client.1.smithi112.stdout:3/687: dwrite d12/d13/d34/d4a/f4c [0,4194304] 0 2024-04-25T02:09:14.608 INFO:tasks.workunit.client.1.smithi112.stdout:9/612: mkdir d1/df/d8f/dd2 0 2024-04-25T02:09:14.608 INFO:tasks.workunit.client.1.smithi112.stdout:9/613: write d1/fd [1514539,109454] 0 2024-04-25T02:09:14.611 INFO:tasks.workunit.client.1.smithi112.stdout:4/777: rmdir d2/d1e/d1b/d67 39 2024-04-25T02:09:14.611 INFO:tasks.workunit.client.1.smithi112.stdout:4/778: write d2/d12/de1/fcc [191804,63340] 0 2024-04-25T02:09:14.615 INFO:tasks.workunit.client.1.smithi112.stdout:2/635: creat d3/da/dc/d3e/df/d71/dc5/fd5 x:0 0 0 2024-04-25T02:09:14.615 INFO:tasks.workunit.client.1.smithi112.stdout:2/636: truncate d3/da/f2b 944032 0 2024-04-25T02:09:14.616 INFO:tasks.workunit.client.1.smithi112.stdout:6/631: rename d0/d7b/lb2 to d0/d2/d66/d7d/ld9 0 2024-04-25T02:09:14.616 INFO:tasks.workunit.client.1.smithi112.stdout:6/632: chown d0/d2/d66/l75 57 1 2024-04-25T02:09:14.629 INFO:tasks.workunit.client.1.smithi112.stdout:9/614: mknod d1/d48/d65/d73/daf/d8e/cd3 0 2024-04-25T02:09:14.629 INFO:tasks.workunit.client.1.smithi112.stdout:9/615: fdatasync d1/d13/d5b/f85 0 2024-04-25T02:09:14.629 INFO:tasks.workunit.client.1.smithi112.stdout:9/616: chown d1/d13/d41/d84/fcc 1088755 1 2024-04-25T02:09:14.629 INFO:tasks.workunit.client.1.smithi112.stdout:9/617: dread - d1/d48/d65/d73/daf/fb8 zero size 2024-04-25T02:09:14.629 INFO:tasks.workunit.client.1.smithi112.stdout:9/618: read d1/f21 [1146745,38028] 0 2024-04-25T02:09:14.630 INFO:tasks.workunit.client.1.smithi112.stdout:4/779: dwrite d2/d1e/d1b/d83/fb9 [0,4194304] 0 2024-04-25T02:09:14.630 INFO:tasks.workunit.client.1.smithi112.stdout:6/633: dread d0/f30 [0,4194304] 0 2024-04-25T02:09:14.630 INFO:tasks.workunit.client.1.smithi112.stdout:3/688: dwrite d12/d5d/fc2 [0,4194304] 0 2024-04-25T02:09:14.631 INFO:tasks.workunit.client.1.smithi112.stdout:8/886: sync 2024-04-25T02:09:14.637 INFO:tasks.workunit.client.1.smithi112.stdout:4/780: symlink d2/d17/d20/d26/d39/lff 0 2024-04-25T02:09:14.641 INFO:tasks.workunit.client.1.smithi112.stdout:8/887: write d15/d26/d4f/d67/de0/ff0 [8172863,121808] 0 2024-04-25T02:09:14.641 INFO:tasks.workunit.client.1.smithi112.stdout:8/888: readlink d15/d35/d5c/d5e/d94/laa 0 2024-04-25T02:09:14.643 INFO:tasks.workunit.client.1.smithi112.stdout:3/689: creat d12/d13/d34/d4a/d4f/d7d/dba/fe3 x:0 0 0 2024-04-25T02:09:14.644 INFO:tasks.workunit.client.1.smithi112.stdout:3/690: write d12/d1f/d27/d44/d7e/f88 [4494425,115810] 0 2024-04-25T02:09:14.644 INFO:tasks.workunit.client.1.smithi112.stdout:3/691: write d12/d13/d34/d53/f8d [3649219,113089] 0 2024-04-25T02:09:14.644 INFO:tasks.workunit.client.1.smithi112.stdout:3/692: creat d12/d1f/d27/d44/fe4 x:0 0 0 2024-04-25T02:09:14.644 INFO:tasks.workunit.client.1.smithi112.stdout:3/693: chown d12/d13/d34/d4a/d87 2 1 2024-04-25T02:09:14.644 INFO:tasks.workunit.client.1.smithi112.stdout:2/637: truncate d3/f59 659592 0 2024-04-25T02:09:14.646 INFO:tasks.workunit.client.1.smithi112.stdout:4/781: rename d2/d1e/d1b/d67/ff3 to d2/d1e/d4b/d57/f100 0 2024-04-25T02:09:14.646 INFO:tasks.workunit.client.1.smithi112.stdout:4/782: fdatasync d2/d17/d25/d3f/fe8 0 2024-04-25T02:09:14.647 INFO:tasks.workunit.client.1.smithi112.stdout:6/634: getdents d0/d2/d3b/d53/d67/d6b 0 2024-04-25T02:09:14.649 INFO:tasks.workunit.client.1.smithi112.stdout:8/889: creat d15/d35/d5c/de4/dfd/d119/f131 x:0 0 0 2024-04-25T02:09:14.650 INFO:tasks.workunit.client.1.smithi112.stdout:8/890: write d15/d35/f98 [516107,20104] 0 2024-04-25T02:09:14.653 INFO:tasks.workunit.client.1.smithi112.stdout:3/694: creat d12/d13/d34/d78/fe5 x:0 0 0 2024-04-25T02:09:14.654 INFO:tasks.workunit.client.1.smithi112.stdout:2/638: truncate d3/da/dc/d3e/df/d30/d7c/faa 2629054 0 2024-04-25T02:09:14.655 INFO:tasks.workunit.client.1.smithi112.stdout:4/783: read d2/d1e/d1b/d86/f6d [2721827,32167] 0 2024-04-25T02:09:14.655 INFO:tasks.workunit.client.1.smithi112.stdout:6/635: symlink d0/d2/d2c/lda 0 2024-04-25T02:09:14.658 INFO:tasks.workunit.client.1.smithi112.stdout:8/891: mknod d15/d35/d5f/db5/c132 0 2024-04-25T02:09:14.660 INFO:tasks.workunit.client.1.smithi112.stdout:3/695: creat d12/d1f/fe6 x:0 0 0 2024-04-25T02:09:14.660 INFO:tasks.workunit.client.1.smithi112.stdout:3/696: chown d12/d13/d34/d78/d91/ca9 220109795 1 2024-04-25T02:09:14.661 INFO:tasks.workunit.client.1.smithi112.stdout:4/784: rename d2/d17/d7c/d9c/la8 to d2/d17/d20/d26/d39/l101 0 2024-04-25T02:09:14.664 INFO:tasks.workunit.client.1.smithi112.stdout:8/892: truncate d15/d40/f60 1460289 0 2024-04-25T02:09:14.665 INFO:tasks.workunit.client.1.smithi112.stdout:8/893: dread - d15/d35/d5f/ff9 zero size 2024-04-25T02:09:14.667 INFO:tasks.workunit.client.1.smithi112.stdout:3/697: truncate d12/d13/d86/f8b 1842241 0 2024-04-25T02:09:14.668 INFO:tasks.workunit.client.1.smithi112.stdout:4/785: creat d2/d17/db2/f102 x:0 0 0 2024-04-25T02:09:14.668 INFO:tasks.workunit.client.1.smithi112.stdout:6/636: rmdir d0/d2/d4/d28 39 2024-04-25T02:09:14.670 INFO:tasks.workunit.client.1.smithi112.stdout:6/637: dread d0/d2/d4/f1d [4194304,4194304] 0 2024-04-25T02:09:14.670 INFO:tasks.workunit.client.1.smithi112.stdout:6/638: creat d0/d2/fdb x:0 0 0 2024-04-25T02:09:14.670 INFO:tasks.workunit.client.1.smithi112.stdout:6/639: write d0/d61/db0/fbf [1953536,11362] 0 2024-04-25T02:09:14.670 INFO:tasks.workunit.client.1.smithi112.stdout:8/894: symlink d15/d35/d5c/de4/dfd/l133 0 2024-04-25T02:09:14.670 INFO:tasks.workunit.client.1.smithi112.stdout:3/698: dread d12/d13/fc1 [0,4194304] 0 2024-04-25T02:09:14.671 INFO:tasks.workunit.client.1.smithi112.stdout:2/639: dwrite d3/da/dc/d3e/df/d25/d9e/f84 [0,4194304] 0 2024-04-25T02:09:14.680 INFO:tasks.workunit.client.1.smithi112.stdout:6/640: truncate d0/f2b 6498325 0 2024-04-25T02:09:14.680 INFO:tasks.workunit.client.1.smithi112.stdout:6/641: write d0/d2/f82 [2152115,81115] 0 2024-04-25T02:09:14.682 INFO:tasks.workunit.client.1.smithi112.stdout:3/699: rmdir d12/d13/d34/d4a/d4f/d7d/dba 39 2024-04-25T02:09:14.682 INFO:tasks.workunit.client.1.smithi112.stdout:3/700: dread - d12/d1f/d27/d44/d73/d95/da5/db3/fb7 zero size 2024-04-25T02:09:14.684 INFO:tasks.workunit.client.1.smithi112.stdout:4/786: getdents d2/d1e/d1b/d65 0 2024-04-25T02:09:14.684 INFO:tasks.workunit.client.1.smithi112.stdout:4/787: readlink d2/d1e/d5c/lab 0 2024-04-25T02:09:14.687 INFO:tasks.workunit.client.1.smithi112.stdout:8/895: mkdir d15/d17/d1a/d134 0 2024-04-25T02:09:14.688 INFO:tasks.workunit.client.1.smithi112.stdout:6/642: getdents d0/d2/d4/dd/db7 0 2024-04-25T02:09:14.691 INFO:tasks.workunit.client.1.smithi112.stdout:6/643: dread d0/d2/d4/f4f [0,4194304] 0 2024-04-25T02:09:14.697 INFO:tasks.workunit.client.1.smithi112.stdout:4/788: dread d2/d17/d20/d26/d39/d49/f56 [0,4194304] 0 2024-04-25T02:09:14.755 INFO:tasks.workunit.client.1.smithi112.stdout:8/896: dread d15/d35/d56/f6a [0,4194304] 0 2024-04-25T02:09:14.756 INFO:tasks.workunit.client.1.smithi112.stdout:2/640: dwrite d3/da/dc/d20/d43/d7e/da3/fae [0,4194304] 0 2024-04-25T02:09:14.759 INFO:tasks.workunit.client.1.smithi112.stdout:6/644: dwrite d0/d2/d2c/f8e [0,4194304] 0 2024-04-25T02:09:14.759 INFO:tasks.workunit.client.1.smithi112.stdout:6/645: readlink d0/d2/d4/d28/l5e 0 2024-04-25T02:09:14.762 INFO:tasks.workunit.client.1.smithi112.stdout:4/789: write d2/f15 [783782,69771] 0 2024-04-25T02:09:14.763 INFO:tasks.workunit.client.1.smithi112.stdout:4/790: dread - d2/d17/fa6 zero size 2024-04-25T02:09:14.763 INFO:tasks.workunit.client.1.smithi112.stdout:4/791: fsync d2/d17/d25/d3f/fa4 0 2024-04-25T02:09:14.764 INFO:tasks.workunit.client.1.smithi112.stdout:8/897: rename d15/d35/l124 to d15/d17/d130/l135 0 2024-04-25T02:09:14.769 INFO:tasks.workunit.client.1.smithi112.stdout:6/646: rename d0/d2/d4/f7a to d0/d2/d4/fdc 0 2024-04-25T02:09:14.770 INFO:tasks.workunit.client.1.smithi112.stdout:7/631: sync 2024-04-25T02:09:14.770 INFO:tasks.workunit.client.1.smithi112.stdout:0/818: sync 2024-04-25T02:09:14.772 INFO:tasks.workunit.client.1.smithi112.stdout:4/792: rename d2/d17/d25/f3b to d2/d17/d7c/d9c/f103 0 2024-04-25T02:09:14.772 INFO:tasks.workunit.client.1.smithi112.stdout:4/793: write d2/d1e/f74 [2755296,45446] 0 2024-04-25T02:09:14.772 INFO:tasks.workunit.client.1.smithi112.stdout:4/794: truncate d2/d17/d20/d26/ffe 730943 0 2024-04-25T02:09:14.775 INFO:tasks.workunit.client.1.smithi112.stdout:8/898: mkdir d15/d17/d130/d136 0 2024-04-25T02:09:14.776 INFO:tasks.workunit.client.1.smithi112.stdout:4/795: dread d2/d17/d20/f6b [0,4194304] 0 2024-04-25T02:09:14.777 INFO:tasks.workunit.client.1.smithi112.stdout:7/632: dread d7/dd/f21 [0,4194304] 0 2024-04-25T02:09:14.778 INFO:tasks.workunit.client.1.smithi112.stdout:8/899: mkdir d15/d35/d5c/d5e/d137 0 2024-04-25T02:09:14.778 INFO:tasks.workunit.client.1.smithi112.stdout:8/900: stat d15/d26/d4f/d67/de0 0 2024-04-25T02:09:14.779 INFO:tasks.workunit.client.1.smithi112.stdout:8/901: write d15/d26/d4f/fd4 [3909086,72036] 0 2024-04-25T02:09:14.780 INFO:tasks.workunit.client.1.smithi112.stdout:4/796: rename d2/d17/d7c/ldb to d2/d1e/d1b/d67/dfc/l104 0 2024-04-25T02:09:14.780 INFO:tasks.workunit.client.1.smithi112.stdout:8/902: dread d15/f121 [0,4194304] 0 2024-04-25T02:09:14.781 INFO:tasks.workunit.client.1.smithi112.stdout:4/797: read d2/d17/fc2 [675910,30804] 0 2024-04-25T02:09:14.784 INFO:tasks.workunit.client.1.smithi112.stdout:4/798: mknod d2/d1e/d1b/c105 0 2024-04-25T02:09:14.784 INFO:tasks.workunit.client.1.smithi112.stdout:4/799: write d2/d17/d20/d26/d39/f68 [2308955,58890] 0 2024-04-25T02:09:14.786 INFO:tasks.workunit.client.1.smithi112.stdout:8/903: mknod d15/d17/d1a/c138 0 2024-04-25T02:09:14.788 INFO:tasks.workunit.client.1.smithi112.stdout:4/800: rename d2/d17/d20/d5e/daf to d2/d17/d20/d26/d39/d106 0 2024-04-25T02:09:14.790 INFO:tasks.workunit.client.1.smithi112.stdout:8/904: mkdir d15/d26/d4f/d67/de0/df5/d139 0 2024-04-25T02:09:14.790 INFO:tasks.workunit.client.1.smithi112.stdout:7/633: write d7/dd/d20/d2c/f45 [2707153,34217] 0 2024-04-25T02:09:14.790 INFO:tasks.workunit.client.1.smithi112.stdout:7/634: truncate d7/f17 1838472 0 2024-04-25T02:09:14.792 INFO:tasks.workunit.client.1.smithi112.stdout:4/801: creat d2/d17/d20/f107 x:0 0 0 2024-04-25T02:09:14.792 INFO:tasks.workunit.client.1.smithi112.stdout:8/905: write d15/d35/d5f/fef [184599,87885] 0 2024-04-25T02:09:14.792 INFO:tasks.workunit.client.1.smithi112.stdout:8/906: creat d15/d26/d37/d52/f13a x:0 0 0 2024-04-25T02:09:14.792 INFO:tasks.workunit.client.1.smithi112.stdout:8/907: read d15/d26/d4f/d67/ff3 [816565,104511] 0 2024-04-25T02:09:14.793 INFO:tasks.workunit.client.1.smithi112.stdout:6/647: dwrite d0/d2/d2c/f2e [4194304,4194304] 0 2024-04-25T02:09:14.793 INFO:tasks.workunit.client.1.smithi112.stdout:6/648: write d0/d2/d4/f1d [5327138,44384] 0 2024-04-25T02:09:14.798 INFO:tasks.workunit.client.1.smithi112.stdout:6/649: mknod d0/d2/d2c/d41/cdd 0 2024-04-25T02:09:14.800 INFO:tasks.workunit.client.1.smithi112.stdout:8/908: dread d15/d26/f3a [0,4194304] 0 2024-04-25T02:09:14.800 INFO:tasks.workunit.client.1.smithi112.stdout:8/909: creat d15/d35/d5c/d5e/d85/f13b x:0 0 0 2024-04-25T02:09:14.800 INFO:tasks.workunit.client.1.smithi112.stdout:8/910: write d15/d35/d5c/de4/dfd/d119/f131 [367076,19270] 0 2024-04-25T02:09:14.803 INFO:tasks.workunit.client.1.smithi112.stdout:0/819: dwrite da/d13/d45/f5a [0,4194304] 0 2024-04-25T02:09:14.804 INFO:tasks.workunit.client.1.smithi112.stdout:8/911: read d15/d40/f60 [362170,118439] 0 2024-04-25T02:09:14.804 INFO:tasks.workunit.client.1.smithi112.stdout:8/912: fsync d15/d81/dce/ffa 0 2024-04-25T02:09:14.809 INFO:tasks.workunit.client.1.smithi112.stdout:8/913: rmdir d15/d17/d130/d136 0 2024-04-25T02:09:14.816 INFO:tasks.workunit.client.1.smithi112.stdout:0/820: dread da/d1d/d88/d24/f9c [0,4194304] 0 2024-04-25T02:09:14.816 INFO:tasks.workunit.client.1.smithi112.stdout:0/821: write da/d1d/d2e/d40/d49/d4f/d58/d6d/f8b [833654,88783] 0 2024-04-25T02:09:14.816 INFO:tasks.workunit.client.1.smithi112.stdout:0/822: write da/f32 [1544329,56266] 0 2024-04-25T02:09:14.817 INFO:tasks.workunit.client.1.smithi112.stdout:0/823: mknod da/d13/d45/d5e/d7a/c107 0 2024-04-25T02:09:14.817 INFO:tasks.workunit.client.1.smithi112.stdout:0/824: getdents da/d13/d1e/de0 0 2024-04-25T02:09:14.817 INFO:tasks.workunit.client.1.smithi112.stdout:0/825: rename da/d1d/d2e/d40/d49 to da/d1d/d2e/d40/d49/d4f/d82/d108 22 2024-04-25T02:09:14.818 INFO:tasks.workunit.client.1.smithi112.stdout:0/826: unlink da/l34 0 2024-04-25T02:09:14.820 INFO:tasks.workunit.client.1.smithi112.stdout:0/827: rmdir da/d1d/d88 39 2024-04-25T02:09:14.820 INFO:tasks.workunit.client.1.smithi112.stdout:0/828: chown da/d13/d23 920330577 1 2024-04-25T02:09:14.821 INFO:tasks.workunit.client.1.smithi112.stdout:7/635: dwrite d7/d25/d40/f80 [0,4194304] 0 2024-04-25T02:09:14.821 INFO:tasks.workunit.client.1.smithi112.stdout:4/802: dwrite d2/d17/d20/f6b [0,4194304] 0 2024-04-25T02:09:14.822 INFO:tasks.workunit.client.1.smithi112.stdout:4/803: dread d2/d1e/d5c/fd6 [0,4194304] 0 2024-04-25T02:09:14.825 INFO:tasks.workunit.client.1.smithi112.stdout:7/636: creat d7/dd/d88/db6/fc4 x:0 0 0 2024-04-25T02:09:14.825 INFO:tasks.workunit.client.1.smithi112.stdout:7/637: fsync d7/d79/da2/f7c 0 2024-04-25T02:09:14.825 INFO:tasks.workunit.client.1.smithi112.stdout:7/638: chown d7/dd/da9/l63 396107 1 2024-04-25T02:09:14.825 INFO:tasks.workunit.client.1.smithi112.stdout:7/639: readlink d7/d25/d43/l31 0 2024-04-25T02:09:14.830 INFO:tasks.workunit.client.1.smithi112.stdout:7/640: creat d7/d25/fc5 x:0 0 0 2024-04-25T02:09:14.830 INFO:tasks.workunit.client.1.smithi112.stdout:7/641: chown d7/d25/d40/d6b/d91/lac 320 1 2024-04-25T02:09:14.831 INFO:tasks.workunit.client.1.smithi112.stdout:4/804: write d2/d1e/d42/f47 [2578645,113877] 0 2024-04-25T02:09:14.832 INFO:tasks.workunit.client.1.smithi112.stdout:0/829: dread da/d1d/d88/d24/d97/ffe [0,4194304] 0 2024-04-25T02:09:14.832 INFO:tasks.workunit.client.1.smithi112.stdout:0/830: creat da/d13/d45/d5e/d7a/f109 x:0 0 0 2024-04-25T02:09:14.833 INFO:tasks.workunit.client.1.smithi112.stdout:4/805: rmdir d2/d1e/db3 39 2024-04-25T02:09:14.833 INFO:tasks.workunit.client.1.smithi112.stdout:4/806: write d2/d12/fa9 [484033,110455] 0 2024-04-25T02:09:14.835 INFO:tasks.workunit.client.1.smithi112.stdout:0/831: mkdir da/d1d/d2e/dbd/d10a 0 2024-04-25T02:09:14.835 INFO:tasks.workunit.client.1.smithi112.stdout:0/832: chown da/d1d/d2e/d40/d49/d5f/lb7 418 1 2024-04-25T02:09:14.836 INFO:tasks.workunit.client.1.smithi112.stdout:0/833: fdatasync da/f46 0 2024-04-25T02:09:14.836 INFO:tasks.workunit.client.1.smithi112.stdout:0/834: fdatasync da/d13/d23/d77/fb6 0 2024-04-25T02:09:14.837 INFO:tasks.workunit.client.1.smithi112.stdout:0/835: unlink da/d1d/d2e/d40/d49/f98 0 2024-04-25T02:09:14.838 INFO:tasks.workunit.client.1.smithi112.stdout:0/836: mkdir da/d13/d23/d77/d10b 0 2024-04-25T02:09:14.846 INFO:tasks.workunit.client.1.smithi112.stdout:4/807: dread d2/f2d [0,4194304] 0 2024-04-25T02:09:14.848 INFO:tasks.workunit.client.1.smithi112.stdout:4/808: symlink d2/d17/d20/d5e/l108 0 2024-04-25T02:09:14.851 INFO:tasks.workunit.client.1.smithi112.stdout:4/809: mkdir d2/d1e/d5c/d109 0 2024-04-25T02:09:14.859 INFO:tasks.workunit.client.1.smithi112.stdout:7/642: dwrite d7/d79/da2/d3a/f9d [0,4194304] 0 2024-04-25T02:09:14.862 INFO:tasks.workunit.client.1.smithi112.stdout:0/837: dwrite da/d1d/d2e/d40/d49/d4f/d58/d6d/f8b [0,4194304] 0 2024-04-25T02:09:14.862 INFO:tasks.workunit.client.1.smithi112.stdout:0/838: fsync da/d13/fa5 0 2024-04-25T02:09:14.882 INFO:tasks.workunit.client.1.smithi112.stdout:7/643: dwrite d7/d25/d43/d46/f8e [0,4194304] 0 2024-04-25T02:09:14.885 INFO:tasks.workunit.client.1.smithi112.stdout:0/839: dwrite da/d13/d45/d5e/fb8 [0,4194304] 0 2024-04-25T02:09:14.885 INFO:tasks.workunit.client.1.smithi112.stdout:0/840: fdatasync da/d13/d1e/f4e 0 2024-04-25T02:09:14.892 INFO:tasks.workunit.client.1.smithi112.stdout:7/644: dread d7/d25/d43/f60 [0,4194304] 0 2024-04-25T02:09:14.892 INFO:tasks.workunit.client.1.smithi112.stdout:7/645: chown d7/d25/d43/dbc 578 1 2024-04-25T02:09:14.898 INFO:tasks.workunit.client.1.smithi112.stdout:0/841: unlink da/d1d/d2e/d40/d49/d6b/d90/cde 0 2024-04-25T02:09:14.898 INFO:tasks.workunit.client.1.smithi112.stdout:0/842: read - da/d1d/d2e/d40/d49/d4f/d82/f106 zero size 2024-04-25T02:09:14.905 INFO:tasks.workunit.client.1.smithi112.stdout:7/646: rename d7/d25/d40/d6b/f9e to d7/dd/d20/fc6 0 2024-04-25T02:09:14.905 INFO:tasks.workunit.client.1.smithi112.stdout:7/647: write d7/dd/f1d [3403167,41772] 0 2024-04-25T02:09:14.907 INFO:tasks.workunit.client.1.smithi112.stdout:0/843: unlink da/d1d/d2e/d40/d49/d4f/l56 0 2024-04-25T02:09:14.907 INFO:tasks.workunit.client.1.smithi112.stdout:0/844: truncate da/d1d/d2e/d40/d49/d6b/d90/fc6 2091478 0 2024-04-25T02:09:14.909 INFO:tasks.workunit.client.1.smithi112.stdout:7/648: mknod d7/cc7 0 2024-04-25T02:09:14.911 INFO:tasks.workunit.client.1.smithi112.stdout:7/649: symlink d7/d79/db8/lc8 0 2024-04-25T02:09:14.911 INFO:tasks.workunit.client.1.smithi112.stdout:7/650: truncate d7/dd/d20/fbb 906071 0 2024-04-25T02:09:14.911 INFO:tasks.workunit.client.1.smithi112.stdout:7/651: chown d7/d79/da2/fb5 3108 1 2024-04-25T02:09:14.912 INFO:tasks.workunit.client.1.smithi112.stdout:7/652: link d7/d25/d40/da3/f56 d7/fc9 0 2024-04-25T02:09:14.929 INFO:tasks.workunit.client.1.smithi112.stdout:7/653: dwrite d7/dd/f21 [4194304,4194304] 0 2024-04-25T02:09:14.929 INFO:tasks.workunit.client.1.smithi112.stdout:0/845: dwrite da/d1d/d88/d24/f2c [0,4194304] 0 2024-04-25T02:09:14.932 INFO:tasks.workunit.client.1.smithi112.stdout:7/654: mkdir d7/d25/d43/dca 0 2024-04-25T02:09:14.934 INFO:tasks.workunit.client.1.smithi112.stdout:0/846: getdents da/d13/d45/d5e/db4 0 2024-04-25T02:09:14.943 INFO:tasks.workunit.client.1.smithi112.stdout:0/847: dread da/d1d/d2e/d40/d49/d6b/fae [0,4194304] 0 2024-04-25T02:09:14.946 INFO:tasks.workunit.client.1.smithi112.stdout:0/848: dread da/d1d/d2e/d40/d49/d6b/d90/fac [0,4194304] 0 2024-04-25T02:09:14.952 INFO:tasks.workunit.client.1.smithi112.stdout:7/655: dwrite d7/d25/d40/d51/fbe [0,4194304] 0 2024-04-25T02:09:14.956 INFO:tasks.workunit.client.1.smithi112.stdout:7/656: creat d7/dd/d20/fcb x:0 0 0 2024-04-25T02:09:14.961 INFO:tasks.workunit.client.1.smithi112.stdout:0/849: dwrite da/d13/d1e/de0/deb/ff2 [0,4194304] 0 2024-04-25T02:09:14.961 INFO:tasks.workunit.client.1.smithi112.stdout:0/850: fdatasync da/f10 0 2024-04-25T02:09:14.963 INFO:tasks.workunit.client.1.smithi112.stdout:0/851: unlink da/d1d/d2e/d40/d49/d6b/f73 0 2024-04-25T02:09:14.967 INFO:tasks.workunit.client.1.smithi112.stdout:0/852: creat da/d13/d1e/db1/f10c x:0 0 0 2024-04-25T02:09:14.967 INFO:tasks.workunit.client.1.smithi112.stdout:0/853: write da/d1d/d2e/d40/d49/d4f/d58/fb5 [944689,49179] 0 2024-04-25T02:09:14.967 INFO:tasks.workunit.client.1.smithi112.stdout:7/657: dread d7/dd/f1c [0,4194304] 0 2024-04-25T02:09:14.967 INFO:tasks.workunit.client.1.smithi112.stdout:7/658: fsync d7/d25/d43/f75 0 2024-04-25T02:09:14.967 INFO:tasks.workunit.client.1.smithi112.stdout:7/659: fdatasync d7/dd/d20/db2/fc3 0 2024-04-25T02:09:14.969 INFO:tasks.workunit.client.1.smithi112.stdout:0/854: mknod da/d1d/d2e/d40/d49/d6b/c10d 0 2024-04-25T02:09:14.971 INFO:tasks.workunit.client.1.smithi112.stdout:7/660: unlink d7/dd/fba 0 2024-04-25T02:09:14.973 INFO:tasks.workunit.client.1.smithi112.stdout:0/855: creat da/d13/f10e x:0 0 0 2024-04-25T02:09:14.976 INFO:tasks.workunit.client.1.smithi112.stdout:0/856: mknod da/d1d/d88/d24/c10f 0 2024-04-25T02:09:14.978 INFO:tasks.workunit.client.1.smithi112.stdout:1/700: sync 2024-04-25T02:09:14.979 INFO:tasks.workunit.client.1.smithi112.stdout:5/549: sync 2024-04-25T02:09:14.979 INFO:tasks.workunit.client.1.smithi112.stdout:1/701: dread d7/d9/d1e/de/d9a/fba [0,4194304] 0 2024-04-25T02:09:14.984 INFO:tasks.workunit.client.1.smithi112.stdout:5/550: unlink d1/d16/l1a 0 2024-04-25T02:09:14.988 INFO:tasks.workunit.client.1.smithi112.stdout:1/702: link d7/d9/d4e/d28/f70 d7/d9/d1e/de/fe1 0 2024-04-25T02:09:14.989 INFO:tasks.workunit.client.1.smithi112.stdout:1/703: write d7/d9/d51/d58/f5b [5775281,43171] 0 2024-04-25T02:09:14.989 INFO:tasks.workunit.client.1.smithi112.stdout:1/704: truncate d7/d4b/d94/fbe 628375 0 2024-04-25T02:09:14.991 INFO:tasks.workunit.client.1.smithi112.stdout:7/661: dwrite d7/dd/f1c [0,4194304] 0 2024-04-25T02:09:14.991 INFO:tasks.workunit.client.1.smithi112.stdout:7/662: readlink d7/d79/db8/lc8 0 2024-04-25T02:09:14.997 INFO:tasks.workunit.client.1.smithi112.stdout:1/705: mkdir d7/d9/d1e/d40/de2 0 2024-04-25T02:09:14.997 INFO:tasks.workunit.client.1.smithi112.stdout:1/706: creat d7/d9/d1e/d66/dc6/fe3 x:0 0 0 2024-04-25T02:09:14.997 INFO:tasks.workunit.client.1.smithi112.stdout:5/551: write d1/d3f/d9c/fa1 [2485501,46977] 0 2024-04-25T02:09:14.997 INFO:tasks.workunit.client.1.smithi112.stdout:5/552: chown d1/c39 3465 1 2024-04-25T02:09:14.997 INFO:tasks.workunit.client.1.smithi112.stdout:5/553: creat d1/d3f/d9c/fbc x:0 0 0 2024-04-25T02:09:14.997 INFO:tasks.workunit.client.1.smithi112.stdout:5/554: readlink d1/d16/d51/lad 0 2024-04-25T02:09:14.999 INFO:tasks.workunit.client.1.smithi112.stdout:7/663: symlink d7/d25/d40/d51/d77/lcc 0 2024-04-25T02:09:14.999 INFO:tasks.workunit.client.1.smithi112.stdout:7/664: fsync d7/dd/d20/f96 0 2024-04-25T02:09:15.009 INFO:tasks.workunit.client.1.smithi112.stdout:0/857: dwrite da/fb [0,4194304] 0 2024-04-25T02:09:15.009 INFO:tasks.workunit.client.1.smithi112.stdout:7/665: dread d7/d79/da2/f8b [0,4194304] 0 2024-04-25T02:09:15.011 INFO:tasks.workunit.client.1.smithi112.stdout:0/858: truncate da/d1d/d88/f50 3544912 0 2024-04-25T02:09:15.016 INFO:tasks.workunit.client.1.smithi112.stdout:0/859: creat da/d1d/d88/f110 x:0 0 0 2024-04-25T02:09:15.016 INFO:tasks.workunit.client.1.smithi112.stdout:0/860: dread - da/d1d/d2e/d40/d49/d4f/d82/f106 zero size 2024-04-25T02:09:15.022 INFO:tasks.workunit.client.1.smithi112.stdout:0/861: symlink da/d1d/dcb/l111 0 2024-04-25T02:09:15.024 INFO:tasks.workunit.client.1.smithi112.stdout:0/862: rename da/d1d/d2e/d40/d49/d4f/d82/f106 to da/d1d/d88/d78/f112 0 2024-04-25T02:09:15.026 INFO:tasks.workunit.client.1.smithi112.stdout:0/863: creat da/d1d/d2e/d40/d49/f113 x:0 0 0 2024-04-25T02:09:15.026 INFO:tasks.workunit.client.1.smithi112.stdout:0/864: fsync da/d1d/d2e/d40/d49/d6b/fae 0 2024-04-25T02:09:15.026 INFO:tasks.workunit.client.1.smithi112.stdout:0/865: chown da/d1d/d88/l38 1445 1 2024-04-25T02:09:15.026 INFO:tasks.workunit.client.1.smithi112.stdout:0/866: read da/f46 [542702,117440] 0 2024-04-25T02:09:15.033 INFO:tasks.workunit.client.1.smithi112.stdout:5/555: dwrite d1/d16/d22/f37 [0,4194304] 0 2024-04-25T02:09:15.033 INFO:tasks.workunit.client.1.smithi112.stdout:5/556: dread - d1/d16/d8f/fa7 zero size 2024-04-25T02:09:15.033 INFO:tasks.workunit.client.1.smithi112.stdout:5/557: creat d1/d16/d8f/fbd x:0 0 0 2024-04-25T02:09:15.033 INFO:tasks.workunit.client.1.smithi112.stdout:7/666: dwrite d7/dd/da9/d74/fa0 [0,4194304] 0 2024-04-25T02:09:15.033 INFO:tasks.workunit.client.1.smithi112.stdout:1/707: dwrite d7/d9/d51/fce [0,4194304] 0 2024-04-25T02:09:15.041 INFO:tasks.workunit.client.1.smithi112.stdout:7/667: dread d7/dd/f9f [0,4194304] 0 2024-04-25T02:09:15.041 INFO:tasks.workunit.client.1.smithi112.stdout:7/668: fdatasync d7/f13 0 2024-04-25T02:09:15.041 INFO:tasks.workunit.client.1.smithi112.stdout:7/669: chown d7/d79/fae 70278 1 2024-04-25T02:09:15.046 INFO:tasks.workunit.client.1.smithi112.stdout:5/558: symlink d1/d3f/d9c/lbe 0 2024-04-25T02:09:15.047 INFO:tasks.workunit.client.1.smithi112.stdout:0/867: dwrite da/fb [0,4194304] 0 2024-04-25T02:09:15.049 INFO:tasks.workunit.client.1.smithi112.stdout:1/708: link d7/d9/d4e/cd1 d7/d9/d1e/dab/ce4 0 2024-04-25T02:09:15.051 INFO:tasks.workunit.client.1.smithi112.stdout:7/670: rename d7/d25/d43/f60 to d7/d79/da2/d3a/fcd 0 2024-04-25T02:09:15.053 INFO:tasks.workunit.client.1.smithi112.stdout:0/868: chown da/d13/d1e/l47 92559762 1 2024-04-25T02:09:15.061 INFO:tasks.workunit.client.1.smithi112.stdout:0/869: write da/d1d/f43 [1409459,41060] 0 2024-04-25T02:09:15.061 INFO:tasks.workunit.client.1.smithi112.stdout:0/870: chown da/d1d/d88/d80/lb2 1888706 1 2024-04-25T02:09:15.064 INFO:tasks.workunit.client.1.smithi112.stdout:0/871: write da/d1d/d2e/d40/d49/d6b/d90/fac [3266808,106921] 0 2024-04-25T02:09:15.073 INFO:tasks.workunit.client.1.smithi112.stdout:5/559: dwrite d1/d41/d5b/d6b/fa5 [0,4194304] 0 2024-04-25T02:09:15.073 INFO:tasks.workunit.client.1.smithi112.stdout:5/560: dread - d1/d2/f74 zero size 2024-04-25T02:09:15.073 INFO:tasks.workunit.client.1.smithi112.stdout:1/709: dwrite d7/d9/d4e/d28/d3f/fa3 [0,4194304] 0 2024-04-25T02:09:15.076 INFO:tasks.workunit.client.1.smithi112.stdout:5/561: mknod d1/d2/d28/d4f/cbf 0 2024-04-25T02:09:15.078 INFO:tasks.workunit.client.1.smithi112.stdout:7/671: dwrite d7/dd/d88/f8a [0,4194304] 0 2024-04-25T02:09:15.081 INFO:tasks.workunit.client.1.smithi112.stdout:1/710: rename d7/d9/d1e/d66/dc6/dd2 to d7/d4b/d94/de5 0 2024-04-25T02:09:15.081 INFO:tasks.workunit.client.1.smithi112.stdout:1/711: readlink d7/d9/d51/d83/lbf 0 2024-04-25T02:09:15.085 INFO:tasks.workunit.client.1.smithi112.stdout:5/562: mkdir d1/d41/d5b/d7b/db2/dc0 0 2024-04-25T02:09:15.085 INFO:tasks.workunit.client.1.smithi112.stdout:1/712: read d7/d9/d1e/de/f17 [4659966,34017] 0 2024-04-25T02:09:15.086 INFO:tasks.workunit.client.1.smithi112.stdout:1/713: write d7/d9/d1e/de/fbc [990812,67588] 0 2024-04-25T02:09:15.089 INFO:tasks.workunit.client.1.smithi112.stdout:0/872: dwrite da/f26 [0,4194304] 0 2024-04-25T02:09:15.095 INFO:tasks.workunit.client.1.smithi112.stdout:5/563: symlink d1/d16/d98/lc1 0 2024-04-25T02:09:15.097 INFO:tasks.workunit.client.1.smithi112.stdout:1/714: mkdir d7/d9/d1e/d40/de2/de6 0 2024-04-25T02:09:15.097 INFO:tasks.workunit.client.1.smithi112.stdout:1/715: chown d7/d9/f8c 53667766 1 2024-04-25T02:09:15.098 INFO:tasks.workunit.client.1.smithi112.stdout:0/873: symlink da/d1d/d2e/d40/dad/l114 0 2024-04-25T02:09:15.098 INFO:tasks.workunit.client.1.smithi112.stdout:0/874: chown da/d1d/d88/d78/de7 44 1 2024-04-25T02:09:15.100 INFO:tasks.workunit.client.1.smithi112.stdout:0/875: dread da/d1d/dcb/fe6 [0,4194304] 0 2024-04-25T02:09:15.100 INFO:tasks.workunit.client.1.smithi112.stdout:0/876: creat da/d1d/d88/f115 x:0 0 0 2024-04-25T02:09:15.100 INFO:tasks.workunit.client.1.smithi112.stdout:0/877: fdatasync da/d1d/d88/d24/f33 0 2024-04-25T02:09:15.101 INFO:tasks.workunit.client.1.smithi112.stdout:5/564: creat d1/d2/d7d/fc2 x:0 0 0 2024-04-25T02:09:15.101 INFO:tasks.workunit.client.1.smithi112.stdout:5/565: dread - d1/d2/f74 zero size 2024-04-25T02:09:15.102 INFO:tasks.workunit.client.1.smithi112.stdout:5/566: truncate d1/d2/d28/d4f/fac 363808 0 2024-04-25T02:09:15.102 INFO:tasks.workunit.client.1.smithi112.stdout:5/567: fsync d1/d16/d51/f5f 0 2024-04-25T02:09:15.102 INFO:tasks.workunit.client.1.smithi112.stdout:5/568: chown d1/d3f/d9c/lae 6190886 1 2024-04-25T02:09:15.102 INFO:tasks.workunit.client.1.smithi112.stdout:5/569: write d1/f50 [3463061,76296] 0 2024-04-25T02:09:15.102 INFO:tasks.workunit.client.1.smithi112.stdout:1/716: mkdir d7/d9/d4e/d28/de7 0 2024-04-25T02:09:15.102 INFO:tasks.workunit.client.1.smithi112.stdout:1/717: stat d7/d9/d1e/de/d84/fca 0 2024-04-25T02:09:15.106 INFO:tasks.workunit.client.1.smithi112.stdout:0/878: unlink da/d1d/d88/f60 0 2024-04-25T02:09:15.109 INFO:tasks.workunit.client.1.smithi112.stdout:5/570: symlink d1/dba/lc3 0 2024-04-25T02:09:15.110 INFO:tasks.workunit.client.1.smithi112.stdout:1/718: write d7/d9/d51/d58/f5b [3288342,4338] 0 2024-04-25T02:09:15.113 INFO:tasks.workunit.client.1.smithi112.stdout:0/879: dread da/d1d/d2e/d40/f41 [0,4194304] 0 2024-04-25T02:09:15.118 INFO:tasks.workunit.client.1.smithi112.stdout:0/880: dread da/d13/d23/d77/f95 [0,4194304] 0 2024-04-25T02:09:15.121 INFO:tasks.workunit.client.1.smithi112.stdout:5/571: rename d1/d3f to d1/d2/d4/dc4 0 2024-04-25T02:09:15.121 INFO:tasks.workunit.client.1.smithi112.stdout:5/572: fsync d1/d41/d5b/f80 0 2024-04-25T02:09:15.123 INFO:tasks.workunit.client.1.smithi112.stdout:0/881: link da/d13/d1e/l68 da/d13/d45/d5e/l116 0 2024-04-25T02:09:15.123 INFO:tasks.workunit.client.1.smithi112.stdout:0/882: write da/d1d/d2e/d40/d49/d4f/d58/f7c [1070194,64591] 0 2024-04-25T02:09:15.125 INFO:tasks.workunit.client.1.smithi112.stdout:0/883: creat da/d1d/d2e/dbd/f117 x:0 0 0 2024-04-25T02:09:15.126 INFO:tasks.workunit.client.1.smithi112.stdout:5/573: unlink d1/d2/c38 0 2024-04-25T02:09:15.128 INFO:tasks.workunit.client.1.smithi112.stdout:0/884: creat da/d1d/d88/d78/f118 x:0 0 0 2024-04-25T02:09:15.128 INFO:tasks.workunit.client.1.smithi112.stdout:0/885: chown da/d1d/d2e/d40/d49/d4f/d58/d6d 609174 1 2024-04-25T02:09:15.128 INFO:tasks.workunit.client.1.smithi112.stdout:5/574: symlink d1/d6c/lc5 0 2024-04-25T02:09:15.130 INFO:tasks.workunit.client.1.smithi112.stdout:0/886: rename da/d13/d23/fd0 to da/d1d/d88/d80/f119 0 2024-04-25T02:09:15.169 INFO:tasks.workunit.client.1.smithi112.stdout:0/887: mknod da/d13/d1e/de0/c11a 0 2024-04-25T02:09:15.170 INFO:tasks.workunit.client.1.smithi112.stdout:5/575: rmdir d1/d2/d7d 39 2024-04-25T02:09:15.174 INFO:tasks.workunit.client.1.smithi112.stdout:5/576: symlink d1/d2/d45/lc6 0 2024-04-25T02:09:15.174 INFO:tasks.workunit.client.1.smithi112.stdout:9/619: sync 2024-04-25T02:09:15.174 INFO:tasks.workunit.client.1.smithi112.stdout:0/888: getdents da/d1d/d2e/d40/d49/d4f/d82 0 2024-04-25T02:09:15.178 INFO:tasks.workunit.client.1.smithi112.stdout:9/620: creat d1/df/d8f/dd2/fd4 x:0 0 0 2024-04-25T02:09:15.178 INFO:tasks.workunit.client.1.smithi112.stdout:9/621: write d1/d13/d5b/fa8 [839250,114196] 0 2024-04-25T02:09:15.183 INFO:tasks.workunit.client.1.smithi112.stdout:5/577: dread d1/f8 [0,4194304] 0 2024-04-25T02:09:15.184 INFO:tasks.workunit.client.1.smithi112.stdout:5/578: link d1/d16/d22/f37 d1/d16/d22/fc7 0 2024-04-25T02:09:15.186 INFO:tasks.workunit.client.1.smithi112.stdout:5/579: creat d1/d16/d51/d93/fc8 x:0 0 0 2024-04-25T02:09:15.187 INFO:tasks.workunit.client.1.smithi112.stdout:0/889: dwrite da/d13/fa8 [0,4194304] 0 2024-04-25T02:09:15.187 INFO:tasks.workunit.client.1.smithi112.stdout:0/890: chown da/d1d/d88/d80/f119 5 1 2024-04-25T02:09:15.190 INFO:tasks.workunit.client.1.smithi112.stdout:0/891: creat da/d13/d45/d5e/f11b x:0 0 0 2024-04-25T02:09:15.197 INFO:tasks.workunit.client.1.smithi112.stdout:0/892: creat da/d13/d23/d77/f11c x:0 0 0 2024-04-25T02:09:15.197 INFO:tasks.workunit.client.1.smithi112.stdout:0/893: dread - da/d1d/d2e/d40/dad/fec zero size 2024-04-25T02:09:15.198 INFO:tasks.workunit.client.1.smithi112.stdout:5/580: write d1/d16/d99/fb8 [3574798,109019] 0 2024-04-25T02:09:15.198 INFO:tasks.workunit.client.1.smithi112.stdout:0/894: mknod da/d1d/d88/c11d 0 2024-04-25T02:09:15.198 INFO:tasks.workunit.client.1.smithi112.stdout:0/895: fdatasync da/d1d/d2e/d40/d49/f113 0 2024-04-25T02:09:15.201 INFO:tasks.workunit.client.1.smithi112.stdout:0/896: creat da/d13/d45/d5e/db4/f11e x:0 0 0 2024-04-25T02:09:15.202 INFO:tasks.workunit.client.1.smithi112.stdout:0/897: truncate da/fb 3792884 0 2024-04-25T02:09:15.213 INFO:tasks.workunit.client.1.smithi112.stdout:0/898: dread da/d1d/d88/d24/f2c [0,4194304] 0 2024-04-25T02:09:15.215 INFO:tasks.workunit.client.1.smithi112.stdout:5/581: dwrite d1/d41/d5b/d7b/f7f [4194304,4194304] 0 2024-04-25T02:09:15.216 INFO:tasks.workunit.client.1.smithi112.stdout:5/582: chown d1/d2/d4/dc4/l4a 18948476 1 2024-04-25T02:09:15.216 INFO:tasks.workunit.client.1.smithi112.stdout:5/583: fdatasync d1/faa 0 2024-04-25T02:09:15.217 INFO:tasks.workunit.client.1.smithi112.stdout:5/584: mkdir d1/d2/d4/d1d/dc9 0 2024-04-25T02:09:15.218 INFO:tasks.workunit.client.1.smithi112.stdout:5/585: unlink d1/d2/d45/f4c 0 2024-04-25T02:09:15.218 INFO:tasks.workunit.client.1.smithi112.stdout:5/586: write d1/d41/d5b/d7b/fa8 [761496,39884] 0 2024-04-25T02:09:15.229 INFO:tasks.workunit.client.1.smithi112.stdout:5/587: dread d1/d2/d78/f81 [0,4194304] 0 2024-04-25T02:09:15.231 INFO:tasks.workunit.client.1.smithi112.stdout:5/588: mknod d1/d41/d8a/cca 0 2024-04-25T02:09:15.236 INFO:tasks.workunit.client.1.smithi112.stdout:0/899: dwrite da/d13/d1e/f3c [0,4194304] 0 2024-04-25T02:09:15.239 INFO:tasks.workunit.client.1.smithi112.stdout:0/900: creat da/d1d/d2e/d40/d49/d4f/d58/d6d/dd4/f11f x:0 0 0 2024-04-25T02:09:15.240 INFO:tasks.workunit.client.1.smithi112.stdout:0/901: creat da/d13/d23/d77/d10b/f120 x:0 0 0 2024-04-25T02:09:15.240 INFO:tasks.workunit.client.1.smithi112.stdout:0/902: truncate da/d1d/d88/d24/f2a 1918331 0 2024-04-25T02:09:15.240 INFO:tasks.workunit.client.1.smithi112.stdout:0/903: mknod da/d1d/d88/d24/d97/c121 0 2024-04-25T02:09:15.247 INFO:tasks.workunit.client.1.smithi112.stdout:0/904: dread da/d1d/d2e/d40/d49/d4f/d58/f6e [0,4194304] 0 2024-04-25T02:09:15.248 INFO:tasks.workunit.client.1.smithi112.stdout:0/905: symlink da/d1d/d2e/d40/dad/l122 0 2024-04-25T02:09:15.252 INFO:tasks.workunit.client.1.smithi112.stdout:5/589: dwrite d1/d2/d4/f54 [0,4194304] 0 2024-04-25T02:09:15.260 INFO:tasks.workunit.client.1.smithi112.stdout:0/906: write da/d13/d1e/f3f [220000,96449] 0 2024-04-25T02:09:15.276 INFO:tasks.workunit.client.1.smithi112.stdout:5/590: rmdir d1/d2/d4/dc4/d76 0 2024-04-25T02:09:15.280 INFO:tasks.workunit.client.1.smithi112.stdout:0/907: getdents da/d1d/d2e/d40/d49/d6b/d90 0 2024-04-25T02:09:15.281 INFO:tasks.workunit.client.1.smithi112.stdout:5/591: mknod d1/d2/d28/ccb 0 2024-04-25T02:09:15.288 INFO:tasks.workunit.client.1.smithi112.stdout:0/908: write da/f32 [1908659,46198] 0 2024-04-25T02:09:15.295 INFO:tasks.workunit.client.1.smithi112.stdout:5/592: chown d1/d2/c3c 83 1 2024-04-25T02:09:15.305 INFO:tasks.workunit.client.1.smithi112.stdout:0/909: rename da/f94 to da/d1d/d2e/d40/d49/d4f/d58/de9/f123 0 2024-04-25T02:09:15.305 INFO:tasks.workunit.client.1.smithi112.stdout:0/910: stat da/d1d/d88/f50 0 2024-04-25T02:09:15.305 INFO:tasks.workunit.client.1.smithi112.stdout:0/911: creat da/d1d/d2e/dbd/f124 x:0 0 0 2024-04-25T02:09:15.305 INFO:tasks.workunit.client.1.smithi112.stdout:0/912: chown da/d1d/d2e/d40/d49/d4f/d82/f104 2 1 2024-04-25T02:09:15.312 INFO:tasks.workunit.client.1.smithi112.stdout:5/593: dwrite d1/d2/d28/d4f/f5d [0,4194304] 0 2024-04-25T02:09:15.316 INFO:tasks.workunit.client.1.smithi112.stdout:0/913: rename da/d13/d23/d77/d10b/f120 to da/d1d/d88/d24/f125 0 2024-04-25T02:09:15.320 INFO:tasks.workunit.client.1.smithi112.stdout:5/594: mknod d1/dba/ccc 0 2024-04-25T02:09:15.320 INFO:tasks.workunit.client.1.smithi112.stdout:5/595: write d1/d2/d28/f67 [904390,36784] 0 2024-04-25T02:09:15.320 INFO:tasks.workunit.client.1.smithi112.stdout:5/596: dread - d1/d2/f74 zero size 2024-04-25T02:09:15.320 INFO:tasks.workunit.client.1.smithi112.stdout:5/597: fsync d1/d2/d78/fb1 0 2024-04-25T02:09:15.321 INFO:tasks.workunit.client.1.smithi112.stdout:5/598: mknod d1/dba/ccd 0 2024-04-25T02:09:15.321 INFO:tasks.workunit.client.1.smithi112.stdout:5/599: mknod d1/d2/d4/d1d/dc9/cce 0 2024-04-25T02:09:15.322 INFO:tasks.workunit.client.1.smithi112.stdout:5/600: mkdir d1/d41/d5b/d7b/db2/dc0/dcf 0 2024-04-25T02:09:15.325 INFO:tasks.workunit.client.1.smithi112.stdout:5/601: mknod d1/d16/d99/cd0 0 2024-04-25T02:09:15.329 INFO:tasks.workunit.client.1.smithi112.stdout:5/602: symlink d1/d2/d28/ld1 0 2024-04-25T02:09:15.330 INFO:tasks.workunit.client.1.smithi112.stdout:0/914: write da/d13/fa8 [371133,14297] 0 2024-04-25T02:09:15.334 INFO:tasks.workunit.client.1.smithi112.stdout:5/603: mkdir d1/d41/d5b/d6b/dd2 0 2024-04-25T02:09:15.339 INFO:tasks.workunit.client.1.smithi112.stdout:5/604: unlink d1/d2/d4/dc4/d9c/lae 0 2024-04-25T02:09:15.349 INFO:tasks.workunit.client.1.smithi112.stdout:0/915: rmdir da/d13/d45/d5e 39 2024-04-25T02:09:15.349 INFO:tasks.workunit.client.1.smithi112.stdout:0/916: dread - da/d13/d45/d5e/f11b zero size 2024-04-25T02:09:15.352 INFO:tasks.workunit.client.1.smithi112.stdout:0/917: rename da/d1d/d2e/d40/dad/fe8 to da/d1d/d2e/f126 0 2024-04-25T02:09:15.355 INFO:tasks.workunit.client.1.smithi112.stdout:3/701: sync 2024-04-25T02:09:15.355 INFO:tasks.workunit.client.1.smithi112.stdout:2/641: sync 2024-04-25T02:09:15.355 INFO:tasks.workunit.client.1.smithi112.stdout:2/642: fsync d3/da/dac/dbf/f58 0 2024-04-25T02:09:15.356 INFO:tasks.workunit.client.1.smithi112.stdout:3/702: mknod d12/d13/d34/d78/d91/ce7 0 2024-04-25T02:09:15.358 INFO:tasks.workunit.client.1.smithi112.stdout:5/605: dwrite d1/d2/d4/dc4/f85 [0,4194304] 0 2024-04-25T02:09:15.358 INFO:tasks.workunit.client.1.smithi112.stdout:5/606: creat d1/d41/d5b/d7b/fd3 x:0 0 0 2024-04-25T02:09:15.358 INFO:tasks.workunit.client.1.smithi112.stdout:5/607: chown d1/c21 9302 1 2024-04-25T02:09:15.358 INFO:tasks.workunit.client.1.smithi112.stdout:5/608: chown d1/d16 350 1 2024-04-25T02:09:15.358 INFO:tasks.workunit.client.1.smithi112.stdout:5/609: write d1/d16/d51/d93/fc8 [815947,60211] 0 2024-04-25T02:09:15.358 INFO:tasks.workunit.client.1.smithi112.stdout:5/610: chown d1/d41/d5b/d7b/db2/dc0/dcf 258889 1 2024-04-25T02:09:15.358 INFO:tasks.workunit.client.1.smithi112.stdout:2/643: link d3/da/dc/ca7 d3/da/dc/d3e/cd6 0 2024-04-25T02:09:15.363 INFO:tasks.workunit.client.1.smithi112.stdout:5/611: mkdir d1/d41/d5b/d79/dd4 0 2024-04-25T02:09:15.368 INFO:tasks.workunit.client.1.smithi112.stdout:3/703: dread d12/d1f/d27/f2b [0,4194304] 0 2024-04-25T02:09:15.368 INFO:tasks.workunit.client.1.smithi112.stdout:3/704: fdatasync d12/d1f/fc6 0 2024-04-25T02:09:15.368 INFO:tasks.workunit.client.1.smithi112.stdout:5/612: mkdir d1/d41/d5b/d79/d7a/d9d/dd5 0 2024-04-25T02:09:15.373 INFO:tasks.workunit.client.1.smithi112.stdout:5/613: creat d1/d2/d4/d1d/dc9/fd6 x:0 0 0 2024-04-25T02:09:15.373 INFO:tasks.workunit.client.1.smithi112.stdout:3/705: getdents d12/d13/d34/d53/d9c 0 2024-04-25T02:09:15.373 INFO:tasks.workunit.client.1.smithi112.stdout:3/706: write d12/d1f/d27/d44/d73/d95/da5/fd9 [968981,130655] 0 2024-04-25T02:09:15.375 INFO:tasks.workunit.client.1.smithi112.stdout:5/614: symlink d1/d41/d5b/d79/d7a/ld7 0 2024-04-25T02:09:15.375 INFO:tasks.workunit.client.1.smithi112.stdout:5/615: chown d1/d2/d4/c26 39990192 1 2024-04-25T02:09:15.375 INFO:tasks.workunit.client.1.smithi112.stdout:5/616: read d1/f50 [1140211,52492] 0 2024-04-25T02:09:15.377 INFO:tasks.workunit.client.1.smithi112.stdout:3/707: unlink d12/d13/d34/d78/d83/f94 0 2024-04-25T02:09:15.377 INFO:tasks.workunit.client.1.smithi112.stdout:3/708: stat d12/d13/d34/d4a/fce 0 2024-04-25T02:09:15.377 INFO:tasks.workunit.client.1.smithi112.stdout:0/918: dwrite da/d1d/d88/d24/f2a [0,4194304] 0 2024-04-25T02:09:15.379 INFO:tasks.workunit.client.1.smithi112.stdout:5/617: symlink d1/d41/d5b/d7b/db2/ld8 0 2024-04-25T02:09:15.379 INFO:tasks.workunit.client.1.smithi112.stdout:5/618: write d1/d16/d22/fc7 [5036400,37920] 0 2024-04-25T02:09:15.379 INFO:tasks.workunit.client.1.smithi112.stdout:5/619: fsync d1/d2/d4/d1d/f25 0 2024-04-25T02:09:15.380 INFO:tasks.workunit.client.1.smithi112.stdout:2/644: dwrite d3/da/dc/d3e/df/d25/f46 [4194304,4194304] 0 2024-04-25T02:09:15.381 INFO:tasks.workunit.client.1.smithi112.stdout:3/709: rename d12/l2a to d12/le8 0 2024-04-25T02:09:15.385 INFO:tasks.workunit.client.1.smithi112.stdout:0/919: dread da/d13/d1e/f3f [0,4194304] 0 2024-04-25T02:09:15.385 INFO:tasks.workunit.client.1.smithi112.stdout:0/920: fsync da/d1d/d88/d24/f33 0 2024-04-25T02:09:15.388 INFO:tasks.workunit.client.1.smithi112.stdout:0/921: symlink da/d13/d45/d5e/d7a/l127 0 2024-04-25T02:09:15.391 INFO:tasks.workunit.client.1.smithi112.stdout:3/710: dread d12/f63 [0,4194304] 0 2024-04-25T02:09:15.391 INFO:tasks.workunit.client.1.smithi112.stdout:3/711: truncate d12/d13/d34/f64 1005109 0 2024-04-25T02:09:15.394 INFO:tasks.workunit.client.1.smithi112.stdout:3/712: creat d12/fe9 x:0 0 0 2024-04-25T02:09:15.403 INFO:tasks.workunit.client.1.smithi112.stdout:2/645: dwrite d3/da/dc/d3e/df/d30/f6c [0,4194304] 0 2024-04-25T02:09:15.403 INFO:tasks.workunit.client.1.smithi112.stdout:5/620: dwrite d1/d41/d5b/f80 [0,4194304] 0 2024-04-25T02:09:15.410 INFO:tasks.workunit.client.1.smithi112.stdout:0/922: dwrite da/d1d/d2e/d40/d49/d6b/f85 [0,4194304] 0 2024-04-25T02:09:15.410 INFO:tasks.workunit.client.1.smithi112.stdout:0/923: readlink da/d13/d45/d5e/l116 0 2024-04-25T02:09:15.425 INFO:tasks.workunit.client.1.smithi112.stdout:3/713: dwrite d12/d13/d34/d78/d83/f93 [0,4194304] 0 2024-04-25T02:09:15.448 INFO:tasks.workunit.client.1.smithi112.stdout:2/646: dwrite d3/da/dc/d3e/df/d71/dc5/fd5 [0,4194304] 0 2024-04-25T02:09:15.448 INFO:tasks.workunit.client.1.smithi112.stdout:5/621: dwrite d1/d16/d8f/fa7 [0,4194304] 0 2024-04-25T02:09:15.448 INFO:tasks.workunit.client.1.smithi112.stdout:5/622: chown d1/d2/d28 9134951 1 2024-04-25T02:09:15.448 INFO:tasks.workunit.client.1.smithi112.stdout:0/924: dwrite da/d13/d45/d5e/fca [0,4194304] 0 2024-04-25T02:09:15.448 INFO:tasks.workunit.client.1.smithi112.stdout:0/925: creat da/d1d/d2e/d40/dad/f128 x:0 0 0 2024-04-25T02:09:15.448 INFO:tasks.workunit.client.1.smithi112.stdout:3/714: dwrite d12/f19 [0,4194304] 0 2024-04-25T02:09:15.452 INFO:tasks.workunit.client.1.smithi112.stdout:2/647: getdents d3/da/dc/d20/d43/dcf 0 2024-04-25T02:09:15.452 INFO:tasks.workunit.client.1.smithi112.stdout:6/650: sync 2024-04-25T02:09:15.452 INFO:tasks.workunit.client.1.smithi112.stdout:4/810: sync 2024-04-25T02:09:15.452 INFO:tasks.workunit.client.1.smithi112.stdout:8/914: sync 2024-04-25T02:09:15.456 INFO:tasks.workunit.client.1.smithi112.stdout:0/926: dread da/d1d/d88/d78/f9d [4194304,4194304] 0 2024-04-25T02:09:15.460 INFO:tasks.workunit.client.1.smithi112.stdout:5/623: dread d1/f8 [0,4194304] 0 2024-04-25T02:09:15.460 INFO:tasks.workunit.client.1.smithi112.stdout:5/624: chown d1/d41/d5b/d6b/f8c 24690 1 2024-04-25T02:09:15.462 INFO:tasks.workunit.client.1.smithi112.stdout:4/811: write d2/d1e/fc5 [2719142,3748] 0 2024-04-25T02:09:15.464 INFO:tasks.workunit.client.1.smithi112.stdout:3/715: getdents d12/d67 0 2024-04-25T02:09:15.464 INFO:tasks.workunit.client.1.smithi112.stdout:3/716: truncate d12/d1f/fe6 919568 0 2024-04-25T02:09:15.464 INFO:tasks.workunit.client.1.smithi112.stdout:3/717: stat d12/d13/d34/d78/d91/ca9 0 2024-04-25T02:09:15.464 INFO:tasks.workunit.client.1.smithi112.stdout:6/651: dread d0/d32/d45/f52 [0,4194304] 0 2024-04-25T02:09:15.466 INFO:tasks.workunit.client.1.smithi112.stdout:2/648: mkdir d3/da/dc/d3e/df/d30/dd7 0 2024-04-25T02:09:15.468 INFO:tasks.workunit.client.1.smithi112.stdout:8/915: rmdir d15/d35 39 2024-04-25T02:09:15.472 INFO:tasks.workunit.client.1.smithi112.stdout:5/625: truncate d1/f8 1703542 0 2024-04-25T02:09:15.472 INFO:tasks.workunit.client.1.smithi112.stdout:5/626: getdents d1/d41/d5b/d7b/db2/dc0/dcf 0 2024-04-25T02:09:15.473 INFO:tasks.workunit.client.1.smithi112.stdout:4/812: truncate d2/fb 2885874 0 2024-04-25T02:09:15.478 INFO:tasks.workunit.client.1.smithi112.stdout:6/652: truncate d0/d32/d45/f80 2445900 0 2024-04-25T02:09:15.478 INFO:tasks.workunit.client.1.smithi112.stdout:6/653: chown d0/f1a 127 1 2024-04-25T02:09:15.479 INFO:tasks.workunit.client.1.smithi112.stdout:0/927: dwrite da/f46 [0,4194304] 0 2024-04-25T02:09:15.479 INFO:tasks.workunit.client.1.smithi112.stdout:0/928: write da/d1d/d88/f110 [241893,56814] 0 2024-04-25T02:09:15.479 INFO:tasks.workunit.client.1.smithi112.stdout:0/929: truncate da/fb 3872012 0 2024-04-25T02:09:15.479 INFO:tasks.workunit.client.1.smithi112.stdout:2/649: symlink d3/da/dc/d3e/df/d71/dc5/ld8 0 2024-04-25T02:09:15.486 INFO:tasks.workunit.client.1.smithi112.stdout:3/718: rename d12/d13/d34/d4a/d4f/d7d/dba to d12/d13/d34/d4a/d4f/da1/dea 0 2024-04-25T02:09:15.487 INFO:tasks.workunit.client.1.smithi112.stdout:3/719: dread d12/d1f/d27/d44/f56 [0,4194304] 0 2024-04-25T02:09:15.487 INFO:tasks.workunit.client.1.smithi112.stdout:3/720: write d12/d1f/d27/d44/fb6 [198116,31206] 0 2024-04-25T02:09:15.491 INFO:tasks.workunit.client.1.smithi112.stdout:6/654: rename d0/d2/d1f/f43 to d0/d2/d1f/fde 0 2024-04-25T02:09:15.494 INFO:tasks.workunit.client.1.smithi112.stdout:0/930: dwrite da/d13/d45/f8f [0,4194304] 0 2024-04-25T02:09:15.494 INFO:tasks.workunit.client.1.smithi112.stdout:0/931: dread - da/d1d/d88/d80/f119 zero size 2024-04-25T02:09:15.495 INFO:tasks.workunit.client.1.smithi112.stdout:2/650: symlink d3/da/dc/d3e/df/d25/d88/d8e/ld9 0 2024-04-25T02:09:15.495 INFO:tasks.workunit.client.1.smithi112.stdout:2/651: write d3/da/dc/d3e/df/d25/d88/d8e/fa4 [5184860,679] 0 2024-04-25T02:09:15.496 INFO:tasks.workunit.client.1.smithi112.stdout:2/652: dread d3/da/dc/fb9 [0,4194304] 0 2024-04-25T02:09:15.497 INFO:tasks.workunit.client.1.smithi112.stdout:2/653: dread - d3/da/dc/d20/d43/d74/fce zero size 2024-04-25T02:09:15.498 INFO:tasks.workunit.client.1.smithi112.stdout:5/627: getdents d1/d2/d28/d4f 0 2024-04-25T02:09:15.499 INFO:tasks.workunit.client.1.smithi112.stdout:5/628: dread - d1/d2/d28/d4f/f71 zero size 2024-04-25T02:09:15.505 INFO:tasks.workunit.client.1.smithi112.stdout:6/655: truncate d0/d36/f5a 524880 0 2024-04-25T02:09:15.505 INFO:tasks.workunit.client.1.smithi112.stdout:6/656: readlink d0/d2/d1f/l5f 0 2024-04-25T02:09:15.505 INFO:tasks.workunit.client.1.smithi112.stdout:6/657: creat d0/d2/d66/d7d/fdf x:0 0 0 2024-04-25T02:09:15.505 INFO:tasks.workunit.client.1.smithi112.stdout:6/658: write d0/d2/d3b/f40 [4323959,86650] 0 2024-04-25T02:09:15.505 INFO:tasks.workunit.client.1.smithi112.stdout:6/659: chown d0/d2 251067 1 2024-04-25T02:09:15.511 INFO:tasks.workunit.client.1.smithi112.stdout:5/629: symlink d1/dba/ld9 0 2024-04-25T02:09:15.511 INFO:tasks.workunit.client.1.smithi112.stdout:5/630: chown d1/f3b 0 1 2024-04-25T02:09:15.516 INFO:tasks.workunit.client.1.smithi112.stdout:5/631: dread d1/d2/d28/d4f/f66 [0,4194304] 0 2024-04-25T02:09:15.517 INFO:tasks.workunit.client.1.smithi112.stdout:6/660: getdents d0/d7b 0 2024-04-25T02:09:15.523 INFO:tasks.workunit.client.1.smithi112.stdout:2/654: dwrite d3/da/dc/d20/d43/d7e/da3/fae [0,4194304] 0 2024-04-25T02:09:15.523 INFO:tasks.workunit.client.1.smithi112.stdout:2/655: readlink d3/da/dc/d3e/df/d30/lad 0 2024-04-25T02:09:15.524 INFO:tasks.workunit.client.1.smithi112.stdout:3/721: dwrite d12/d13/f37 [0,4194304] 0 2024-04-25T02:09:15.524 INFO:tasks.workunit.client.1.smithi112.stdout:5/632: dread d1/faa [0,4194304] 0 2024-04-25T02:09:15.525 INFO:tasks.workunit.client.1.smithi112.stdout:2/656: mkdir d3/da/dc/d3e/df/d25/d9e/dda 0 2024-04-25T02:09:15.526 INFO:tasks.workunit.client.1.smithi112.stdout:3/722: stat d12/d13/d34/d4a/d4f/f9d 0 2024-04-25T02:09:15.529 INFO:tasks.workunit.client.1.smithi112.stdout:5/633: rename d1/d41/d5b/d7b/fa8 to d1/d16/fda 0 2024-04-25T02:09:15.531 INFO:tasks.workunit.client.1.smithi112.stdout:3/723: mkdir d12/d13/d34/d78/d91/deb 0 2024-04-25T02:09:15.532 INFO:tasks.workunit.client.1.smithi112.stdout:5/634: mkdir d1/d16/ddb 0 2024-04-25T02:09:15.534 INFO:tasks.workunit.client.1.smithi112.stdout:3/724: unlink d12/d1f/d27/d44/l65 0 2024-04-25T02:09:15.534 INFO:tasks.workunit.client.1.smithi112.stdout:3/725: write d12/d13/d34/d4a/fda [784415,115560] 0 2024-04-25T02:09:15.535 INFO:tasks.workunit.client.1.smithi112.stdout:5/635: creat d1/d41/d5b/d6b/dd2/fdc x:0 0 0 2024-04-25T02:09:15.539 INFO:tasks.workunit.client.1.smithi112.stdout:3/726: rmdir d12/d13/d86/da0 39 2024-04-25T02:09:15.539 INFO:tasks.workunit.client.1.smithi112.stdout:7/672: sync 2024-04-25T02:09:15.539 INFO:tasks.workunit.client.1.smithi112.stdout:9/622: sync 2024-04-25T02:09:15.540 INFO:tasks.workunit.client.1.smithi112.stdout:1/719: sync 2024-04-25T02:09:15.541 INFO:tasks.workunit.client.1.smithi112.stdout:1/720: write d7/d9/d1f/d25/f77 [460194,101329] 0 2024-04-25T02:09:15.541 INFO:tasks.workunit.client.1.smithi112.stdout:1/721: chown d7/d9/d1f/l23 92448462 1 2024-04-25T02:09:15.542 INFO:tasks.workunit.client.1.smithi112.stdout:3/727: creat d12/d13/d34/d78/d83/fec x:0 0 0 2024-04-25T02:09:15.546 INFO:tasks.workunit.client.1.smithi112.stdout:9/623: dread d1/f21 [0,4194304] 0 2024-04-25T02:09:15.546 INFO:tasks.workunit.client.1.smithi112.stdout:3/728: symlink d12/d13/d34/d78/d91/led 0 2024-04-25T02:09:15.547 INFO:tasks.workunit.client.1.smithi112.stdout:3/729: readlink d12/d13/d34/d4a/l54 0 2024-04-25T02:09:15.551 INFO:tasks.workunit.client.1.smithi112.stdout:9/624: creat d1/d13/d41/fd5 x:0 0 0 2024-04-25T02:09:15.553 INFO:tasks.workunit.client.1.smithi112.stdout:9/625: rename d1/d48/fc5 to d1/d13/fd6 0 2024-04-25T02:09:15.553 INFO:tasks.workunit.client.1.smithi112.stdout:9/626: chown d1/d13/d5b/lae 177951 1 2024-04-25T02:09:15.554 INFO:tasks.workunit.client.1.smithi112.stdout:2/657: dwrite d3/da/dc/d20/d43/d74/fce [0,4194304] 0 2024-04-25T02:09:15.557 INFO:tasks.workunit.client.1.smithi112.stdout:9/627: rename d1/d13/l35 to d1/d13/ld7 0 2024-04-25T02:09:15.558 INFO:tasks.workunit.client.1.smithi112.stdout:2/658: truncate d3/da/dc/d20/d43/d5e/f92 4099891 0 2024-04-25T02:09:15.561 INFO:tasks.workunit.client.1.smithi112.stdout:2/659: rename d3/da/dc/d20/d85/c91 to d3/da/dc/d3e/df/d71/dc5/dcc/cdb 0 2024-04-25T02:09:15.563 INFO:tasks.workunit.client.1.smithi112.stdout:9/628: rmdir d1/d13/d41/d84 39 2024-04-25T02:09:15.563 INFO:tasks.workunit.client.1.smithi112.stdout:9/629: chown d1/d13/d41/cba 0 1 2024-04-25T02:09:15.563 INFO:tasks.workunit.client.1.smithi112.stdout:9/630: creat d1/d13/d41/fd8 x:0 0 0 2024-04-25T02:09:15.563 INFO:tasks.workunit.client.1.smithi112.stdout:9/631: chown d1/df/ca2 6087048 1 2024-04-25T02:09:15.564 INFO:tasks.workunit.client.1.smithi112.stdout:2/660: creat d3/da/dc/d3e/df/d30/fdc x:0 0 0 2024-04-25T02:09:15.564 INFO:tasks.workunit.client.1.smithi112.stdout:2/661: creat d3/da/dc/d20/d43/d7e/da3/fdd x:0 0 0 2024-04-25T02:09:15.564 INFO:tasks.workunit.client.1.smithi112.stdout:2/662: dread - d3/da/dc/d3e/fc4 zero size 2024-04-25T02:09:15.567 INFO:tasks.workunit.client.1.smithi112.stdout:2/663: rename d3/da/dc/d3e/df/d25/d9e/dda to d3/da/dc/d20/d43/d7e/da3/dde 0 2024-04-25T02:09:15.571 INFO:tasks.workunit.client.1.smithi112.stdout:5/636: dwrite d1/d16/d22/f37 [0,4194304] 0 2024-04-25T02:09:15.571 INFO:tasks.workunit.client.1.smithi112.stdout:5/637: fdatasync d1/d16/d99/fb8 0 2024-04-25T02:09:15.571 INFO:tasks.workunit.client.1.smithi112.stdout:5/638: chown d1/dba/ccc 4317763 1 2024-04-25T02:09:15.571 INFO:tasks.workunit.client.1.smithi112.stdout:5/639: fdatasync d1/d2/f7e 0 2024-04-25T02:09:15.571 INFO:tasks.workunit.client.1.smithi112.stdout:5/640: chown d1/d2/d28/d4f/f5d 7450 1 2024-04-25T02:09:15.571 INFO:tasks.workunit.client.1.smithi112.stdout:5/641: readlink d1/d2/d28/l53 0 2024-04-25T02:09:15.571 INFO:tasks.workunit.client.1.smithi112.stdout:5/642: chown d1/d2/d78/fb1 20 1 2024-04-25T02:09:15.572 INFO:tasks.workunit.client.1.smithi112.stdout:9/632: dread d1/d13/f47 [0,4194304] 0 2024-04-25T02:09:15.572 INFO:tasks.workunit.client.1.smithi112.stdout:9/633: read d1/df/d3c/d46/f8b [881702,47136] 0 2024-04-25T02:09:15.572 INFO:tasks.workunit.client.1.smithi112.stdout:9/634: creat d1/df/d8f/dd2/fd9 x:0 0 0 2024-04-25T02:09:15.575 INFO:tasks.workunit.client.1.smithi112.stdout:1/722: dwrite d7/d9/d4e/d28/d3f/fa7 [0,4194304] 0 2024-04-25T02:09:15.576 INFO:tasks.workunit.client.1.smithi112.stdout:7/673: dwrite d7/fc [0,4194304] 0 2024-04-25T02:09:15.576 INFO:tasks.workunit.client.1.smithi112.stdout:3/730: dwrite d12/d13/f37 [4194304,4194304] 0 2024-04-25T02:09:15.576 INFO:tasks.workunit.client.1.smithi112.stdout:3/731: getdents d12/d13/d34/d53/d9c 0 2024-04-25T02:09:15.576 INFO:tasks.workunit.client.1.smithi112.stdout:3/732: chown d12/d13/d34/l5e 7798760 1 2024-04-25T02:09:15.576 INFO:tasks.workunit.client.1.smithi112.stdout:3/733: dread - d12/d1f/d27/d44/d7e/fdb zero size 2024-04-25T02:09:15.576 INFO:tasks.workunit.client.1.smithi112.stdout:3/734: readlink d12/lbc 0 2024-04-25T02:09:15.576 INFO:tasks.workunit.client.1.smithi112.stdout:9/635: symlink d1/df/d3c/d6c/lda 0 2024-04-25T02:09:15.580 INFO:tasks.workunit.client.1.smithi112.stdout:5/643: rename d1/d41/d5b/d6b to d1/d41/d5b/d7b/db2/dc0/dcf/ddd 0 2024-04-25T02:09:15.590 INFO:tasks.workunit.client.1.smithi112.stdout:5/644: link d1/c21 d1/d41/d5b/cde 0 2024-04-25T02:09:15.603 INFO:tasks.workunit.client.1.smithi112.stdout:5/645: read d1/d41/d5b/f80 [3876817,37226] 0 2024-04-25T02:09:15.605 INFO:tasks.workunit.client.1.smithi112.stdout:2/664: dwrite d3/da/dc/fb9 [0,4194304] 0 2024-04-25T02:09:15.605 INFO:tasks.workunit.client.1.smithi112.stdout:5/646: mkdir d1/d41/d5b/d7b/db2/dc0/ddf 0 2024-04-25T02:09:15.608 INFO:tasks.workunit.client.1.smithi112.stdout:3/735: dwrite d12/d1f/d27/d44/fcb [0,4194304] 0 2024-04-25T02:09:15.608 INFO:tasks.workunit.client.1.smithi112.stdout:1/723: dwrite d7/d9/fd6 [0,4194304] 0 2024-04-25T02:09:15.608 INFO:tasks.workunit.client.1.smithi112.stdout:7/674: dwrite d7/d79/da2/fad [0,4194304] 0 2024-04-25T02:09:15.609 INFO:tasks.workunit.client.1.smithi112.stdout:5/647: link d1/d2/d28/d4f/cbf d1/d16/d8f/ce0 0 2024-04-25T02:09:15.609 INFO:tasks.workunit.client.1.smithi112.stdout:5/648: fsync d1/d2/d28/f57 0 2024-04-25T02:09:15.613 INFO:tasks.workunit.client.1.smithi112.stdout:3/736: creat d12/d1f/daa/fee x:0 0 0 2024-04-25T02:09:15.615 INFO:tasks.workunit.client.1.smithi112.stdout:3/737: dread d12/d67/fb2 [0,4194304] 0 2024-04-25T02:09:15.618 INFO:tasks.workunit.client.1.smithi112.stdout:1/724: dread d7/d9/d1e/de/f17 [0,4194304] 0 2024-04-25T02:09:15.618 INFO:tasks.workunit.client.1.smithi112.stdout:1/725: readlink d7/d9/d4e/d28/d32/l42 0 2024-04-25T02:09:15.619 INFO:tasks.workunit.client.1.smithi112.stdout:7/675: dread d7/dd/d20/fc6 [0,4194304] 0 2024-04-25T02:09:15.619 INFO:tasks.workunit.client.1.smithi112.stdout:7/676: creat d7/d25/d40/d51/fce x:0 0 0 2024-04-25T02:09:15.620 INFO:tasks.workunit.client.1.smithi112.stdout:7/677: fsync d7/dd/da9/d74/f94 0 2024-04-25T02:09:15.620 INFO:tasks.workunit.client.1.smithi112.stdout:5/649: creat d1/d41/d5b/d7b/d87/fe1 x:0 0 0 2024-04-25T02:09:15.625 INFO:tasks.workunit.client.1.smithi112.stdout:2/665: dwrite d3/f59 [0,4194304] 0 2024-04-25T02:09:15.625 INFO:tasks.workunit.client.1.smithi112.stdout:7/678: mkdir d7/d25/d40/d6b/dcf 0 2024-04-25T02:09:15.629 INFO:tasks.workunit.client.1.smithi112.stdout:5/650: mknod d1/d2/d7d/ce2 0 2024-04-25T02:09:15.629 INFO:tasks.workunit.client.1.smithi112.stdout:5/651: fdatasync d1/d2/d28/d4f/fb7 0 2024-04-25T02:09:15.629 INFO:tasks.workunit.client.1.smithi112.stdout:5/652: write d1/d16/f73 [873901,45288] 0 2024-04-25T02:09:15.629 INFO:tasks.workunit.client.1.smithi112.stdout:5/653: read - d1/f63 zero size 2024-04-25T02:09:15.629 INFO:tasks.workunit.client.1.smithi112.stdout:5/654: chown d1/d41/d5b/d7b/db2/dc0/dcf 3 1 2024-04-25T02:09:15.630 INFO:tasks.workunit.client.1.smithi112.stdout:3/738: rename d12/d13/f21 to d12/d13/d34/d4a/d87/fef 0 2024-04-25T02:09:15.632 INFO:tasks.workunit.client.1.smithi112.stdout:1/726: dwrite d7/d9/d1e/f12 [0,4194304] 0 2024-04-25T02:09:15.632 INFO:tasks.workunit.client.1.smithi112.stdout:1/727: fdatasync d7/d9/d1e/de/f3b 0 2024-04-25T02:09:15.637 INFO:tasks.workunit.client.1.smithi112.stdout:2/666: mkdir d3/da/dc/d3e/df/d32/ddf 0 2024-04-25T02:09:15.639 INFO:tasks.workunit.client.1.smithi112.stdout:7/679: truncate d7/dd/d20/f5c 1655485 0 2024-04-25T02:09:15.639 INFO:tasks.workunit.client.1.smithi112.stdout:7/680: chown d7/dd/d88/db6/lc2 9918 1 2024-04-25T02:09:15.643 INFO:tasks.workunit.client.1.smithi112.stdout:5/655: rename d1/d41/d5b/d7b/db2/dc0/dcf/ddd/dd2/fdc to d1/d2/d4/dc4/d9c/fe3 0 2024-04-25T02:09:15.644 INFO:tasks.workunit.client.1.smithi112.stdout:3/739: rmdir d12/d13/d34/d4a/d4f 39 2024-04-25T02:09:15.650 INFO:tasks.workunit.client.1.smithi112.stdout:2/667: mknod d3/da/dc/d3e/df/d71/ce0 0 2024-04-25T02:09:15.650 INFO:tasks.workunit.client.1.smithi112.stdout:2/668: write d3/da/dc/d20/d40/f79 [4906657,93227] 0 2024-04-25T02:09:15.652 INFO:tasks.workunit.client.1.smithi112.stdout:7/681: mknod d7/dd/cd0 0 2024-04-25T02:09:15.652 INFO:tasks.workunit.client.1.smithi112.stdout:7/682: fsync d7/dd/d20/db2/fc3 0 2024-04-25T02:09:15.652 INFO:tasks.workunit.client.1.smithi112.stdout:7/683: fsync d7/d79/fae 0 2024-04-25T02:09:15.652 INFO:tasks.workunit.client.1.smithi112.stdout:7/684: readlink d7/d25/d40/d51/l59 0 2024-04-25T02:09:15.656 INFO:tasks.workunit.client.1.smithi112.stdout:1/728: rename d7/d9/d1e/dab to d7/d9/d1e/de/d9a/de8 0 2024-04-25T02:09:15.656 INFO:tasks.workunit.client.1.smithi112.stdout:5/656: dwrite d1/d16/f75 [4194304,4194304] 0 2024-04-25T02:09:15.659 INFO:tasks.workunit.client.1.smithi112.stdout:3/740: mknod d12/d13/d34/d78/cf0 0 2024-04-25T02:09:15.659 INFO:tasks.workunit.client.1.smithi112.stdout:3/741: chown d12/d5d/cb8 123977202 1 2024-04-25T02:09:15.664 INFO:tasks.workunit.client.1.smithi112.stdout:2/669: mkdir d3/da/dc/d3e/df/d25/d9e/de1 0 2024-04-25T02:09:15.664 INFO:tasks.workunit.client.1.smithi112.stdout:2/670: truncate d3/da/fa6 624959 0 2024-04-25T02:09:15.664 INFO:tasks.workunit.client.1.smithi112.stdout:2/671: readlink d3/da/dc/d20/d43/d5e/l8b 0 2024-04-25T02:09:15.664 INFO:tasks.workunit.client.1.smithi112.stdout:1/729: fsync d7/d9/d51/d83/fb9 0 2024-04-25T02:09:15.665 INFO:tasks.workunit.client.1.smithi112.stdout:2/672: dread d3/da/dc/d3e/df/d25/d88/d8e/fa4 [4194304,4194304] 0 2024-04-25T02:09:15.668 INFO:tasks.workunit.client.1.smithi112.stdout:5/657: rename d1/d2/c3c to d1/d2/d78/ce4 0 2024-04-25T02:09:15.671 INFO:tasks.workunit.client.1.smithi112.stdout:2/673: mknod d3/da/dc/d3e/df/d71/dc5/dcc/ce2 0 2024-04-25T02:09:15.676 INFO:tasks.workunit.client.1.smithi112.stdout:1/730: write d7/d9/d4e/f62 [400047,81476] 0 2024-04-25T02:09:15.676 INFO:tasks.workunit.client.1.smithi112.stdout:1/731: readlink d7/d9/d46/l9e 0 2024-04-25T02:09:15.683 INFO:tasks.workunit.client.1.smithi112.stdout:5/658: write d1/d16/d51/f5f [1861671,83439] 0 2024-04-25T02:09:15.685 INFO:tasks.workunit.client.1.smithi112.stdout:7/685: dwrite d7/d25/d40/d6b/d91/f98 [0,4194304] 0 2024-04-25T02:09:15.689 INFO:tasks.workunit.client.1.smithi112.stdout:2/674: dwrite d3/da/dc/d3e/df/d25/d9e/d81/f87 [0,4194304] 0 2024-04-25T02:09:15.700 INFO:tasks.workunit.client.1.smithi112.stdout:2/675: write d3/da/dc/d3e/df/d25/d9e/f84 [2366514,74133] 0 2024-04-25T02:09:15.701 INFO:tasks.workunit.client.1.smithi112.stdout:7/686: dread d7/d79/da2/fad [0,4194304] 0 2024-04-25T02:09:15.701 INFO:tasks.workunit.client.1.smithi112.stdout:7/687: stat d7/dd/da9 0 2024-04-25T02:09:15.705 INFO:tasks.workunit.client.1.smithi112.stdout:3/742: dwrite d12/d13/d34/d4a/f84 [0,4194304] 0 2024-04-25T02:09:15.705 INFO:tasks.workunit.client.1.smithi112.stdout:3/743: dread - d12/fe9 zero size 2024-04-25T02:09:15.706 INFO:tasks.workunit.client.1.smithi112.stdout:5/659: dwrite d1/fa2 [4194304,4194304] 0 2024-04-25T02:09:15.706 INFO:tasks.workunit.client.1.smithi112.stdout:5/660: write d1/d2/d28/f67 [1100227,37516] 0 2024-04-25T02:09:15.706 INFO:tasks.workunit.client.1.smithi112.stdout:5/661: truncate d1/d41/d5b/d7b/d87/fe1 475304 0 2024-04-25T02:09:15.708 INFO:tasks.workunit.client.1.smithi112.stdout:2/676: mkdir d3/da/de3 0 2024-04-25T02:09:15.708 INFO:tasks.workunit.client.1.smithi112.stdout:2/677: chown d3/da/dc/d20/d43/f56 124889514 1 2024-04-25T02:09:15.710 INFO:tasks.workunit.client.1.smithi112.stdout:7/688: truncate d7/dd/f1d 2367581 0 2024-04-25T02:09:15.710 INFO:tasks.workunit.client.1.smithi112.stdout:7/689: fsync d7/f1e 0 2024-04-25T02:09:15.712 INFO:tasks.workunit.client.1.smithi112.stdout:1/732: rename d7/d9/d4e/d28 to d7/d9/d4e/d72/d73/de9 0 2024-04-25T02:09:15.713 INFO:tasks.workunit.client.1.smithi112.stdout:1/733: dread - d7/d9/d1e/de/d84/fca zero size 2024-04-25T02:09:15.713 INFO:tasks.workunit.client.1.smithi112.stdout:1/734: dread - d7/d9/d1f/d25/fbb zero size 2024-04-25T02:09:15.715 INFO:tasks.workunit.client.1.smithi112.stdout:3/744: dread d12/f19 [0,4194304] 0 2024-04-25T02:09:15.715 INFO:tasks.workunit.client.1.smithi112.stdout:3/745: read - d12/d13/d34/d53/fae zero size 2024-04-25T02:09:15.716 INFO:tasks.workunit.client.1.smithi112.stdout:5/662: unlink d1/f3b 0 2024-04-25T02:09:15.716 INFO:tasks.workunit.client.1.smithi112.stdout:7/690: dread d7/dd/da9/f4c [0,4194304] 0 2024-04-25T02:09:15.719 INFO:tasks.workunit.client.1.smithi112.stdout:2/678: unlink d3/da/dc/d3e/df/d71/dc5/dcc/ce2 0 2024-04-25T02:09:15.719 INFO:tasks.workunit.client.1.smithi112.stdout:2/679: getdents d3/da/de3 0 2024-04-25T02:09:15.720 INFO:tasks.workunit.client.1.smithi112.stdout:1/735: mknod d7/d9/d4e/d72/d73/de9/d3f/cea 0 2024-04-25T02:09:15.724 INFO:tasks.workunit.client.1.smithi112.stdout:3/746: mknod d12/d13/d34/d78/cf1 0 2024-04-25T02:09:15.725 INFO:tasks.workunit.client.1.smithi112.stdout:7/691: link d7/c28 d7/d25/d43/dbc/cd1 0 2024-04-25T02:09:15.729 INFO:tasks.workunit.client.1.smithi112.stdout:2/680: rename d3/da/dc/d3e/df/d30/l41 to d3/da/dc/d20/d43/le4 0 2024-04-25T02:09:15.731 INFO:tasks.workunit.client.1.smithi112.stdout:3/747: unlink d12/d13/d34/d78/d83/fec 0 2024-04-25T02:09:15.731 INFO:tasks.workunit.client.1.smithi112.stdout:3/748: fsync d12/d1f/fc6 0 2024-04-25T02:09:15.736 INFO:tasks.workunit.client.1.smithi112.stdout:7/692: rmdir d7/d25/d40/db0 39 2024-04-25T02:09:15.736 INFO:tasks.workunit.client.1.smithi112.stdout:7/693: write d7/fc0 [889477,97814] 0 2024-04-25T02:09:15.736 INFO:tasks.workunit.client.1.smithi112.stdout:7/694: dread - d7/d25/fc5 zero size 2024-04-25T02:09:15.737 INFO:tasks.workunit.client.1.smithi112.stdout:2/681: creat d3/da/dc/d20/d85/fe5 x:0 0 0 2024-04-25T02:09:15.738 INFO:tasks.workunit.client.1.smithi112.stdout:5/663: dwrite d1/d2/d28/f77 [0,4194304] 0 2024-04-25T02:09:15.738 INFO:tasks.workunit.client.1.smithi112.stdout:1/736: dwrite d7/d4b/faa [0,4194304] 0 2024-04-25T02:09:15.739 INFO:tasks.workunit.client.1.smithi112.stdout:1/737: truncate d7/d9/d1e/d66/dc6/fda 450884 0 2024-04-25T02:09:15.739 INFO:tasks.workunit.client.1.smithi112.stdout:3/749: mkdir d12/d1f/daa/df2 0 2024-04-25T02:09:15.743 INFO:tasks.workunit.client.1.smithi112.stdout:2/682: mknod d3/da/ce6 0 2024-04-25T02:09:15.743 INFO:tasks.workunit.client.1.smithi112.stdout:2/683: chown d3/da/dc/d3e/df/d25/d88/d8e/fa4 30008377 1 2024-04-25T02:09:15.744 INFO:tasks.workunit.client.1.smithi112.stdout:2/684: creat d3/da/dc/d20/d85/fe7 x:0 0 0 2024-04-25T02:09:15.750 INFO:tasks.workunit.client.1.smithi112.stdout:1/738: rename d7/d4b/d7b/da8 to d7/d9/deb 0 2024-04-25T02:09:15.750 INFO:tasks.workunit.client.1.smithi112.stdout:1/739: chown d7/d9/d1e/d40/c80 0 1 2024-04-25T02:09:15.750 INFO:tasks.workunit.client.1.smithi112.stdout:1/740: chown d7/d9/d1e/d66/dc6 175 1 2024-04-25T02:09:15.751 INFO:tasks.workunit.client.1.smithi112.stdout:5/664: dwrite d1/d2/d4/f9 [4194304,4194304] 0 2024-04-25T02:09:15.752 INFO:tasks.workunit.client.1.smithi112.stdout:3/750: mknod d12/d1f/daa/cf3 0 2024-04-25T02:09:15.752 INFO:tasks.workunit.client.1.smithi112.stdout:3/751: creat d12/ff4 x:0 0 0 2024-04-25T02:09:15.758 INFO:tasks.workunit.client.1.smithi112.stdout:1/741: dread d7/d9/d4e/d72/d73/de9/fd7 [0,4194304] 0 2024-04-25T02:09:15.759 INFO:tasks.workunit.client.1.smithi112.stdout:7/695: write d7/d79/da2/f9b [1799747,44749] 0 2024-04-25T02:09:15.760 INFO:tasks.workunit.client.1.smithi112.stdout:2/685: creat d3/da/de3/fe8 x:0 0 0 2024-04-25T02:09:15.765 INFO:tasks.workunit.client.1.smithi112.stdout:5/665: mkdir d1/d41/d5b/d7b/db2/dc0/ddf/de5 0 2024-04-25T02:09:15.765 INFO:tasks.workunit.client.1.smithi112.stdout:5/666: chown d1/d2/d4/ff 136067352 1 2024-04-25T02:09:15.765 INFO:tasks.workunit.client.1.smithi112.stdout:5/667: fsync d1/d2/f36 0 2024-04-25T02:09:15.766 INFO:tasks.workunit.client.1.smithi112.stdout:3/752: mknod d12/d13/d34/cf5 0 2024-04-25T02:09:15.766 INFO:tasks.workunit.client.1.smithi112.stdout:1/742: write d7/d9/d1f/f36 [9216058,29806] 0 2024-04-25T02:09:15.767 INFO:tasks.workunit.client.1.smithi112.stdout:1/743: write d7/d9/d1e/de/fbc [1966846,56769] 0 2024-04-25T02:09:15.770 INFO:tasks.workunit.client.1.smithi112.stdout:2/686: unlink d3/da/dc/f93 0 2024-04-25T02:09:15.772 INFO:tasks.workunit.client.1.smithi112.stdout:5/668: rmdir d1/d2/d4 39 2024-04-25T02:09:15.775 INFO:tasks.workunit.client.1.smithi112.stdout:1/744: truncate d7/d9/d4e/fad 4974280 0 2024-04-25T02:09:15.777 INFO:tasks.workunit.client.1.smithi112.stdout:2/687: creat d3/da/dac/fe9 x:0 0 0 2024-04-25T02:09:15.778 INFO:tasks.workunit.client.1.smithi112.stdout:3/753: getdents d12/d13/d34/d4a 0 2024-04-25T02:09:15.778 INFO:tasks.workunit.client.1.smithi112.stdout:3/754: creat d12/ff6 x:0 0 0 2024-04-25T02:09:15.778 INFO:tasks.workunit.client.1.smithi112.stdout:3/755: stat d12/d13/d34/d78 0 2024-04-25T02:09:15.780 INFO:tasks.workunit.client.1.smithi112.stdout:1/745: symlink d7/d9/d46/lec 0 2024-04-25T02:09:15.780 INFO:tasks.workunit.client.1.smithi112.stdout:1/746: dread - d7/d9/d51/d58/f76 zero size 2024-04-25T02:09:15.780 INFO:tasks.workunit.client.1.smithi112.stdout:1/747: chown d7/d9/d1e/c61 27015534 1 2024-04-25T02:09:15.780 INFO:tasks.workunit.client.1.smithi112.stdout:1/748: truncate d7/d9/d46/fa2 5093761 0 2024-04-25T02:09:15.781 INFO:tasks.workunit.client.1.smithi112.stdout:7/696: dwrite d7/d25/fc5 [0,4194304] 0 2024-04-25T02:09:15.783 INFO:tasks.workunit.client.1.smithi112.stdout:1/749: link d7/d9/d1e/l2f d7/d9/d1f/d25/led 0 2024-04-25T02:09:15.785 INFO:tasks.workunit.client.1.smithi112.stdout:2/688: write d3/da/dc/d3e/df/d25/d9e/d81/fb6 [697596,59442] 0 2024-04-25T02:09:15.789 INFO:tasks.workunit.client.1.smithi112.stdout:7/697: mknod d7/dd/da9/cd2 0 2024-04-25T02:09:15.789 INFO:tasks.workunit.client.1.smithi112.stdout:7/698: stat d7/dd/d20/fbb 0 2024-04-25T02:09:15.790 INFO:tasks.workunit.client.1.smithi112.stdout:1/750: dread d7/d9/d1f/f36 [0,4194304] 0 2024-04-25T02:09:15.790 INFO:tasks.workunit.client.1.smithi112.stdout:1/751: chown d7/d9/d4e/d72/d73/de9/d3f/da9/dae/cdc 51372966 1 2024-04-25T02:09:15.796 INFO:tasks.workunit.client.1.smithi112.stdout:3/756: dread d12/d13/d34/d4a/f84 [0,4194304] 0 2024-04-25T02:09:15.796 INFO:tasks.workunit.client.1.smithi112.stdout:5/669: dwrite d1/d2/d78/f81 [0,4194304] 0 2024-04-25T02:09:15.806 INFO:tasks.workunit.client.1.smithi112.stdout:1/752: dwrite d7/d9/d1e/d66/dc6/fda [0,4194304] 0 2024-04-25T02:09:15.821 INFO:tasks.workunit.client.1.smithi112.stdout:2/689: symlink d3/da/dc/d3e/df/d25/d9e/d81/lea 0 2024-04-25T02:09:15.822 INFO:tasks.workunit.client.1.smithi112.stdout:7/699: mknod d7/dd/d88/cd3 0 2024-04-25T02:09:15.822 INFO:tasks.workunit.client.1.smithi112.stdout:7/700: chown d7/dd/da9/f5e 17119 1 2024-04-25T02:09:15.823 INFO:tasks.workunit.client.1.smithi112.stdout:5/670: mknod d1/d41/d5b/d96/ce6 0 2024-04-25T02:09:15.823 INFO:tasks.workunit.client.1.smithi112.stdout:5/671: write d1/d41/d5b/d96/fab [723135,64671] 0 2024-04-25T02:09:15.823 INFO:tasks.workunit.client.1.smithi112.stdout:5/672: write d1/d16/f4d [1434667,57183] 0 2024-04-25T02:09:15.823 INFO:tasks.workunit.client.1.smithi112.stdout:5/673: write d1/d41/d5b/d7b/db2/dc0/dcf/ddd/fa5 [4885315,45765] 0 2024-04-25T02:09:15.824 INFO:tasks.workunit.client.1.smithi112.stdout:5/674: stat d1/d2/d78/caf 0 2024-04-25T02:09:15.827 INFO:tasks.workunit.client.1.smithi112.stdout:2/690: rename d3/da/dc/d3e/df/d25/d88/d8e/c95 to d3/da/dc/d3e/df/d30/dd7/ceb 0 2024-04-25T02:09:15.828 INFO:tasks.workunit.client.1.smithi112.stdout:7/701: symlink d7/d25/d43/d46/ld4 0 2024-04-25T02:09:15.830 INFO:tasks.workunit.client.1.smithi112.stdout:5/675: unlink d1/d41/c48 0 2024-04-25T02:09:15.831 INFO:tasks.workunit.client.1.smithi112.stdout:1/753: symlink d7/d9/d51/d83/lee 0 2024-04-25T02:09:15.833 INFO:tasks.workunit.client.1.smithi112.stdout:2/691: mknod d3/da/dc/d20/d85/cec 0 2024-04-25T02:09:15.835 INFO:tasks.workunit.client.1.smithi112.stdout:7/702: link d7/fc9 d7/d25/d40/db0/fd5 0 2024-04-25T02:09:15.835 INFO:tasks.workunit.client.1.smithi112.stdout:7/703: fdatasync d7/dd/da9/f5e 0 2024-04-25T02:09:15.836 INFO:tasks.workunit.client.1.smithi112.stdout:7/704: chown d7/d25/d40 20 1 2024-04-25T02:09:15.836 INFO:tasks.workunit.client.1.smithi112.stdout:7/705: readlink d7/dd/d20/d2c/l5d 0 2024-04-25T02:09:15.862 INFO:tasks.workunit.client.1.smithi112.stdout:2/692: dwrite d3/da/dc/d3e/df/d30/fc6 [0,4194304] 0 2024-04-25T02:09:15.867 INFO:tasks.workunit.client.1.smithi112.stdout:1/754: dwrite d7/d9/f10 [0,4194304] 0 2024-04-25T02:09:15.867 INFO:tasks.workunit.client.1.smithi112.stdout:5/676: dwrite d1/d2/f11 [0,4194304] 0 2024-04-25T02:09:15.867 INFO:tasks.workunit.client.1.smithi112.stdout:7/706: dwrite d7/dd/da9/d74/f94 [0,4194304] 0 2024-04-25T02:09:15.871 INFO:tasks.workunit.client.1.smithi112.stdout:7/707: dread d7/dd/da9/f4c [0,4194304] 0 2024-04-25T02:09:15.871 INFO:tasks.workunit.client.1.smithi112.stdout:7/708: write d7/dd/da9/f89 [625481,27436] 0 2024-04-25T02:09:15.873 INFO:tasks.workunit.client.1.smithi112.stdout:2/693: dread d3/da/dc/d3e/df/d25/f5f [0,4194304] 0 2024-04-25T02:09:15.874 INFO:tasks.workunit.client.1.smithi112.stdout:5/677: unlink d1/f50 0 2024-04-25T02:09:15.878 INFO:tasks.workunit.client.1.smithi112.stdout:7/709: truncate d7/d25/d40/db0/fd5 333354 0 2024-04-25T02:09:15.885 INFO:tasks.workunit.client.1.smithi112.stdout:7/710: truncate d7/dd/da9/f4c 25923 0 2024-04-25T02:09:15.887 INFO:tasks.workunit.client.1.smithi112.stdout:7/711: mkdir d7/d25/dd6 0 2024-04-25T02:09:15.887 INFO:tasks.workunit.client.1.smithi112.stdout:1/755: dwrite d7/d9/d51/d58/f5b [4194304,4194304] 0 2024-04-25T02:09:15.888 INFO:tasks.workunit.client.1.smithi112.stdout:1/756: mkdir d7/d4b/d94/de5/def 0 2024-04-25T02:09:15.889 INFO:tasks.workunit.client.1.smithi112.stdout:1/757: write d7/d9/d1f/d25/fcd [326424,124733] 0 2024-04-25T02:09:15.890 INFO:tasks.workunit.client.1.smithi112.stdout:1/758: mknod d7/d4b/d94/de5/cf0 0 2024-04-25T02:09:15.898 INFO:tasks.workunit.client.1.smithi112.stdout:2/694: dwrite d3/da/f2c [4194304,4194304] 0 2024-04-25T02:09:15.902 INFO:tasks.workunit.client.1.smithi112.stdout:7/712: read d7/d25/f85 [3311737,36036] 0 2024-04-25T02:09:15.902 INFO:tasks.workunit.client.1.smithi112.stdout:2/695: rename d3/da/dc/d3e/df/d25/f5f to d3/da/dc/d3e/df/fed 0 2024-04-25T02:09:15.905 INFO:tasks.workunit.client.1.smithi112.stdout:7/713: mknod d7/dd/d20/cd7 0 2024-04-25T02:09:15.905 INFO:tasks.workunit.client.1.smithi112.stdout:1/759: read d7/d9/d1f/d25/d39/f96 [1403578,25136] 0 2024-04-25T02:09:15.916 INFO:tasks.workunit.client.1.smithi112.stdout:7/714: rmdir d7/dd/d20 39 2024-04-25T02:09:15.923 INFO:tasks.workunit.client.1.smithi112.stdout:2/696: dwrite d3/da/dc/d3e/df/d30/fdc [0,4194304] 0 2024-04-25T02:09:15.923 INFO:tasks.workunit.client.1.smithi112.stdout:1/760: dwrite d7/d9/d1e/de/f3b [4194304,4194304] 0 2024-04-25T02:09:15.923 INFO:tasks.workunit.client.1.smithi112.stdout:1/761: chown d7/d9/d1e/cf 126895530 1 2024-04-25T02:09:15.923 INFO:tasks.workunit.client.1.smithi112.stdout:1/762: chown d7/d9/d1f/d25/d39 184954 1 2024-04-25T02:09:15.931 INFO:tasks.workunit.client.1.smithi112.stdout:1/763: creat d7/d9/d1f/ff1 x:0 0 0 2024-04-25T02:09:15.937 INFO:tasks.workunit.client.1.smithi112.stdout:2/697: dwrite d3/da/dc/d3e/df/d25/f46 [8388608,4194304] 0 2024-04-25T02:09:15.937 INFO:tasks.workunit.client.1.smithi112.stdout:2/698: chown d3/c6 5550 1 2024-04-25T02:09:15.955 INFO:tasks.workunit.client.1.smithi112.stdout:2/699: dwrite d3/da/dac/dbf/f58 [0,4194304] 0 2024-04-25T02:09:15.970 INFO:tasks.workunit.client.1.smithi112.stdout:2/700: dwrite d3/da/dc/d3e/df/d30/fdc [0,4194304] 0 2024-04-25T02:09:15.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:15 smithi077 ceph-mon[26330]: pgmap v267: 65 pgs: 65 active+clean; 2.5 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 140 MiB/s rd, 169 MiB/s wr, 323 op/s 2024-04-25T02:09:15.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:15 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:09:16.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:15 smithi112 ceph-mon[33313]: pgmap v267: 65 pgs: 65 active+clean; 2.5 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 140 MiB/s rd, 169 MiB/s wr, 323 op/s 2024-04-25T02:09:16.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:15 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:09:16.051 INFO:tasks.workunit.client.1.smithi112.stdout:2/701: mkdir d3/da/dac/dbf/dee 0 2024-04-25T02:09:16.051 INFO:tasks.workunit.client.1.smithi112.stdout:2/702: read d3/da/dc/d20/d43/d5e/fcd [401421,89930] 0 2024-04-25T02:09:16.056 INFO:tasks.workunit.client.1.smithi112.stdout:2/703: rename d3/da/dc/d3e/df/d25/d9e/f7f to d3/da/dc/d3e/df/d71/dc5/dcc/fef 0 2024-04-25T02:09:16.062 INFO:tasks.workunit.client.1.smithi112.stdout:2/704: dread d3/da/dc/d3e/f3c [0,4194304] 0 2024-04-25T02:09:16.073 INFO:tasks.workunit.client.1.smithi112.stdout:2/705: dread d3/f59 [0,4194304] 0 2024-04-25T02:09:16.074 INFO:tasks.workunit.client.1.smithi112.stdout:2/706: truncate d3/da/dc/d3e/df/d25/d88/d8e/fa4 1216641 0 2024-04-25T02:09:16.074 INFO:tasks.workunit.client.1.smithi112.stdout:2/707: chown d3/fca 132357538 1 2024-04-25T02:09:16.079 INFO:tasks.workunit.client.1.smithi112.stdout:8/916: sync 2024-04-25T02:09:16.083 INFO:tasks.workunit.client.1.smithi112.stdout:8/917: mkdir d15/d35/d5c/d91/d78/dc5/d13c 0 2024-04-25T02:09:16.083 INFO:tasks.workunit.client.1.smithi112.stdout:2/708: dread d3/da/dc/d3e/df/d25/f54 [0,4194304] 0 2024-04-25T02:09:16.085 INFO:tasks.workunit.client.1.smithi112.stdout:8/918: creat d15/d35/d5f/db5/dc2/f13d x:0 0 0 2024-04-25T02:09:16.085 INFO:tasks.workunit.client.1.smithi112.stdout:8/919: chown d15/d35/d5c/d91/l8f 762 1 2024-04-25T02:09:16.088 INFO:tasks.workunit.client.1.smithi112.stdout:2/709: mkdir d3/da/dc/d3e/df/d25/d88/d8e/df0 0 2024-04-25T02:09:16.089 INFO:tasks.workunit.client.1.smithi112.stdout:8/920: symlink d15/d26/d37/d52/l13e 0 2024-04-25T02:09:16.089 INFO:tasks.workunit.client.1.smithi112.stdout:8/921: fdatasync d15/d35/d5c/d91/f45 0 2024-04-25T02:09:16.090 INFO:tasks.workunit.client.1.smithi112.stdout:2/710: mkdir d3/da/dc/d20/d43/d7e/df1 0 2024-04-25T02:09:16.109 INFO:tasks.workunit.client.1.smithi112.stdout:8/922: dwrite d15/d35/d5f/ff9 [0,4194304] 0 2024-04-25T02:09:16.109 INFO:tasks.workunit.client.1.smithi112.stdout:2/711: dwrite d3/da/dc/d20/d43/faf [0,4194304] 0 2024-04-25T02:09:16.109 INFO:tasks.workunit.client.1.smithi112.stdout:2/712: stat d3/da/dc/d20/d43/d7e/da3 0 2024-04-25T02:09:16.115 INFO:tasks.workunit.client.1.smithi112.stdout:8/923: rename d15/d26/d4f/d67/ff3 to d15/d35/d5c/d5e/d137/f13f 0 2024-04-25T02:09:16.118 INFO:tasks.workunit.client.1.smithi112.stdout:2/713: dread d3/f73 [0,4194304] 0 2024-04-25T02:09:16.118 INFO:tasks.workunit.client.1.smithi112.stdout:2/714: chown d3/da/dc/d20/lb3 2039907 1 2024-04-25T02:09:16.118 INFO:tasks.workunit.client.1.smithi112.stdout:2/715: write d3/da/dc/d20/d43/d7e/da3/fdd [181417,91177] 0 2024-04-25T02:09:16.127 INFO:tasks.workunit.client.1.smithi112.stdout:2/716: write d3/da/dac/dbf/f58 [820473,83476] 0 2024-04-25T02:09:16.134 INFO:tasks.workunit.client.1.smithi112.stdout:2/717: write d3/da/dc/d3e/df/d71/fc0 [3150028,15383] 0 2024-04-25T02:09:16.136 INFO:tasks.workunit.client.1.smithi112.stdout:2/718: creat d3/da/dc/d3e/df/d32/ddf/ff2 x:0 0 0 2024-04-25T02:09:16.136 INFO:tasks.workunit.client.1.smithi112.stdout:2/719: fdatasync d3/da/dc/d3e/df/d32/f90 0 2024-04-25T02:09:16.136 INFO:tasks.workunit.client.1.smithi112.stdout:2/720: dread - d3/da/dc/d3e/df/d25/d88/d8e/fb2 zero size 2024-04-25T02:09:16.142 INFO:tasks.workunit.client.1.smithi112.stdout:2/721: rmdir d3/da/dc/d3e/df/d32/ddf 39 2024-04-25T02:09:16.143 INFO:tasks.workunit.client.1.smithi112.stdout:2/722: readlink d3/da/dc/d20/d85/l9b 0 2024-04-25T02:09:16.143 INFO:tasks.workunit.client.1.smithi112.stdout:2/723: readlink d3/da/dc/d3e/df/d71/dc5/ld8 0 2024-04-25T02:09:16.143 INFO:tasks.workunit.client.1.smithi112.stdout:2/724: chown d3/da/cbc 14 1 2024-04-25T02:09:16.143 INFO:tasks.workunit.client.1.smithi112.stdout:2/725: write d3/da/dc/d3e/df/fed [2995702,76958] 0 2024-04-25T02:09:16.159 INFO:tasks.workunit.client.1.smithi112.stdout:2/726: dwrite d3/f9 [0,4194304] 0 2024-04-25T02:09:16.159 INFO:tasks.workunit.client.1.smithi112.stdout:2/727: stat d3/da/dc/d3e/df/d25/d9e/f9a 0 2024-04-25T02:09:16.159 INFO:tasks.workunit.client.1.smithi112.stdout:2/728: readlink d3/da/dc/d3e/df/d25/la0 0 2024-04-25T02:09:16.160 INFO:tasks.workunit.client.1.smithi112.stdout:2/729: write d3/da/dc/d3e/df/d25/d88/d8e/fa4 [391612,76774] 0 2024-04-25T02:09:16.162 INFO:tasks.workunit.client.1.smithi112.stdout:2/730: write d3/da/dc/d20/d43/d5e/f92 [3817206,25556] 0 2024-04-25T02:09:16.162 INFO:tasks.workunit.client.1.smithi112.stdout:2/731: fdatasync d3/da/dc/d3e/df/d25/f54 0 2024-04-25T02:09:16.165 INFO:tasks.workunit.client.1.smithi112.stdout:2/732: unlink d3/da/dc/d3e/cbb 0 2024-04-25T02:09:16.169 INFO:tasks.workunit.client.1.smithi112.stdout:2/733: rename d3/da/dc/d20/d43/l8a to d3/da/dc/lf3 0 2024-04-25T02:09:16.170 INFO:tasks.workunit.client.1.smithi112.stdout:2/734: read d3/da/dc/d3e/df/fb5 [648823,15454] 0 2024-04-25T02:09:16.172 INFO:tasks.workunit.client.1.smithi112.stdout:2/735: creat d3/da/dc/d3e/df/d30/dc2/ff4 x:0 0 0 2024-04-25T02:09:16.177 INFO:tasks.workunit.client.1.smithi112.stdout:2/736: dread d3/da/dac/dbf/f58 [0,4194304] 0 2024-04-25T02:09:16.178 INFO:tasks.workunit.client.1.smithi112.stdout:2/737: symlink d3/da/dac/dbf/dee/lf5 0 2024-04-25T02:09:16.181 INFO:tasks.workunit.client.1.smithi112.stdout:2/738: creat d3/da/dc/d3e/df/d25/d88/d8e/df0/ff6 x:0 0 0 2024-04-25T02:09:16.181 INFO:tasks.workunit.client.1.smithi112.stdout:2/739: readlink d3/da/dc/d3e/df/d71/dc5/dcc/ld0 0 2024-04-25T02:09:16.183 INFO:tasks.workunit.client.1.smithi112.stdout:2/740: symlink d3/da/dc/d3e/df/d25/d9e/de1/lf7 0 2024-04-25T02:09:16.183 INFO:tasks.workunit.client.1.smithi112.stdout:2/741: getdents d3/da/dc/d20/d43/dcf 0 2024-04-25T02:09:16.185 INFO:tasks.workunit.client.1.smithi112.stdout:2/742: link d3/da/dc/d20/d43/d5e/l9c d3/da/dc/d3e/df/lf8 0 2024-04-25T02:09:16.190 INFO:tasks.workunit.client.1.smithi112.stdout:2/743: rename d3/da/dc/d3e/df/d71/fc0 to d3/ff9 0 2024-04-25T02:09:16.190 INFO:tasks.workunit.client.1.smithi112.stdout:2/744: chown d3/da/dc/d3e/df/d30 1 1 2024-04-25T02:09:16.192 INFO:tasks.workunit.client.1.smithi112.stdout:2/745: rename d3/da/dc/d20/d43/d74/f99 to d3/da/dc/d20/d43/dcf/ffa 0 2024-04-25T02:09:16.195 INFO:tasks.workunit.client.1.smithi112.stdout:2/746: dread d3/da/dc/d3e/df/fb5 [0,4194304] 0 2024-04-25T02:09:16.196 INFO:tasks.workunit.client.1.smithi112.stdout:2/747: rename d3/da/dc/d20/d40/f79 to d3/da/dc/d20/ffb 0 2024-04-25T02:09:16.204 INFO:tasks.workunit.client.1.smithi112.stdout:2/748: write d3/da/dc/d20/fc7 [6090233,42036] 0 2024-04-25T02:09:16.204 INFO:tasks.workunit.client.1.smithi112.stdout:2/749: readlink d3/da/dc/d20/d43/d7e/da3/lbe 0 2024-04-25T02:09:16.221 INFO:tasks.workunit.client.1.smithi112.stdout:0/932: sync 2024-04-25T02:09:16.221 INFO:tasks.workunit.client.1.smithi112.stdout:4/813: sync 2024-04-25T02:09:16.223 INFO:tasks.workunit.client.1.smithi112.stdout:2/750: dwrite d3/da/f15 [0,4194304] 0 2024-04-25T02:09:16.223 INFO:tasks.workunit.client.1.smithi112.stdout:2/751: chown d3/da/dc/d20/d43/d7e/da3/lbe 160 1 2024-04-25T02:09:16.225 INFO:tasks.workunit.client.1.smithi112.stdout:0/933: truncate da/d13/d1e/f83 214560 0 2024-04-25T02:09:16.228 INFO:tasks.workunit.client.1.smithi112.stdout:2/752: link d3/da/f2c d3/da/dac/ffc 0 2024-04-25T02:09:16.234 INFO:tasks.workunit.client.1.smithi112.stdout:0/934: truncate da/d13/d1e/f6a 2944045 0 2024-04-25T02:09:16.235 INFO:tasks.workunit.client.1.smithi112.stdout:4/814: dwrite d2/d17/d20/d26/d39/d106/fcb [0,4194304] 0 2024-04-25T02:09:16.235 INFO:tasks.workunit.client.1.smithi112.stdout:4/815: creat d2/d17/d20/f10a x:0 0 0 2024-04-25T02:09:16.241 INFO:tasks.workunit.client.1.smithi112.stdout:2/753: write d3/da/dc/d3e/df/d32/f90 [3746671,95146] 0 2024-04-25T02:09:16.243 INFO:tasks.workunit.client.1.smithi112.stdout:0/935: mknod da/d1d/d2e/d40/d49/d5f/c129 0 2024-04-25T02:09:16.243 INFO:tasks.workunit.client.1.smithi112.stdout:0/936: readlink da/d13/d1e/l92 0 2024-04-25T02:09:16.265 INFO:tasks.workunit.client.1.smithi112.stdout:4/816: rename d2/d12/cc3 to d2/d1e/db3/c10b 0 2024-04-25T02:09:16.273 INFO:tasks.workunit.client.1.smithi112.stdout:7/715: sync 2024-04-25T02:09:16.273 INFO:tasks.workunit.client.1.smithi112.stdout:1/764: sync 2024-04-25T02:09:16.273 INFO:tasks.workunit.client.1.smithi112.stdout:5/678: sync 2024-04-25T02:09:16.273 INFO:tasks.workunit.client.1.smithi112.stdout:3/757: sync 2024-04-25T02:09:16.273 INFO:tasks.workunit.client.1.smithi112.stdout:6/661: sync 2024-04-25T02:09:16.273 INFO:tasks.workunit.client.1.smithi112.stdout:9/636: sync 2024-04-25T02:09:16.273 INFO:tasks.workunit.client.1.smithi112.stdout:3/758: truncate d12/d13/d34/d4a/f6b 1203876 0 2024-04-25T02:09:16.273 INFO:tasks.workunit.client.1.smithi112.stdout:5/679: truncate d1/d2/d7d/fc2 865481 0 2024-04-25T02:09:16.273 INFO:tasks.workunit.client.1.smithi112.stdout:5/680: fdatasync d1/d2/d28/d4f/f66 0 2024-04-25T02:09:16.273 INFO:tasks.workunit.client.1.smithi112.stdout:1/765: creat d7/d9/d1f/ff2 x:0 0 0 2024-04-25T02:09:16.276 INFO:tasks.workunit.client.1.smithi112.stdout:9/637: dread d1/df/d3c/d46/f78 [0,4194304] 0 2024-04-25T02:09:16.276 INFO:tasks.workunit.client.1.smithi112.stdout:4/817: creat d2/d17/d20/d26/d39/d106/f10c x:0 0 0 2024-04-25T02:09:16.283 INFO:tasks.workunit.client.1.smithi112.stdout:7/716: write d7/d25/d43/d46/f8e [4137278,77979] 0 2024-04-25T02:09:16.283 INFO:tasks.workunit.client.1.smithi112.stdout:7/717: creat d7/d25/d40/d51/fd8 x:0 0 0 2024-04-25T02:09:16.283 INFO:tasks.workunit.client.1.smithi112.stdout:4/818: dread d2/fb [0,4194304] 0 2024-04-25T02:09:16.283 INFO:tasks.workunit.client.1.smithi112.stdout:0/937: rename da/d1d/d2e/d40/d49/d4f/d58 to da/d13/d1e/de0/d12a 0 2024-04-25T02:09:16.283 INFO:tasks.workunit.client.1.smithi112.stdout:0/938: read - da/d1d/d2e/dbd/fc3 zero size 2024-04-25T02:09:16.287 INFO:tasks.workunit.client.1.smithi112.stdout:3/759: getdents d12/d1f/d27/d44 0 2024-04-25T02:09:16.287 INFO:tasks.workunit.client.1.smithi112.stdout:3/760: creat d12/d1f/d27/ff7 x:0 0 0 2024-04-25T02:09:16.290 INFO:tasks.workunit.client.1.smithi112.stdout:7/718: link d7/dd/lb4 d7/dd/da9/ld9 0 2024-04-25T02:09:16.290 INFO:tasks.workunit.client.1.smithi112.stdout:7/719: chown d7/d25/fc5 19921130 1 2024-04-25T02:09:16.290 INFO:tasks.workunit.client.1.smithi112.stdout:7/720: write d7/d79/da2/fc1 [833033,74867] 0 2024-04-25T02:09:16.291 INFO:tasks.workunit.client.1.smithi112.stdout:4/819: symlink d2/d17/d25/l10d 0 2024-04-25T02:09:16.294 INFO:tasks.workunit.client.1.smithi112.stdout:6/662: rename d0/d2/d2c/d41/dce/fd1 to d0/d61/d98/db5/fe0 0 2024-04-25T02:09:16.294 INFO:tasks.workunit.client.1.smithi112.stdout:0/939: read da/d13/d1e/f4e [315250,115702] 0 2024-04-25T02:09:16.294 INFO:tasks.workunit.client.1.smithi112.stdout:6/663: fdatasync d0/d2/d4/d28/f57 0 2024-04-25T02:09:16.294 INFO:tasks.workunit.client.1.smithi112.stdout:0/940: chown da/d1d/d2e/d40/d49/d4f/d82/lbb 4977 1 2024-04-25T02:09:16.294 INFO:tasks.workunit.client.1.smithi112.stdout:6/664: write d0/d2/d3b/f68 [750195,41102] 0 2024-04-25T02:09:16.294 INFO:tasks.workunit.client.1.smithi112.stdout:6/665: fdatasync d0/d2/d3b/f58 0 2024-04-25T02:09:16.295 INFO:tasks.workunit.client.1.smithi112.stdout:9/638: getdents d1/df/d8f/dd2 0 2024-04-25T02:09:16.298 INFO:tasks.workunit.client.1.smithi112.stdout:7/721: mkdir d7/d79/dda 0 2024-04-25T02:09:16.299 INFO:tasks.workunit.client.1.smithi112.stdout:4/820: rmdir d2/d1e/d4b/d57 39 2024-04-25T02:09:16.302 INFO:tasks.workunit.client.1.smithi112.stdout:3/761: rename d12/d13/d86 to d12/d1f/d27/df8 0 2024-04-25T02:09:16.302 INFO:tasks.workunit.client.1.smithi112.stdout:3/762: readlink d12/d13/d34/d78/d91/lc7 0 2024-04-25T02:09:16.303 INFO:tasks.workunit.client.1.smithi112.stdout:1/766: dwrite d7/d4b/faa [0,4194304] 0 2024-04-25T02:09:16.303 INFO:tasks.workunit.client.1.smithi112.stdout:5/681: dwrite d1/d16/d8f/fa7 [0,4194304] 0 2024-04-25T02:09:16.303 INFO:tasks.workunit.client.1.smithi112.stdout:0/941: unlink da/d13/d1e/f6a 0 2024-04-25T02:09:16.305 INFO:tasks.workunit.client.1.smithi112.stdout:7/722: mkdir d7/ddb 0 2024-04-25T02:09:16.306 INFO:tasks.workunit.client.1.smithi112.stdout:9/639: dread d1/df/d3c/d43/f4a [0,4194304] 0 2024-04-25T02:09:16.307 INFO:tasks.workunit.client.1.smithi112.stdout:4/821: unlink d2/d17/d20/d26/d39/d49/fc8 0 2024-04-25T02:09:16.308 INFO:tasks.workunit.client.1.smithi112.stdout:3/763: symlink d12/d13/d34/d4a/d4f/da1/dea/lf9 0 2024-04-25T02:09:16.318 INFO:tasks.workunit.client.1.smithi112.stdout:5/682: symlink d1/le7 0 2024-04-25T02:09:16.319 INFO:tasks.workunit.client.1.smithi112.stdout:0/942: rename da/d13/d23/dee/c100 to da/d13/d23/c12b 0 2024-04-25T02:09:16.321 INFO:tasks.workunit.client.1.smithi112.stdout:9/640: truncate d1/f31 166467 0 2024-04-25T02:09:16.321 INFO:tasks.workunit.client.1.smithi112.stdout:1/767: getdents d7/d9/d1e/de/dcf 0 2024-04-25T02:09:16.321 INFO:tasks.workunit.client.1.smithi112.stdout:9/641: read d1/d13/d41/fa5 [252481,7508] 0 2024-04-25T02:09:16.323 INFO:tasks.workunit.client.1.smithi112.stdout:7/723: dwrite d7/d25/d40/d6b/f84 [0,4194304] 0 2024-04-25T02:09:16.323 INFO:tasks.workunit.client.1.smithi112.stdout:7/724: write d7/d25/d43/d46/f68 [653307,113216] 0 2024-04-25T02:09:16.323 INFO:tasks.workunit.client.1.smithi112.stdout:5/683: getdents d1/d41/d5b 0 2024-04-25T02:09:16.325 INFO:tasks.workunit.client.1.smithi112.stdout:4/822: rename d2/d17/d25/lbb to d2/d17/d20/d26/d39/d106/l10e 0 2024-04-25T02:09:16.327 INFO:tasks.workunit.client.1.smithi112.stdout:7/725: dread d7/dd/da9/f4c [0,4194304] 0 2024-04-25T02:09:16.328 INFO:tasks.workunit.client.1.smithi112.stdout:0/943: mkdir da/d13/d23/dee/d12c 0 2024-04-25T02:09:16.331 INFO:tasks.workunit.client.1.smithi112.stdout:3/764: dwrite d12/d1f/d27/d44/f56 [0,4194304] 0 2024-04-25T02:09:16.332 INFO:tasks.workunit.client.1.smithi112.stdout:3/765: write d12/d1f/fe6 [767742,119942] 0 2024-04-25T02:09:16.332 INFO:tasks.workunit.client.1.smithi112.stdout:3/766: write d12/d1f/d27/d44/d7e/fa3 [2207389,78494] 0 2024-04-25T02:09:16.332 INFO:tasks.workunit.client.1.smithi112.stdout:3/767: chown d12/f36 164258 1 2024-04-25T02:09:16.334 INFO:tasks.workunit.client.1.smithi112.stdout:1/768: truncate d7/d9/d4e/d72/d73/de9/d3f/fa7 437781 0 2024-04-25T02:09:16.340 INFO:tasks.workunit.client.1.smithi112.stdout:1/769: dread d7/d9/d4e/d72/d73/de9/d3f/f8d [0,4194304] 0 2024-04-25T02:09:16.340 INFO:tasks.workunit.client.1.smithi112.stdout:9/642: dwrite d1/df/d3c/d46/f99 [0,4194304] 0 2024-04-25T02:09:16.341 INFO:tasks.workunit.client.1.smithi112.stdout:7/726: symlink d7/d25/d40/ldc 0 2024-04-25T02:09:16.348 INFO:tasks.workunit.client.1.smithi112.stdout:4/823: dwrite d2/d17/d20/deb/fd2 [0,4194304] 0 2024-04-25T02:09:16.348 INFO:tasks.workunit.client.1.smithi112.stdout:4/824: write d2/f5f [3632871,13857] 0 2024-04-25T02:09:16.361 INFO:tasks.workunit.client.1.smithi112.stdout:4/825: dwrite d2/d12/d22/ff1 [0,4194304] 0 2024-04-25T02:09:16.404 INFO:tasks.workunit.client.1.smithi112.stdout:0/944: rename da/d13/d1e/de0/d12a to da/d13/d1e/de0/deb/d12d 0 2024-04-25T02:09:16.410 INFO:tasks.workunit.client.1.smithi112.stdout:8/924: sync 2024-04-25T02:09:16.411 INFO:tasks.workunit.client.1.smithi112.stdout:1/770: mknod d7/d4b/d94/de5/cf3 0 2024-04-25T02:09:16.413 INFO:tasks.workunit.client.1.smithi112.stdout:7/727: mkdir d7/dd/d20/db2/ddd 0 2024-04-25T02:09:16.426 INFO:tasks.workunit.client.1.smithi112.stdout:8/925: dwrite d15/fe3 [0,4194304] 0 2024-04-25T02:09:16.427 INFO:tasks.workunit.client.1.smithi112.stdout:5/684: rename d1/d2/d4/dc4/d9c/fa1 to d1/d2/d28/fe8 0 2024-04-25T02:09:16.428 INFO:tasks.workunit.client.1.smithi112.stdout:5/685: write d1/d2/d7d/fc2 [1432358,61630] 0 2024-04-25T02:09:16.428 INFO:tasks.workunit.client.1.smithi112.stdout:5/686: fsync d1/d2/d4/ff 0 2024-04-25T02:09:16.429 INFO:tasks.workunit.client.1.smithi112.stdout:0/945: mknod da/d1d/d2e/d40/c12e 0 2024-04-25T02:09:16.431 INFO:tasks.workunit.client.1.smithi112.stdout:7/728: creat d7/dd/da9/d74/fde x:0 0 0 2024-04-25T02:09:16.434 INFO:tasks.workunit.client.1.smithi112.stdout:4/826: unlink d2/d1e/fbd 0 2024-04-25T02:09:16.440 INFO:tasks.workunit.client.1.smithi112.stdout:8/926: mknod d15/d81/dce/c140 0 2024-04-25T02:09:16.441 INFO:tasks.workunit.client.1.smithi112.stdout:7/729: creat d7/dd/d20/db2/fdf x:0 0 0 2024-04-25T02:09:16.441 INFO:tasks.workunit.client.1.smithi112.stdout:7/730: fdatasync d7/f19 0 2024-04-25T02:09:16.444 INFO:tasks.workunit.client.1.smithi112.stdout:7/731: creat d7/dd/d88/fe0 x:0 0 0 2024-04-25T02:09:16.449 INFO:tasks.workunit.client.1.smithi112.stdout:4/827: rename d2/d17/d20/d5e/f34 to d2/f10f 0 2024-04-25T02:09:16.451 INFO:tasks.workunit.client.1.smithi112.stdout:5/687: dwrite d1/d2/d4/d1d/f70 [0,4194304] 0 2024-04-25T02:09:16.451 INFO:tasks.workunit.client.1.smithi112.stdout:0/946: dwrite da/d1d/d2e/d40/d49/f113 [0,4194304] 0 2024-04-25T02:09:16.452 INFO:tasks.workunit.client.1.smithi112.stdout:0/947: truncate da/f32 5205354 0 2024-04-25T02:09:16.452 INFO:tasks.workunit.client.1.smithi112.stdout:8/927: rename d15/d17/f23 to d15/d26/d37/d8e/f141 0 2024-04-25T02:09:16.453 INFO:tasks.workunit.client.1.smithi112.stdout:4/828: mknod d2/d17/d20/d26/d39/c110 0 2024-04-25T02:09:16.459 INFO:tasks.workunit.client.1.smithi112.stdout:0/948: dread da/d13/fcf [0,4194304] 0 2024-04-25T02:09:16.459 INFO:tasks.workunit.client.1.smithi112.stdout:8/928: mkdir d15/d35/d5c/de4/d142 0 2024-04-25T02:09:16.461 INFO:tasks.workunit.client.1.smithi112.stdout:4/829: getdents d2/d17/d20/d26/d39/d106 0 2024-04-25T02:09:16.463 INFO:tasks.workunit.client.1.smithi112.stdout:0/949: truncate da/f10 8749777 0 2024-04-25T02:09:16.464 INFO:tasks.workunit.client.1.smithi112.stdout:0/950: chown da/d1d/d2e/d40/d49 4090 1 2024-04-25T02:09:16.464 INFO:tasks.workunit.client.1.smithi112.stdout:0/951: fsync da/d1d/d88/d24/f125 0 2024-04-25T02:09:16.464 INFO:tasks.workunit.client.1.smithi112.stdout:0/952: write da/d1d/d2e/d40/f41 [6020090,5421] 0 2024-04-25T02:09:16.464 INFO:tasks.workunit.client.1.smithi112.stdout:0/953: readlink da/d13/d23/lf6 0 2024-04-25T02:09:16.464 INFO:tasks.workunit.client.1.smithi112.stdout:4/830: getdents d2/d1e/d1b 0 2024-04-25T02:09:16.465 INFO:tasks.workunit.client.1.smithi112.stdout:0/954: write da/d1d/dbe/fcc [230017,10938] 0 2024-04-25T02:09:16.465 INFO:tasks.workunit.client.1.smithi112.stdout:0/955: chown da/d1d/d2e/d40 17937 1 2024-04-25T02:09:16.465 INFO:tasks.workunit.client.1.smithi112.stdout:0/956: fdatasync da/fb 0 2024-04-25T02:09:16.465 INFO:tasks.workunit.client.1.smithi112.stdout:0/957: chown da/d13/d45/d5e/l116 553960 1 2024-04-25T02:09:16.466 INFO:tasks.workunit.client.1.smithi112.stdout:0/958: readlink da/d1d/d88/l36 0 2024-04-25T02:09:16.466 INFO:tasks.workunit.client.1.smithi112.stdout:4/831: dread d2/d12/fa9 [0,4194304] 0 2024-04-25T02:09:16.467 INFO:tasks.workunit.client.1.smithi112.stdout:7/732: dwrite d7/f17 [0,4194304] 0 2024-04-25T02:09:16.469 INFO:tasks.workunit.client.1.smithi112.stdout:4/832: mkdir d2/d4e/d111 0 2024-04-25T02:09:16.469 INFO:tasks.workunit.client.1.smithi112.stdout:4/833: readlink d2/d12/d22/le0 0 2024-04-25T02:09:16.469 INFO:tasks.workunit.client.1.smithi112.stdout:4/834: stat d2/d1e/d4b/cdc 0 2024-04-25T02:09:16.469 INFO:tasks.workunit.client.1.smithi112.stdout:5/688: dwrite d1/d41/d5b/d96/fb0 [0,4194304] 0 2024-04-25T02:09:16.470 INFO:tasks.workunit.client.1.smithi112.stdout:7/733: truncate d7/dd/f30 2591557 0 2024-04-25T02:09:16.470 INFO:tasks.workunit.client.1.smithi112.stdout:7/734: chown d7/d25/d43/d46 35097 1 2024-04-25T02:09:16.473 INFO:tasks.workunit.client.1.smithi112.stdout:5/689: mknod d1/d41/d5b/d7b/db2/ce9 0 2024-04-25T02:09:16.474 INFO:tasks.workunit.client.1.smithi112.stdout:7/735: mkdir d7/d25/d43/de1 0 2024-04-25T02:09:16.475 INFO:tasks.workunit.client.1.smithi112.stdout:0/959: dread da/d13/d1e/f3c [0,4194304] 0 2024-04-25T02:09:16.477 INFO:tasks.workunit.client.1.smithi112.stdout:7/736: dread d7/d25/d43/f2a [0,4194304] 0 2024-04-25T02:09:16.480 INFO:tasks.workunit.client.1.smithi112.stdout:0/960: write da/d13/d23/d77/f95 [2355730,66815] 0 2024-04-25T02:09:16.481 INFO:tasks.workunit.client.1.smithi112.stdout:7/737: dread d7/d25/d43/d46/f42 [0,4194304] 0 2024-04-25T02:09:16.482 INFO:tasks.workunit.client.1.smithi112.stdout:4/835: write d2/d17/d20/fa7 [1248878,79344] 0 2024-04-25T02:09:16.482 INFO:tasks.workunit.client.1.smithi112.stdout:8/929: dwrite d15/d35/d5c/d5e/d85/fd3 [0,4194304] 0 2024-04-25T02:09:16.488 INFO:tasks.workunit.client.1.smithi112.stdout:5/690: dread d1/d2/d7d/fc2 [0,4194304] 0 2024-04-25T02:09:16.488 INFO:tasks.workunit.client.1.smithi112.stdout:5/691: chown d1/d2/d4/d1d/dc9 3 1 2024-04-25T02:09:16.488 INFO:tasks.workunit.client.1.smithi112.stdout:5/692: stat d1/d2/d28/ld1 0 2024-04-25T02:09:16.488 INFO:tasks.workunit.client.1.smithi112.stdout:5/693: readlink d1/d41/d5b/d7b/db2/ld8 0 2024-04-25T02:09:16.490 INFO:tasks.workunit.client.1.smithi112.stdout:0/961: link da/d1d/d2e/d40/d49/d6b/ldf da/d13/d23/l12f 0 2024-04-25T02:09:16.499 INFO:tasks.workunit.client.1.smithi112.stdout:0/962: link da/d1d/dcb/lf4 da/d1d/d88/d24/l130 0 2024-04-25T02:09:16.499 INFO:tasks.workunit.client.1.smithi112.stdout:5/694: dread d1/f46 [0,4194304] 0 2024-04-25T02:09:16.500 INFO:tasks.workunit.client.1.smithi112.stdout:7/738: dwrite d7/d25/f2d [0,4194304] 0 2024-04-25T02:09:16.503 INFO:tasks.workunit.client.1.smithi112.stdout:8/930: rename d15/d17 to d15/d35/d5f/db5/dc2/d143 0 2024-04-25T02:09:16.505 INFO:tasks.workunit.client.1.smithi112.stdout:5/695: link d1/d2/d28/l53 d1/d41/d5b/d7b/db2/dc0/dcf/ddd/lea 0 2024-04-25T02:09:16.507 INFO:tasks.workunit.client.1.smithi112.stdout:8/931: rmdir d15/d35/d5f/db5/dc2/d143/df1 39 2024-04-25T02:09:16.510 INFO:tasks.workunit.client.1.smithi112.stdout:5/696: rmdir d1/d41/d5b/d79/dd4 0 2024-04-25T02:09:16.510 INFO:tasks.workunit.client.1.smithi112.stdout:5/697: fsync d1/d2/d4/d1d/dc9/fd6 0 2024-04-25T02:09:16.513 INFO:tasks.workunit.client.1.smithi112.stdout:4/836: dwrite d2/d17/d25/fc6 [0,4194304] 0 2024-04-25T02:09:16.513 INFO:tasks.workunit.client.1.smithi112.stdout:7/739: write d7/d25/d40/d6b/d91/f98 [2998040,104821] 0 2024-04-25T02:09:16.514 INFO:tasks.workunit.client.1.smithi112.stdout:8/932: mknod d15/d35/d5c/d91/d78/c144 0 2024-04-25T02:09:16.522 INFO:tasks.workunit.client.1.smithi112.stdout:4/837: stat d2/d17/d20/d5e/c5a 0 2024-04-25T02:09:16.522 INFO:tasks.workunit.client.1.smithi112.stdout:4/838: readlink d2/d12/d22/l6f 0 2024-04-25T02:09:16.522 INFO:tasks.workunit.client.1.smithi112.stdout:4/839: chown d2/d1e/d42/fdd 29274 1 2024-04-25T02:09:16.523 INFO:tasks.workunit.client.1.smithi112.stdout:7/740: creat d7/d79/db8/fe2 x:0 0 0 2024-04-25T02:09:16.525 INFO:tasks.workunit.client.1.smithi112.stdout:0/963: dwrite da/f26 [0,4194304] 0 2024-04-25T02:09:16.529 INFO:tasks.workunit.client.1.smithi112.stdout:5/698: dwrite d1/d2/d28/d4f/f83 [0,4194304] 0 2024-04-25T02:09:16.530 INFO:tasks.workunit.client.1.smithi112.stdout:8/933: link d15/d26/d37/c68 d15/d35/d5c/d91/d78/c145 0 2024-04-25T02:09:16.530 INFO:tasks.workunit.client.1.smithi112.stdout:8/934: write d15/d35/d5c/d91/f45 [3734342,114521] 0 2024-04-25T02:09:16.532 INFO:tasks.workunit.client.1.smithi112.stdout:7/741: dread d7/dd/f30 [0,4194304] 0 2024-04-25T02:09:16.532 INFO:tasks.workunit.client.1.smithi112.stdout:4/840: symlink d2/d17/db2/l112 0 2024-04-25T02:09:16.533 INFO:tasks.workunit.client.1.smithi112.stdout:4/841: fdatasync d2/d17/d25/f91 0 2024-04-25T02:09:16.539 INFO:tasks.workunit.client.1.smithi112.stdout:7/742: creat d7/d25/d40/d6b/fe3 x:0 0 0 2024-04-25T02:09:16.539 INFO:tasks.workunit.client.1.smithi112.stdout:7/743: chown d7/d79/da2/l4e 191384 1 2024-04-25T02:09:16.541 INFO:tasks.workunit.client.1.smithi112.stdout:4/842: creat d2/d17/d20/d5e/f113 x:0 0 0 2024-04-25T02:09:16.544 INFO:tasks.workunit.client.1.smithi112.stdout:0/964: dwrite da/d13/d1e/fa4 [0,4194304] 0 2024-04-25T02:09:16.544 INFO:tasks.workunit.client.1.smithi112.stdout:5/699: getdents d1 0 2024-04-25T02:09:16.545 INFO:tasks.workunit.client.1.smithi112.stdout:4/843: creat d2/d1e/d1b/d67/f114 x:0 0 0 2024-04-25T02:09:16.546 INFO:tasks.workunit.client.1.smithi112.stdout:4/844: write d2/d17/d20/d26/d39/d49/f3c [223170,88169] 0 2024-04-25T02:09:16.546 INFO:tasks.workunit.client.1.smithi112.stdout:4/845: chown d2/d4e/fac 1859413719 1 2024-04-25T02:09:16.548 INFO:tasks.workunit.client.1.smithi112.stdout:7/744: dread d7/f13 [4194304,4194304] 0 2024-04-25T02:09:16.549 INFO:tasks.workunit.client.1.smithi112.stdout:7/745: dread - d7/dd/d20/db2/fdf zero size 2024-04-25T02:09:16.549 INFO:tasks.workunit.client.1.smithi112.stdout:7/746: stat d7/d25/d43/d46 0 2024-04-25T02:09:16.551 INFO:tasks.workunit.client.1.smithi112.stdout:0/965: creat da/d13/d23/dee/d12c/f131 x:0 0 0 2024-04-25T02:09:16.551 INFO:tasks.workunit.client.1.smithi112.stdout:0/966: truncate da/d13/d45/d5e/d7a/fb9 73371 0 2024-04-25T02:09:16.551 INFO:tasks.workunit.client.1.smithi112.stdout:0/967: readlink da/d1d/d88/d80/l91 0 2024-04-25T02:09:16.552 INFO:tasks.workunit.client.1.smithi112.stdout:5/700: mknod d1/d16/ceb 0 2024-04-25T02:09:16.556 INFO:tasks.workunit.client.1.smithi112.stdout:4/846: creat d2/d1e/db3/f115 x:0 0 0 2024-04-25T02:09:16.556 INFO:tasks.workunit.client.1.smithi112.stdout:4/847: write d2/d12/de1/f7f [5068193,106292] 0 2024-04-25T02:09:16.556 INFO:tasks.workunit.client.1.smithi112.stdout:4/848: chown d2/d17/d20/d26/d39/d49/d95/dc7/ff8 0 1 2024-04-25T02:09:16.556 INFO:tasks.workunit.client.1.smithi112.stdout:4/849: write d2/d1e/d1b/d83/fb7 [4279020,25964] 0 2024-04-25T02:09:16.556 INFO:tasks.workunit.client.1.smithi112.stdout:7/747: creat d7/dd/d20/db2/ddd/fe4 x:0 0 0 2024-04-25T02:09:16.559 INFO:tasks.workunit.client.1.smithi112.stdout:7/748: dread d7/d25/d43/d46/f42 [0,4194304] 0 2024-04-25T02:09:16.559 INFO:tasks.workunit.client.1.smithi112.stdout:7/749: chown d7/dd/da9/f89 1666891335 1 2024-04-25T02:09:16.561 INFO:tasks.workunit.client.1.smithi112.stdout:4/850: mknod d2/d1e/d1b/d67/c116 0 2024-04-25T02:09:16.563 INFO:tasks.workunit.client.1.smithi112.stdout:0/968: rmdir da/d1d/d88 39 2024-04-25T02:09:16.563 INFO:tasks.workunit.client.1.smithi112.stdout:0/969: chown da/f26 371594 1 2024-04-25T02:09:16.564 INFO:tasks.workunit.client.1.smithi112.stdout:8/935: dwrite d15/d35/d5c/d91/f45 [4194304,4194304] 0 2024-04-25T02:09:16.564 INFO:tasks.workunit.client.1.smithi112.stdout:8/936: truncate fe 1080955 0 2024-04-25T02:09:16.565 INFO:tasks.workunit.client.1.smithi112.stdout:4/851: symlink d2/d17/d7c/l117 0 2024-04-25T02:09:16.566 INFO:tasks.workunit.client.1.smithi112.stdout:0/970: truncate da/d13/d1e/de0/deb/d12d/fb5 623609 0 2024-04-25T02:09:16.566 INFO:tasks.workunit.client.1.smithi112.stdout:5/701: write d1/d41/f47 [34313,82191] 0 2024-04-25T02:09:16.566 INFO:tasks.workunit.client.1.smithi112.stdout:5/702: chown d1/d16/l1b 393391 1 2024-04-25T02:09:16.570 INFO:tasks.workunit.client.1.smithi112.stdout:7/750: dread d7/d25/d40/f62 [0,4194304] 0 2024-04-25T02:09:16.583 INFO:tasks.workunit.client.1.smithi112.stdout:8/937: mkdir d15/d26/d4f/d67/d146 0 2024-04-25T02:09:16.583 INFO:tasks.workunit.client.1.smithi112.stdout:8/938: write d15/d35/d5f/db5/dc2/d143/fa2 [940076,85325] 0 2024-04-25T02:09:16.588 INFO:tasks.workunit.client.1.smithi112.stdout:4/852: dwrite d2/d1e/d1b/d83/f90 [0,4194304] 0 2024-04-25T02:09:16.588 INFO:tasks.workunit.client.1.smithi112.stdout:4/853: dread - d2/d1e/d1b/d65/ffa zero size 2024-04-25T02:09:16.588 INFO:tasks.workunit.client.1.smithi112.stdout:5/703: unlink d1/d16/fda 0 2024-04-25T02:09:16.592 INFO:tasks.workunit.client.1.smithi112.stdout:7/751: mkdir d7/dd/de5 0 2024-04-25T02:09:16.598 INFO:tasks.workunit.client.1.smithi112.stdout:2/754: sync 2024-04-25T02:09:16.608 INFO:tasks.workunit.client.1.smithi112.stdout:3/768: sync 2024-04-25T02:09:16.608 INFO:tasks.workunit.client.1.smithi112.stdout:9/643: sync 2024-04-25T02:09:16.608 INFO:tasks.workunit.client.1.smithi112.stdout:1/771: sync 2024-04-25T02:09:16.608 INFO:tasks.workunit.client.1.smithi112.stdout:6/666: sync 2024-04-25T02:09:16.608 INFO:tasks.workunit.client.1.smithi112.stdout:6/667: fsync d0/d2/f15 0 2024-04-25T02:09:16.608 INFO:tasks.workunit.client.1.smithi112.stdout:9/644: dread - d1/df/d3c/d6c/f71 zero size 2024-04-25T02:09:16.608 INFO:tasks.workunit.client.1.smithi112.stdout:9/645: fsync d1/df/d3c/d46/f78 0 2024-04-25T02:09:16.609 INFO:tasks.workunit.client.1.smithi112.stdout:3/769: dread d12/d13/d34/f9a [0,4194304] 0 2024-04-25T02:09:16.610 INFO:tasks.workunit.client.1.smithi112.stdout:4/854: write d2/d12/fca [633524,80534] 0 2024-04-25T02:09:16.611 INFO:tasks.workunit.client.1.smithi112.stdout:5/704: mknod d1/d41/d5b/d79/cec 0 2024-04-25T02:09:16.612 INFO:tasks.workunit.client.1.smithi112.stdout:2/755: link d3/da/dc/d3e/df/d25/cab d3/da/dc/d3e/df/d30/d7c/cfd 0 2024-04-25T02:09:16.612 INFO:tasks.workunit.client.1.smithi112.stdout:2/756: chown d3/da/dc/d3e/df/d25/d9e/f9a 1032 1 2024-04-25T02:09:16.614 INFO:tasks.workunit.client.1.smithi112.stdout:1/772: rename d7/d4b/cb2 to d7/d9/d4e/d72/d73/de9/d3f/da9/dae/cf4 0 2024-04-25T02:09:16.615 INFO:tasks.workunit.client.1.smithi112.stdout:6/668: link d0/d7b/c8b d0/d2/d4/d28/ce1 0 2024-04-25T02:09:16.615 INFO:tasks.workunit.client.1.smithi112.stdout:6/669: write d0/d2/d4/fdc [915934,33989] 0 2024-04-25T02:09:16.615 INFO:tasks.workunit.client.1.smithi112.stdout:6/670: write d0/d32/d45/fad [244244,26798] 0 2024-04-25T02:09:16.616 INFO:tasks.workunit.client.1.smithi112.stdout:9/646: creat d1/df/d8f/dd2/fdb x:0 0 0 2024-04-25T02:09:16.616 INFO:tasks.workunit.client.1.smithi112.stdout:3/770: mkdir d12/d1f/daa/dfa 0 2024-04-25T02:09:16.616 INFO:tasks.workunit.client.1.smithi112.stdout:3/771: fsync d12/d67/fb2 0 2024-04-25T02:09:16.617 INFO:tasks.workunit.client.1.smithi112.stdout:2/757: symlink d3/da/lfe 0 2024-04-25T02:09:16.617 INFO:tasks.workunit.client.1.smithi112.stdout:1/773: mknod d7/d9/d4e/d72/d73/de9/d32/cf5 0 2024-04-25T02:09:16.619 INFO:tasks.workunit.client.1.smithi112.stdout:6/671: truncate d0/d2/d1f/fde 611918 0 2024-04-25T02:09:16.619 INFO:tasks.workunit.client.1.smithi112.stdout:6/672: write d0/d2/d3b/d53/f72 [3885094,18096] 0 2024-04-25T02:09:16.619 INFO:tasks.workunit.client.1.smithi112.stdout:6/673: write d0/d61/db0/fbf [506760,45108] 0 2024-04-25T02:09:16.619 INFO:tasks.workunit.client.1.smithi112.stdout:6/674: write d0/f17 [5428370,30467] 0 2024-04-25T02:09:16.619 INFO:tasks.workunit.client.1.smithi112.stdout:6/675: chown d0/d2/d1f 529812303 1 2024-04-25T02:09:16.619 INFO:tasks.workunit.client.1.smithi112.stdout:6/676: chown d0/c46 1 1 2024-04-25T02:09:16.619 INFO:tasks.workunit.client.1.smithi112.stdout:6/677: chown d0/d2/d3b/d53/cb8 26 1 2024-04-25T02:09:16.619 INFO:tasks.workunit.client.1.smithi112.stdout:9/647: mkdir d1/df/d3c/d6c/ddc 0 2024-04-25T02:09:16.620 INFO:tasks.workunit.client.1.smithi112.stdout:9/648: creat d1/d48/fdd x:0 0 0 2024-04-25T02:09:16.620 INFO:tasks.workunit.client.1.smithi112.stdout:2/758: creat d3/da/dc/d3e/df/d30/d7c/d96/fff x:0 0 0 2024-04-25T02:09:16.620 INFO:tasks.workunit.client.1.smithi112.stdout:2/759: chown d3/da/dc/d20/d40/f6e 371847826 1 2024-04-25T02:09:16.621 INFO:tasks.workunit.client.1.smithi112.stdout:1/774: rename d7/d4b/laf to d7/d9/d1e/d40/de2/lf6 0 2024-04-25T02:09:16.623 INFO:tasks.workunit.client.1.smithi112.stdout:9/649: unlink d1/df/d3c/d6c/c6f 0 2024-04-25T02:09:16.624 INFO:tasks.workunit.client.1.smithi112.stdout:4/855: write d2/d17/d25/fc6 [919962,10810] 0 2024-04-25T02:09:16.624 INFO:tasks.workunit.client.1.smithi112.stdout:0/971: dwrite da/d1d/d2e/d40/d49/d6b/d90/fc6 [0,4194304] 0 2024-04-25T02:09:16.624 INFO:tasks.workunit.client.1.smithi112.stdout:2/760: link d3/da/dc/d20/d40/f5b d3/da/dc/d3e/df/d25/d88/d8e/df0/f100 0 2024-04-25T02:09:16.625 INFO:tasks.workunit.client.1.smithi112.stdout:1/775: creat d7/d9/d4e/d72/d73/de9/ff7 x:0 0 0 2024-04-25T02:09:16.625 INFO:tasks.workunit.client.1.smithi112.stdout:1/776: creat d7/d9/d46/ff8 x:0 0 0 2024-04-25T02:09:16.626 INFO:tasks.workunit.client.1.smithi112.stdout:5/705: write d1/d2/d4/dc4/f85 [1824515,36485] 0 2024-04-25T02:09:16.626 INFO:tasks.workunit.client.1.smithi112.stdout:9/650: truncate d1/d48/d65/d73/daf/fa4 1124837 0 2024-04-25T02:09:16.628 INFO:tasks.workunit.client.1.smithi112.stdout:2/761: mkdir d3/da/dc/d3e/df/d25/d9e/d81/d101 0 2024-04-25T02:09:16.629 INFO:tasks.workunit.client.1.smithi112.stdout:1/777: rename d7/d9/d1f/l23 to d7/d9/d1f/d25/d39/lf9 0 2024-04-25T02:09:16.629 INFO:tasks.workunit.client.1.smithi112.stdout:1/778: write d7/d4b/f69 [88606,127283] 0 2024-04-25T02:09:16.630 INFO:tasks.workunit.client.1.smithi112.stdout:5/706: creat d1/d41/d5b/fed x:0 0 0 2024-04-25T02:09:16.631 INFO:tasks.workunit.client.1.smithi112.stdout:9/651: creat d1/d13/d41/d84/fde x:0 0 0 2024-04-25T02:09:16.632 INFO:tasks.workunit.client.1.smithi112.stdout:4/856: dread d2/d17/d20/d5e/f6c [0,4194304] 0 2024-04-25T02:09:16.633 INFO:tasks.workunit.client.1.smithi112.stdout:2/762: dread d3/da/dc/d20/d43/d74/f80 [0,4194304] 0 2024-04-25T02:09:16.633 INFO:tasks.workunit.client.1.smithi112.stdout:1/779: symlink d7/d4b/d7b/lfa 0 2024-04-25T02:09:16.634 INFO:tasks.workunit.client.1.smithi112.stdout:5/707: creat d1/d16/ddb/fee x:0 0 0 2024-04-25T02:09:16.634 INFO:tasks.workunit.client.1.smithi112.stdout:5/708: chown d1/d2/d28/d4f/f83 10548 1 2024-04-25T02:09:16.635 INFO:tasks.workunit.client.1.smithi112.stdout:9/652: mknod d1/df/cdf 0 2024-04-25T02:09:16.637 INFO:tasks.workunit.client.1.smithi112.stdout:4/857: truncate d2/d1e/d1b/d86/f6d 3190831 0 2024-04-25T02:09:16.637 INFO:tasks.workunit.client.1.smithi112.stdout:4/858: chown d2/d4e/cf9 42 1 2024-04-25T02:09:16.637 INFO:tasks.workunit.client.1.smithi112.stdout:4/859: write d2/d1e/f74 [3700527,11969] 0 2024-04-25T02:09:16.637 INFO:tasks.workunit.client.1.smithi112.stdout:5/709: mknod d1/d16/d99/cef 0 2024-04-25T02:09:16.639 INFO:tasks.workunit.client.1.smithi112.stdout:4/860: creat d2/d17/d20/d26/d39/d49/d95/dc7/f118 x:0 0 0 2024-04-25T02:09:16.641 INFO:tasks.workunit.client.1.smithi112.stdout:5/710: creat d1/d41/d5b/d79/d7a/ff0 x:0 0 0 2024-04-25T02:09:16.642 INFO:tasks.workunit.client.1.smithi112.stdout:4/861: rename d2/d17/d20/d5e/ld5 to d2/d17/d20/dbe/l119 0 2024-04-25T02:09:16.643 INFO:tasks.workunit.client.1.smithi112.stdout:4/862: rename d2/d17/d20/d26/d80/cf7 to d2/d17/d20/d26/d39/d49/c11a 0 2024-04-25T02:09:16.656 INFO:tasks.workunit.client.1.smithi112.stdout:7/752: dwrite d7/f19 [0,4194304] 0 2024-04-25T02:09:16.657 INFO:tasks.workunit.client.1.smithi112.stdout:7/753: symlink d7/dd/d20/le6 0 2024-04-25T02:09:16.659 INFO:tasks.workunit.client.1.smithi112.stdout:7/754: mknod d7/dd/da9/d74/ce7 0 2024-04-25T02:09:16.659 INFO:tasks.workunit.client.1.smithi112.stdout:7/755: creat d7/fe8 x:0 0 0 2024-04-25T02:09:16.661 INFO:tasks.workunit.client.1.smithi112.stdout:7/756: creat d7/d25/d40/db0/fe9 x:0 0 0 2024-04-25T02:09:16.662 INFO:tasks.workunit.client.1.smithi112.stdout:7/757: chown d7/d25/d40/d6b/dcf 118881534 1 2024-04-25T02:09:16.674 INFO:tasks.workunit.client.1.smithi112.stdout:7/758: write d7/dd/f18 [3303919,111358] 0 2024-04-25T02:09:16.676 INFO:tasks.workunit.client.1.smithi112.stdout:0/972: dread da/f10 [0,4194304] 0 2024-04-25T02:09:16.678 INFO:tasks.workunit.client.1.smithi112.stdout:5/711: write d1/d16/f75 [7903374,113489] 0 2024-04-25T02:09:16.678 INFO:tasks.workunit.client.1.smithi112.stdout:5/712: dread - d1/d2/d4/dc4/d9c/fbc zero size 2024-04-25T02:09:16.687 INFO:tasks.workunit.client.1.smithi112.stdout:5/713: rmdir d1/d41/d5b/d7b/db2/dc0/dcf/ddd/dd2 0 2024-04-25T02:09:16.687 INFO:tasks.workunit.client.1.smithi112.stdout:5/714: fdatasync d1/d2/d4/dc4/f85 0 2024-04-25T02:09:16.687 INFO:tasks.workunit.client.1.smithi112.stdout:5/715: dread - d1/d2/d28/d4f/fb7 zero size 2024-04-25T02:09:16.688 INFO:tasks.workunit.client.1.smithi112.stdout:5/716: mknod d1/d6c/cf1 0 2024-04-25T02:09:16.697 INFO:tasks.workunit.client.1.smithi112.stdout:6/678: getdents d0/d2/d4/d28 0 2024-04-25T02:09:16.697 INFO:tasks.workunit.client.1.smithi112.stdout:7/759: write d7/dd/f21 [4482009,27727] 0 2024-04-25T02:09:16.698 INFO:tasks.workunit.client.1.smithi112.stdout:7/760: chown d7/f19 399 1 2024-04-25T02:09:16.698 INFO:tasks.workunit.client.1.smithi112.stdout:7/761: chown d7/dd/d20/d2c/l5d 19305973 1 2024-04-25T02:09:16.698 INFO:tasks.workunit.client.1.smithi112.stdout:7/762: creat d7/d25/d40/d51/fea x:0 0 0 2024-04-25T02:09:16.699 INFO:tasks.workunit.client.1.smithi112.stdout:6/679: creat d0/d7b/fe2 x:0 0 0 2024-04-25T02:09:16.702 INFO:tasks.workunit.client.1.smithi112.stdout:7/763: unlink d7/d25/f2d 0 2024-04-25T02:09:16.703 INFO:tasks.workunit.client.1.smithi112.stdout:6/680: creat d0/d2/d66/fe3 x:0 0 0 2024-04-25T02:09:16.706 INFO:tasks.workunit.client.1.smithi112.stdout:6/681: symlink d0/d61/d98/db5/le4 0 2024-04-25T02:09:16.707 INFO:tasks.workunit.client.1.smithi112.stdout:1/780: dwrite d7/d9/d1e/de/d84/f9f [0,4194304] 0 2024-04-25T02:09:16.708 INFO:tasks.workunit.client.1.smithi112.stdout:3/772: dwrite d12/f63 [0,4194304] 0 2024-04-25T02:09:16.709 INFO:tasks.workunit.client.1.smithi112.stdout:6/682: link d0/d2/d66/d7d/fdf d0/d2/d4/d28/fe5 0 2024-04-25T02:09:16.710 INFO:tasks.workunit.client.1.smithi112.stdout:2/763: dwrite d3/da/dc/d20/d43/d5e/f92 [0,4194304] 0 2024-04-25T02:09:16.710 INFO:tasks.workunit.client.1.smithi112.stdout:5/717: dwrite d1/d16/d8f/fa7 [0,4194304] 0 2024-04-25T02:09:16.711 INFO:tasks.workunit.client.1.smithi112.stdout:7/764: rename d7/d79/db8 to d7/dd/da9/d74/deb 0 2024-04-25T02:09:16.711 INFO:tasks.workunit.client.1.smithi112.stdout:4/863: dwrite d2/d17/d20/d26/d39/d49/f3c [0,4194304] 0 2024-04-25T02:09:16.711 INFO:tasks.workunit.client.1.smithi112.stdout:0/973: dwrite da/d13/d45/d5e/db4/f11e [0,4194304] 0 2024-04-25T02:09:16.712 INFO:tasks.workunit.client.1.smithi112.stdout:1/781: symlink d7/d9/d51/lfb 0 2024-04-25T02:09:16.712 INFO:tasks.workunit.client.1.smithi112.stdout:1/782: fsync d7/d4b/d94/fbe 0 2024-04-25T02:09:16.713 INFO:tasks.workunit.client.1.smithi112.stdout:1/783: read - d7/d9/d1f/ff1 zero size 2024-04-25T02:09:16.719 INFO:tasks.workunit.client.1.smithi112.stdout:6/683: mknod d0/d2/d66/da8/ce6 0 2024-04-25T02:09:16.719 INFO:tasks.workunit.client.1.smithi112.stdout:6/684: write d0/d2/d4/dd/f3d [4441002,76668] 0 2024-04-25T02:09:16.721 INFO:tasks.workunit.client.1.smithi112.stdout:4/864: dread d2/d1e/f74 [0,4194304] 0 2024-04-25T02:09:16.722 INFO:tasks.workunit.client.1.smithi112.stdout:5/718: symlink d1/d41/d5b/d7b/d87/lf2 0 2024-04-25T02:09:16.724 INFO:tasks.workunit.client.1.smithi112.stdout:2/764: rename d3/da/dc/d3e/df/d25/f46 to d3/da/dc/d3e/df/d25/d88/d8e/df0/f102 0 2024-04-25T02:09:16.726 INFO:tasks.workunit.client.1.smithi112.stdout:7/765: symlink d7/d79/lec 0 2024-04-25T02:09:16.731 INFO:tasks.workunit.client.1.smithi112.stdout:0/974: stat da/c4c 0 2024-04-25T02:09:16.732 INFO:tasks.workunit.client.1.smithi112.stdout:6/685: read d0/d2/fba [2153959,123726] 0 2024-04-25T02:09:16.732 INFO:tasks.workunit.client.1.smithi112.stdout:6/686: creat d0/d2/d1f/fe7 x:0 0 0 2024-04-25T02:09:16.733 INFO:tasks.workunit.client.1.smithi112.stdout:6/687: chown d0/c76 6144 1 2024-04-25T02:09:16.733 INFO:tasks.workunit.client.1.smithi112.stdout:1/784: symlink d7/d9/d4e/d85/lfc 0 2024-04-25T02:09:16.733 INFO:tasks.workunit.client.1.smithi112.stdout:1/785: creat d7/d9/d46/ffd x:0 0 0 2024-04-25T02:09:16.735 INFO:tasks.workunit.client.1.smithi112.stdout:5/719: mkdir d1/d2/d4/dc4/df3 0 2024-04-25T02:09:16.736 INFO:tasks.workunit.client.1.smithi112.stdout:2/765: rename d3/da/dc/d20/d43/d5e/c7b to d3/da/dc/d20/d43/d74/c103 0 2024-04-25T02:09:16.737 INFO:tasks.workunit.client.1.smithi112.stdout:7/766: mkdir d7/d79/da2/d3a/ded 0 2024-04-25T02:09:16.739 INFO:tasks.workunit.client.1.smithi112.stdout:3/773: dwrite d12/d13/d34/d4a/d4f/fa2 [0,4194304] 0 2024-04-25T02:09:16.740 INFO:tasks.workunit.client.1.smithi112.stdout:4/865: dwrite d2/d17/d20/deb/fde [0,4194304] 0 2024-04-25T02:09:16.741 INFO:tasks.workunit.client.1.smithi112.stdout:6/688: truncate d0/d2/d3b/f58 1947389 0 2024-04-25T02:09:16.743 INFO:tasks.workunit.client.1.smithi112.stdout:1/786: mknod d7/d9/d1e/de/d9a/de8/cfe 0 2024-04-25T02:09:16.743 INFO:tasks.workunit.client.1.smithi112.stdout:1/787: dread - d7/d9/d51/d58/f76 zero size 2024-04-25T02:09:16.743 INFO:tasks.workunit.client.1.smithi112.stdout:1/788: creat d7/d9/d1e/de/d84/fff x:0 0 0 2024-04-25T02:09:16.745 INFO:tasks.workunit.client.1.smithi112.stdout:2/766: creat d3/da/dc/d3e/df/d32/ddf/f104 x:0 0 0 2024-04-25T02:09:16.745 INFO:tasks.workunit.client.1.smithi112.stdout:2/767: dread - d3/da/dc/d3e/df/d30/dc2/ff4 zero size 2024-04-25T02:09:16.750 INFO:tasks.workunit.client.1.smithi112.stdout:6/689: mkdir d0/d2/d66/d7d/d95/de8 0 2024-04-25T02:09:16.751 INFO:tasks.workunit.client.1.smithi112.stdout:0/975: dwrite da/d13/d1e/de0/deb/d12d/d6d/f8b [4194304,4194304] 0 2024-04-25T02:09:16.757 INFO:tasks.workunit.client.1.smithi112.stdout:2/768: read d3/da/dc/d20/d40/f5b [2903651,27560] 0 2024-04-25T02:09:16.761 INFO:tasks.workunit.client.1.smithi112.stdout:6/690: mkdir d0/d2/d3b/d53/d67/de9 0 2024-04-25T02:09:16.767 INFO:tasks.workunit.client.1.smithi112.stdout:0/976: dread da/d13/d45/d5e/fb8 [0,4194304] 0 2024-04-25T02:09:16.771 INFO:tasks.workunit.client.1.smithi112.stdout:2/769: rename d3/da/dc/d20/d43/d5e/f92 to d3/da/dc/d3e/df/d25/f105 0 2024-04-25T02:09:16.773 INFO:tasks.workunit.client.1.smithi112.stdout:0/977: mkdir da/d1d/d88/d132 0 2024-04-25T02:09:16.778 INFO:tasks.workunit.client.1.smithi112.stdout:0/978: rmdir da/d1d/d2e/d40/d49/d4f 39 2024-04-25T02:09:16.779 INFO:tasks.workunit.client.1.smithi112.stdout:0/979: rmdir da/d13/d1e/de0/deb/d12d/de9 39 2024-04-25T02:09:16.780 INFO:tasks.workunit.client.1.smithi112.stdout:7/767: dwrite d7/f13 [4194304,4194304] 0 2024-04-25T02:09:16.780 INFO:tasks.workunit.client.1.smithi112.stdout:7/768: write d7/dd/d20/d2c/f8c [1034501,98231] 0 2024-04-25T02:09:16.781 INFO:tasks.workunit.client.1.smithi112.stdout:7/769: creat d7/d25/d43/dca/fee x:0 0 0 2024-04-25T02:09:16.794 INFO:tasks.workunit.client.1.smithi112.stdout:0/980: dread da/d1d/d88/d24/f2c [0,4194304] 0 2024-04-25T02:09:16.795 INFO:tasks.workunit.client.1.smithi112.stdout:0/981: dread - da/d1d/d88/d78/fab zero size 2024-04-25T02:09:16.795 INFO:tasks.workunit.client.1.smithi112.stdout:0/982: chown da/d1d/d2e/d40/d49/d4f/l66 47097035 1 2024-04-25T02:09:16.796 INFO:tasks.workunit.client.1.smithi112.stdout:0/983: symlink da/d1d/d2e/d40/d49/d6b/dc1/l133 0 2024-04-25T02:09:16.800 INFO:tasks.workunit.client.1.smithi112.stdout:5/720: dwrite d1/d2/d4/ff [0,4194304] 0 2024-04-25T02:09:16.801 INFO:tasks.workunit.client.1.smithi112.stdout:5/721: mkdir d1/d2/d4/dc4/df4 0 2024-04-25T02:09:16.802 INFO:tasks.workunit.client.1.smithi112.stdout:3/774: dwrite d12/d13/d34/d78/d83/f93 [0,4194304] 0 2024-04-25T02:09:16.803 INFO:tasks.workunit.client.1.smithi112.stdout:3/775: mkdir d12/d13/d34/d53/d9c/dfb 0 2024-04-25T02:09:16.807 INFO:tasks.workunit.client.1.smithi112.stdout:3/776: link d12/d5d/c77 d12/d13/d34/d78/d83/cfc 0 2024-04-25T02:09:16.807 INFO:tasks.workunit.client.1.smithi112.stdout:3/777: write d12/f1d [1206051,62078] 0 2024-04-25T02:09:16.807 INFO:tasks.workunit.client.1.smithi112.stdout:0/984: dread da/d1d/d2e/d40/d49/d4f/d82/f104 [0,4194304] 0 2024-04-25T02:09:16.808 INFO:tasks.workunit.client.1.smithi112.stdout:5/722: rename d1/d41 to d1/df5 0 2024-04-25T02:09:16.808 INFO:tasks.workunit.client.1.smithi112.stdout:3/778: dread d12/d1f/d27/d44/fb6 [0,4194304] 0 2024-04-25T02:09:16.808 INFO:tasks.workunit.client.1.smithi112.stdout:3/779: write d12/d13/d34/f9a [665535,21509] 0 2024-04-25T02:09:16.809 INFO:tasks.workunit.client.1.smithi112.stdout:3/780: chown d12/d13/d34/f9a 51 1 2024-04-25T02:09:16.810 INFO:tasks.workunit.client.1.smithi112.stdout:2/770: dwrite d3/da/dc/d20/d43/d74/fce [0,4194304] 0 2024-04-25T02:09:16.810 INFO:tasks.workunit.client.1.smithi112.stdout:7/770: dwrite d7/d25/d40/d51/fbe [4194304,4194304] 0 2024-04-25T02:09:16.829 INFO:tasks.workunit.client.1.smithi112.stdout:3/781: symlink d12/d5d/lfd 0 2024-04-25T02:09:16.829 INFO:tasks.workunit.client.1.smithi112.stdout:3/782: fsync d12/d13/f8e 0 2024-04-25T02:09:16.831 INFO:tasks.workunit.client.1.smithi112.stdout:2/771: creat d3/da/dc/d20/d43/d7e/f106 x:0 0 0 2024-04-25T02:09:16.832 INFO:tasks.workunit.client.1.smithi112.stdout:7/771: getdents d7/d25/d43/dbc 0 2024-04-25T02:09:16.832 INFO:tasks.workunit.client.1.smithi112.stdout:7/772: truncate d7/d25/d40/d51/fce 340202 0 2024-04-25T02:09:16.841 INFO:tasks.workunit.client.1.smithi112.stdout:2/772: write d3/da/dc/fb9 [1946235,103315] 0 2024-04-25T02:09:16.850 INFO:tasks.workunit.client.1.smithi112.stdout:4/866: dwrite d2/d17/d25/fe4 [0,4194304] 0 2024-04-25T02:09:16.859 INFO:tasks.workunit.client.1.smithi112.stdout:6/691: dwrite d0/d2/d79/d81/f9b [4194304,4194304] 0 2024-04-25T02:09:16.859 INFO:tasks.workunit.client.1.smithi112.stdout:6/692: stat d0/d61/d98 0 2024-04-25T02:09:16.859 INFO:tasks.workunit.client.1.smithi112.stdout:6/693: creat d0/d2/d66/da8/fea x:0 0 0 2024-04-25T02:09:16.865 INFO:tasks.workunit.client.1.smithi112.stdout:0/985: write da/f10 [4633083,153] 0 2024-04-25T02:09:16.870 INFO:tasks.workunit.client.1.smithi112.stdout:2/773: dwrite d3/da/dc/d3e/df/d25/d88/d8e/df0/f102 [8388608,4194304] 0 2024-04-25T02:09:16.870 INFO:tasks.workunit.client.1.smithi112.stdout:7/773: dread d7/dd/d20/f96 [0,4194304] 0 2024-04-25T02:09:16.879 INFO:tasks.workunit.client.1.smithi112.stdout:2/774: dread d3/f73 [0,4194304] 0 2024-04-25T02:09:16.879 INFO:tasks.workunit.client.1.smithi112.stdout:2/775: stat d3/da/dc/d3e/df/d71/dc5 0 2024-04-25T02:09:16.891 INFO:tasks.workunit.client.1.smithi112.stdout:3/783: unlink d12/d1f/d27/df8/da0/fb1 0 2024-04-25T02:09:16.892 INFO:tasks.workunit.client.1.smithi112.stdout:3/784: dread d12/d13/d34/f64 [0,4194304] 0 2024-04-25T02:09:16.893 INFO:tasks.workunit.client.1.smithi112.stdout:3/785: fsync d12/d1f/d27/f52 0 2024-04-25T02:09:16.893 INFO:tasks.workunit.client.1.smithi112.stdout:3/786: readlink d12/d13/d34/d4a/lcc 0 2024-04-25T02:09:16.902 INFO:tasks.workunit.client.1.smithi112.stdout:4/867: creat d2/d17/d20/dbe/f11b x:0 0 0 2024-04-25T02:09:16.902 INFO:tasks.workunit.client.1.smithi112.stdout:4/868: stat d2/d17/d20/d26/d39/d106 0 2024-04-25T02:09:16.902 INFO:tasks.workunit.client.1.smithi112.stdout:4/869: creat d2/d1e/d1b/d67/f11c x:0 0 0 2024-04-25T02:09:16.908 INFO:tasks.workunit.client.1.smithi112.stdout:6/694: symlink d0/d2/d66/d7d/d95/leb 0 2024-04-25T02:09:16.922 INFO:tasks.workunit.client.1.smithi112.stdout:0/986: mknod da/d1d/dcb/c134 0 2024-04-25T02:09:16.922 INFO:tasks.workunit.client.1.smithi112.stdout:0/987: dread - da/d1d/d88/d24/f125 zero size 2024-04-25T02:09:16.937 INFO:tasks.workunit.client.1.smithi112.stdout:6/695: dwrite d0/d2/d1f/fde [0,4194304] 0 2024-04-25T02:09:16.942 INFO:tasks.workunit.client.1.smithi112.stdout:7/774: creat d7/d25/d43/dbc/fef x:0 0 0 2024-04-25T02:09:16.943 INFO:tasks.workunit.client.1.smithi112.stdout:2/776: mkdir d3/da/dac/dbf/dee/d107 0 2024-04-25T02:09:16.944 INFO:tasks.workunit.client.1.smithi112.stdout:0/988: dwrite da/d13/d45/f5a [4194304,4194304] 0 2024-04-25T02:09:16.946 INFO:tasks.workunit.client.1.smithi112.stdout:3/787: truncate d12/d13/fc1 2664518 0 2024-04-25T02:09:16.949 INFO:tasks.workunit.client.1.smithi112.stdout:4/870: rename d2/d17/d20/d26/d39/d49/d95/dc7/cd0 to d2/d4e/dfb/c11d 0 2024-04-25T02:09:16.951 INFO:tasks.workunit.client.1.smithi112.stdout:6/696: unlink d0/d2/d3b/d53/d67/fd4 0 2024-04-25T02:09:16.954 INFO:tasks.workunit.client.1.smithi112.stdout:5/723: mknod d1/d16/d51/cf6 0 2024-04-25T02:09:16.954 INFO:tasks.workunit.client.1.smithi112.stdout:5/724: write d1/faa [2141252,98819] 0 2024-04-25T02:09:16.957 INFO:tasks.workunit.client.1.smithi112.stdout:3/788: creat d12/d1f/d27/df8/dd2/ffe x:0 0 0 2024-04-25T02:09:16.960 INFO:tasks.workunit.client.1.smithi112.stdout:4/871: mknod d2/d1e/d5c/d109/c11e 0 2024-04-25T02:09:16.962 INFO:tasks.workunit.client.1.smithi112.stdout:5/725: truncate d1/d2/d28/f57 289992 0 2024-04-25T02:09:16.963 INFO:tasks.workunit.client.1.smithi112.stdout:3/789: mknod d12/d13/d34/d78/d91/cff 0 2024-04-25T02:09:16.965 INFO:tasks.workunit.client.1.smithi112.stdout:4/872: symlink d2/d1e/d4b/l11f 0 2024-04-25T02:09:16.965 INFO:tasks.workunit.client.1.smithi112.stdout:4/873: chown d2/d17/d20/d5e/f5b 14 1 2024-04-25T02:09:16.965 INFO:tasks.workunit.client.1.smithi112.stdout:7/775: dwrite d7/d25/fc5 [0,4194304] 0 2024-04-25T02:09:16.966 INFO:tasks.workunit.client.1.smithi112.stdout:5/726: creat d1/d6c/ff7 x:0 0 0 2024-04-25T02:09:16.966 INFO:tasks.workunit.client.1.smithi112.stdout:3/790: mknod d12/d1f/daa/df2/c100 0 2024-04-25T02:09:16.969 INFO:tasks.workunit.client.1.smithi112.stdout:4/874: creat d2/d17/d25/f120 x:0 0 0 2024-04-25T02:09:16.969 INFO:tasks.workunit.client.1.smithi112.stdout:4/875: truncate d2/d1e/d1b/d67/f114 984421 0 2024-04-25T02:09:16.970 INFO:tasks.workunit.client.1.smithi112.stdout:4/876: chown d2/d1e/d1b/c9a 2793969 1 2024-04-25T02:09:16.970 INFO:tasks.workunit.client.1.smithi112.stdout:7/776: dread d7/d25/d40/f62 [0,4194304] 0 2024-04-25T02:09:16.980 INFO:tasks.workunit.client.1.smithi112.stdout:5/727: mkdir d1/df5/d5b/d7b/d87/df8 0 2024-04-25T02:09:16.982 INFO:tasks.workunit.client.1.smithi112.stdout:7/777: symlink d7/dd/de5/lf0 0 2024-04-25T02:09:16.986 INFO:tasks.workunit.client.1.smithi112.stdout:2/777: mkdir d3/d108 0 2024-04-25T02:09:16.988 INFO:tasks.workunit.client.1.smithi112.stdout:2/778: unlink d3/fca 0 2024-04-25T02:09:16.990 INFO:tasks.workunit.client.1.smithi112.stdout:2/779: mknod d3/da/dc/d3e/df/c109 0 2024-04-25T02:09:16.992 INFO:tasks.workunit.client.1.smithi112.stdout:5/728: write d1/d16/d8f/fa7 [1148055,112612] 0 2024-04-25T02:09:17.001 INFO:tasks.workunit.client.1.smithi112.stdout:3/791: dwrite d12/d13/d34/d78/f7f [0,4194304] 0 2024-04-25T02:09:17.001 INFO:tasks.workunit.client.1.smithi112.stdout:4/877: dwrite d2/d12/de1/fcc [0,4194304] 0 2024-04-25T02:09:17.016 INFO:tasks.workunit.client.1.smithi112.stdout:4/878: write d2/f1d [1044411,48910] 0 2024-04-25T02:09:17.016 INFO:tasks.workunit.client.1.smithi112.stdout:4/879: dread - d2/d17/d20/d26/d39/d106/f10c zero size 2024-04-25T02:09:17.032 INFO:tasks.workunit.client.1.smithi112.stdout:4/880: dwrite d2/d17/d20/d26/d39/fee [0,4194304] 0 2024-04-25T02:09:17.041 INFO:tasks.workunit.client.1.smithi112.stdout:5/729: truncate d1/d2/d7d/fc2 1389183 0 2024-04-25T02:09:17.042 INFO:tasks.workunit.client.1.smithi112.stdout:3/792: mknod d12/d1f/daa/dfa/c101 0 2024-04-25T02:09:17.047 INFO:tasks.workunit.client.1.smithi112.stdout:5/730: dread d1/df5/f6d [0,4194304] 0 2024-04-25T02:09:17.093 INFO:tasks.workunit.client.1.smithi112.stdout:4/881: symlink d2/d1e/d5c/d109/l121 0 2024-04-25T02:09:17.093 INFO:tasks.workunit.client.1.smithi112.stdout:4/882: write d2/d1e/fce [712736,124177] 0 2024-04-25T02:09:17.093 INFO:tasks.workunit.client.1.smithi112.stdout:2/780: dwrite d3/da/dc/d3e/df/d30/d7c/d96/fb8 [0,4194304] 0 2024-04-25T02:09:17.095 INFO:tasks.workunit.client.1.smithi112.stdout:3/793: mkdir d12/d67/dd3/d102 0 2024-04-25T02:09:17.095 INFO:tasks.workunit.client.1.smithi112.stdout:3/794: dread - d12/d13/d34/d53/fae zero size 2024-04-25T02:09:17.096 INFO:tasks.workunit.client.1.smithi112.stdout:5/731: creat d1/d2/ff9 x:0 0 0 2024-04-25T02:09:17.098 INFO:tasks.workunit.client.1.smithi112.stdout:2/781: unlink d3/da/dc/d20/d43/d7e/da3/fae 0 2024-04-25T02:09:17.100 INFO:tasks.workunit.client.1.smithi112.stdout:2/782: creat d3/f10a x:0 0 0 2024-04-25T02:09:17.100 INFO:tasks.workunit.client.1.smithi112.stdout:2/783: write d3/da/dc/d3e/df/d25/d9e/f9a [757724,128305] 0 2024-04-25T02:09:17.100 INFO:tasks.workunit.client.1.smithi112.stdout:2/784: dread - d3/da/dc/d3e/df/d30/dc2/ff4 zero size 2024-04-25T02:09:17.100 INFO:tasks.workunit.client.1.smithi112.stdout:2/785: write d3/da/dc/d20/d40/f6e [4930527,99054] 0 2024-04-25T02:09:17.107 INFO:tasks.workunit.client.1.smithi112.stdout:3/795: dread d12/d13/f37 [4194304,4194304] 0 2024-04-25T02:09:17.119 INFO:tasks.workunit.client.1.smithi112.stdout:4/883: dwrite d2/d1e/d1b/d65/ffa [0,4194304] 0 2024-04-25T02:09:17.120 INFO:tasks.workunit.client.1.smithi112.stdout:4/884: dread d2/d17/d20/d5e/fb8 [0,4194304] 0 2024-04-25T02:09:17.125 INFO:tasks.workunit.client.1.smithi112.stdout:4/885: mkdir d2/d12/d122 0 2024-04-25T02:09:17.147 INFO:tasks.workunit.client.1.smithi112.stdout:5/732: dread d1/d2/d28/f57 [0,4194304] 0 2024-04-25T02:09:17.149 INFO:tasks.workunit.client.1.smithi112.stdout:0/989: mknod da/d13/c135 0 2024-04-25T02:09:17.150 INFO:tasks.workunit.client.1.smithi112.stdout:0/990: truncate da/d13/d1e/de0/deb/ff2 1130589 0 2024-04-25T02:09:17.150 INFO:tasks.workunit.client.1.smithi112.stdout:0/991: chown da/d1d/d88/f110 8738936 1 2024-04-25T02:09:17.153 INFO:tasks.workunit.client.1.smithi112.stdout:6/697: creat d0/d2/fec x:0 0 0 2024-04-25T02:09:17.153 INFO:tasks.workunit.client.1.smithi112.stdout:6/698: symlink d0/d2/d1f/led 0 2024-04-25T02:09:17.154 INFO:tasks.workunit.client.1.smithi112.stdout:6/699: readlink d0/d2/d2c/l2d 0 2024-04-25T02:09:17.154 INFO:tasks.workunit.client.1.smithi112.stdout:6/700: mknod d0/d2/d3b/d53/d67/d6b/cee 0 2024-04-25T02:09:17.155 INFO:tasks.workunit.client.1.smithi112.stdout:0/992: dread da/d13/d1e/f4e [0,4194304] 0 2024-04-25T02:09:17.159 INFO:tasks.workunit.client.1.smithi112.stdout:5/733: dread d1/d2/d28/f77 [0,4194304] 0 2024-04-25T02:09:17.164 INFO:tasks.workunit.client.1.smithi112.stdout:6/701: dread d0/d2/d3b/d53/f96 [0,4194304] 0 2024-04-25T02:09:17.165 INFO:tasks.workunit.client.1.smithi112.stdout:5/734: write d1/f8 [1239215,52978] 0 2024-04-25T02:09:17.165 INFO:tasks.workunit.client.1.smithi112.stdout:5/735: truncate d1/d16/d8f/fbd 769404 0 2024-04-25T02:09:17.165 INFO:tasks.workunit.client.1.smithi112.stdout:5/736: dread - d1/d2/d28/d4f/f71 zero size 2024-04-25T02:09:17.165 INFO:tasks.workunit.client.1.smithi112.stdout:5/737: read d1/d16/f75 [440000,86904] 0 2024-04-25T02:09:17.167 INFO:tasks.workunit.client.1.smithi112.stdout:2/786: rename d3/da/dc/d3e/l4f to d3/da/dc/d3e/df/d25/l10b 0 2024-04-25T02:09:17.167 INFO:tasks.workunit.client.1.smithi112.stdout:2/787: write d3/da/dc/d3e/df/d32/ddf/f104 [878721,42737] 0 2024-04-25T02:09:17.167 INFO:tasks.workunit.client.1.smithi112.stdout:2/788: readlink d3/da/dc/d3e/df/d25/d9e/lb4 0 2024-04-25T02:09:17.168 INFO:tasks.workunit.client.1.smithi112.stdout:2/789: write d3/da/dc/d20/d85/fe5 [270398,71273] 0 2024-04-25T02:09:17.169 INFO:tasks.workunit.client.1.smithi112.stdout:2/790: truncate d3/da/dc/d3e/df/d25/d88/d8e/fa4 1255570 0 2024-04-25T02:09:17.170 INFO:tasks.workunit.client.1.smithi112.stdout:6/702: dread d0/d2/d2c/f33 [0,4194304] 0 2024-04-25T02:09:17.172 INFO:tasks.workunit.client.1.smithi112.stdout:2/791: link d3/da/dc/d20/d43/d5e/l9c d3/l10c 0 2024-04-25T02:09:17.173 INFO:tasks.workunit.client.1.smithi112.stdout:6/703: link d0/d32/dc0/l97 d0/d7b/lef 0 2024-04-25T02:09:17.175 INFO:tasks.workunit.client.1.smithi112.stdout:2/792: rename d3/da/dc/d3e/df/fed to d3/da/dc/d3e/df/d25/d9e/d81/d9f/f10d 0 2024-04-25T02:09:17.178 INFO:tasks.workunit.client.1.smithi112.stdout:6/704: creat d0/d61/d98/db5/ff0 x:0 0 0 2024-04-25T02:09:17.178 INFO:tasks.workunit.client.1.smithi112.stdout:6/705: dread - d0/d2/d3b/d53/d67/fd3 zero size 2024-04-25T02:09:17.178 INFO:tasks.workunit.client.1.smithi112.stdout:6/706: creat d0/d32/d45/ff1 x:0 0 0 2024-04-25T02:09:17.181 INFO:tasks.workunit.client.1.smithi112.stdout:3/796: rmdir d12/d5d 39 2024-04-25T02:09:17.181 INFO:tasks.workunit.client.1.smithi112.stdout:3/797: truncate d12/d67/dbf/fd0 1503838 0 2024-04-25T02:09:17.181 INFO:tasks.workunit.client.1.smithi112.stdout:3/798: truncate d12/d1f/d27/d44/d73/d95/da5/db3/fb7 632605 0 2024-04-25T02:09:17.181 INFO:tasks.workunit.client.1.smithi112.stdout:3/799: write d12/d13/d34/d53/fae [791614,110392] 0 2024-04-25T02:09:17.181 INFO:tasks.workunit.client.1.smithi112.stdout:3/800: creat d12/d1f/db0/f103 x:0 0 0 2024-04-25T02:09:17.183 INFO:tasks.workunit.client.1.smithi112.stdout:5/738: dwrite d1/d2/d78/f7c [0,4194304] 0 2024-04-25T02:09:17.186 INFO:tasks.workunit.client.1.smithi112.stdout:3/801: creat d12/d13/d34/d4a/d87/f104 x:0 0 0 2024-04-25T02:09:17.186 INFO:tasks.workunit.client.1.smithi112.stdout:3/802: truncate d12/d1f/d27/fc5 995167 0 2024-04-25T02:09:17.186 INFO:tasks.workunit.client.1.smithi112.stdout:3/803: fsync d12/d5d/f75 0 2024-04-25T02:09:17.190 INFO:tasks.workunit.client.1.smithi112.stdout:5/739: mknod d1/d16/d22/cfa 0 2024-04-25T02:09:17.191 INFO:tasks.workunit.client.1.smithi112.stdout:6/707: dread d0/d7b/f90 [0,4194304] 0 2024-04-25T02:09:17.192 INFO:tasks.workunit.client.1.smithi112.stdout:3/804: mkdir d12/d1f/d27/d44/d73/d95/da5/d105 0 2024-04-25T02:09:17.194 INFO:tasks.workunit.client.1.smithi112.stdout:6/708: getdents d0 0 2024-04-25T02:09:17.203 INFO:tasks.workunit.client.1.smithi112.stdout:9/653: sync 2024-04-25T02:09:17.203 INFO:tasks.workunit.client.1.smithi112.stdout:1/789: sync 2024-04-25T02:09:17.203 INFO:tasks.workunit.client.1.smithi112.stdout:8/939: sync 2024-04-25T02:09:17.203 INFO:tasks.workunit.client.1.smithi112.stdout:9/654: fdatasync d1/d13/f9d 0 2024-04-25T02:09:17.203 INFO:tasks.workunit.client.1.smithi112.stdout:9/655: dread - d1/df/d3c/fab zero size 2024-04-25T02:09:17.206 INFO:tasks.workunit.client.1.smithi112.stdout:9/656: creat d1/d48/d65/d73/fe0 x:0 0 0 2024-04-25T02:09:17.206 INFO:tasks.workunit.client.1.smithi112.stdout:9/657: creat d1/df/d3c/d6c/fe1 x:0 0 0 2024-04-25T02:09:17.206 INFO:tasks.workunit.client.1.smithi112.stdout:9/658: chown d1/df/d3c/d46/f54 402965846 1 2024-04-25T02:09:17.206 INFO:tasks.workunit.client.1.smithi112.stdout:9/659: write d1/df/d3c/d46/f56 [1903331,49228] 0 2024-04-25T02:09:17.206 INFO:tasks.workunit.client.1.smithi112.stdout:6/709: read d0/d2/d4/f4f [3520396,14253] 0 2024-04-25T02:09:17.206 INFO:tasks.workunit.client.1.smithi112.stdout:6/710: chown d0/d2/d66/d7d/f9c 4368 1 2024-04-25T02:09:17.215 INFO:tasks.workunit.client.1.smithi112.stdout:9/660: unlink d1/df/d3c/fcd 0 2024-04-25T02:09:17.217 INFO:tasks.workunit.client.1.smithi112.stdout:2/793: rename d3/da/dc/d20/d43/d5e to d3/da/dc/d3e/df/d25/d9e/d10e 0 2024-04-25T02:09:17.217 INFO:tasks.workunit.client.1.smithi112.stdout:1/790: dread d7/d9/d4e/d72/d73/de9/d32/f64 [0,4194304] 0 2024-04-25T02:09:17.218 INFO:tasks.workunit.client.1.smithi112.stdout:9/661: mknod d1/df/d3c/ce2 0 2024-04-25T02:09:17.218 INFO:tasks.workunit.client.1.smithi112.stdout:9/662: dread - d1/df/d8f/dd2/fd4 zero size 2024-04-25T02:09:17.219 INFO:tasks.workunit.client.1.smithi112.stdout:9/663: truncate d1/df/d8f/dd2/fd4 21784 0 2024-04-25T02:09:17.220 INFO:tasks.workunit.client.1.smithi112.stdout:9/664: dread d1/d13/d41/d84/fac [0,4194304] 0 2024-04-25T02:09:17.221 INFO:tasks.workunit.client.1.smithi112.stdout:9/665: chown d1/d48/d65/f79 23 1 2024-04-25T02:09:17.221 INFO:tasks.workunit.client.1.smithi112.stdout:5/740: rename d1/d2/f7e to d1/df5/d5b/d96/ffb 0 2024-04-25T02:09:17.223 INFO:tasks.workunit.client.1.smithi112.stdout:1/791: unlink d7/d9/d1e/fb7 0 2024-04-25T02:09:17.223 INFO:tasks.workunit.client.1.smithi112.stdout:1/792: readlink d7/d9/lbd 0 2024-04-25T02:09:17.225 INFO:tasks.workunit.client.1.smithi112.stdout:5/741: mknod d1/d6c/cfc 0 2024-04-25T02:09:17.226 INFO:tasks.workunit.client.1.smithi112.stdout:6/711: dwrite d0/d2/fba [0,4194304] 0 2024-04-25T02:09:17.227 INFO:tasks.workunit.client.1.smithi112.stdout:3/805: rename d12/d1f/db0/fd6 to d12/d1f/d27/f106 0 2024-04-25T02:09:17.229 INFO:tasks.workunit.client.1.smithi112.stdout:5/742: mknod d1/df5/d5b/d79/d7a/d9d/dd5/cfd 0 2024-04-25T02:09:17.229 INFO:tasks.workunit.client.1.smithi112.stdout:5/743: creat d1/d16/d8f/ffe x:0 0 0 2024-04-25T02:09:17.233 INFO:tasks.workunit.client.1.smithi112.stdout:8/940: rename d15/d35/d5c/d91/d78/l9c to d15/d26/d37/l147 0 2024-04-25T02:09:17.233 INFO:tasks.workunit.client.1.smithi112.stdout:8/941: write d15/d35/d5f/db5/dc2/d143/d1a/f2f [1480290,108175] 0 2024-04-25T02:09:17.235 INFO:tasks.workunit.client.1.smithi112.stdout:3/806: link d12/d13/d34/cb5 d12/d1f/daa/dfa/c107 0 2024-04-25T02:09:17.237 INFO:tasks.workunit.client.1.smithi112.stdout:1/793: dread d7/d9/d1e/d66/dc6/fda [0,4194304] 0 2024-04-25T02:09:17.239 INFO:tasks.workunit.client.1.smithi112.stdout:2/794: rename d3/da/dc/d20/d43/d74/f80 to d3/da/dc/d3e/df/d30/f10f 0 2024-04-25T02:09:17.240 INFO:tasks.workunit.client.1.smithi112.stdout:2/795: chown d3/da/dc/d3e/df/d30/d7c/faa 199 1 2024-04-25T02:09:17.240 INFO:tasks.workunit.client.1.smithi112.stdout:6/712: write d0/d2/d3b/f6f [59021,65314] 0 2024-04-25T02:09:17.241 INFO:tasks.workunit.client.1.smithi112.stdout:6/713: mknod d0/d61/d98/cf2 0 2024-04-25T02:09:17.243 INFO:tasks.workunit.client.1.smithi112.stdout:6/714: creat d0/d32/ff3 x:0 0 0 2024-04-25T02:09:17.243 INFO:tasks.workunit.client.1.smithi112.stdout:6/715: stat d0/d2/d4/d28/f5c 0 2024-04-25T02:09:17.243 INFO:tasks.workunit.client.1.smithi112.stdout:6/716: readlink d0/d2/d4/d28/l5e 0 2024-04-25T02:09:17.249 INFO:tasks.workunit.client.1.smithi112.stdout:8/942: write d15/f2c [25716,10333] 0 2024-04-25T02:09:17.249 INFO:tasks.workunit.client.1.smithi112.stdout:5/744: dwrite d1/d16/d8f/fbd [0,4194304] 0 2024-04-25T02:09:17.253 INFO:tasks.workunit.client.1.smithi112.stdout:9/666: getdents d1/df/d3c 0 2024-04-25T02:09:17.254 INFO:tasks.workunit.client.1.smithi112.stdout:1/794: dread d7/d9/d1e/de/f65 [0,4194304] 0 2024-04-25T02:09:17.258 INFO:tasks.workunit.client.1.smithi112.stdout:9/667: mknod d1/df/d3c/d6c/ce3 0 2024-04-25T02:09:17.258 INFO:tasks.workunit.client.1.smithi112.stdout:9/668: readlink d1/df/l3a 0 2024-04-25T02:09:17.259 INFO:tasks.workunit.client.1.smithi112.stdout:2/796: dread d3/da/dc/d20/d43/f55 [0,4194304] 0 2024-04-25T02:09:17.262 INFO:tasks.workunit.client.1.smithi112.stdout:1/795: getdents d7/d9/d1e/de 0 2024-04-25T02:09:17.262 INFO:tasks.workunit.client.1.smithi112.stdout:1/796: write f6 [999401,38886] 0 2024-04-25T02:09:17.263 INFO:tasks.workunit.client.1.smithi112.stdout:5/745: symlink d1/d2/lff 0 2024-04-25T02:09:17.267 INFO:tasks.workunit.client.1.smithi112.stdout:9/669: rename d1/df/d8f/f94 to d1/df/d3c/d43/fe4 0 2024-04-25T02:09:17.268 INFO:tasks.workunit.client.1.smithi112.stdout:8/943: dread d15/d26/fe2 [0,4194304] 0 2024-04-25T02:09:17.271 INFO:tasks.workunit.client.1.smithi112.stdout:1/797: unlink d7/d9/d1e/de/f65 0 2024-04-25T02:09:17.275 INFO:tasks.workunit.client.1.smithi112.stdout:9/670: link d1/f4 d1/d13/fe5 0 2024-04-25T02:09:17.277 INFO:tasks.workunit.client.1.smithi112.stdout:8/944: rmdir d15/d26/d37 39 2024-04-25T02:09:17.279 INFO:tasks.workunit.client.1.smithi112.stdout:3/807: dwrite d12/d13/f31 [0,4194304] 0 2024-04-25T02:09:17.279 INFO:tasks.workunit.client.1.smithi112.stdout:3/808: creat d12/d1f/d27/df8/dd2/f108 x:0 0 0 2024-04-25T02:09:17.280 INFO:tasks.workunit.client.1.smithi112.stdout:2/797: rmdir d3/da/dc/d20/d85 39 2024-04-25T02:09:17.280 INFO:tasks.workunit.client.1.smithi112.stdout:2/798: chown d3/da/dc/d20/lb3 20091 1 2024-04-25T02:09:17.280 INFO:tasks.workunit.client.1.smithi112.stdout:5/746: write d1/d16/d22/f37 [1594954,25321] 0 2024-04-25T02:09:17.280 INFO:tasks.workunit.client.1.smithi112.stdout:6/717: dwrite d0/d32/d45/ff1 [0,4194304] 0 2024-04-25T02:09:17.287 INFO:tasks.workunit.client.1.smithi112.stdout:1/798: symlink d7/d9/l100 0 2024-04-25T02:09:17.287 INFO:tasks.workunit.client.1.smithi112.stdout:1/799: chown d7/d9/d4e/d85/lfc 0 1 2024-04-25T02:09:17.306 INFO:tasks.workunit.client.1.smithi112.stdout:8/945: creat d15/d35/d5c/d5e/d94/f148 x:0 0 0 2024-04-25T02:09:17.314 INFO:tasks.workunit.client.1.smithi112.stdout:3/809: dwrite d12/ff4 [0,4194304] 0 2024-04-25T02:09:17.329 INFO:tasks.workunit.client.1.smithi112.stdout:9/671: dwrite d1/fd [0,4194304] 0 2024-04-25T02:09:17.329 INFO:tasks.workunit.client.1.smithi112.stdout:6/718: dwrite d0/d2/d1f/fe7 [0,4194304] 0 2024-04-25T02:09:17.330 INFO:tasks.workunit.client.1.smithi112.stdout:6/719: truncate d0/d2/d66/fe3 31236 0 2024-04-25T02:09:17.330 INFO:tasks.workunit.client.1.smithi112.stdout:5/747: dwrite d1/d16/d22/fc7 [4194304,4194304] 0 2024-04-25T02:09:17.330 INFO:tasks.workunit.client.1.smithi112.stdout:5/748: write d1/f6 [1646936,64242] 0 2024-04-25T02:09:17.338 INFO:tasks.workunit.client.1.smithi112.stdout:9/672: dread d1/d48/d65/d73/daf/d63/f77 [0,4194304] 0 2024-04-25T02:09:17.347 INFO:tasks.workunit.client.1.smithi112.stdout:3/810: dwrite d12/d1f/d27/d44/d7e/fa3 [0,4194304] 0 2024-04-25T02:09:17.347 INFO:tasks.workunit.client.1.smithi112.stdout:6/720: dwrite d0/d2/d79/d81/f9b [0,4194304] 0 2024-04-25T02:09:17.347 INFO:tasks.workunit.client.1.smithi112.stdout:6/721: fsync d0/d2/d2c/d41/d77/f7c 0 2024-04-25T02:09:17.348 INFO:tasks.workunit.client.1.smithi112.stdout:6/722: chown d0/c2f 16235357 1 2024-04-25T02:09:17.389 INFO:tasks.workunit.client.1.smithi112.stdout:2/799: mknod d3/da/dc/d3e/df/d25/d88/c110 0 2024-04-25T02:09:17.414 INFO:tasks.workunit.client.1.smithi112.stdout:1/800: rename d7/d9/d1e/de/dcf to d7/d9/d4e/d72/d73/de9/d43/dc3/d101 0 2024-04-25T02:09:17.420 INFO:tasks.workunit.client.1.smithi112.stdout:8/946: creat d15/d26/d37/d52/df4/d125/f149 x:0 0 0 2024-04-25T02:09:17.420 INFO:tasks.workunit.client.1.smithi112.stdout:8/947: dread - d15/d35/d5c/d91/d78/dc5/feb zero size 2024-04-25T02:09:17.426 INFO:tasks.workunit.client.1.smithi112.stdout:8/948: dread d15/d26/fe2 [0,4194304] 0 2024-04-25T02:09:17.434 INFO:tasks.workunit.client.1.smithi112.stdout:9/673: link d1/d13/d41/d84/fc8 d1/df/fe6 0 2024-04-25T02:09:17.435 INFO:tasks.workunit.client.1.smithi112.stdout:6/723: getdents d0/d61 0 2024-04-25T02:09:17.435 INFO:tasks.workunit.client.1.smithi112.stdout:6/724: dread - d0/d2/d4/d28/fe5 zero size 2024-04-25T02:09:17.436 INFO:tasks.workunit.client.1.smithi112.stdout:2/800: symlink d3/da/dc/d3e/df/d32/ddf/l111 0 2024-04-25T02:09:17.438 INFO:tasks.workunit.client.1.smithi112.stdout:2/801: write d3/da/dc/d20/ffb [4281196,8155] 0 2024-04-25T02:09:17.444 INFO:tasks.workunit.client.1.smithi112.stdout:6/725: dread d0/d32/d45/f52 [0,4194304] 0 2024-04-25T02:09:17.444 INFO:tasks.workunit.client.1.smithi112.stdout:6/726: dread - d0/d2/d2c/d41/d77/f99 zero size 2024-04-25T02:09:17.444 INFO:tasks.workunit.client.1.smithi112.stdout:1/801: dwrite d7/d9/d4e/f62 [4194304,4194304] 0 2024-04-25T02:09:17.444 INFO:tasks.workunit.client.1.smithi112.stdout:1/802: write d7/d9/d1e/d40/f8f [976422,114646] 0 2024-04-25T02:09:17.445 INFO:tasks.workunit.client.1.smithi112.stdout:1/803: fdatasync d7/d9/d4e/d72/d73/de9/d3f/fa7 0 2024-04-25T02:09:17.445 INFO:tasks.workunit.client.1.smithi112.stdout:6/727: write d0/d32/d45/fad [38503,66034] 0 2024-04-25T02:09:17.445 INFO:tasks.workunit.client.1.smithi112.stdout:3/811: rename d12/d13/d34/c3f to d12/d13/d34/d4a/d4f/da1/dea/c109 0 2024-04-25T02:09:17.446 INFO:tasks.workunit.client.1.smithi112.stdout:8/949: mkdir d15/d26/d37/d52/df4/d14a 0 2024-04-25T02:09:17.447 INFO:tasks.workunit.client.1.smithi112.stdout:5/749: getdents d1/d16/d8f 0 2024-04-25T02:09:17.449 INFO:tasks.workunit.client.1.smithi112.stdout:9/674: mknod d1/d48/ce7 0 2024-04-25T02:09:17.450 INFO:tasks.workunit.client.1.smithi112.stdout:2/802: creat d3/da/dc/d20/d43/d7e/da3/dde/f112 x:0 0 0 2024-04-25T02:09:17.450 INFO:tasks.workunit.client.1.smithi112.stdout:2/803: creat d3/da/dc/d20/d43/d7e/da3/f113 x:0 0 0 2024-04-25T02:09:17.451 INFO:tasks.workunit.client.1.smithi112.stdout:5/750: dread d1/d16/d51/d93/fc8 [0,4194304] 0 2024-04-25T02:09:17.453 INFO:tasks.workunit.client.1.smithi112.stdout:1/804: dread d7/d9/f10 [0,4194304] 0 2024-04-25T02:09:17.455 INFO:tasks.workunit.client.1.smithi112.stdout:6/728: symlink d0/d2/lf4 0 2024-04-25T02:09:17.457 INFO:tasks.workunit.client.1.smithi112.stdout:3/812: symlink d12/d1f/d27/d44/d7e/l10a 0 2024-04-25T02:09:17.457 INFO:tasks.workunit.client.1.smithi112.stdout:3/813: chown d12/d1f/d27/d44/d73/d95/da5/fd9 13203813 1 2024-04-25T02:09:17.459 INFO:tasks.workunit.client.1.smithi112.stdout:1/805: dread d7/d9/d4e/f62 [0,4194304] 0 2024-04-25T02:09:17.459 INFO:tasks.workunit.client.1.smithi112.stdout:2/804: dread d3/da/dc/d3e/df/d71/dc5/fd5 [0,4194304] 0 2024-04-25T02:09:17.459 INFO:tasks.workunit.client.1.smithi112.stdout:8/950: creat d15/d35/d5f/db5/dc2/d143/df1/f14b x:0 0 0 2024-04-25T02:09:17.460 INFO:tasks.workunit.client.1.smithi112.stdout:9/675: mknod d1/d13/d41/ce8 0 2024-04-25T02:09:17.463 INFO:tasks.workunit.client.1.smithi112.stdout:5/751: rename d1/d2/d28/c32 to d1/d2/d45/c100 0 2024-04-25T02:09:17.464 INFO:tasks.workunit.client.1.smithi112.stdout:3/814: mknod d12/d67/d8f/c10b 0 2024-04-25T02:09:17.465 INFO:tasks.workunit.client.1.smithi112.stdout:1/806: symlink d7/db0/l102 0 2024-04-25T02:09:17.466 INFO:tasks.workunit.client.1.smithi112.stdout:2/805: creat d3/da/dc/d20/d85/dba/f114 x:0 0 0 2024-04-25T02:09:17.466 INFO:tasks.workunit.client.1.smithi112.stdout:2/806: write d3/da/dc/d3e/df/d30/dc2/ff4 [942754,116548] 0 2024-04-25T02:09:17.466 INFO:tasks.workunit.client.1.smithi112.stdout:2/807: write d3/da/dc/d20/d40/f6e [5374953,13406] 0 2024-04-25T02:09:17.467 INFO:tasks.workunit.client.1.smithi112.stdout:8/951: creat d15/d35/d5c/de4/dfd/f14c x:0 0 0 2024-04-25T02:09:17.468 INFO:tasks.workunit.client.1.smithi112.stdout:6/729: rename d0/d36/f37 to d0/d2/d2c/ff5 0 2024-04-25T02:09:17.469 INFO:tasks.workunit.client.1.smithi112.stdout:5/752: rmdir d1/d16/d8f 39 2024-04-25T02:09:17.469 INFO:tasks.workunit.client.1.smithi112.stdout:5/753: fsync d1/d16/d8f/fbd 0 2024-04-25T02:09:17.470 INFO:tasks.workunit.client.1.smithi112.stdout:3/815: symlink d12/d67/d8f/l10c 0 2024-04-25T02:09:17.471 INFO:tasks.workunit.client.1.smithi112.stdout:1/807: creat d7/d9/d1e/d66/f103 x:0 0 0 2024-04-25T02:09:17.472 INFO:tasks.workunit.client.1.smithi112.stdout:1/808: chown d7/d9/d4e/d72/d73/c78 43564830 1 2024-04-25T02:09:17.473 INFO:tasks.workunit.client.1.smithi112.stdout:8/952: mkdir d15/d35/d5c/d5e/d137/d14d 0 2024-04-25T02:09:17.474 INFO:tasks.workunit.client.1.smithi112.stdout:5/754: rmdir d1/d16/d51 39 2024-04-25T02:09:17.474 INFO:tasks.workunit.client.1.smithi112.stdout:5/755: fdatasync d1/d16/d8f/fbd 0 2024-04-25T02:09:17.474 INFO:tasks.workunit.client.1.smithi112.stdout:5/756: chown d1/f18 273035 1 2024-04-25T02:09:17.475 INFO:tasks.workunit.client.1.smithi112.stdout:3/816: truncate d12/d13/d34/f48 441485 0 2024-04-25T02:09:17.475 INFO:tasks.workunit.client.1.smithi112.stdout:3/817: write d12/d1f/d27/df8/dd2/f108 [834168,92572] 0 2024-04-25T02:09:17.475 INFO:tasks.workunit.client.1.smithi112.stdout:3/818: readlink d12/d13/d34/d4a/d87/ld4 0 2024-04-25T02:09:17.475 INFO:tasks.workunit.client.1.smithi112.stdout:3/819: readlink d12/d13/d34/d78/d83/ldd 0 2024-04-25T02:09:17.476 INFO:tasks.workunit.client.1.smithi112.stdout:1/809: mknod d7/d9/d4e/d72/dd8/c104 0 2024-04-25T02:09:17.476 INFO:tasks.workunit.client.1.smithi112.stdout:1/810: write d7/d9/d46/f89 [4757936,127439] 0 2024-04-25T02:09:17.478 INFO:tasks.workunit.client.1.smithi112.stdout:5/757: write d1/d2/d4/fe [3076533,48016] 0 2024-04-25T02:09:17.478 INFO:tasks.workunit.client.1.smithi112.stdout:6/730: write d0/d2/d2c/d41/d77/fa4 [3188275,35305] 0 2024-04-25T02:09:17.480 INFO:tasks.workunit.client.1.smithi112.stdout:8/953: symlink d15/d35/d5f/db5/dc2/l14e 0 2024-04-25T02:09:17.482 INFO:tasks.workunit.client.1.smithi112.stdout:9/676: dwrite d1/df/d3c/d43/fa7 [0,4194304] 0 2024-04-25T02:09:17.482 INFO:tasks.workunit.client.1.smithi112.stdout:9/677: write d1/d13/d5b/f61 [4694713,5127] 0 2024-04-25T02:09:17.483 INFO:tasks.workunit.client.1.smithi112.stdout:3/820: unlink d12/lbc 0 2024-04-25T02:09:17.483 INFO:tasks.workunit.client.1.smithi112.stdout:6/731: dread d0/d2/d1f/fde [0,4194304] 0 2024-04-25T02:09:17.484 INFO:tasks.workunit.client.1.smithi112.stdout:6/732: stat d0/d2/d3b/d53 0 2024-04-25T02:09:17.484 INFO:tasks.workunit.client.1.smithi112.stdout:6/733: chown d0/d2/d66/fa3 156 1 2024-04-25T02:09:17.485 INFO:tasks.workunit.client.1.smithi112.stdout:1/811: link d7/fd4 d7/d9/d1e/d40/f105 0 2024-04-25T02:09:17.490 INFO:tasks.workunit.client.1.smithi112.stdout:8/954: symlink d15/d35/d5c/d5e/d137/l14f 0 2024-04-25T02:09:17.495 INFO:tasks.workunit.client.1.smithi112.stdout:9/678: truncate d1/df/d3c/d46/f74 1947470 0 2024-04-25T02:09:17.495 INFO:tasks.workunit.client.1.smithi112.stdout:9/679: creat d1/d13/fe9 x:0 0 0 2024-04-25T02:09:17.495 INFO:tasks.workunit.client.1.smithi112.stdout:9/680: write d1/d13/d5b/fc4 [134445,96043] 0 2024-04-25T02:09:17.498 INFO:tasks.workunit.client.1.smithi112.stdout:6/734: write d0/d2/d2c/d41/d77/f7c [1902391,39109] 0 2024-04-25T02:09:17.498 INFO:tasks.workunit.client.1.smithi112.stdout:3/821: mknod d12/d1f/d27/df8/da0/c10d 0 2024-04-25T02:09:17.498 INFO:tasks.workunit.client.1.smithi112.stdout:3/822: chown d12/d1f/d27/d44/l5b 914 1 2024-04-25T02:09:17.502 INFO:tasks.workunit.client.1.smithi112.stdout:1/812: truncate d7/d9/d4e/d72/d73/de9/d43/dc3/fcb 548517 0 2024-04-25T02:09:17.503 INFO:tasks.workunit.client.1.smithi112.stdout:1/813: truncate d7/d9/d1e/de/fe1 936829 0 2024-04-25T02:09:17.505 INFO:tasks.workunit.client.1.smithi112.stdout:5/758: mknod d1/d2/c101 0 2024-04-25T02:09:17.507 INFO:tasks.workunit.client.1.smithi112.stdout:9/681: truncate d1/f1c 8522409 0 2024-04-25T02:09:17.507 INFO:tasks.workunit.client.1.smithi112.stdout:9/682: write d1/f2b [229791,67447] 0 2024-04-25T02:09:17.507 INFO:tasks.workunit.client.1.smithi112.stdout:3/823: fsync d12/d1f/d27/df8/dd2/f108 0 2024-04-25T02:09:17.508 INFO:tasks.workunit.client.1.smithi112.stdout:8/955: dwrite d15/d35/d5f/db5/dc2/d143/df1/f11b [0,4194304] 0 2024-04-25T02:09:17.510 INFO:tasks.workunit.client.1.smithi112.stdout:5/759: dread d1/d16/f4d [0,4194304] 0 2024-04-25T02:09:17.510 INFO:tasks.workunit.client.1.smithi112.stdout:5/760: chown d1/d2/d28/f57 10647914 1 2024-04-25T02:09:17.515 INFO:tasks.workunit.client.1.smithi112.stdout:7/778: sync 2024-04-25T02:09:17.525 INFO:tasks.workunit.client.1.smithi112.stdout:1/814: mknod d7/d9/d51/d83/c106 0 2024-04-25T02:09:17.527 INFO:tasks.workunit.client.1.smithi112.stdout:7/779: creat d7/d79/dda/ff1 x:0 0 0 2024-04-25T02:09:17.529 INFO:tasks.workunit.client.1.smithi112.stdout:7/780: stat d7/fc9 0 2024-04-25T02:09:17.529 INFO:tasks.workunit.client.1.smithi112.stdout:7/781: truncate d7/d25/d40/d51/fce 862838 0 2024-04-25T02:09:17.531 INFO:tasks.workunit.client.1.smithi112.stdout:2/808: getdents d3/da/dc/d20/d43/d7e/da3 0 2024-04-25T02:09:17.532 INFO:tasks.workunit.client.1.smithi112.stdout:4/886: sync 2024-04-25T02:09:17.532 INFO:tasks.workunit.client.1.smithi112.stdout:4/887: write d2/d1e/d5c/fbc [1583038,91724] 0 2024-04-25T02:09:17.533 INFO:tasks.workunit.client.1.smithi112.stdout:4/888: creat d2/d17/d20/d26/f123 x:0 0 0 2024-04-25T02:09:17.533 INFO:tasks.workunit.client.1.smithi112.stdout:0/993: sync 2024-04-25T02:09:17.533 INFO:tasks.workunit.client.1.smithi112.stdout:4/889: dread d2/d1e/d4b/d57/fa0 [0,4194304] 0 2024-04-25T02:09:17.535 INFO:tasks.workunit.client.1.smithi112.stdout:5/761: dwrite d1/df5/d5b/d7b/db2/dc0/dcf/ddd/f8c [0,4194304] 0 2024-04-25T02:09:17.536 INFO:tasks.workunit.client.1.smithi112.stdout:5/762: fdatasync d1/d16/d8f/ffe 0 2024-04-25T02:09:17.536 INFO:tasks.workunit.client.1.smithi112.stdout:5/763: chown d1/d2/lff 45075 1 2024-04-25T02:09:17.536 INFO:tasks.workunit.client.1.smithi112.stdout:8/956: dwrite d15/d26/d4f/fb2 [0,4194304] 0 2024-04-25T02:09:17.537 INFO:tasks.workunit.client.1.smithi112.stdout:0/994: mkdir da/d1d/d2e/d40/d49/d136 0 2024-04-25T02:09:17.539 INFO:tasks.workunit.client.1.smithi112.stdout:4/890: rename d2/d17/d20/cc1 to d2/d17/d20/d26/d39/d49/c124 0 2024-04-25T02:09:17.539 INFO:tasks.workunit.client.1.smithi112.stdout:4/891: dread - d2/d17/db2/f102 zero size 2024-04-25T02:09:17.540 INFO:tasks.workunit.client.1.smithi112.stdout:4/892: fsync d2/d1e/d5c/fd6 0 2024-04-25T02:09:17.540 INFO:tasks.workunit.client.1.smithi112.stdout:4/893: truncate d2/d17/d25/f91 2079134 0 2024-04-25T02:09:17.543 INFO:tasks.workunit.client.1.smithi112.stdout:5/764: link d1/d16/d22/cfa d1/d2/d78/c102 0 2024-04-25T02:09:17.550 INFO:tasks.workunit.client.1.smithi112.stdout:1/815: dwrite d7/d9/d4e/fad [0,4194304] 0 2024-04-25T02:09:17.552 INFO:tasks.workunit.client.1.smithi112.stdout:8/957: mkdir d15/d35/d5f/db5/dc2/d143/d1a/d150 0 2024-04-25T02:09:17.552 INFO:tasks.workunit.client.1.smithi112.stdout:8/958: readlink d15/d81/l107 0 2024-04-25T02:09:17.553 INFO:tasks.workunit.client.1.smithi112.stdout:7/782: dwrite d7/dd/da9/f5e [0,4194304] 0 2024-04-25T02:09:17.554 INFO:tasks.workunit.client.1.smithi112.stdout:1/816: truncate d7/d9/d4e/f4c 2108378 0 2024-04-25T02:09:17.556 INFO:tasks.workunit.client.1.smithi112.stdout:8/959: write d15/d26/fe2 [3714478,80332] 0 2024-04-25T02:09:17.558 INFO:tasks.workunit.client.1.smithi112.stdout:8/960: write d15/d81/f110 [154391,42768] 0 2024-04-25T02:09:17.563 INFO:tasks.workunit.client.1.smithi112.stdout:8/961: mkdir d15/d35/d5c/de4/dfd/d151 0 2024-04-25T02:09:17.567 INFO:tasks.workunit.client.1.smithi112.stdout:8/962: dread d15/d26/d37/f65 [0,4194304] 0 2024-04-25T02:09:17.567 INFO:tasks.workunit.client.1.smithi112.stdout:1/817: dread d7/d9/fd6 [0,4194304] 0 2024-04-25T02:09:17.567 INFO:tasks.workunit.client.1.smithi112.stdout:1/818: chown d7/d9/d4e/d72/d73/de9/d3f/f97 21011718 1 2024-04-25T02:09:17.571 INFO:tasks.workunit.client.1.smithi112.stdout:1/819: chown d7/c2d 58581404 1 2024-04-25T02:09:17.573 INFO:tasks.workunit.client.1.smithi112.stdout:1/820: unlink d7/d4b/d7b/lfa 0 2024-04-25T02:09:17.573 INFO:tasks.workunit.client.1.smithi112.stdout:1/821: dread - d7/d9/d46/fb6 zero size 2024-04-25T02:09:17.573 INFO:tasks.workunit.client.1.smithi112.stdout:1/822: chown d7/d9/l8e 8188 1 2024-04-25T02:09:17.576 INFO:tasks.workunit.client.1.smithi112.stdout:5/765: dwrite d1/df5/d5b/d7b/db2/dc0/dcf/ddd/f8c [0,4194304] 0 2024-04-25T02:09:17.579 INFO:tasks.workunit.client.1.smithi112.stdout:7/783: dwrite d7/dd/da9/f6d [0,4194304] 0 2024-04-25T02:09:17.581 INFO:tasks.workunit.client.1.smithi112.stdout:4/894: dwrite d2/d17/d20/d26/d39/d49/d95/dc7/f118 [0,4194304] 0 2024-04-25T02:09:17.581 INFO:tasks.workunit.client.1.smithi112.stdout:4/895: readlink d2/d17/l24 0 2024-04-25T02:09:17.585 INFO:tasks.workunit.client.1.smithi112.stdout:7/784: rename d7/d79/da2/l78 to d7/d25/d40/db0/lf2 0 2024-04-25T02:09:17.590 INFO:tasks.workunit.client.1.smithi112.stdout:3/824: truncate d12/d1f/d27/df8/dd2/f108 29911 0 2024-04-25T02:09:17.590 INFO:tasks.workunit.client.1.smithi112.stdout:3/825: read - d12/d1f/d27/d44/fe4 zero size 2024-04-25T02:09:17.594 INFO:tasks.workunit.client.1.smithi112.stdout:8/963: dwrite d15/d26/d4f/fca [0,4194304] 0 2024-04-25T02:09:17.602 INFO:tasks.workunit.client.1.smithi112.stdout:1/823: dwrite d7/d9/d1e/d40/f105 [0,4194304] 0 2024-04-25T02:09:17.688 INFO:tasks.workunit.client.1.smithi112.stdout:5/766: dwrite d1/d2/d4/ff [0,4194304] 0 2024-04-25T02:09:17.688 INFO:tasks.workunit.client.1.smithi112.stdout:5/767: dread - d1/d2/d4/dc4/d9c/fbc zero size 2024-04-25T02:09:17.691 INFO:tasks.workunit.client.1.smithi112.stdout:4/896: rmdir d2/d17/d7c 39 2024-04-25T02:09:17.691 INFO:tasks.workunit.client.1.smithi112.stdout:7/785: mknod d7/d79/da2/d3a/ded/cf3 0 2024-04-25T02:09:17.691 INFO:tasks.workunit.client.1.smithi112.stdout:8/964: dwrite d15/d35/d5c/f10b [0,4194304] 0 2024-04-25T02:09:17.691 INFO:tasks.workunit.client.1.smithi112.stdout:8/965: readlink d15/d35/d5c/d5e/d94/la9 0 2024-04-25T02:09:17.691 INFO:tasks.workunit.client.1.smithi112.stdout:3/826: mknod d12/d13/d34/c10e 0 2024-04-25T02:09:17.691 INFO:tasks.workunit.client.1.smithi112.stdout:7/786: dwrite d7/d25/d40/f80 [0,4194304] 0 2024-04-25T02:09:17.691 INFO:tasks.workunit.client.1.smithi112.stdout:1/824: dwrite d7/d9/d4e/fad [4194304,4194304] 0 2024-04-25T02:09:17.691 INFO:tasks.workunit.client.1.smithi112.stdout:8/966: creat d15/d35/d5f/db5/dc2/d143/d1a/d150/f152 x:0 0 0 2024-04-25T02:09:17.691 INFO:tasks.workunit.client.1.smithi112.stdout:8/967: chown d15/d35/d5f/db5/dc2/d143/l87 1019936 1 2024-04-25T02:09:17.692 INFO:tasks.workunit.client.1.smithi112.stdout:5/768: rmdir d1/d2 39 2024-04-25T02:09:17.692 INFO:tasks.workunit.client.1.smithi112.stdout:3/827: chown d12/d13/d34/d4a/fda 44763123 1 2024-04-25T02:09:17.692 INFO:tasks.workunit.client.1.smithi112.stdout:3/828: fdatasync d12/f5c 0 2024-04-25T02:09:17.692 INFO:tasks.workunit.client.1.smithi112.stdout:7/787: link d7/d25/d40/f80 d7/d25/ff4 0 2024-04-25T02:09:17.692 INFO:tasks.workunit.client.1.smithi112.stdout:8/968: creat d15/d35/d5f/db5/d117/f153 x:0 0 0 2024-04-25T02:09:17.692 INFO:tasks.workunit.client.1.smithi112.stdout:8/969: creat d15/d26/d4f/d67/de0/df5/f154 x:0 0 0 2024-04-25T02:09:17.692 INFO:tasks.workunit.client.1.smithi112.stdout:8/970: mkdir d15/d35/d5c/d91/d64/d155 0 2024-04-25T02:09:17.692 INFO:tasks.workunit.client.1.smithi112.stdout:8/971: fsync d15/d35/d5c/f83 0 2024-04-25T02:09:17.692 INFO:tasks.workunit.client.1.smithi112.stdout:8/972: dread - d15/d35/d5c/d91/d78/fbd zero size 2024-04-25T02:09:17.692 INFO:tasks.workunit.client.1.smithi112.stdout:8/973: symlink d15/d26/d37/da8/l156 0 2024-04-25T02:09:17.692 INFO:tasks.workunit.client.1.smithi112.stdout:8/974: creat d15/d35/d5f/db5/dc2/d143/d130/f157 x:0 0 0 2024-04-25T02:09:17.692 INFO:tasks.workunit.client.1.smithi112.stdout:8/975: creat d15/d35/d5f/db5/d117/f158 x:0 0 0 2024-04-25T02:09:17.692 INFO:tasks.workunit.client.1.smithi112.stdout:7/788: dwrite d7/dd/d88/f8a [0,4194304] 0 2024-04-25T02:09:17.692 INFO:tasks.workunit.client.1.smithi112.stdout:7/789: write d7/d25/d40/db0/fe9 [439768,103338] 0 2024-04-25T02:09:17.693 INFO:tasks.workunit.client.1.smithi112.stdout:7/790: fdatasync d7/f76 0 2024-04-25T02:09:17.693 INFO:tasks.workunit.client.1.smithi112.stdout:5/769: dwrite d1/d16/d22/f4e [0,4194304] 0 2024-04-25T02:09:17.693 INFO:tasks.workunit.client.1.smithi112.stdout:5/770: chown d1/d16/d22/l49 961 1 2024-04-25T02:09:17.693 INFO:tasks.workunit.client.1.smithi112.stdout:7/791: getdents d7/d25/d40/d51/d77 0 2024-04-25T02:09:17.693 INFO:tasks.workunit.client.1.smithi112.stdout:8/976: dwrite d15/d26/d37/d52/df4/f12a [0,4194304] 0 2024-04-25T02:09:17.693 INFO:tasks.workunit.client.1.smithi112.stdout:8/977: mkdir d15/d35/d5c/de4/dfd/d151/d159 0 2024-04-25T02:09:17.693 INFO:tasks.workunit.client.1.smithi112.stdout:8/978: symlink d15/d35/d5f/db5/d117/l15a 0 2024-04-25T02:09:17.699 INFO:tasks.workunit.client.1.smithi112.stdout:5/771: dwrite d1/d2/d4/f9 [4194304,4194304] 0 2024-04-25T02:09:17.699 INFO:tasks.workunit.client.1.smithi112.stdout:5/772: chown d1/df5/d5b/d7b/fd3 0 1 2024-04-25T02:09:17.699 INFO:tasks.workunit.client.1.smithi112.stdout:7/792: dwrite d7/dd/d20/d2c/f8c [0,4194304] 0 2024-04-25T02:09:17.702 INFO:tasks.workunit.client.1.smithi112.stdout:5/773: symlink d1/df5/d5b/d79/d7a/d9d/l103 0 2024-04-25T02:09:17.709 INFO:tasks.workunit.client.1.smithi112.stdout:7/793: mkdir d7/d25/d43/de1/df5 0 2024-04-25T02:09:17.735 INFO:tasks.workunit.client.1.smithi112.stdout:7/794: dwrite d7/d25/d40/da3/f9c [0,4194304] 0 2024-04-25T02:09:17.739 INFO:tasks.workunit.client.1.smithi112.stdout:7/795: rename d7/d79/da2/d3a/f9d to d7/dd/d20/d2c/ff6 0 2024-04-25T02:09:17.739 INFO:tasks.workunit.client.1.smithi112.stdout:7/796: write d7/dd/d20/db2/fdf [127698,115406] 0 2024-04-25T02:09:17.740 INFO:tasks.workunit.client.1.smithi112.stdout:7/797: symlink d7/d25/dd6/lf7 0 2024-04-25T02:09:17.740 INFO:tasks.workunit.client.1.smithi112.stdout:7/798: chown d7/d25/d40/f62 10942709 1 2024-04-25T02:09:17.740 INFO:tasks.workunit.client.1.smithi112.stdout:7/799: fsync d7/dd/da9/f71 0 2024-04-25T02:09:17.741 INFO:tasks.workunit.client.1.smithi112.stdout:7/800: creat d7/dd/ff8 x:0 0 0 2024-04-25T02:09:17.742 INFO:tasks.workunit.client.1.smithi112.stdout:7/801: mknod d7/dd/da9/d7f/cf9 0 2024-04-25T02:09:17.742 INFO:tasks.workunit.client.1.smithi112.stdout:7/802: chown d7/d25/d40/da3/f56 3190 1 2024-04-25T02:09:17.747 INFO:tasks.workunit.client.1.smithi112.stdout:7/803: symlink d7/d25/d40/db0/lfa 0 2024-04-25T02:09:17.747 INFO:tasks.workunit.client.1.smithi112.stdout:7/804: read d7/d25/f85 [1825089,18968] 0 2024-04-25T02:09:17.747 INFO:tasks.workunit.client.1.smithi112.stdout:7/805: dread - d7/d25/d40/d6b/fe3 zero size 2024-04-25T02:09:17.747 INFO:tasks.workunit.client.1.smithi112.stdout:7/806: write d7/dd/da9/f89 [1200694,9359] 0 2024-04-25T02:09:17.747 INFO:tasks.workunit.client.1.smithi112.stdout:7/807: readlink d7/d79/da2/d3a/lbd 0 2024-04-25T02:09:17.754 INFO:tasks.workunit.client.1.smithi112.stdout:7/808: mkdir d7/dd/da9/dfb 0 2024-04-25T02:09:17.757 INFO:tasks.workunit.client.1.smithi112.stdout:7/809: rmdir d7/d25/d43/de1/df5 0 2024-04-25T02:09:17.924 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: pgmap v268: 65 pgs: 65 active+clean; 2.5 GiB data, 8.9 GiB used, 528 GiB / 536 GiB avail; 157 MiB/s rd, 184 MiB/s wr, 338 op/s 2024-04-25T02:09:17.924 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:09:17.924 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:09:17.924 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:09:17.924 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:09:17.924 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:09:17.924 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:09:17.924 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr fail", "who": "smithi077.zpflzp"}]: dispatch 2024-04-25T02:09:17.924 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: Activating manager daemon smithi112.cswrxs 2024-04-25T02:09:17.925 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: osdmap e48: 6 total, 6 up, 6 in 2024-04-25T02:09:17.925 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "mgr fail", "who": "smithi077.zpflzp"}]': finished 2024-04-25T02:09:17.925 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: mgrmap e21: smithi112.cswrxs(active, starting, since 0.00962448s) 2024-04-25T02:09:17.925 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-04-25T02:09:17.925 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-04-25T02:09:17.925 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.gcfygj"}]: dispatch 2024-04-25T02:09:17.925 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.oadrkb"}]: dispatch 2024-04-25T02:09:17.925 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.dvwudt"}]: dispatch 2024-04-25T02:09:17.925 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.fjnadi"}]: dispatch 2024-04-25T02:09:17.925 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "mgr metadata", "who": "smithi112.cswrxs", "id": "smithi112.cswrxs"}]: dispatch 2024-04-25T02:09:17.925 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:09:17.925 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:09:17.925 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:09:17.925 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:09:17.926 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:09:17.926 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:09:17.926 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T02:09:17.926 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T02:09:17.926 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T02:09:17.926 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:17 smithi112 ceph-mon[33313]: Manager daemon smithi112.cswrxs is now available 2024-04-25T02:09:17.933 INFO:tasks.workunit.client.1.smithi112.stdout:9/683: sync 2024-04-25T02:09:17.933 INFO:tasks.workunit.client.1.smithi112.stdout:0/995: sync 2024-04-25T02:09:17.933 INFO:tasks.workunit.client.1.smithi112.stdout:4/897: sync 2024-04-25T02:09:17.933 INFO:tasks.workunit.client.1.smithi112.stdout:6/735: sync 2024-04-25T02:09:17.934 INFO:tasks.workunit.client.1.smithi112.stdout:2/809: sync 2024-04-25T02:09:17.934 INFO:tasks.workunit.client.1.smithi112.stdout:2/810: chown d3/da/dac/dbf/dee/lf5 12 1 2024-04-25T02:09:17.934 INFO:tasks.workunit.client.1.smithi112.stdout:2/811: chown d3/l10c 578147 1 2024-04-25T02:09:17.935 INFO:tasks.workunit.client.1.smithi112.stdout:0/996: mknod da/d13/d45/c137 0 2024-04-25T02:09:17.935 INFO:tasks.workunit.client.1.smithi112.stdout:0/997: creat da/d1d/d2e/dbd/f138 x:0 0 0 2024-04-25T02:09:17.935 INFO:tasks.workunit.client.1.smithi112.stdout:0/998: chown da/d1d/d88/d24/f2a 127351 1 2024-04-25T02:09:17.935 INFO:tasks.workunit.client.1.smithi112.stdout:0/999: readlink da/d13/d45/d5e/db4/ddc/le1 0 2024-04-25T02:09:17.937 INFO:tasks.workunit.client.1.smithi112.stdout:9/684: symlink d1/d13/lea 0 2024-04-25T02:09:17.937 INFO:tasks.workunit.client.1.smithi112.stdout:9/685: dread - d1/d48/fce zero size 2024-04-25T02:09:17.937 INFO:tasks.workunit.client.1.smithi112.stdout:9/686: fdatasync d1/d48/fce 0 2024-04-25T02:09:17.937 INFO:tasks.workunit.client.1.smithi112.stdout:9/687: fdatasync d1/df/d8f/dd2/fd4 0 2024-04-25T02:09:17.940 INFO:tasks.workunit.client.1.smithi112.stdout:6/736: mknod d0/cf6 0 2024-04-25T02:09:17.940 INFO:tasks.workunit.client.1.smithi112.stdout:6/737: chown d0/d2/d3b/d53/d67/d6b/cee 76179 1 2024-04-25T02:09:17.940 INFO:tasks.workunit.client.1.smithi112.stdout:6/738: write d0/d2/d66/da8/fc8 [911084,36961] 0 2024-04-25T02:09:17.943 INFO:tasks.workunit.client.1.smithi112.stdout:2/812: dread d3/da/dc/f2e [0,4194304] 0 2024-04-25T02:09:17.943 INFO:tasks.workunit.client.1.smithi112.stdout:2/813: fsync d3/da/dc/d3e/df/d25/d88/d8e/df0/f100 0 2024-04-25T02:09:17.945 INFO:tasks.workunit.client.1.smithi112.stdout:6/739: link d0/d32/d45/c83 d0/d2/da1/cf7 0 2024-04-25T02:09:17.959 INFO:tasks.workunit.client.1.smithi112.stdout:6/740: write d0/d2/d4/d28/fa2 [1906328,19289] 0 2024-04-25T02:09:17.959 INFO:tasks.workunit.client.1.smithi112.stdout:9/688: dwrite d1/fd [0,4194304] 0 2024-04-25T02:09:17.959 INFO:tasks.workunit.client.1.smithi112.stdout:9/689: write d1/d13/d41/d84/fac [1257760,16662] 0 2024-04-25T02:09:17.959 INFO:tasks.workunit.client.1.smithi112.stdout:9/690: read - d1/df/f8d zero size 2024-04-25T02:09:17.965 INFO:tasks.workunit.client.1.smithi112.stdout:6/741: write d0/d32/d45/f52 [1959954,96447] 0 2024-04-25T02:09:17.965 INFO:tasks.workunit.client.1.smithi112.stdout:6/742: readlink d0/d2/d2c/d41/d77/l94 0 2024-04-25T02:09:17.967 INFO:tasks.workunit.client.1.smithi112.stdout:9/691: dread d1/f27 [0,4194304] 0 2024-04-25T02:09:17.973 INFO:tasks.workunit.client.1.smithi112.stdout:9/692: truncate d1/f2b 1162380 0 2024-04-25T02:09:17.973 INFO:tasks.workunit.client.1.smithi112.stdout:6/743: dread d0/d2/d4/d28/fa2 [0,4194304] 0 2024-04-25T02:09:17.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: pgmap v268: 65 pgs: 65 active+clean; 2.5 GiB data, 8.9 GiB used, 528 GiB / 536 GiB avail; 157 MiB/s rd, 184 MiB/s wr, 338 op/s 2024-04-25T02:09:17.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:09:17.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:09:17.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:09:17.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:09:17.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' 2024-04-25T02:09:17.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:09:17.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr fail", "who": "smithi077.zpflzp"}]: dispatch 2024-04-25T02:09:17.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: Activating manager daemon smithi112.cswrxs 2024-04-25T02:09:17.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: osdmap e48: 6 total, 6 up, 6 in 2024-04-25T02:09:17.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: from='mgr.14208 172.21.15.77:0/1911905006' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "mgr fail", "who": "smithi077.zpflzp"}]': finished 2024-04-25T02:09:17.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: mgrmap e21: smithi112.cswrxs(active, starting, since 0.00962448s) 2024-04-25T02:09:17.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-04-25T02:09:17.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-04-25T02:09:17.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.gcfygj"}]: dispatch 2024-04-25T02:09:17.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.oadrkb"}]: dispatch 2024-04-25T02:09:17.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.dvwudt"}]: dispatch 2024-04-25T02:09:17.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.fjnadi"}]: dispatch 2024-04-25T02:09:17.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "mgr metadata", "who": "smithi112.cswrxs", "id": "smithi112.cswrxs"}]: dispatch 2024-04-25T02:09:17.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:09:17.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:09:17.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:09:17.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:09:17.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:09:17.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:09:17.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T02:09:17.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T02:09:17.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T02:09:17.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:17 smithi077 ceph-mon[26330]: Manager daemon smithi112.cswrxs is now available 2024-04-25T02:09:17.983 INFO:tasks.workunit.client.1.smithi112.stdout:9/693: mkdir d1/d48/d65/d73/daf/d63/deb 0 2024-04-25T02:09:17.984 INFO:tasks.workunit.client.1.smithi112.stdout:6/744: rename d0/c63 to d0/d2/da1/cf8 0 2024-04-25T02:09:17.987 INFO:tasks.workunit.client.1.smithi112.stdout:9/694: mknod d1/d93/dc2/cec 0 2024-04-25T02:09:17.995 INFO:tasks.workunit.client.1.smithi112.stdout:6/745: link d0/d2/d4/fbb d0/d2/d4/d28/ff9 0 2024-04-25T02:09:17.995 INFO:tasks.workunit.client.1.smithi112.stdout:6/746: fdatasync d0/d7b/f90 0 2024-04-25T02:09:18.002 INFO:tasks.workunit.client.1.smithi112.stdout:6/747: rename d0/d2/d2c/l2d to d0/d61/db0/lfa 0 2024-04-25T02:09:18.003 INFO:tasks.workunit.client.1.smithi112.stdout:9/695: dwrite d1/df/d3c/d43/fe4 [0,4194304] 0 2024-04-25T02:09:18.004 INFO:tasks.workunit.client.1.smithi112.stdout:6/748: creat d0/d2/d66/d7d/ffb x:0 0 0 2024-04-25T02:09:18.008 INFO:tasks.workunit.client.1.smithi112.stdout:9/696: rename d1/c45 to d1/d48/dbd/ced 0 2024-04-25T02:09:18.013 INFO:tasks.workunit.client.1.smithi112.stdout:9/697: rename d1/df/d3c/d46/f56 to d1/d93/fee 0 2024-04-25T02:09:18.031 INFO:tasks.workunit.client.1.smithi112.stdout:9/698: dwrite d1/f3b [0,4194304] 0 2024-04-25T02:09:18.046 INFO:tasks.workunit.client.1.smithi112.stdout:9/699: dwrite d1/d13/d5b/f61 [0,4194304] 0 2024-04-25T02:09:18.047 INFO:tasks.workunit.client.1.smithi112.stdout:9/700: chown d1/d13/d41/f53 1 1 2024-04-25T02:09:18.047 INFO:tasks.workunit.client.1.smithi112.stdout:9/701: stat d1/d13/d41/c7c 0 2024-04-25T02:09:18.062 INFO:tasks.workunit.client.1.smithi112.stdout:9/702: dwrite d1/d13/d41/fa5 [0,4194304] 0 2024-04-25T02:09:18.067 INFO:tasks.workunit.client.1.smithi112.stdout:9/703: write d1/d48/d65/d73/daf/d63/f77 [1071391,123939] 0 2024-04-25T02:09:18.067 INFO:tasks.workunit.client.1.smithi112.stdout:9/704: chown d1/d48/d65/f79 28644912 1 2024-04-25T02:09:18.075 INFO:tasks.workunit.client.1.smithi112.stdout:9/705: dread d1/d13/f26 [0,4194304] 0 2024-04-25T02:09:18.078 INFO:tasks.workunit.client.1.smithi112.stdout:9/706: symlink d1/d48/d65/d73/daf/d63/lef 0 2024-04-25T02:09:18.090 INFO:tasks.workunit.client.1.smithi112.stdout:9/707: write d1/df/d3c/d46/f99 [2102091,78083] 0 2024-04-25T02:09:18.090 INFO:tasks.workunit.client.1.smithi112.stdout:9/708: dread - d1/d13/fe9 zero size 2024-04-25T02:09:18.092 INFO:tasks.workunit.client.1.smithi112.stdout:9/709: symlink d1/df/d8f/dd2/lf0 0 2024-04-25T02:09:18.093 INFO:tasks.workunit.client.1.smithi112.stdout:9/710: chown d1/c59 701284 1 2024-04-25T02:09:18.093 INFO:tasks.workunit.client.1.smithi112.stdout:9/711: write d1/d13/d41/fd8 [752283,101425] 0 2024-04-25T02:09:18.108 INFO:tasks.workunit.client.1.smithi112.stdout:9/712: dwrite d1/d48/d65/d73/daf/f5d [0,4194304] 0 2024-04-25T02:09:18.108 INFO:tasks.workunit.client.1.smithi112.stdout:9/713: write d1/df/d3c/d46/f98 [707142,38296] 0 2024-04-25T02:09:18.112 INFO:tasks.workunit.client.1.smithi112.stdout:9/714: rmdir d1/d13/d5b 39 2024-04-25T02:09:18.120 INFO:tasks.workunit.client.1.smithi112.stdout:9/715: dread d1/d13/fe5 [0,4194304] 0 2024-04-25T02:09:18.123 INFO:tasks.workunit.client.1.smithi112.stdout:9/716: mknod d1/df/d3c/d46/cf1 0 2024-04-25T02:09:18.126 INFO:tasks.workunit.client.1.smithi112.stdout:9/717: creat d1/d13/d41/dc1/ff2 x:0 0 0 2024-04-25T02:09:18.126 INFO:tasks.workunit.client.1.smithi112.stdout:9/718: chown d1/d48/d65/d73/daf/l5e 810 1 2024-04-25T02:09:18.134 INFO:tasks.workunit.client.1.smithi112.stdout:9/719: dread d1/d13/f9f [0,4194304] 0 2024-04-25T02:09:18.150 INFO:tasks.workunit.client.1.smithi112.stdout:9/720: dwrite d1/df/d3c/f52 [0,4194304] 0 2024-04-25T02:09:18.154 INFO:tasks.workunit.client.1.smithi112.stdout:9/721: symlink d1/d93/lf3 0 2024-04-25T02:09:18.162 INFO:tasks.workunit.client.1.smithi112.stdout:9/722: mknod d1/d13/d5b/cf4 0 2024-04-25T02:09:18.177 INFO:tasks.workunit.client.1.smithi112.stdout:9/723: dwrite d1/d13/f26 [0,4194304] 0 2024-04-25T02:09:18.177 INFO:tasks.workunit.client.1.smithi112.stdout:9/724: chown d1/d13/d41/d84/fde 180629 1 2024-04-25T02:09:18.177 INFO:tasks.workunit.client.1.smithi112.stdout:9/725: readlink d1/d48/d65/d73/daf/d63/lef 0 2024-04-25T02:09:18.179 INFO:tasks.workunit.client.1.smithi112.stdout:9/726: getdents d1/d48/d65 0 2024-04-25T02:09:18.179 INFO:tasks.workunit.client.1.smithi112.stdout:9/727: stat d1/d13/d5b 0 2024-04-25T02:09:18.182 INFO:tasks.workunit.client.1.smithi112.stdout:9/728: creat d1/d48/dbd/ff5 x:0 0 0 2024-04-25T02:09:18.184 INFO:tasks.workunit.client.1.smithi112.stdout:9/729: creat d1/df/d3c/d43/ff6 x:0 0 0 2024-04-25T02:09:18.186 INFO:tasks.workunit.client.1.smithi112.stdout:9/730: mknod d1/df/d3c/d46/cf7 0 2024-04-25T02:09:18.186 INFO:tasks.workunit.client.1.smithi112.stdout:9/731: truncate d1/df/d3c/f7f 604500 0 2024-04-25T02:09:18.186 INFO:tasks.workunit.client.1.smithi112.stdout:9/732: readlink d1/df/l28 0 2024-04-25T02:09:18.187 INFO:tasks.workunit.client.1.smithi112.stdout:9/733: creat d1/d48/d65/d73/daf/ff8 x:0 0 0 2024-04-25T02:09:18.193 INFO:tasks.workunit.client.1.smithi112.stdout:9/734: dread d1/d13/d5b/f85 [0,4194304] 0 2024-04-25T02:09:18.195 INFO:tasks.workunit.client.1.smithi112.stdout:9/735: unlink d1/d13/d41/c7c 0 2024-04-25T02:09:18.195 INFO:tasks.workunit.client.1.smithi112.stdout:9/736: write d1/fd1 [137664,10366] 0 2024-04-25T02:09:18.195 INFO:tasks.workunit.client.1.smithi112.stdout:9/737: getdents d1/df/d3c 0 2024-04-25T02:09:18.196 INFO:tasks.workunit.client.1.smithi112.stdout:9/738: symlink d1/d48/d65/d73/daf/lf9 0 2024-04-25T02:09:18.196 INFO:tasks.workunit.client.1.smithi112.stdout:9/739: truncate d1/d13/d41/d84/fac 1824845 0 2024-04-25T02:09:18.198 INFO:tasks.workunit.client.1.smithi112.stdout:9/740: creat d1/d48/d65/d73/daf/d63/ffa x:0 0 0 2024-04-25T02:09:18.198 INFO:tasks.workunit.client.1.smithi112.stdout:9/741: creat d1/d48/ffb x:0 0 0 2024-04-25T02:09:18.198 INFO:tasks.workunit.client.1.smithi112.stdout:9/742: creat d1/df/d3c/d6c/ffc x:0 0 0 2024-04-25T02:09:18.201 INFO:tasks.workunit.client.1.smithi112.stdout:9/743: mkdir d1/df/d3c/d6c/dfd 0 2024-04-25T02:09:18.201 INFO:tasks.workunit.client.1.smithi112.stdout:9/744: read - d1/df/d3c/d6c/f71 zero size 2024-04-25T02:09:18.211 INFO:tasks.workunit.client.1.smithi112.stdout:9/745: symlink d1/lfe 0 2024-04-25T02:09:18.211 INFO:tasks.workunit.client.1.smithi112.stdout:9/746: chown d1/d13/fe9 400480 1 2024-04-25T02:09:18.226 INFO:tasks.workunit.client.1.smithi112.stdout:9/747: dwrite d1/d48/d65/d73/daf/fb8 [0,4194304] 0 2024-04-25T02:09:18.226 INFO:tasks.workunit.client.1.smithi112.stdout:9/748: fdatasync d1/d48/d65/d73/fe0 0 2024-04-25T02:09:18.238 INFO:tasks.workunit.client.1.smithi112.stdout:9/749: rmdir d1/d13/d5b 39 2024-04-25T02:09:18.239 INFO:tasks.workunit.client.1.smithi112.stdout:9/750: creat d1/d48/dbd/fff x:0 0 0 2024-04-25T02:09:18.239 INFO:tasks.workunit.client.1.smithi112.stdout:9/751: readlink d1/d48/d65/d73/daf/lf9 0 2024-04-25T02:09:18.246 INFO:tasks.workunit.client.1.smithi112.stdout:9/752: unlink d1/d93/cbb 0 2024-04-25T02:09:18.283 INFO:tasks.workunit.client.1.smithi112.stdout:9/753: rename d1/df to d1/d48/d65/d73/daf/d63/deb/d100 0 2024-04-25T02:09:18.286 INFO:tasks.workunit.client.1.smithi112.stdout:9/754: symlink d1/d48/dbd/l101 0 2024-04-25T02:09:18.297 INFO:tasks.workunit.client.1.smithi112.stdout:9/755: dread d1/d13/d41/d84/fcc [0,4194304] 0 2024-04-25T02:09:18.309 INFO:tasks.workunit.client.1.smithi112.stdout:9/756: rename d1/d48/d65/d73/daf/d63/deb/d100/f8d to d1/d13/d41/f102 0 2024-04-25T02:09:18.320 INFO:tasks.workunit.client.1.smithi112.stdout:9/757: mkdir d1/d48/d65/d73/daf/d63/deb/d100/d3c/d43/d103 0 2024-04-25T02:09:18.321 INFO:tasks.workunit.client.1.smithi112.stdout:9/758: fdatasync d1/d13/d41/fa5 0 2024-04-25T02:09:18.347 INFO:tasks.workunit.client.1.smithi112.stdout:9/759: dwrite d1/fd [0,4194304] 0 2024-04-25T02:09:18.353 INFO:tasks.workunit.client.1.smithi112.stdout:9/760: symlink d1/d13/l104 0 2024-04-25T02:09:18.353 INFO:tasks.workunit.client.1.smithi112.stdout:9/761: chown d1/d48/d65/d73/daf/d63/deb/d100/d3c 3565601 1 2024-04-25T02:09:18.357 INFO:tasks.workunit.client.1.smithi112.stdout:9/762: symlink d1/d13/d41/l105 0 2024-04-25T02:09:18.362 INFO:tasks.workunit.client.1.smithi112.stdout:9/763: unlink d1/d13/f9d 0 2024-04-25T02:09:18.362 INFO:tasks.workunit.client.1.smithi112.stdout:9/764: write d1/d48/d65/d73/daf/d63/deb/d100/d8f/dd2/fd9 [1027701,107528] 0 2024-04-25T02:09:18.376 INFO:tasks.workunit.client.1.smithi112.stdout:8/979: sync 2024-04-25T02:09:18.377 INFO:tasks.workunit.client.1.smithi112.stdout:4/898: sync 2024-04-25T02:09:18.377 INFO:tasks.workunit.client.1.smithi112.stdout:5/774: sync 2024-04-25T02:09:18.378 INFO:tasks.workunit.client.1.smithi112.stdout:5/775: write d1/f8 [2700565,40544] 0 2024-04-25T02:09:18.378 INFO:tasks.workunit.client.1.smithi112.stdout:5/776: write d1/f8 [390981,34922] 0 2024-04-25T02:09:18.378 INFO:tasks.workunit.client.1.smithi112.stdout:5/777: truncate d1/d2/d45/f95 569354 0 2024-04-25T02:09:18.378 INFO:tasks.workunit.client.1.smithi112.stdout:5/778: read d1/d16/f75 [6309385,124684] 0 2024-04-25T02:09:18.378 INFO:tasks.workunit.client.1.smithi112.stdout:7/810: sync 2024-04-25T02:09:18.378 INFO:tasks.workunit.client.1.smithi112.stdout:1/825: sync 2024-04-25T02:09:18.378 INFO:tasks.workunit.client.1.smithi112.stdout:3/829: sync 2024-04-25T02:09:18.378 INFO:tasks.workunit.client.1.smithi112.stdout:6/749: sync 2024-04-25T02:09:18.378 INFO:tasks.workunit.client.1.smithi112.stdout:2/814: sync 2024-04-25T02:09:18.378 INFO:tasks.workunit.client.1.smithi112.stdout:2/815: chown d3/da/dc/d20/d40 6234086 1 2024-04-25T02:09:18.378 INFO:tasks.workunit.client.1.smithi112.stdout:2/816: fdatasync d3/da/dc/d3e/df/d25/f37 0 2024-04-25T02:09:18.378 INFO:tasks.workunit.client.1.smithi112.stdout:2/817: getdents d3/da/dc/d20/d43/d7e/df1 0 2024-04-25T02:09:18.385 INFO:tasks.workunit.client.1.smithi112.stdout:7/811: creat d7/d79/da2/d3a/ded/ffc x:0 0 0 2024-04-25T02:09:18.385 INFO:tasks.workunit.client.1.smithi112.stdout:3/830: mkdir d12/d13/d34/d4a/d87/d10f 0 2024-04-25T02:09:18.385 INFO:tasks.workunit.client.1.smithi112.stdout:7/812: fsync d7/dd/f18 0 2024-04-25T02:09:18.386 INFO:tasks.workunit.client.1.smithi112.stdout:9/765: dread d1/d48/d65/d73/daf/f5d [0,4194304] 0 2024-04-25T02:09:18.391 INFO:tasks.workunit.client.1.smithi112.stdout:6/750: mkdir d0/d61/d98/db5/dfc 0 2024-04-25T02:09:18.395 INFO:tasks.workunit.client.1.smithi112.stdout:7/813: link d7/d25/d40/d6b/f70 d7/d25/d40/d6b/ffd 0 2024-04-25T02:09:18.397 INFO:tasks.workunit.client.1.smithi112.stdout:4/899: dread d2/d17/d20/d5e/f5b [0,4194304] 0 2024-04-25T02:09:18.397 INFO:tasks.workunit.client.1.smithi112.stdout:4/900: readlink d2/d17/d20/d26/d39/lff 0 2024-04-25T02:09:18.397 INFO:tasks.workunit.client.1.smithi112.stdout:4/901: truncate d2/d17/db2/f102 233272 0 2024-04-25T02:09:18.399 INFO:tasks.workunit.client.1.smithi112.stdout:2/818: dread d3/da/dc/d3e/df/d32/f98 [0,4194304] 0 2024-04-25T02:09:18.399 INFO:tasks.workunit.client.1.smithi112.stdout:2/819: chown d3/da/dc/d3e/df/d30 31 1 2024-04-25T02:09:18.399 INFO:tasks.workunit.client.1.smithi112.stdout:9/766: mknod d1/d48/d65/d73/daf/d63/deb/d100/c106 0 2024-04-25T02:09:18.401 INFO:tasks.workunit.client.1.smithi112.stdout:6/751: rename d0/d2/d66/d7d/f9c to d0/d2/d3b/ffd 0 2024-04-25T02:09:18.401 INFO:tasks.workunit.client.1.smithi112.stdout:6/752: write d0/d61/d98/db5/fe0 [991931,37570] 0 2024-04-25T02:09:18.406 INFO:tasks.workunit.client.1.smithi112.stdout:3/831: unlink d12/d13/d34/d53/d9c/ld7 0 2024-04-25T02:09:18.406 INFO:tasks.workunit.client.1.smithi112.stdout:3/832: fsync d12/d13/d34/d4a/fc9 0 2024-04-25T02:09:18.407 INFO:tasks.workunit.client.1.smithi112.stdout:7/814: symlink d7/d25/d43/lfe 0 2024-04-25T02:09:18.407 INFO:tasks.workunit.client.1.smithi112.stdout:7/815: write d7/d25/d43/d46/f42 [2055975,8029] 0 2024-04-25T02:09:18.408 INFO:tasks.workunit.client.1.smithi112.stdout:7/816: write d7/dd/da9/f33 [1214045,82672] 0 2024-04-25T02:09:18.408 INFO:tasks.workunit.client.1.smithi112.stdout:7/817: dread - d7/dd/d20/db2/fc3 zero size 2024-04-25T02:09:18.408 INFO:tasks.workunit.client.1.smithi112.stdout:7/818: chown d7/dd/cd0 23864349 1 2024-04-25T02:09:18.415 INFO:tasks.workunit.client.1.smithi112.stdout:2/820: mkdir d3/da/dc/d3e/df/d25/d9e/d81/d101/d115 0 2024-04-25T02:09:18.419 INFO:tasks.workunit.client.1.smithi112.stdout:4/902: rename d2/d17/d20/fa2 to d2/d17/d20/dbe/f125 0 2024-04-25T02:09:18.420 INFO:tasks.workunit.client.1.smithi112.stdout:6/753: dread d0/d2/d2c/d41/f5d [0,4194304] 0 2024-04-25T02:09:18.423 INFO:tasks.workunit.client.1.smithi112.stdout:7/819: dread d7/d25/d43/fa7 [0,4194304] 0 2024-04-25T02:09:18.425 INFO:tasks.workunit.client.1.smithi112.stdout:8/980: dwrite d15/d26/d4f/fd4 [4194304,4194304] 0 2024-04-25T02:09:18.425 INFO:tasks.workunit.client.1.smithi112.stdout:8/981: stat d15/d26/d37/lde 0 2024-04-25T02:09:18.432 INFO:tasks.workunit.client.1.smithi112.stdout:4/903: dread d2/d17/d25/d3f/fa4 [0,4194304] 0 2024-04-25T02:09:18.432 INFO:tasks.workunit.client.1.smithi112.stdout:7/820: rename d7/dd/da9/d74/fa0 to d7/d25/d40/da3/fff 0 2024-04-25T02:09:18.433 INFO:tasks.workunit.client.1.smithi112.stdout:8/982: dread d15/d35/d5f/db5/dc2/d143/d1a/fb3 [0,4194304] 0 2024-04-25T02:09:18.434 INFO:tasks.workunit.client.1.smithi112.stdout:8/983: creat d15/d26/d37/d52/df4/d125/f15b x:0 0 0 2024-04-25T02:09:18.434 INFO:tasks.workunit.client.1.smithi112.stdout:8/984: write d15/d35/d56/f96 [770273,53436] 0 2024-04-25T02:09:18.434 INFO:tasks.workunit.client.1.smithi112.stdout:9/767: dwrite d1/d48/d65/d73/daf/d63/deb/d100/f40 [0,4194304] 0 2024-04-25T02:09:18.435 INFO:tasks.workunit.client.1.smithi112.stdout:4/904: mkdir d2/d1e/d1b/d83/d126 0 2024-04-25T02:09:18.437 INFO:tasks.workunit.client.1.smithi112.stdout:5/779: dwrite d1/d2/f74 [0,4194304] 0 2024-04-25T02:09:18.437 INFO:tasks.workunit.client.1.smithi112.stdout:5/780: write d1/d2/f33 [2880890,29283] 0 2024-04-25T02:09:18.441 INFO:tasks.workunit.client.1.smithi112.stdout:7/821: truncate d7/d25/d40/d51/d77/fb1 2898275 0 2024-04-25T02:09:18.442 INFO:tasks.workunit.client.1.smithi112.stdout:7/822: chown d7/d25/d40/f62 254 1 2024-04-25T02:09:18.446 INFO:tasks.workunit.client.1.smithi112.stdout:3/833: dread d12/d13/d34/d78/f7f [0,4194304] 0 2024-04-25T02:09:18.448 INFO:tasks.workunit.client.1.smithi112.stdout:9/768: rename d1/d13/d41/d84/fc8 to d1/d48/dbd/f107 0 2024-04-25T02:09:18.448 INFO:tasks.workunit.client.1.smithi112.stdout:9/769: chown d1/d48/d65/d73/daf/d63/deb/d100/d3c/d46/c62 9 1 2024-04-25T02:09:18.448 INFO:tasks.workunit.client.1.smithi112.stdout:4/905: write d2/d1e/d1b/d86/f72 [1267185,40635] 0 2024-04-25T02:09:18.452 INFO:tasks.workunit.client.1.smithi112.stdout:8/985: dread d15/d35/d5c/f83 [0,4194304] 0 2024-04-25T02:09:18.452 INFO:tasks.workunit.client.1.smithi112.stdout:2/821: dwrite d3/da/dc/d20/f76 [0,4194304] 0 2024-04-25T02:09:18.453 INFO:tasks.workunit.client.1.smithi112.stdout:7/823: mknod d7/d25/d43/dbc/c100 0 2024-04-25T02:09:18.453 INFO:tasks.workunit.client.1.smithi112.stdout:5/781: truncate d1/df5/d5b/d7b/f7f 6316470 0 2024-04-25T02:09:18.454 INFO:tasks.workunit.client.1.smithi112.stdout:5/782: write d1/d2/d4/dc4/f85 [697243,76076] 0 2024-04-25T02:09:18.456 INFO:tasks.workunit.client.1.smithi112.stdout:2/822: dread d3/da/dc/d20/d85/fe5 [0,4194304] 0 2024-04-25T02:09:18.456 INFO:tasks.workunit.client.1.smithi112.stdout:2/823: write d3/da/dc/fb9 [4046419,80276] 0 2024-04-25T02:09:18.456 INFO:tasks.workunit.client.1.smithi112.stdout:2/824: truncate d3/da/dc/d3e/df/d25/d9e/d10e/fcd 1004888 0 2024-04-25T02:09:18.456 INFO:tasks.workunit.client.1.smithi112.stdout:2/825: write d3/da/dc/d3e/df/d30/d7c/d96/fff [258928,45394] 0 2024-04-25T02:09:18.458 INFO:tasks.workunit.client.1.smithi112.stdout:3/834: creat d12/d1f/d27/d44/d73/d95/da5/d105/f110 x:0 0 0 2024-04-25T02:09:18.458 INFO:tasks.workunit.client.1.smithi112.stdout:9/770: unlink d1/d93/fa3 0 2024-04-25T02:09:18.459 INFO:tasks.workunit.client.1.smithi112.stdout:3/835: dread d12/d13/d34/d4a/fce [0,4194304] 0 2024-04-25T02:09:18.461 INFO:tasks.workunit.client.1.smithi112.stdout:8/986: getdents d15/d26/d37/d52 0 2024-04-25T02:09:18.466 INFO:tasks.workunit.client.1.smithi112.stdout:2/826: dread d3/da/dc/d3e/df/d30/d7c/faa [0,4194304] 0 2024-04-25T02:09:18.466 INFO:tasks.workunit.client.1.smithi112.stdout:9/771: mknod d1/d13/d41/d84/c108 0 2024-04-25T02:09:18.469 INFO:tasks.workunit.client.1.smithi112.stdout:3/836: creat d12/d13/d34/d53/d9c/f111 x:0 0 0 2024-04-25T02:09:18.472 INFO:tasks.workunit.client.1.smithi112.stdout:7/824: getdents d7/d25/d40/d51 0 2024-04-25T02:09:18.483 INFO:tasks.workunit.client.1.smithi112.stdout:9/772: read d1/d13/d41/fa5 [3246956,31981] 0 2024-04-25T02:09:18.487 INFO:tasks.workunit.client.1.smithi112.stdout:9/773: mknod d1/d48/d65/d73/daf/c109 0 2024-04-25T02:09:18.495 INFO:tasks.workunit.client.1.smithi112.stdout:4/906: dwrite d2/d17/d20/d26/d39/d106/fcb [0,4194304] 0 2024-04-25T02:09:18.497 INFO:tasks.workunit.client.1.smithi112.stdout:9/774: mkdir d1/d48/d65/d73/daf/d63/deb/d100/d3c/d43/d10a 0 2024-04-25T02:09:18.502 INFO:tasks.workunit.client.1.smithi112.stdout:7/825: dread d7/dd/d20/f96 [0,4194304] 0 2024-04-25T02:09:18.504 INFO:tasks.workunit.client.1.smithi112.stdout:4/907: dread d2/d1e/f74 [0,4194304] 0 2024-04-25T02:09:18.512 INFO:tasks.workunit.client.1.smithi112.stdout:5/783: dwrite d1/f63 [0,4194304] 0 2024-04-25T02:09:18.513 INFO:tasks.workunit.client.1.smithi112.stdout:7/826: mknod d7/dd/d20/db2/ddd/c101 0 2024-04-25T02:09:18.513 INFO:tasks.workunit.client.1.smithi112.stdout:7/827: creat d7/d25/d43/dca/f102 x:0 0 0 2024-04-25T02:09:18.515 INFO:tasks.workunit.client.1.smithi112.stdout:2/827: dwrite d3/da/dac/fe9 [0,4194304] 0 2024-04-25T02:09:18.515 INFO:tasks.workunit.client.1.smithi112.stdout:9/775: write d1/d13/f37 [7446390,67827] 0 2024-04-25T02:09:18.515 INFO:tasks.workunit.client.1.smithi112.stdout:9/776: fdatasync d1/d13/d41/f4c 0 2024-04-25T02:09:18.515 INFO:tasks.workunit.client.1.smithi112.stdout:8/987: dwrite d15/f28 [0,4194304] 0 2024-04-25T02:09:18.515 INFO:tasks.workunit.client.1.smithi112.stdout:9/777: stat d1/d48/d65/d73/daf/d63/deb/d100/d3c/d46/f99 0 2024-04-25T02:09:18.517 INFO:tasks.workunit.client.1.smithi112.stdout:4/908: creat d2/d17/d25/d3f/f127 x:0 0 0 2024-04-25T02:09:18.532 INFO:tasks.workunit.client.1.smithi112.stdout:5/784: rmdir d1/d2/d4/dc4 39 2024-04-25T02:09:18.535 INFO:tasks.workunit.client.1.smithi112.stdout:7/828: rename d7/c28 to d7/d25/d43/de1/c103 0 2024-04-25T02:09:18.536 INFO:tasks.workunit.client.1.smithi112.stdout:7/829: write d7/dd/d20/db2/fdf [1215248,56332] 0 2024-04-25T02:09:18.538 INFO:tasks.workunit.client.1.smithi112.stdout:4/909: dwrite d2/d1e/d1b/d65/fc9 [4194304,4194304] 0 2024-04-25T02:09:18.540 INFO:tasks.workunit.client.1.smithi112.stdout:7/830: read d7/d79/da2/fad [4110933,79539] 0 2024-04-25T02:09:18.541 INFO:tasks.workunit.client.1.smithi112.stdout:2/828: creat d3/da/dc/d3e/df/d25/d9e/d81/d101/f116 x:0 0 0 2024-04-25T02:09:18.542 INFO:tasks.workunit.client.1.smithi112.stdout:8/988: mkdir d15/d35/d5c/d91/d15c 0 2024-04-25T02:09:18.543 INFO:tasks.workunit.client.1.smithi112.stdout:9/778: mkdir d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/dfd/d10b 0 2024-04-25T02:09:18.546 INFO:tasks.workunit.client.1.smithi112.stdout:5/785: rename d1/d2/d4/l3a to d1/d2/d4/d1d/l104 0 2024-04-25T02:09:18.553 INFO:tasks.workunit.client.1.smithi112.stdout:4/910: symlink d2/d17/d20/d26/d39/d106/l128 0 2024-04-25T02:09:18.553 INFO:tasks.workunit.client.1.smithi112.stdout:4/911: readlink d2/d17/l24 0 2024-04-25T02:09:18.553 INFO:tasks.workunit.client.1.smithi112.stdout:2/829: dread d3/da/dc/d3e/df/d25/d9e/f84 [0,4194304] 0 2024-04-25T02:09:18.558 INFO:tasks.workunit.client.1.smithi112.stdout:7/831: creat d7/d25/d40/f104 x:0 0 0 2024-04-25T02:09:18.563 INFO:tasks.workunit.client.1.smithi112.stdout:7/832: creat d7/dd/de5/f105 x:0 0 0 2024-04-25T02:09:18.563 INFO:tasks.workunit.client.1.smithi112.stdout:7/833: write d7/dd/d20/fbb [2810551,115254] 0 2024-04-25T02:09:18.571 INFO:tasks.workunit.client.1.smithi112.stdout:7/834: rmdir d7/dd/d88/db6 39 2024-04-25T02:09:18.574 INFO:tasks.workunit.client.1.smithi112.stdout:7/835: rename d7/dd/d20/db2/f6f to d7/dd/f106 0 2024-04-25T02:09:18.574 INFO:tasks.workunit.client.1.smithi112.stdout:7/836: write d7/d25/d40/db0/fe9 [1074814,79506] 0 2024-04-25T02:09:18.582 INFO:tasks.workunit.client.1.smithi112.stdout:7/837: rename d7/d25/d40/d51/fbe to d7/d79/da2/d3a/f107 0 2024-04-25T02:09:18.584 INFO:tasks.workunit.client.1.smithi112.stdout:8/989: dwrite d15/d35/d5c/d91/f45 [4194304,4194304] 0 2024-04-25T02:09:18.592 INFO:tasks.workunit.client.1.smithi112.stdout:8/990: symlink d15/d26/d37/d8e/l15d 0 2024-04-25T02:09:18.592 INFO:tasks.workunit.client.1.smithi112.stdout:8/991: chown d15/d40/ld0 6009 1 2024-04-25T02:09:18.592 INFO:tasks.workunit.client.1.smithi112.stdout:8/992: fdatasync d15/d35/d5c/d91/d78/dc5/f84 0 2024-04-25T02:09:18.592 INFO:tasks.workunit.client.1.smithi112.stdout:4/912: dwrite d2/d17/d25/fc6 [0,4194304] 0 2024-04-25T02:09:18.593 INFO:tasks.workunit.client.1.smithi112.stdout:9/779: dwrite d1/d48/dbd/fff [0,4194304] 0 2024-04-25T02:09:18.593 INFO:tasks.workunit.client.1.smithi112.stdout:9/780: truncate d1/d48/d65/d73/daf/d63/deb/d100/fe6 504330 0 2024-04-25T02:09:18.593 INFO:tasks.workunit.client.1.smithi112.stdout:5/786: dwrite d1/d2/f31 [0,4194304] 0 2024-04-25T02:09:18.595 INFO:tasks.workunit.client.1.smithi112.stdout:7/838: read d7/dd/d20/d2c/f45 [5471490,85739] 0 2024-04-25T02:09:18.595 INFO:tasks.workunit.client.1.smithi112.stdout:2/830: dwrite d3/da/dc/d3e/df/d30/dc2/ff4 [0,4194304] 0 2024-04-25T02:09:18.595 INFO:tasks.workunit.client.1.smithi112.stdout:7/839: write d7/d79/da2/d3a/ded/ffc [179249,86] 0 2024-04-25T02:09:18.597 INFO:tasks.workunit.client.1.smithi112.stdout:4/913: rename d2/f5f to d2/d1e/d1b/d83/d126/f129 0 2024-04-25T02:09:18.607 INFO:tasks.workunit.client.1.smithi112.stdout:9/781: getdents d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c 0 2024-04-25T02:09:18.607 INFO:tasks.workunit.client.1.smithi112.stdout:9/782: chown d1/c36 455660 1 2024-04-25T02:09:18.607 INFO:tasks.workunit.client.1.smithi112.stdout:9/783: dread - d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/f9e zero size 2024-04-25T02:09:18.607 INFO:tasks.workunit.client.1.smithi112.stdout:9/784: creat d1/d13/f10c x:0 0 0 2024-04-25T02:09:18.607 INFO:tasks.workunit.client.1.smithi112.stdout:2/831: dread d3/da/dac/fe9 [0,4194304] 0 2024-04-25T02:09:18.607 INFO:tasks.workunit.client.1.smithi112.stdout:2/832: chown d3/da/dc/d20/d85/l9b 2 1 2024-04-25T02:09:18.610 INFO:tasks.workunit.client.1.smithi112.stdout:8/993: dwrite d15/f28 [0,4194304] 0 2024-04-25T02:09:18.610 INFO:tasks.workunit.client.1.smithi112.stdout:8/994: creat d15/d26/d37/d52/df4/f15e x:0 0 0 2024-04-25T02:09:18.610 INFO:tasks.workunit.client.1.smithi112.stdout:8/995: fsync d15/d26/d37/f38 0 2024-04-25T02:09:18.614 INFO:tasks.workunit.client.1.smithi112.stdout:5/787: symlink d1/d16/ddb/l105 0 2024-04-25T02:09:18.620 INFO:tasks.workunit.client.1.smithi112.stdout:7/840: link d7/dd/d20/cd7 d7/dd/da9/d74/deb/c108 0 2024-04-25T02:09:18.621 INFO:tasks.workunit.client.1.smithi112.stdout:4/914: mkdir d2/d17/d20/d26/d12a 0 2024-04-25T02:09:18.621 INFO:tasks.workunit.client.1.smithi112.stdout:4/915: truncate d2/d1e/d4b/d57/f100 865877 0 2024-04-25T02:09:18.622 INFO:tasks.workunit.client.1.smithi112.stdout:2/833: stat d3/da/dc/d3e/df/d25/d9e/lb4 0 2024-04-25T02:09:18.625 INFO:tasks.workunit.client.1.smithi112.stdout:8/996: mkdir d15/d35/d5f/db5/d15f 0 2024-04-25T02:09:18.625 INFO:tasks.workunit.client.1.smithi112.stdout:8/997: creat d15/d35/d5f/db5/dc2/f160 x:0 0 0 2024-04-25T02:09:18.627 INFO:tasks.workunit.client.1.smithi112.stdout:5/788: creat d1/df5/f106 x:0 0 0 2024-04-25T02:09:18.627 INFO:tasks.workunit.client.1.smithi112.stdout:5/789: stat d1/c39 0 2024-04-25T02:09:18.627 INFO:tasks.workunit.client.1.smithi112.stdout:9/785: dwrite d1/d13/d41/d84/fcc [4194304,4194304] 0 2024-04-25T02:09:18.628 INFO:tasks.workunit.client.1.smithi112.stdout:7/841: creat d7/d79/f109 x:0 0 0 2024-04-25T02:09:18.629 INFO:tasks.workunit.client.1.smithi112.stdout:4/916: rmdir d2/d17/d7c/d9c 39 2024-04-25T02:09:18.639 INFO:tasks.workunit.client.1.smithi112.stdout:5/790: write d1/df5/d5b/d7b/f7f [5298345,130758] 0 2024-04-25T02:09:18.639 INFO:tasks.workunit.client.1.smithi112.stdout:7/842: symlink d7/dd/da9/dfb/l10a 0 2024-04-25T02:09:18.639 INFO:tasks.workunit.client.1.smithi112.stdout:7/843: creat d7/dd/d20/db2/f10b x:0 0 0 2024-04-25T02:09:18.641 INFO:tasks.workunit.client.1.smithi112.stdout:4/917: creat d2/d17/f12b x:0 0 0 2024-04-25T02:09:18.644 INFO:tasks.workunit.client.1.smithi112.stdout:2/834: rename d3/da/dc/d3e/df/d25/d9e to d3/da/dc/d20/d117 0 2024-04-25T02:09:18.644 INFO:tasks.workunit.client.1.smithi112.stdout:2/835: write d3/da/dc/d3e/df/d30/d7c/d96/fb8 [2176372,49681] 0 2024-04-25T02:09:18.650 INFO:tasks.workunit.client.1.smithi112.stdout:5/791: dread d1/d2/d78/f7c [0,4194304] 0 2024-04-25T02:09:18.652 INFO:tasks.workunit.client.1.smithi112.stdout:7/844: link d7/d25/d43/d46/f5b d7/dd/de5/f10c 0 2024-04-25T02:09:18.652 INFO:tasks.workunit.client.1.smithi112.stdout:7/845: creat d7/dd/d20/db2/ddd/f10d x:0 0 0 2024-04-25T02:09:18.652 INFO:tasks.workunit.client.1.smithi112.stdout:7/846: creat d7/dd/f10e x:0 0 0 2024-04-25T02:09:18.654 INFO:tasks.workunit.client.1.smithi112.stdout:4/918: mknod d2/d1e/db3/c12c 0 2024-04-25T02:09:18.657 INFO:tasks.workunit.client.1.smithi112.stdout:8/998: dwrite d15/d35/d5f/db5/dc2/d143/d1a/fb3 [0,4194304] 0 2024-04-25T02:09:18.663 INFO:tasks.workunit.client.1.smithi112.stdout:9/786: dwrite d1/d13/d41/f66 [0,4194304] 0 2024-04-25T02:09:18.663 INFO:tasks.workunit.client.1.smithi112.stdout:9/787: creat d1/d48/d65/d73/f10d x:0 0 0 2024-04-25T02:09:18.666 INFO:tasks.workunit.client.1.smithi112.stdout:5/792: write d1/d2/f11 [677547,17785] 0 2024-04-25T02:09:18.672 INFO:tasks.workunit.client.1.smithi112.stdout:7/847: mkdir d7/d25/d40/db0/d10f 0 2024-04-25T02:09:18.676 INFO:tasks.workunit.client.1.smithi112.stdout:4/919: unlink d2/d1e/d1b/d67/ce6 0 2024-04-25T02:09:18.676 INFO:tasks.workunit.client.1.smithi112.stdout:4/920: write d2/d17/d20/d5e/fb8 [198526,16690] 0 2024-04-25T02:09:18.677 INFO:tasks.workunit.client.1.smithi112.stdout:8/999: truncate d15/d35/d5f/db5/dc2/d143/f19 442661 0 2024-04-25T02:09:18.678 INFO:tasks.workunit.client.1.smithi112.stdout:2/836: getdents d3/da/dc/d3e/df/d32 0 2024-04-25T02:09:18.682 INFO:tasks.workunit.client.1.smithi112.stdout:9/788: truncate d1/d93/fee 554586 0 2024-04-25T02:09:18.686 INFO:tasks.workunit.client.1.smithi112.stdout:5/793: symlink d1/df5/d5b/d7b/db2/dc0/dcf/ddd/db6/l107 0 2024-04-25T02:09:18.686 INFO:tasks.workunit.client.1.smithi112.stdout:5/794: write d1/df5/d5b/d7b/db2/dc0/dcf/ddd/f8c [4325905,129882] 0 2024-04-25T02:09:18.686 INFO:tasks.workunit.client.1.smithi112.stdout:5/795: write d1/d2/d78/f9b [599757,89638] 0 2024-04-25T02:09:18.687 INFO:tasks.workunit.client.1.smithi112.stdout:5/796: chown d1/d2/d7d/ce2 21 1 2024-04-25T02:09:18.687 INFO:tasks.workunit.client.1.smithi112.stdout:5/797: chown d1/dba/ccc 5683 1 2024-04-25T02:09:18.687 INFO:tasks.workunit.client.1.smithi112.stdout:5/798: chown d1/d2/d4/dc4/df3 5645 1 2024-04-25T02:09:18.688 INFO:tasks.workunit.client.1.smithi112.stdout:4/921: dread d2/d1e/d1b/d65/fc9 [0,4194304] 0 2024-04-25T02:09:18.688 INFO:tasks.workunit.client.1.smithi112.stdout:4/922: truncate d2/fa3 457046 0 2024-04-25T02:09:18.688 INFO:tasks.workunit.client.1.smithi112.stdout:4/923: creat d2/d17/d20/dbe/f12d x:0 0 0 2024-04-25T02:09:18.690 INFO:tasks.workunit.client.1.smithi112.stdout:7/848: truncate d7/dd/d88/f8a 1583586 0 2024-04-25T02:09:18.695 INFO:tasks.workunit.client.1.smithi112.stdout:9/789: mkdir d1/d48/d65/d10e 0 2024-04-25T02:09:18.695 INFO:tasks.workunit.client.1.smithi112.stdout:9/790: truncate d1/d48/d65/f79 1607286 0 2024-04-25T02:09:18.695 INFO:tasks.workunit.client.1.smithi112.stdout:9/791: write d1/d13/d41/dc1/ff2 [520789,83381] 0 2024-04-25T02:09:18.696 INFO:tasks.workunit.client.1.smithi112.stdout:9/792: dread d1/d13/d41/f53 [0,4194304] 0 2024-04-25T02:09:18.697 INFO:tasks.workunit.client.1.smithi112.stdout:7/849: dread d7/dd/d20/fc6 [0,4194304] 0 2024-04-25T02:09:18.697 INFO:tasks.workunit.client.1.smithi112.stdout:7/850: chown d7/dd/d88 210 1 2024-04-25T02:09:18.697 INFO:tasks.workunit.client.1.smithi112.stdout:7/851: chown d7/dd/d20 1176334 1 2024-04-25T02:09:18.716 INFO:tasks.workunit.client.1.smithi112.stdout:5/799: symlink d1/df5/d5b/d79/d7a/d9d/l108 0 2024-04-25T02:09:18.716 INFO:tasks.workunit.client.1.smithi112.stdout:5/800: creat d1/df5/f109 x:0 0 0 2024-04-25T02:09:18.716 INFO:tasks.workunit.client.1.smithi112.stdout:5/801: write d1/d16/ddb/fee [751285,101093] 0 2024-04-25T02:09:18.718 INFO:tasks.workunit.client.1.smithi112.stdout:5/802: dread d1/d2/d7d/fc2 [0,4194304] 0 2024-04-25T02:09:18.729 INFO:tasks.workunit.client.1.smithi112.stdout:9/793: symlink d1/l10f 0 2024-04-25T02:09:18.729 INFO:tasks.workunit.client.1.smithi112.stdout:9/794: dread - d1/d48/ffb zero size 2024-04-25T02:09:18.733 INFO:tasks.workunit.client.1.smithi112.stdout:7/852: mknod d7/d25/d40/d6b/dcf/c110 0 2024-04-25T02:09:18.733 INFO:tasks.workunit.client.1.smithi112.stdout:7/853: rename d7/dd/d20 to d7/dd/d20/db2/d111 22 2024-04-25T02:09:18.740 INFO:tasks.workunit.client.1.smithi112.stdout:5/803: symlink d1/df5/d5b/d79/d7a/da0/l10a 0 2024-04-25T02:09:18.746 INFO:tasks.workunit.client.1.smithi112.stdout:9/795: creat d1/d48/d65/d73/daf/d63/deb/d100/d8f/f110 x:0 0 0 2024-04-25T02:09:18.750 INFO:tasks.workunit.client.1.smithi112.stdout:7/854: unlink d7/dd/d20/la5 0 2024-04-25T02:09:18.757 INFO:tasks.workunit.client.1.smithi112.stdout:9/796: unlink d1/d48/d65/d73/daf/d63/lef 0 2024-04-25T02:09:18.776 INFO:tasks.workunit.client.1.smithi112.stdout:5/804: dwrite d1/df5/d5b/d7b/f7f [4194304,4194304] 0 2024-04-25T02:09:18.776 INFO:tasks.workunit.client.1.smithi112.stdout:5/805: chown d1/df5/l58 2251 1 2024-04-25T02:09:18.776 INFO:tasks.workunit.client.1.smithi112.stdout:7/855: dwrite d7/fc [0,4194304] 0 2024-04-25T02:09:18.778 INFO:tasks.workunit.client.1.smithi112.stdout:5/806: truncate d1/f6 581540 0 2024-04-25T02:09:18.780 INFO:tasks.workunit.client.1.smithi112.stdout:7/856: creat d7/dd/d20/f112 x:0 0 0 2024-04-25T02:09:18.780 INFO:tasks.workunit.client.1.smithi112.stdout:7/857: creat d7/d25/d40/d6b/d91/f113 x:0 0 0 2024-04-25T02:09:18.781 INFO:tasks.workunit.client.1.smithi112.stdout:9/797: rmdir d1/d48/d65/d73 39 2024-04-25T02:09:18.793 INFO:tasks.workunit.client.1.smithi112.stdout:5/807: read d1/df5/d5b/d7b/db2/dc0/dcf/ddd/fa5 [1113660,4385] 0 2024-04-25T02:09:18.798 INFO:tasks.workunit.client.1.smithi112.stdout:5/808: read d1/d2/d78/f7c [3303749,10946] 0 2024-04-25T02:09:18.798 INFO:tasks.workunit.client.1.smithi112.stdout:5/809: chown d1/d16 847886262 1 2024-04-25T02:09:18.799 INFO:tasks.workunit.client.1.smithi112.stdout:5/810: write d1/df5/d5b/d79/d7a/ff0 [192757,100084] 0 2024-04-25T02:09:18.799 INFO:tasks.workunit.client.1.smithi112.stdout:5/811: chown d1/df5/f109 1 1 2024-04-25T02:09:18.802 INFO:tasks.workunit.client.1.smithi112.stdout:7/858: mknod d7/d25/d40/db0/c114 0 2024-04-25T02:09:18.803 INFO:tasks.workunit.client.1.smithi112.stdout:7/859: write d7/d25/f85 [3934291,51663] 0 2024-04-25T02:09:18.803 INFO:tasks.workunit.client.1.smithi112.stdout:7/860: dread - d7/d25/d40/d51/fea zero size 2024-04-25T02:09:18.806 INFO:tasks.workunit.client.1.smithi112.stdout:9/798: creat d1/d93/f111 x:0 0 0 2024-04-25T02:09:18.807 INFO:tasks.workunit.client.1.smithi112.stdout:5/812: creat d1/d16/d51/f10b x:0 0 0 2024-04-25T02:09:18.808 INFO:tasks.workunit.client.1.smithi112.stdout:5/813: truncate d1/d2/d4/dc4/d9c/fe3 619917 0 2024-04-25T02:09:18.810 INFO:tasks.workunit.client.1.smithi112.stdout:9/799: mknod d1/d48/d65/d73/daf/d63/deb/c112 0 2024-04-25T02:09:18.813 INFO:tasks.workunit.client.1.smithi112.stdout:5/814: read d1/d2/d4/dc4/d9c/fe3 [377684,26730] 0 2024-04-25T02:09:18.813 INFO:tasks.workunit.client.1.smithi112.stdout:5/815: fdatasync d1/df5/f109 0 2024-04-25T02:09:18.813 INFO:tasks.workunit.client.1.smithi112.stdout:5/816: fdatasync d1/f6 0 2024-04-25T02:09:18.814 INFO:tasks.workunit.client.1.smithi112.stdout:9/800: mknod d1/d13/d5b/c113 0 2024-04-25T02:09:18.833 INFO:tasks.workunit.client.1.smithi112.stdout:5/817: write d1/d2/d28/d4f/f83 [2727387,121554] 0 2024-04-25T02:09:18.833 INFO:tasks.workunit.client.1.smithi112.stdout:5/818: readlink d1/d16/l8d 0 2024-04-25T02:09:18.834 INFO:tasks.workunit.client.1.smithi112.stdout:5/819: unlink d1/d2/d4/ff 0 2024-04-25T02:09:18.835 INFO:tasks.workunit.client.1.smithi112.stdout:5/820: mknod d1/d2/d4/d1d/dc9/c10c 0 2024-04-25T02:09:18.835 INFO:tasks.workunit.client.1.smithi112.stdout:5/821: write d1/df5/d5b/d79/d7a/ff0 [1278702,91620] 0 2024-04-25T02:09:18.836 INFO:tasks.workunit.client.1.smithi112.stdout:5/822: mknod d1/df5/d5b/d79/d7a/d9d/dd5/c10d 0 2024-04-25T02:09:18.843 INFO:tasks.workunit.client.1.smithi112.stdout:7/861: dwrite d7/f1e [0,4194304] 0 2024-04-25T02:09:18.844 INFO:tasks.workunit.client.1.smithi112.stdout:9/801: dwrite d1/d93/fee [0,4194304] 0 2024-04-25T02:09:18.850 INFO:tasks.workunit.client.1.smithi112.stdout:7/862: symlink d7/dd/d20/db2/l115 0 2024-04-25T02:09:18.855 INFO:tasks.workunit.client.1.smithi112.stdout:7/863: creat d7/d25/d43/de1/f116 x:0 0 0 2024-04-25T02:09:18.859 INFO:tasks.workunit.client.1.smithi112.stdout:9/802: write d1/d13/d41/f66 [2336913,106851] 0 2024-04-25T02:09:18.864 INFO:tasks.workunit.client.1.smithi112.stdout:7/864: dread d7/d25/d43/d46/f42 [0,4194304] 0 2024-04-25T02:09:18.866 INFO:tasks.workunit.client.1.smithi112.stdout:7/865: creat d7/dd/da9/f117 x:0 0 0 2024-04-25T02:09:18.866 INFO:tasks.workunit.client.1.smithi112.stdout:7/866: symlink d7/d25/d40/d51/l118 0 2024-04-25T02:09:18.867 INFO:tasks.workunit.client.1.smithi112.stdout:7/867: mknod d7/d25/d40/db0/d10f/c119 0 2024-04-25T02:09:18.867 INFO:tasks.workunit.client.1.smithi112.stdout:7/868: creat d7/dd/d20/f11a x:0 0 0 2024-04-25T02:09:18.887 INFO:tasks.workunit.client.1.smithi112.stdout:7/869: dwrite d7/d25/ff4 [0,4194304] 0 2024-04-25T02:09:18.888 INFO:tasks.workunit.client.1.smithi112.stdout:1/826: sync 2024-04-25T02:09:18.888 INFO:tasks.workunit.client.1.smithi112.stdout:1/827: fsync d7/d9/d1e/de/fbc 0 2024-04-25T02:09:18.889 INFO:tasks.workunit.client.1.smithi112.stdout:1/828: rename d7 to d7/d9/d1f/d25/d39/d107 22 2024-04-25T02:09:18.892 INFO:tasks.workunit.client.1.smithi112.stdout:9/803: dwrite d1/d48/f87 [0,4194304] 0 2024-04-25T02:09:18.895 INFO:tasks.workunit.client.1.smithi112.stdout:9/804: creat d1/d48/d65/d73/f114 x:0 0 0 2024-04-25T02:09:18.895 INFO:tasks.workunit.client.1.smithi112.stdout:9/805: read d1/d13/f20 [2832526,27280] 0 2024-04-25T02:09:18.910 INFO:tasks.workunit.client.1.smithi112.stdout:7/870: dwrite d7/d25/ff4 [0,4194304] 0 2024-04-25T02:09:18.911 INFO:tasks.workunit.client.1.smithi112.stdout:7/871: chown d7/dd/da9/cd2 3 1 2024-04-25T02:09:18.912 INFO:tasks.workunit.client.1.smithi112.stdout:1/829: dwrite d7/d9/d4e/d72/d73/de9/d3f/f8d [0,4194304] 0 2024-04-25T02:09:18.926 INFO:tasks.workunit.client.1.smithi112.stdout:7/872: mknod d7/d25/d40/da3/c11b 0 2024-04-25T02:09:18.929 INFO:tasks.workunit.client.1.smithi112.stdout:7/873: symlink d7/d79/da2/d3a/ded/l11c 0 2024-04-25T02:09:18.929 INFO:tasks.workunit.client.1.smithi112.stdout:7/874: chown d7/d25/d40/d51/d77 37620 1 2024-04-25T02:09:18.929 INFO:tasks.workunit.client.1.smithi112.stdout:7/875: write d7/d25/d43/dbc/fef [598402,102341] 0 2024-04-25T02:09:18.929 INFO:tasks.workunit.client.1.smithi112.stdout:7/876: chown d7/dd/d20/fc6 898980970 1 2024-04-25T02:09:18.932 INFO:tasks.workunit.client.1.smithi112.stdout:7/877: symlink d7/dd/d20/db2/l11d 0 2024-04-25T02:09:18.932 INFO:tasks.workunit.client.1.smithi112.stdout:7/878: dread - d7/d79/da2/fb5 zero size 2024-04-25T02:09:18.932 INFO:tasks.workunit.client.1.smithi112.stdout:7/879: chown d7/f17 336534 1 2024-04-25T02:09:18.939 INFO:tasks.workunit.client.1.smithi112.stdout:7/880: read d7/dd/da9/f5e [3896117,24313] 0 2024-04-25T02:09:18.941 INFO:tasks.workunit.client.1.smithi112.stdout:7/881: creat d7/d25/dd6/f11e x:0 0 0 2024-04-25T02:09:18.954 INFO:tasks.workunit.client.1.smithi112.stdout:7/882: dread d7/d79/da2/d3a/f107 [4194304,4194304] 0 2024-04-25T02:09:18.955 INFO:tasks.workunit.client.1.smithi112.stdout:7/883: stat d7/d79/da2/l6e 0 2024-04-25T02:09:18.955 INFO:tasks.workunit.client.1.smithi112.stdout:7/884: chown d7/d25/d40/db0/lfa 31721 1 2024-04-25T02:09:18.956 INFO:tasks.workunit.client.1.smithi112.stdout:7/885: creat d7/dd/da9/d74/deb/f11f x:0 0 0 2024-04-25T02:09:18.957 INFO:tasks.workunit.client.1.smithi112.stdout:7/886: chown d7/d79/lec 844984 1 2024-04-25T02:09:18.959 INFO:tasks.workunit.client.1.smithi112.stdout:7/887: unlink d7/f76 0 2024-04-25T02:09:18.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:18 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:09:18.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:18 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:09:18.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:18 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.cswrxs/mirror_snapshot_schedule"}]: dispatch 2024-04-25T02:09:18.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:18 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.cswrxs/trash_purge_schedule"}]: dispatch 2024-04-25T02:09:18.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:18 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:18.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:18 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:18.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:18 smithi077 ceph-mon[26330]: Deploying cephadm binary to smithi077 2024-04-25T02:09:18.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:18 smithi077 ceph-mon[26330]: mgrmap e22: smithi112.cswrxs(active, since 1.01936s) 2024-04-25T02:09:18.989 INFO:tasks.workunit.client.1.smithi112.stdout:7/888: dwrite d7/dd/d20/db2/fdf [0,4194304] 0 2024-04-25T02:09:18.989 INFO:tasks.workunit.client.1.smithi112.stdout:7/889: creat d7/dd/da9/d74/deb/f120 x:0 0 0 2024-04-25T02:09:18.997 INFO:tasks.workunit.client.1.smithi112.stdout:7/890: write d7/d25/ff4 [851395,126115] 0 2024-04-25T02:09:18.997 INFO:tasks.workunit.client.1.smithi112.stdout:7/891: dread - d7/fe8 zero size 2024-04-25T02:09:19.019 INFO:tasks.workunit.client.1.smithi112.stdout:7/892: dwrite d7/dd/da9/d74/fde [0,4194304] 0 2024-04-25T02:09:19.023 INFO:tasks.workunit.client.1.smithi112.stdout:7/893: getdents d7/d25/d40/d51 0 2024-04-25T02:09:19.023 INFO:tasks.workunit.client.1.smithi112.stdout:7/894: chown d7/d25/d43/d46/ld4 57601305 1 2024-04-25T02:09:19.023 INFO:tasks.workunit.client.1.smithi112.stdout:7/895: chown d7/d25/d40/d51/fea 465556 1 2024-04-25T02:09:19.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:18 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:09:19.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:18 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:09:19.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:18 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.cswrxs/mirror_snapshot_schedule"}]: dispatch 2024-04-25T02:09:19.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:18 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.cswrxs/trash_purge_schedule"}]: dispatch 2024-04-25T02:09:19.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:18 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:19.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:18 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:19.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:18 smithi112 ceph-mon[33313]: Deploying cephadm binary to smithi077 2024-04-25T02:09:19.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:18 smithi112 ceph-mon[33313]: mgrmap e22: smithi112.cswrxs(active, since 1.01936s) 2024-04-25T02:09:19.040 INFO:tasks.workunit.client.1.smithi112.stdout:7/896: dwrite d7/d25/d43/f8f [0,4194304] 0 2024-04-25T02:09:19.084 INFO:tasks.workunit.client.1.smithi112.stdout:3/837: sync 2024-04-25T02:09:19.084 INFO:tasks.workunit.client.1.smithi112.stdout:6/754: sync 2024-04-25T02:09:19.084 INFO:tasks.workunit.client.1.smithi112.stdout:3/838: chown d12/d5d 12 1 2024-04-25T02:09:19.084 INFO:tasks.workunit.client.1.smithi112.stdout:2/837: sync 2024-04-25T02:09:19.089 INFO:tasks.workunit.client.1.smithi112.stdout:7/897: rmdir d7/dd/d88/db6 39 2024-04-25T02:09:19.091 INFO:tasks.workunit.client.1.smithi112.stdout:6/755: mknod d0/d7b/cfe 0 2024-04-25T02:09:19.091 INFO:tasks.workunit.client.1.smithi112.stdout:6/756: dread - d0/d2/d66/d7d/ffb zero size 2024-04-25T02:09:19.091 INFO:tasks.workunit.client.1.smithi112.stdout:6/757: chown d0/d2/d4/dd/l4b 275639 1 2024-04-25T02:09:19.091 INFO:tasks.workunit.client.1.smithi112.stdout:6/758: chown d0/d36/ca0 9942 1 2024-04-25T02:09:19.095 INFO:tasks.workunit.client.1.smithi112.stdout:3/839: mknod d12/d67/dd3/d102/c112 0 2024-04-25T02:09:19.098 INFO:tasks.workunit.client.1.smithi112.stdout:6/759: unlink d0/d32/d45/fad 0 2024-04-25T02:09:19.102 INFO:tasks.workunit.client.1.smithi112.stdout:6/760: dread d0/d2/d2c/f33 [0,4194304] 0 2024-04-25T02:09:19.102 INFO:tasks.workunit.client.1.smithi112.stdout:3/840: creat d12/d13/d34/d4a/f113 x:0 0 0 2024-04-25T02:09:19.105 INFO:tasks.workunit.client.1.smithi112.stdout:3/841: rmdir d12/d67/dd3/d102 39 2024-04-25T02:09:19.106 INFO:tasks.workunit.client.1.smithi112.stdout:6/761: rmdir d0/d2/d66/da8 39 2024-04-25T02:09:19.109 INFO:tasks.workunit.client.1.smithi112.stdout:6/762: mkdir d0/d7b/dff 0 2024-04-25T02:09:19.109 INFO:tasks.workunit.client.1.smithi112.stdout:6/763: write d0/d2/d4/d28/fa2 [3253021,16437] 0 2024-04-25T02:09:19.110 INFO:tasks.workunit.client.1.smithi112.stdout:3/842: mkdir d12/d13/d34/d53/d114 0 2024-04-25T02:09:19.112 INFO:tasks.workunit.client.1.smithi112.stdout:3/843: mkdir d12/d67/dbf/d115 0 2024-04-25T02:09:19.113 INFO:tasks.workunit.client.1.smithi112.stdout:3/844: symlink d12/d1f/daa/l116 0 2024-04-25T02:09:19.115 INFO:tasks.workunit.client.1.smithi112.stdout:3/845: mkdir d12/d13/d34/d78/d117 0 2024-04-25T02:09:19.115 INFO:tasks.workunit.client.1.smithi112.stdout:3/846: fdatasync d12/d13/d34/d78/fe5 0 2024-04-25T02:09:19.115 INFO:tasks.workunit.client.1.smithi112.stdout:3/847: read d12/f1d [218915,96156] 0 2024-04-25T02:09:19.117 INFO:tasks.workunit.client.1.smithi112.stdout:3/848: creat d12/d13/d34/d4a/d87/d10f/f118 x:0 0 0 2024-04-25T02:09:19.117 INFO:tasks.workunit.client.1.smithi112.stdout:3/849: creat d12/d13/d34/d4a/d87/d10f/f119 x:0 0 0 2024-04-25T02:09:19.118 INFO:tasks.workunit.client.1.smithi112.stdout:2/838: dwrite d3/da/dc/d20/d43/d7e/da3/f113 [0,4194304] 0 2024-04-25T02:09:19.118 INFO:tasks.workunit.client.1.smithi112.stdout:7/898: dwrite d7/d25/d43/fa7 [0,4194304] 0 2024-04-25T02:09:19.125 INFO:tasks.workunit.client.1.smithi112.stdout:6/764: dwrite d0/d61/d98/db5/ff0 [0,4194304] 0 2024-04-25T02:09:19.130 INFO:tasks.workunit.client.1.smithi112.stdout:2/839: getdents d3/da/dc/d3e/df/d30/dd7 0 2024-04-25T02:09:19.138 INFO:tasks.workunit.client.1.smithi112.stdout:2/840: dread d3/da/dc/d20/f21 [0,4194304] 0 2024-04-25T02:09:19.142 INFO:tasks.workunit.client.1.smithi112.stdout:3/850: getdents d12/d1f/d27/d44/d73/d95/da5/d105 0 2024-04-25T02:09:19.142 INFO:tasks.workunit.client.1.smithi112.stdout:3/851: write d12/d1f/d27/d44/d73/d95/da5/db3/fb7 [1421022,14175] 0 2024-04-25T02:09:19.149 INFO:tasks.workunit.client.1.smithi112.stdout:6/765: mkdir d0/d32/d45/d100 0 2024-04-25T02:09:19.151 INFO:tasks.workunit.client.1.smithi112.stdout:2/841: creat d3/da/dc/d20/d43/f118 x:0 0 0 2024-04-25T02:09:19.153 INFO:tasks.workunit.client.1.smithi112.stdout:7/899: getdents d7/d25/d43/de1 0 2024-04-25T02:09:19.157 INFO:tasks.workunit.client.1.smithi112.stdout:6/766: link d0/d2/d79/d81/cd5 d0/d2/d2c/d41/d77/c101 0 2024-04-25T02:09:19.181 INFO:tasks.workunit.client.1.smithi112.stdout:2/842: mkdir d3/da/dc/d20/d43/d119 0 2024-04-25T02:09:19.181 INFO:tasks.workunit.client.1.smithi112.stdout:2/843: read d3/da/dc/d20/f21 [2855811,760] 0 2024-04-25T02:09:19.186 INFO:tasks.workunit.client.1.smithi112.stdout:7/900: symlink d7/d79/dda/l121 0 2024-04-25T02:09:19.186 INFO:tasks.workunit.client.1.smithi112.stdout:7/901: chown d7/d25/d43/dca/fee 164785 1 2024-04-25T02:09:19.193 INFO:tasks.workunit.client.1.smithi112.stdout:3/852: link d12/d1f/d27/d44/d73/d95/da5/db3/fb7 d12/d13/d34/d4a/d4f/da1/f11a 0 2024-04-25T02:09:19.195 INFO:tasks.workunit.client.1.smithi112.stdout:6/767: unlink d0/d36/f5a 0 2024-04-25T02:09:19.200 INFO:tasks.workunit.client.1.smithi112.stdout:7/902: dwrite d7/dd/da9/f117 [0,4194304] 0 2024-04-25T02:09:19.201 INFO:tasks.workunit.client.1.smithi112.stdout:6/768: mkdir d0/d2/d2c/d41/d77/d102 0 2024-04-25T02:09:19.208 INFO:tasks.workunit.client.1.smithi112.stdout:2/844: rmdir d3/da/dc/d3e/df/d30/d7c 39 2024-04-25T02:09:19.212 INFO:tasks.workunit.client.1.smithi112.stdout:5/823: sync 2024-04-25T02:09:19.212 INFO:tasks.workunit.client.1.smithi112.stdout:4/924: sync 2024-04-25T02:09:19.213 INFO:tasks.workunit.client.1.smithi112.stdout:7/903: dwrite d7/d79/da2/f7c [0,4194304] 0 2024-04-25T02:09:19.220 INFO:tasks.workunit.client.1.smithi112.stdout:2/845: truncate d3/da/dc/d20/d43/fd3 542073 0 2024-04-25T02:09:19.222 INFO:tasks.workunit.client.1.smithi112.stdout:7/904: dread d7/d25/d40/d6b/f84 [0,4194304] 0 2024-04-25T02:09:19.222 INFO:tasks.workunit.client.1.smithi112.stdout:4/925: mkdir d2/d17/d20/deb/d12e 0 2024-04-25T02:09:19.222 INFO:tasks.workunit.client.1.smithi112.stdout:4/926: getdents d2/d17/d20/d26/d12a 0 2024-04-25T02:09:19.225 INFO:tasks.workunit.client.1.smithi112.stdout:5/824: creat d1/d16/f10e x:0 0 0 2024-04-25T02:09:19.230 INFO:tasks.workunit.client.1.smithi112.stdout:4/927: write d2/f2d [3510415,35372] 0 2024-04-25T02:09:19.230 INFO:tasks.workunit.client.1.smithi112.stdout:4/928: write d2/d1e/db3/ff6 [356044,34692] 0 2024-04-25T02:09:19.232 INFO:tasks.workunit.client.1.smithi112.stdout:2/846: mkdir d3/da/dac/dbf/dee/d11a 0 2024-04-25T02:09:19.235 INFO:tasks.workunit.client.1.smithi112.stdout:7/905: getdents d7/d25/d40/d6b/dcf 0 2024-04-25T02:09:19.237 INFO:tasks.workunit.client.1.smithi112.stdout:5/825: mknod d1/d2/d28/c10f 0 2024-04-25T02:09:19.240 INFO:tasks.workunit.client.1.smithi112.stdout:4/929: rename d2/d1e/d1b/d86/c8b to d2/d17/d20/c12f 0 2024-04-25T02:09:19.245 INFO:tasks.workunit.client.1.smithi112.stdout:2/847: unlink d3/da/dc/f7a 0 2024-04-25T02:09:19.246 INFO:tasks.workunit.client.1.smithi112.stdout:7/906: mkdir d7/dd/da9/d74/d122 0 2024-04-25T02:09:19.246 INFO:tasks.workunit.client.1.smithi112.stdout:2/848: dread d3/da/dc/d20/d43/d7e/da3/fdd [0,4194304] 0 2024-04-25T02:09:19.249 INFO:tasks.workunit.client.1.smithi112.stdout:5/826: getdents d1/df5/d5b/d79/d7a/d9d 0 2024-04-25T02:09:19.250 INFO:tasks.workunit.client.1.smithi112.stdout:7/907: dread d7/dd/da9/f5e [0,4194304] 0 2024-04-25T02:09:19.250 INFO:tasks.workunit.client.1.smithi112.stdout:7/908: write d7/d79/f109 [906196,3901] 0 2024-04-25T02:09:19.252 INFO:tasks.workunit.client.1.smithi112.stdout:4/930: creat d2/d1e/d5c/f130 x:0 0 0 2024-04-25T02:09:19.254 INFO:tasks.workunit.client.1.smithi112.stdout:2/849: mkdir d3/da/dc/d3e/df/d30/dd7/d11b 0 2024-04-25T02:09:19.257 INFO:tasks.workunit.client.1.smithi112.stdout:5/827: truncate d1/d2/d4/dc4/f85 407931 0 2024-04-25T02:09:19.257 INFO:tasks.workunit.client.1.smithi112.stdout:5/828: write d1/d2/ff9 [456784,127565] 0 2024-04-25T02:09:19.260 INFO:tasks.workunit.client.1.smithi112.stdout:7/909: mknod d7/d25/d40/d51/c123 0 2024-04-25T02:09:19.262 INFO:tasks.workunit.client.1.smithi112.stdout:4/931: symlink d2/d17/d20/d26/d39/d106/l131 0 2024-04-25T02:09:19.263 INFO:tasks.workunit.client.1.smithi112.stdout:4/932: write d2/d1e/d5c/f76 [102985,3013] 0 2024-04-25T02:09:19.263 INFO:tasks.workunit.client.1.smithi112.stdout:7/910: dread d7/d25/d43/f2a [0,4194304] 0 2024-04-25T02:09:19.266 INFO:tasks.workunit.client.1.smithi112.stdout:5/829: rename d1/df5/l58 to d1/df5/d5b/d7b/d87/l110 0 2024-04-25T02:09:19.266 INFO:tasks.workunit.client.1.smithi112.stdout:5/830: dread - d1/d2/d28/d4f/fb7 zero size 2024-04-25T02:09:19.266 INFO:tasks.workunit.client.1.smithi112.stdout:5/831: truncate d1/d2/d4/d1d/f70 4743452 0 2024-04-25T02:09:19.267 INFO:tasks.workunit.client.1.smithi112.stdout:5/832: write d1/d2/d28/f57 [173742,4721] 0 2024-04-25T02:09:19.270 INFO:tasks.workunit.client.1.smithi112.stdout:4/933: write d2/d12/f44 [1324008,4299] 0 2024-04-25T02:09:19.273 INFO:tasks.workunit.client.1.smithi112.stdout:4/934: mkdir d2/d17/d20/dbe/d132 0 2024-04-25T02:09:19.275 INFO:tasks.workunit.client.1.smithi112.stdout:4/935: creat d2/f133 x:0 0 0 2024-04-25T02:09:19.280 INFO:tasks.workunit.client.1.smithi112.stdout:2/850: dwrite d3/da/dc/d3e/df/d30/f6c [0,4194304] 0 2024-04-25T02:09:19.280 INFO:tasks.workunit.client.1.smithi112.stdout:7/911: dread d7/dd/de5/f10c [0,4194304] 0 2024-04-25T02:09:19.282 INFO:tasks.workunit.client.1.smithi112.stdout:2/851: creat d3/da/dc/d3e/f11c x:0 0 0 2024-04-25T02:09:19.282 INFO:tasks.workunit.client.1.smithi112.stdout:2/852: truncate d3/da/dc/d20/d117/d81/f87 4251461 0 2024-04-25T02:09:19.283 INFO:tasks.workunit.client.1.smithi112.stdout:7/912: mkdir d7/dd/da9/d124 0 2024-04-25T02:09:19.287 INFO:tasks.workunit.client.1.smithi112.stdout:5/833: dwrite d1/d16/d8f/ffe [0,4194304] 0 2024-04-25T02:09:19.290 INFO:tasks.workunit.client.1.smithi112.stdout:2/853: dread d3/f73 [0,4194304] 0 2024-04-25T02:09:19.291 INFO:tasks.workunit.client.1.smithi112.stdout:5/834: unlink d1/d2/d28/fe8 0 2024-04-25T02:09:19.293 INFO:tasks.workunit.client.1.smithi112.stdout:2/854: rename d3/da/dc/d20/d117 to d3/da/dac/dbf/dee/d11d 0 2024-04-25T02:09:19.296 INFO:tasks.workunit.client.1.smithi112.stdout:5/835: link d1/df5/d5b/d79/d7a/da0/fb4 d1/d16/d51/d93/f111 0 2024-04-25T02:09:19.296 INFO:tasks.workunit.client.1.smithi112.stdout:5/836: chown d1/dba/ccd 8293 1 2024-04-25T02:09:19.299 INFO:tasks.workunit.client.1.smithi112.stdout:7/913: write d7/d25/d40/da3/fff [1780697,14191] 0 2024-04-25T02:09:19.299 INFO:tasks.workunit.client.1.smithi112.stdout:2/855: symlink d3/da/dc/d3e/df/d25/d88/d8e/l11e 0 2024-04-25T02:09:19.303 INFO:tasks.workunit.client.1.smithi112.stdout:4/936: dwrite d2/d17/d20/d26/d39/fee [0,4194304] 0 2024-04-25T02:09:19.304 INFO:tasks.workunit.client.1.smithi112.stdout:5/837: creat d1/df5/d5b/d7b/db2/dc0/dcf/ddd/f112 x:0 0 0 2024-04-25T02:09:19.323 INFO:tasks.workunit.client.1.smithi112.stdout:2/856: dwrite d3/da/dc/d20/d43/faf [0,4194304] 0 2024-04-25T02:09:19.323 INFO:tasks.workunit.client.1.smithi112.stdout:2/857: write d3/f10a [147118,69006] 0 2024-04-25T02:09:19.325 INFO:tasks.workunit.client.1.smithi112.stdout:7/914: dwrite d7/dd/f21 [0,4194304] 0 2024-04-25T02:09:19.335 INFO:tasks.workunit.client.1.smithi112.stdout:2/858: symlink d3/d108/l11f 0 2024-04-25T02:09:19.335 INFO:tasks.workunit.client.1.smithi112.stdout:5/838: creat d1/d16/d99/f113 x:0 0 0 2024-04-25T02:09:19.341 INFO:tasks.workunit.client.1.smithi112.stdout:7/915: creat d7/d25/d43/de1/f125 x:0 0 0 2024-04-25T02:09:19.341 INFO:tasks.workunit.client.1.smithi112.stdout:7/916: fsync d7/d25/d40/d51/fce 0 2024-04-25T02:09:19.342 INFO:tasks.workunit.client.1.smithi112.stdout:7/917: creat d7/d79/f126 x:0 0 0 2024-04-25T02:09:19.342 INFO:tasks.workunit.client.1.smithi112.stdout:4/937: mknod d2/d1e/c134 0 2024-04-25T02:09:19.344 INFO:tasks.workunit.client.1.smithi112.stdout:2/859: creat d3/da/dc/d3e/df/d30/dd7/f120 x:0 0 0 2024-04-25T02:09:19.344 INFO:tasks.workunit.client.1.smithi112.stdout:2/860: chown d3/da/dc/d20/d43/d7e/df1 392171233 1 2024-04-25T02:09:19.344 INFO:tasks.workunit.client.1.smithi112.stdout:2/861: fsync d3/da/dc/d20/d43/d7e/f106 0 2024-04-25T02:09:19.344 INFO:tasks.workunit.client.1.smithi112.stdout:2/862: stat d3/da/dc/d3e/df/d32 0 2024-04-25T02:09:19.345 INFO:tasks.workunit.client.1.smithi112.stdout:2/863: write d3/da/dc/d3e/df/d32/f98 [4020805,64439] 0 2024-04-25T02:09:19.345 INFO:tasks.workunit.client.1.smithi112.stdout:2/864: chown d3/da/dac/dbf/c8f 1 1 2024-04-25T02:09:19.345 INFO:tasks.workunit.client.1.smithi112.stdout:2/865: write d3/da/dc/d3e/df/d30/f6c [4728194,84215] 0 2024-04-25T02:09:19.345 INFO:tasks.workunit.client.1.smithi112.stdout:2/866: chown d3/da/dc/d3e/fc4 1410980 1 2024-04-25T02:09:19.345 INFO:tasks.workunit.client.1.smithi112.stdout:2/867: write d3/da/dc/d20/d85/fe5 [704860,1367] 0 2024-04-25T02:09:19.345 INFO:tasks.workunit.client.1.smithi112.stdout:5/839: symlink d1/df5/d5b/d7b/db2/dc0/dcf/ddd/db6/l114 0 2024-04-25T02:09:19.348 INFO:tasks.workunit.client.1.smithi112.stdout:4/938: truncate d2/d17/db2/fd7 602472 0 2024-04-25T02:09:19.349 INFO:tasks.workunit.client.1.smithi112.stdout:4/939: truncate d2/d17/d20/d5e/f2b 3007392 0 2024-04-25T02:09:19.349 INFO:tasks.workunit.client.1.smithi112.stdout:4/940: stat d2/f1d 0 2024-04-25T02:09:19.349 INFO:tasks.workunit.client.1.smithi112.stdout:4/941: chown d2/d4e/d111 6 1 2024-04-25T02:09:19.349 INFO:tasks.workunit.client.1.smithi112.stdout:4/942: chown d2/d12/de1 132993512 1 2024-04-25T02:09:19.350 INFO:tasks.workunit.client.1.smithi112.stdout:2/868: mknod d3/da/dc/d3e/df/d25/c121 0 2024-04-25T02:09:19.354 INFO:tasks.workunit.client.1.smithi112.stdout:2/869: symlink d3/da/dc/d20/d43/d7e/l122 0 2024-04-25T02:09:19.354 INFO:tasks.workunit.client.1.smithi112.stdout:2/870: stat d3/da/dc/d20/d43/d7e/da3/f113 0 2024-04-25T02:09:19.358 INFO:tasks.workunit.client.1.smithi112.stdout:7/918: read d7/fc [205884,64264] 0 2024-04-25T02:09:19.361 INFO:tasks.workunit.client.1.smithi112.stdout:5/840: write d1/df5/d5b/d96/fb0 [288510,44570] 0 2024-04-25T02:09:19.361 INFO:tasks.workunit.client.1.smithi112.stdout:5/841: stat d1/d16/d99/cd0 0 2024-04-25T02:09:19.363 INFO:tasks.workunit.client.1.smithi112.stdout:4/943: dread d2/d17/d20/d5e/f5b [0,4194304] 0 2024-04-25T02:09:19.368 INFO:tasks.workunit.client.1.smithi112.stdout:5/842: creat d1/f115 x:0 0 0 2024-04-25T02:09:19.369 INFO:tasks.workunit.client.1.smithi112.stdout:4/944: creat d2/d17/d20/d26/d12a/f135 x:0 0 0 2024-04-25T02:09:19.369 INFO:tasks.workunit.client.1.smithi112.stdout:4/945: truncate d2/d17/d20/f10a 112783 0 2024-04-25T02:09:19.369 INFO:tasks.workunit.client.1.smithi112.stdout:4/946: write d2/d17/d20/d26/d39/d106/f10c [994367,56353] 0 2024-04-25T02:09:19.369 INFO:tasks.workunit.client.1.smithi112.stdout:4/947: creat d2/d17/d25/d3f/f136 x:0 0 0 2024-04-25T02:09:19.370 INFO:tasks.workunit.client.1.smithi112.stdout:7/919: rmdir d7/dd/d20/db2/ddd 39 2024-04-25T02:09:19.375 INFO:tasks.workunit.client.1.smithi112.stdout:2/871: dwrite d3/da/dc/d3e/df/d30/fdc [0,4194304] 0 2024-04-25T02:09:19.375 INFO:tasks.workunit.client.1.smithi112.stdout:9/806: sync 2024-04-25T02:09:19.378 INFO:tasks.workunit.client.1.smithi112.stdout:4/948: symlink d2/d1e/d5c/l137 0 2024-04-25T02:09:19.382 INFO:tasks.workunit.client.1.smithi112.stdout:7/920: link d7/dd/d20/fc6 d7/d25/d43/d46/f127 0 2024-04-25T02:09:19.382 INFO:tasks.workunit.client.1.smithi112.stdout:7/921: chown d7/ca 1560 1 2024-04-25T02:09:19.385 INFO:tasks.workunit.client.1.smithi112.stdout:5/843: symlink d1/d2/l116 0 2024-04-25T02:09:19.385 INFO:tasks.workunit.client.1.smithi112.stdout:5/844: readlink d1/l56 0 2024-04-25T02:09:19.398 INFO:tasks.workunit.client.1.smithi112.stdout:4/949: dread d2/d17/d25/fc6 [0,4194304] 0 2024-04-25T02:09:19.399 INFO:tasks.workunit.client.1.smithi112.stdout:5/845: dread d1/df5/d5b/f80 [0,4194304] 0 2024-04-25T02:09:19.404 INFO:tasks.workunit.client.1.smithi112.stdout:7/922: creat d7/dd/d20/d2c/f128 x:0 0 0 2024-04-25T02:09:19.404 INFO:tasks.workunit.client.1.smithi112.stdout:7/923: readlink d7/dd/da9/ld9 0 2024-04-25T02:09:19.407 INFO:tasks.workunit.client.1.smithi112.stdout:5/846: symlink d1/df5/d5b/d7b/db2/dc0/ddf/l117 0 2024-04-25T02:09:19.407 INFO:tasks.workunit.client.1.smithi112.stdout:5/847: readlink d1/dba/lc3 0 2024-04-25T02:09:19.407 INFO:tasks.workunit.client.1.smithi112.stdout:5/848: fdatasync d1/f46 0 2024-04-25T02:09:19.412 INFO:tasks.workunit.client.1.smithi112.stdout:7/924: mknod d7/d25/dd6/c129 0 2024-04-25T02:09:19.412 INFO:tasks.workunit.client.1.smithi112.stdout:4/950: dread d2/d12/de1/f7f [0,4194304] 0 2024-04-25T02:09:19.412 INFO:tasks.workunit.client.1.smithi112.stdout:2/872: dwrite d3/da/dc/d3e/df/d25/f54 [4194304,4194304] 0 2024-04-25T02:09:19.419 INFO:tasks.workunit.client.1.smithi112.stdout:2/873: getdents d3/da/dc/d3e/df/d71/dc5 0 2024-04-25T02:09:19.423 INFO:tasks.workunit.client.1.smithi112.stdout:4/951: dread d2/d17/d25/d3f/fa4 [0,4194304] 0 2024-04-25T02:09:19.423 INFO:tasks.workunit.client.1.smithi112.stdout:9/807: dwrite d1/d48/d65/d73/daf/d63/deb/d100/d3c/fab [0,4194304] 0 2024-04-25T02:09:19.423 INFO:tasks.workunit.client.1.smithi112.stdout:7/925: write d7/dd/de5/f10c [2486132,39978] 0 2024-04-25T02:09:19.430 INFO:tasks.workunit.client.1.smithi112.stdout:9/808: mknod d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/dfd/c115 0 2024-04-25T02:09:19.432 INFO:tasks.workunit.client.1.smithi112.stdout:5/849: dwrite d1/d16/d22/f37 [0,4194304] 0 2024-04-25T02:09:19.433 INFO:tasks.workunit.client.1.smithi112.stdout:2/874: write d3/da/dc/d3e/df/d30/f6c [3110863,95510] 0 2024-04-25T02:09:19.433 INFO:tasks.workunit.client.1.smithi112.stdout:2/875: read d3/da/dc/d20/d43/fd3 [129995,4775] 0 2024-04-25T02:09:19.433 INFO:tasks.workunit.client.1.smithi112.stdout:7/926: symlink d7/dd/da9/d7f/l12a 0 2024-04-25T02:09:19.434 INFO:tasks.workunit.client.1.smithi112.stdout:1/830: sync 2024-04-25T02:09:19.434 INFO:tasks.workunit.client.1.smithi112.stdout:3/853: sync 2024-04-25T02:09:19.434 INFO:tasks.workunit.client.1.smithi112.stdout:6/769: sync 2024-04-25T02:09:19.437 INFO:tasks.workunit.client.1.smithi112.stdout:9/809: truncate d1/d48/d65/d73/daf/d63/deb/d100/d3c/d46/f99 1179114 0 2024-04-25T02:09:19.440 INFO:tasks.workunit.client.1.smithi112.stdout:5/850: creat d1/df5/d5b/d79/d7a/f118 x:0 0 0 2024-04-25T02:09:19.441 INFO:tasks.workunit.client.1.smithi112.stdout:2/876: truncate d3/da/dac/ffc 4677151 0 2024-04-25T02:09:19.441 INFO:tasks.workunit.client.1.smithi112.stdout:2/877: chown d3/da/dc/d3e/df/d25/d88/d8e 1 1 2024-04-25T02:09:19.445 INFO:tasks.workunit.client.1.smithi112.stdout:7/927: mkdir d7/d12b 0 2024-04-25T02:09:19.448 INFO:tasks.workunit.client.1.smithi112.stdout:4/952: rename d2/d1e/f35 to d2/d12/f138 0 2024-04-25T02:09:19.449 INFO:tasks.workunit.client.1.smithi112.stdout:4/953: chown d2/d17/d20/le9 648771 1 2024-04-25T02:09:19.451 INFO:tasks.workunit.client.1.smithi112.stdout:6/770: creat d0/d2/d2c/f103 x:0 0 0 2024-04-25T02:09:19.452 INFO:tasks.workunit.client.1.smithi112.stdout:6/771: fsync d0/d2/d3b/ffd 0 2024-04-25T02:09:19.457 INFO:tasks.workunit.client.1.smithi112.stdout:3/854: mknod d12/d1f/d27/d44/d73/d95/da5/c11b 0 2024-04-25T02:09:19.460 INFO:tasks.workunit.client.1.smithi112.stdout:6/772: read d0/d2/d1f/fc9 [3590727,79714] 0 2024-04-25T02:09:19.460 INFO:tasks.workunit.client.1.smithi112.stdout:9/810: dwrite d1/d48/d65/d73/daf/d63/deb/d100/d3c/d43/fbf [0,4194304] 0 2024-04-25T02:09:19.460 INFO:tasks.workunit.client.1.smithi112.stdout:6/773: truncate d0/d2/d3b/f40 4641219 0 2024-04-25T02:09:19.460 INFO:tasks.workunit.client.1.smithi112.stdout:1/831: link d7/d9/d1e/de/fbc d7/d9/d4e/d72/d73/de9/d43/f108 0 2024-04-25T02:09:19.465 INFO:tasks.workunit.client.1.smithi112.stdout:5/851: creat d1/d2/d4/f119 x:0 0 0 2024-04-25T02:09:19.465 INFO:tasks.workunit.client.1.smithi112.stdout:5/852: getdents d1/d16/d8f 0 2024-04-25T02:09:19.467 INFO:tasks.workunit.client.1.smithi112.stdout:7/928: symlink d7/d25/d40/db0/l12c 0 2024-04-25T02:09:19.473 INFO:tasks.workunit.client.1.smithi112.stdout:2/878: rename d3/da/dac/dbf/dee/d11d/de1/lf7 to d3/da/dc/d3e/df/d30/l123 0 2024-04-25T02:09:19.476 INFO:tasks.workunit.client.1.smithi112.stdout:3/855: stat d12/d13/d34/cb5 0 2024-04-25T02:09:19.476 INFO:tasks.workunit.client.1.smithi112.stdout:3/856: chown d12/d5d/c77 409732455 1 2024-04-25T02:09:19.479 INFO:tasks.workunit.client.1.smithi112.stdout:7/929: dread d7/d25/d43/f47 [0,4194304] 0 2024-04-25T02:09:19.479 INFO:tasks.workunit.client.1.smithi112.stdout:9/811: mkdir d1/d93/dc2/d116 0 2024-04-25T02:09:19.481 INFO:tasks.workunit.client.1.smithi112.stdout:6/774: symlink d0/d2/d66/d7d/d95/l104 0 2024-04-25T02:09:19.484 INFO:tasks.workunit.client.1.smithi112.stdout:4/954: symlink d2/d1e/l139 0 2024-04-25T02:09:19.484 INFO:tasks.workunit.client.1.smithi112.stdout:4/955: dread - d2/d1e/d5c/f130 zero size 2024-04-25T02:09:19.491 INFO:tasks.workunit.client.1.smithi112.stdout:2/879: symlink d3/da/dc/d20/d40/l124 0 2024-04-25T02:09:19.495 INFO:tasks.workunit.client.1.smithi112.stdout:9/812: creat d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/dfd/f117 x:0 0 0 2024-04-25T02:09:19.498 INFO:tasks.workunit.client.1.smithi112.stdout:9/813: fsync d1/d48/d65/d73/daf/d63/deb/d100/d3c/d43/ff6 0 2024-04-25T02:09:19.498 INFO:tasks.workunit.client.1.smithi112.stdout:6/775: mkdir d0/d61/d105 0 2024-04-25T02:09:19.498 INFO:tasks.workunit.client.1.smithi112.stdout:6/776: chown d0/d2/l69 963498 1 2024-04-25T02:09:19.498 INFO:tasks.workunit.client.1.smithi112.stdout:7/930: dwrite d7/d25/d43/f2a [4194304,4194304] 0 2024-04-25T02:09:19.498 INFO:tasks.workunit.client.1.smithi112.stdout:7/931: fsync d7/dd/da9/f5e 0 2024-04-25T02:09:19.498 INFO:tasks.workunit.client.1.smithi112.stdout:1/832: rename d7/d9/d4e/d72 to d7/d9/d4e/d85/dc1/d109 0 2024-04-25T02:09:19.501 INFO:tasks.workunit.client.1.smithi112.stdout:2/880: creat d3/da/dac/dbf/dee/d107/f125 x:0 0 0 2024-04-25T02:09:19.504 INFO:tasks.workunit.client.1.smithi112.stdout:3/857: getdents d12/d1f/d27/df8/dd2 0 2024-04-25T02:09:19.504 INFO:tasks.workunit.client.1.smithi112.stdout:3/858: truncate d12/d5d/f75 865246 0 2024-04-25T02:09:19.508 INFO:tasks.workunit.client.1.smithi112.stdout:4/956: dwrite d2/d17/f12b [0,4194304] 0 2024-04-25T02:09:19.508 INFO:tasks.workunit.client.1.smithi112.stdout:9/814: creat d1/d48/d65/d73/daf/d63/deb/d100/d3c/f118 x:0 0 0 2024-04-25T02:09:19.509 INFO:tasks.workunit.client.1.smithi112.stdout:9/815: chown d1/lb0 2 1 2024-04-25T02:09:19.509 INFO:tasks.workunit.client.1.smithi112.stdout:9/816: chown d1/d48/d65/d73/daf/d63/deb/d100/d8f/dd2/fd9 64 1 2024-04-25T02:09:19.509 INFO:tasks.workunit.client.1.smithi112.stdout:9/817: chown d1/d13/d41/f66 2598837 1 2024-04-25T02:09:19.509 INFO:tasks.workunit.client.1.smithi112.stdout:9/818: creat d1/d48/f119 x:0 0 0 2024-04-25T02:09:19.509 INFO:tasks.workunit.client.1.smithi112.stdout:1/833: write d7/d9/d1f/f36 [2516823,9615] 0 2024-04-25T02:09:19.510 INFO:tasks.workunit.client.1.smithi112.stdout:6/777: unlink d0/d2/d2c/d41/d77/fa4 0 2024-04-25T02:09:19.515 INFO:tasks.workunit.client.1.smithi112.stdout:7/932: dwrite d7/dd/da9/d74/deb/fe2 [0,4194304] 0 2024-04-25T02:09:19.515 INFO:tasks.workunit.client.1.smithi112.stdout:7/933: chown d7/d25/d40 1681 1 2024-04-25T02:09:19.515 INFO:tasks.workunit.client.1.smithi112.stdout:7/934: creat d7/d79/f12d x:0 0 0 2024-04-25T02:09:19.523 INFO:tasks.workunit.client.1.smithi112.stdout:9/819: creat d1/d48/d65/d73/daf/d63/deb/d100/f11a x:0 0 0 2024-04-25T02:09:19.527 INFO:tasks.workunit.client.1.smithi112.stdout:1/834: symlink d7/d9/d4e/d85/dc1/d109/d73/de9/d32/dc9/l10a 0 2024-04-25T02:09:19.536 INFO:tasks.workunit.client.1.smithi112.stdout:6/778: read d0/d2/d4/d28/f34 [4064586,29291] 0 2024-04-25T02:09:19.537 INFO:tasks.workunit.client.1.smithi112.stdout:6/779: chown d0/d2/d3b/d53/d67/de9 203663 1 2024-04-25T02:09:19.537 INFO:tasks.workunit.client.1.smithi112.stdout:6/780: creat d0/d2/d2c/d41/dce/f106 x:0 0 0 2024-04-25T02:09:19.537 INFO:tasks.workunit.client.1.smithi112.stdout:6/781: creat d0/d2/d1f/f107 x:0 0 0 2024-04-25T02:09:19.537 INFO:tasks.workunit.client.1.smithi112.stdout:6/782: fdatasync d0/d36/fab 0 2024-04-25T02:09:19.537 INFO:tasks.workunit.client.1.smithi112.stdout:6/783: fdatasync d0/d7b/f90 0 2024-04-25T02:09:19.537 INFO:tasks.workunit.client.1.smithi112.stdout:6/784: chown d0/d2/d3b/d53/d67/fd3 343 1 2024-04-25T02:09:19.537 INFO:tasks.workunit.client.1.smithi112.stdout:6/785: write d0/d2/d66/da8/fea [68785,79023] 0 2024-04-25T02:09:19.537 INFO:tasks.workunit.client.1.smithi112.stdout:6/786: fsync d0/d61/d98/db5/ff0 0 2024-04-25T02:09:19.540 INFO:tasks.workunit.client.1.smithi112.stdout:7/935: symlink d7/dd/da9/d7f/l12e 0 2024-04-25T02:09:19.542 INFO:tasks.workunit.client.1.smithi112.stdout:9/820: unlink d1/c88 0 2024-04-25T02:09:19.546 INFO:tasks.workunit.client.1.smithi112.stdout:5/853: rename d1/df5 to d1/d2/d4/d1d/dc9/d11a 0 2024-04-25T02:09:19.549 INFO:tasks.workunit.client.1.smithi112.stdout:9/821: rmdir d1/d48/d65/d73/daf/d63/deb/d100/d8f 39 2024-04-25T02:09:19.552 INFO:tasks.workunit.client.1.smithi112.stdout:3/859: rename d12/d13/d34/d53/fe1 to d12/d1f/daa/dfa/f11c 0 2024-04-25T02:09:19.552 INFO:tasks.workunit.client.1.smithi112.stdout:3/860: stat d12/d13/d34/d78/d91/led 0 2024-04-25T02:09:19.554 INFO:tasks.workunit.client.1.smithi112.stdout:5/854: creat d1/d16/d22/f11b x:0 0 0 2024-04-25T02:09:19.555 INFO:tasks.workunit.client.1.smithi112.stdout:9/822: dread d1/d13/d5b/fc4 [0,4194304] 0 2024-04-25T02:09:19.557 INFO:tasks.workunit.client.1.smithi112.stdout:1/835: rename d7/d9/d4e/d85/dc1/d109/fd9 to d7/d9/d1e/de/d84/f10b 0 2024-04-25T02:09:19.565 INFO:tasks.workunit.client.1.smithi112.stdout:1/836: link d7/d9/d4e/d85/dc1/d109/d73/de9/d3f/cea d7/d4b/c10c 0 2024-04-25T02:09:19.565 INFO:tasks.workunit.client.1.smithi112.stdout:1/837: write d7/d9/d1f/ff1 [828880,103104] 0 2024-04-25T02:09:19.565 INFO:tasks.workunit.client.1.smithi112.stdout:1/838: rename d7/d9/d1e/d40/de2 to d7/d9/d1e/d40/de2/d10d 22 2024-04-25T02:09:19.566 INFO:tasks.workunit.client.1.smithi112.stdout:1/839: rmdir d7/d4b/d94/de5 39 2024-04-25T02:09:19.567 INFO:tasks.workunit.client.1.smithi112.stdout:1/840: mknod d7/d9/d4e/d85/dc1/d109/d73/c10e 0 2024-04-25T02:09:19.568 INFO:tasks.workunit.client.1.smithi112.stdout:9/823: write d1/d48/d65/d73/daf/d63/deb/d100/d3c/f52 [1058057,23195] 0 2024-04-25T02:09:19.568 INFO:tasks.workunit.client.1.smithi112.stdout:6/787: dwrite d0/d2/d4/d28/f5c [0,4194304] 0 2024-04-25T02:09:19.568 INFO:tasks.workunit.client.1.smithi112.stdout:6/788: chown d0/d2/d2c/d41/cdd 2 1 2024-04-25T02:09:19.568 INFO:tasks.workunit.client.1.smithi112.stdout:6/789: fdatasync d0/d2/d2c/d41/f5d 0 2024-04-25T02:09:19.568 INFO:tasks.workunit.client.1.smithi112.stdout:6/790: read d0/d32/dc0/f9d [138275,43312] 0 2024-04-25T02:09:19.568 INFO:tasks.workunit.client.1.smithi112.stdout:6/791: write d0/d2/f82 [1369234,36276] 0 2024-04-25T02:09:19.570 INFO:tasks.workunit.client.1.smithi112.stdout:9/824: symlink d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/ddc/l11b 0 2024-04-25T02:09:19.572 INFO:tasks.workunit.client.1.smithi112.stdout:6/792: truncate d0/d2/d2c/f33 2901532 0 2024-04-25T02:09:19.572 INFO:tasks.workunit.client.1.smithi112.stdout:6/793: chown d0/d2/d2c/d41/d77/f7c 615 1 2024-04-25T02:09:19.573 INFO:tasks.workunit.client.1.smithi112.stdout:7/936: dwrite d7/dd/f26 [0,4194304] 0 2024-04-25T02:09:19.573 INFO:tasks.workunit.client.1.smithi112.stdout:9/825: creat d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/ddc/f11c x:0 0 0 2024-04-25T02:09:19.574 INFO:tasks.workunit.client.1.smithi112.stdout:7/937: symlink d7/ddb/l12f 0 2024-04-25T02:09:19.576 INFO:tasks.workunit.client.1.smithi112.stdout:9/826: mknod d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/dfd/d10b/c11d 0 2024-04-25T02:09:19.576 INFO:tasks.workunit.client.1.smithi112.stdout:9/827: read d1/d13/f47 [1261080,65632] 0 2024-04-25T02:09:19.576 INFO:tasks.workunit.client.1.smithi112.stdout:9/828: write d1/d48/d65/d73/daf/d63/deb/d100/d8f/dd2/fd9 [1161530,89085] 0 2024-04-25T02:09:19.581 INFO:tasks.workunit.client.1.smithi112.stdout:1/841: dread d7/d9/f1b [0,4194304] 0 2024-04-25T02:09:19.582 INFO:tasks.workunit.client.1.smithi112.stdout:5/855: dwrite d1/d2/d4/d1d/dc9/d11a/d5b/d7b/db2/dc0/dcf/ddd/f112 [0,4194304] 0 2024-04-25T02:09:19.583 INFO:tasks.workunit.client.1.smithi112.stdout:1/842: mkdir d7/d4b/d94/de5/def/d10f 0 2024-04-25T02:09:19.585 INFO:tasks.workunit.client.1.smithi112.stdout:9/829: dread d1/d48/d65/d73/daf/d63/deb/d100/d3c/d43/f4a [0,4194304] 0 2024-04-25T02:09:19.585 INFO:tasks.workunit.client.1.smithi112.stdout:3/861: dwrite d12/d5d/f90 [0,4194304] 0 2024-04-25T02:09:19.586 INFO:tasks.workunit.client.1.smithi112.stdout:9/830: creat d1/d93/f11e x:0 0 0 2024-04-25T02:09:19.586 INFO:tasks.workunit.client.1.smithi112.stdout:9/831: creat d1/d48/dbd/f11f x:0 0 0 2024-04-25T02:09:19.586 INFO:tasks.workunit.client.1.smithi112.stdout:9/832: stat d1/d13/d5b/l9c 0 2024-04-25T02:09:19.586 INFO:tasks.workunit.client.1.smithi112.stdout:9/833: fdatasync d1/d13/f47 0 2024-04-25T02:09:19.589 INFO:tasks.workunit.client.1.smithi112.stdout:5/856: mkdir d1/d6c/d11c 0 2024-04-25T02:09:19.589 INFO:tasks.workunit.client.1.smithi112.stdout:1/843: creat d7/d4b/d94/de5/def/f110 x:0 0 0 2024-04-25T02:09:19.591 INFO:tasks.workunit.client.1.smithi112.stdout:7/938: dwrite d7/d79/da2/fc1 [0,4194304] 0 2024-04-25T02:09:19.593 INFO:tasks.workunit.client.1.smithi112.stdout:5/857: creat d1/d2/d4/d1d/dc9/d11a/d5b/f11d x:0 0 0 2024-04-25T02:09:19.594 INFO:tasks.workunit.client.1.smithi112.stdout:1/844: mknod d7/d9/deb/c111 0 2024-04-25T02:09:19.601 INFO:tasks.workunit.client.1.smithi112.stdout:7/939: mkdir d7/dd/d20/db2/d130 0 2024-04-25T02:09:19.601 INFO:tasks.workunit.client.1.smithi112.stdout:7/940: dread - d7/dd/d20/db2/fc3 zero size 2024-04-25T02:09:19.608 INFO:tasks.workunit.client.1.smithi112.stdout:5/858: symlink d1/d2/d4/d1d/dc9/d11a/d5b/d7b/db2/l11e 0 2024-04-25T02:09:19.610 INFO:tasks.workunit.client.1.smithi112.stdout:7/941: mknod d7/d12b/c131 0 2024-04-25T02:09:19.614 INFO:tasks.workunit.client.1.smithi112.stdout:9/834: dwrite d1/d13/d41/fa5 [0,4194304] 0 2024-04-25T02:09:19.614 INFO:tasks.workunit.client.1.smithi112.stdout:9/835: fdatasync d1/d13/d41/fd5 0 2024-04-25T02:09:19.614 INFO:tasks.workunit.client.1.smithi112.stdout:9/836: readlink d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/ddc/l11b 0 2024-04-25T02:09:19.615 INFO:tasks.workunit.client.1.smithi112.stdout:1/845: dwrite d7/d9/d1f/d25/fbb [0,4194304] 0 2024-04-25T02:09:19.616 INFO:tasks.workunit.client.1.smithi112.stdout:1/846: stat d7/d9/deb 0 2024-04-25T02:09:19.622 INFO:tasks.workunit.client.1.smithi112.stdout:5/859: dread d1/d2/d28/d4f/f5d [0,4194304] 0 2024-04-25T02:09:19.630 INFO:tasks.workunit.client.1.smithi112.stdout:6/794: dread d0/d2/d2c/f33 [0,4194304] 0 2024-04-25T02:09:19.631 INFO:tasks.workunit.client.1.smithi112.stdout:1/847: dwrite d7/d9/d1e/de/f3b [4194304,4194304] 0 2024-04-25T02:09:19.631 INFO:tasks.workunit.client.1.smithi112.stdout:1/848: chown d7/d9/d1e/de/d84/fca 0 1 2024-04-25T02:09:19.634 INFO:tasks.workunit.client.1.smithi112.stdout:7/942: unlink d7/d79/da2/fb5 0 2024-04-25T02:09:19.638 INFO:tasks.workunit.client.1.smithi112.stdout:9/837: mkdir d1/d48/d120 0 2024-04-25T02:09:19.638 INFO:tasks.workunit.client.1.smithi112.stdout:9/838: creat d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/dfd/f121 x:0 0 0 2024-04-25T02:09:19.644 INFO:tasks.workunit.client.1.smithi112.stdout:6/795: mknod d0/d2/d66/d7d/dc6/c108 0 2024-04-25T02:09:19.651 INFO:tasks.workunit.client.1.smithi112.stdout:7/943: write d7/dd/f10 [49842,36474] 0 2024-04-25T02:09:19.651 INFO:tasks.workunit.client.1.smithi112.stdout:7/944: write d7/fe8 [1043930,85637] 0 2024-04-25T02:09:19.655 INFO:tasks.workunit.client.1.smithi112.stdout:6/796: write d0/d2/d4/d28/f5c [792949,19931] 0 2024-04-25T02:09:19.655 INFO:tasks.workunit.client.1.smithi112.stdout:6/797: fsync d0/d2/da1/fcc 0 2024-04-25T02:09:19.656 INFO:tasks.workunit.client.1.smithi112.stdout:5/860: dwrite d1/d2/f31 [0,4194304] 0 2024-04-25T02:09:19.656 INFO:tasks.workunit.client.1.smithi112.stdout:1/849: dwrite d7/f4d [0,4194304] 0 2024-04-25T02:09:19.657 INFO:tasks.workunit.client.1.smithi112.stdout:6/798: mknod d0/d61/d98/c109 0 2024-04-25T02:09:19.660 INFO:tasks.workunit.client.1.smithi112.stdout:9/839: dwrite d1/d13/fd6 [0,4194304] 0 2024-04-25T02:09:19.660 INFO:tasks.workunit.client.1.smithi112.stdout:9/840: chown d1/d13/d41/d84/c108 245839912 1 2024-04-25T02:09:19.662 INFO:tasks.workunit.client.1.smithi112.stdout:1/850: creat d7/f112 x:0 0 0 2024-04-25T02:09:19.665 INFO:tasks.workunit.client.1.smithi112.stdout:6/799: symlink d0/d2/d66/d7d/d95/de8/l10a 0 2024-04-25T02:09:19.669 INFO:tasks.workunit.client.1.smithi112.stdout:7/945: dwrite d7/f13 [4194304,4194304] 0 2024-04-25T02:09:19.676 INFO:tasks.workunit.client.1.smithi112.stdout:1/851: unlink d7/d9/d1f/ff1 0 2024-04-25T02:09:19.679 INFO:tasks.workunit.client.1.smithi112.stdout:6/800: mkdir d0/d61/d98/db5/dfc/d10b 0 2024-04-25T02:09:19.682 INFO:tasks.workunit.client.1.smithi112.stdout:5/861: rename d1/d2/d4 to d1/d16/d51/d93/d11f 0 2024-04-25T02:09:19.690 INFO:tasks.workunit.client.1.smithi112.stdout:1/852: rename d7/d4b/d7b/d7f to d7/d9/d4e/d85/dc1/d109/d113 0 2024-04-25T02:09:19.690 INFO:tasks.workunit.client.1.smithi112.stdout:5/862: dread d1/d16/d8f/fbd [0,4194304] 0 2024-04-25T02:09:19.690 INFO:tasks.workunit.client.1.smithi112.stdout:5/863: read d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d96/fb0 [2077905,35000] 0 2024-04-25T02:09:19.693 INFO:tasks.workunit.client.1.smithi112.stdout:7/946: getdents d7/d25/d43/dca 0 2024-04-25T02:09:19.698 INFO:tasks.workunit.client.1.smithi112.stdout:1/853: write d7/d9/d4e/f6d [687069,45827] 0 2024-04-25T02:09:19.698 INFO:tasks.workunit.client.1.smithi112.stdout:1/854: stat d7/d9/d4e/d85 0 2024-04-25T02:09:19.699 INFO:tasks.workunit.client.1.smithi112.stdout:1/855: getdents d7/d4b/d94 0 2024-04-25T02:09:19.701 INFO:tasks.workunit.client.1.smithi112.stdout:6/801: dwrite d0/d2/d3b/f6f [0,4194304] 0 2024-04-25T02:09:19.701 INFO:tasks.workunit.client.1.smithi112.stdout:6/802: readlink d0/d2/d3b/d53/lae 0 2024-04-25T02:09:19.706 INFO:tasks.workunit.client.1.smithi112.stdout:1/856: creat d7/d9/d1e/de/d9a/de8/f114 x:0 0 0 2024-04-25T02:09:19.706 INFO:tasks.workunit.client.1.smithi112.stdout:7/947: dread d7/d25/d40/d6b/ffd [0,4194304] 0 2024-04-25T02:09:19.706 INFO:tasks.workunit.client.1.smithi112.stdout:7/948: write d7/d25/ff4 [2054201,105826] 0 2024-04-25T02:09:19.707 INFO:tasks.workunit.client.1.smithi112.stdout:1/857: unlink d7/d9/fd6 0 2024-04-25T02:09:19.707 INFO:tasks.workunit.client.1.smithi112.stdout:1/858: chown d7/db0 72417348 1 2024-04-25T02:09:19.707 INFO:tasks.workunit.client.1.smithi112.stdout:1/859: fdatasync d7/d9/d1e/de/fe1 0 2024-04-25T02:09:19.709 INFO:tasks.workunit.client.1.smithi112.stdout:7/949: write d7/d25/d40/d6b/f84 [1469169,99970] 0 2024-04-25T02:09:19.710 INFO:tasks.workunit.client.1.smithi112.stdout:7/950: readlink d7/d25/d43/l31 0 2024-04-25T02:09:19.710 INFO:tasks.workunit.client.1.smithi112.stdout:1/860: rmdir d7/d9/deb 39 2024-04-25T02:09:19.713 INFO:tasks.workunit.client.1.smithi112.stdout:5/864: dwrite d1/d2/f36 [0,4194304] 0 2024-04-25T02:09:19.715 INFO:tasks.workunit.client.1.smithi112.stdout:1/861: rename d7/d9/d4e/d85/dc1/d109/d73/de9/lb8 to d7/d9/d1f/d25/l115 0 2024-04-25T02:09:19.719 INFO:tasks.workunit.client.1.smithi112.stdout:1/862: mkdir d7/d9/d4e/d85/dc1/d109/d73/de9/d32/d116 0 2024-04-25T02:09:19.722 INFO:tasks.workunit.client.1.smithi112.stdout:1/863: rename d7/d9/d46/ffd to d7/d9/f117 0 2024-04-25T02:09:19.725 INFO:tasks.workunit.client.1.smithi112.stdout:1/864: write d7/d9/d4e/d85/dc1/d109/d73/de9/d43/f108 [1730979,6375] 0 2024-04-25T02:09:19.727 INFO:tasks.workunit.client.1.smithi112.stdout:1/865: rename d7/d9/d1f/d25/d39/f96 to d7/d9/d4e/d85/dc1/d109/d73/de9/dc7/f118 0 2024-04-25T02:09:19.729 INFO:tasks.workunit.client.1.smithi112.stdout:1/866: mknod d7/d9/d51/c119 0 2024-04-25T02:09:19.729 INFO:tasks.workunit.client.1.smithi112.stdout:1/867: chown d7/d9/d4e/d85/dc1/d109/d73/de9/d43/c8b 7420239 1 2024-04-25T02:09:19.731 INFO:tasks.workunit.client.1.smithi112.stdout:1/868: link d7/d9/d1e/de/c9b d7/d9/d1f/c11a 0 2024-04-25T02:09:19.732 INFO:tasks.workunit.client.1.smithi112.stdout:1/869: mknod d7/d9/d4e/d85/dc1/d109/d113/c11b 0 2024-04-25T02:09:19.732 INFO:tasks.workunit.client.1.smithi112.stdout:1/870: write d7/d9/d1e/fb5 [13980,79738] 0 2024-04-25T02:09:19.734 INFO:tasks.workunit.client.1.smithi112.stdout:1/871: rmdir d7/d9/d1e/d40/de2 39 2024-04-25T02:09:19.737 INFO:tasks.workunit.client.1.smithi112.stdout:6/803: dwrite d0/d2/d2c/f103 [0,4194304] 0 2024-04-25T02:09:19.737 INFO:tasks.workunit.client.1.smithi112.stdout:6/804: fdatasync d0/d2/d66/fe3 0 2024-04-25T02:09:19.741 INFO:tasks.workunit.client.1.smithi112.stdout:6/805: mknod d0/d2/d3b/d53/c10c 0 2024-04-25T02:09:19.743 INFO:tasks.workunit.client.1.smithi112.stdout:7/951: dwrite d7/d79/da2/fad [0,4194304] 0 2024-04-25T02:09:19.743 INFO:tasks.workunit.client.1.smithi112.stdout:7/952: chown d7/d25/d40/da3/fff 544442 1 2024-04-25T02:09:19.743 INFO:tasks.workunit.client.1.smithi112.stdout:7/953: write d7/dd/de5/f105 [405628,109187] 0 2024-04-25T02:09:19.744 INFO:tasks.workunit.client.1.smithi112.stdout:5/865: dwrite d1/fa2 [0,4194304] 0 2024-04-25T02:09:19.745 INFO:tasks.workunit.client.1.smithi112.stdout:6/806: mkdir d0/d7b/dff/d10d 0 2024-04-25T02:09:19.745 INFO:tasks.workunit.client.1.smithi112.stdout:6/807: write d0/d2/d2c/d41/d77/f8a [2007340,14192] 0 2024-04-25T02:09:19.748 INFO:tasks.workunit.client.1.smithi112.stdout:1/872: dread d7/d4b/f69 [0,4194304] 0 2024-04-25T02:09:19.749 INFO:tasks.workunit.client.1.smithi112.stdout:6/808: dread d0/d2/d66/da8/fc8 [0,4194304] 0 2024-04-25T02:09:19.749 INFO:tasks.workunit.client.1.smithi112.stdout:7/954: dread d7/d25/d43/d46/f42 [0,4194304] 0 2024-04-25T02:09:19.749 INFO:tasks.workunit.client.1.smithi112.stdout:6/809: fsync d0/d32/ff3 0 2024-04-25T02:09:19.750 INFO:tasks.workunit.client.1.smithi112.stdout:6/810: dread d0/d2/d66/fe3 [0,4194304] 0 2024-04-25T02:09:19.769 INFO:tasks.workunit.client.1.smithi112.stdout:7/955: rename d7/d25/d43/d46/f68 to d7/dd/da9/f132 0 2024-04-25T02:09:19.769 INFO:tasks.workunit.client.1.smithi112.stdout:6/811: mknod d0/d61/d98/db5/c10e 0 2024-04-25T02:09:19.772 INFO:tasks.workunit.client.1.smithi112.stdout:1/873: write d7/d4b/fa4 [497693,48873] 0 2024-04-25T02:09:19.772 INFO:tasks.workunit.client.1.smithi112.stdout:5/866: dwrite d1/d16/d51/d93/d11f/d1d/f25 [0,4194304] 0 2024-04-25T02:09:19.774 INFO:tasks.workunit.client.1.smithi112.stdout:7/956: symlink d7/dd/da9/dfb/l133 0 2024-04-25T02:09:19.774 INFO:tasks.workunit.client.1.smithi112.stdout:7/957: fsync d7/d25/d43/fa7 0 2024-04-25T02:09:19.774 INFO:tasks.workunit.client.1.smithi112.stdout:7/958: chown d7/cc7 78570 1 2024-04-25T02:09:19.774 INFO:tasks.workunit.client.1.smithi112.stdout:7/959: chown d7/d25/d40/d6b/dcf 14 1 2024-04-25T02:09:19.776 INFO:tasks.workunit.client.1.smithi112.stdout:5/867: creat d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d79/d7a/da0/f120 x:0 0 0 2024-04-25T02:09:19.776 INFO:tasks.workunit.client.1.smithi112.stdout:5/868: fdatasync d1/d16/d22/f4e 0 2024-04-25T02:09:19.777 INFO:tasks.workunit.client.1.smithi112.stdout:7/960: truncate d7/d25/d40/db0/fd5 619525 0 2024-04-25T02:09:19.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:19 smithi112 ceph-mon[33313]: Deploying cephadm binary to smithi112 2024-04-25T02:09:19.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:19 smithi112 ceph-mon[33313]: pgmap v3: 65 pgs: 65 active+clean; 2.5 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail 2024-04-25T02:09:19.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:19 smithi112 ceph-mon[33313]: [25/Apr/2024:02:09:18] ENGINE Bus STARTING 2024-04-25T02:09:19.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:19 smithi112 ceph-mon[33313]: [25/Apr/2024:02:09:18] ENGINE Serving on http://172.21.15.112:8765 2024-04-25T02:09:19.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:19 smithi112 ceph-mon[33313]: [25/Apr/2024:02:09:19] ENGINE Serving on https://172.21.15.112:7150 2024-04-25T02:09:19.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:19 smithi112 ceph-mon[33313]: [25/Apr/2024:02:09:19] ENGINE Bus STARTED 2024-04-25T02:09:19.780 INFO:tasks.workunit.client.1.smithi112.stdout:5/869: rename d1/d2/d78/c102 to d1/d16/d8f/c121 0 2024-04-25T02:09:19.781 INFO:tasks.workunit.client.1.smithi112.stdout:7/961: creat d7/dd/d20/db2/d130/f134 x:0 0 0 2024-04-25T02:09:19.781 INFO:tasks.workunit.client.1.smithi112.stdout:1/874: dread d7/d9/d1e/de/f3b [4194304,4194304] 0 2024-04-25T02:09:19.782 INFO:tasks.workunit.client.1.smithi112.stdout:5/870: creat d1/d16/d51/d93/d11f/dc4/d9c/f122 x:0 0 0 2024-04-25T02:09:19.784 INFO:tasks.workunit.client.1.smithi112.stdout:7/962: creat d7/dd/d20/db2/ddd/f135 x:0 0 0 2024-04-25T02:09:19.785 INFO:tasks.workunit.client.1.smithi112.stdout:7/963: rename d7/d25/d40/d6b/c73 to d7/dd/d88/c136 0 2024-04-25T02:09:19.788 INFO:tasks.workunit.client.1.smithi112.stdout:6/812: dwrite d0/d2/d2c/ff5 [0,4194304] 0 2024-04-25T02:09:19.788 INFO:tasks.workunit.client.1.smithi112.stdout:6/813: truncate d0/d2/d66/da8/fc8 1223566 0 2024-04-25T02:09:19.793 INFO:tasks.workunit.client.1.smithi112.stdout:6/814: creat d0/d61/db0/f10f x:0 0 0 2024-04-25T02:09:19.794 INFO:tasks.workunit.client.1.smithi112.stdout:1/875: dread d7/d9/d1e/d40/f105 [0,4194304] 0 2024-04-25T02:09:19.800 INFO:tasks.workunit.client.1.smithi112.stdout:1/876: read d7/d9/d1e/de/d84/f9f [7687251,109172] 0 2024-04-25T02:09:19.800 INFO:tasks.workunit.client.1.smithi112.stdout:1/877: chown d7/d9/d46/l9e 18604304 1 2024-04-25T02:09:19.802 INFO:tasks.workunit.client.1.smithi112.stdout:1/878: mkdir d7/d9/d1e/de/d9a/de8/d11c 0 2024-04-25T02:09:19.806 INFO:tasks.workunit.client.1.smithi112.stdout:1/879: rename d7/d9/d4e/d85/dc1/d109/d73/de9/d32/dc9 to d7/d9/d1e/d40/de2/de6/d11d 0 2024-04-25T02:09:19.806 INFO:tasks.workunit.client.1.smithi112.stdout:1/880: dread - d7/f112 zero size 2024-04-25T02:09:19.808 INFO:tasks.workunit.client.1.smithi112.stdout:1/881: creat d7/d9/d51/d83/f11e x:0 0 0 2024-04-25T02:09:19.811 INFO:tasks.workunit.client.1.smithi112.stdout:1/882: rename d7/d9/d4e/d85/dc1/d109/d73/de9/ff7 to d7/d9/d51/d58/f11f 0 2024-04-25T02:09:19.813 INFO:tasks.workunit.client.1.smithi112.stdout:1/883: rename d7/d9/d1e/de/fe1 to d7/d9/d1e/d66/f120 0 2024-04-25T02:09:19.815 INFO:tasks.workunit.client.1.smithi112.stdout:1/884: link d7/d4b/d94/de5/cf0 d7/d9/d1e/de/d84/c121 0 2024-04-25T02:09:19.815 INFO:tasks.workunit.client.1.smithi112.stdout:1/885: fdatasync d7/d9/d4e/d85/dc1/d109/d73/fd3 0 2024-04-25T02:09:19.816 INFO:tasks.workunit.client.1.smithi112.stdout:1/886: write d7/d4b/fac [550914,56414] 0 2024-04-25T02:09:19.816 INFO:tasks.workunit.client.1.smithi112.stdout:1/887: fdatasync d7/d9/d1f/d25/f77 0 2024-04-25T02:09:19.816 INFO:tasks.workunit.client.1.smithi112.stdout:2/881: sync 2024-04-25T02:09:19.816 INFO:tasks.workunit.client.1.smithi112.stdout:6/815: dwrite d0/d2/d66/fa3 [0,4194304] 0 2024-04-25T02:09:19.816 INFO:tasks.workunit.client.1.smithi112.stdout:7/964: dwrite d7/dd/d20/f112 [0,4194304] 0 2024-04-25T02:09:19.817 INFO:tasks.workunit.client.1.smithi112.stdout:2/882: mkdir d3/da/dc/d3e/df/d126 0 2024-04-25T02:09:19.820 INFO:tasks.workunit.client.1.smithi112.stdout:1/888: link d7/d9/d1f/d25/d39/c93 d7/d9/d51/d83/c122 0 2024-04-25T02:09:19.820 INFO:tasks.workunit.client.1.smithi112.stdout:1/889: write d7/f112 [368758,97819] 0 2024-04-25T02:09:19.827 INFO:tasks.workunit.client.1.smithi112.stdout:6/816: truncate d0/d2/d2c/d41/f5d 516031 0 2024-04-25T02:09:19.828 INFO:tasks.workunit.client.1.smithi112.stdout:7/965: dread d7/dd/d20/f112 [0,4194304] 0 2024-04-25T02:09:19.828 INFO:tasks.workunit.client.1.smithi112.stdout:7/966: chown d7/d25/d40/d51/d77/lcc 150112 1 2024-04-25T02:09:19.829 INFO:tasks.workunit.client.1.smithi112.stdout:6/817: mkdir d0/d61/d98/db5/dfc/d110 0 2024-04-25T02:09:19.829 INFO:tasks.workunit.client.1.smithi112.stdout:6/818: chown d0/d2/d4/d28/lc7 757685127 1 2024-04-25T02:09:19.834 INFO:tasks.workunit.client.1.smithi112.stdout:6/819: mknod d0/c111 0 2024-04-25T02:09:19.841 INFO:tasks.workunit.client.1.smithi112.stdout:7/967: rmdir d7/d79 39 2024-04-25T02:09:19.843 INFO:tasks.workunit.client.1.smithi112.stdout:6/820: getdents d0/d2/d66 0 2024-04-25T02:09:19.845 INFO:tasks.workunit.client.1.smithi112.stdout:7/968: mkdir d7/d137 0 2024-04-25T02:09:19.847 INFO:tasks.workunit.client.1.smithi112.stdout:6/821: mkdir d0/d61/d98/d112 0 2024-04-25T02:09:19.850 INFO:tasks.workunit.client.1.smithi112.stdout:7/969: dread d7/d25/d40/db0/fd5 [0,4194304] 0 2024-04-25T02:09:19.850 INFO:tasks.workunit.client.1.smithi112.stdout:7/970: chown d7/dd/da9/d74/deb/fe2 6706 1 2024-04-25T02:09:19.851 INFO:tasks.workunit.client.1.smithi112.stdout:6/822: link d0/d2/d66/fa3 d0/d2/d2c/d41/f113 0 2024-04-25T02:09:19.869 INFO:tasks.workunit.client.1.smithi112.stdout:6/823: dwrite d0/d2/fba [0,4194304] 0 2024-04-25T02:09:19.869 INFO:tasks.workunit.client.1.smithi112.stdout:6/824: fdatasync d0/d2/fba 0 2024-04-25T02:09:19.872 INFO:tasks.workunit.client.1.smithi112.stdout:6/825: mkdir d0/d32/dc0/d114 0 2024-04-25T02:09:19.872 INFO:tasks.workunit.client.1.smithi112.stdout:6/826: dread - d0/d2/d4/d28/fe5 zero size 2024-04-25T02:09:19.873 INFO:tasks.workunit.client.1.smithi112.stdout:6/827: dread - d0/d2/d4/d28/fe5 zero size 2024-04-25T02:09:19.880 INFO:tasks.workunit.client.1.smithi112.stdout:6/828: dread d0/d2/d4/dd/f3d [0,4194304] 0 2024-04-25T02:09:19.922 INFO:tasks.workunit.client.1.smithi112.stdout:2/883: dwrite d3/da/dc/d20/d43/dcf/ffa [0,4194304] 0 2024-04-25T02:09:19.928 INFO:tasks.workunit.client.1.smithi112.stdout:2/884: unlink d3/l83 0 2024-04-25T02:09:19.935 INFO:tasks.workunit.client.1.smithi112.stdout:2/885: getdents d3/da/dac/dbf/dee/d107 0 2024-04-25T02:09:19.935 INFO:tasks.workunit.client.1.smithi112.stdout:2/886: chown d3/da/dc/d20/d85/dba/f114 2574 1 2024-04-25T02:09:19.940 INFO:tasks.workunit.client.1.smithi112.stdout:6/829: dwrite d0/d2/d79/d81/fd2 [0,4194304] 0 2024-04-25T02:09:19.940 INFO:tasks.workunit.client.1.smithi112.stdout:6/830: chown d0/d2/d4/d28/ce1 29364 1 2024-04-25T02:09:19.941 INFO:tasks.workunit.client.1.smithi112.stdout:7/971: dwrite d7/d79/da2/d3a/f107 [0,4194304] 0 2024-04-25T02:09:19.941 INFO:tasks.workunit.client.1.smithi112.stdout:7/972: fdatasync d7/dd/d20/db2/ddd/fe4 0 2024-04-25T02:09:19.941 INFO:tasks.workunit.client.1.smithi112.stdout:2/887: truncate d3/da/dc/fb9 1514820 0 2024-04-25T02:09:19.948 INFO:tasks.workunit.client.1.smithi112.stdout:7/973: link d7/d25/f85 d7/d25/d43/dca/f138 0 2024-04-25T02:09:19.950 INFO:tasks.workunit.client.1.smithi112.stdout:2/888: rename d3/da/dc/d20/d43/dcf to d3/d108/d127 0 2024-04-25T02:09:19.951 INFO:tasks.workunit.client.1.smithi112.stdout:6/831: dread d0/d2/d66/fa3 [0,4194304] 0 2024-04-25T02:09:19.952 INFO:tasks.workunit.client.1.smithi112.stdout:6/832: fdatasync d0/d32/d45/ff1 0 2024-04-25T02:09:19.977 INFO:tasks.workunit.client.1.smithi112.stdout:2/889: dwrite d3/da/dc/d3e/df/d30/d7c/faa [0,4194304] 0 2024-04-25T02:09:19.978 INFO:tasks.workunit.client.1.smithi112.stdout:7/974: dwrite d7/dd/f10e [0,4194304] 0 2024-04-25T02:09:19.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:19 smithi077 ceph-mon[26330]: Deploying cephadm binary to smithi112 2024-04-25T02:09:19.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:19 smithi077 ceph-mon[26330]: pgmap v3: 65 pgs: 65 active+clean; 2.5 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail 2024-04-25T02:09:19.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:19 smithi077 ceph-mon[26330]: [25/Apr/2024:02:09:18] ENGINE Bus STARTING 2024-04-25T02:09:19.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:19 smithi077 ceph-mon[26330]: [25/Apr/2024:02:09:18] ENGINE Serving on http://172.21.15.112:8765 2024-04-25T02:09:19.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:19 smithi077 ceph-mon[26330]: [25/Apr/2024:02:09:19] ENGINE Serving on https://172.21.15.112:7150 2024-04-25T02:09:19.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:19 smithi077 ceph-mon[26330]: [25/Apr/2024:02:09:19] ENGINE Bus STARTED 2024-04-25T02:09:19.989 INFO:tasks.workunit.client.1.smithi112.stdout:7/975: dread d7/dd/f1c [0,4194304] 0 2024-04-25T02:09:19.989 INFO:tasks.workunit.client.1.smithi112.stdout:7/976: fsync d7/dd/da9/d74/deb/f11f 0 2024-04-25T02:09:19.990 INFO:tasks.workunit.client.1.smithi112.stdout:7/977: symlink d7/dd/d88/db6/l139 0 2024-04-25T02:09:19.992 INFO:tasks.workunit.client.1.smithi112.stdout:2/890: dwrite d3/da/dc/d20/fc7 [0,4194304] 0 2024-04-25T02:09:19.994 INFO:tasks.workunit.client.1.smithi112.stdout:2/891: creat d3/da/dac/dbf/dee/d107/f128 x:0 0 0 2024-04-25T02:09:19.998 INFO:tasks.workunit.client.1.smithi112.stdout:2/892: link d3/da/dc/d20/ffb d3/da/dac/dbf/dee/d11d/d10e/f129 0 2024-04-25T02:09:19.998 INFO:tasks.workunit.client.1.smithi112.stdout:2/893: chown d3/da/dc/d20/d43/d74/c103 6 1 2024-04-25T02:09:19.998 INFO:tasks.workunit.client.1.smithi112.stdout:3/862: sync 2024-04-25T02:09:19.999 INFO:tasks.workunit.client.1.smithi112.stdout:4/957: sync 2024-04-25T02:09:19.999 INFO:tasks.workunit.client.1.smithi112.stdout:9/841: sync 2024-04-25T02:09:19.999 INFO:tasks.workunit.client.1.smithi112.stdout:4/958: dread - d2/d1e/d1b/d67/f11c zero size 2024-04-25T02:09:19.999 INFO:tasks.workunit.client.1.smithi112.stdout:7/978: rename d7/dd/de5 to d7/d79/da2/d13a 0 2024-04-25T02:09:20.001 INFO:tasks.workunit.client.1.smithi112.stdout:2/894: unlink d3/da/dc/d3e/c75 0 2024-04-25T02:09:20.002 INFO:tasks.workunit.client.1.smithi112.stdout:9/842: rename d1/l42 to d1/d13/d41/dc1/l122 0 2024-04-25T02:09:20.003 INFO:tasks.workunit.client.1.smithi112.stdout:7/979: symlink d7/d25/d40/db0/d10f/l13b 0 2024-04-25T02:09:20.003 INFO:tasks.workunit.client.1.smithi112.stdout:2/895: stat d3/da/dc/d20/d43/lc9 0 2024-04-25T02:09:20.006 INFO:tasks.workunit.client.1.smithi112.stdout:9/843: creat d1/d93/dc2/f123 x:0 0 0 2024-04-25T02:09:20.006 INFO:tasks.workunit.client.1.smithi112.stdout:7/980: truncate d7/dd/f18 244349 0 2024-04-25T02:09:20.008 INFO:tasks.workunit.client.1.smithi112.stdout:2/896: truncate d3/da/dc/d3e/df/d30/d7c/d96/fb8 1099126 0 2024-04-25T02:09:20.008 INFO:tasks.workunit.client.1.smithi112.stdout:2/897: fdatasync d3/da/dc/d3e/df/d30/f10f 0 2024-04-25T02:09:20.011 INFO:tasks.workunit.client.1.smithi112.stdout:9/844: link d1/d48/d65/d73/daf/d63/deb/d100/f23 d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/dfd/d10b/f124 0 2024-04-25T02:09:20.015 INFO:tasks.workunit.client.1.smithi112.stdout:7/981: symlink d7/d25/d43/dbc/l13c 0 2024-04-25T02:09:20.020 INFO:tasks.workunit.client.1.smithi112.stdout:2/898: truncate d3/f9d 649092 0 2024-04-25T02:09:20.021 INFO:tasks.workunit.client.1.smithi112.stdout:7/982: dread d7/d25/d43/d46/f82 [0,4194304] 0 2024-04-25T02:09:20.021 INFO:tasks.workunit.client.1.smithi112.stdout:3/863: dwrite d12/d1f/d27/d44/d73/d95/da5/d105/f110 [0,4194304] 0 2024-04-25T02:09:20.027 INFO:tasks.workunit.client.1.smithi112.stdout:7/983: link d7/d25/d43/d46/f8e d7/d25/d43/dca/f13d 0 2024-04-25T02:09:20.028 INFO:tasks.workunit.client.1.smithi112.stdout:9/845: dwrite d1/d48/f119 [0,4194304] 0 2024-04-25T02:09:20.035 INFO:tasks.workunit.client.1.smithi112.stdout:2/899: rename d3/da/dc/d20/d85 to d3/da/dc/d3e/df/d30/d7c/d96/d12a 0 2024-04-25T02:09:20.038 INFO:tasks.workunit.client.1.smithi112.stdout:7/984: symlink d7/dd/l13e 0 2024-04-25T02:09:20.044 INFO:tasks.workunit.client.1.smithi112.stdout:9/846: link d1/d13/d41/d84/c108 d1/d48/d65/d73/daf/d63/deb/d100/d3c/d43/d10a/c125 0 2024-04-25T02:09:20.045 INFO:tasks.workunit.client.1.smithi112.stdout:3/864: rename d12/d5d/cb8 to d12/d13/d34/d4a/d87/c11d 0 2024-04-25T02:09:20.046 INFO:tasks.workunit.client.1.smithi112.stdout:2/900: symlink d3/da/dc/d3e/df/d30/d7c/d96/d12a/dba/l12b 0 2024-04-25T02:09:20.048 INFO:tasks.workunit.client.1.smithi112.stdout:7/985: getdents d7/d79/da2 0 2024-04-25T02:09:20.050 INFO:tasks.workunit.client.1.smithi112.stdout:9/847: rmdir d1/d48/d65/d73/daf/d63/deb/d100/d3c/d43 39 2024-04-25T02:09:20.051 INFO:tasks.workunit.client.1.smithi112.stdout:9/848: readlink d1/d48/d65/lb2 0 2024-04-25T02:09:20.053 INFO:tasks.workunit.client.1.smithi112.stdout:3/865: rmdir d12/d13/d34/d78/d117 0 2024-04-25T02:09:20.054 INFO:tasks.workunit.client.1.smithi112.stdout:7/986: creat d7/d25/d40/db0/d10f/f13f x:0 0 0 2024-04-25T02:09:20.057 INFO:tasks.workunit.client.1.smithi112.stdout:9/849: symlink d1/d48/d65/d73/daf/d8e/l126 0 2024-04-25T02:09:20.058 INFO:tasks.workunit.client.1.smithi112.stdout:9/850: truncate d1/d48/ffb 806558 0 2024-04-25T02:09:20.059 INFO:tasks.workunit.client.1.smithi112.stdout:2/901: write d3/da/f2c [2334194,41758] 0 2024-04-25T02:09:20.059 INFO:tasks.workunit.client.1.smithi112.stdout:2/902: write d3/da/dc/d3e/df/d30/d7c/d96/d12a/dba/f114 [90995,121702] 0 2024-04-25T02:09:20.059 INFO:tasks.workunit.client.1.smithi112.stdout:2/903: stat d3/da/dc/d20/d43/d7e/da3/dde 0 2024-04-25T02:09:20.062 INFO:tasks.workunit.client.1.smithi112.stdout:3/866: rename d12/d1f/d27/d44/fe4 to d12/f11e 0 2024-04-25T02:09:20.069 INFO:tasks.workunit.client.1.smithi112.stdout:7/987: rename d7/dd/l13e to d7/d25/d43/dbc/l140 0 2024-04-25T02:09:20.072 INFO:tasks.workunit.client.1.smithi112.stdout:3/867: truncate d12/d1f/f79 698752 0 2024-04-25T02:09:20.073 INFO:tasks.workunit.client.1.smithi112.stdout:9/851: getdents d1/d13/d41/dc1 0 2024-04-25T02:09:20.074 INFO:tasks.workunit.client.1.smithi112.stdout:3/868: write d12/d13/d34/f48 [562661,81389] 0 2024-04-25T02:09:20.074 INFO:tasks.workunit.client.1.smithi112.stdout:3/869: fdatasync d12/d1f/daa/dfa/f11c 0 2024-04-25T02:09:20.076 INFO:tasks.workunit.client.1.smithi112.stdout:9/852: creat d1/d13/d41/dc1/f127 x:0 0 0 2024-04-25T02:09:20.076 INFO:tasks.workunit.client.1.smithi112.stdout:9/853: chown d1/d48/d65/d73/daf/d63/deb/c112 188771747 1 2024-04-25T02:09:20.076 INFO:tasks.workunit.client.1.smithi112.stdout:9/854: creat d1/d48/d65/d73/f128 x:0 0 0 2024-04-25T02:09:20.076 INFO:tasks.workunit.client.1.smithi112.stdout:9/855: dread - d1/d13/d41/f102 zero size 2024-04-25T02:09:20.079 INFO:tasks.workunit.client.1.smithi112.stdout:9/856: creat d1/d48/d65/d73/daf/d63/deb/f129 x:0 0 0 2024-04-25T02:09:20.080 INFO:tasks.workunit.client.1.smithi112.stdout:9/857: symlink d1/d48/d65/d73/daf/d63/deb/d100/d3c/d43/d10a/l12a 0 2024-04-25T02:09:20.081 INFO:tasks.workunit.client.1.smithi112.stdout:3/870: dread d12/d5d/fc2 [0,4194304] 0 2024-04-25T02:09:20.081 INFO:tasks.workunit.client.1.smithi112.stdout:3/871: write d12/d13/d34/d4a/fc9 [159069,19085] 0 2024-04-25T02:09:20.082 INFO:tasks.workunit.client.1.smithi112.stdout:3/872: creat d12/d13/d34/d4a/d4f/d7d/f11f x:0 0 0 2024-04-25T02:09:20.088 INFO:tasks.workunit.client.1.smithi112.stdout:9/858: dread d1/d13/f20 [0,4194304] 0 2024-04-25T02:09:20.089 INFO:tasks.workunit.client.1.smithi112.stdout:9/859: mkdir d1/d48/d65/d73/daf/d63/deb/d12b 0 2024-04-25T02:09:20.089 INFO:tasks.workunit.client.1.smithi112.stdout:9/860: mkdir d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/dfd/d12c 0 2024-04-25T02:09:20.090 INFO:tasks.workunit.client.1.smithi112.stdout:7/988: dwrite d7/f1e [0,4194304] 0 2024-04-25T02:09:20.091 INFO:tasks.workunit.client.1.smithi112.stdout:9/861: mkdir d1/d48/d65/d73/daf/d63/deb/d12d 0 2024-04-25T02:09:20.091 INFO:tasks.workunit.client.1.smithi112.stdout:9/862: readlink d1/d13/d5b/lae 0 2024-04-25T02:09:20.091 INFO:tasks.workunit.client.1.smithi112.stdout:9/863: fsync d1/d13/f37 0 2024-04-25T02:09:20.091 INFO:tasks.workunit.client.1.smithi112.stdout:9/864: write d1/d48/d65/d73/daf/d63/deb/d100/d8f/dd2/fd4 [788619,37712] 0 2024-04-25T02:09:20.091 INFO:tasks.workunit.client.1.smithi112.stdout:9/865: creat d1/d48/d65/d73/daf/d63/deb/f12e x:0 0 0 2024-04-25T02:09:20.092 INFO:tasks.workunit.client.1.smithi112.stdout:7/989: symlink d7/d25/d43/l141 0 2024-04-25T02:09:20.094 INFO:tasks.workunit.client.1.smithi112.stdout:9/866: mknod d1/d48/d65/d73/c12f 0 2024-04-25T02:09:20.095 INFO:tasks.workunit.client.1.smithi112.stdout:9/867: creat d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/dfd/f130 x:0 0 0 2024-04-25T02:09:20.096 INFO:tasks.workunit.client.1.smithi112.stdout:7/990: mkdir d7/dd/d20/d142 0 2024-04-25T02:09:20.099 INFO:tasks.workunit.client.1.smithi112.stdout:7/991: mknod d7/d79/c143 0 2024-04-25T02:09:20.100 INFO:tasks.workunit.client.1.smithi112.stdout:7/992: creat d7/d25/d40/d6b/f144 x:0 0 0 2024-04-25T02:09:20.100 INFO:tasks.workunit.client.1.smithi112.stdout:7/993: write d7/d25/ff4 [2718540,80154] 0 2024-04-25T02:09:20.100 INFO:tasks.workunit.client.1.smithi112.stdout:7/994: stat d7/d25/d40/f104 0 2024-04-25T02:09:20.100 INFO:tasks.workunit.client.1.smithi112.stdout:7/995: chown d7/dd/d20/d2c/ff6 135630104 1 2024-04-25T02:09:20.101 INFO:tasks.workunit.client.1.smithi112.stdout:7/996: mknod d7/d137/c145 0 2024-04-25T02:09:20.102 INFO:tasks.workunit.client.1.smithi112.stdout:7/997: rename d7/f16 to d7/d79/dda/f146 0 2024-04-25T02:09:20.104 INFO:tasks.workunit.client.1.smithi112.stdout:7/998: mkdir d7/d137/d147 0 2024-04-25T02:09:20.106 INFO:tasks.workunit.client.1.smithi112.stdout:7/999: dread d7/d25/d43/d46/f82 [0,4194304] 0 2024-04-25T02:09:20.112 INFO:tasks.workunit.client.1.smithi112.stdout:9/868: dwrite d1/d13/d41/fd8 [0,4194304] 0 2024-04-25T02:09:20.115 INFO:tasks.workunit.client.1.smithi112.stdout:9/869: symlink d1/d48/d65/d73/daf/d63/deb/d100/d3c/d43/d10a/l131 0 2024-04-25T02:09:20.116 INFO:tasks.workunit.client.1.smithi112.stdout:9/870: rmdir d1/d13/d41/dc1 39 2024-04-25T02:09:20.118 INFO:tasks.workunit.client.1.smithi112.stdout:9/871: symlink d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/dfd/d10b/l132 0 2024-04-25T02:09:20.119 INFO:tasks.workunit.client.1.smithi112.stdout:9/872: getdents d1/d13/d41/d84 0 2024-04-25T02:09:20.119 INFO:tasks.workunit.client.1.smithi112.stdout:9/873: chown d1/d13/f37 11977 1 2024-04-25T02:09:20.139 INFO:tasks.workunit.client.1.smithi112.stdout:9/874: dwrite d1/d93/f111 [0,4194304] 0 2024-04-25T02:09:20.140 INFO:tasks.workunit.client.1.smithi112.stdout:9/875: write d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/f75 [4379367,101714] 0 2024-04-25T02:09:20.147 INFO:tasks.workunit.client.1.smithi112.stdout:9/876: mkdir d1/d133 0 2024-04-25T02:09:20.154 INFO:tasks.workunit.client.1.smithi112.stdout:9/877: write d1/d48/d65/d73/daf/d63/deb/d100/d3c/d43/fa7 [1086287,85843] 0 2024-04-25T02:09:20.157 INFO:tasks.workunit.client.1.smithi112.stdout:9/878: creat d1/d48/d65/d10e/f134 x:0 0 0 2024-04-25T02:09:20.158 INFO:tasks.workunit.client.1.smithi112.stdout:9/879: read d1/d13/d41/f4c [126338,10152] 0 2024-04-25T02:09:20.235 INFO:tasks.workunit.client.1.smithi112.stdout:5/871: sync 2024-04-25T02:09:20.235 INFO:tasks.workunit.client.1.smithi112.stdout:1/890: sync 2024-04-25T02:09:20.235 INFO:tasks.workunit.client.1.smithi112.stdout:6/833: sync 2024-04-25T02:09:20.236 INFO:tasks.workunit.client.1.smithi112.stdout:6/834: dread d0/d32/dc0/f9d [0,4194304] 0 2024-04-25T02:09:20.237 INFO:tasks.workunit.client.1.smithi112.stdout:5/872: dread d1/d2/ff9 [0,4194304] 0 2024-04-25T02:09:20.237 INFO:tasks.workunit.client.1.smithi112.stdout:6/835: mknod d0/d2/d4/dd/db7/c115 0 2024-04-25T02:09:20.239 INFO:tasks.workunit.client.1.smithi112.stdout:1/891: dread d7/fd4 [0,4194304] 0 2024-04-25T02:09:20.239 INFO:tasks.workunit.client.1.smithi112.stdout:1/892: chown d7/d9/d4e/d85/dc1/d109/d73/de9/f70 25812 1 2024-04-25T02:09:20.240 INFO:tasks.workunit.client.1.smithi112.stdout:5/873: creat d1/d16/d51/d93/d11f/d1d/dc9/d11a/f123 x:0 0 0 2024-04-25T02:09:20.240 INFO:tasks.workunit.client.1.smithi112.stdout:5/874: readlink d1/d16/d51/d93/l9a 0 2024-04-25T02:09:20.240 INFO:tasks.workunit.client.1.smithi112.stdout:5/875: fsync d1/f8 0 2024-04-25T02:09:20.240 INFO:tasks.workunit.client.1.smithi112.stdout:5/876: stat d1/d16/d51/d93/d11f/d1d/dc9/d11a/f6d 0 2024-04-25T02:09:20.241 INFO:tasks.workunit.client.1.smithi112.stdout:5/877: truncate d1/d2/ff9 1356551 0 2024-04-25T02:09:20.243 INFO:tasks.workunit.client.1.smithi112.stdout:1/893: mkdir d7/d9/d46/d123 0 2024-04-25T02:09:20.244 INFO:tasks.workunit.client.1.smithi112.stdout:5/878: mknod d1/d2/d28/c124 0 2024-04-25T02:09:20.247 INFO:tasks.workunit.client.1.smithi112.stdout:1/894: creat d7/d9/d4e/d85/dc1/d109/d73/de9/d43/dc3/f124 x:0 0 0 2024-04-25T02:09:20.247 INFO:tasks.workunit.client.1.smithi112.stdout:1/895: chown d7/fd4 18289 1 2024-04-25T02:09:20.250 INFO:tasks.workunit.client.1.smithi112.stdout:5/879: symlink d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d7b/db2/l125 0 2024-04-25T02:09:20.251 INFO:tasks.workunit.client.1.smithi112.stdout:5/880: dread d1/d16/d51/d93/d11f/d1d/f70 [4194304,4194304] 0 2024-04-25T02:09:20.252 INFO:tasks.workunit.client.1.smithi112.stdout:1/896: symlink d7/d9/d51/l125 0 2024-04-25T02:09:20.252 INFO:tasks.workunit.client.1.smithi112.stdout:1/897: dread - d7/db0/fd0 zero size 2024-04-25T02:09:20.252 INFO:tasks.workunit.client.1.smithi112.stdout:1/898: chown d7/ce0 271835523 1 2024-04-25T02:09:20.252 INFO:tasks.workunit.client.1.smithi112.stdout:1/899: dread d7/d4b/d94/fbe [0,4194304] 0 2024-04-25T02:09:20.253 INFO:tasks.workunit.client.1.smithi112.stdout:5/881: symlink d1/d16/d51/d93/d11f/d1d/dc9/d11a/l126 0 2024-04-25T02:09:20.255 INFO:tasks.workunit.client.1.smithi112.stdout:1/900: write d7/d9/d4e/f37 [7407302,10788] 0 2024-04-25T02:09:20.255 INFO:tasks.workunit.client.1.smithi112.stdout:1/901: write d7/d4b/fac [1048338,113246] 0 2024-04-25T02:09:20.257 INFO:tasks.workunit.client.1.smithi112.stdout:1/902: truncate d7/d9/d4e/d85/dc1/d109/d73/de9/d3f/f53 2043364 0 2024-04-25T02:09:20.257 INFO:tasks.workunit.client.1.smithi112.stdout:1/903: write d7/d9/d51/d83/fb9 [651617,44245] 0 2024-04-25T02:09:20.259 INFO:tasks.workunit.client.1.smithi112.stdout:1/904: creat d7/d9/d4e/d85/dc1/d109/f126 x:0 0 0 2024-04-25T02:09:20.263 INFO:tasks.workunit.client.1.smithi112.stdout:5/882: dread d1/d16/d51/d93/d11f/f54 [0,4194304] 0 2024-04-25T02:09:20.263 INFO:tasks.workunit.client.1.smithi112.stdout:5/883: readlink d1/d16/d51/d93/d11f/d1d/dc9/d11a/l126 0 2024-04-25T02:09:20.263 INFO:tasks.workunit.client.1.smithi112.stdout:5/884: fdatasync d1/d2/d28/f67 0 2024-04-25T02:09:20.263 INFO:tasks.workunit.client.1.smithi112.stdout:5/885: chown d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d7b/db2/l11e 14418 1 2024-04-25T02:09:20.263 INFO:tasks.workunit.client.1.smithi112.stdout:5/886: chown d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d7b/db2/dc0/dcf/ddd/f112 30 1 2024-04-25T02:09:20.267 INFO:tasks.workunit.client.1.smithi112.stdout:5/887: creat d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d7b/db2/dc0/ddf/de5/f127 x:0 0 0 2024-04-25T02:09:20.268 INFO:tasks.workunit.client.1.smithi112.stdout:5/888: creat d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/f128 x:0 0 0 2024-04-25T02:09:20.270 INFO:tasks.workunit.client.1.smithi112.stdout:5/889: link d1/d2/d45/fb3 d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d79/d7a/f129 0 2024-04-25T02:09:20.280 INFO:tasks.workunit.client.1.smithi112.stdout:5/890: dread d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d7b/f7f [0,4194304] 0 2024-04-25T02:09:20.369 INFO:tasks.workunit.client.1.smithi112.stdout:5/891: dwrite d1/d2/d45/f95 [0,4194304] 0 2024-04-25T02:09:20.377 INFO:tasks.workunit.client.1.smithi112.stdout:5/892: mknod d1/d16/d51/d93/d11f/d1d/dc9/d11a/d8a/c12a 0 2024-04-25T02:09:20.381 INFO:tasks.workunit.client.1.smithi112.stdout:5/893: mkdir d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d7b/d87/d12b 0 2024-04-25T02:09:20.384 INFO:tasks.workunit.client.1.smithi112.stdout:5/894: symlink d1/d16/d22/l12c 0 2024-04-25T02:09:20.401 INFO:tasks.workunit.client.1.smithi112.stdout:5/895: dwrite d1/d16/d8f/fbd [0,4194304] 0 2024-04-25T02:09:20.403 INFO:tasks.workunit.client.1.smithi112.stdout:5/896: symlink d1/d16/d51/d93/d11f/dc4/df3/l12d 0 2024-04-25T02:09:20.404 INFO:tasks.workunit.client.1.smithi112.stdout:5/897: symlink d1/d6c/l12e 0 2024-04-25T02:09:20.405 INFO:tasks.workunit.client.1.smithi112.stdout:5/898: write d1/d2/d78/fb1 [888642,38356] 0 2024-04-25T02:09:20.405 INFO:tasks.workunit.client.1.smithi112.stdout:5/899: mknod d1/d2/d7d/c12f 0 2024-04-25T02:09:20.418 INFO:tasks.workunit.client.1.smithi112.stdout:5/900: dwrite d1/d16/d51/d93/d11f/d1d/dc9/fd6 [0,4194304] 0 2024-04-25T02:09:20.422 INFO:tasks.workunit.client.1.smithi112.stdout:5/901: symlink d1/d2/d45/l130 0 2024-04-25T02:09:20.426 INFO:tasks.workunit.client.1.smithi112.stdout:5/902: dread d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d96/fb0 [0,4194304] 0 2024-04-25T02:09:20.446 INFO:tasks.workunit.client.1.smithi112.stdout:5/903: dwrite d1/d16/d51/d93/d11f/dc4/d9c/fe3 [0,4194304] 0 2024-04-25T02:09:20.446 INFO:tasks.workunit.client.1.smithi112.stdout:5/904: chown d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d7b/d87/l110 230549 1 2024-04-25T02:09:20.446 INFO:tasks.workunit.client.1.smithi112.stdout:5/905: readlink d1/d16/d51/d93/d11f/dc4/l4a 0 2024-04-25T02:09:20.447 INFO:tasks.workunit.client.1.smithi112.stdout:5/906: dread - d1/f115 zero size 2024-04-25T02:09:20.447 INFO:tasks.workunit.client.1.smithi112.stdout:5/907: chown d1/d16/d51/d93/d11f/d1d/c6a 12165 1 2024-04-25T02:09:20.462 INFO:tasks.workunit.client.1.smithi112.stdout:5/908: dwrite d1/d16/d51/d93/d11f/d1d/f25 [0,4194304] 0 2024-04-25T02:09:20.464 INFO:tasks.workunit.client.1.smithi112.stdout:5/909: creat d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d96/f131 x:0 0 0 2024-04-25T02:09:20.484 INFO:tasks.workunit.client.1.smithi112.stdout:4/959: sync 2024-04-25T02:09:20.486 INFO:tasks.workunit.client.1.smithi112.stdout:4/960: symlink d2/d17/d20/deb/l13a 0 2024-04-25T02:09:20.487 INFO:tasks.workunit.client.1.smithi112.stdout:4/961: symlink d2/d1e/d42/l13b 0 2024-04-25T02:09:20.501 INFO:tasks.workunit.client.1.smithi112.stdout:4/962: dwrite d2/d1e/d1b/d86/f72 [4194304,4194304] 0 2024-04-25T02:09:20.503 INFO:tasks.workunit.client.1.smithi112.stdout:4/963: mkdir d2/d1e/d5c/d13c 0 2024-04-25T02:09:20.504 INFO:tasks.workunit.client.1.smithi112.stdout:4/964: symlink d2/d1e/d42/l13d 0 2024-04-25T02:09:20.511 INFO:tasks.workunit.client.1.smithi112.stdout:4/965: dread d2/d17/d20/f6b [0,4194304] 0 2024-04-25T02:09:20.511 INFO:tasks.workunit.client.1.smithi112.stdout:4/966: dread - d2/d17/d20/d26/f123 zero size 2024-04-25T02:09:20.514 INFO:tasks.workunit.client.1.smithi112.stdout:4/967: rename d2/d17/d20/d26/d39/d49/c11a to d2/d17/d20/dbe/c13e 0 2024-04-25T02:09:20.516 INFO:tasks.workunit.client.1.smithi112.stdout:4/968: dread d2/d12/fa9 [0,4194304] 0 2024-04-25T02:09:20.518 INFO:tasks.workunit.client.1.smithi112.stdout:4/969: creat d2/d17/d20/d26/d39/d106/f13f x:0 0 0 2024-04-25T02:09:20.526 INFO:tasks.workunit.client.1.smithi112.stdout:4/970: dread d2/d4e/fac [4194304,4194304] 0 2024-04-25T02:09:20.537 INFO:tasks.workunit.client.1.smithi112.stdout:4/971: rename d2/d17/d20/d26/d39 to d2/d17/d20/d140 0 2024-04-25T02:09:20.538 INFO:tasks.workunit.client.1.smithi112.stdout:4/972: dread d2/d17/db2/f102 [0,4194304] 0 2024-04-25T02:09:20.540 INFO:tasks.workunit.client.1.smithi112.stdout:4/973: creat d2/d12/f141 x:0 0 0 2024-04-25T02:09:20.540 INFO:tasks.workunit.client.1.smithi112.stdout:4/974: readlink d2/d17/d7c/l117 0 2024-04-25T02:09:20.540 INFO:tasks.workunit.client.1.smithi112.stdout:4/975: read d2/d12/fa9 [426356,89885] 0 2024-04-25T02:09:20.542 INFO:tasks.workunit.client.1.smithi112.stdout:4/976: rename d2/d12/de1/f7f to d2/d17/d20/dbe/d132/f142 0 2024-04-25T02:09:20.542 INFO:tasks.workunit.client.1.smithi112.stdout:4/977: chown d2/d1e/fce 1601217874 1 2024-04-25T02:09:20.544 INFO:tasks.workunit.client.1.smithi112.stdout:4/978: creat d2/d12/de1/f143 x:0 0 0 2024-04-25T02:09:20.546 INFO:tasks.workunit.client.1.smithi112.stdout:4/979: rmdir d2/d17/d20/dbe/d132 39 2024-04-25T02:09:20.552 INFO:tasks.workunit.client.1.smithi112.stdout:4/980: dread d2/d17/f12b [0,4194304] 0 2024-04-25T02:09:20.553 INFO:tasks.workunit.client.1.smithi112.stdout:4/981: readlink d2/d17/d20/deb/lb6 0 2024-04-25T02:09:20.556 INFO:tasks.workunit.client.1.smithi112.stdout:4/982: rename d2/d17/d20/d5e/cf2 to d2/d12/d22/c144 0 2024-04-25T02:09:20.558 INFO:tasks.workunit.client.1.smithi112.stdout:4/983: symlink d2/d17/d7c/d9c/l145 0 2024-04-25T02:09:20.560 INFO:tasks.workunit.client.1.smithi112.stdout:4/984: creat d2/d1e/d1b/d83/d126/f146 x:0 0 0 2024-04-25T02:09:20.560 INFO:tasks.workunit.client.1.smithi112.stdout:4/985: write d2/d1e/f74 [456877,77348] 0 2024-04-25T02:09:20.562 INFO:tasks.workunit.client.1.smithi112.stdout:4/986: creat d2/d4e/dfb/f147 x:0 0 0 2024-04-25T02:09:20.574 INFO:tasks.workunit.client.1.smithi112.stdout:4/987: rename d2/d17/d7c/d9c to d2/d1e/d1b/d67/d148 0 2024-04-25T02:09:20.574 INFO:tasks.workunit.client.1.smithi112.stdout:4/988: write d2/d17/d25/d3f/f136 [944693,7536] 0 2024-04-25T02:09:20.575 INFO:tasks.workunit.client.1.smithi112.stdout:4/989: write d2/d1e/d4b/d57/fa0 [399456,78989] 0 2024-04-25T02:09:20.575 INFO:tasks.workunit.client.1.smithi112.stdout:4/990: chown d2/d1e/d1b/d83/f90 23898 1 2024-04-25T02:09:20.575 INFO:tasks.workunit.client.1.smithi112.stdout:4/991: dread - d2/d17/d25/f120 zero size 2024-04-25T02:09:20.578 INFO:tasks.workunit.client.1.smithi112.stdout:4/992: mkdir d2/d1e/d5c/d149 0 2024-04-25T02:09:20.578 INFO:tasks.workunit.client.1.smithi112.stdout:4/993: chown d2/d1e/d5c 220532265 1 2024-04-25T02:09:20.595 INFO:tasks.workunit.client.1.smithi112.stdout:4/994: dwrite d2/d1e/f74 [0,4194304] 0 2024-04-25T02:09:20.597 INFO:tasks.workunit.client.1.smithi112.stdout:4/995: mknod d2/d17/d20/d26/d12a/c14a 0 2024-04-25T02:09:20.599 INFO:tasks.workunit.client.1.smithi112.stdout:4/996: readlink d2/d12/lad 0 2024-04-25T02:09:20.600 INFO:tasks.workunit.client.1.smithi112.stdout:4/997: mkdir d2/d17/d20/deb/d14b 0 2024-04-25T02:09:20.604 INFO:tasks.workunit.client.1.smithi112.stdout:4/998: rmdir d2/d1e/d1b/d83/d126 39 2024-04-25T02:09:20.605 INFO:tasks.workunit.client.1.smithi112.stdout:4/999: read d2/d17/d25/d3f/f136 [773914,36518] 0 2024-04-25T02:09:20.630 INFO:tasks.workunit.client.1.smithi112.stdout:2/904: sync 2024-04-25T02:09:20.631 INFO:tasks.workunit.client.1.smithi112.stdout:2/905: getdents d3/da/dc/d3e/df/d30/d7c 0 2024-04-25T02:09:20.633 INFO:tasks.workunit.client.1.smithi112.stdout:2/906: mkdir d3/da/dc/d20/d12c 0 2024-04-25T02:09:20.647 INFO:tasks.workunit.client.1.smithi112.stdout:2/907: dwrite d3/da/dc/d3e/df/d32/ddf/ff2 [0,4194304] 0 2024-04-25T02:09:20.647 INFO:tasks.workunit.client.1.smithi112.stdout:2/908: truncate d3/da/dc/d3e/df/d25/d88/d8e/df0/f102 1595579 0 2024-04-25T02:09:20.647 INFO:tasks.workunit.client.1.smithi112.stdout:2/909: chown d3/da/dc/d20/d43/d7e/f106 328 1 2024-04-25T02:09:20.654 INFO:tasks.workunit.client.1.smithi112.stdout:2/910: mknod d3/da/dac/dbf/dee/d11d/c12d 0 2024-04-25T02:09:20.666 INFO:tasks.workunit.client.1.smithi112.stdout:2/911: mknod d3/da/dac/dbf/dee/c12e 0 2024-04-25T02:09:20.669 INFO:tasks.workunit.client.1.smithi112.stdout:9/880: sync 2024-04-25T02:09:20.669 INFO:tasks.workunit.client.1.smithi112.stdout:3/873: sync 2024-04-25T02:09:20.669 INFO:tasks.workunit.client.1.smithi112.stdout:9/881: write d1/d48/dbd/f11f [750468,22540] 0 2024-04-25T02:09:20.669 INFO:tasks.workunit.client.1.smithi112.stdout:9/882: chown d1/d48/l8a 6064032 1 2024-04-25T02:09:20.671 INFO:tasks.workunit.client.1.smithi112.stdout:2/912: truncate d3/da/dc/d20/d43/faf 2159122 0 2024-04-25T02:09:20.677 INFO:tasks.workunit.client.1.smithi112.stdout:1/905: sync 2024-04-25T02:09:20.677 INFO:tasks.workunit.client.1.smithi112.stdout:6/836: sync 2024-04-25T02:09:20.677 INFO:tasks.workunit.client.1.smithi112.stdout:5/910: sync 2024-04-25T02:09:20.677 INFO:tasks.workunit.client.1.smithi112.stdout:6/837: truncate d0/d2/d2c/d41/d77/f99 62549 0 2024-04-25T02:09:20.677 INFO:tasks.workunit.client.1.smithi112.stdout:6/838: dread - d0/d7b/fe2 zero size 2024-04-25T02:09:20.681 INFO:tasks.workunit.client.1.smithi112.stdout:3/874: mkdir d12/d13/d34/d4a/d120 0 2024-04-25T02:09:20.682 INFO:tasks.workunit.client.1.smithi112.stdout:9/883: symlink d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/dfd/d10b/l135 0 2024-04-25T02:09:20.686 INFO:tasks.workunit.client.1.smithi112.stdout:1/906: mknod d7/d9/d4e/d85/dc1/d109/d73/de9/d43/d6a/c127 0 2024-04-25T02:09:20.689 INFO:tasks.workunit.client.1.smithi112.stdout:6/839: creat d0/d2/d3b/d53/f116 x:0 0 0 2024-04-25T02:09:20.689 INFO:tasks.workunit.client.1.smithi112.stdout:6/840: write d0/d2/d2c/f33 [315532,12496] 0 2024-04-25T02:09:20.691 INFO:tasks.workunit.client.1.smithi112.stdout:3/875: mknod d12/d13/d34/d4a/d4f/d7d/c121 0 2024-04-25T02:09:20.693 INFO:tasks.workunit.client.1.smithi112.stdout:5/911: dwrite d1/d16/d51/d93/d11f/d1d/dc9/fd6 [0,4194304] 0 2024-04-25T02:09:20.694 INFO:tasks.workunit.client.1.smithi112.stdout:9/884: link d1/d13/d41/d84/fcc d1/d48/d65/d73/daf/d63/deb/d12b/f136 0 2024-04-25T02:09:20.695 INFO:tasks.workunit.client.1.smithi112.stdout:9/885: write d1/d48/fce [109556,81536] 0 2024-04-25T02:09:20.695 INFO:tasks.workunit.client.1.smithi112.stdout:2/913: rename d3/da/dac/dbf/dee to d3/d108/d127/d12f 0 2024-04-25T02:09:20.696 INFO:tasks.workunit.client.1.smithi112.stdout:2/914: stat d3/da/dc/d3e/df/fb5 0 2024-04-25T02:09:20.697 INFO:tasks.workunit.client.1.smithi112.stdout:6/841: unlink d0/d32/d45/c6e 0 2024-04-25T02:09:20.700 INFO:tasks.workunit.client.1.smithi112.stdout:3/876: mkdir d12/d1f/db0/d122 0 2024-04-25T02:09:20.701 INFO:tasks.workunit.client.1.smithi112.stdout:5/912: creat d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d7b/d87/d12b/f132 x:0 0 0 2024-04-25T02:09:20.704 INFO:tasks.workunit.client.1.smithi112.stdout:2/915: dread d3/da/dc/fb9 [0,4194304] 0 2024-04-25T02:09:20.707 INFO:tasks.workunit.client.1.smithi112.stdout:3/877: stat d12/d13/d34/d53/cbe 0 2024-04-25T02:09:20.707 INFO:tasks.workunit.client.1.smithi112.stdout:3/878: chown d12/d13/d34/d78/l8a 1245888125 1 2024-04-25T02:09:20.707 INFO:tasks.workunit.client.1.smithi112.stdout:3/879: write d12/d13/d34/d78/d91/fde [279957,91370] 0 2024-04-25T02:09:20.708 INFO:tasks.workunit.client.1.smithi112.stdout:1/907: dwrite d7/d9/d4e/f6d [4194304,4194304] 0 2024-04-25T02:09:20.709 INFO:tasks.workunit.client.1.smithi112.stdout:5/913: write d1/d2/d45/fb3 [3346822,32461] 0 2024-04-25T02:09:20.710 INFO:tasks.workunit.client.1.smithi112.stdout:2/916: mkdir d3/da/dc/d3e/df/d30/d7c/d96/d12a/dba/d130 0 2024-04-25T02:09:20.719 INFO:tasks.workunit.client.1.smithi112.stdout:5/914: truncate d1/d16/d51/d93/d11f/fe 299511 0 2024-04-25T02:09:20.721 INFO:tasks.workunit.client.1.smithi112.stdout:2/917: link d3/da/dc/d3e/df/d30/d7c/d96/d12a/dba/l12b d3/da/dac/dbf/l131 0 2024-04-25T02:09:20.721 INFO:tasks.workunit.client.1.smithi112.stdout:2/918: chown d3/da/dc/d3e/df/d25/d88/d8e 112811923 1 2024-04-25T02:09:20.721 INFO:tasks.workunit.client.1.smithi112.stdout:2/919: chown d3/da/dc/d3e/df/d30/d7c/d96/d12a/l9b 19587 1 2024-04-25T02:09:20.723 INFO:tasks.workunit.client.1.smithi112.stdout:5/915: mkdir d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d79/d7a/da0/d133 0 2024-04-25T02:09:20.724 INFO:tasks.workunit.client.1.smithi112.stdout:2/920: truncate d3/da/dc/d3e/df/d25/f105 2308357 0 2024-04-25T02:09:20.728 INFO:tasks.workunit.client.1.smithi112.stdout:3/880: dwrite d12/d13/d34/d53/d9c/fe0 [0,4194304] 0 2024-04-25T02:09:20.728 INFO:tasks.workunit.client.1.smithi112.stdout:2/921: getdents d3/da/dc/d20/d43 0 2024-04-25T02:09:20.728 INFO:tasks.workunit.client.1.smithi112.stdout:2/922: stat d3/da/dc/d3e/df/d71/dc5/dcc/fef 0 2024-04-25T02:09:20.735 INFO:tasks.workunit.client.1.smithi112.stdout:3/881: rmdir d12/d13/d34/d78/d83/dd5 0 2024-04-25T02:09:20.736 INFO:tasks.workunit.client.1.smithi112.stdout:1/908: dwrite d7/d9/f1b [0,4194304] 0 2024-04-25T02:09:20.737 INFO:tasks.workunit.client.1.smithi112.stdout:2/923: creat d3/da/dc/d3e/df/d30/d7c/d96/d12a/f132 x:0 0 0 2024-04-25T02:09:20.737 INFO:tasks.workunit.client.1.smithi112.stdout:2/924: readlink d3/da/dc/d3e/df/d71/dc5/ld8 0 2024-04-25T02:09:20.740 INFO:tasks.workunit.client.1.smithi112.stdout:1/909: read d7/d9/d4e/d85/dc1/d109/d73/de9/d3f/fa7 [199333,95153] 0 2024-04-25T02:09:20.744 INFO:tasks.workunit.client.1.smithi112.stdout:1/910: creat d7/d9/d4e/d85/dc1/d109/d113/f128 x:0 0 0 2024-04-25T02:09:20.747 INFO:tasks.workunit.client.1.smithi112.stdout:5/916: dwrite d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d7b/db2/dc0/dcf/ddd/f8c [0,4194304] 0 2024-04-25T02:09:20.747 INFO:tasks.workunit.client.1.smithi112.stdout:3/882: dread d12/d13/d34/d4a/d4f/f9d [0,4194304] 0 2024-04-25T02:09:20.750 INFO:tasks.workunit.client.1.smithi112.stdout:9/886: dwrite d1/f1c [0,4194304] 0 2024-04-25T02:09:20.752 INFO:tasks.workunit.client.1.smithi112.stdout:2/925: dread d3/da/dc/d20/d40/f5b [0,4194304] 0 2024-04-25T02:09:20.754 INFO:tasks.workunit.client.1.smithi112.stdout:9/887: getdents d1/d48/d65/d73/daf/d63/deb/d100 0 2024-04-25T02:09:20.754 INFO:tasks.workunit.client.1.smithi112.stdout:9/888: fsync d1/d13/d5b/fa8 0 2024-04-25T02:09:20.759 INFO:tasks.workunit.client.1.smithi112.stdout:5/917: dread d1/d16/d51/d93/d11f/d1d/dc9/d11a/f6d [0,4194304] 0 2024-04-25T02:09:20.759 INFO:tasks.workunit.client.1.smithi112.stdout:5/918: dread - d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d7b/db2/dc0/ddf/de5/f127 zero size 2024-04-25T02:09:20.759 INFO:tasks.workunit.client.1.smithi112.stdout:5/919: write d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/f80 [1963079,91668] 0 2024-04-25T02:09:20.760 INFO:tasks.workunit.client.1.smithi112.stdout:5/920: rmdir d1/d16/d8f 39 2024-04-25T02:09:20.765 INFO:tasks.workunit.client.1.smithi112.stdout:5/921: mkdir d1/d6c/d134 0 2024-04-25T02:09:20.765 INFO:tasks.workunit.client.1.smithi112.stdout:5/922: write d1/d2/d28/d4f/fb7 [449187,5537] 0 2024-04-25T02:09:20.765 INFO:tasks.workunit.client.1.smithi112.stdout:1/911: read d7/d9/f10 [3364337,34359] 0 2024-04-25T02:09:20.766 INFO:tasks.workunit.client.1.smithi112.stdout:2/926: write d3/da/dc/d20/f76 [222296,107872] 0 2024-04-25T02:09:20.767 INFO:tasks.workunit.client.1.smithi112.stdout:9/889: dread d1/d48/d65/d73/daf/d63/deb/d100/d3c/d43/f4a [4194304,4194304] 0 2024-04-25T02:09:20.772 INFO:tasks.workunit.client.1.smithi112.stdout:2/927: creat d3/d108/d127/d12f/d107/f133 x:0 0 0 2024-04-25T02:09:20.772 INFO:tasks.workunit.client.1.smithi112.stdout:2/928: fdatasync d3/da/dc/d3e/df/d32/ddf/f104 0 2024-04-25T02:09:20.774 INFO:tasks.workunit.client.1.smithi112.stdout:1/912: write d7/d9/d1e/d66/dc6/fda [1504645,92864] 0 2024-04-25T02:09:20.774 INFO:tasks.workunit.client.1.smithi112.stdout:3/883: dwrite d12/d13/d34/d78/fe5 [0,4194304] 0 2024-04-25T02:09:20.776 INFO:tasks.workunit.client.1.smithi112.stdout:9/890: creat d1/d48/d65/d73/daf/d63/deb/d100/d3c/d46/f137 x:0 0 0 2024-04-25T02:09:20.777 INFO:tasks.workunit.client.1.smithi112.stdout:5/923: getdents d1/d16/d99 0 2024-04-25T02:09:20.782 INFO:tasks.workunit.client.1.smithi112.stdout:2/929: unlink d3/f9d 0 2024-04-25T02:09:20.783 INFO:tasks.workunit.client.1.smithi112.stdout:1/913: symlink d7/d9/d1e/de/d9a/l129 0 2024-04-25T02:09:20.786 INFO:tasks.workunit.client.1.smithi112.stdout:9/891: write d1/d13/d41/d84/fcc [6477901,92988] 0 2024-04-25T02:09:20.786 INFO:tasks.workunit.client.1.smithi112.stdout:9/892: stat d1/d93/f11e 0 2024-04-25T02:09:20.787 INFO:tasks.workunit.client.1.smithi112.stdout:9/893: fdatasync d1/d13/f47 0 2024-04-25T02:09:20.787 INFO:tasks.workunit.client.1.smithi112.stdout:9/894: creat d1/d48/d65/d73/daf/d63/deb/d100/d3c/d46/f138 x:0 0 0 2024-04-25T02:09:20.788 INFO:tasks.workunit.client.1.smithi112.stdout:3/884: mkdir d12/d13/d34/d78/d91/d123 0 2024-04-25T02:09:20.788 INFO:tasks.workunit.client.1.smithi112.stdout:3/885: chown d12/d13/d34/d78/d91/ce7 6053531 1 2024-04-25T02:09:20.789 INFO:tasks.workunit.client.1.smithi112.stdout:5/924: creat d1/d6c/d11c/f135 x:0 0 0 2024-04-25T02:09:20.790 INFO:tasks.workunit.client.1.smithi112.stdout:2/930: rmdir d3/da/dc/d20/d43/d7e/da3 39 2024-04-25T02:09:20.790 INFO:tasks.workunit.client.1.smithi112.stdout:2/931: creat d3/da/dac/f134 x:0 0 0 2024-04-25T02:09:20.795 INFO:tasks.workunit.client.1.smithi112.stdout:9/895: dread d1/d48/d65/d73/daf/d63/deb/d100/d3c/f69 [0,4194304] 0 2024-04-25T02:09:20.795 INFO:tasks.workunit.client.1.smithi112.stdout:9/896: chown d1/d48/d65/d73/daf/d63/deb/d100/d3c/d46/c64 4000 1 2024-04-25T02:09:20.796 INFO:tasks.workunit.client.1.smithi112.stdout:3/886: write d12/d1f/d27/d44/d73/fbb [750841,104204] 0 2024-04-25T02:09:20.796 INFO:tasks.workunit.client.1.smithi112.stdout:3/887: readlink lf 0 2024-04-25T02:09:20.796 INFO:tasks.workunit.client.1.smithi112.stdout:3/888: fsync d12/d1f/d27/d44/d73/f98 0 2024-04-25T02:09:20.796 INFO:tasks.workunit.client.1.smithi112.stdout:3/889: stat d12/d13/d34/d4a/d4f/da1/dea 0 2024-04-25T02:09:20.796 INFO:tasks.workunit.client.1.smithi112.stdout:3/890: dread - d12/ff6 zero size 2024-04-25T02:09:20.796 INFO:tasks.workunit.client.1.smithi112.stdout:1/914: rmdir d7/d4b/d94 39 2024-04-25T02:09:20.806 INFO:tasks.workunit.client.1.smithi112.stdout:2/932: dwrite d3/d108/d127/d12f/d11d/d81/fb6 [0,4194304] 0 2024-04-25T02:09:20.809 INFO:tasks.workunit.client.1.smithi112.stdout:5/925: rename d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/l6e to d1/d16/d51/d93/d11f/d1d/l136 0 2024-04-25T02:09:20.809 INFO:tasks.workunit.client.1.smithi112.stdout:5/926: chown d1/d16/d51/d93/d11f/d1d/l104 107 1 2024-04-25T02:09:20.810 INFO:tasks.workunit.client.1.smithi112.stdout:9/897: mkdir d1/d48/d65/d73/daf/d63/d139 0 2024-04-25T02:09:20.813 INFO:tasks.workunit.client.1.smithi112.stdout:3/891: unlink d12/d1f/d27/df8/da0/cdc 0 2024-04-25T02:09:20.814 INFO:tasks.workunit.client.1.smithi112.stdout:3/892: dread d12/d1f/d27/df8/dd2/f108 [0,4194304] 0 2024-04-25T02:09:20.815 INFO:tasks.workunit.client.1.smithi112.stdout:1/915: symlink d7/d9/d4e/d85/dc1/d109/d73/l12a 0 2024-04-25T02:09:20.815 INFO:tasks.workunit.client.1.smithi112.stdout:1/916: dread - d7/d9/d51/d83/f11e zero size 2024-04-25T02:09:20.815 INFO:tasks.workunit.client.1.smithi112.stdout:1/917: chown d7/d4b/d94/de5/cf3 13 1 2024-04-25T02:09:20.815 INFO:tasks.workunit.client.1.smithi112.stdout:1/918: readlink d7/d9/l100 0 2024-04-25T02:09:20.817 INFO:tasks.workunit.client.1.smithi112.stdout:2/933: rename d3/d108/d127/d12f/d107/f128 to d3/d108/d127/d12f/d11a/f135 0 2024-04-25T02:09:20.818 INFO:tasks.workunit.client.1.smithi112.stdout:1/919: mknod d7/d9/d4e/d85/dc1/d109/d113/c12b 0 2024-04-25T02:09:20.818 INFO:tasks.workunit.client.1.smithi112.stdout:1/920: fsync d7/d9/d4e/d85/dc1/d109/d73/de9/f70 0 2024-04-25T02:09:20.818 INFO:tasks.workunit.client.1.smithi112.stdout:1/921: write d7/d4b/d94/de5/def/f110 [415106,56164] 0 2024-04-25T02:09:20.824 INFO:tasks.workunit.client.1.smithi112.stdout:5/927: rename d1/d2/f31 to d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d7b/db2/dc0/dcf/f137 0 2024-04-25T02:09:20.824 INFO:tasks.workunit.client.1.smithi112.stdout:3/893: rename d12/d1f to d12/d1f/d27/df8/d124 22 2024-04-25T02:09:20.824 INFO:tasks.workunit.client.1.smithi112.stdout:3/894: write d12/d1f/fe6 [75946,70942] 0 2024-04-25T02:09:20.825 INFO:tasks.workunit.client.1.smithi112.stdout:2/934: symlink d3/da/dc/d3e/df/d30/dd7/l136 0 2024-04-25T02:09:20.825 INFO:tasks.workunit.client.1.smithi112.stdout:2/935: chown d3/d108/d127/d12f/d11d/d81/d9f/cb7 3 1 2024-04-25T02:09:20.828 INFO:tasks.workunit.client.1.smithi112.stdout:5/928: truncate d1/d2/f33 2630433 0 2024-04-25T02:09:20.828 INFO:tasks.workunit.client.1.smithi112.stdout:5/929: write d1/d16/d51/d93/d11f/d1d/dc9/d11a/f109 [233151,30946] 0 2024-04-25T02:09:20.829 INFO:tasks.workunit.client.1.smithi112.stdout:3/895: symlink d12/d5d/l125 0 2024-04-25T02:09:20.829 INFO:tasks.workunit.client.1.smithi112.stdout:3/896: stat d12/d13/d34/d53/d9c/dfb 0 2024-04-25T02:09:20.831 INFO:tasks.workunit.client.1.smithi112.stdout:1/922: dread d7/d9/d4e/d85/dc1/d109/d73/de9/fd7 [0,4194304] 0 2024-04-25T02:09:20.831 INFO:tasks.workunit.client.1.smithi112.stdout:1/923: dread d7/d9/d1e/d66/f120 [0,4194304] 0 2024-04-25T02:09:20.833 INFO:tasks.workunit.client.1.smithi112.stdout:2/936: symlink d3/d108/d127/d12f/d11d/d81/d101/l137 0 2024-04-25T02:09:20.833 INFO:tasks.workunit.client.1.smithi112.stdout:2/937: chown d3/da 3484 1 2024-04-25T02:09:20.836 INFO:tasks.workunit.client.1.smithi112.stdout:5/930: unlink d1/d2/l64 0 2024-04-25T02:09:20.838 INFO:tasks.workunit.client.1.smithi112.stdout:1/924: rmdir d7/d9/d1f/d25/d39 39 2024-04-25T02:09:20.850 INFO:tasks.workunit.client.1.smithi112.stdout:5/931: rename d1/d2/d28/c10f to d1/d6c/d134/c138 0 2024-04-25T02:09:20.854 INFO:tasks.workunit.client.1.smithi112.stdout:1/925: link d7/d4b/f69 d7/d9/d4e/d85/dc1/d109/f12c 0 2024-04-25T02:09:20.854 INFO:tasks.workunit.client.1.smithi112.stdout:1/926: write d7/d9/d4e/d85/dc1/d109/d73/de9/d3f/fa7 [121505,19001] 0 2024-04-25T02:09:20.854 INFO:tasks.workunit.client.1.smithi112.stdout:1/927: chown d7/d9/d51/d58/f76 13 1 2024-04-25T02:09:20.855 INFO:tasks.workunit.client.1.smithi112.stdout:2/938: mknod d3/c138 0 2024-04-25T02:09:20.863 INFO:tasks.workunit.client.1.smithi112.stdout:1/928: write d7/d9/d51/d58/f5b [6593202,121618] 0 2024-04-25T02:09:20.863 INFO:tasks.workunit.client.1.smithi112.stdout:1/929: write d7/d9/d51/d58/f5b [4514141,104651] 0 2024-04-25T02:09:20.866 INFO:tasks.workunit.client.1.smithi112.stdout:1/930: mknod d7/d9/d46/d123/c12d 0 2024-04-25T02:09:20.868 INFO:tasks.workunit.client.1.smithi112.stdout:2/939: dwrite d3/d108/d127/d12f/d11d/d81/d101/f116 [0,4194304] 0 2024-04-25T02:09:20.868 INFO:tasks.workunit.client.1.smithi112.stdout:2/940: truncate d3/d108/d127/d12f/d107/f125 789647 0 2024-04-25T02:09:20.869 INFO:tasks.workunit.client.1.smithi112.stdout:1/931: mkdir d7/d9/d46/d123/d12e 0 2024-04-25T02:09:20.870 INFO:tasks.workunit.client.1.smithi112.stdout:2/941: dread d3/da/dc/d3e/df/d32/ddf/f104 [0,4194304] 0 2024-04-25T02:09:20.874 INFO:tasks.workunit.client.1.smithi112.stdout:2/942: creat d3/da/dc/d3e/df/d25/f139 x:0 0 0 2024-04-25T02:09:20.874 INFO:tasks.workunit.client.1.smithi112.stdout:2/943: truncate d3/da/dc/d3e/df/d30/d7c/d96/d12a/fe5 1740353 0 2024-04-25T02:09:20.877 INFO:tasks.workunit.client.1.smithi112.stdout:1/932: getdents d7/d9/d4e/d85/dc1/d109 0 2024-04-25T02:09:20.882 INFO:tasks.workunit.client.1.smithi112.stdout:1/933: truncate d7/d9/d1e/de/f27 1314897 0 2024-04-25T02:09:20.882 INFO:tasks.workunit.client.1.smithi112.stdout:1/934: fdatasync d7/d9/d1e/d66/dc6/fda 0 2024-04-25T02:09:20.882 INFO:tasks.workunit.client.1.smithi112.stdout:1/935: write d7/d9/d1e/d66/f103 [12727,22034] 0 2024-04-25T02:09:20.882 INFO:tasks.workunit.client.1.smithi112.stdout:1/936: creat d7/d9/d46/f12f x:0 0 0 2024-04-25T02:09:20.882 INFO:tasks.workunit.client.1.smithi112.stdout:2/944: read d3/da/dc/d3e/df/d71/dc5/fd5 [1780877,79090] 0 2024-04-25T02:09:20.886 INFO:tasks.workunit.client.1.smithi112.stdout:1/937: mknod d7/d9/d4e/d85/dc1/d109/dd8/c130 0 2024-04-25T02:09:20.886 INFO:tasks.workunit.client.1.smithi112.stdout:1/938: dread - d7/d9/d4e/d85/dc1/d109/d113/f128 zero size 2024-04-25T02:09:20.910 INFO:tasks.workunit.client.1.smithi112.stdout:1/939: dwrite d7/d9/d4e/d85/dc1/d109/d113/f128 [0,4194304] 0 2024-04-25T02:09:20.910 INFO:tasks.workunit.client.1.smithi112.stdout:2/945: dwrite d3/f73 [0,4194304] 0 2024-04-25T02:09:20.915 INFO:tasks.workunit.client.1.smithi112.stdout:2/946: symlink d3/da/dc/d20/l13a 0 2024-04-25T02:09:20.921 INFO:tasks.workunit.client.1.smithi112.stdout:1/940: write d7/d9/d4e/d85/dc1/d109/d73/de9/d3f/f8d [548931,33862] 0 2024-04-25T02:09:20.921 INFO:tasks.workunit.client.1.smithi112.stdout:1/941: fdatasync d7/d9/d1e/d40/f57 0 2024-04-25T02:09:20.921 INFO:tasks.workunit.client.1.smithi112.stdout:1/942: truncate f6 12931841 0 2024-04-25T02:09:20.927 INFO:tasks.workunit.client.1.smithi112.stdout:2/947: link d3/da/dc/d3e/df/d25/f77 d3/d108/d127/d12f/d11d/d81/d9f/f13b 0 2024-04-25T02:09:20.927 INFO:tasks.workunit.client.1.smithi112.stdout:2/948: chown d3/da/dc/d3e/df/d32/ddf 5228339 1 2024-04-25T02:09:20.935 INFO:tasks.workunit.client.1.smithi112.stdout:1/943: mknod d7/d9/d4e/d85/dc1/d109/d73/de9/d32/d116/c131 0 2024-04-25T02:09:20.939 INFO:tasks.workunit.client.1.smithi112.stdout:1/944: symlink d7/d9/d4e/d85/dc1/d109/dd8/l132 0 2024-04-25T02:09:20.939 INFO:tasks.workunit.client.1.smithi112.stdout:1/945: dread - d7/d9/d1e/de/d9a/de8/f114 zero size 2024-04-25T02:09:20.941 INFO:tasks.workunit.client.1.smithi112.stdout:1/946: creat d7/f133 x:0 0 0 2024-04-25T02:09:20.942 INFO:tasks.workunit.client.1.smithi112.stdout:1/947: chown d7/d9/d4e/d85/dc1/d109/d73/de9/d43/c8b 7 1 2024-04-25T02:09:20.944 INFO:tasks.workunit.client.1.smithi112.stdout:1/948: rename d7/d9/d4e/d85/dc1/d109/d73/de9/d43/d6a/c127 to d7/d9/d4e/d85/dc1/d109/d73/de9/d43/d6a/c134 0 2024-04-25T02:09:20.944 INFO:tasks.workunit.client.1.smithi112.stdout:1/949: dread - d7/d9/d1f/ff2 zero size 2024-04-25T02:09:20.944 INFO:tasks.workunit.client.1.smithi112.stdout:1/950: fdatasync d7/f4d 0 2024-04-25T02:09:20.946 INFO:tasks.workunit.client.1.smithi112.stdout:2/949: dwrite d3/d108/d127/ffa [0,4194304] 0 2024-04-25T02:09:20.946 INFO:tasks.workunit.client.1.smithi112.stdout:2/950: truncate d3/da/dc/d3e/df/d25/d88/d8e/fb2 918828 0 2024-04-25T02:09:20.946 INFO:tasks.workunit.client.1.smithi112.stdout:2/951: write d3/da/dc/d3e/df/d25/d88/d8e/df0/ff6 [773967,101543] 0 2024-04-25T02:09:20.952 INFO:tasks.workunit.client.1.smithi112.stdout:1/951: link d7/db0/fd0 d7/f135 0 2024-04-25T02:09:20.956 INFO:tasks.workunit.client.1.smithi112.stdout:2/952: rename d3/da/dc/d3e/df/d25/d88 to d3/da/dc/d20/d43/d7e/d13c 0 2024-04-25T02:09:20.959 INFO:tasks.workunit.client.1.smithi112.stdout:1/952: symlink d7/d9/d1e/d40/de2/de6/l136 0 2024-04-25T02:09:20.962 INFO:tasks.workunit.client.1.smithi112.stdout:2/953: mknod d3/d108/d127/d12f/d11a/c13d 0 2024-04-25T02:09:20.966 INFO:tasks.workunit.client.1.smithi112.stdout:1/953: dread d7/d9/d4e/d85/dc1/d109/d73/de9/d3f/f8d [0,4194304] 0 2024-04-25T02:09:20.968 INFO:tasks.workunit.client.1.smithi112.stdout:1/954: symlink d7/d9/d4e/d85/dc1/d109/d73/de9/d43/l137 0 2024-04-25T02:09:20.968 INFO:tasks.workunit.client.1.smithi112.stdout:1/955: write d7/d9/d4e/d85/dc1/d109/f126 [773186,97478] 0 2024-04-25T02:09:20.968 INFO:tasks.workunit.client.1.smithi112.stdout:1/956: chown d7/d9/d4e/d85/la6 9 1 2024-04-25T02:09:20.969 INFO:tasks.workunit.client.1.smithi112.stdout:1/957: getdents d7/d9/d1e/d40/de2 0 2024-04-25T02:09:20.969 INFO:tasks.workunit.client.1.smithi112.stdout:1/958: chown d7/d9/d51/lfb 528426007 1 2024-04-25T02:09:20.969 INFO:tasks.workunit.client.1.smithi112.stdout:2/954: write d3/da/dc/d3e/df/d30/dc2/ff4 [1008272,119487] 0 2024-04-25T02:09:20.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:20 smithi077 ceph-mon[26330]: pgmap v4: 65 pgs: 65 active+clean; 2.5 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail 2024-04-25T02:09:20.987 INFO:tasks.workunit.client.1.smithi112.stdout:2/955: dwrite d3/d108/d127/d12f/d11a/f135 [0,4194304] 0 2024-04-25T02:09:20.991 INFO:tasks.workunit.client.1.smithi112.stdout:2/956: link d3/da/dc/d20/d43/d7e/da3/dde/f112 d3/d108/d127/d12f/d11d/f13e 0 2024-04-25T02:09:20.995 INFO:tasks.workunit.client.1.smithi112.stdout:1/959: dwrite d7/d9/d1e/de/f27 [0,4194304] 0 2024-04-25T02:09:20.997 INFO:tasks.workunit.client.1.smithi112.stdout:2/957: dread d3/da/dc/d20/f76 [0,4194304] 0 2024-04-25T02:09:20.999 INFO:tasks.workunit.client.1.smithi112.stdout:1/960: creat d7/d9/d4e/d85/dc1/d109/d73/de9/d3f/da9/dae/f138 x:0 0 0 2024-04-25T02:09:21.001 INFO:tasks.workunit.client.1.smithi112.stdout:1/961: unlink d7/d9/d4e/d85/dc1/d109/d73/de9/d32/cf5 0 2024-04-25T02:09:21.004 INFO:tasks.workunit.client.1.smithi112.stdout:2/958: getdents d3/da/de3 0 2024-04-25T02:09:21.004 INFO:tasks.workunit.client.1.smithi112.stdout:2/959: chown d3/da 1 1 2024-04-25T02:09:21.005 INFO:tasks.workunit.client.1.smithi112.stdout:1/962: dread d7/fd4 [0,4194304] 0 2024-04-25T02:09:21.007 INFO:tasks.workunit.client.1.smithi112.stdout:2/960: mknod d3/da/dc/d3e/df/d30/d7c/d96/c13f 0 2024-04-25T02:09:21.007 INFO:tasks.workunit.client.1.smithi112.stdout:2/961: stat d3/da/dc/d20/d43/d119 0 2024-04-25T02:09:21.008 INFO:tasks.workunit.client.1.smithi112.stdout:2/962: write d3/da/dc/d20/d43/d7e/da3/fdd [425989,105238] 0 2024-04-25T02:09:21.008 INFO:tasks.workunit.client.1.smithi112.stdout:1/963: getdents d7/d9/d51/d58 0 2024-04-25T02:09:21.010 INFO:tasks.workunit.client.1.smithi112.stdout:2/963: creat d3/da/dc/d3e/df/d71/dc5/f140 x:0 0 0 2024-04-25T02:09:21.011 INFO:tasks.workunit.client.1.smithi112.stdout:1/964: link d7/d9/d1f/d25/c3a d7/d9/d1e/de/d9a/de8/d11c/c139 0 2024-04-25T02:09:21.013 INFO:tasks.workunit.client.1.smithi112.stdout:6/842: sync 2024-04-25T02:09:21.013 INFO:tasks.workunit.client.1.smithi112.stdout:9/898: sync 2024-04-25T02:09:21.023 INFO:tasks.workunit.client.1.smithi112.stdout:6/843: dread d0/d2/fba [0,4194304] 0 2024-04-25T02:09:21.023 INFO:tasks.workunit.client.1.smithi112.stdout:6/844: chown d0/d2/d3b/d53/d67/fd7 9196 1 2024-04-25T02:09:21.023 INFO:tasks.workunit.client.1.smithi112.stdout:6/845: chown d0/d2/d2c/d41/d77/ca5 2 1 2024-04-25T02:09:21.028 INFO:tasks.workunit.client.1.smithi112.stdout:1/965: dwrite d7/d9/d4e/d85/dc1/d109/d73/fd5 [0,4194304] 0 2024-04-25T02:09:21.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:20 smithi112 ceph-mon[33313]: pgmap v4: 65 pgs: 65 active+clean; 2.5 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail 2024-04-25T02:09:21.030 INFO:tasks.workunit.client.1.smithi112.stdout:9/899: creat d1/d13/d5b/f13a x:0 0 0 2024-04-25T02:09:21.031 INFO:tasks.workunit.client.1.smithi112.stdout:9/900: chown d1/d48/d65/d73/daf/d63/deb/d100/d3c/d46/f8b 707444205 1 2024-04-25T02:09:21.032 INFO:tasks.workunit.client.1.smithi112.stdout:6/846: creat d0/d2/d2c/d41/d77/f117 x:0 0 0 2024-04-25T02:09:21.035 INFO:tasks.workunit.client.1.smithi112.stdout:1/966: rename d7/d9/d4e/d85/dc1/d109/d73/de9/c52 to d7/d9/d4e/d85/dc1/d109/d73/de9/c13a 0 2024-04-25T02:09:21.037 INFO:tasks.workunit.client.1.smithi112.stdout:2/964: rename d3/da/dc/d3e to d3/da/dc/d20/d43/d7e/d13c/d141 0 2024-04-25T02:09:21.037 INFO:tasks.workunit.client.1.smithi112.stdout:2/965: dread - d3/d108/d127/d12f/d11d/f13e zero size 2024-04-25T02:09:21.044 INFO:tasks.workunit.client.1.smithi112.stdout:6/847: rename d0/d2/d66/l75 to d0/d61/d98/db5/l118 0 2024-04-25T02:09:21.051 INFO:tasks.workunit.client.1.smithi112.stdout:6/848: unlink d0/d2/d2c/d41/f113 0 2024-04-25T02:09:21.051 INFO:tasks.workunit.client.1.smithi112.stdout:6/849: creat d0/d32/d45/f119 x:0 0 0 2024-04-25T02:09:21.051 INFO:tasks.workunit.client.1.smithi112.stdout:6/850: creat d0/d32/d45/f11a x:0 0 0 2024-04-25T02:09:21.054 INFO:tasks.workunit.client.1.smithi112.stdout:9/901: dwrite d1/f2b [0,4194304] 0 2024-04-25T02:09:21.054 INFO:tasks.workunit.client.1.smithi112.stdout:1/967: dwrite d7/d9/d4e/d85/dc1/d109/d73/de9/d3f/f97 [0,4194304] 0 2024-04-25T02:09:21.061 INFO:tasks.workunit.client.1.smithi112.stdout:6/851: write d0/d2/d3b/f40 [4112908,83293] 0 2024-04-25T02:09:21.063 INFO:tasks.workunit.client.1.smithi112.stdout:9/902: rename d1/d13/d41/fd8 to d1/d13/d41/d84/f13b 0 2024-04-25T02:09:21.064 INFO:tasks.workunit.client.1.smithi112.stdout:1/968: dread d7/d9/d4e/f62 [0,4194304] 0 2024-04-25T02:09:21.069 INFO:tasks.workunit.client.1.smithi112.stdout:6/852: mkdir d0/d2/d4/dd/db7/d11b 0 2024-04-25T02:09:21.071 INFO:tasks.workunit.client.1.smithi112.stdout:9/903: symlink d1/d48/d65/d73/daf/d63/deb/d100/d8f/l13c 0 2024-04-25T02:09:21.073 INFO:tasks.workunit.client.1.smithi112.stdout:1/969: dread d7/d9/d46/f89 [4194304,4194304] 0 2024-04-25T02:09:21.073 INFO:tasks.workunit.client.1.smithi112.stdout:6/853: mkdir d0/d2/d2c/d41/d11c 0 2024-04-25T02:09:21.076 INFO:tasks.workunit.client.1.smithi112.stdout:9/904: unlink d1/d48/fce 0 2024-04-25T02:09:21.078 INFO:tasks.workunit.client.1.smithi112.stdout:6/854: mkdir d0/d2/d2c/d41/d11c/d11d 0 2024-04-25T02:09:21.078 INFO:tasks.workunit.client.1.smithi112.stdout:6/855: read d0/d2/d1f/fc9 [3070918,125705] 0 2024-04-25T02:09:21.078 INFO:tasks.workunit.client.1.smithi112.stdout:6/856: write d0/d2/d4/dd/f48 [4638760,105157] 0 2024-04-25T02:09:21.081 INFO:tasks.workunit.client.1.smithi112.stdout:6/857: mknod d0/d2/d4/c11e 0 2024-04-25T02:09:21.082 INFO:tasks.workunit.client.1.smithi112.stdout:6/858: truncate d0/f1a 4622028 0 2024-04-25T02:09:21.084 INFO:tasks.workunit.client.1.smithi112.stdout:9/905: dread d1/d48/d65/d73/daf/d63/deb/d100/d3c/d43/fbf [0,4194304] 0 2024-04-25T02:09:21.084 INFO:tasks.workunit.client.1.smithi112.stdout:9/906: chown d1/d48/d65/d73/daf/d63 2677641 1 2024-04-25T02:09:21.084 INFO:tasks.workunit.client.1.smithi112.stdout:9/907: truncate d1/fd1 738561 0 2024-04-25T02:09:21.086 INFO:tasks.workunit.client.1.smithi112.stdout:9/908: link d1/d13/f37 d1/d48/d65/d10e/f13d 0 2024-04-25T02:09:21.088 INFO:tasks.workunit.client.1.smithi112.stdout:9/909: link d1/d48/d65/d73/daf/d8e/l9b d1/d48/d65/d73/daf/d63/deb/d12d/l13e 0 2024-04-25T02:09:21.090 INFO:tasks.workunit.client.1.smithi112.stdout:1/970: dwrite d7/d9/d1e/f12 [4194304,4194304] 0 2024-04-25T02:09:21.091 INFO:tasks.workunit.client.1.smithi112.stdout:9/910: creat d1/d48/d65/d73/daf/d63/deb/d12b/f13f x:0 0 0 2024-04-25T02:09:21.094 INFO:tasks.workunit.client.1.smithi112.stdout:9/911: mkdir d1/d48/d65/d73/daf/d63/deb/d100/d8f/d140 0 2024-04-25T02:09:21.100 INFO:tasks.workunit.client.1.smithi112.stdout:5/932: sync 2024-04-25T02:09:21.100 INFO:tasks.workunit.client.1.smithi112.stdout:3/897: sync 2024-04-25T02:09:21.101 INFO:tasks.workunit.client.1.smithi112.stdout:6/859: dwrite d0/f2b [0,4194304] 0 2024-04-25T02:09:21.101 INFO:tasks.workunit.client.1.smithi112.stdout:5/933: mknod d1/dba/c139 0 2024-04-25T02:09:21.101 INFO:tasks.workunit.client.1.smithi112.stdout:5/934: chown d1/d16/d8f/ce0 1612008 1 2024-04-25T02:09:21.102 INFO:tasks.workunit.client.1.smithi112.stdout:3/898: symlink d12/d13/d34/d53/d9c/l126 0 2024-04-25T02:09:21.103 INFO:tasks.workunit.client.1.smithi112.stdout:3/899: creat d12/d1f/db0/f127 x:0 0 0 2024-04-25T02:09:21.104 INFO:tasks.workunit.client.1.smithi112.stdout:6/860: creat d0/d2/d4/d28/f11f x:0 0 0 2024-04-25T02:09:21.105 INFO:tasks.workunit.client.1.smithi112.stdout:5/935: mknod d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d79/d7a/c13a 0 2024-04-25T02:09:21.106 INFO:tasks.workunit.client.1.smithi112.stdout:3/900: truncate d12/d1f/d27/d44/d7e/f88 535794 0 2024-04-25T02:09:21.108 INFO:tasks.workunit.client.1.smithi112.stdout:6/861: unlink d0/d2/d79/cc1 0 2024-04-25T02:09:21.110 INFO:tasks.workunit.client.1.smithi112.stdout:6/862: mknod d0/d32/d45/c120 0 2024-04-25T02:09:21.110 INFO:tasks.workunit.client.1.smithi112.stdout:6/863: truncate d0/d2/d4/fbb 445273 0 2024-04-25T02:09:21.110 INFO:tasks.workunit.client.1.smithi112.stdout:6/864: write d0/d2/d66/d7d/ffb [372422,83817] 0 2024-04-25T02:09:21.110 INFO:tasks.workunit.client.1.smithi112.stdout:6/865: chown d0/d2/d66 18556530 1 2024-04-25T02:09:21.110 INFO:tasks.workunit.client.1.smithi112.stdout:5/936: getdents d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d96 0 2024-04-25T02:09:21.113 INFO:tasks.workunit.client.1.smithi112.stdout:6/866: mkdir d0/d2/d4/d121 0 2024-04-25T02:09:21.118 INFO:tasks.workunit.client.1.smithi112.stdout:6/867: dread d0/d2/d4/fdc [0,4194304] 0 2024-04-25T02:09:21.120 INFO:tasks.workunit.client.1.smithi112.stdout:6/868: rename d0/d2/d3b/d53/f72 to d0/d2/d66/da8/f122 0 2024-04-25T02:09:21.120 INFO:tasks.workunit.client.1.smithi112.stdout:6/869: read d0/d2/d2c/d41/d77/f8a [68005,64376] 0 2024-04-25T02:09:21.121 INFO:tasks.workunit.client.1.smithi112.stdout:3/901: dread d12/d1f/d27/d44/fcb [0,4194304] 0 2024-04-25T02:09:21.121 INFO:tasks.workunit.client.1.smithi112.stdout:9/912: dwrite d1/d48/d65/d73/daf/d63/deb/d100/d3c/fab [0,4194304] 0 2024-04-25T02:09:21.121 INFO:tasks.workunit.client.1.smithi112.stdout:9/913: creat d1/d48/d65/d73/daf/d63/deb/d100/d3c/d46/f141 x:0 0 0 2024-04-25T02:09:21.123 INFO:tasks.workunit.client.1.smithi112.stdout:3/902: symlink d12/d1f/l128 0 2024-04-25T02:09:21.124 INFO:tasks.workunit.client.1.smithi112.stdout:6/870: dread d0/d2/d4/d28/f5c [0,4194304] 0 2024-04-25T02:09:21.127 INFO:tasks.workunit.client.1.smithi112.stdout:9/914: unlink d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/dfd/c115 0 2024-04-25T02:09:21.127 INFO:tasks.workunit.client.1.smithi112.stdout:9/915: chown d1/fd1 389 1 2024-04-25T02:09:21.128 INFO:tasks.workunit.client.1.smithi112.stdout:6/871: rename d0/d2/d4/dd/f3d to d0/d32/dc0/f123 0 2024-04-25T02:09:21.131 INFO:tasks.workunit.client.1.smithi112.stdout:9/916: mkdir d1/d48/d65/d73/daf/d63/deb/d100/d8f/dd2/d142 0 2024-04-25T02:09:21.133 INFO:tasks.workunit.client.1.smithi112.stdout:6/872: mkdir d0/d61/d98/db5/d124 0 2024-04-25T02:09:21.133 INFO:tasks.workunit.client.1.smithi112.stdout:6/873: dread - d0/d2/fdb zero size 2024-04-25T02:09:21.139 INFO:tasks.workunit.client.1.smithi112.stdout:9/917: dread d1/d48/d65/d73/daf/d63/deb/d100/f23 [0,4194304] 0 2024-04-25T02:09:21.139 INFO:tasks.workunit.client.1.smithi112.stdout:9/918: chown d1/d48/d65/d73/daf/d63/d139 7920237 1 2024-04-25T02:09:21.140 INFO:tasks.workunit.client.1.smithi112.stdout:6/874: symlink d0/d2/l125 0 2024-04-25T02:09:21.143 INFO:tasks.workunit.client.1.smithi112.stdout:9/919: link d1/d48/d65/d73/daf/d63/deb/d100/d3c/d43/f4a d1/d93/dc2/d116/f143 0 2024-04-25T02:09:21.146 INFO:tasks.workunit.client.1.smithi112.stdout:6/875: symlink d0/d2/d3b/l126 0 2024-04-25T02:09:21.147 INFO:tasks.workunit.client.1.smithi112.stdout:6/876: rename d0/d2 to d0/d2/d127 22 2024-04-25T02:09:21.147 INFO:tasks.workunit.client.1.smithi112.stdout:6/877: fdatasync d0/d2/d66/d7d/ffb 0 2024-04-25T02:09:21.151 INFO:tasks.workunit.client.1.smithi112.stdout:9/920: mknod d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/ddc/c144 0 2024-04-25T02:09:21.152 INFO:tasks.workunit.client.1.smithi112.stdout:6/878: symlink d0/d2/d1f/l128 0 2024-04-25T02:09:21.152 INFO:tasks.workunit.client.1.smithi112.stdout:6/879: chown d0/d7b 9948157 1 2024-04-25T02:09:21.156 INFO:tasks.workunit.client.1.smithi112.stdout:6/880: dread d0/d2/d4/d28/fa2 [0,4194304] 0 2024-04-25T02:09:21.156 INFO:tasks.workunit.client.1.smithi112.stdout:9/921: dread d1/f21 [0,4194304] 0 2024-04-25T02:09:21.157 INFO:tasks.workunit.client.1.smithi112.stdout:9/922: write d1/d48/d65/d73/daf/d63/deb/d100/d3c/d46/f98 [620723,106848] 0 2024-04-25T02:09:21.157 INFO:tasks.workunit.client.1.smithi112.stdout:9/923: chown d1/d48/dbd 99961 1 2024-04-25T02:09:21.160 INFO:tasks.workunit.client.1.smithi112.stdout:6/881: mkdir d0/d61/d98/db5/dfc/d10b/d129 0 2024-04-25T02:09:21.160 INFO:tasks.workunit.client.1.smithi112.stdout:6/882: readlink d0/d2/l69 0 2024-04-25T02:09:21.160 INFO:tasks.workunit.client.1.smithi112.stdout:6/883: write d0/d2/d3b/d53/d67/fd7 [986158,76568] 0 2024-04-25T02:09:21.160 INFO:tasks.workunit.client.1.smithi112.stdout:9/924: mknod d1/d13/d41/d84/c145 0 2024-04-25T02:09:21.164 INFO:tasks.workunit.client.1.smithi112.stdout:6/884: rename d0/d2/d2c/lda to d0/d2/d66/d7d/l12a 0 2024-04-25T02:09:21.167 INFO:tasks.workunit.client.1.smithi112.stdout:9/925: mkdir d1/d48/d120/d146 0 2024-04-25T02:09:21.168 INFO:tasks.workunit.client.1.smithi112.stdout:9/926: creat d1/d48/d65/d73/daf/d63/deb/d100/f147 x:0 0 0 2024-04-25T02:09:21.169 INFO:tasks.workunit.client.1.smithi112.stdout:9/927: chown d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/ddc/f11c 52564 1 2024-04-25T02:09:21.188 INFO:tasks.workunit.client.1.smithi112.stdout:6/885: dwrite d0/f2b [0,4194304] 0 2024-04-25T02:09:21.188 INFO:tasks.workunit.client.1.smithi112.stdout:9/928: dwrite d1/d48/d65/d73/f10d [0,4194304] 0 2024-04-25T02:09:21.189 INFO:tasks.workunit.client.1.smithi112.stdout:6/886: read d0/d2/d3b/f68 [714985,93621] 0 2024-04-25T02:09:21.189 INFO:tasks.workunit.client.1.smithi112.stdout:6/887: chown d0/d2/d79 473521 1 2024-04-25T02:09:21.192 INFO:tasks.workunit.client.1.smithi112.stdout:9/929: symlink d1/d93/l148 0 2024-04-25T02:09:21.194 INFO:tasks.workunit.client.1.smithi112.stdout:6/888: rmdir d0/d2/d4/d121 0 2024-04-25T02:09:21.217 INFO:tasks.workunit.client.1.smithi112.stdout:9/930: dwrite d1/d48/d65/d73/daf/d63/deb/d100/d3c/d43/fbf [0,4194304] 0 2024-04-25T02:09:21.218 INFO:tasks.workunit.client.1.smithi112.stdout:6/889: dwrite d0/d2/d1f/fe7 [0,4194304] 0 2024-04-25T02:09:21.218 INFO:tasks.workunit.client.1.smithi112.stdout:6/890: fsync d0/d2/d3b/d53/d67/fd3 0 2024-04-25T02:09:21.272 INFO:tasks.workunit.client.1.smithi112.stdout:9/931: truncate d1/d13/f37 5907304 0 2024-04-25T02:09:21.273 INFO:tasks.workunit.client.1.smithi112.stdout:9/932: chown d1/d13/d41/f102 8628706 1 2024-04-25T02:09:21.273 INFO:tasks.workunit.client.1.smithi112.stdout:9/933: fdatasync d1/d13/f47 0 2024-04-25T02:09:21.276 INFO:tasks.workunit.client.1.smithi112.stdout:6/891: creat d0/d61/f12b x:0 0 0 2024-04-25T02:09:21.279 INFO:tasks.workunit.client.1.smithi112.stdout:9/934: mknod d1/d48/d65/d73/daf/d63/d139/c149 0 2024-04-25T02:09:21.279 INFO:tasks.workunit.client.1.smithi112.stdout:9/935: dread - d1/d93/dc2/f123 zero size 2024-04-25T02:09:21.279 INFO:tasks.workunit.client.1.smithi112.stdout:9/936: write d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/f9e [417078,71993] 0 2024-04-25T02:09:21.283 INFO:tasks.workunit.client.1.smithi112.stdout:9/937: mkdir d1/d48/d14a 0 2024-04-25T02:09:21.287 INFO:tasks.workunit.client.1.smithi112.stdout:2/966: sync 2024-04-25T02:09:21.287 INFO:tasks.workunit.client.1.smithi112.stdout:2/967: write d3/da/dc/d20/d43/faf [3028153,57302] 0 2024-04-25T02:09:21.287 INFO:tasks.workunit.client.1.smithi112.stdout:9/938: dread d1/d48/d65/d73/daf/d63/deb/d100/f23 [0,4194304] 0 2024-04-25T02:09:21.288 INFO:tasks.workunit.client.1.smithi112.stdout:9/939: write d1/d13/d41/d84/fde [154018,4342] 0 2024-04-25T02:09:21.288 INFO:tasks.workunit.client.1.smithi112.stdout:9/940: write d1/d13/fe9 [830753,56740] 0 2024-04-25T02:09:21.289 INFO:tasks.workunit.client.1.smithi112.stdout:6/892: rename d0/d36 to d0/d7b/dff/d12c 0 2024-04-25T02:09:21.291 INFO:tasks.workunit.client.1.smithi112.stdout:9/941: truncate d1/d48/d65/d73/daf/d63/deb/d100/d3c/d43/fa7 2724364 0 2024-04-25T02:09:21.293 INFO:tasks.workunit.client.1.smithi112.stdout:2/968: write d3/da/dc/d20/d43/f55 [1851077,96630] 0 2024-04-25T02:09:21.296 INFO:tasks.workunit.client.1.smithi112.stdout:2/969: rename d3/da/dc/d20/d43/fd3 to d3/d108/d127/f142 0 2024-04-25T02:09:21.296 INFO:tasks.workunit.client.1.smithi112.stdout:2/970: dread - d3/da/de3/fe8 zero size 2024-04-25T02:09:21.297 INFO:tasks.workunit.client.1.smithi112.stdout:2/971: write d3/d108/d127/f142 [366692,351] 0 2024-04-25T02:09:21.297 INFO:tasks.workunit.client.1.smithi112.stdout:2/972: dread - d3/da/dc/d20/d43/d7e/d13c/d141/df/d30/dd7/f120 zero size 2024-04-25T02:09:21.297 INFO:tasks.workunit.client.1.smithi112.stdout:9/942: dread d1/d48/d65/d73/daf/d63/deb/d100/d3c/f52 [0,4194304] 0 2024-04-25T02:09:21.301 INFO:tasks.workunit.client.1.smithi112.stdout:2/973: creat d3/da/dc/d20/d43/d119/f143 x:0 0 0 2024-04-25T02:09:21.301 INFO:tasks.workunit.client.1.smithi112.stdout:2/974: write d3/da/f2b [1153217,72609] 0 2024-04-25T02:09:21.302 INFO:tasks.workunit.client.1.smithi112.stdout:2/975: fdatasync d3/da/dac/fe9 0 2024-04-25T02:09:21.302 INFO:tasks.workunit.client.1.smithi112.stdout:9/943: mknod d1/d93/dc2/c14b 0 2024-04-25T02:09:21.302 INFO:tasks.workunit.client.1.smithi112.stdout:9/944: creat d1/d48/dbd/f14c x:0 0 0 2024-04-25T02:09:21.302 INFO:tasks.workunit.client.1.smithi112.stdout:9/945: fdatasync d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/ddc/f11c 0 2024-04-25T02:09:21.302 INFO:tasks.workunit.client.1.smithi112.stdout:9/946: fsync d1/d13/d41/f53 0 2024-04-25T02:09:21.305 INFO:tasks.workunit.client.1.smithi112.stdout:2/976: mkdir d3/da/dc/d20/d43/d7e/d13c/d141/d144 0 2024-04-25T02:09:21.305 INFO:tasks.workunit.client.1.smithi112.stdout:2/977: chown d3/da/dc/d20/d43/d7e/d13c/d141/df/d30/dd7/d11b 326 1 2024-04-25T02:09:21.307 INFO:tasks.workunit.client.1.smithi112.stdout:6/893: dwrite d0/d2/d4/d28/f11f [0,4194304] 0 2024-04-25T02:09:21.307 INFO:tasks.workunit.client.1.smithi112.stdout:9/947: rmdir d1/d48/d65/d73/daf/d63 39 2024-04-25T02:09:21.309 INFO:tasks.workunit.client.1.smithi112.stdout:2/978: symlink d3/da/dc/d20/d43/d7e/d13c/d141/df/d30/d7c/d96/l145 0 2024-04-25T02:09:21.314 INFO:tasks.workunit.client.1.smithi112.stdout:6/894: dread d0/d61/db0/fbf [0,4194304] 0 2024-04-25T02:09:21.317 INFO:tasks.workunit.client.1.smithi112.stdout:9/948: truncate d1/d48/dbd/f107 269293 0 2024-04-25T02:09:21.319 INFO:tasks.workunit.client.1.smithi112.stdout:2/979: rename d3/da/dc/d20/d43/d7e/d13c/d141/df/d30/d7c/faa to d3/da/dc/d20/d43/d7e/d13c/d141/df/d71/dc5/f146 0 2024-04-25T02:09:21.319 INFO:tasks.workunit.client.1.smithi112.stdout:2/980: truncate d3/da/dc/d20/d43/d7e/da3/dde/f112 294543 0 2024-04-25T02:09:21.321 INFO:tasks.workunit.client.1.smithi112.stdout:6/895: creat d0/d7b/dff/d12c/f12d x:0 0 0 2024-04-25T02:09:21.321 INFO:tasks.workunit.client.1.smithi112.stdout:6/896: read - d0/d2/d4/f84 zero size 2024-04-25T02:09:21.322 INFO:tasks.workunit.client.1.smithi112.stdout:9/949: link d1/d48/d65/d73/daf/d63/deb/d100/d3c/d43/c4e d1/d93/dc2/d116/c14d 0 2024-04-25T02:09:21.322 INFO:tasks.workunit.client.1.smithi112.stdout:9/950: creat d1/d48/d65/d73/daf/d63/deb/f14e x:0 0 0 2024-04-25T02:09:21.322 INFO:tasks.workunit.client.1.smithi112.stdout:9/951: creat d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/dfd/f14f x:0 0 0 2024-04-25T02:09:21.323 INFO:tasks.workunit.client.1.smithi112.stdout:2/981: mkdir d3/da/dc/d20/d43/d7e/d13c/d141/df/d30/dd7/d147 0 2024-04-25T02:09:21.326 INFO:tasks.workunit.client.1.smithi112.stdout:6/897: symlink d0/d2/d2c/d41/l12e 0 2024-04-25T02:09:21.330 INFO:tasks.workunit.client.1.smithi112.stdout:9/952: unlink d1/d48/d65/d73/daf/d63/deb/d100/d8f/l13c 0 2024-04-25T02:09:21.332 INFO:tasks.workunit.client.1.smithi112.stdout:2/982: creat d3/d108/d127/d12f/d11d/d81/f148 x:0 0 0 2024-04-25T02:09:21.334 INFO:tasks.workunit.client.1.smithi112.stdout:9/953: creat d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/dfd/d12c/f150 x:0 0 0 2024-04-25T02:09:21.335 INFO:tasks.workunit.client.1.smithi112.stdout:6/898: dread d0/d2/d66/da8/f122 [0,4194304] 0 2024-04-25T02:09:21.337 INFO:tasks.workunit.client.1.smithi112.stdout:2/983: dread d3/da/dc/d20/d43/f55 [0,4194304] 0 2024-04-25T02:09:21.339 INFO:tasks.workunit.client.1.smithi112.stdout:2/984: unlink d3/da/dc/d20/d43/d7e/d13c/d141/df/d30/d7c/d96/d12a/dba/l12b 0 2024-04-25T02:09:21.343 INFO:tasks.workunit.client.1.smithi112.stdout:2/985: creat d3/da/dc/d20/d43/d7e/d13c/f149 x:0 0 0 2024-04-25T02:09:21.343 INFO:tasks.workunit.client.1.smithi112.stdout:9/954: write d1/d48/d65/d73/daf/d63/deb/d100/f40 [8075137,93979] 0 2024-04-25T02:09:21.343 INFO:tasks.workunit.client.1.smithi112.stdout:2/986: write d3/da/dac/f134 [771513,98175] 0 2024-04-25T02:09:21.346 INFO:tasks.workunit.client.1.smithi112.stdout:6/899: write d0/f2b [1032346,65430] 0 2024-04-25T02:09:21.347 INFO:tasks.workunit.client.1.smithi112.stdout:2/987: read d3/da/dc/d20/d43/d7e/d13c/d8e/df0/f100 [2833033,75489] 0 2024-04-25T02:09:21.347 INFO:tasks.workunit.client.1.smithi112.stdout:6/900: fdatasync d0/d2/d4/d28/f57 0 2024-04-25T02:09:21.348 INFO:tasks.workunit.client.1.smithi112.stdout:9/955: mknod d1/d48/d65/d73/c151 0 2024-04-25T02:09:21.360 INFO:tasks.workunit.client.1.smithi112.stdout:6/901: creat d0/d61/d98/db5/dfc/d10b/d129/f12f x:0 0 0 2024-04-25T02:09:21.362 INFO:tasks.workunit.client.1.smithi112.stdout:2/988: dwrite d3/da/dac/f134 [0,4194304] 0 2024-04-25T02:09:21.362 INFO:tasks.workunit.client.1.smithi112.stdout:2/989: stat d3/da/dc/d20/d43/d7e/da3 0 2024-04-25T02:09:21.362 INFO:tasks.workunit.client.1.smithi112.stdout:2/990: truncate d3/da/f2b 2235426 0 2024-04-25T02:09:21.365 INFO:tasks.workunit.client.1.smithi112.stdout:6/902: creat d0/d2/d66/f130 x:0 0 0 2024-04-25T02:09:21.365 INFO:tasks.workunit.client.1.smithi112.stdout:6/903: readlink d0/d32/d45/l8d 0 2024-04-25T02:09:21.365 INFO:tasks.workunit.client.1.smithi112.stdout:6/904: fdatasync d0/d2/d3b/f40 0 2024-04-25T02:09:21.367 INFO:tasks.workunit.client.1.smithi112.stdout:9/956: getdents d1/d48/dbd 0 2024-04-25T02:09:21.368 INFO:tasks.workunit.client.1.smithi112.stdout:2/991: mkdir d3/da/dc/d20/d14a 0 2024-04-25T02:09:21.370 INFO:tasks.workunit.client.1.smithi112.stdout:6/905: getdents d0/d2/d4/dd 0 2024-04-25T02:09:21.372 INFO:tasks.workunit.client.1.smithi112.stdout:2/992: link d3/da/dc/d20/d43/d7e/d13c/d8e/ld9 d3/da/dc/d20/d43/d7e/d13c/d141/df/d30/dd7/d147/l14b 0 2024-04-25T02:09:21.375 INFO:tasks.workunit.client.1.smithi112.stdout:6/906: creat d0/d32/d45/dc5/f131 x:0 0 0 2024-04-25T02:09:21.375 INFO:tasks.workunit.client.1.smithi112.stdout:6/907: readlink d0/d2/d3b/d53/d67/ld8 0 2024-04-25T02:09:21.375 INFO:tasks.workunit.client.1.smithi112.stdout:9/957: dread d1/f2b [0,4194304] 0 2024-04-25T02:09:21.375 INFO:tasks.workunit.client.1.smithi112.stdout:9/958: readlink d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/l81 0 2024-04-25T02:09:21.383 INFO:tasks.workunit.client.1.smithi112.stdout:1/971: sync 2024-04-25T02:09:21.383 INFO:tasks.workunit.client.1.smithi112.stdout:2/993: read d3/d108/d127/d12f/d11d/d81/fb6 [3882,81542] 0 2024-04-25T02:09:21.383 INFO:tasks.workunit.client.1.smithi112.stdout:2/994: fsync d3/da/dc/d20/d43/d7e/d13c/d141/df/d25/f37 0 2024-04-25T02:09:21.383 INFO:tasks.workunit.client.1.smithi112.stdout:1/972: chown d7/d9/d4e/d85/dc1/d109/d73/de9/d43/dc3/d101 179877749 1 2024-04-25T02:09:21.383 INFO:tasks.workunit.client.1.smithi112.stdout:1/973: readlink d7/d9/d51/l125 0 2024-04-25T02:09:21.383 INFO:tasks.workunit.client.1.smithi112.stdout:1/974: dread - d7/d9/d51/d58/f11f zero size 2024-04-25T02:09:21.384 INFO:tasks.workunit.client.1.smithi112.stdout:1/975: chown d7/l3d 5 1 2024-04-25T02:09:21.384 INFO:tasks.workunit.client.1.smithi112.stdout:1/976: write d7/d9/d46/f89 [9157077,1307] 0 2024-04-25T02:09:21.385 INFO:tasks.workunit.client.1.smithi112.stdout:1/977: readlink d7/d9/d1f/d25/d39/lf9 0 2024-04-25T02:09:21.385 INFO:tasks.workunit.client.1.smithi112.stdout:1/978: read d7/d9/d1f/d25/f77 [196718,32899] 0 2024-04-25T02:09:21.394 INFO:tasks.workunit.client.1.smithi112.stdout:1/979: write d7/d9/d4e/d85/dc1/d109/d73/fd5 [1088038,10285] 0 2024-04-25T02:09:21.396 INFO:tasks.workunit.client.1.smithi112.stdout:1/980: mknod d7/d9/d1e/de/d9a/c13b 0 2024-04-25T02:09:21.406 INFO:tasks.workunit.client.1.smithi112.stdout:3/903: sync 2024-04-25T02:09:21.406 INFO:tasks.workunit.client.1.smithi112.stdout:5/937: sync 2024-04-25T02:09:21.409 INFO:tasks.workunit.client.1.smithi112.stdout:2/995: dwrite d3/ff9 [4194304,4194304] 0 2024-04-25T02:09:21.411 INFO:tasks.workunit.client.1.smithi112.stdout:5/938: mkdir d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d79/d7a/d13b 0 2024-04-25T02:09:21.411 INFO:tasks.workunit.client.1.smithi112.stdout:5/939: fdatasync d1/d16/d51/d93/d11f/f119 0 2024-04-25T02:09:21.411 INFO:tasks.workunit.client.1.smithi112.stdout:5/940: write d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d96/ffb [159791,36443] 0 2024-04-25T02:09:21.414 INFO:tasks.workunit.client.1.smithi112.stdout:6/908: dwrite d0/d2/d4/d28/fe5 [0,4194304] 0 2024-04-25T02:09:21.414 INFO:tasks.workunit.client.1.smithi112.stdout:6/909: chown d0/d2/d1f/fb4 0 1 2024-04-25T02:09:21.414 INFO:tasks.workunit.client.1.smithi112.stdout:3/904: mknod d12/d13/d34/d4a/d4f/da1/dea/c129 0 2024-04-25T02:09:21.418 INFO:tasks.workunit.client.1.smithi112.stdout:5/941: unlink d1/d16/d51/d93/d11f/la 0 2024-04-25T02:09:21.419 INFO:tasks.workunit.client.1.smithi112.stdout:6/910: dread d0/d2/d2c/d41/f5d [0,4194304] 0 2024-04-25T02:09:21.419 INFO:tasks.workunit.client.1.smithi112.stdout:1/981: dwrite d7/d4b/fac [0,4194304] 0 2024-04-25T02:09:21.419 INFO:tasks.workunit.client.1.smithi112.stdout:1/982: truncate d7/d4b/d94/de5/def/f110 913434 0 2024-04-25T02:09:21.420 INFO:tasks.workunit.client.1.smithi112.stdout:6/911: write d0/d2/d4/fdc [84038,74541] 0 2024-04-25T02:09:21.423 INFO:tasks.workunit.client.1.smithi112.stdout:3/905: mkdir d12/d67/d12a 0 2024-04-25T02:09:21.429 INFO:tasks.workunit.client.1.smithi112.stdout:5/942: creat d1/d16/d8f/f13c x:0 0 0 2024-04-25T02:09:21.436 INFO:tasks.workunit.client.1.smithi112.stdout:1/983: creat d7/d9/d4e/d85/dc1/d109/dd8/f13c x:0 0 0 2024-04-25T02:09:21.436 INFO:tasks.workunit.client.1.smithi112.stdout:1/984: stat d7/d9/d4e/d85/dc1/d109/d113/c12b 0 2024-04-25T02:09:21.436 INFO:tasks.workunit.client.1.smithi112.stdout:1/985: creat d7/d9/d4e/d85/dc1/d109/dd8/f13d x:0 0 0 2024-04-25T02:09:21.439 INFO:tasks.workunit.client.1.smithi112.stdout:5/943: truncate d1/d2/d28/d4f/fb7 355656 0 2024-04-25T02:09:21.448 INFO:tasks.workunit.client.1.smithi112.stdout:6/912: dwrite d0/d2/f82 [4194304,4194304] 0 2024-04-25T02:09:21.449 INFO:tasks.workunit.client.1.smithi112.stdout:6/913: fdatasync d0/d2/d1f/fb4 0 2024-04-25T02:09:21.449 INFO:tasks.workunit.client.1.smithi112.stdout:1/986: write d7/d9/d4e/d85/dc1/d109/d73/de9/d3f/f97 [3674709,61482] 0 2024-04-25T02:09:21.449 INFO:tasks.workunit.client.1.smithi112.stdout:1/987: read d7/d9/d1e/f1a [1085897,106812] 0 2024-04-25T02:09:21.452 INFO:tasks.workunit.client.1.smithi112.stdout:3/906: dwrite d12/ff4 [4194304,4194304] 0 2024-04-25T02:09:21.462 INFO:tasks.workunit.client.1.smithi112.stdout:5/944: mknod d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d7b/c13d 0 2024-04-25T02:09:21.462 INFO:tasks.workunit.client.1.smithi112.stdout:5/945: dread - d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d7b/f8b zero size 2024-04-25T02:09:21.466 INFO:tasks.workunit.client.1.smithi112.stdout:6/914: unlink d0/d61/d98/db5/fe0 0 2024-04-25T02:09:21.473 INFO:tasks.workunit.client.1.smithi112.stdout:3/907: symlink d12/l12b 0 2024-04-25T02:09:21.473 INFO:tasks.workunit.client.1.smithi112.stdout:1/988: dwrite d7/d9/d51/d58/f76 [0,4194304] 0 2024-04-25T02:09:21.473 INFO:tasks.workunit.client.1.smithi112.stdout:1/989: write d7/d9/d4e/fad [10075533,95442] 0 2024-04-25T02:09:21.477 INFO:tasks.workunit.client.1.smithi112.stdout:5/946: unlink d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d79/d7a/c13a 0 2024-04-25T02:09:21.481 INFO:tasks.workunit.client.1.smithi112.stdout:6/915: link d0/d32/c78 d0/d2/d66/c132 0 2024-04-25T02:09:21.500 INFO:tasks.workunit.client.1.smithi112.stdout:1/990: symlink d7/d9/d4e/d85/dc1/d109/d73/de9/de7/l13e 0 2024-04-25T02:09:21.500 INFO:tasks.workunit.client.1.smithi112.stdout:1/991: chown d7/d9/d1e/d66/dc6/fe3 15 1 2024-04-25T02:09:21.506 INFO:tasks.workunit.client.1.smithi112.stdout:6/916: mkdir d0/d2/d2c/d133 0 2024-04-25T02:09:21.510 INFO:tasks.workunit.client.1.smithi112.stdout:3/908: mkdir d12/d13/d34/d4a/d4f/d12c 0 2024-04-25T02:09:21.515 INFO:tasks.workunit.client.1.smithi112.stdout:5/947: getdents d1/d16/d51/d93/d11f/d1d/dc9/d11a 0 2024-04-25T02:09:21.520 INFO:tasks.workunit.client.1.smithi112.stdout:6/917: unlink d0/d32/c78 0 2024-04-25T02:09:21.520 INFO:tasks.workunit.client.1.smithi112.stdout:6/918: truncate d0/d2/d2c/d41/d77/f117 93860 0 2024-04-25T02:09:21.522 INFO:tasks.workunit.client.1.smithi112.stdout:3/909: dread - d12/d13/d34/fe2 zero size 2024-04-25T02:09:21.522 INFO:tasks.workunit.client.1.smithi112.stdout:3/910: write d12/d13/d34/d4a/fce [1842419,111082] 0 2024-04-25T02:09:21.523 INFO:tasks.workunit.client.1.smithi112.stdout:1/992: dwrite d7/d9/f10 [0,4194304] 0 2024-04-25T02:09:21.523 INFO:tasks.workunit.client.1.smithi112.stdout:1/993: creat d7/d9/d1e/de/d9a/f13f x:0 0 0 2024-04-25T02:09:21.529 INFO:tasks.workunit.client.1.smithi112.stdout:5/948: dread d1/d2/d28/f77 [0,4194304] 0 2024-04-25T02:09:21.536 INFO:tasks.workunit.client.1.smithi112.stdout:3/911: rename d12/d13/l16 to d12/d13/d34/l12d 0 2024-04-25T02:09:21.536 INFO:tasks.workunit.client.1.smithi112.stdout:3/912: readlink d12/d13/d34/d78/l8a 0 2024-04-25T02:09:21.537 INFO:tasks.workunit.client.1.smithi112.stdout:6/919: dwrite d0/d2/d3b/d53/f116 [0,4194304] 0 2024-04-25T02:09:21.542 INFO:tasks.workunit.client.1.smithi112.stdout:1/994: rmdir d7/d9/d1e/de/d84 39 2024-04-25T02:09:21.542 INFO:tasks.workunit.client.1.smithi112.stdout:1/995: truncate d7/d9/d4e/d85/dc1/d109/d73/fd3 929440 0 2024-04-25T02:09:21.545 INFO:tasks.workunit.client.1.smithi112.stdout:1/996: write d7/d9/d1e/de/fc0 [40863,81634] 0 2024-04-25T02:09:21.545 INFO:tasks.workunit.client.1.smithi112.stdout:1/997: write d7/d9/d4e/f6d [835480,110833] 0 2024-04-25T02:09:21.546 INFO:tasks.workunit.client.1.smithi112.stdout:1/998: write d7/d9/d4e/d85/dc1/d109/d73/fd5 [1200877,55633] 0 2024-04-25T02:09:21.546 INFO:tasks.workunit.client.1.smithi112.stdout:3/913: symlink d12/d13/d34/d78/d83/l12e 0 2024-04-25T02:09:21.551 INFO:tasks.workunit.client.1.smithi112.stdout:6/920: write d0/d61/d98/db5/ff0 [1094096,108661] 0 2024-04-25T02:09:21.559 INFO:tasks.workunit.client.1.smithi112.stdout:5/949: unlink d1/d16/d51/d93/d11f/c2b 0 2024-04-25T02:09:21.559 INFO:tasks.workunit.client.1.smithi112.stdout:1/999: write d7/d4b/fac [1612362,15625] 0 2024-04-25T02:09:21.561 INFO:tasks.workunit.client.1.smithi112.stdout:3/914: dwrite d12/d13/d34/d4a/d87/d10f/f118 [0,4194304] 0 2024-04-25T02:09:21.561 INFO:tasks.workunit.client.1.smithi112.stdout:6/921: creat d0/d2/d2c/d41/d11c/f134 x:0 0 0 2024-04-25T02:09:21.562 INFO:tasks.workunit.client.1.smithi112.stdout:5/950: write d1/d16/d8f/f13c [830419,59205] 0 2024-04-25T02:09:21.563 INFO:tasks.workunit.client.1.smithi112.stdout:6/922: dread d0/d2/d3b/f68 [0,4194304] 0 2024-04-25T02:09:21.571 INFO:tasks.workunit.client.1.smithi112.stdout:5/951: dread d1/d2/d45/f95 [0,4194304] 0 2024-04-25T02:09:21.571 INFO:tasks.workunit.client.1.smithi112.stdout:5/952: creat d1/d16/d8f/f13e x:0 0 0 2024-04-25T02:09:21.571 INFO:tasks.workunit.client.1.smithi112.stdout:5/953: fsync d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d7b/f7f 0 2024-04-25T02:09:21.574 INFO:tasks.workunit.client.1.smithi112.stdout:3/915: mknod d12/d1f/d27/df8/c12f 0 2024-04-25T02:09:21.577 INFO:tasks.workunit.client.1.smithi112.stdout:2/996: sync 2024-04-25T02:09:21.583 INFO:tasks.workunit.client.1.smithi112.stdout:6/923: unlink d0/d7b/dff/d12c/f12d 0 2024-04-25T02:09:21.584 INFO:tasks.workunit.client.1.smithi112.stdout:6/924: chown d0/d2/d3b/d53/f116 3459457 1 2024-04-25T02:09:21.584 INFO:tasks.workunit.client.1.smithi112.stdout:6/925: truncate d0/d61/db0/f10f 195407 0 2024-04-25T02:09:21.584 INFO:tasks.workunit.client.1.smithi112.stdout:6/926: creat d0/d7b/f135 x:0 0 0 2024-04-25T02:09:21.584 INFO:tasks.workunit.client.1.smithi112.stdout:9/959: sync 2024-04-25T02:09:21.589 INFO:tasks.workunit.client.1.smithi112.stdout:2/997: mkdir d3/da/dc/d20/d43/d7e/d13c/d141/df/d32/ddf/d14c 0 2024-04-25T02:09:21.592 INFO:tasks.workunit.client.1.smithi112.stdout:5/954: dwrite d1/d2/d28/f77 [0,4194304] 0 2024-04-25T02:09:21.609 INFO:tasks.workunit.client.1.smithi112.stdout:6/927: symlink d0/d2/d2c/d41/d77/l136 0 2024-04-25T02:09:21.609 INFO:tasks.workunit.client.1.smithi112.stdout:6/928: write d0/d2/d1f/fde [1704449,87527] 0 2024-04-25T02:09:21.609 INFO:tasks.workunit.client.1.smithi112.stdout:6/929: stat d0/d7b/fe2 0 2024-04-25T02:09:21.612 INFO:tasks.workunit.client.1.smithi112.stdout:2/998: symlink d3/da/dc/d20/d43/d7e/d13c/d141/df/d32/l14d 0 2024-04-25T02:09:21.613 INFO:tasks.workunit.client.1.smithi112.stdout:5/955: dwrite d1/d16/d51/f10b [0,4194304] 0 2024-04-25T02:09:21.618 INFO:tasks.workunit.client.1.smithi112.stdout:9/960: write d1/d48/d65/f79 [408208,54218] 0 2024-04-25T02:09:21.618 INFO:tasks.workunit.client.1.smithi112.stdout:6/930: symlink d0/d2/d4/dd/db7/l137 0 2024-04-25T02:09:21.622 INFO:tasks.workunit.client.1.smithi112.stdout:2/999: creat d3/da/dc/d20/d43/d7e/d13c/d141/df/d30/d7c/d96/f14e x:0 0 0 2024-04-25T02:09:21.628 INFO:tasks.workunit.client.1.smithi112.stdout:6/931: rename d0/d2/d4/dd/db7/l137 to d0/d61/d98/db5/dfc/d110/l138 0 2024-04-25T02:09:21.630 INFO:tasks.workunit.client.1.smithi112.stdout:5/956: rmdir d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d7b/d87/d12b 39 2024-04-25T02:09:21.631 INFO:tasks.workunit.client.1.smithi112.stdout:5/957: mkdir d1/d16/d51/d93/d11f/d1d/d13f 0 2024-04-25T02:09:21.633 INFO:tasks.workunit.client.1.smithi112.stdout:9/961: dwrite d1/d48/d65/d73/daf/d63/deb/d100/f11 [0,4194304] 0 2024-04-25T02:09:21.633 INFO:tasks.workunit.client.1.smithi112.stdout:9/962: fsync d1/f21 0 2024-04-25T02:09:21.635 INFO:tasks.workunit.client.1.smithi112.stdout:5/958: mkdir d1/d16/d98/d140 0 2024-04-25T02:09:21.635 INFO:tasks.workunit.client.1.smithi112.stdout:5/959: chown d1/d16/d51/d93/d11f/d1d 432691477 1 2024-04-25T02:09:21.639 INFO:tasks.workunit.client.1.smithi112.stdout:5/960: rmdir d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d79/d7a/d13b 0 2024-04-25T02:09:21.639 INFO:tasks.workunit.client.1.smithi112.stdout:5/961: fsync d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d7b/f8b 0 2024-04-25T02:09:21.642 INFO:tasks.workunit.client.1.smithi112.stdout:9/963: rename d1/d13/d41/dc1/ff2 to d1/d93/dc2/d116/f152 0 2024-04-25T02:09:21.644 INFO:tasks.workunit.client.1.smithi112.stdout:9/964: creat d1/d48/d65/d73/daf/d63/d139/f153 x:0 0 0 2024-04-25T02:09:21.645 INFO:tasks.workunit.client.1.smithi112.stdout:9/965: truncate d1/d48/f119 2530710 0 2024-04-25T02:09:21.646 INFO:tasks.workunit.client.1.smithi112.stdout:9/966: symlink d1/d48/d65/d73/daf/d63/deb/d12b/l154 0 2024-04-25T02:09:21.647 INFO:tasks.workunit.client.1.smithi112.stdout:9/967: fsync d1/d13/fe9 0 2024-04-25T02:09:21.647 INFO:tasks.workunit.client.1.smithi112.stdout:9/968: creat d1/d48/d65/d73/daf/d63/deb/d100/f155 x:0 0 0 2024-04-25T02:09:21.668 INFO:tasks.workunit.client.1.smithi112.stdout:9/969: dwrite d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/ddc/f11c [0,4194304] 0 2024-04-25T02:09:21.673 INFO:tasks.workunit.client.1.smithi112.stdout:9/970: rename d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/ddc/l11b to d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/dfd/d10b/l156 0 2024-04-25T02:09:21.673 INFO:tasks.workunit.client.1.smithi112.stdout:9/971: stat d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/fe1 0 2024-04-25T02:09:21.674 INFO:tasks.workunit.client.1.smithi112.stdout:9/972: symlink d1/d93/l157 0 2024-04-25T02:09:21.677 INFO:tasks.workunit.client.1.smithi112.stdout:9/973: dread d1/d48/d65/f79 [0,4194304] 0 2024-04-25T02:09:21.678 INFO:tasks.workunit.client.1.smithi112.stdout:9/974: mknod d1/d48/d65/d73/daf/d63/deb/d100/c158 0 2024-04-25T02:09:21.694 INFO:tasks.workunit.client.1.smithi112.stdout:9/975: dwrite d1/d13/d5b/fc0 [0,4194304] 0 2024-04-25T02:09:21.695 INFO:tasks.workunit.client.1.smithi112.stdout:9/976: chown d1/f1c 17075247 1 2024-04-25T02:09:21.695 INFO:tasks.workunit.client.1.smithi112.stdout:9/977: write d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/dfd/d12c/f150 [803439,106775] 0 2024-04-25T02:09:21.695 INFO:tasks.workunit.client.1.smithi112.stdout:9/978: chown d1/d48/d65/d73/daf/d63/deb/d100/d3c/d43/c4e 138 1 2024-04-25T02:09:21.883 INFO:tasks.workunit.client.1.smithi112.stdout:5/962: sync 2024-04-25T02:09:21.883 INFO:tasks.workunit.client.1.smithi112.stdout:3/916: sync 2024-04-25T02:09:21.884 INFO:tasks.workunit.client.1.smithi112.stdout:6/932: sync 2024-04-25T02:09:21.884 INFO:tasks.workunit.client.1.smithi112.stdout:6/933: read d0/d2/d1f/fc9 [2025487,116917] 0 2024-04-25T02:09:21.884 INFO:tasks.workunit.client.1.smithi112.stdout:9/979: sync 2024-04-25T02:09:21.885 INFO:tasks.workunit.client.1.smithi112.stdout:3/917: dread d12/d67/dbf/fd0 [0,4194304] 0 2024-04-25T02:09:21.943 INFO:tasks.workunit.client.1.smithi112.stdout:6/934: rmdir d0/d7b/dff 39 2024-04-25T02:09:21.943 INFO:tasks.workunit.client.1.smithi112.stdout:6/935: readlink d0/d2/d1f/led 0 2024-04-25T02:09:21.944 INFO:tasks.workunit.client.1.smithi112.stdout:3/918: creat d12/d13/d34/d78/f130 x:0 0 0 2024-04-25T02:09:21.946 INFO:tasks.workunit.client.1.smithi112.stdout:6/936: mkdir d0/d2/d2c/d41/d139 0 2024-04-25T02:09:21.947 INFO:tasks.workunit.client.1.smithi112.stdout:6/937: symlink d0/d2/d79/l13a 0 2024-04-25T02:09:21.947 INFO:tasks.workunit.client.1.smithi112.stdout:6/938: write d0/d2/d3b/ffd [978213,95117] 0 2024-04-25T02:09:21.948 INFO:tasks.workunit.client.1.smithi112.stdout:6/939: getdents d0/d2/d2c/d41/d77/d102 0 2024-04-25T02:09:21.948 INFO:tasks.workunit.client.1.smithi112.stdout:3/919: dread d12/d1f/d27/d44/d73/d95/da5/db3/fb7 [0,4194304] 0 2024-04-25T02:09:21.950 INFO:tasks.workunit.client.1.smithi112.stdout:3/920: rename d12/d5d/lfd to d12/d1f/d27/d44/d73/d95/l131 0 2024-04-25T02:09:21.951 INFO:tasks.workunit.client.1.smithi112.stdout:3/921: symlink d12/d67/dd3/l132 0 2024-04-25T02:09:21.951 INFO:tasks.workunit.client.1.smithi112.stdout:3/922: truncate d12/d13/d34/d4a/f84 4993568 0 2024-04-25T02:09:21.952 INFO:tasks.workunit.client.1.smithi112.stdout:3/923: creat d12/d1f/d27/d44/f133 x:0 0 0 2024-04-25T02:09:21.954 INFO:tasks.workunit.client.1.smithi112.stdout:3/924: getdents d12/d1f/d27/df8/da0 0 2024-04-25T02:09:21.957 INFO:tasks.workunit.client.1.smithi112.stdout:6/940: read d0/d7b/dff/d12c/fab [2004923,6252] 0 2024-04-25T02:09:21.957 INFO:tasks.workunit.client.1.smithi112.stdout:6/941: chown d0/d32/lcb 15 1 2024-04-25T02:09:21.957 INFO:tasks.workunit.client.1.smithi112.stdout:3/925: creat d12/d1f/d27/d44/d73/f134 x:0 0 0 2024-04-25T02:09:21.957 INFO:tasks.workunit.client.1.smithi112.stdout:3/926: write d12/d1f/daa/fee [208403,109595] 0 2024-04-25T02:09:21.959 INFO:tasks.workunit.client.1.smithi112.stdout:3/927: mkdir d12/d67/d135 0 2024-04-25T02:09:21.959 INFO:tasks.workunit.client.1.smithi112.stdout:3/928: dread d12/d13/d34/d4a/f84 [4194304,4194304] 0 2024-04-25T02:09:21.986 INFO:tasks.workunit.client.1.smithi112.stdout:6/942: creat d0/d32/f13b x:0 0 0 2024-04-25T02:09:21.987 INFO:tasks.workunit.client.1.smithi112.stdout:6/943: mkdir d0/d32/d45/d100/d13c 0 2024-04-25T02:09:21.987 INFO:tasks.workunit.client.1.smithi112.stdout:6/944: dread - d0/d32/ff3 zero size 2024-04-25T02:09:22.000 INFO:tasks.workunit.client.1.smithi112.stdout:6/945: dwrite d0/d32/d45/f11a [0,4194304] 0 2024-04-25T02:09:22.004 INFO:tasks.workunit.client.1.smithi112.stdout:6/946: truncate d0/d2/d4/d28/faa 2350035 0 2024-04-25T02:09:22.005 INFO:tasks.workunit.client.1.smithi112.stdout:3/929: rmdir d12/d1f/d27/d44/d73 39 2024-04-25T02:09:22.013 INFO:tasks.workunit.client.1.smithi112.stdout:3/930: unlink d12/d13/d34/d4a/fc9 0 2024-04-25T02:09:22.015 INFO:tasks.workunit.client.1.smithi112.stdout:3/931: getdents d12/d5d 0 2024-04-25T02:09:22.016 INFO:tasks.workunit.client.1.smithi112.stdout:3/932: truncate d12/d1f/d27/d44/d73/d95/da5/db3/fb7 57962 0 2024-04-25T02:09:22.019 INFO:tasks.workunit.client.1.smithi112.stdout:6/947: mkdir d0/d2/d3b/d53/d13d 0 2024-04-25T02:09:22.021 INFO:tasks.workunit.client.1.smithi112.stdout:6/948: rename d0/d2/d4/dd/c3a to d0/d61/db0/c13e 0 2024-04-25T02:09:22.021 INFO:tasks.workunit.client.1.smithi112.stdout:6/949: creat d0/d2/f13f x:0 0 0 2024-04-25T02:09:22.022 INFO:tasks.workunit.client.1.smithi112.stdout:6/950: mknod d0/d2/d3b/d53/d67/c140 0 2024-04-25T02:09:22.024 INFO:tasks.workunit.client.1.smithi112.stdout:6/951: rename d0/d2/l125 to d0/d32/dc0/d114/l141 0 2024-04-25T02:09:22.025 INFO:tasks.workunit.client.1.smithi112.stdout:3/933: read d12/d13/d34/d4a/d87/d10f/f118 [3842095,93993] 0 2024-04-25T02:09:22.027 INFO:tasks.workunit.client.1.smithi112.stdout:6/952: rmdir d0/d32/d45/d100/d13c 0 2024-04-25T02:09:22.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:21 smithi112 ceph-mon[33313]: mgrmap e23: smithi112.cswrxs(active, since 3s) 2024-04-25T02:09:22.033 INFO:tasks.workunit.client.1.smithi112.stdout:3/934: symlink d12/d13/d34/d53/d9c/l136 0 2024-04-25T02:09:22.035 INFO:tasks.workunit.client.1.smithi112.stdout:3/935: dread d12/d1f/d27/df8/f99 [0,4194304] 0 2024-04-25T02:09:22.035 INFO:tasks.workunit.client.1.smithi112.stdout:3/936: fsync d12/d1f/d27/ff7 0 2024-04-25T02:09:22.038 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-25T02:09:22.038 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-25T02:09:22.038 INFO:tasks.workunit.client.1.smithi112.stdout:3/937: mkdir d12/d13/d34/d78/d91/d137 0 2024-04-25T02:09:22.039 INFO:tasks.workunit.client.1.smithi112.stdout:3/938: unlink d12/d1f/d27/d44/l5a 0 2024-04-25T02:09:22.040 INFO:tasks.workunit.client.1.smithi112.stdout:3/939: mkdir d12/d13/d34/d4a/d4f/d7d/d138 0 2024-04-25T02:09:22.041 INFO:tasks.workunit.client.1.smithi112.stdout:6/953: dwrite d0/d2/d1f/fe7 [0,4194304] 0 2024-04-25T02:09:22.041 INFO:tasks.workunit.client.1.smithi112.stdout:6/954: dread - d0/d2/d2c/d41/d11c/f134 zero size 2024-04-25T02:09:22.043 INFO:tasks.workunit.client.1.smithi112.stdout:6/955: mkdir d0/d61/d98/db5/d142 0 2024-04-25T02:09:22.043 INFO:tasks.workunit.client.1.smithi112.stdout:6/956: write d0/d2/d2c/d41/dce/f106 [74806,41616] 0 2024-04-25T02:09:22.045 INFO:tasks.workunit.client.1.smithi112.stdout:6/957: rename d0/d2/d4/fb to d0/d7b/f143 0 2024-04-25T02:09:22.047 INFO:tasks.workunit.client.1.smithi112.stdout:6/958: creat d0/d7b/dff/d10d/f144 x:0 0 0 2024-04-25T02:09:22.047 INFO:tasks.workunit.client.1.smithi112.stdout:6/959: read - d0/d2/fdb zero size 2024-04-25T02:09:22.047 INFO:tasks.workunit.client.1.smithi112.stdout:6/960: creat d0/d7b/dff/d10d/f145 x:0 0 0 2024-04-25T02:09:22.052 INFO:tasks.workunit.client.1.smithi112.stdout:3/940: dread d12/d13/f37 [4194304,4194304] 0 2024-04-25T02:09:22.052 INFO:tasks.workunit.client.1.smithi112.stdout:3/941: truncate d12/d1f/d27/f2b 2083706 0 2024-04-25T02:09:22.052 INFO:tasks.workunit.client.1.smithi112.stdout:3/942: truncate d12/d13/d34/d53/d9c/fe0 4850170 0 2024-04-25T02:09:22.052 INFO:tasks.workunit.client.1.smithi112.stdout:3/943: chown d12/d1f/d27/c2f 0 1 2024-04-25T02:09:22.053 INFO:tasks.workunit.client.1.smithi112.stdout:3/944: symlink d12/d1f/d27/d44/d73/d95/da5/d105/l139 0 2024-04-25T02:09:22.053 INFO:tasks.workunit.client.1.smithi112.stdout:3/945: chown d12/d1f/daa/lb9 53270 1 2024-04-25T02:09:22.054 INFO:tasks.workunit.client.1.smithi112.stdout:3/946: symlink d12/d13/d34/d4a/d87/d10f/l13a 0 2024-04-25T02:09:22.057 INFO:tasks.workunit.client.1.smithi112.stdout:3/947: rename d12/d13/f30 to d12/d13/d34/d53/d9c/f13b 0 2024-04-25T02:09:22.059 INFO:tasks.workunit.client.1.smithi112.stdout:3/948: creat d12/d67/dbf/f13c x:0 0 0 2024-04-25T02:09:22.061 INFO:tasks.workunit.client.1.smithi112.stdout:3/949: creat d12/d1f/daa/dfa/f13d x:0 0 0 2024-04-25T02:09:22.061 INFO:tasks.workunit.client.1.smithi112.stdout:3/950: readlink d12/d13/d34/d78/d83/laf 0 2024-04-25T02:09:22.065 INFO:tasks.workunit.client.1.smithi112.stdout:6/961: dwrite d0/d2/d66/fe3 [0,4194304] 0 2024-04-25T02:09:22.071 INFO:tasks.workunit.client.1.smithi112.stdout:6/962: rename d0/d7b/dff/d12c to d0/d61/d98/db5/d124/d146 0 2024-04-25T02:09:22.071 INFO:tasks.workunit.client.1.smithi112.stdout:6/963: write d0/f2b [6960770,56226] 0 2024-04-25T02:09:22.072 INFO:tasks.workunit.client.1.smithi112.stdout:6/964: stat d0/d2/d2c/f33 0 2024-04-25T02:09:22.072 INFO:tasks.workunit.client.1.smithi112.stdout:6/965: fsync d0/d2/d3b/f68 0 2024-04-25T02:09:22.072 INFO:tasks.workunit.client.1.smithi112.stdout:6/966: creat d0/d61/d98/db5/f147 x:0 0 0 2024-04-25T02:09:22.072 INFO:tasks.workunit.client.1.smithi112.stdout:6/967: readlink d0/d61/d98/db5/l118 0 2024-04-25T02:09:22.074 INFO:tasks.workunit.client.1.smithi112.stdout:6/968: dread d0/d61/db0/fbf [0,4194304] 0 2024-04-25T02:09:22.074 INFO:tasks.workunit.client.1.smithi112.stdout:6/969: chown d0/d61/d98/db5/dfc/d110 54109259 1 2024-04-25T02:09:22.075 INFO:tasks.workunit.client.1.smithi112.stdout:6/970: mknod d0/d2/d4/c148 0 2024-04-25T02:09:22.077 INFO:tasks.workunit.client.1.smithi112.stdout:3/951: dwrite d12/f1d [0,4194304] 0 2024-04-25T02:09:22.081 INFO:tasks.workunit.client.1.smithi112.stdout:6/971: dread d0/d2/da1/fcc [0,4194304] 0 2024-04-25T02:09:22.082 INFO:tasks.workunit.client.1.smithi112.stdout:6/972: symlink d0/d2/d2c/d41/d139/l149 0 2024-04-25T02:09:22.082 INFO:tasks.workunit.client.1.smithi112.stdout:6/973: creat d0/d2/d79/d81/f14a x:0 0 0 2024-04-25T02:09:22.086 INFO:tasks.workunit.client.1.smithi112.stdout:9/980: sync 2024-04-25T02:09:22.086 INFO:tasks.workunit.client.1.smithi112.stdout:5/963: sync 2024-04-25T02:09:22.087 INFO:tasks.workunit.client.1.smithi112.stdout:5/964: mknod d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d7b/d87/df8/c141 0 2024-04-25T02:09:22.087 INFO:tasks.workunit.client.1.smithi112.stdout:5/965: dread - d1/d16/d51/d93/d11f/dc4/d9c/f122 zero size 2024-04-25T02:09:22.088 INFO:tasks.workunit.client.1.smithi112.stdout:5/966: chown d1/d2/d28/l92 555397 1 2024-04-25T02:09:22.088 INFO:tasks.workunit.client.1.smithi112.stdout:9/981: dread d1/fa [0,4194304] 0 2024-04-25T02:09:22.089 INFO:tasks.workunit.client.1.smithi112.stdout:5/967: link d1/f63 d1/d6c/f142 0 2024-04-25T02:09:22.090 INFO:tasks.workunit.client.1.smithi112.stdout:9/982: rename d1/d48/d65/d73/daf/d63/deb/d100/d3c/d43/d10a to d1/d13/d41/d84/d159 0 2024-04-25T02:09:22.091 INFO:tasks.workunit.client.1.smithi112.stdout:9/983: fdatasync d1/d13/f20 0 2024-04-25T02:09:22.091 INFO:tasks.workunit.client.1.smithi112.stdout:5/968: rmdir d1/d2/d28/d4f 39 2024-04-25T02:09:22.092 INFO:tasks.workunit.client.1.smithi112.stdout:9/984: creat d1/d48/d65/d73/daf/d63/deb/d12d/f15a x:0 0 0 2024-04-25T02:09:22.093 INFO:tasks.workunit.client.1.smithi112.stdout:5/969: symlink d1/d16/d51/d93/d11f/dc4/df4/l143 0 2024-04-25T02:09:22.093 INFO:tasks.workunit.client.1.smithi112.stdout:5/970: dread - d1/d16/d51/d93/d11f/d1d/dc9/d11a/f123 zero size 2024-04-25T02:09:22.094 INFO:tasks.workunit.client.1.smithi112.stdout:9/985: unlink d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/l81 0 2024-04-25T02:09:22.094 INFO:tasks.workunit.client.1.smithi112.stdout:9/986: fsync d1/d13/fd6 0 2024-04-25T02:09:22.095 INFO:tasks.workunit.client.1.smithi112.stdout:5/971: creat d1/d2/d7d/f144 x:0 0 0 2024-04-25T02:09:22.095 INFO:tasks.workunit.client.1.smithi112.stdout:9/987: creat d1/d48/d65/d73/daf/f15b x:0 0 0 2024-04-25T02:09:22.096 INFO:tasks.workunit.client.1.smithi112.stdout:6/974: dwrite d0/d61/d98/db5/dfc/d10b/d129/f12f [0,4194304] 0 2024-04-25T02:09:22.097 INFO:tasks.workunit.client.1.smithi112.stdout:5/972: rename d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/fed to d1/d16/d51/f145 0 2024-04-25T02:09:22.098 INFO:tasks.workunit.client.1.smithi112.stdout:9/988: symlink d1/d48/d120/d146/l15c 0 2024-04-25T02:09:22.101 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:21 smithi077 ceph-mon[26330]: mgrmap e23: smithi112.cswrxs(active, since 3s) 2024-04-25T02:09:22.108 INFO:tasks.workunit.client.1.smithi112.stdout:6/975: dread d0/d32/d45/f80 [0,4194304] 0 2024-04-25T02:09:22.110 INFO:tasks.workunit.client.1.smithi112.stdout:6/976: dread d0/d61/db0/f10f [0,4194304] 0 2024-04-25T02:09:22.110 INFO:tasks.workunit.client.1.smithi112.stdout:6/977: chown d0/d2/d2c/d133 14 1 2024-04-25T02:09:22.112 INFO:tasks.workunit.client.1.smithi112.stdout:6/978: creat d0/d7b/dff/f14b x:0 0 0 2024-04-25T02:09:22.113 INFO:tasks.workunit.client.1.smithi112.stdout:6/979: mknod d0/d2/d4/dd/db7/d11b/c14c 0 2024-04-25T02:09:22.114 INFO:tasks.workunit.client.1.smithi112.stdout:9/989: dwrite d1/d48/d65/f79 [0,4194304] 0 2024-04-25T02:09:22.114 INFO:tasks.workunit.client.1.smithi112.stdout:9/990: truncate d1/d48/d65/d73/daf/d63/ffa 790109 0 2024-04-25T02:09:22.115 INFO:tasks.workunit.client.1.smithi112.stdout:9/991: write d1/fd [4415468,61124] 0 2024-04-25T02:09:22.131 INFO:tasks.workunit.client.1.smithi112.stdout:5/973: dwrite d1/d16/d22/f4e [0,4194304] 0 2024-04-25T02:09:22.131 INFO:tasks.workunit.client.1.smithi112.stdout:9/992: dwrite d1/d93/f11e [0,4194304] 0 2024-04-25T02:09:22.133 INFO:tasks.workunit.client.1.smithi112.stdout:5/974: creat d1/d16/d51/d93/d11f/d1d/f146 x:0 0 0 2024-04-25T02:09:22.134 INFO:tasks.workunit.client.1.smithi112.stdout:9/993: dread d1/d13/f20 [0,4194304] 0 2024-04-25T02:09:22.134 INFO:tasks.workunit.client.1.smithi112.stdout:9/994: write d1/fd1 [1562377,64206] 0 2024-04-25T02:09:22.134 INFO:tasks.workunit.client.1.smithi112.stdout:9/995: creat d1/d48/d65/d73/daf/d63/deb/d100/d3c/d6c/dfd/f15d x:0 0 0 2024-04-25T02:09:22.138 INFO:tasks.workunit.client.1.smithi112.stdout:9/996: rmdir d1/d48/d65/d73/daf/d63/d139 39 2024-04-25T02:09:22.154 INFO:tasks.workunit.client.1.smithi112.stdout:5/975: dwrite d1/d16/d51/d93/d11f/f54 [0,4194304] 0 2024-04-25T02:09:22.159 INFO:tasks.workunit.client.1.smithi112.stdout:5/976: symlink d1/d16/l147 0 2024-04-25T02:09:22.159 INFO:tasks.workunit.client.1.smithi112.stdout:9/997: dwrite d1/d93/dc2/d116/f143 [0,4194304] 0 2024-04-25T02:09:22.159 INFO:tasks.workunit.client.1.smithi112.stdout:9/998: chown d1/d48/d65/d73/daf/d63/deb/d100/d3c/fab 36345 1 2024-04-25T02:09:22.178 INFO:tasks.workunit.client.1.smithi112.stdout:9/999: dwrite d1/d48/f87 [4194304,4194304] 0 2024-04-25T02:09:22.180 INFO:tasks.workunit.client.1.smithi112.stdout:5/977: dwrite d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d7b/d87/fe1 [0,4194304] 0 2024-04-25T02:09:22.191 INFO:tasks.workunit.client.1.smithi112.stdout:5/978: truncate d1/d2/d28/d4f/fb7 155116 0 2024-04-25T02:09:22.194 INFO:tasks.workunit.client.1.smithi112.stdout:5/979: getdents d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d7b/db2 0 2024-04-25T02:09:22.194 INFO:tasks.workunit.client.1.smithi112.stdout:5/980: write d1/d16/d51/d93/d11f/dc4/d9c/fe3 [4724023,35975] 0 2024-04-25T02:09:22.200 INFO:tasks.workunit.client.1.smithi112.stdout:5/981: unlink d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d96/ce6 0 2024-04-25T02:09:22.200 INFO:tasks.workunit.client.1.smithi112.stdout:5/982: dread - d1/f115 zero size 2024-04-25T02:09:22.200 INFO:tasks.workunit.client.1.smithi112.stdout:5/983: fdatasync d1/d16/d51/d93/d11f/dc4/d9c/f122 0 2024-04-25T02:09:22.204 INFO:tasks.workunit.client.1.smithi112.stdout:5/984: rename d1/d16/d51/d93/d11f/dc4/df3 to d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d7b/d148 0 2024-04-25T02:09:22.204 INFO:tasks.workunit.client.1.smithi112.stdout:5/985: fdatasync d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d79/d7a/da0/f120 0 2024-04-25T02:09:22.210 INFO:tasks.workunit.client.1.smithi112.stdout:5/986: mknod d1/d16/ddb/c149 0 2024-04-25T02:09:22.212 INFO:tasks.workunit.client.1.smithi112.stdout:5/987: symlink d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d7b/db2/dc0/ddf/de5/l14a 0 2024-04-25T02:09:22.212 INFO:tasks.workunit.client.1.smithi112.stdout:5/988: fdatasync d1/d16/d51/f145 0 2024-04-25T02:09:22.214 INFO:tasks.workunit.client.1.smithi112.stdout:5/989: rmdir d1/d2/d7d 39 2024-04-25T02:09:22.215 INFO:tasks.workunit.client.1.smithi112.stdout:5/990: mknod d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d7b/db2/dc0/ddf/de5/c14b 0 2024-04-25T02:09:22.218 INFO:tasks.workunit.client.1.smithi112.stdout:5/991: rename d1/d16/d22/f37 to d1/d16/f14c 0 2024-04-25T02:09:22.220 INFO:tasks.workunit.client.1.smithi112.stdout:5/992: creat d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d7b/db2/dc0/dcf/ddd/db6/f14d x:0 0 0 2024-04-25T02:09:22.221 INFO:tasks.workunit.client.1.smithi112.stdout:5/993: dread - d1/d16/d99/f113 zero size 2024-04-25T02:09:22.221 INFO:tasks.workunit.client.1.smithi112.stdout:5/994: truncate d1/d16/f73 1068985 0 2024-04-25T02:09:22.223 INFO:tasks.workunit.client.1.smithi112.stdout:5/995: mknod d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/c14e 0 2024-04-25T02:09:22.223 INFO:tasks.workunit.client.1.smithi112.stdout:5/996: readlink d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/d7b/db2/dc0/dcf/ddd/lea 0 2024-04-25T02:09:22.223 INFO:tasks.workunit.client.1.smithi112.stdout:5/997: chown d1/d2/f74 254393 1 2024-04-25T02:09:22.224 INFO:tasks.workunit.client.1.smithi112.stdout:5/998: fsync d1/d2/d78/f9b 0 2024-04-25T02:09:22.238 INFO:tasks.workunit.client.1.smithi112.stdout:5/999: dwrite d1/d16/d51/d93/d11f/d1d/dc9/d11a/d5b/f11d [0,4194304] 0 2024-04-25T02:09:22.312 INFO:tasks.workunit.client.1.smithi112.stdout:6/980: sync 2024-04-25T02:09:22.312 INFO:tasks.workunit.client.1.smithi112.stdout:3/952: sync 2024-04-25T02:09:22.313 INFO:tasks.workunit.client.1.smithi112.stdout:3/953: fsync d12/d1f/d27/fc5 0 2024-04-25T02:09:22.313 INFO:tasks.workunit.client.1.smithi112.stdout:6/981: write d0/d7b/dff/d10d/f145 [889026,4968] 0 2024-04-25T02:09:22.313 INFO:tasks.workunit.client.1.smithi112.stdout:3/954: write d12/d1f/d27/f52 [4975821,77885] 0 2024-04-25T02:09:22.318 INFO:tasks.workunit.client.1.smithi112.stdout:6/982: getdents d0/d2/da1 0 2024-04-25T02:09:22.321 INFO:tasks.workunit.client.1.smithi112.stdout:3/955: mkdir d12/d13/d13e 0 2024-04-25T02:09:22.324 INFO:tasks.workunit.client.1.smithi112.stdout:6/983: mkdir d0/d2/d3b/d14d 0 2024-04-25T02:09:22.328 INFO:tasks.workunit.client.1.smithi112.stdout:6/984: truncate d0/d2/d3b/f6f 1879994 0 2024-04-25T02:09:22.340 INFO:tasks.workunit.client.1.smithi112.stdout:3/956: dwrite d12/d13/f1b [0,4194304] 0 2024-04-25T02:09:22.357 INFO:tasks.workunit.client.1.smithi112.stdout:3/957: dwrite d12/d13/d34/fe2 [0,4194304] 0 2024-04-25T02:09:22.357 INFO:tasks.workunit.client.1.smithi112.stdout:3/958: write d12/d1f/d27/d44/fb6 [816449,49440] 0 2024-04-25T02:09:22.357 INFO:tasks.workunit.client.1.smithi112.stdout:3/959: readlink d12/d13/d34/d4a/l54 0 2024-04-25T02:09:22.362 INFO:tasks.workunit.client.1.smithi112.stdout:3/960: mkdir d12/d1f/d27/d44/d7e/d13f 0 2024-04-25T02:09:22.362 INFO:tasks.workunit.client.1.smithi112.stdout:3/961: chown d12/d13/f4d 1484 1 2024-04-25T02:09:22.363 INFO:tasks.workunit.client.1.smithi112.stdout:3/962: mknod d12/d1f/d27/d44/d73/d95/da5/d105/c140 0 2024-04-25T02:09:22.363 INFO:tasks.workunit.client.1.smithi112.stdout:3/963: dread d12/d13/d34/d4a/fce [0,4194304] 0 2024-04-25T02:09:22.380 INFO:tasks.workunit.client.1.smithi112.stdout:3/964: dwrite d12/d13/f1c [4194304,4194304] 0 2024-04-25T02:09:22.380 INFO:tasks.workunit.client.1.smithi112.stdout:3/965: readlink d12/d67/dd3/l132 0 2024-04-25T02:09:22.388 INFO:tasks.workunit.client.1.smithi112.stdout:3/966: dread d12/d13/d34/d78/f7f [0,4194304] 0 2024-04-25T02:09:22.390 INFO:tasks.workunit.client.1.smithi112.stdout:3/967: mkdir d12/d13/d34/d4a/d87/d141 0 2024-04-25T02:09:22.391 INFO:tasks.workunit.client.1.smithi112.stdout:3/968: dread d12/d13/d34/d78/d83/f9e [0,4194304] 0 2024-04-25T02:09:22.400 INFO:tasks.workunit.client.1.smithi112.stdout:3/969: read d12/f36 [1512002,92185] 0 2024-04-25T02:09:22.417 INFO:tasks.workunit.client.1.smithi112.stdout:3/970: dwrite d12/d13/d34/f48 [0,4194304] 0 2024-04-25T02:09:22.421 INFO:tasks.workunit.client.1.smithi112.stdout:3/971: write d12/d13/d34/f64 [1458905,47121] 0 2024-04-25T02:09:22.421 INFO:tasks.workunit.client.1.smithi112.stdout:3/972: truncate d12/d13/d34/d4a/d87/d10f/f118 4750314 0 2024-04-25T02:09:22.421 INFO:tasks.workunit.client.1.smithi112.stdout:3/973: chown d12/l12b 53761590 1 2024-04-25T02:09:22.421 INFO:tasks.workunit.client.1.smithi112.stdout:3/974: readlink d12/d1f/d27/d44/d73/d95/l131 0 2024-04-25T02:09:22.421 INFO:tasks.workunit.client.1.smithi112.stdout:3/975: fdatasync d12/d1f/d27/d44/f56 0 2024-04-25T02:09:22.421 INFO:tasks.workunit.client.1.smithi112.stdout:3/976: mknod d12/d1f/d27/df8/c142 0 2024-04-25T02:09:22.422 INFO:tasks.workunit.client.1.smithi112.stdout:3/977: readlink d12/d1f/daa/lb9 0 2024-04-25T02:09:22.423 INFO:tasks.workunit.client.1.smithi112.stdout:3/978: unlink d12/d1f/d27/d44/f56 0 2024-04-25T02:09:22.425 INFO:tasks.workunit.client.1.smithi112.stdout:3/979: symlink d12/d13/d34/d78/d91/d123/l143 0 2024-04-25T02:09:22.425 INFO:tasks.workunit.client.1.smithi112.stdout:3/980: truncate d12/d67/dbf/f13c 574193 0 2024-04-25T02:09:22.425 INFO:tasks.workunit.client.1.smithi112.stdout:3/981: rmdir d12/d1f/d27/df8/dd2 39 2024-04-25T02:09:22.427 INFO:tasks.workunit.client.1.smithi112.stdout:3/982: truncate d12/d1f/d27/d44/d73/d95/da5/d105/f110 1842561 0 2024-04-25T02:09:22.442 INFO:tasks.workunit.client.1.smithi112.stdout:3/983: dwrite d12/ff6 [0,4194304] 0 2024-04-25T02:09:22.447 INFO:tasks.workunit.client.1.smithi112.stdout:3/984: dread d12/d13/d34/d4a/f6b [0,4194304] 0 2024-04-25T02:09:22.447 INFO:tasks.workunit.client.1.smithi112.stdout:3/985: stat d12/d13/f8e 0 2024-04-25T02:09:22.448 INFO:tasks.workunit.client.1.smithi112.stdout:3/986: mknod d12/d1f/d27/d44/d7e/d13f/c144 0 2024-04-25T02:09:22.449 INFO:tasks.workunit.client.1.smithi112.stdout:3/987: symlink d12/d67/l145 0 2024-04-25T02:09:22.450 INFO:tasks.workunit.client.1.smithi112.stdout:3/988: write d12/d1f/daa/dfa/f13d [218837,117285] 0 2024-04-25T02:09:22.451 INFO:tasks.workunit.client.1.smithi112.stdout:3/989: rename d12/d13/d34/d4a/d87/c9b to d12/d13/d34/d4a/d87/c146 0 2024-04-25T02:09:22.467 INFO:tasks.workunit.client.1.smithi112.stdout:3/990: dwrite d12/d1f/d27/d44/d73/d95/da5/db3/fb7 [0,4194304] 0 2024-04-25T02:09:22.471 INFO:tasks.workunit.client.1.smithi112.stdout:3/991: symlink d12/d1f/d27/l147 0 2024-04-25T02:09:22.473 INFO:tasks.workunit.client.1.smithi112.stdout:3/992: mknod d12/d13/c148 0 2024-04-25T02:09:22.481 INFO:tasks.workunit.client.1.smithi112.stdout:3/993: write d12/d13/d34/d78/d83/f93 [2386121,31749] 0 2024-04-25T02:09:22.562 INFO:tasks.workunit.client.1.smithi112.stdout:6/985: sync 2024-04-25T02:09:22.565 INFO:tasks.workunit.client.1.smithi112.stdout:6/986: creat d0/d2/d66/d7d/dc6/f14e x:0 0 0 2024-04-25T02:09:22.579 INFO:tasks.workunit.client.1.smithi112.stdout:6/987: write d0/f1a [3768220,75113] 0 2024-04-25T02:09:22.582 INFO:tasks.workunit.client.1.smithi112.stdout:6/988: link d0/d2/d3b/l126 d0/d7b/dff/l14f 0 2024-04-25T02:09:22.582 INFO:tasks.workunit.client.1.smithi112.stdout:6/989: read - d0/d2/d4/f84 zero size 2024-04-25T02:09:22.582 INFO:tasks.workunit.client.1.smithi112.stdout:6/990: chown d0/d2/fdb 232761909 1 2024-04-25T02:09:22.598 INFO:tasks.workunit.client.1.smithi112.stdout:6/991: dwrite d0/d2/d4/d28/fa2 [0,4194304] 0 2024-04-25T02:09:22.600 INFO:tasks.workunit.client.1.smithi112.stdout:6/992: mkdir d0/d2/d2c/d41/dce/d150 0 2024-04-25T02:09:22.609 INFO:tasks.workunit.client.1.smithi112.stdout:6/993: write d0/d2/d66/fe3 [227306,84472] 0 2024-04-25T02:09:22.611 INFO:tasks.workunit.client.1.smithi112.stdout:6/994: rename d0/d2/d4/d28/l56 to d0/d2/l151 0 2024-04-25T02:09:22.614 INFO:tasks.workunit.client.1.smithi112.stdout:6/995: symlink d0/d2/d79/l152 0 2024-04-25T02:09:22.615 INFO:tasks.workunit.client.1.smithi112.stdout:6/996: truncate d0/d2/d2c/ff5 1415185 0 2024-04-25T02:09:22.615 INFO:tasks.workunit.client.1.smithi112.stdout:6/997: read d0/d2/d2c/f3f [136703,38887] 0 2024-04-25T02:09:22.617 INFO:tasks.workunit.client.1.smithi112.stdout:6/998: mknod d0/d2/d3b/d53/d67/c153 0 2024-04-25T02:09:22.633 INFO:tasks.workunit.client.1.smithi112.stdout:6/999: dwrite d0/f17 [0,4194304] 0 2024-04-25T02:09:22.670 INFO:tasks.workunit.client.1.smithi112.stdout:3/994: sync 2024-04-25T02:09:22.678 INFO:tasks.workunit.client.1.smithi112.stdout:3/995: dread d12/d1f/d27/d44/d7e/fa3 [0,4194304] 0 2024-04-25T02:09:22.679 INFO:tasks.workunit.client.1.smithi112.stdout:3/996: getdents d12/d67/dd3/d102 0 2024-04-25T02:09:22.679 INFO:tasks.workunit.client.1.smithi112.stdout:3/997: chown d12/d5d 128230150 1 2024-04-25T02:09:22.680 INFO:tasks.workunit.client.1.smithi112.stdout:3/998: stat d12/d13/d34/d4a/d4f/da1/dea/c109 0 2024-04-25T02:09:22.680 INFO:tasks.workunit.client.1.smithi112.stdout:3/999: getdents d12/d1f/d27/df8/dd2 0 2024-04-25T02:09:22.682 INFO:tasks.workunit.client.1.smithi112.stderr:+ rm -rf -- ./tmp.6sAGee91Vn 2024-04-25T02:09:22.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.815+0000 7f61164f8700 1 -- 172.21.15.77:0/4078950158 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61100fed80 msgr2=0x7f61100faec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:22.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.815+0000 7f61164f8700 1 --2- 172.21.15.77:0/4078950158 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61100fed80 0x7f61100faec0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6104004940 tx=0x7f6104009e30 comp rx=0 tx=0).stop 2024-04-25T02:09:22.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.815+0000 7f61164f8700 1 -- 172.21.15.77:0/4078950158 shutdown_connections 2024-04-25T02:09:22.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.815+0000 7f61164f8700 1 --2- 172.21.15.77:0/4078950158 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61100fed80 0x7f61100faec0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:22.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.815+0000 7f61164f8700 1 --2- 172.21.15.77:0/4078950158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61100fe430 0x7f61100fe840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:22.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.815+0000 7f61164f8700 1 -- 172.21.15.77:0/4078950158 >> 172.21.15.77:0/4078950158 conn(0x7f61100f6bb0 msgr2=0x7f61100f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:22.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.815+0000 7f61164f8700 1 -- 172.21.15.77:0/4078950158 shutdown_connections 2024-04-25T02:09:22.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.815+0000 7f61164f8700 1 -- 172.21.15.77:0/4078950158 wait complete. 2024-04-25T02:09:22.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.815+0000 7f61164f8700 1 Processor -- start 2024-04-25T02:09:22.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.815+0000 7f61164f8700 1 -- start start 2024-04-25T02:09:22.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.815+0000 7f61164f8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61100fe430 0x7f611010d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:22.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.815+0000 7f61164f8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61100fed80 0x7f611010de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:22.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.816+0000 7f61164f8700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611010e460 con 0x7f61100fed80 2024-04-25T02:09:22.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.816+0000 7f61164f8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611010e5d0 con 0x7f61100fe430 2024-04-25T02:09:22.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.816+0000 7f610f7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61100fed80 0x7f611010de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:22.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.816+0000 7f610f7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61100fed80 0x7f611010de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40908/0 (socket says 172.21.15.77:40908) 2024-04-25T02:09:22.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.816+0000 7f610f7fe700 1 -- 172.21.15.77:0/3707921011 learned_addr learned my addr 172.21.15.77:0/3707921011 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:09:22.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.816+0000 7f610ffff700 1 --2- 172.21.15.77:0/3707921011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61100fe430 0x7f611010d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:22.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.816+0000 7f610f7fe700 1 -- 172.21.15.77:0/3707921011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61100fe430 msgr2=0x7f611010d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:22.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.816+0000 7f610f7fe700 1 --2- 172.21.15.77:0/3707921011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61100fe430 0x7f611010d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:22.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.816+0000 7f610f7fe700 1 -- 172.21.15.77:0/3707921011 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6104005040 con 0x7f61100fed80 2024-04-25T02:09:22.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.816+0000 7f610ffff700 1 --2- 172.21.15.77:0/3707921011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61100fe430 0x7f611010d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:22.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.816+0000 7f610f7fe700 1 --2- 172.21.15.77:0/3707921011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61100fed80 0x7f611010de60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6104013870 tx=0x7f6104009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:22.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.816+0000 7f610cff9700 1 -- 172.21.15.77:0/3707921011 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6104021070 con 0x7f61100fed80 2024-04-25T02:09:22.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.816+0000 7f61164f8700 1 -- 172.21.15.77:0/3707921011 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61100fbfd0 con 0x7f61100fed80 2024-04-25T02:09:22.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.816+0000 7f61164f8700 1 -- 172.21.15.77:0/3707921011 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61100fc4b0 con 0x7f61100fed80 2024-04-25T02:09:22.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.817+0000 7f610cff9700 1 -- 172.21.15.77:0/3707921011 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6104026410 con 0x7f61100fed80 2024-04-25T02:09:22.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.817+0000 7f610cff9700 1 -- 172.21.15.77:0/3707921011 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f610400e070 con 0x7f61100fed80 2024-04-25T02:09:22.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.817+0000 7f610cff9700 1 -- 172.21.15.77:0/3707921011 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) v1 ==== 46297+0+0 (secure 0 0 0) 0x7f610401c600 con 0x7f61100fed80 2024-04-25T02:09:22.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.818+0000 7f610cff9700 1 --2- 172.21.15.77:0/3707921011 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f60f8038f20 0x7f60f803b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:22.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.818+0000 7f610cff9700 1 -- 172.21.15.77:0/3707921011 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f610404ee20 con 0x7f61100fed80 2024-04-25T02:09:22.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.818+0000 7f61164f8700 1 -- 172.21.15.77:0/3707921011 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60fc0052e0 con 0x7f61100fed80 2024-04-25T02:09:22.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.818+0000 7f610ffff700 1 --2- 172.21.15.77:0/3707921011 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f60f8038f20 0x7f60f803b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:22.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.818+0000 7f610ffff700 1 --2- 172.21.15.77:0/3707921011 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f60f8038f20 0x7f60f803b3d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6100009b80 tx=0x7f610000b040 comp rx=0 tx=0).ready entity=mgr.24353 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:22.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:22.823+0000 7f610cff9700 1 -- 172.21.15.77:0/3707921011 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f610401cb80 con 0x7f61100fed80 2024-04-25T02:09:23.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:22 smithi112 ceph-mon[33313]: pgmap v5: 65 pgs: 65 active+clean; 2.5 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail 2024-04-25T02:09:23.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:22 smithi112 ceph-mon[33313]: mgrmap e24: smithi112.cswrxs(active, since 4s) 2024-04-25T02:09:23.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.062+0000 7f61164f8700 1 -- 172.21.15.77:0/3707921011 --> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f60fc000bf0 con 0x7f60f8038f20 2024-04-25T02:09:23.070 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:22 smithi077 ceph-mon[26330]: pgmap v5: 65 pgs: 65 active+clean; 2.5 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail 2024-04-25T02:09:23.070 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:22 smithi077 ceph-mon[26330]: mgrmap e24: smithi112.cswrxs(active, since 4s) 2024-04-25T02:09:23.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.071+0000 7f610cff9700 1 -- 172.21.15.77:0/3707921011 <== mgr.24353 v2:172.21.15.112:6828/218023931 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f60fc000bf0 con 0x7f60f8038f20 2024-04-25T02:09:23.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.073+0000 7f61164f8700 1 -- 172.21.15.77:0/3707921011 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f60f8038f20 msgr2=0x7f60f803b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:23.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.073+0000 7f61164f8700 1 --2- 172.21.15.77:0/3707921011 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f60f8038f20 0x7f60f803b3d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6100009b80 tx=0x7f610000b040 comp rx=0 tx=0).stop 2024-04-25T02:09:23.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.073+0000 7f61164f8700 1 -- 172.21.15.77:0/3707921011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61100fed80 msgr2=0x7f611010de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:23.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.073+0000 7f61164f8700 1 --2- 172.21.15.77:0/3707921011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61100fed80 0x7f611010de60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6104013870 tx=0x7f6104009e30 comp rx=0 tx=0).stop 2024-04-25T02:09:23.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.073+0000 7f61164f8700 1 -- 172.21.15.77:0/3707921011 shutdown_connections 2024-04-25T02:09:23.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.073+0000 7f61164f8700 1 --2- 172.21.15.77:0/3707921011 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f60f8038f20 0x7f60f803b3d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:23.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.073+0000 7f61164f8700 1 --2- 172.21.15.77:0/3707921011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61100fe430 0x7f611010d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:23.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.073+0000 7f61164f8700 1 --2- 172.21.15.77:0/3707921011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61100fed80 0x7f611010de60 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:23.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.073+0000 7f61164f8700 1 -- 172.21.15.77:0/3707921011 >> 172.21.15.77:0/3707921011 conn(0x7f61100f6bb0 msgr2=0x7f61100f8280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:23.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.073+0000 7f61164f8700 1 -- 172.21.15.77:0/3707921011 shutdown_connections 2024-04-25T02:09:23.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.073+0000 7f61164f8700 1 -- 172.21.15.77:0/3707921011 wait complete. 2024-04-25T02:09:23.092 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-04-25T02:09:23.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.184+0000 7fcb4d14c700 1 -- 172.21.15.77:0/3502378010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb48070810 msgr2=0x7fcb48070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:23.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.184+0000 7fcb4d14c700 1 --2- 172.21.15.77:0/3502378010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb48070810 0x7fcb48070c80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c004940 tx=0x7fcb3c009e30 comp rx=0 tx=0).stop 2024-04-25T02:09:23.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.185+0000 7fcb4d14c700 1 -- 172.21.15.77:0/3502378010 shutdown_connections 2024-04-25T02:09:23.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.185+0000 7fcb4d14c700 1 --2- 172.21.15.77:0/3502378010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb48070810 0x7fcb48070c80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:23.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.185+0000 7fcb4d14c700 1 --2- 172.21.15.77:0/3502378010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb48071dc0 0x7fcb480702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:23.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.185+0000 7fcb4d14c700 1 -- 172.21.15.77:0/3502378010 >> 172.21.15.77:0/3502378010 conn(0x7fcb480f85c0 msgr2=0x7fcb480fa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:23.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.185+0000 7fcb4d14c700 1 -- 172.21.15.77:0/3502378010 shutdown_connections 2024-04-25T02:09:23.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.185+0000 7fcb4d14c700 1 -- 172.21.15.77:0/3502378010 wait complete. 2024-04-25T02:09:23.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.185+0000 7fcb4d14c700 1 Processor -- start 2024-04-25T02:09:23.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.185+0000 7fcb4d14c700 1 -- start start 2024-04-25T02:09:23.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.186+0000 7fcb4d14c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb48070810 0x7fcb4810fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:23.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.186+0000 7fcb4d14c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb48071dc0 0x7fcb481100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:23.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.186+0000 7fcb4d14c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb481106e0 con 0x7fcb48071dc0 2024-04-25T02:09:23.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.186+0000 7fcb4d14c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb48110f30 con 0x7fcb48070810 2024-04-25T02:09:23.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.186+0000 7fcb4659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb48071dc0 0x7fcb481100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:23.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.186+0000 7fcb4659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb48071dc0 0x7fcb481100e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40924/0 (socket says 172.21.15.77:40924) 2024-04-25T02:09:23.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.186+0000 7fcb4659c700 1 -- 172.21.15.77:0/4081058970 learned_addr learned my addr 172.21.15.77:0/4081058970 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:09:23.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.186+0000 7fcb46d9d700 1 --2- 172.21.15.77:0/4081058970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb48070810 0x7fcb4810fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:23.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.186+0000 7fcb4659c700 1 -- 172.21.15.77:0/4081058970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb48070810 msgr2=0x7fcb4810fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:23.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.186+0000 7fcb4659c700 1 --2- 172.21.15.77:0/4081058970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb48070810 0x7fcb4810fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:23.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.186+0000 7fcb4659c700 1 -- 172.21.15.77:0/4081058970 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3c005040 con 0x7fcb48071dc0 2024-04-25T02:09:23.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.186+0000 7fcb4659c700 1 --2- 172.21.15.77:0/4081058970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb48071dc0 0x7fcb481100e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00b0d0 tx=0x7fcb3c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:23.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.186+0000 7fcb2f7fe700 1 -- 172.21.15.77:0/4081058970 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb3c00e030 con 0x7fcb48071dc0 2024-04-25T02:09:23.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.187+0000 7fcb4d14c700 1 -- 172.21.15.77:0/4081058970 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb481111b0 con 0x7fcb48071dc0 2024-04-25T02:09:23.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.187+0000 7fcb2f7fe700 1 -- 172.21.15.77:0/4081058970 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcb3c01c400 con 0x7fcb48071dc0 2024-04-25T02:09:23.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.187+0000 7fcb2f7fe700 1 -- 172.21.15.77:0/4081058970 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb3c00b630 con 0x7fcb48071dc0 2024-04-25T02:09:23.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.187+0000 7fcb4d14c700 1 -- 172.21.15.77:0/4081058970 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb481116f0 con 0x7fcb48071dc0 2024-04-25T02:09:23.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.187+0000 7fcb4d14c700 1 -- 172.21.15.77:0/4081058970 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb4805f5c0 con 0x7fcb48071dc0 2024-04-25T02:09:23.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.188+0000 7fcb2f7fe700 1 -- 172.21.15.77:0/4081058970 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) v1 ==== 46297+0+0 (secure 0 0 0) 0x7fcb3c00b8f0 con 0x7fcb48071dc0 2024-04-25T02:09:23.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.188+0000 7fcb2f7fe700 1 --2- 172.21.15.77:0/4081058970 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7fcb30038f10 0x7fcb3003b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:23.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.188+0000 7fcb2f7fe700 1 -- 172.21.15.77:0/4081058970 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fcb3c04e5e0 con 0x7fcb48071dc0 2024-04-25T02:09:23.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.188+0000 7fcb46d9d700 1 --2- 172.21.15.77:0/4081058970 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7fcb30038f10 0x7fcb3003b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:23.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.189+0000 7fcb46d9d700 1 --2- 172.21.15.77:0/4081058970 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7fcb30038f10 0x7fcb3003b3c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcb38009b80 tx=0x7fcb3800b040 comp rx=0 tx=0).ready entity=mgr.24353 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:23.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.193+0000 7fcb2f7fe700 1 -- 172.21.15.77:0/4081058970 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7fcb3c023360 con 0x7fcb48071dc0 2024-04-25T02:09:23.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.428+0000 7fcb4d14c700 1 -- 172.21.15.77:0/4081058970 --> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb48111ae0 con 0x7fcb30038f10 2024-04-25T02:09:23.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.432+0000 7fcb2f7fe700 1 -- 172.21.15.77:0/4081058970 <== mgr.24353 v2:172.21.15.112:6828/218023931 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fcb48111ae0 con 0x7fcb30038f10 2024-04-25T02:09:23.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.434+0000 7fcb4d14c700 1 -- 172.21.15.77:0/4081058970 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7fcb30038f10 msgr2=0x7fcb3003b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:23.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.434+0000 7fcb4d14c700 1 --2- 172.21.15.77:0/4081058970 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7fcb30038f10 0x7fcb3003b3c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcb38009b80 tx=0x7fcb3800b040 comp rx=0 tx=0).stop 2024-04-25T02:09:23.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.434+0000 7fcb4d14c700 1 -- 172.21.15.77:0/4081058970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb48071dc0 msgr2=0x7fcb481100e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:23.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.434+0000 7fcb4d14c700 1 --2- 172.21.15.77:0/4081058970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb48071dc0 0x7fcb481100e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00b0d0 tx=0x7fcb3c009e30 comp rx=0 tx=0).stop 2024-04-25T02:09:23.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.434+0000 7fcb4d14c700 1 -- 172.21.15.77:0/4081058970 shutdown_connections 2024-04-25T02:09:23.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.434+0000 7fcb4d14c700 1 --2- 172.21.15.77:0/4081058970 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7fcb30038f10 0x7fcb3003b3c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:23.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.434+0000 7fcb4d14c700 1 --2- 172.21.15.77:0/4081058970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb48070810 0x7fcb4810fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:23.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.434+0000 7fcb4d14c700 1 --2- 172.21.15.77:0/4081058970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb48071dc0 0x7fcb481100e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:23.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.434+0000 7fcb4d14c700 1 -- 172.21.15.77:0/4081058970 >> 172.21.15.77:0/4081058970 conn(0x7fcb480f85c0 msgr2=0x7fcb480f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:23.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.435+0000 7fcb4d14c700 1 -- 172.21.15.77:0/4081058970 shutdown_connections 2024-04-25T02:09:23.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.435+0000 7fcb4d14c700 1 -- 172.21.15.77:0/4081058970 wait complete. 2024-04-25T02:09:23.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.593+0000 7f7d1968f700 1 -- 172.21.15.77:0/1247498128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d140fff50 msgr2=0x7f7d14102330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:23.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.593+0000 7f7d1968f700 1 --2- 172.21.15.77:0/1247498128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d140fff50 0x7f7d14102330 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7d04004940 tx=0x7f7d04009e30 comp rx=0 tx=0).stop 2024-04-25T02:09:23.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.593+0000 7f7d1968f700 1 -- 172.21.15.77:0/1247498128 shutdown_connections 2024-04-25T02:09:23.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.593+0000 7f7d1968f700 1 --2- 172.21.15.77:0/1247498128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d140fff50 0x7f7d14102330 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:23.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.593+0000 7f7d1968f700 1 --2- 172.21.15.77:0/1247498128 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d14066af0 0x7f7d140ffa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:23.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.593+0000 7f7d1968f700 1 -- 172.21.15.77:0/1247498128 >> 172.21.15.77:0/1247498128 conn(0x7f7d140f7420 msgr2=0x7f7d140f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:23.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.595+0000 7f7d1968f700 1 -- 172.21.15.77:0/1247498128 shutdown_connections 2024-04-25T02:09:23.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.596+0000 7f7d1968f700 1 -- 172.21.15.77:0/1247498128 wait complete. 2024-04-25T02:09:23.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.597+0000 7f7d1968f700 1 Processor -- start 2024-04-25T02:09:23.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.597+0000 7f7d1968f700 1 -- start start 2024-04-25T02:09:23.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.597+0000 7f7d1968f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d14066af0 0x7f7d141140b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:23.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.597+0000 7f7d1968f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d140fff50 0x7f7d141145f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:23.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.597+0000 7f7d1968f700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d14114c80 con 0x7f7d140fff50 2024-04-25T02:09:23.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.597+0000 7f7d1968f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d14115410 con 0x7f7d14066af0 2024-04-25T02:09:23.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.598+0000 7f7d12ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d14066af0 0x7f7d141140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:23.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.598+0000 7f7d12ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d14066af0 0x7f7d141140b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.77:42190/0 (socket says 172.21.15.77:42190) 2024-04-25T02:09:23.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.598+0000 7f7d12ffd700 1 -- 172.21.15.77:0/2934893525 learned_addr learned my addr 172.21.15.77:0/2934893525 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:09:23.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.598+0000 7f7d127fc700 1 --2- 172.21.15.77:0/2934893525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d140fff50 0x7f7d141145f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:23.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.598+0000 7f7d12ffd700 1 -- 172.21.15.77:0/2934893525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d140fff50 msgr2=0x7f7d141145f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:23.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.598+0000 7f7d12ffd700 1 --2- 172.21.15.77:0/2934893525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d140fff50 0x7f7d141145f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:23.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.598+0000 7f7d12ffd700 1 -- 172.21.15.77:0/2934893525 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d04005040 con 0x7f7d14066af0 2024-04-25T02:09:23.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.599+0000 7f7d12ffd700 1 --2- 172.21.15.77:0/2934893525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d14066af0 0x7f7d141140b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7d0800b790 tx=0x7f7d08009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:23.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.599+0000 7f7cfb7fe700 1 -- 172.21.15.77:0/2934893525 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d0800f6f0 con 0x7f7d14066af0 2024-04-25T02:09:23.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.599+0000 7f7cfb7fe700 1 -- 172.21.15.77:0/2934893525 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7d0800fd20 con 0x7f7d14066af0 2024-04-25T02:09:23.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.599+0000 7f7d1968f700 1 -- 172.21.15.77:0/2934893525 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d141156f0 con 0x7f7d14066af0 2024-04-25T02:09:23.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.600+0000 7f7d1968f700 1 -- 172.21.15.77:0/2934893525 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d14115c50 con 0x7f7d14066af0 2024-04-25T02:09:23.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.600+0000 7f7cfb7fe700 1 -- 172.21.15.77:0/2934893525 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d080103a0 con 0x7f7d14066af0 2024-04-25T02:09:23.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.600+0000 7f7cfb7fe700 1 -- 172.21.15.77:0/2934893525 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 24) v1 ==== 46297+0+0 (secure 0 0 0) 0x7f7d080105c0 con 0x7f7d14066af0 2024-04-25T02:09:23.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.601+0000 7f7cfb7fe700 1 --2- 172.21.15.77:0/2934893525 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f7cfc038d00 0x7f7cfc03b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:23.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.601+0000 7f7cfb7fe700 1 -- 172.21.15.77:0/2934893525 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f7d0800fe90 con 0x7f7d14066af0 2024-04-25T02:09:23.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.601+0000 7f7d1968f700 1 -- 172.21.15.77:0/2934893525 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d1405f5c0 con 0x7f7d14066af0 2024-04-25T02:09:23.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.601+0000 7f7d127fc700 1 --2- 172.21.15.77:0/2934893525 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f7cfc038d00 0x7f7cfc03b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:23.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.603+0000 7f7d127fc700 1 --2- 172.21.15.77:0/2934893525 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f7cfc038d00 0x7f7cfc03b1b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7d0400b8b0 tx=0x7f7d04009e30 comp rx=0 tx=0).ready entity=mgr.24353 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:23.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.611+0000 7f7cfb7fe700 1 -- 172.21.15.77:0/2934893525 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f7d08010980 con 0x7f7d14066af0 2024-04-25T02:09:23.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.867+0000 7f7d1968f700 1 -- 172.21.15.77:0/2934893525 --> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d14115f80 con 0x7f7cfc038d00 2024-04-25T02:09:23.875 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:23 smithi077 ceph-mon[26330]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:23.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.896+0000 7f7cfb7fe700 1 -- 172.21.15.77:0/2934893525 <== mgr.24353 v2:172.21.15.112:6828/218023931 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f7d14115f80 con 0x7f7cfc038d00 2024-04-25T02:09:23.904 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T02:09:23.904 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (7m) 2m ago 8m 24.4M - 0.25.0 c8568f914cd2 54c6f8f4d32d 2024-04-25T02:09:23.904 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (8m) 2m ago 8m 6665k - 17.2.7-902-gc61472c8 0de407c1b3af 2ad2e3d2b09e 2024-04-25T02:09:23.904 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi112 smithi112 running (7m) 25s ago 7m 6660k - 17.2.7-902-gc61472c8 0de407c1b3af 9235dc5eb15d 2024-04-25T02:09:23.904 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (7m) 2m ago 8m 85.0M - 9.4.7 954c08fa6188 d3b9c1566a82 2024-04-25T02:09:23.904 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.gcfygj smithi077 running (3m) 2m ago 3m 12.1M - 17.2.7-902-gc61472c8 0de407c1b3af 382dd7abf674 2024-04-25T02:09:23.904 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.oadrkb smithi077 running (3m) 2m ago 3m 10.4M - 17.2.7-902-gc61472c8 0de407c1b3af 6992064a4b2a 2024-04-25T02:09:23.904 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.dvwudt smithi112 running (3m) 25s ago 3m 200M - 17.2.7-902-gc61472c8 0de407c1b3af 0792e451abfd 2024-04-25T02:09:23.904 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.fjnadi smithi112 running (3m) 25s ago 3m 12.5M - 17.2.7-902-gc61472c8 0de407c1b3af c8093f622f6b 2024-04-25T02:09:23.905 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.zpflzp smithi077 *:9283 running (9m) 2m ago 9m 481M - 17.2.7-902-gc61472c8 0de407c1b3af 8c5e41dfcae2 2024-04-25T02:09:23.905 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi112.cswrxs smithi112 *:8443,9283 running (38s) 25s ago 7m 97.5M - 19.0.0-2445-gd2c45d97 f68e37b807ef 89564cfe9a4c 2024-04-25T02:09:23.905 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (9m) 2m ago 10m 42.5M 2048M 17.2.7-902-gc61472c8 0de407c1b3af adb57965a306 2024-04-25T02:09:23.905 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi112 smithi112 running (7m) 25s ago 7m 34.4M 2048M 17.2.7-902-gc61472c8 0de407c1b3af db2fb9b09789 2024-04-25T02:09:23.905 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (8m) 2m ago 8m 15.3M - 1.5.0 0da6a335fe13 ec91684b7e6d 2024-04-25T02:09:23.905 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi112 smithi112 *:9100 running (7m) 25s ago 7m 16.4M - 1.5.0 0da6a335fe13 3a7c783c933b 2024-04-25T02:09:23.905 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (6m) 2m ago 6m 44.9M 4288M 17.2.7-902-gc61472c8 0de407c1b3af c741abec3b94 2024-04-25T02:09:23.905 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (6m) 2m ago 6m 44.7M 4288M 17.2.7-902-gc61472c8 0de407c1b3af 256ff3ced322 2024-04-25T02:09:23.905 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (5m) 2m ago 5m 47.4M 4288M 17.2.7-902-gc61472c8 0de407c1b3af c5d7d8c993f4 2024-04-25T02:09:23.905 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi112 running (5m) 25s ago 5m 242M 5312M 17.2.7-902-gc61472c8 0de407c1b3af 68429d0dbf88 2024-04-25T02:09:23.905 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi112 running (5m) 25s ago 5m 212M 5312M 17.2.7-902-gc61472c8 0de407c1b3af 66eb71201444 2024-04-25T02:09:23.905 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi112 running (4m) 25s ago 4m 236M 5312M 17.2.7-902-gc61472c8 0de407c1b3af 963e700d6aea 2024-04-25T02:09:23.905 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (6m) 2m ago 8m 51.4M - 2.43.0 a07b618ecd1d 85f5766c90c7 2024-04-25T02:09:23.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.898+0000 7f7d1968f700 1 -- 172.21.15.77:0/2934893525 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f7cfc038d00 msgr2=0x7f7cfc03b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:23.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.898+0000 7f7d1968f700 1 --2- 172.21.15.77:0/2934893525 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f7cfc038d00 0x7f7cfc03b1b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7d0400b8b0 tx=0x7f7d04009e30 comp rx=0 tx=0).stop 2024-04-25T02:09:23.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.898+0000 7f7d1968f700 1 -- 172.21.15.77:0/2934893525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d14066af0 msgr2=0x7f7d141140b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:23.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.898+0000 7f7d1968f700 1 --2- 172.21.15.77:0/2934893525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d14066af0 0x7f7d141140b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7d0800b790 tx=0x7f7d08009220 comp rx=0 tx=0).stop 2024-04-25T02:09:23.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.898+0000 7f7d1968f700 1 -- 172.21.15.77:0/2934893525 shutdown_connections 2024-04-25T02:09:23.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.898+0000 7f7d1968f700 1 --2- 172.21.15.77:0/2934893525 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f7cfc038d00 0x7f7cfc03b1b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:23.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.898+0000 7f7d1968f700 1 --2- 172.21.15.77:0/2934893525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d14066af0 0x7f7d141140b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:23.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.898+0000 7f7d1968f700 1 --2- 172.21.15.77:0/2934893525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d140fff50 0x7f7d141145f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:23.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.898+0000 7f7d1968f700 1 -- 172.21.15.77:0/2934893525 >> 172.21.15.77:0/2934893525 conn(0x7f7d140f7420 msgr2=0x7f7d14100320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:23.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.898+0000 7f7d1968f700 1 -- 172.21.15.77:0/2934893525 shutdown_connections 2024-04-25T02:09:23.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:23.899+0000 7f7d1968f700 1 -- 172.21.15.77:0/2934893525 wait complete. 2024-04-25T02:09:24.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.006+0000 7fc1d5062700 1 -- 172.21.15.77:0/2368739235 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1d00fbce0 msgr2=0x7fc1d00fc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.006+0000 7fc1d5062700 1 --2- 172.21.15.77:0/2368739235 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1d00fbce0 0x7fc1d00fc0f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0004940 tx=0x7fc1c0009e30 comp rx=0 tx=0).stop 2024-04-25T02:09:24.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.006+0000 7fc1d5062700 1 -- 172.21.15.77:0/2368739235 shutdown_connections 2024-04-25T02:09:24.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.006+0000 7fc1d5062700 1 --2- 172.21.15.77:0/2368739235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1d00fcf90 0x7fc1d00fd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.006+0000 7fc1d5062700 1 --2- 172.21.15.77:0/2368739235 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1d00fbce0 0x7fc1d00fc0f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.006+0000 7fc1d5062700 1 -- 172.21.15.77:0/2368739235 >> 172.21.15.77:0/2368739235 conn(0x7fc1d00f7440 msgr2=0x7fc1d00f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:24.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.006+0000 7fc1d5062700 1 -- 172.21.15.77:0/2368739235 shutdown_connections 2024-04-25T02:09:24.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.006+0000 7fc1d5062700 1 -- 172.21.15.77:0/2368739235 wait complete. 2024-04-25T02:09:24.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.007+0000 7fc1d5062700 1 Processor -- start 2024-04-25T02:09:24.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.007+0000 7fc1d5062700 1 -- start start 2024-04-25T02:09:24.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.007+0000 7fc1d5062700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1d00fbce0 0x7fc1d0066cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:24.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.007+0000 7fc1d5062700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1d00fcf90 0x7fc1d0114ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:24.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.007+0000 7fc1d5062700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d010e4a0 con 0x7fc1d00fbce0 2024-04-25T02:09:24.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.007+0000 7fc1d5062700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d0115000 con 0x7fc1d00fcf90 2024-04-25T02:09:24.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.007+0000 7fc1ced9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1d00fbce0 0x7fc1d0066cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:24.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.007+0000 7fc1ced9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1d00fbce0 0x7fc1d0066cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40966/0 (socket says 172.21.15.77:40966) 2024-04-25T02:09:24.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.007+0000 7fc1ced9d700 1 -- 172.21.15.77:0/1269969360 learned_addr learned my addr 172.21.15.77:0/1269969360 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:09:24.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.007+0000 7fc1ce59c700 1 --2- 172.21.15.77:0/1269969360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1d00fcf90 0x7fc1d0114ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:24.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.007+0000 7fc1ced9d700 1 -- 172.21.15.77:0/1269969360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1d00fcf90 msgr2=0x7fc1d0114ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.007+0000 7fc1ced9d700 1 --2- 172.21.15.77:0/1269969360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1d00fcf90 0x7fc1d0114ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.007+0000 7fc1ced9d700 1 -- 172.21.15.77:0/1269969360 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c0005040 con 0x7fc1d00fbce0 2024-04-25T02:09:24.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.007+0000 7fc1ce59c700 1 --2- 172.21.15.77:0/1269969360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1d00fcf90 0x7fc1d0114ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:24.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.008+0000 7fc1ced9d700 1 --2- 172.21.15.77:0/1269969360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1d00fbce0 0x7fc1d0066cf0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009040 tx=0x7fc1c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:24.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.008+0000 7fc1b77fe700 1 -- 172.21.15.77:0/1269969360 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1c0021070 con 0x7fc1d00fbce0 2024-04-25T02:09:24.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.008+0000 7fc1d5062700 1 -- 172.21.15.77:0/1269969360 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d01151a0 con 0x7fc1d00fbce0 2024-04-25T02:09:24.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.008+0000 7fc1b77fe700 1 -- 172.21.15.77:0/1269969360 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc1c0009430 con 0x7fc1d00fbce0 2024-04-25T02:09:24.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.008+0000 7fc1b77fe700 1 -- 172.21.15.77:0/1269969360 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1c000e070 con 0x7fc1d00fbce0 2024-04-25T02:09:24.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.008+0000 7fc1d5062700 1 -- 172.21.15.77:0/1269969360 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d0115690 con 0x7fc1d00fbce0 2024-04-25T02:09:24.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.009+0000 7fc1b77fe700 1 -- 172.21.15.77:0/1269969360 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) v1 ==== 46297+0+0 (secure 0 0 0) 0x7fc1c0026410 con 0x7fc1d00fbce0 2024-04-25T02:09:24.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.009+0000 7fc1b77fe700 1 --2- 172.21.15.77:0/1269969360 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7fc1b8038f20 0x7fc1b803b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:24.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.009+0000 7fc1b77fe700 1 -- 172.21.15.77:0/1269969360 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc1c004ee80 con 0x7fc1d00fbce0 2024-04-25T02:09:24.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.009+0000 7fc1d5062700 1 -- 172.21.15.77:0/1269969360 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d004c710 con 0x7fc1d00fbce0 2024-04-25T02:09:24.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.009+0000 7fc1ce59c700 1 --2- 172.21.15.77:0/1269969360 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7fc1b8038f20 0x7fc1b803b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:24.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.010+0000 7fc1ce59c700 1 --2- 172.21.15.77:0/1269969360 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7fc1b8038f20 0x7fc1b803b3d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4004fd0 tx=0x7fc1c400b040 comp rx=0 tx=0).ready entity=mgr.24353 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:24.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.014+0000 7fc1b77fe700 1 -- 172.21.15.77:0/1269969360 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7fc1c00123c0 con 0x7fc1d00fbce0 2024-04-25T02:09:24.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:23 smithi112 ceph-mon[33313]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:24.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.323+0000 7fc1d5062700 1 -- 172.21.15.77:0/1269969360 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc1d0115ad0 con 0x7fc1d00fbce0 2024-04-25T02:09:24.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.323+0000 7fc1b77fe700 1 -- 172.21.15.77:0/1269969360 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7fc1c001bed0 con 0x7fc1d00fbce0 2024-04-25T02:09:24.332 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:09:24.332 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-04-25T02:09:24.332 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2 2024-04-25T02:09:24.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:09:24.332 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-04-25T02:09:24.332 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 1 2024-04-25T02:09:24.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:09:24.332 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-04-25T02:09:24.332 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 6 2024-04-25T02:09:24.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:09:24.332 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-04-25T02:09:24.332 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T02:09:24.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:09:24.333 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-04-25T02:09:24.333 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 12, 2024-04-25T02:09:24.333 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 1 2024-04-25T02:09:24.333 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-25T02:09:24.333 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:09:24.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.325+0000 7fc1d5062700 1 -- 172.21.15.77:0/1269969360 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7fc1b8038f20 msgr2=0x7fc1b803b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.325+0000 7fc1d5062700 1 --2- 172.21.15.77:0/1269969360 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7fc1b8038f20 0x7fc1b803b3d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4004fd0 tx=0x7fc1c400b040 comp rx=0 tx=0).stop 2024-04-25T02:09:24.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.325+0000 7fc1d5062700 1 -- 172.21.15.77:0/1269969360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1d00fbce0 msgr2=0x7fc1d0066cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.325+0000 7fc1d5062700 1 --2- 172.21.15.77:0/1269969360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1d00fbce0 0x7fc1d0066cf0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009040 tx=0x7fc1c0009e30 comp rx=0 tx=0).stop 2024-04-25T02:09:24.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.325+0000 7fc1d5062700 1 -- 172.21.15.77:0/1269969360 shutdown_connections 2024-04-25T02:09:24.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.325+0000 7fc1d5062700 1 --2- 172.21.15.77:0/1269969360 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7fc1b8038f20 0x7fc1b803b3d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.325+0000 7fc1d5062700 1 --2- 172.21.15.77:0/1269969360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1d00fbce0 0x7fc1d0066cf0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.325+0000 7fc1d5062700 1 --2- 172.21.15.77:0/1269969360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1d00fcf90 0x7fc1d0114ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.325+0000 7fc1d5062700 1 -- 172.21.15.77:0/1269969360 >> 172.21.15.77:0/1269969360 conn(0x7fc1d00f7440 msgr2=0x7fc1d00f8a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:24.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.325+0000 7fc1d5062700 1 -- 172.21.15.77:0/1269969360 shutdown_connections 2024-04-25T02:09:24.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.325+0000 7fc1d5062700 1 -- 172.21.15.77:0/1269969360 wait complete. 2024-04-25T02:09:24.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.433+0000 7effd2ac4700 1 -- 172.21.15.77:0/2243969513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effcc0fffb0 msgr2=0x7effcc102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.433+0000 7effd2ac4700 1 --2- 172.21.15.77:0/2243969513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effcc0fffb0 0x7effcc102390 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7effb8004940 tx=0x7effb8009e30 comp rx=0 tx=0).stop 2024-04-25T02:09:24.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.433+0000 7effd2ac4700 1 -- 172.21.15.77:0/2243969513 shutdown_connections 2024-04-25T02:09:24.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.433+0000 7effd2ac4700 1 --2- 172.21.15.77:0/2243969513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effcc0fffb0 0x7effcc102390 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.433+0000 7effd2ac4700 1 --2- 172.21.15.77:0/2243969513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effcc066b10 0x7effcc0ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.433+0000 7effd2ac4700 1 -- 172.21.15.77:0/2243969513 >> 172.21.15.77:0/2243969513 conn(0x7effcc0f74c0 msgr2=0x7effcc0f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:24.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.434+0000 7effd2ac4700 1 -- 172.21.15.77:0/2243969513 shutdown_connections 2024-04-25T02:09:24.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.434+0000 7effd2ac4700 1 -- 172.21.15.77:0/2243969513 wait complete. 2024-04-25T02:09:24.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.434+0000 7effd2ac4700 1 Processor -- start 2024-04-25T02:09:24.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.435+0000 7effd2ac4700 1 -- start start 2024-04-25T02:09:24.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.435+0000 7effd2ac4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effcc066b10 0x7effcc0fd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:24.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.435+0000 7effd2ac4700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effcc0fffb0 0x7effcc0fb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:24.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.435+0000 7effd2ac4700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effcc111630 con 0x7effcc0fffb0 2024-04-25T02:09:24.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.435+0000 7effd2ac4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effcc111770 con 0x7effcc066b10 2024-04-25T02:09:24.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.435+0000 7effcbfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effcc0fffb0 0x7effcc0fb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:24.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.435+0000 7effd0860700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effcc066b10 0x7effcc0fd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:24.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.435+0000 7effcbfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effcc0fffb0 0x7effcc0fb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40978/0 (socket says 172.21.15.77:40978) 2024-04-25T02:09:24.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.435+0000 7effcbfff700 1 -- 172.21.15.77:0/3434644197 learned_addr learned my addr 172.21.15.77:0/3434644197 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:09:24.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.435+0000 7effd0860700 1 -- 172.21.15.77:0/3434644197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effcc0fffb0 msgr2=0x7effcc0fb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.435+0000 7effd0860700 1 --2- 172.21.15.77:0/3434644197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effcc0fffb0 0x7effcc0fb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.435+0000 7effd0860700 1 -- 172.21.15.77:0/3434644197 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb8005040 con 0x7effcc066b10 2024-04-25T02:09:24.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.435+0000 7effcbfff700 1 --2- 172.21.15.77:0/3434644197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effcc0fffb0 0x7effcc0fb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:24.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.436+0000 7effd0860700 1 --2- 172.21.15.77:0/3434644197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effcc066b10 0x7effcc0fd450 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7effcc066850 tx=0x7effc000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:24.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.436+0000 7effc97fa700 1 -- 172.21.15.77:0/3434644197 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effc0004e90 con 0x7effcc066b10 2024-04-25T02:09:24.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.436+0000 7effd2ac4700 1 -- 172.21.15.77:0/3434644197 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effcc0fbf10 con 0x7effcc066b10 2024-04-25T02:09:24.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.436+0000 7effd2ac4700 1 -- 172.21.15.77:0/3434644197 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effcc0fc450 con 0x7effcc066b10 2024-04-25T02:09:24.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.436+0000 7effc97fa700 1 -- 172.21.15.77:0/3434644197 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7effc000f040 con 0x7effcc066b10 2024-04-25T02:09:24.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.436+0000 7effc97fa700 1 -- 172.21.15.77:0/3434644197 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effc000c980 con 0x7effcc066b10 2024-04-25T02:09:24.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.437+0000 7effc97fa700 1 -- 172.21.15.77:0/3434644197 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 24) v1 ==== 46297+0+0 (secure 0 0 0) 0x7effc000cae0 con 0x7effcc066b10 2024-04-25T02:09:24.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.437+0000 7effc97fa700 1 --2- 172.21.15.77:0/3434644197 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7effbc038f10 0x7effbc03b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:24.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.437+0000 7effc97fa700 1 -- 172.21.15.77:0/3434644197 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7effc004c5b0 con 0x7effcc066b10 2024-04-25T02:09:24.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.437+0000 7effcbfff700 1 --2- 172.21.15.77:0/3434644197 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7effbc038f10 0x7effbc03b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:24.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.437+0000 7effd2ac4700 1 -- 172.21.15.77:0/3434644197 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effcc05f5c0 con 0x7effcc066b10 2024-04-25T02:09:24.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.438+0000 7effcbfff700 1 --2- 172.21.15.77:0/3434644197 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7effbc038f10 0x7effbc03b3c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7effcc0fda30 tx=0x7effb8009e30 comp rx=0 tx=0).ready entity=mgr.24353 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:24.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.443+0000 7effc97fa700 1 -- 172.21.15.77:0/3434644197 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7effc001b2c0 con 0x7effcc066b10 2024-04-25T02:09:24.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.722+0000 7effd2ac4700 1 -- 172.21.15.77:0/3434644197 --> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7effcc1059c0 con 0x7effbc038f10 2024-04-25T02:09:24.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.726+0000 7effc97fa700 1 -- 172.21.15.77:0/3434644197 <== mgr.24353 v2:172.21.15.112:6828/218023931 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7effcc1059c0 con 0x7effbc038f10 2024-04-25T02:09:24.734 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:09:24.734 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901", 2024-04-25T02:09:24.735 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-04-25T02:09:24.735 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-25T02:09:24.735 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [], 2024-04-25T02:09:24.735 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "1/2 daemons upgraded", 2024-04-25T02:09:24.735 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "", 2024-04-25T02:09:24.735 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-04-25T02:09:24.735 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:09:24.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.729+0000 7effd2ac4700 1 -- 172.21.15.77:0/3434644197 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7effbc038f10 msgr2=0x7effbc03b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.729+0000 7effd2ac4700 1 --2- 172.21.15.77:0/3434644197 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7effbc038f10 0x7effbc03b3c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7effcc0fda30 tx=0x7effb8009e30 comp rx=0 tx=0).stop 2024-04-25T02:09:24.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.729+0000 7effd2ac4700 1 -- 172.21.15.77:0/3434644197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effcc066b10 msgr2=0x7effcc0fd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.729+0000 7effd2ac4700 1 --2- 172.21.15.77:0/3434644197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effcc066b10 0x7effcc0fd450 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7effcc066850 tx=0x7effc000b040 comp rx=0 tx=0).stop 2024-04-25T02:09:24.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.729+0000 7effd2ac4700 1 -- 172.21.15.77:0/3434644197 shutdown_connections 2024-04-25T02:09:24.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.729+0000 7effd2ac4700 1 --2- 172.21.15.77:0/3434644197 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7effbc038f10 0x7effbc03b3c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.729+0000 7effd2ac4700 1 --2- 172.21.15.77:0/3434644197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effcc066b10 0x7effcc0fd450 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.729+0000 7effd2ac4700 1 --2- 172.21.15.77:0/3434644197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effcc0fffb0 0x7effcc0fb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.729+0000 7effd2ac4700 1 -- 172.21.15.77:0/3434644197 >> 172.21.15.77:0/3434644197 conn(0x7effcc0f74c0 msgr2=0x7effcc0f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:24.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.729+0000 7effd2ac4700 1 -- 172.21.15.77:0/3434644197 shutdown_connections 2024-04-25T02:09:24.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:24.729+0000 7effd2ac4700 1 -- 172.21.15.77:0/3434644197 wait complete. 2024-04-25T02:09:25.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:24 smithi112 ceph-mon[33313]: from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:25.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:24 smithi112 ceph-mon[33313]: pgmap v6: 65 pgs: 65 active+clean; 2.5 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail 2024-04-25T02:09:25.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:24 smithi112 ceph-mon[33313]: from='client.24399 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:25.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:24 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/1269969360' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:09:25.046 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:24 smithi077 ceph-mon[26330]: from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:25.046 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:24 smithi077 ceph-mon[26330]: pgmap v6: 65 pgs: 65 active+clean; 2.5 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail 2024-04-25T02:09:25.047 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:24 smithi077 ceph-mon[26330]: from='client.24399 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:25.047 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:24 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/1269969360' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:09:26.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:25 smithi112 ceph-mon[33313]: from='client.24407 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:26.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:25 smithi112 ceph-mon[33313]: Standby manager daemon smithi077.zpflzp started 2024-04-25T02:09:26.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:25 smithi112 ceph-mon[33313]: from='mgr.? 172.21.15.77:0/80389237' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi077.zpflzp/crt"}]: dispatch 2024-04-25T02:09:26.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:25 smithi112 ceph-mon[33313]: from='mgr.? 172.21.15.77:0/80389237' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T02:09:26.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:25 smithi112 ceph-mon[33313]: from='mgr.? 172.21.15.77:0/80389237' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi077.zpflzp/key"}]: dispatch 2024-04-25T02:09:26.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:25 smithi112 ceph-mon[33313]: from='mgr.? 172.21.15.77:0/80389237' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T02:09:26.143 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:25 smithi077 ceph-mon[26330]: from='client.24407 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:26.143 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:25 smithi077 ceph-mon[26330]: Standby manager daemon smithi077.zpflzp started 2024-04-25T02:09:26.143 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:25 smithi077 ceph-mon[26330]: from='mgr.? 172.21.15.77:0/80389237' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi077.zpflzp/crt"}]: dispatch 2024-04-25T02:09:26.143 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:25 smithi077 ceph-mon[26330]: from='mgr.? 172.21.15.77:0/80389237' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T02:09:26.143 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:25 smithi077 ceph-mon[26330]: from='mgr.? 172.21.15.77:0/80389237' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi077.zpflzp/key"}]: dispatch 2024-04-25T02:09:26.143 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:25 smithi077 ceph-mon[26330]: from='mgr.? 172.21.15.77:0/80389237' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T02:09:27.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:26 smithi112 ceph-mon[33313]: pgmap v7: 65 pgs: 65 active+clean; 2.2 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 72 MiB/s rd, 77 MiB/s wr, 230 op/s 2024-04-25T02:09:27.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:26 smithi112 ceph-mon[33313]: mgrmap e25: smithi112.cswrxs(active, since 8s), standbys: smithi077.zpflzp 2024-04-25T02:09:27.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:26 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "mgr metadata", "who": "smithi077.zpflzp", "id": "smithi077.zpflzp"}]: dispatch 2024-04-25T02:09:27.040 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:26 smithi077 ceph-mon[26330]: pgmap v7: 65 pgs: 65 active+clean; 2.2 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 72 MiB/s rd, 77 MiB/s wr, 230 op/s 2024-04-25T02:09:27.040 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:26 smithi077 ceph-mon[26330]: mgrmap e25: smithi112.cswrxs(active, since 8s), standbys: smithi077.zpflzp 2024-04-25T02:09:27.040 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:26 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "mgr metadata", "who": "smithi077.zpflzp", "id": "smithi077.zpflzp"}]: dispatch 2024-04-25T02:09:29.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:28 smithi112 ceph-mon[33313]: pgmap v8: 65 pgs: 65 active+clean; 2.2 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 56 MiB/s rd, 60 MiB/s wr, 179 op/s 2024-04-25T02:09:29.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:28 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:29.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:28 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:29.133 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:28 smithi077 ceph-mon[26330]: pgmap v8: 65 pgs: 65 active+clean; 2.2 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 56 MiB/s rd, 60 MiB/s wr, 179 op/s 2024-04-25T02:09:29.133 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:28 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:29.133 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:28 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:31.173 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:30 smithi112 ceph-mon[33313]: pgmap v9: 65 pgs: 65 active+clean; 1.7 GiB data, 6.9 GiB used, 529 GiB / 536 GiB avail; 46 MiB/s rd, 50 MiB/s wr, 286 op/s 2024-04-25T02:09:31.173 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:30 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:31.173 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:30 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:31.173 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:30 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:31.174 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:30 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:31.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:30 smithi077 ceph-mon[26330]: pgmap v9: 65 pgs: 65 active+clean; 1.7 GiB data, 6.9 GiB used, 529 GiB / 536 GiB avail; 46 MiB/s rd, 50 MiB/s wr, 286 op/s 2024-04-25T02:09:31.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:30 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:31.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:30 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:31.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:30 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:31.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:30 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:32.238 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:32 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:32.238 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:32 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:32.238 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:32 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:32.238 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:32 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:32.238 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:32 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:32.238 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:32 smithi112 ceph-mon[33313]: Adjusting osd_memory_target on smithi077 to 1557M 2024-04-25T02:09:32.238 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:32 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:32.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:32 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:32.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:32 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:32.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:32 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:32.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:32 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:32.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:32 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:32.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:32 smithi077 ceph-mon[26330]: Adjusting osd_memory_target on smithi077 to 1557M 2024-04-25T02:09:32.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:32 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:33.417 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:33 smithi112 ceph-mon[33313]: pgmap v10: 65 pgs: 65 active+clean; 1.7 GiB data, 6.9 GiB used, 529 GiB / 536 GiB avail; 42 MiB/s rd, 46 MiB/s wr, 262 op/s 2024-04-25T02:09:33.418 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:33 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:09:33.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:33 smithi077 ceph-mon[26330]: pgmap v10: 65 pgs: 65 active+clean; 1.7 GiB data, 6.9 GiB used, 529 GiB / 536 GiB avail; 42 MiB/s rd, 46 MiB/s wr, 262 op/s 2024-04-25T02:09:33.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:33 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:09:35.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:35 smithi112 ceph-mon[33313]: pgmap v11: 65 pgs: 65 active+clean; 1.7 GiB data, 6.9 GiB used, 529 GiB / 536 GiB avail; 42 MiB/s rd, 46 MiB/s wr, 262 op/s 2024-04-25T02:09:35.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:35 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:35.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:35 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:35.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:35 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:35.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:35 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:35.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:35 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:35.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:35 smithi112 ceph-mon[33313]: Adjusting osd_memory_target on smithi112 to 2581M 2024-04-25T02:09:35.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:35 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:35.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:35 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:09:35.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:35 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:09:35.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:35 smithi112 ceph-mon[33313]: Updating smithi077:/etc/ceph/ceph.conf 2024-04-25T02:09:35.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:35 smithi112 ceph-mon[33313]: Updating smithi112:/etc/ceph/ceph.conf 2024-04-25T02:09:35.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:35 smithi077 ceph-mon[26330]: pgmap v11: 65 pgs: 65 active+clean; 1.7 GiB data, 6.9 GiB used, 529 GiB / 536 GiB avail; 42 MiB/s rd, 46 MiB/s wr, 262 op/s 2024-04-25T02:09:35.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:35 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:35.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:35 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:35.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:35 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:35.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:35 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:35.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:35 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:35.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:35 smithi077 ceph-mon[26330]: Adjusting osd_memory_target on smithi112 to 2581M 2024-04-25T02:09:35.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:35 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:35.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:35 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:09:35.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:35 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:09:35.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:35 smithi077 ceph-mon[26330]: Updating smithi077:/etc/ceph/ceph.conf 2024-04-25T02:09:35.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:35 smithi077 ceph-mon[26330]: Updating smithi112:/etc/ceph/ceph.conf 2024-04-25T02:09:36.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:36 smithi077 ceph-mon[26330]: Updating smithi077:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:09:36.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:36 smithi077 ceph-mon[26330]: Updating smithi112:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:09:36.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:36 smithi077 ceph-mon[26330]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:09:36.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:36 smithi077 ceph-mon[26330]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:09:36.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:36 smithi077 ceph-mon[26330]: Updating smithi077:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:09:36.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:36 smithi077 ceph-mon[26330]: Updating smithi112:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:09:36.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:36 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:36.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:36 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:36.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:36 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:36.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:36 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:36.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:36 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:36.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:36 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:36.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:36 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:36.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:36 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:36.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:36 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:36.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:36 smithi112 ceph-mon[33313]: Updating smithi077:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:09:36.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:36 smithi112 ceph-mon[33313]: Updating smithi112:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:09:36.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:36 smithi112 ceph-mon[33313]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:09:36.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:36 smithi112 ceph-mon[33313]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:09:36.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:36 smithi112 ceph-mon[33313]: Updating smithi077:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:09:36.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:36 smithi112 ceph-mon[33313]: Updating smithi112:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:09:36.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:36 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:36.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:36 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:36.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:36 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:36.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:36 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:36.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:36 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:36.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:36 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:36.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:36 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:36.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:36 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:36.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:36 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:37.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:37 smithi077 ceph-mon[26330]: Reconfiguring node-exporter.smithi077 (dependencies changed)... 2024-04-25T02:09:37.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:37 smithi077 ceph-mon[26330]: Reconfiguring daemon node-exporter.smithi077 on smithi077 2024-04-25T02:09:37.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:37 smithi077 ceph-mon[26330]: pgmap v12: 65 pgs: 65 active+clean; 1.2 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 42 MiB/s rd, 46 MiB/s wr, 361 op/s 2024-04-25T02:09:37.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:37 smithi112 ceph-mon[33313]: Reconfiguring node-exporter.smithi077 (dependencies changed)... 2024-04-25T02:09:37.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:37 smithi112 ceph-mon[33313]: Reconfiguring daemon node-exporter.smithi077 on smithi077 2024-04-25T02:09:37.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:37 smithi112 ceph-mon[33313]: pgmap v12: 65 pgs: 65 active+clean; 1.2 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 42 MiB/s rd, 46 MiB/s wr, 361 op/s 2024-04-25T02:09:39.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:39 smithi077 ceph-mon[26330]: pgmap v13: 65 pgs: 65 active+clean; 1.2 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 26 KiB/s rd, 1.3 MiB/s wr, 227 op/s 2024-04-25T02:09:39.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:39 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:39.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:39 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:39.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:39 smithi077 ceph-mon[26330]: Reconfiguring alertmanager.smithi077 (dependencies changed)... 2024-04-25T02:09:39.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:39 smithi077 ceph-mon[26330]: Reconfiguring daemon alertmanager.smithi077 on smithi077 2024-04-25T02:09:39.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:39 smithi112 ceph-mon[33313]: pgmap v13: 65 pgs: 65 active+clean; 1.2 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 26 KiB/s rd, 1.3 MiB/s wr, 227 op/s 2024-04-25T02:09:39.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:39 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:39.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:39 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:39.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:39 smithi112 ceph-mon[33313]: Reconfiguring alertmanager.smithi077 (dependencies changed)... 2024-04-25T02:09:39.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:39 smithi112 ceph-mon[33313]: Reconfiguring daemon alertmanager.smithi077 on smithi077 2024-04-25T02:09:41.432 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:41 smithi077 ceph-mon[26330]: pgmap v14: 65 pgs: 65 active+clean; 745 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 42 KiB/s rd, 2.1 MiB/s wr, 382 op/s 2024-04-25T02:09:41.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:41 smithi112 ceph-mon[33313]: pgmap v14: 65 pgs: 65 active+clean; 745 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 42 KiB/s rd, 2.1 MiB/s wr, 382 op/s 2024-04-25T02:09:42.894 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-25T02:09:42.894 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-04-25T02:09:43.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:43 smithi112 ceph-mon[33313]: pgmap v15: 65 pgs: 65 active+clean; 745 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 254 op/s 2024-04-25T02:09:43.313 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:43 smithi077 ceph-mon[26330]: pgmap v15: 65 pgs: 65 active+clean; 745 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 254 op/s 2024-04-25T02:09:44.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:44 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:44.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:44 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:44.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:44 smithi112 ceph-mon[33313]: Reconfiguring grafana.smithi077 (dependencies changed)... 2024-04-25T02:09:44.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:44 smithi112 ceph-mon[33313]: Reconfiguring daemon grafana.smithi077 on smithi077 2024-04-25T02:09:44.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:44 smithi112 ceph-mon[33313]: pgmap v16: 65 pgs: 65 active+clean; 745 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 254 op/s 2024-04-25T02:09:44.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:44 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:44.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:44 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:44.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:44 smithi077 ceph-mon[26330]: Reconfiguring grafana.smithi077 (dependencies changed)... 2024-04-25T02:09:44.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:44 smithi077 ceph-mon[26330]: Reconfiguring daemon grafana.smithi077 on smithi077 2024-04-25T02:09:44.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:44 smithi077 ceph-mon[26330]: pgmap v16: 65 pgs: 65 active+clean; 745 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 254 op/s 2024-04-25T02:09:46.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:46 smithi077 ceph-mon[26330]: pgmap v17: 65 pgs: 65 active+clean; 366 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 36 KiB/s rd, 2.3 MiB/s wr, 313 op/s 2024-04-25T02:09:47.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:46 smithi112 ceph-mon[33313]: pgmap v17: 65 pgs: 65 active+clean; 366 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 36 KiB/s rd, 2.3 MiB/s wr, 313 op/s 2024-04-25T02:09:48.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:48 smithi077 ceph-mon[26330]: pgmap v18: 65 pgs: 65 active+clean; 366 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 24 KiB/s rd, 1.7 MiB/s wr, 214 op/s 2024-04-25T02:09:48.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:48 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:09:49.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:48 smithi112 ceph-mon[33313]: pgmap v18: 65 pgs: 65 active+clean; 366 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 24 KiB/s rd, 1.7 MiB/s wr, 214 op/s 2024-04-25T02:09:49.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:48 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:09:50.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:50 smithi077 ceph-mon[26330]: pgmap v19: 65 pgs: 65 active+clean; 306 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 2.9 MiB/s wr, 239 op/s 2024-04-25T02:09:51.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:50 smithi112 ceph-mon[33313]: pgmap v19: 65 pgs: 65 active+clean; 306 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 2.9 MiB/s wr, 239 op/s 2024-04-25T02:09:53.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:52 smithi112 ceph-mon[33313]: pgmap v20: 65 pgs: 65 active+clean; 306 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 2.2 MiB/s wr, 84 op/s 2024-04-25T02:09:53.042 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:52 smithi077 ceph-mon[26330]: pgmap v20: 65 pgs: 65 active+clean; 306 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 2.2 MiB/s wr, 84 op/s 2024-04-25T02:09:54.855 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:54 smithi077 ceph-mon[26330]: pgmap v21: 65 pgs: 65 active+clean; 306 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 2.2 MiB/s wr, 84 op/s 2024-04-25T02:09:54.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.866+0000 7f898e6b5700 1 -- 172.21.15.77:0/1852854999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89880fd270 msgr2=0x7f89880fd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:54.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.866+0000 7f898e6b5700 1 --2- 172.21.15.77:0/1852854999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89880fd270 0x7f89880fd680 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8978004940 tx=0x7f8978009e30 comp rx=0 tx=0).stop 2024-04-25T02:09:54.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.866+0000 7f898e6b5700 1 -- 172.21.15.77:0/1852854999 shutdown_connections 2024-04-25T02:09:54.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.866+0000 7f898e6b5700 1 --2- 172.21.15.77:0/1852854999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89880fdbc0 0x7f89880fbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:54.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.866+0000 7f898e6b5700 1 --2- 172.21.15.77:0/1852854999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89880fd270 0x7f89880fd680 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:54.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.866+0000 7f898e6b5700 1 -- 172.21.15.77:0/1852854999 >> 172.21.15.77:0/1852854999 conn(0x7f89880f6b80 msgr2=0x7f89880f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:54.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.866+0000 7f898e6b5700 1 -- 172.21.15.77:0/1852854999 shutdown_connections 2024-04-25T02:09:54.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.866+0000 7f898e6b5700 1 -- 172.21.15.77:0/1852854999 wait complete. 2024-04-25T02:09:54.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.866+0000 7f898e6b5700 1 Processor -- start 2024-04-25T02:09:54.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.866+0000 7f898e6b5700 1 -- start start 2024-04-25T02:09:54.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.867+0000 7f898e6b5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89880fd270 0x7f89880ffdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:54.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.867+0000 7f898e6b5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89880fe2d0 0x7f89880fe740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:54.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.867+0000 7f898e6b5700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89880fec80 con 0x7f89880fe2d0 2024-04-25T02:09:54.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.867+0000 7f898e6b5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89880fedf0 con 0x7f89880fd270 2024-04-25T02:09:54.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.867+0000 7f89877fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89880fe2d0 0x7f89880fe740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:54.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.867+0000 7f89877fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89880fe2d0 0x7f89880fe740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57328/0 (socket says 172.21.15.77:57328) 2024-04-25T02:09:54.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.867+0000 7f89877fe700 1 -- 172.21.15.77:0/2551024238 learned_addr learned my addr 172.21.15.77:0/2551024238 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:09:54.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.867+0000 7f8987fff700 1 --2- 172.21.15.77:0/2551024238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89880fd270 0x7f89880ffdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:54.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.867+0000 7f89877fe700 1 -- 172.21.15.77:0/2551024238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89880fd270 msgr2=0x7f89880ffdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:54.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.867+0000 7f89877fe700 1 --2- 172.21.15.77:0/2551024238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89880fd270 0x7f89880ffdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:54.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.867+0000 7f89877fe700 1 -- 172.21.15.77:0/2551024238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8978005040 con 0x7f89880fe2d0 2024-04-25T02:09:54.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.867+0000 7f89877fe700 1 --2- 172.21.15.77:0/2551024238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89880fe2d0 0x7f89880fe740 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f897c002a50 tx=0x7f897c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:54.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.867+0000 7f8984ff9700 1 -- 172.21.15.77:0/2551024238 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f897c007cc0 con 0x7f89880fe2d0 2024-04-25T02:09:54.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.867+0000 7f898e6b5700 1 -- 172.21.15.77:0/2551024238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89880ff0d0 con 0x7f89880fe2d0 2024-04-25T02:09:54.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.867+0000 7f8984ff9700 1 -- 172.21.15.77:0/2551024238 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f897c00f040 con 0x7f89880fe2d0 2024-04-25T02:09:54.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.867+0000 7f8984ff9700 1 -- 172.21.15.77:0/2551024238 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f897c00da30 con 0x7f89880fe2d0 2024-04-25T02:09:54.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.867+0000 7f898e6b5700 1 -- 172.21.15.77:0/2551024238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8988115df0 con 0x7f89880fe2d0 2024-04-25T02:09:54.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.868+0000 7f898e6b5700 1 -- 172.21.15.77:0/2551024238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8988101b20 con 0x7f89880fe2d0 2024-04-25T02:09:54.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.869+0000 7f8984ff9700 1 -- 172.21.15.77:0/2551024238 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 25) v1 ==== 89381+0+0 (secure 0 0 0) 0x7f897c00db90 con 0x7f89880fe2d0 2024-04-25T02:09:54.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.869+0000 7f8984ff9700 1 --2- 172.21.15.77:0/2551024238 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f897006b790 0x7f897006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:54.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.869+0000 7f8984ff9700 1 -- 172.21.15.77:0/2551024238 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f897c08a200 con 0x7f89880fe2d0 2024-04-25T02:09:54.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.870+0000 7f8987fff700 1 --2- 172.21.15.77:0/2551024238 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f897006b790 0x7f897006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:54.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.870+0000 7f8987fff700 1 --2- 172.21.15.77:0/2551024238 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f897006b790 0x7f897006dc40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8978004890 tx=0x7f8978009e30 comp rx=0 tx=0).ready entity=mgr.24353 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:54.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:54.874+0000 7f8984ff9700 1 -- 172.21.15.77:0/2551024238 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f897c053cc0 con 0x7f89880fe2d0 2024-04-25T02:09:55.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:54 smithi112 ceph-mon[33313]: pgmap v21: 65 pgs: 65 active+clean; 306 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 2.2 MiB/s wr, 84 op/s 2024-04-25T02:09:55.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.116+0000 7f898e6b5700 1 -- 172.21.15.77:0/2551024238 --> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f89880fdbc0 con 0x7f897006b790 2024-04-25T02:09:55.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.117+0000 7f8984ff9700 1 -- 172.21.15.77:0/2551024238 <== mgr.24353 v2:172.21.15.112:6828/218023931 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f89880fdbc0 con 0x7f897006b790 2024-04-25T02:09:55.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.119+0000 7f898e6b5700 1 -- 172.21.15.77:0/2551024238 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f897006b790 msgr2=0x7f897006dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:55.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.119+0000 7f898e6b5700 1 --2- 172.21.15.77:0/2551024238 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f897006b790 0x7f897006dc40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8978004890 tx=0x7f8978009e30 comp rx=0 tx=0).stop 2024-04-25T02:09:55.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.119+0000 7f898e6b5700 1 -- 172.21.15.77:0/2551024238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89880fe2d0 msgr2=0x7f89880fe740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:55.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.119+0000 7f898e6b5700 1 --2- 172.21.15.77:0/2551024238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89880fe2d0 0x7f89880fe740 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f897c002a50 tx=0x7f897c0046b0 comp rx=0 tx=0).stop 2024-04-25T02:09:55.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.119+0000 7f898e6b5700 1 -- 172.21.15.77:0/2551024238 shutdown_connections 2024-04-25T02:09:55.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.119+0000 7f898e6b5700 1 --2- 172.21.15.77:0/2551024238 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f897006b790 0x7f897006dc40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:55.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.119+0000 7f898e6b5700 1 --2- 172.21.15.77:0/2551024238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89880fd270 0x7f89880ffdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:55.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.119+0000 7f898e6b5700 1 --2- 172.21.15.77:0/2551024238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89880fe2d0 0x7f89880fe740 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:55.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.119+0000 7f898e6b5700 1 -- 172.21.15.77:0/2551024238 >> 172.21.15.77:0/2551024238 conn(0x7f89880f6b80 msgr2=0x7f89880fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:55.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.119+0000 7f898e6b5700 1 -- 172.21.15.77:0/2551024238 shutdown_connections 2024-04-25T02:09:55.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.119+0000 7f898e6b5700 1 -- 172.21.15.77:0/2551024238 wait complete. 2024-04-25T02:09:55.136 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-04-25T02:09:55.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.225+0000 7f1a38b05700 1 -- 172.21.15.77:0/1593983111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a340fbcc0 msgr2=0x7f1a340fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:55.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.225+0000 7f1a38b05700 1 --2- 172.21.15.77:0/1593983111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a340fbcc0 0x7f1a340fc0d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c009ce0 tx=0x7f1a2c004d10 comp rx=0 tx=0).stop 2024-04-25T02:09:55.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.225+0000 7f1a38b05700 1 -- 172.21.15.77:0/1593983111 shutdown_connections 2024-04-25T02:09:55.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.225+0000 7f1a38b05700 1 --2- 172.21.15.77:0/1593983111 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a340fcf70 0x7f1a340fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:55.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.225+0000 7f1a38b05700 1 --2- 172.21.15.77:0/1593983111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a340fbcc0 0x7f1a340fc0d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:55.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.225+0000 7f1a38b05700 1 -- 172.21.15.77:0/1593983111 >> 172.21.15.77:0/1593983111 conn(0x7f1a340f7440 msgr2=0x7f1a340f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:55.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.225+0000 7f1a38b05700 1 -- 172.21.15.77:0/1593983111 shutdown_connections 2024-04-25T02:09:55.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.225+0000 7f1a38b05700 1 -- 172.21.15.77:0/1593983111 wait complete. 2024-04-25T02:09:55.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.225+0000 7f1a38b05700 1 Processor -- start 2024-04-25T02:09:55.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.225+0000 7f1a38b05700 1 -- start start 2024-04-25T02:09:55.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.225+0000 7f1a38b05700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a340fbcc0 0x7f1a3410d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:55.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.225+0000 7f1a38b05700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a340fcf70 0x7f1a3410def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:55.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.225+0000 7f1a38b05700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3410e4f0 con 0x7f1a340fcf70 2024-04-25T02:09:55.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.225+0000 7f1a38b05700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3410e660 con 0x7f1a340fbcc0 2024-04-25T02:09:55.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.226+0000 7f1a31d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a340fcf70 0x7f1a3410def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:55.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.226+0000 7f1a31d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a340fcf70 0x7f1a3410def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57342/0 (socket says 172.21.15.77:57342) 2024-04-25T02:09:55.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.226+0000 7f1a3259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a340fbcc0 0x7f1a3410d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:55.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.226+0000 7f1a31d9b700 1 -- 172.21.15.77:0/1346395967 learned_addr learned my addr 172.21.15.77:0/1346395967 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:09:55.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.226+0000 7f1a31d9b700 1 -- 172.21.15.77:0/1346395967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a340fbcc0 msgr2=0x7f1a3410d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:55.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.226+0000 7f1a31d9b700 1 --2- 172.21.15.77:0/1346395967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a340fbcc0 0x7f1a3410d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:55.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.226+0000 7f1a31d9b700 1 -- 172.21.15.77:0/1346395967 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2c009940 con 0x7f1a340fcf70 2024-04-25T02:09:55.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.226+0000 7f1a3259c700 1 --2- 172.21.15.77:0/1346395967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a340fbcc0 0x7f1a3410d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:55.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.226+0000 7f1a31d9b700 1 --2- 172.21.15.77:0/1346395967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a340fcf70 0x7f1a3410def0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00eb40 tx=0x7f1a1c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:55.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.226+0000 7f1a2affd700 1 -- 172.21.15.77:0/1346395967 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a1c007cc0 con 0x7f1a340fcf70 2024-04-25T02:09:55.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.226+0000 7f1a2affd700 1 -- 172.21.15.77:0/1346395967 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1a1c00f040 con 0x7f1a340fcf70 2024-04-25T02:09:55.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.226+0000 7f1a2affd700 1 -- 172.21.15.77:0/1346395967 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a1c00ca10 con 0x7f1a340fcf70 2024-04-25T02:09:55.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.226+0000 7f1a38b05700 1 -- 172.21.15.77:0/1346395967 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a34113010 con 0x7f1a340fcf70 2024-04-25T02:09:55.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.226+0000 7f1a38b05700 1 -- 172.21.15.77:0/1346395967 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a341135d0 con 0x7f1a340fcf70 2024-04-25T02:09:55.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.227+0000 7f1a38b05700 1 -- 172.21.15.77:0/1346395967 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a34101b00 con 0x7f1a340fcf70 2024-04-25T02:09:55.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.228+0000 7f1a2affd700 1 -- 172.21.15.77:0/1346395967 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 25) v1 ==== 89381+0+0 (secure 0 0 0) 0x7f1a1c00cc80 con 0x7f1a340fcf70 2024-04-25T02:09:55.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.228+0000 7f1a2affd700 1 --2- 172.21.15.77:0/1346395967 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f1a2006b7a0 0x7f1a2006dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:55.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.228+0000 7f1a2affd700 1 -- 172.21.15.77:0/1346395967 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f1a1c08a040 con 0x7f1a340fcf70 2024-04-25T02:09:55.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.228+0000 7f1a3259c700 1 --2- 172.21.15.77:0/1346395967 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f1a2006b7a0 0x7f1a2006dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:55.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.229+0000 7f1a3259c700 1 --2- 172.21.15.77:0/1346395967 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f1a2006b7a0 0x7f1a2006dc50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c004f80 tx=0x7f1a2c004d10 comp rx=0 tx=0).ready entity=mgr.24353 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:55.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.233+0000 7f1a2affd700 1 -- 172.21.15.77:0/1346395967 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f1a1c050100 con 0x7f1a340fcf70 2024-04-25T02:09:55.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.457+0000 7f1a38b05700 1 -- 172.21.15.77:0/1346395967 --> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a3402b3b0 con 0x7f1a2006b7a0 2024-04-25T02:09:55.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.458+0000 7f1a2affd700 1 -- 172.21.15.77:0/1346395967 <== mgr.24353 v2:172.21.15.112:6828/218023931 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f1a3402b3b0 con 0x7f1a2006b7a0 2024-04-25T02:09:55.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.460+0000 7f1a38b05700 1 -- 172.21.15.77:0/1346395967 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f1a2006b7a0 msgr2=0x7f1a2006dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:55.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.460+0000 7f1a38b05700 1 --2- 172.21.15.77:0/1346395967 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f1a2006b7a0 0x7f1a2006dc50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c004f80 tx=0x7f1a2c004d10 comp rx=0 tx=0).stop 2024-04-25T02:09:55.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.460+0000 7f1a38b05700 1 -- 172.21.15.77:0/1346395967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a340fcf70 msgr2=0x7f1a3410def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:55.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.460+0000 7f1a38b05700 1 --2- 172.21.15.77:0/1346395967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a340fcf70 0x7f1a3410def0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00eb40 tx=0x7f1a1c00b040 comp rx=0 tx=0).stop 2024-04-25T02:09:55.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.461+0000 7f1a38b05700 1 -- 172.21.15.77:0/1346395967 shutdown_connections 2024-04-25T02:09:55.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.461+0000 7f1a38b05700 1 --2- 172.21.15.77:0/1346395967 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f1a2006b7a0 0x7f1a2006dc50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:55.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.461+0000 7f1a38b05700 1 --2- 172.21.15.77:0/1346395967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a340fbcc0 0x7f1a3410d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:55.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.461+0000 7f1a38b05700 1 --2- 172.21.15.77:0/1346395967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a340fcf70 0x7f1a3410def0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:55.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.461+0000 7f1a38b05700 1 -- 172.21.15.77:0/1346395967 >> 172.21.15.77:0/1346395967 conn(0x7f1a340f7440 msgr2=0x7f1a34066900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:55.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.461+0000 7f1a38b05700 1 -- 172.21.15.77:0/1346395967 shutdown_connections 2024-04-25T02:09:55.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.461+0000 7f1a38b05700 1 -- 172.21.15.77:0/1346395967 wait complete. 2024-04-25T02:09:55.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.564+0000 7f9b63498700 1 -- 172.21.15.77:0/325849588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b5c0fbcc0 msgr2=0x7f9b5c0fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:55.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.564+0000 7f9b63498700 1 --2- 172.21.15.77:0/325849588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b5c0fbcc0 0x7f9b5c0fc0d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9b58004940 tx=0x7f9b58009e30 comp rx=0 tx=0).stop 2024-04-25T02:09:55.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.564+0000 7f9b63498700 1 -- 172.21.15.77:0/325849588 shutdown_connections 2024-04-25T02:09:55.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.564+0000 7f9b63498700 1 --2- 172.21.15.77:0/325849588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b5c0fcf70 0x7f9b5c0fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:55.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.564+0000 7f9b63498700 1 --2- 172.21.15.77:0/325849588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b5c0fbcc0 0x7f9b5c0fc0d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:55.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.564+0000 7f9b63498700 1 -- 172.21.15.77:0/325849588 >> 172.21.15.77:0/325849588 conn(0x7f9b5c0f7440 msgr2=0x7f9b5c0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:55.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.564+0000 7f9b63498700 1 -- 172.21.15.77:0/325849588 shutdown_connections 2024-04-25T02:09:55.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.564+0000 7f9b63498700 1 -- 172.21.15.77:0/325849588 wait complete. 2024-04-25T02:09:55.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.565+0000 7f9b63498700 1 Processor -- start 2024-04-25T02:09:55.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.565+0000 7f9b63498700 1 -- start start 2024-04-25T02:09:55.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.565+0000 7f9b63498700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b5c0fbcc0 0x7f9b5c113e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:55.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.565+0000 7f9b63498700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b5c0fcf70 0x7f9b5c1143d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:55.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.565+0000 7f9b63498700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c1149d0 con 0x7f9b5c0fbcc0 2024-04-25T02:09:55.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.565+0000 7f9b63498700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c114b40 con 0x7f9b5c0fcf70 2024-04-25T02:09:55.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.565+0000 7f9b61234700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b5c0fbcc0 0x7f9b5c113e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:55.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.565+0000 7f9b61234700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b5c0fbcc0 0x7f9b5c113e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57360/0 (socket says 172.21.15.77:57360) 2024-04-25T02:09:55.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.565+0000 7f9b61234700 1 -- 172.21.15.77:0/894745184 learned_addr learned my addr 172.21.15.77:0/894745184 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:09:55.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.566+0000 7f9b60a33700 1 --2- 172.21.15.77:0/894745184 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b5c0fcf70 0x7f9b5c1143d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:55.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.566+0000 7f9b61234700 1 -- 172.21.15.77:0/894745184 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b5c0fcf70 msgr2=0x7f9b5c1143d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:55.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.566+0000 7f9b61234700 1 --2- 172.21.15.77:0/894745184 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b5c0fcf70 0x7f9b5c1143d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:55.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.566+0000 7f9b61234700 1 -- 172.21.15.77:0/894745184 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b58005040 con 0x7f9b5c0fbcc0 2024-04-25T02:09:55.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.566+0000 7f9b61234700 1 --2- 172.21.15.77:0/894745184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b5c0fbcc0 0x7f9b5c113e90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9b58013870 tx=0x7f9b58009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:55.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.566+0000 7f9b51ffb700 1 -- 172.21.15.77:0/894745184 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b58021070 con 0x7f9b5c0fbcc0 2024-04-25T02:09:55.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.566+0000 7f9b51ffb700 1 -- 172.21.15.77:0/894745184 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9b58009430 con 0x7f9b5c0fbcc0 2024-04-25T02:09:55.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.566+0000 7f9b63498700 1 -- 172.21.15.77:0/894745184 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b5c119540 con 0x7f9b5c0fbcc0 2024-04-25T02:09:55.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.566+0000 7f9b51ffb700 1 -- 172.21.15.77:0/894745184 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b5800e070 con 0x7f9b5c0fbcc0 2024-04-25T02:09:55.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.566+0000 7f9b63498700 1 -- 172.21.15.77:0/894745184 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5c119a80 con 0x7f9b5c0fbcc0 2024-04-25T02:09:55.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.568+0000 7f9b63498700 1 -- 172.21.15.77:0/894745184 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b5c101900 con 0x7f9b5c0fbcc0 2024-04-25T02:09:55.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.569+0000 7f9b51ffb700 1 -- 172.21.15.77:0/894745184 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 25) v1 ==== 89381+0+0 (secure 0 0 0) 0x7f9b5801c750 con 0x7f9b5c0fbcc0 2024-04-25T02:09:55.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.569+0000 7f9b51ffb700 1 --2- 172.21.15.77:0/894745184 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f9b4806b730 0x7f9b4806dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:55.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.569+0000 7f9b51ffb700 1 -- 172.21.15.77:0/894745184 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f9b5808bc10 con 0x7f9b5c0fbcc0 2024-04-25T02:09:55.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.569+0000 7f9b60a33700 1 --2- 172.21.15.77:0/894745184 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f9b4806b730 0x7f9b4806dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:55.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.570+0000 7f9b60a33700 1 --2- 172.21.15.77:0/894745184 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f9b4806b730 0x7f9b4806dbe0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c009b80 tx=0x7f9b4c00b040 comp rx=0 tx=0).ready entity=mgr.24353 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:55.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.573+0000 7f9b51ffb700 1 -- 172.21.15.77:0/894745184 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f9b58059520 con 0x7f9b5c0fbcc0 2024-04-25T02:09:55.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.791+0000 7f9b63498700 1 -- 172.21.15.77:0/894745184 --> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b5c02b310 con 0x7f9b4806b730 2024-04-25T02:09:55.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.803+0000 7f9b51ffb700 1 -- 172.21.15.77:0/894745184 <== mgr.24353 v2:172.21.15.112:6828/218023931 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f9b5c02b310 con 0x7f9b4806b730 2024-04-25T02:09:55.810 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T02:09:55.810 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 starting - - - - 2024-04-25T02:09:55.811 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (9m) 25s ago 9m 6665k - 17.2.7-902-gc61472c8 0de407c1b3af 2ad2e3d2b09e 2024-04-25T02:09:55.811 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi112 smithi112 running (8m) 27s ago 8m 6660k - 17.2.7-902-gc61472c8 0de407c1b3af 9235dc5eb15d 2024-04-25T02:09:55.811 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (7m) 25s ago 8m 88.7M - 9.4.7 954c08fa6188 d3b9c1566a82 2024-04-25T02:09:55.811 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.gcfygj smithi077 running (3m) 25s ago 3m 13.5M - 17.2.7-902-gc61472c8 0de407c1b3af 382dd7abf674 2024-04-25T02:09:55.811 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.oadrkb smithi077 running (3m) 25s ago 3m 11.9M - 17.2.7-902-gc61472c8 0de407c1b3af 6992064a4b2a 2024-04-25T02:09:55.811 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.dvwudt smithi112 running (3m) 27s ago 3m 226M - 17.2.7-902-gc61472c8 0de407c1b3af 0792e451abfd 2024-04-25T02:09:55.811 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.fjnadi smithi112 running (3m) 27s ago 3m 13.1M - 17.2.7-902-gc61472c8 0de407c1b3af c8093f622f6b 2024-04-25T02:09:55.811 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.zpflzp smithi077 *:9283 running (10m) 25s ago 10m 428M - 17.2.7-902-gc61472c8 0de407c1b3af 8c5e41dfcae2 2024-04-25T02:09:55.811 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi112.cswrxs smithi112 *:8443,9283 running (70s) 27s ago 8m 489M - 19.0.0-2445-gd2c45d97 f68e37b807ef 89564cfe9a4c 2024-04-25T02:09:55.811 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (10m) 25s ago 10m 50.0M 2048M 17.2.7-902-gc61472c8 0de407c1b3af adb57965a306 2024-04-25T02:09:55.811 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi112 smithi112 running (8m) 27s ago 8m 38.0M 2048M 17.2.7-902-gc61472c8 0de407c1b3af db2fb9b09789 2024-04-25T02:09:55.811 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 starting - - - - 2024-04-25T02:09:55.811 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi112 smithi112 *:9100 running (8m) 27s ago 8m 16.8M - 1.5.0 0da6a335fe13 3a7c783c933b 2024-04-25T02:09:55.811 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (7m) 25s ago 7m 239M 1557M 17.2.7-902-gc61472c8 0de407c1b3af c741abec3b94 2024-04-25T02:09:55.811 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (6m) 25s ago 6m 234M 1557M 17.2.7-902-gc61472c8 0de407c1b3af 256ff3ced322 2024-04-25T02:09:55.812 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (6m) 25s ago 6m 196M 1557M 17.2.7-902-gc61472c8 0de407c1b3af c5d7d8c993f4 2024-04-25T02:09:55.812 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi112 running (6m) 27s ago 6m 261M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 68429d0dbf88 2024-04-25T02:09:55.812 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi112 running (5m) 27s ago 5m 224M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 66eb71201444 2024-04-25T02:09:55.812 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi112 running (5m) 27s ago 5m 250M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 963e700d6aea 2024-04-25T02:09:55.812 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (7m) 25s ago 8m 54.3M - 2.43.0 a07b618ecd1d 85f5766c90c7 2024-04-25T02:09:55.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.805+0000 7f9b63498700 1 -- 172.21.15.77:0/894745184 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f9b4806b730 msgr2=0x7f9b4806dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:55.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.805+0000 7f9b63498700 1 --2- 172.21.15.77:0/894745184 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f9b4806b730 0x7f9b4806dbe0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c009b80 tx=0x7f9b4c00b040 comp rx=0 tx=0).stop 2024-04-25T02:09:55.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.805+0000 7f9b63498700 1 -- 172.21.15.77:0/894745184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b5c0fbcc0 msgr2=0x7f9b5c113e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:55.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.805+0000 7f9b63498700 1 --2- 172.21.15.77:0/894745184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b5c0fbcc0 0x7f9b5c113e90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9b58013870 tx=0x7f9b58009e30 comp rx=0 tx=0).stop 2024-04-25T02:09:55.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.805+0000 7f9b63498700 1 -- 172.21.15.77:0/894745184 shutdown_connections 2024-04-25T02:09:55.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.805+0000 7f9b63498700 1 --2- 172.21.15.77:0/894745184 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f9b4806b730 0x7f9b4806dbe0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:55.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.805+0000 7f9b63498700 1 --2- 172.21.15.77:0/894745184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b5c0fbcc0 0x7f9b5c113e90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:55.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.805+0000 7f9b63498700 1 --2- 172.21.15.77:0/894745184 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b5c0fcf70 0x7f9b5c1143d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:55.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.805+0000 7f9b63498700 1 -- 172.21.15.77:0/894745184 >> 172.21.15.77:0/894745184 conn(0x7f9b5c0f7440 msgr2=0x7f9b5c066770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:55.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.805+0000 7f9b63498700 1 -- 172.21.15.77:0/894745184 shutdown_connections 2024-04-25T02:09:55.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.805+0000 7f9b63498700 1 -- 172.21.15.77:0/894745184 wait complete. 2024-04-25T02:09:55.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.941+0000 7fc50f7fe700 1 -- 172.21.15.77:0/3943688361 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc508012410 con 0x7fc5100fcf70 2024-04-25T02:09:55.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.941+0000 7fc516d59700 1 -- 172.21.15.77:0/3943688361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5100fcf70 msgr2=0x7fc5100fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:55.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.941+0000 7fc516d59700 1 --2- 172.21.15.77:0/3943688361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5100fcf70 0x7fc5100fd3e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc508009ce0 tx=0x7fc508004d10 comp rx=0 tx=0).stop 2024-04-25T02:09:55.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.941+0000 7fc516d59700 1 -- 172.21.15.77:0/3943688361 shutdown_connections 2024-04-25T02:09:55.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.941+0000 7fc516d59700 1 --2- 172.21.15.77:0/3943688361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5100fcf70 0x7fc5100fd3e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:55.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.941+0000 7fc516d59700 1 --2- 172.21.15.77:0/3943688361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5100fbcc0 0x7fc5100fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:55.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.941+0000 7fc516d59700 1 -- 172.21.15.77:0/3943688361 >> 172.21.15.77:0/3943688361 conn(0x7fc5100f7420 msgr2=0x7fc5100f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:55.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.941+0000 7fc516d59700 1 -- 172.21.15.77:0/3943688361 shutdown_connections 2024-04-25T02:09:55.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.941+0000 7fc516d59700 1 -- 172.21.15.77:0/3943688361 wait complete. 2024-04-25T02:09:55.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.942+0000 7fc516d59700 1 Processor -- start 2024-04-25T02:09:55.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.942+0000 7fc516d59700 1 -- start start 2024-04-25T02:09:55.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.943+0000 7fc516d59700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5100fbcc0 0x7fc510065ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:55.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.943+0000 7fc516d59700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5100fcf70 0x7fc510066530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:55.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.943+0000 7fc516d59700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51006ff10 con 0x7fc5100fbcc0 2024-04-25T02:09:55.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.943+0000 7fc516d59700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc510070050 con 0x7fc5100fcf70 2024-04-25T02:09:55.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.943+0000 7fc50ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5100fcf70 0x7fc510066530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:55.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.943+0000 7fc50ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5100fcf70 0x7fc510066530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.77:34262/0 (socket says 172.21.15.77:34262) 2024-04-25T02:09:55.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.943+0000 7fc50ffff700 1 -- 172.21.15.77:0/1235071227 learned_addr learned my addr 172.21.15.77:0/1235071227 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:09:55.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.943+0000 7fc514af5700 1 --2- 172.21.15.77:0/1235071227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5100fbcc0 0x7fc510065ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:55.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.944+0000 7fc514af5700 1 -- 172.21.15.77:0/1235071227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5100fcf70 msgr2=0x7fc510066530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:55.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.944+0000 7fc514af5700 1 --2- 172.21.15.77:0/1235071227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5100fcf70 0x7fc510066530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:55.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.944+0000 7fc514af5700 1 -- 172.21.15.77:0/1235071227 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc508009940 con 0x7fc5100fbcc0 2024-04-25T02:09:55.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.944+0000 7fc50ffff700 1 --2- 172.21.15.77:0/1235071227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5100fcf70 0x7fc510066530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:55.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.944+0000 7fc514af5700 1 --2- 172.21.15.77:0/1235071227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5100fbcc0 0x7fc510065ff0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8009fd0 tx=0x7fc4f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:55.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.945+0000 7fc50d7fa700 1 -- 172.21.15.77:0/1235071227 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4f8004e90 con 0x7fc5100fbcc0 2024-04-25T02:09:55.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.945+0000 7fc50d7fa700 1 -- 172.21.15.77:0/1235071227 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc4f800f040 con 0x7fc5100fbcc0 2024-04-25T02:09:55.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.945+0000 7fc50d7fa700 1 -- 172.21.15.77:0/1235071227 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4f800ca50 con 0x7fc5100fbcc0 2024-04-25T02:09:55.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.945+0000 7fc516d59700 1 -- 172.21.15.77:0/1235071227 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc510066bb0 con 0x7fc5100fbcc0 2024-04-25T02:09:55.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.945+0000 7fc516d59700 1 -- 172.21.15.77:0/1235071227 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc51006e510 con 0x7fc5100fbcc0 2024-04-25T02:09:55.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.946+0000 7fc516d59700 1 -- 172.21.15.77:0/1235071227 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc51005f5c0 con 0x7fc5100fbcc0 2024-04-25T02:09:55.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.947+0000 7fc50d7fa700 1 -- 172.21.15.77:0/1235071227 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 25) v1 ==== 89381+0+0 (secure 0 0 0) 0x7fc4f8007cc0 con 0x7fc5100fbcc0 2024-04-25T02:09:55.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.948+0000 7fc50d7fa700 1 --2- 172.21.15.77:0/1235071227 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7fc4fc06b7e0 0x7fc4fc06dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:55.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.948+0000 7fc50d7fa700 1 -- 172.21.15.77:0/1235071227 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc4f8089db0 con 0x7fc5100fbcc0 2024-04-25T02:09:55.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.948+0000 7fc50ffff700 1 --2- 172.21.15.77:0/1235071227 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7fc4fc06b7e0 0x7fc4fc06dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:55.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.951+0000 7fc50ffff700 1 --2- 172.21.15.77:0/1235071227 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7fc4fc06b7e0 0x7fc4fc06dc90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc508005010 tx=0x7fc508004d10 comp rx=0 tx=0).ready entity=mgr.24353 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:55.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:55.957+0000 7fc50d7fa700 1 -- 172.21.15.77:0/1235071227 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7fc4f8050100 con 0x7fc5100fbcc0 2024-04-25T02:09:55.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:55 smithi077 ceph-mon[26330]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:56.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:55 smithi112 ceph-mon[33313]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:56.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.292+0000 7fc516d59700 1 -- 172.21.15.77:0/1235071227 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc51006e890 con 0x7fc5100fbcc0 2024-04-25T02:09:56.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.292+0000 7fc50d7fa700 1 -- 172.21.15.77:0/1235071227 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7fc4f8050100 con 0x7fc5100fbcc0 2024-04-25T02:09:56.300 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:09:56.300 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-04-25T02:09:56.300 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2 2024-04-25T02:09:56.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:09:56.300 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-04-25T02:09:56.300 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 1, 2024-04-25T02:09:56.300 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 1 2024-04-25T02:09:56.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:09:56.300 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-04-25T02:09:56.300 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 6 2024-04-25T02:09:56.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:09:56.300 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-04-25T02:09:56.300 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T02:09:56.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:09:56.300 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-04-25T02:09:56.301 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 13, 2024-04-25T02:09:56.301 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 1 2024-04-25T02:09:56.301 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-25T02:09:56.301 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:09:56.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.294+0000 7fc516d59700 1 -- 172.21.15.77:0/1235071227 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7fc4fc06b7e0 msgr2=0x7fc4fc06dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:56.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.294+0000 7fc516d59700 1 --2- 172.21.15.77:0/1235071227 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7fc4fc06b7e0 0x7fc4fc06dc90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc508005010 tx=0x7fc508004d10 comp rx=0 tx=0).stop 2024-04-25T02:09:56.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.294+0000 7fc516d59700 1 -- 172.21.15.77:0/1235071227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5100fbcc0 msgr2=0x7fc510065ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:56.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.294+0000 7fc516d59700 1 --2- 172.21.15.77:0/1235071227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5100fbcc0 0x7fc510065ff0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8009fd0 tx=0x7fc4f800b040 comp rx=0 tx=0).stop 2024-04-25T02:09:56.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.295+0000 7fc516d59700 1 -- 172.21.15.77:0/1235071227 shutdown_connections 2024-04-25T02:09:56.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.295+0000 7fc516d59700 1 --2- 172.21.15.77:0/1235071227 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7fc4fc06b7e0 0x7fc4fc06dc90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:56.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.295+0000 7fc516d59700 1 --2- 172.21.15.77:0/1235071227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5100fbcc0 0x7fc510065ff0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:56.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.295+0000 7fc516d59700 1 --2- 172.21.15.77:0/1235071227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5100fcf70 0x7fc510066530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:56.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.295+0000 7fc516d59700 1 -- 172.21.15.77:0/1235071227 >> 172.21.15.77:0/1235071227 conn(0x7fc5100f7420 msgr2=0x7fc5100f8c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:56.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.295+0000 7fc516d59700 1 -- 172.21.15.77:0/1235071227 shutdown_connections 2024-04-25T02:09:56.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.295+0000 7fc516d59700 1 -- 172.21.15.77:0/1235071227 wait complete. 2024-04-25T02:09:56.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.398+0000 7ff5a6cd6700 1 -- 172.21.15.77:0/27852786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5a00fbcc0 msgr2=0x7ff5a00fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:56.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.398+0000 7ff5a6cd6700 1 --2- 172.21.15.77:0/27852786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5a00fbcc0 0x7ff5a00fc0d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff594004940 tx=0x7ff594009e30 comp rx=0 tx=0).stop 2024-04-25T02:09:56.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.398+0000 7ff5a6cd6700 1 -- 172.21.15.77:0/27852786 shutdown_connections 2024-04-25T02:09:56.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.398+0000 7ff5a6cd6700 1 --2- 172.21.15.77:0/27852786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5a00fcf70 0x7ff5a00fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:56.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.398+0000 7ff5a6cd6700 1 --2- 172.21.15.77:0/27852786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5a00fbcc0 0x7ff5a00fc0d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:56.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.398+0000 7ff5a6cd6700 1 -- 172.21.15.77:0/27852786 >> 172.21.15.77:0/27852786 conn(0x7ff5a00f7440 msgr2=0x7ff5a00f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:56.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.398+0000 7ff5a6cd6700 1 -- 172.21.15.77:0/27852786 shutdown_connections 2024-04-25T02:09:56.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.398+0000 7ff5a6cd6700 1 -- 172.21.15.77:0/27852786 wait complete. 2024-04-25T02:09:56.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.399+0000 7ff5a6cd6700 1 Processor -- start 2024-04-25T02:09:56.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.399+0000 7ff5a6cd6700 1 -- start start 2024-04-25T02:09:56.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.399+0000 7ff5a6cd6700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5a00fbcc0 0x7ff5a010c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:56.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.399+0000 7ff5a6cd6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5a00fcf70 0x7ff5a010cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:56.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.399+0000 7ff5a6cd6700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a010d330 con 0x7ff5a00fbcc0 2024-04-25T02:09:56.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.399+0000 7ff5a6cd6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a010d4a0 con 0x7ff5a00fcf70 2024-04-25T02:09:56.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.399+0000 7ff5a4a72700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5a00fbcc0 0x7ff5a010c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:56.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.399+0000 7ff5a4a72700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5a00fbcc0 0x7ff5a010c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57384/0 (socket says 172.21.15.77:57384) 2024-04-25T02:09:56.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.399+0000 7ff5a4a72700 1 -- 172.21.15.77:0/3830050171 learned_addr learned my addr 172.21.15.77:0/3830050171 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:09:56.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.399+0000 7ff59ffff700 1 --2- 172.21.15.77:0/3830050171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5a00fcf70 0x7ff5a010cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:56.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.400+0000 7ff5a4a72700 1 -- 172.21.15.77:0/3830050171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5a00fcf70 msgr2=0x7ff5a010cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:56.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.400+0000 7ff5a4a72700 1 --2- 172.21.15.77:0/3830050171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5a00fcf70 0x7ff5a010cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:56.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.400+0000 7ff5a4a72700 1 -- 172.21.15.77:0/3830050171 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff594005040 con 0x7ff5a00fbcc0 2024-04-25T02:09:56.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.400+0000 7ff5a4a72700 1 --2- 172.21.15.77:0/3830050171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5a00fbcc0 0x7ff5a010c7f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff594013870 tx=0x7ff594009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:56.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.400+0000 7ff59d7fa700 1 -- 172.21.15.77:0/3830050171 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff594021070 con 0x7ff5a00fbcc0 2024-04-25T02:09:56.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.400+0000 7ff5a6cd6700 1 -- 172.21.15.77:0/3830050171 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a0111ea0 con 0x7ff5a00fbcc0 2024-04-25T02:09:56.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.400+0000 7ff59d7fa700 1 -- 172.21.15.77:0/3830050171 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff59401c400 con 0x7ff5a00fbcc0 2024-04-25T02:09:56.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.400+0000 7ff59d7fa700 1 -- 172.21.15.77:0/3830050171 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff59400e070 con 0x7ff5a00fbcc0 2024-04-25T02:09:56.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.400+0000 7ff5a6cd6700 1 -- 172.21.15.77:0/3830050171 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a0112300 con 0x7ff5a00fbcc0 2024-04-25T02:09:56.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.401+0000 7ff5a6cd6700 1 -- 172.21.15.77:0/3830050171 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a004c710 con 0x7ff5a00fbcc0 2024-04-25T02:09:56.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.401+0000 7ff59d7fa700 1 -- 172.21.15.77:0/3830050171 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 25) v1 ==== 89381+0+0 (secure 0 0 0) 0x7ff59401ca70 con 0x7ff5a00fbcc0 2024-04-25T02:09:56.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.402+0000 7ff59d7fa700 1 --2- 172.21.15.77:0/3830050171 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7ff59006b7a0 0x7ff59006dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:56.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.402+0000 7ff59d7fa700 1 -- 172.21.15.77:0/3830050171 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7ff59408b5e0 con 0x7ff5a00fbcc0 2024-04-25T02:09:56.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.402+0000 7ff59ffff700 1 --2- 172.21.15.77:0/3830050171 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7ff59006b7a0 0x7ff59006dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:56.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.403+0000 7ff59ffff700 1 --2- 172.21.15.77:0/3830050171 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7ff59006b7a0 0x7ff59006dc50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff58c009b80 tx=0x7ff58c00b040 comp rx=0 tx=0).ready entity=mgr.24353 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:56.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.406+0000 7ff59d7fa700 1 -- 172.21.15.77:0/3830050171 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7ff594058c50 con 0x7ff5a00fbcc0 2024-04-25T02:09:56.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.642+0000 7ff5a6cd6700 1 -- 172.21.15.77:0/3830050171 --> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5a0101280 con 0x7ff59006b7a0 2024-04-25T02:09:56.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.644+0000 7ff59d7fa700 1 -- 172.21.15.77:0/3830050171 <== mgr.24353 v2:172.21.15.112:6828/218023931 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7ff5a0101280 con 0x7ff59006b7a0 2024-04-25T02:09:56.652 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:09:56.652 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901", 2024-04-25T02:09:56.652 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-04-25T02:09:56.652 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-25T02:09:56.652 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [], 2024-04-25T02:09:56.652 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "1/2 daemons upgraded", 2024-04-25T02:09:56.652 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "", 2024-04-25T02:09:56.652 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-04-25T02:09:56.652 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:09:56.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.646+0000 7ff5a6cd6700 1 -- 172.21.15.77:0/3830050171 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7ff59006b7a0 msgr2=0x7ff59006dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:56.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.646+0000 7ff5a6cd6700 1 --2- 172.21.15.77:0/3830050171 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7ff59006b7a0 0x7ff59006dc50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff58c009b80 tx=0x7ff58c00b040 comp rx=0 tx=0).stop 2024-04-25T02:09:56.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.646+0000 7ff5a6cd6700 1 -- 172.21.15.77:0/3830050171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5a00fbcc0 msgr2=0x7ff5a010c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:56.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.646+0000 7ff5a6cd6700 1 --2- 172.21.15.77:0/3830050171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5a00fbcc0 0x7ff5a010c7f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff594013870 tx=0x7ff594009e30 comp rx=0 tx=0).stop 2024-04-25T02:09:56.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.646+0000 7ff5a6cd6700 1 -- 172.21.15.77:0/3830050171 shutdown_connections 2024-04-25T02:09:56.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.646+0000 7ff5a6cd6700 1 --2- 172.21.15.77:0/3830050171 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7ff59006b7a0 0x7ff59006dc50 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:56.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.646+0000 7ff5a6cd6700 1 --2- 172.21.15.77:0/3830050171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5a00fbcc0 0x7ff5a010c7f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:56.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.646+0000 7ff5a6cd6700 1 --2- 172.21.15.77:0/3830050171 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff5a00fcf70 0x7ff5a010cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:56.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.646+0000 7ff5a6cd6700 1 -- 172.21.15.77:0/3830050171 >> 172.21.15.77:0/3830050171 conn(0x7ff5a00f7440 msgr2=0x7ff5a00f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:56.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.646+0000 7ff5a6cd6700 1 -- 172.21.15.77:0/3830050171 shutdown_connections 2024-04-25T02:09:56.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:09:56.646+0000 7ff5a6cd6700 1 -- 172.21.15.77:0/3830050171 wait complete. 2024-04-25T02:09:56.845 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:56 smithi077 ceph-mon[26330]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:56.845 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:56 smithi077 ceph-mon[26330]: pgmap v22: 65 pgs: 65 active+clean; 310 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 3.1 MiB/s wr, 176 op/s 2024-04-25T02:09:56.846 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:56 smithi077 ceph-mon[26330]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:56.846 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:56 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/1235071227' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:09:57.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:56 smithi112 ceph-mon[33313]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:57.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:56 smithi112 ceph-mon[33313]: pgmap v22: 65 pgs: 65 active+clean; 310 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 3.1 MiB/s wr, 176 op/s 2024-04-25T02:09:57.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:56 smithi112 ceph-mon[33313]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:57.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:56 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/1235071227' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:09:58.175 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:57 smithi077 ceph-mon[26330]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:58.175 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:57 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:58.176 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:57 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:58.176 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:57 smithi077 ceph-mon[26330]: Reconfiguring prometheus.smithi077 (dependencies changed)... 2024-04-25T02:09:58.176 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:57 smithi077 ceph-mon[26330]: Reconfiguring daemon prometheus.smithi077 on smithi077 2024-04-25T02:09:58.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:57 smithi112 ceph-mon[33313]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:58.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:57 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:58.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:57 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:09:58.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:57 smithi112 ceph-mon[33313]: Reconfiguring prometheus.smithi077 (dependencies changed)... 2024-04-25T02:09:58.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:57 smithi112 ceph-mon[33313]: Reconfiguring daemon prometheus.smithi077 on smithi077 2024-04-25T02:09:59.136 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:09:58 smithi077 ceph-mon[26330]: pgmap v23: 65 pgs: 65 active+clean; 310 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 13 KiB/s rd, 2.1 MiB/s wr, 116 op/s 2024-04-25T02:09:59.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:09:58 smithi112 ceph-mon[33313]: pgmap v23: 65 pgs: 65 active+clean; 310 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 13 KiB/s rd, 2.1 MiB/s wr, 116 op/s 2024-04-25T02:10:01.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:00 smithi077 ceph-mon[26330]: pgmap v24: 65 pgs: 65 active+clean; 308 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 3.0 MiB/s wr, 315 op/s 2024-04-25T02:10:01.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:00 smithi077 ceph-mon[26330]: overall HEALTH_OK 2024-04-25T02:10:01.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:00 smithi112 ceph-mon[33313]: pgmap v24: 65 pgs: 65 active+clean; 308 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 3.0 MiB/s wr, 315 op/s 2024-04-25T02:10:01.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:00 smithi112 ceph-mon[33313]: overall HEALTH_OK 2024-04-25T02:10:03.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:02 smithi077 ceph-mon[26330]: pgmap v25: 65 pgs: 65 active+clean; 308 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.8 MiB/s wr, 289 op/s 2024-04-25T02:10:03.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:02 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:10:03.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:02 smithi112 ceph-mon[33313]: pgmap v25: 65 pgs: 65 active+clean; 308 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.8 MiB/s wr, 289 op/s 2024-04-25T02:10:03.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:02 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:10:05.183 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:04 smithi077 ceph-mon[26330]: pgmap v26: 65 pgs: 65 active+clean; 309 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 2.1 MiB/s wr, 336 op/s 2024-04-25T02:10:05.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:04 smithi112 ceph-mon[33313]: pgmap v26: 65 pgs: 65 active+clean; 309 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 2.1 MiB/s wr, 336 op/s 2024-04-25T02:10:06.838 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:06 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:06.839 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:06 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:06.839 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:06 smithi112 ceph-mon[33313]: Reconfiguring node-exporter.smithi112 (dependencies changed)... 2024-04-25T02:10:06.839 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:06 smithi112 ceph-mon[33313]: Reconfiguring daemon node-exporter.smithi112 on smithi112 2024-04-25T02:10:06.839 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:06 smithi112 ceph-mon[33313]: pgmap v27: 65 pgs: 65 active+clean; 310 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 2.6 MiB/s wr, 554 op/s 2024-04-25T02:10:06.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:06 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:06.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:06 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:06.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:06 smithi077 ceph-mon[26330]: Reconfiguring node-exporter.smithi112 (dependencies changed)... 2024-04-25T02:10:06.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:06 smithi077 ceph-mon[26330]: Reconfiguring daemon node-exporter.smithi112 on smithi112 2024-04-25T02:10:06.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:06 smithi077 ceph-mon[26330]: pgmap v27: 65 pgs: 65 active+clean; 310 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 2.6 MiB/s wr, 554 op/s 2024-04-25T02:10:08.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:08 smithi077 ceph-mon[26330]: pgmap v28: 65 pgs: 65 active+clean; 310 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.7 MiB/s wr, 462 op/s 2024-04-25T02:10:08.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:08 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:08.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:08 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:08.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:08 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-25T02:10:08.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:08 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi077.front.sepia.ceph.com:9093"}]: dispatch 2024-04-25T02:10:08.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:08 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:08.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:08 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-25T02:10:08.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:08 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi077.front.sepia.ceph.com:3000"}]: dispatch 2024-04-25T02:10:08.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:08 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:08.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:08 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T02:10:08.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:08 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi077.front.sepia.ceph.com:9095"}]: dispatch 2024-04-25T02:10:08.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:08 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:08.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:08 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:10:09.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:08 smithi112 ceph-mon[33313]: pgmap v28: 65 pgs: 65 active+clean; 310 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.7 MiB/s wr, 462 op/s 2024-04-25T02:10:09.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:08 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:09.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:08 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:09.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:08 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-25T02:10:09.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:08 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi077.front.sepia.ceph.com:9093"}]: dispatch 2024-04-25T02:10:09.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:08 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:09.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:08 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-25T02:10:09.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:08 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi077.front.sepia.ceph.com:3000"}]: dispatch 2024-04-25T02:10:09.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:08 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:09.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:08 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T02:10:09.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:08 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi077.front.sepia.ceph.com:9095"}]: dispatch 2024-04-25T02:10:09.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:08 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:09.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:08 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:10:09.991 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:09 smithi077 ceph-mon[26330]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-25T02:10:09.991 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:09 smithi077 ceph-mon[26330]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi077.front.sepia.ceph.com:9093"}]: dispatch 2024-04-25T02:10:09.991 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:09 smithi077 ceph-mon[26330]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-25T02:10:09.991 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:09 smithi077 ceph-mon[26330]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi077.front.sepia.ceph.com:3000"}]: dispatch 2024-04-25T02:10:09.991 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:09 smithi077 ceph-mon[26330]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T02:10:09.992 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:09 smithi077 ceph-mon[26330]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi077.front.sepia.ceph.com:9095"}]: dispatch 2024-04-25T02:10:09.992 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:09 smithi077 ceph-mon[26330]: Upgrade: Need to upgrade myself (mgr.smithi112.cswrxs) 2024-04-25T02:10:09.992 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:09 smithi077 ceph-mon[26330]: Upgrade: Need to upgrade myself (mgr.smithi112.cswrxs) 2024-04-25T02:10:10.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:09 smithi112 ceph-mon[33313]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-25T02:10:10.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:09 smithi112 ceph-mon[33313]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi077.front.sepia.ceph.com:9093"}]: dispatch 2024-04-25T02:10:10.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:09 smithi112 ceph-mon[33313]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-25T02:10:10.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:09 smithi112 ceph-mon[33313]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi077.front.sepia.ceph.com:3000"}]: dispatch 2024-04-25T02:10:10.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:09 smithi112 ceph-mon[33313]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T02:10:10.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:09 smithi112 ceph-mon[33313]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi077.front.sepia.ceph.com:9095"}]: dispatch 2024-04-25T02:10:10.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:09 smithi112 ceph-mon[33313]: Upgrade: Need to upgrade myself (mgr.smithi112.cswrxs) 2024-04-25T02:10:10.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:09 smithi112 ceph-mon[33313]: Upgrade: Need to upgrade myself (mgr.smithi112.cswrxs) 2024-04-25T02:10:11.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:11 smithi112 ceph-mon[33313]: pgmap v29: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 2.4 MiB/s wr, 902 op/s 2024-04-25T02:10:11.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:11 smithi112 ceph-mon[33313]: Upgrade: Updating mgr.smithi077.zpflzp 2024-04-25T02:10:11.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:11 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:11.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:11 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi077.zpflzp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T02:10:11.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:11 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T02:10:11.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:11 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:10:11.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:11 smithi112 ceph-mon[33313]: Deploying daemon mgr.smithi077.zpflzp on smithi077 2024-04-25T02:10:11.625 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:11 smithi077 ceph-mon[26330]: pgmap v29: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 2.4 MiB/s wr, 902 op/s 2024-04-25T02:10:11.625 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:11 smithi077 ceph-mon[26330]: Upgrade: Updating mgr.smithi077.zpflzp 2024-04-25T02:10:11.625 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:11 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:11.625 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:11 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi077.zpflzp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T02:10:11.625 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:11 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T02:10:11.625 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:11 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:10:11.625 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:11 smithi077 ceph-mon[26330]: Deploying daemon mgr.smithi077.zpflzp on smithi077 2024-04-25T02:10:13.337 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:13 smithi077 ceph-mon[26330]: pgmap v30: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.5 MiB/s wr, 704 op/s 2024-04-25T02:10:13.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:13 smithi112 ceph-mon[33313]: pgmap v30: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.5 MiB/s wr, 704 op/s 2024-04-25T02:10:15.333 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:15 smithi077 ceph-mon[26330]: pgmap v31: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 1.8 MiB/s wr, 799 op/s 2024-04-25T02:10:15.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:15 smithi112 ceph-mon[33313]: pgmap v31: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 1.8 MiB/s wr, 799 op/s 2024-04-25T02:10:16.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:16 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:16.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:16 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:16.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:16 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:10:16.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:16 smithi077 ceph-mon[26330]: pgmap v32: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 2.1 MiB/s wr, 971 op/s 2024-04-25T02:10:16.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:16 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:16.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:16 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:16.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:16 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:16.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:16 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:16.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:16 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:10:16.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:16 smithi112 ceph-mon[33313]: pgmap v32: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 2.1 MiB/s wr, 971 op/s 2024-04-25T02:10:16.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:16 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:16.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:16 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:18.890 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:18 smithi077 ceph-mon[26330]: pgmap v33: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 753 op/s 2024-04-25T02:10:18.890 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:18 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:10:19.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:18 smithi112 ceph-mon[33313]: pgmap v33: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 753 op/s 2024-04-25T02:10:19.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:18 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:10:20.139 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:19 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:20.139 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:19 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:20.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:19 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:20.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:19 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:21.210 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:20 smithi077 ceph-mon[26330]: pgmap v34: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 2.3 MiB/s wr, 1.22k op/s 2024-04-25T02:10:21.210 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:20 smithi077 ceph-mon[26330]: mgrmap e26: smithi112.cswrxs(active, since 62s), standbys: smithi077.zpflzp 2024-04-25T02:10:21.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:20 smithi112 ceph-mon[33313]: pgmap v34: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 2.3 MiB/s wr, 1.22k op/s 2024-04-25T02:10:21.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:20 smithi112 ceph-mon[33313]: mgrmap e26: smithi112.cswrxs(active, since 62s), standbys: smithi077.zpflzp 2024-04-25T02:10:23.150 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:22 smithi077 ceph-mon[26330]: pgmap v35: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 782 op/s 2024-04-25T02:10:23.150 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:22 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:23.151 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:22 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:23.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:22 smithi112 ceph-mon[33313]: pgmap v35: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 782 op/s 2024-04-25T02:10:23.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:22 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:23.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:22 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:24.331 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:24 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:24.332 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:24 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:24.332 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:24 smithi077 ceph-mon[26330]: Standby manager daemon smithi077.zpflzp restarted 2024-04-25T02:10:24.332 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:24 smithi077 ceph-mon[26330]: Standby manager daemon smithi077.zpflzp started 2024-04-25T02:10:24.332 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:24 smithi077 ceph-mon[26330]: from='mgr.? 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi077.zpflzp/crt"}]: dispatch 2024-04-25T02:10:24.332 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:24 smithi077 ceph-mon[26330]: from='mgr.? 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T02:10:24.332 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:24 smithi077 ceph-mon[26330]: from='mgr.? 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi077.zpflzp/key"}]: dispatch 2024-04-25T02:10:24.332 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:24 smithi077 ceph-mon[26330]: from='mgr.? 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T02:10:24.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:24 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:24.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:24 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:24.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:24 smithi112 ceph-mon[33313]: Standby manager daemon smithi077.zpflzp restarted 2024-04-25T02:10:24.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:24 smithi112 ceph-mon[33313]: Standby manager daemon smithi077.zpflzp started 2024-04-25T02:10:24.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:24 smithi112 ceph-mon[33313]: from='mgr.? 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi077.zpflzp/crt"}]: dispatch 2024-04-25T02:10:24.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:24 smithi112 ceph-mon[33313]: from='mgr.? 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T02:10:24.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:24 smithi112 ceph-mon[33313]: from='mgr.? 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi077.zpflzp/key"}]: dispatch 2024-04-25T02:10:24.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:24 smithi112 ceph-mon[33313]: from='mgr.? 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T02:10:25.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:25 smithi077 ceph-mon[26330]: pgmap v36: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 1.8 MiB/s wr, 926 op/s 2024-04-25T02:10:25.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:25 smithi077 ceph-mon[26330]: mgrmap e27: smithi112.cswrxs(active, since 66s), standbys: smithi077.zpflzp 2024-04-25T02:10:25.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:25 smithi112 ceph-mon[33313]: pgmap v36: 65 pgs: 65 active+clean; 284 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 1.8 MiB/s wr, 926 op/s 2024-04-25T02:10:25.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:25 smithi112 ceph-mon[33313]: mgrmap e27: smithi112.cswrxs(active, since 66s), standbys: smithi077.zpflzp 2024-04-25T02:10:26.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.753+0000 7f6d59348700 1 -- 172.21.15.77:0/3516346535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d540fce60 msgr2=0x7f6d540fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:26.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.753+0000 7f6d59348700 1 --2- 172.21.15.77:0/3516346535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d540fce60 0x7f6d540fd270 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6d48004940 tx=0x7f6d48009e30 comp rx=0 tx=0).stop 2024-04-25T02:10:26.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.753+0000 7f6d59348700 1 -- 172.21.15.77:0/3516346535 shutdown_connections 2024-04-25T02:10:26.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.753+0000 7f6d59348700 1 --2- 172.21.15.77:0/3516346535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d540fdfd0 0x7f6d540fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:26.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.753+0000 7f6d59348700 1 --2- 172.21.15.77:0/3516346535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d540fce60 0x7f6d540fd270 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:26.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.753+0000 7f6d59348700 1 -- 172.21.15.77:0/3516346535 >> 172.21.15.77:0/3516346535 conn(0x7f6d540f8540 msgr2=0x7f6d540fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:26.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.753+0000 7f6d59348700 1 -- 172.21.15.77:0/3516346535 shutdown_connections 2024-04-25T02:10:26.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.753+0000 7f6d59348700 1 -- 172.21.15.77:0/3516346535 wait complete. 2024-04-25T02:10:26.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.754+0000 7f6d59348700 1 Processor -- start 2024-04-25T02:10:26.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.754+0000 7f6d59348700 1 -- start start 2024-04-25T02:10:26.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.754+0000 7f6d59348700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d540fce60 0x7f6d5410d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:26.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.754+0000 7f6d59348700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d540fdfd0 0x7f6d5410de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:26.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.754+0000 7f6d59348700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5410e400 con 0x7f6d540fce60 2024-04-25T02:10:26.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.754+0000 7f6d59348700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5410e570 con 0x7f6d540fdfd0 2024-04-25T02:10:26.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.754+0000 7f6d52ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d540fce60 0x7f6d5410d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:26.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.754+0000 7f6d52ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d540fce60 0x7f6d5410d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38564/0 (socket says 172.21.15.77:38564) 2024-04-25T02:10:26.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.754+0000 7f6d52ffd700 1 -- 172.21.15.77:0/2612210158 learned_addr learned my addr 172.21.15.77:0/2612210158 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:10:26.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.754+0000 7f6d527fc700 1 --2- 172.21.15.77:0/2612210158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d540fdfd0 0x7f6d5410de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:26.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.755+0000 7f6d527fc700 1 -- 172.21.15.77:0/2612210158 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d540fce60 msgr2=0x7f6d5410d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:26.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.755+0000 7f6d527fc700 1 --2- 172.21.15.77:0/2612210158 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d540fce60 0x7f6d5410d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:26.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.755+0000 7f6d527fc700 1 -- 172.21.15.77:0/2612210158 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d48005040 con 0x7f6d540fdfd0 2024-04-25T02:10:26.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.755+0000 7f6d52ffd700 1 --2- 172.21.15.77:0/2612210158 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d540fce60 0x7f6d5410d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:26.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.755+0000 7f6d527fc700 1 --2- 172.21.15.77:0/2612210158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d540fdfd0 0x7f6d5410de00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6d44009fd0 tx=0x7f6d4400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:26.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.755+0000 7f6d3b7fe700 1 -- 172.21.15.77:0/2612210158 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d44004e90 con 0x7f6d540fdfd0 2024-04-25T02:10:26.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.755+0000 7f6d59348700 1 -- 172.21.15.77:0/2612210158 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d54112f70 con 0x7f6d540fdfd0 2024-04-25T02:10:26.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.755+0000 7f6d3b7fe700 1 -- 172.21.15.77:0/2612210158 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6d4400f040 con 0x7f6d540fdfd0 2024-04-25T02:10:26.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.755+0000 7f6d59348700 1 -- 172.21.15.77:0/2612210158 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d54113480 con 0x7f6d540fdfd0 2024-04-25T02:10:26.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.755+0000 7f6d3b7fe700 1 -- 172.21.15.77:0/2612210158 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d4400ca50 con 0x7f6d540fdfd0 2024-04-25T02:10:26.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.756+0000 7f6d59348700 1 -- 172.21.15.77:0/2612210158 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d400052e0 con 0x7f6d540fdfd0 2024-04-25T02:10:26.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.757+0000 7f6d3b7fe700 1 -- 172.21.15.77:0/2612210158 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 27) v1 ==== 91927+0+0 (secure 0 0 0) 0x7f6d4400cbb0 con 0x7f6d540fdfd0 2024-04-25T02:10:26.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.757+0000 7f6d3b7fe700 1 --2- 172.21.15.77:0/2612210158 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f6d3c06da40 0x7f6d3c06fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:26.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.758+0000 7f6d3b7fe700 1 -- 172.21.15.77:0/2612210158 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f6d4408c9c0 con 0x7f6d540fdfd0 2024-04-25T02:10:26.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.758+0000 7f6d52ffd700 1 --2- 172.21.15.77:0/2612210158 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f6d3c06da40 0x7f6d3c06fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:26.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.758+0000 7f6d52ffd700 1 --2- 172.21.15.77:0/2612210158 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f6d3c06da40 0x7f6d3c06fef0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800b0d0 tx=0x7f6d48009e30 comp rx=0 tx=0).ready entity=mgr.24353 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:26.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:26.764+0000 7f6d3b7fe700 1 -- 172.21.15.77:0/2612210158 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f6d4405a300 con 0x7f6d540fdfd0 2024-04-25T02:10:27.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.027+0000 7f6d59348700 1 -- 172.21.15.77:0/2612210158 --> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d40000bf0 con 0x7f6d3c06da40 2024-04-25T02:10:27.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.032+0000 7f6d3b7fe700 1 -- 172.21.15.77:0/2612210158 <== mgr.24353 v2:172.21.15.112:6828/218023931 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f6d40000bf0 con 0x7f6d3c06da40 2024-04-25T02:10:27.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.039+0000 7f6d59348700 1 -- 172.21.15.77:0/2612210158 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f6d3c06da40 msgr2=0x7f6d3c06fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:27.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.039+0000 7f6d59348700 1 --2- 172.21.15.77:0/2612210158 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f6d3c06da40 0x7f6d3c06fef0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800b0d0 tx=0x7f6d48009e30 comp rx=0 tx=0).stop 2024-04-25T02:10:27.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.039+0000 7f6d59348700 1 -- 172.21.15.77:0/2612210158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d540fdfd0 msgr2=0x7f6d5410de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:27.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.039+0000 7f6d59348700 1 --2- 172.21.15.77:0/2612210158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d540fdfd0 0x7f6d5410de00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6d44009fd0 tx=0x7f6d4400b040 comp rx=0 tx=0).stop 2024-04-25T02:10:27.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.042+0000 7f6d59348700 1 -- 172.21.15.77:0/2612210158 shutdown_connections 2024-04-25T02:10:27.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.042+0000 7f6d59348700 1 --2- 172.21.15.77:0/2612210158 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f6d3c06da40 0x7f6d3c06fef0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.042+0000 7f6d59348700 1 --2- 172.21.15.77:0/2612210158 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d540fce60 0x7f6d5410d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.042+0000 7f6d59348700 1 --2- 172.21.15.77:0/2612210158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d540fdfd0 0x7f6d5410de00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.042+0000 7f6d59348700 1 -- 172.21.15.77:0/2612210158 >> 172.21.15.77:0/2612210158 conn(0x7f6d540f8540 msgr2=0x7f6d540f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:27.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.043+0000 7f6d59348700 1 -- 172.21.15.77:0/2612210158 shutdown_connections 2024-04-25T02:10:27.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.043+0000 7f6d59348700 1 -- 172.21.15.77:0/2612210158 wait complete. 2024-04-25T02:10:27.071 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-04-25T02:10:27.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.252+0000 7f488677a700 1 -- 172.21.15.77:0/267128215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f488006ed90 msgr2=0x7f4880108f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:27.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.252+0000 7f488677a700 1 --2- 172.21.15.77:0/267128215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f488006ed90 0x7f4880108f80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4874004940 tx=0x7f4874009e30 comp rx=0 tx=0).stop 2024-04-25T02:10:27.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.256+0000 7f488677a700 1 -- 172.21.15.77:0/267128215 shutdown_connections 2024-04-25T02:10:27.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.256+0000 7f488677a700 1 --2- 172.21.15.77:0/267128215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f488006ed90 0x7f4880108f80 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.256+0000 7f488677a700 1 --2- 172.21.15.77:0/267128215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f488006e440 0x7f488006e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.256+0000 7f488677a700 1 -- 172.21.15.77:0/267128215 >> 172.21.15.77:0/267128215 conn(0x7f4880069dc0 msgr2=0x7f488006c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:27.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.259+0000 7f488677a700 1 -- 172.21.15.77:0/267128215 shutdown_connections 2024-04-25T02:10:27.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.259+0000 7f488677a700 1 -- 172.21.15.77:0/267128215 wait complete. 2024-04-25T02:10:27.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.260+0000 7f488677a700 1 Processor -- start 2024-04-25T02:10:27.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.260+0000 7f488677a700 1 -- start start 2024-04-25T02:10:27.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.260+0000 7f488677a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f488006e440 0x7f488011c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:27.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.260+0000 7f488677a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f488006ed90 0x7f488011cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:27.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.260+0000 7f488677a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488011d270 con 0x7f488006ed90 2024-04-25T02:10:27.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.260+0000 7f488677a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488011d3e0 con 0x7f488006e440 2024-04-25T02:10:27.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.261+0000 7f487f7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f488006ed90 0x7f488011cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:27.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.261+0000 7f487f7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f488006ed90 0x7f488011cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38596/0 (socket says 172.21.15.77:38596) 2024-04-25T02:10:27.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.261+0000 7f487f7fe700 1 -- 172.21.15.77:0/3116532346 learned_addr learned my addr 172.21.15.77:0/3116532346 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:10:27.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.262+0000 7f487f7fe700 1 -- 172.21.15.77:0/3116532346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f488006e440 msgr2=0x7f488011c730 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T02:10:27.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.262+0000 7f487f7fe700 1 --2- 172.21.15.77:0/3116532346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f488006e440 0x7f488011c730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.262+0000 7f487f7fe700 1 -- 172.21.15.77:0/3116532346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4874005040 con 0x7f488006ed90 2024-04-25T02:10:27.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.262+0000 7f487f7fe700 1 --2- 172.21.15.77:0/3116532346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f488006ed90 0x7f488011cc70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f487400b3b0 tx=0x7f4874009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:27.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.262+0000 7f487cff9700 1 -- 172.21.15.77:0/3116532346 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f487400e030 con 0x7f488006ed90 2024-04-25T02:10:27.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.262+0000 7f487cff9700 1 -- 172.21.15.77:0/3116532346 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f487400bbf0 con 0x7f488006ed90 2024-04-25T02:10:27.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.262+0000 7f487cff9700 1 -- 172.21.15.77:0/3116532346 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f487401c400 con 0x7f488006ed90 2024-04-25T02:10:27.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.263+0000 7f488677a700 1 -- 172.21.15.77:0/3116532346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f488010b6c0 con 0x7f488006ed90 2024-04-25T02:10:27.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.263+0000 7f488677a700 1 -- 172.21.15.77:0/3116532346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f488010bbf0 con 0x7f488006ed90 2024-04-25T02:10:27.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.266+0000 7f487cff9700 1 -- 172.21.15.77:0/3116532346 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 27) v1 ==== 91927+0+0 (secure 0 0 0) 0x7f487400bd60 con 0x7f488006ed90 2024-04-25T02:10:27.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.266+0000 7f488677a700 1 -- 172.21.15.77:0/3116532346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488004c710 con 0x7f488006ed90 2024-04-25T02:10:27.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.267+0000 7f487cff9700 1 --2- 172.21.15.77:0/3116532346 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f486806db50 0x7f4868070000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:27.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.267+0000 7f487cff9700 1 -- 172.21.15.77:0/3116532346 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f487405fbc0 con 0x7f488006ed90 2024-04-25T02:10:27.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.269+0000 7f487ffff700 1 --2- 172.21.15.77:0/3116532346 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f486806db50 0x7f4868070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:27.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.274+0000 7f487ffff700 1 --2- 172.21.15.77:0/3116532346 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f486806db50 0x7f4868070000 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4870004b70 tx=0x7f4870007cc0 comp rx=0 tx=0).ready entity=mgr.24353 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:27.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.279+0000 7f487cff9700 1 -- 172.21.15.77:0/3116532346 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f4874058240 con 0x7f488006ed90 2024-04-25T02:10:27.286 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:27 smithi077 ceph-mon[26330]: pgmap v37: 65 pgs: 65 active+clean; 272 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 2.2 MiB/s wr, 1.01k op/s 2024-04-25T02:10:27.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:27 smithi112 ceph-mon[33313]: pgmap v37: 65 pgs: 65 active+clean; 272 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 2.2 MiB/s wr, 1.01k op/s 2024-04-25T02:10:27.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.716+0000 7f488677a700 1 -- 172.21.15.77:0/3116532346 --> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4880108760 con 0x7f486806db50 2024-04-25T02:10:27.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.719+0000 7f487cff9700 1 -- 172.21.15.77:0/3116532346 <== mgr.24353 v2:172.21.15.112:6828/218023931 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f4880108760 con 0x7f486806db50 2024-04-25T02:10:27.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.726+0000 7f488677a700 1 -- 172.21.15.77:0/3116532346 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f486806db50 msgr2=0x7f4868070000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:27.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.726+0000 7f488677a700 1 --2- 172.21.15.77:0/3116532346 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f486806db50 0x7f4868070000 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4870004b70 tx=0x7f4870007cc0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.726+0000 7f488677a700 1 -- 172.21.15.77:0/3116532346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f488006ed90 msgr2=0x7f488011cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:27.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.726+0000 7f488677a700 1 --2- 172.21.15.77:0/3116532346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f488006ed90 0x7f488011cc70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f487400b3b0 tx=0x7f4874009e30 comp rx=0 tx=0).stop 2024-04-25T02:10:27.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.728+0000 7f488677a700 1 -- 172.21.15.77:0/3116532346 shutdown_connections 2024-04-25T02:10:27.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.728+0000 7f488677a700 1 --2- 172.21.15.77:0/3116532346 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f486806db50 0x7f4868070000 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.728+0000 7f488677a700 1 --2- 172.21.15.77:0/3116532346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f488006e440 0x7f488011c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.728+0000 7f488677a700 1 --2- 172.21.15.77:0/3116532346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f488006ed90 0x7f488011cc70 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.728+0000 7f488677a700 1 -- 172.21.15.77:0/3116532346 >> 172.21.15.77:0/3116532346 conn(0x7f4880069dc0 msgr2=0x7f4880107040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:27.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.729+0000 7f488677a700 1 -- 172.21.15.77:0/3116532346 shutdown_connections 2024-04-25T02:10:27.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.731+0000 7f488677a700 1 -- 172.21.15.77:0/3116532346 wait complete. 2024-04-25T02:10:27.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.920+0000 7f2c86ac2700 1 -- 172.21.15.77:0/1045316044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c801033d0 msgr2=0x7f2c801037e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:27.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.920+0000 7f2c86ac2700 1 --2- 172.21.15.77:0/1045316044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c801033d0 0x7f2c801037e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2c70004880 tx=0x7f2c70009e30 comp rx=0 tx=0).stop 2024-04-25T02:10:27.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.920+0000 7f2c86ac2700 1 -- 172.21.15.77:0/1045316044 shutdown_connections 2024-04-25T02:10:27.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.920+0000 7f2c86ac2700 1 --2- 172.21.15.77:0/1045316044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c80104680 0x7f2c80104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.920+0000 7f2c86ac2700 1 --2- 172.21.15.77:0/1045316044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c801033d0 0x7f2c801037e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.921+0000 7f2c86ac2700 1 -- 172.21.15.77:0/1045316044 >> 172.21.15.77:0/1045316044 conn(0x7f2c80066ce0 msgr2=0x7f2c80067100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:27.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.921+0000 7f2c86ac2700 1 -- 172.21.15.77:0/1045316044 shutdown_connections 2024-04-25T02:10:27.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.922+0000 7f2c86ac2700 1 -- 172.21.15.77:0/1045316044 wait complete. 2024-04-25T02:10:27.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.923+0000 7f2c86ac2700 1 Processor -- start 2024-04-25T02:10:27.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.923+0000 7f2c86ac2700 1 -- start start 2024-04-25T02:10:27.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.923+0000 7f2c86ac2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c801033d0 0x7f2c80114060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:27.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.923+0000 7f2c86ac2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c80104680 0x7f2c801145a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:27.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.923+0000 7f2c86ac2700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c80114ba0 con 0x7f2c801033d0 2024-04-25T02:10:27.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.923+0000 7f2c86ac2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c801153a0 con 0x7f2c80104680 2024-04-25T02:10:27.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.924+0000 7f2c7ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c80104680 0x7f2c801145a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:27.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.924+0000 7f2c7ffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c80104680 0x7f2c801145a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.77:45980/0 (socket says 172.21.15.77:45980) 2024-04-25T02:10:27.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.924+0000 7f2c7ffff700 1 -- 172.21.15.77:0/1955496439 learned_addr learned my addr 172.21.15.77:0/1955496439 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:10:27.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.924+0000 7f2c7ffff700 1 -- 172.21.15.77:0/1955496439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c801033d0 msgr2=0x7f2c80114060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:10:27.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.924+0000 7f2c7ffff700 1 --2- 172.21.15.77:0/1955496439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c801033d0 0x7f2c80114060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:27.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.925+0000 7f2c7ffff700 1 -- 172.21.15.77:0/1955496439 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c70005040 con 0x7f2c80104680 2024-04-25T02:10:27.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.925+0000 7f2c7ffff700 1 --2- 172.21.15.77:0/1955496439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c80104680 0x7f2c801145a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2c740041d0 tx=0x7f2c7400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:27.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.926+0000 7f2c7d7fa700 1 -- 172.21.15.77:0/1955496439 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c74007cc0 con 0x7f2c80104680 2024-04-25T02:10:27.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.926+0000 7f2c7d7fa700 1 -- 172.21.15.77:0/1955496439 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2c7400f040 con 0x7f2c80104680 2024-04-25T02:10:27.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.926+0000 7f2c7d7fa700 1 -- 172.21.15.77:0/1955496439 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c7400cb50 con 0x7f2c80104680 2024-04-25T02:10:27.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.926+0000 7f2c86ac2700 1 -- 172.21.15.77:0/1955496439 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c80115620 con 0x7f2c80104680 2024-04-25T02:10:27.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.926+0000 7f2c86ac2700 1 -- 172.21.15.77:0/1955496439 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c80115aa0 con 0x7f2c80104680 2024-04-25T02:10:27.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.928+0000 7f2c86ac2700 1 -- 172.21.15.77:0/1955496439 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c6c0052e0 con 0x7f2c80104680 2024-04-25T02:10:27.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.928+0000 7f2c7d7fa700 1 -- 172.21.15.77:0/1955496439 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 27) v1 ==== 91927+0+0 (secure 0 0 0) 0x7f2c7400ccb0 con 0x7f2c80104680 2024-04-25T02:10:27.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.929+0000 7f2c7d7fa700 1 --2- 172.21.15.77:0/1955496439 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f2c6806db20 0x7f2c6806ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:27.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.929+0000 7f2c7d7fa700 1 -- 172.21.15.77:0/1955496439 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f2c7408cb90 con 0x7f2c80104680 2024-04-25T02:10:27.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.929+0000 7f2c8485e700 1 --2- 172.21.15.77:0/1955496439 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f2c6806db20 0x7f2c6806ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:27.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.930+0000 7f2c8485e700 1 --2- 172.21.15.77:0/1955496439 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f2c6806db20 0x7f2c6806ffd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2c70004880 tx=0x7f2c70009e30 comp rx=0 tx=0).ready entity=mgr.24353 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:27.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:27.938+0000 7f2c7d7fa700 1 -- 172.21.15.77:0/1955496439 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f2c7405b4e0 con 0x7f2c80104680 2024-04-25T02:10:28.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.231+0000 7f2c86ac2700 1 -- 172.21.15.77:0/1955496439 --> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c6c000bf0 con 0x7f2c6806db20 2024-04-25T02:10:28.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.245+0000 7f2c7d7fa700 1 -- 172.21.15.77:0/1955496439 <== mgr.24353 v2:172.21.15.112:6828/218023931 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f2c6c000bf0 con 0x7f2c6806db20 2024-04-25T02:10:28.253 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T02:10:28.253 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (45s) 6s ago 9m 16.3M - 0.25.0 c8568f914cd2 0d354e136134 2024-04-25T02:10:28.253 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (9m) 6s ago 9m 6665k - 17.2.7-902-gc61472c8 0de407c1b3af 2ad2e3d2b09e 2024-04-25T02:10:28.253 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi112 smithi112 running (8m) 9s ago 8m 6660k - 17.2.7-902-gc61472c8 0de407c1b3af 9235dc5eb15d 2024-04-25T02:10:28.253 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 unknown 6s ago 9m - - 2024-04-25T02:10:28.253 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.gcfygj smithi077 running (4m) 6s ago 4m 13.7M - 17.2.7-902-gc61472c8 0de407c1b3af 382dd7abf674 2024-04-25T02:10:28.253 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.oadrkb smithi077 running (4m) 6s ago 4m 12.1M - 17.2.7-902-gc61472c8 0de407c1b3af 6992064a4b2a 2024-04-25T02:10:28.254 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.dvwudt smithi112 running (4m) 9s ago 4m 228M - 17.2.7-902-gc61472c8 0de407c1b3af 0792e451abfd 2024-04-25T02:10:28.254 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.fjnadi smithi112 running (4m) 9s ago 4m 13.3M - 17.2.7-902-gc61472c8 0de407c1b3af c8093f622f6b 2024-04-25T02:10:28.254 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.zpflzp smithi077 *:8443,9283,8765 running (13s) 6s ago 10m 101M - 19.0.0-2445-gd2c45d97 f68e37b807ef a1af92e027e5 2024-04-25T02:10:28.254 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi112.cswrxs smithi112 *:8443,9283 running (102s) 9s ago 8m 506M - 19.0.0-2445-gd2c45d97 f68e37b807ef 89564cfe9a4c 2024-04-25T02:10:28.254 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (10m) 6s ago 11m 48.9M 2048M 17.2.7-902-gc61472c8 0de407c1b3af adb57965a306 2024-04-25T02:10:28.254 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi112 smithi112 running (8m) 9s ago 8m 34.6M 2048M 17.2.7-902-gc61472c8 0de407c1b3af db2fb9b09789 2024-04-25T02:10:28.254 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (50s) 6s ago 9m 8061k - 1.5.0 0da6a335fe13 ded4bbea5bf6 2024-04-25T02:10:28.254 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi112 smithi112 *:9100 running (20s) 9s ago 8m 8052k - 1.5.0 0da6a335fe13 a1266cab6f22 2024-04-25T02:10:28.254 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (7m) 6s ago 7m 220M 1557M 17.2.7-902-gc61472c8 0de407c1b3af c741abec3b94 2024-04-25T02:10:28.254 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (7m) 6s ago 7m 223M 1557M 17.2.7-902-gc61472c8 0de407c1b3af 256ff3ced322 2024-04-25T02:10:28.255 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (6m) 6s ago 6m 194M 1557M 17.2.7-902-gc61472c8 0de407c1b3af c5d7d8c993f4 2024-04-25T02:10:28.255 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi112 running (6m) 9s ago 6m 257M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 68429d0dbf88 2024-04-25T02:10:28.255 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi112 running (6m) 9s ago 6m 229M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 66eb71201444 2024-04-25T02:10:28.255 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi112 running (5m) 9s ago 5m 206M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 963e700d6aea 2024-04-25T02:10:28.255 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (23s) 6s ago 9m 38.7M - 2.43.0 a07b618ecd1d 704a322333d4 2024-04-25T02:10:28.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.248+0000 7f2c86ac2700 1 -- 172.21.15.77:0/1955496439 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f2c6806db20 msgr2=0x7f2c6806ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:28.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.248+0000 7f2c86ac2700 1 --2- 172.21.15.77:0/1955496439 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f2c6806db20 0x7f2c6806ffd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2c70004880 tx=0x7f2c70009e30 comp rx=0 tx=0).stop 2024-04-25T02:10:28.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.248+0000 7f2c86ac2700 1 -- 172.21.15.77:0/1955496439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c80104680 msgr2=0x7f2c801145a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:28.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.248+0000 7f2c86ac2700 1 --2- 172.21.15.77:0/1955496439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c80104680 0x7f2c801145a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2c740041d0 tx=0x7f2c7400b040 comp rx=0 tx=0).stop 2024-04-25T02:10:28.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.248+0000 7f2c86ac2700 1 -- 172.21.15.77:0/1955496439 shutdown_connections 2024-04-25T02:10:28.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.248+0000 7f2c86ac2700 1 --2- 172.21.15.77:0/1955496439 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f2c6806db20 0x7f2c6806ffd0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.248+0000 7f2c86ac2700 1 --2- 172.21.15.77:0/1955496439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c801033d0 0x7f2c80114060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.248+0000 7f2c86ac2700 1 --2- 172.21.15.77:0/1955496439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c80104680 0x7f2c801145a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.248+0000 7f2c86ac2700 1 -- 172.21.15.77:0/1955496439 >> 172.21.15.77:0/1955496439 conn(0x7f2c80066ce0 msgr2=0x7f2c80075120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:28.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.248+0000 7f2c86ac2700 1 -- 172.21.15.77:0/1955496439 shutdown_connections 2024-04-25T02:10:28.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.248+0000 7f2c86ac2700 1 -- 172.21.15.77:0/1955496439 wait complete. 2024-04-25T02:10:28.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.351+0000 7f4c310d3700 1 -- 172.21.15.77:0/520264360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c2c0fcf60 msgr2=0x7f4c2c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:28.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.351+0000 7f4c310d3700 1 --2- 172.21.15.77:0/520264360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c2c0fcf60 0x7f4c2c0fd3d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4c20004940 tx=0x7f4c20009e30 comp rx=0 tx=0).stop 2024-04-25T02:10:28.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.351+0000 7f4c310d3700 1 -- 172.21.15.77:0/520264360 shutdown_connections 2024-04-25T02:10:28.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.351+0000 7f4c310d3700 1 --2- 172.21.15.77:0/520264360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c2c0fcf60 0x7f4c2c0fd3d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.351+0000 7f4c310d3700 1 --2- 172.21.15.77:0/520264360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c2c0fbcb0 0x7f4c2c0fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.351+0000 7f4c310d3700 1 -- 172.21.15.77:0/520264360 >> 172.21.15.77:0/520264360 conn(0x7f4c2c0f7430 msgr2=0x7f4c2c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:28.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.351+0000 7f4c310d3700 1 -- 172.21.15.77:0/520264360 shutdown_connections 2024-04-25T02:10:28.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.351+0000 7f4c310d3700 1 -- 172.21.15.77:0/520264360 wait complete. 2024-04-25T02:10:28.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.351+0000 7f4c310d3700 1 Processor -- start 2024-04-25T02:10:28.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.351+0000 7f4c310d3700 1 -- start start 2024-04-25T02:10:28.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.352+0000 7f4c310d3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c2c0fbcb0 0x7f4c2c0ffb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:28.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.352+0000 7f4c310d3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c2c0fcf60 0x7f4c2c0fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:28.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.352+0000 7f4c310d3700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c100150 con 0x7f4c2c0fcf60 2024-04-25T02:10:28.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.352+0000 7f4c310d3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c0fe7e0 con 0x7f4c2c0fbcb0 2024-04-25T02:10:28.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.352+0000 7f4c2a59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c2c0fcf60 0x7f4c2c0fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:28.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.352+0000 7f4c2a59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c2c0fcf60 0x7f4c2c0fe2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37526/0 (socket says 172.21.15.77:37526) 2024-04-25T02:10:28.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.352+0000 7f4c2a59c700 1 -- 172.21.15.77:0/1754414547 learned_addr learned my addr 172.21.15.77:0/1754414547 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:10:28.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.352+0000 7f4c2ad9d700 1 --2- 172.21.15.77:0/1754414547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c2c0fbcb0 0x7f4c2c0ffb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:28.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.352+0000 7f4c2a59c700 1 -- 172.21.15.77:0/1754414547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c2c0fbcb0 msgr2=0x7f4c2c0ffb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:28.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.352+0000 7f4c2a59c700 1 --2- 172.21.15.77:0/1754414547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c2c0fbcb0 0x7f4c2c0ffb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.352+0000 7f4c2a59c700 1 -- 172.21.15.77:0/1754414547 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c20005040 con 0x7f4c2c0fcf60 2024-04-25T02:10:28.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.352+0000 7f4c2a59c700 1 --2- 172.21.15.77:0/1754414547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c2c0fcf60 0x7f4c2c0fe2a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000b3b0 tx=0x7f4c20009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:28.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.352+0000 7f4c137fe700 1 -- 172.21.15.77:0/1754414547 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c2000e040 con 0x7f4c2c0fcf60 2024-04-25T02:10:28.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.352+0000 7f4c310d3700 1 -- 172.21.15.77:0/1754414547 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c2c0fea60 con 0x7f4c2c0fcf60 2024-04-25T02:10:28.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.352+0000 7f4c137fe700 1 -- 172.21.15.77:0/1754414547 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4c20004290 con 0x7f4c2c0fcf60 2024-04-25T02:10:28.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.352+0000 7f4c137fe700 1 -- 172.21.15.77:0/1754414547 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c2001c3f0 con 0x7f4c2c0fcf60 2024-04-25T02:10:28.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.352+0000 7f4c310d3700 1 -- 172.21.15.77:0/1754414547 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c2c0ff020 con 0x7f4c2c0fcf60 2024-04-25T02:10:28.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.353+0000 7f4c310d3700 1 -- 172.21.15.77:0/1754414547 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c2c04c710 con 0x7f4c2c0fcf60 2024-04-25T02:10:28.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.354+0000 7f4c137fe700 1 -- 172.21.15.77:0/1754414547 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 27) v1 ==== 91927+0+0 (secure 0 0 0) 0x7f4c2000bbf0 con 0x7f4c2c0fcf60 2024-04-25T02:10:28.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.354+0000 7f4c137fe700 1 --2- 172.21.15.77:0/1754414547 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f4c1406da40 0x7f4c1406fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:28.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.354+0000 7f4c137fe700 1 -- 172.21.15.77:0/1754414547 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f4c2008e3b0 con 0x7f4c2c0fcf60 2024-04-25T02:10:28.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.355+0000 7f4c2ad9d700 1 --2- 172.21.15.77:0/1754414547 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f4c1406da40 0x7f4c1406fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:28.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.355+0000 7f4c2ad9d700 1 --2- 172.21.15.77:0/1754414547 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f4c1406da40 0x7f4c1406fef0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009fd0 tx=0x7f4c1c00b040 comp rx=0 tx=0).ready entity=mgr.24353 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:28.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.359+0000 7f4c137fe700 1 -- 172.21.15.77:0/1754414547 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f4c2005bc40 con 0x7f4c2c0fcf60 2024-04-25T02:10:28.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:28 smithi077 ceph-mon[26330]: from='client.24435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:10:28.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:28 smithi112 ceph-mon[33313]: from='client.24435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:10:28.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.658+0000 7f4c310d3700 1 -- 172.21.15.77:0/1754414547 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4c2c101a20 con 0x7f4c2c0fcf60 2024-04-25T02:10:28.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.659+0000 7f4c137fe700 1 -- 172.21.15.77:0/1754414547 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f4c2005b7d0 con 0x7f4c2c0fcf60 2024-04-25T02:10:28.666 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:10:28.666 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-04-25T02:10:28.666 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2 2024-04-25T02:10:28.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:10:28.666 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-04-25T02:10:28.666 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:10:28.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:10:28.666 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-04-25T02:10:28.666 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 6 2024-04-25T02:10:28.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:10:28.666 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-04-25T02:10:28.667 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T02:10:28.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:10:28.667 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-04-25T02:10:28.667 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 12, 2024-04-25T02:10:28.667 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:10:28.667 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-25T02:10:28.667 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:10:28.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.661+0000 7f4c310d3700 1 -- 172.21.15.77:0/1754414547 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f4c1406da40 msgr2=0x7f4c1406fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:28.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.661+0000 7f4c310d3700 1 --2- 172.21.15.77:0/1754414547 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f4c1406da40 0x7f4c1406fef0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009fd0 tx=0x7f4c1c00b040 comp rx=0 tx=0).stop 2024-04-25T02:10:28.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.661+0000 7f4c310d3700 1 -- 172.21.15.77:0/1754414547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c2c0fcf60 msgr2=0x7f4c2c0fe2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:28.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.661+0000 7f4c310d3700 1 --2- 172.21.15.77:0/1754414547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c2c0fcf60 0x7f4c2c0fe2a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000b3b0 tx=0x7f4c20009e30 comp rx=0 tx=0).stop 2024-04-25T02:10:28.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.661+0000 7f4c310d3700 1 -- 172.21.15.77:0/1754414547 shutdown_connections 2024-04-25T02:10:28.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.661+0000 7f4c310d3700 1 --2- 172.21.15.77:0/1754414547 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f4c1406da40 0x7f4c1406fef0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.661+0000 7f4c310d3700 1 --2- 172.21.15.77:0/1754414547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c2c0fbcb0 0x7f4c2c0ffb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.661+0000 7f4c310d3700 1 --2- 172.21.15.77:0/1754414547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c2c0fcf60 0x7f4c2c0fe2a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.661+0000 7f4c310d3700 1 -- 172.21.15.77:0/1754414547 >> 172.21.15.77:0/1754414547 conn(0x7f4c2c0f7430 msgr2=0x7f4c2c066710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:28.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.661+0000 7f4c310d3700 1 -- 172.21.15.77:0/1754414547 shutdown_connections 2024-04-25T02:10:28.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.661+0000 7f4c310d3700 1 -- 172.21.15.77:0/1754414547 wait complete. 2024-04-25T02:10:28.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.766+0000 7f1e2d1e6700 1 -- 172.21.15.77:0/2809747486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e280fbcc0 msgr2=0x7f1e280fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:28.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.766+0000 7f1e2d1e6700 1 --2- 172.21.15.77:0/2809747486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e280fbcc0 0x7f1e280fc0d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1e10004940 tx=0x7f1e10009e30 comp rx=0 tx=0).stop 2024-04-25T02:10:28.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.766+0000 7f1e2d1e6700 1 -- 172.21.15.77:0/2809747486 shutdown_connections 2024-04-25T02:10:28.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.766+0000 7f1e2d1e6700 1 --2- 172.21.15.77:0/2809747486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e280fcf70 0x7f1e280fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.766+0000 7f1e2d1e6700 1 --2- 172.21.15.77:0/2809747486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e280fbcc0 0x7f1e280fc0d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.766+0000 7f1e2d1e6700 1 -- 172.21.15.77:0/2809747486 >> 172.21.15.77:0/2809747486 conn(0x7f1e280f7440 msgr2=0x7f1e280f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:28.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.766+0000 7f1e2d1e6700 1 -- 172.21.15.77:0/2809747486 shutdown_connections 2024-04-25T02:10:28.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.766+0000 7f1e2d1e6700 1 -- 172.21.15.77:0/2809747486 wait complete. 2024-04-25T02:10:28.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.766+0000 7f1e2d1e6700 1 Processor -- start 2024-04-25T02:10:28.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.766+0000 7f1e2d1e6700 1 -- start start 2024-04-25T02:10:28.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.766+0000 7f1e2d1e6700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e280fbcc0 0x7f1e2810c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:28.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.766+0000 7f1e2d1e6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e280fcf70 0x7f1e2810cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:28.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.766+0000 7f1e2d1e6700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2810d330 con 0x7f1e280fbcc0 2024-04-25T02:10:28.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.766+0000 7f1e2d1e6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2810d4a0 con 0x7f1e280fcf70 2024-04-25T02:10:28.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.767+0000 7f1e26d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e280fbcc0 0x7f1e2810c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:28.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.767+0000 7f1e26d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e280fbcc0 0x7f1e2810c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37556/0 (socket says 172.21.15.77:37556) 2024-04-25T02:10:28.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.767+0000 7f1e26d9d700 1 -- 172.21.15.77:0/860866143 learned_addr learned my addr 172.21.15.77:0/860866143 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:10:28.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.767+0000 7f1e2659c700 1 --2- 172.21.15.77:0/860866143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e280fcf70 0x7f1e2810cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:28.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.767+0000 7f1e26d9d700 1 -- 172.21.15.77:0/860866143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e280fcf70 msgr2=0x7f1e2810cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:28.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.767+0000 7f1e26d9d700 1 --2- 172.21.15.77:0/860866143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e280fcf70 0x7f1e2810cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:28.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.767+0000 7f1e26d9d700 1 -- 172.21.15.77:0/860866143 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e10005040 con 0x7f1e280fbcc0 2024-04-25T02:10:28.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.767+0000 7f1e26d9d700 1 --2- 172.21.15.77:0/860866143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e280fbcc0 0x7f1e2810c7f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1e10013870 tx=0x7f1e10009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:28.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.767+0000 7f1e1f7fe700 1 -- 172.21.15.77:0/860866143 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e10021070 con 0x7f1e280fbcc0 2024-04-25T02:10:28.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.767+0000 7f1e1f7fe700 1 -- 172.21.15.77:0/860866143 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1e1001c400 con 0x7f1e280fbcc0 2024-04-25T02:10:28.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.767+0000 7f1e2d1e6700 1 -- 172.21.15.77:0/860866143 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e28111ea0 con 0x7f1e280fbcc0 2024-04-25T02:10:28.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.767+0000 7f1e1f7fe700 1 -- 172.21.15.77:0/860866143 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e1000e070 con 0x7f1e280fbcc0 2024-04-25T02:10:28.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.767+0000 7f1e2d1e6700 1 -- 172.21.15.77:0/860866143 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e28112300 con 0x7f1e280fbcc0 2024-04-25T02:10:28.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.768+0000 7f1e2d1e6700 1 -- 172.21.15.77:0/860866143 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e2804c710 con 0x7f1e280fbcc0 2024-04-25T02:10:28.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.769+0000 7f1e1f7fe700 1 -- 172.21.15.77:0/860866143 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 27) v1 ==== 91927+0+0 (secure 0 0 0) 0x7f1e1001ca70 con 0x7f1e280fbcc0 2024-04-25T02:10:28.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.769+0000 7f1e1f7fe700 1 --2- 172.21.15.77:0/860866143 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f1e1406da40 0x7f1e1406fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:28.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.769+0000 7f1e1f7fe700 1 -- 172.21.15.77:0/860866143 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f1e1008e210 con 0x7f1e280fbcc0 2024-04-25T02:10:28.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.769+0000 7f1e2659c700 1 --2- 172.21.15.77:0/860866143 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f1e1406da40 0x7f1e1406fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:28.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.770+0000 7f1e2659c700 1 --2- 172.21.15.77:0/860866143 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f1e1406da40 0x7f1e1406fef0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1e18009b80 tx=0x7f1e1800b040 comp rx=0 tx=0).ready entity=mgr.24353 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:28.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:28.774+0000 7f1e1f7fe700 1 -- 172.21.15.77:0/860866143 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f1e1005baa0 con 0x7f1e280fbcc0 2024-04-25T02:10:29.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:29.000+0000 7f1e2d1e6700 1 -- 172.21.15.77:0/860866143 --> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e28101280 con 0x7f1e1406da40 2024-04-25T02:10:29.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:29.001+0000 7f1e1f7fe700 1 -- 172.21.15.77:0/860866143 <== mgr.24353 v2:172.21.15.112:6828/218023931 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f1e28101280 con 0x7f1e1406da40 2024-04-25T02:10:29.008 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:10:29.008 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901", 2024-04-25T02:10:29.008 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-04-25T02:10:29.008 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-25T02:10:29.009 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-04-25T02:10:29.009 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr" 2024-04-25T02:10:29.009 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-25T02:10:29.009 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "2/2 daemons upgraded", 2024-04-25T02:10:29.009 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading mgr daemons", 2024-04-25T02:10:29.009 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-04-25T02:10:29.009 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:10:29.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:29.003+0000 7f1e2d1e6700 1 -- 172.21.15.77:0/860866143 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f1e1406da40 msgr2=0x7f1e1406fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:29.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:29.003+0000 7f1e2d1e6700 1 --2- 172.21.15.77:0/860866143 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f1e1406da40 0x7f1e1406fef0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1e18009b80 tx=0x7f1e1800b040 comp rx=0 tx=0).stop 2024-04-25T02:10:29.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:29.003+0000 7f1e2d1e6700 1 -- 172.21.15.77:0/860866143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e280fbcc0 msgr2=0x7f1e2810c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:29.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:29.003+0000 7f1e2d1e6700 1 --2- 172.21.15.77:0/860866143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e280fbcc0 0x7f1e2810c7f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1e10013870 tx=0x7f1e10009e30 comp rx=0 tx=0).stop 2024-04-25T02:10:29.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:29.003+0000 7f1e2d1e6700 1 -- 172.21.15.77:0/860866143 shutdown_connections 2024-04-25T02:10:29.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:29.003+0000 7f1e2d1e6700 1 --2- 172.21.15.77:0/860866143 >> [v2:172.21.15.112:6828/218023931,v1:172.21.15.112:6829/218023931] conn(0x7f1e1406da40 0x7f1e1406fef0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:29.003+0000 7f1e2d1e6700 1 --2- 172.21.15.77:0/860866143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e280fbcc0 0x7f1e2810c7f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:29.003+0000 7f1e2d1e6700 1 --2- 172.21.15.77:0/860866143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e280fcf70 0x7f1e2810cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:29.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:29.003+0000 7f1e2d1e6700 1 -- 172.21.15.77:0/860866143 >> 172.21.15.77:0/860866143 conn(0x7f1e280f7440 msgr2=0x7f1e280f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:29.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:29.003+0000 7f1e2d1e6700 1 -- 172.21.15.77:0/860866143 shutdown_connections 2024-04-25T02:10:29.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:29.003+0000 7f1e2d1e6700 1 -- 172.21.15.77:0/860866143 wait complete. 2024-04-25T02:10:29.417 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:29 smithi077 ceph-mon[26330]: pgmap v38: 65 pgs: 65 active+clean; 272 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.7 MiB/s wr, 789 op/s 2024-04-25T02:10:29.417 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:29 smithi077 ceph-mon[26330]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:10:29.417 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:29 smithi077 ceph-mon[26330]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:10:29.417 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:29 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/1754414547' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:10:29.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:29 smithi112 ceph-mon[33313]: pgmap v38: 65 pgs: 65 active+clean; 272 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.7 MiB/s wr, 789 op/s 2024-04-25T02:10:29.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:29 smithi112 ceph-mon[33313]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:10:29.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:29 smithi112 ceph-mon[33313]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:10:29.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:29 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/1754414547' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:10:30.481 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:10:30.481 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:30.481 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:30.481 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:10:30.481 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:10:30.481 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:30.481 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:10:30.482 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "mgr fail", "who": "smithi112.cswrxs"}]: dispatch 2024-04-25T02:10:30.482 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: Activating manager daemon smithi077.zpflzp 2024-04-25T02:10:30.482 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: osdmap e49: 6 total, 6 up, 6 in 2024-04-25T02:10:30.482 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd='[{"prefix": "mgr fail", "who": "smithi112.cswrxs"}]': finished 2024-04-25T02:10:30.482 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: mgrmap e28: smithi077.zpflzp(active, starting, since 0.00693993s) 2024-04-25T02:10:30.482 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-04-25T02:10:30.482 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-04-25T02:10:30.482 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.gcfygj"}]: dispatch 2024-04-25T02:10:30.482 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.oadrkb"}]: dispatch 2024-04-25T02:10:30.482 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.dvwudt"}]: dispatch 2024-04-25T02:10:30.482 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.fjnadi"}]: dispatch 2024-04-25T02:10:30.482 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr metadata", "who": "smithi077.zpflzp", "id": "smithi077.zpflzp"}]: dispatch 2024-04-25T02:10:30.482 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:10:30.482 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:10:30.483 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:10:30.483 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:10:30.483 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:10:30.483 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:10:30.483 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T02:10:30.483 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T02:10:30.483 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T02:10:30.483 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: Manager daemon smithi077.zpflzp is now available 2024-04-25T02:10:30.483 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:10:30.483 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:10:30.483 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.zpflzp/mirror_snapshot_schedule"}]: dispatch 2024-04-25T02:10:30.483 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:30 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.zpflzp/trash_purge_schedule"}]: dispatch 2024-04-25T02:10:30.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:10:30.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:30.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:30.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:10:30.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:10:30.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' 2024-04-25T02:10:30.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:10:30.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "mgr fail", "who": "smithi112.cswrxs"}]: dispatch 2024-04-25T02:10:30.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: Activating manager daemon smithi077.zpflzp 2024-04-25T02:10:30.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: osdmap e49: 6 total, 6 up, 6 in 2024-04-25T02:10:30.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='mgr.24353 172.21.15.112:0/1474648761' entity='mgr.smithi112.cswrxs' cmd='[{"prefix": "mgr fail", "who": "smithi112.cswrxs"}]': finished 2024-04-25T02:10:30.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: mgrmap e28: smithi077.zpflzp(active, starting, since 0.00693993s) 2024-04-25T02:10:30.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-04-25T02:10:30.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-04-25T02:10:30.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.gcfygj"}]: dispatch 2024-04-25T02:10:30.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.oadrkb"}]: dispatch 2024-04-25T02:10:30.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.dvwudt"}]: dispatch 2024-04-25T02:10:30.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.fjnadi"}]: dispatch 2024-04-25T02:10:30.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr metadata", "who": "smithi077.zpflzp", "id": "smithi077.zpflzp"}]: dispatch 2024-04-25T02:10:30.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:10:30.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:10:30.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:10:30.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:10:30.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:10:30.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:10:30.533 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T02:10:30.533 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T02:10:30.533 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T02:10:30.533 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: Manager daemon smithi077.zpflzp is now available 2024-04-25T02:10:30.533 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:10:30.533 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:10:30.533 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.zpflzp/mirror_snapshot_schedule"}]: dispatch 2024-04-25T02:10:30.533 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:30 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.zpflzp/trash_purge_schedule"}]: dispatch 2024-04-25T02:10:31.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:31 smithi112 ceph-mon[33313]: [25/Apr/2024:02:10:30] ENGINE Bus STARTING 2024-04-25T02:10:31.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:31 smithi112 ceph-mon[33313]: [25/Apr/2024:02:10:30] ENGINE Serving on https://172.21.15.77:7150 2024-04-25T02:10:31.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:31 smithi112 ceph-mon[33313]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-25T02:10:31.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:31 smithi112 ceph-mon[33313]: mgrmap e29: smithi077.zpflzp(active, since 1.00807s) 2024-04-25T02:10:31.481 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:31 smithi077 ceph-mon[26330]: [25/Apr/2024:02:10:30] ENGINE Bus STARTING 2024-04-25T02:10:31.481 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:31 smithi077 ceph-mon[26330]: [25/Apr/2024:02:10:30] ENGINE Serving on https://172.21.15.77:7150 2024-04-25T02:10:31.482 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:31 smithi077 ceph-mon[26330]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-25T02:10:31.482 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:31 smithi077 ceph-mon[26330]: mgrmap e29: smithi077.zpflzp(active, since 1.00807s) 2024-04-25T02:10:32.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:32 smithi112 ceph-mon[33313]: [25/Apr/2024:02:10:30] ENGINE Serving on http://172.21.15.77:8765 2024-04-25T02:10:32.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:32 smithi112 ceph-mon[33313]: [25/Apr/2024:02:10:30] ENGINE Bus STARTED 2024-04-25T02:10:32.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:32 smithi112 ceph-mon[33313]: pgmap v3: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:10:32.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:32 smithi112 ceph-mon[33313]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-04-25T02:10:32.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:32 smithi112 ceph-mon[33313]: Cluster is now healthy 2024-04-25T02:10:32.444 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:32 smithi077 ceph-mon[26330]: [25/Apr/2024:02:10:30] ENGINE Serving on http://172.21.15.77:8765 2024-04-25T02:10:32.444 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:32 smithi077 ceph-mon[26330]: [25/Apr/2024:02:10:30] ENGINE Bus STARTED 2024-04-25T02:10:32.444 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:32 smithi077 ceph-mon[26330]: pgmap v3: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:10:32.444 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:32 smithi077 ceph-mon[26330]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-04-25T02:10:32.444 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:32 smithi077 ceph-mon[26330]: Cluster is now healthy 2024-04-25T02:10:33.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:33 smithi077 ceph-mon[26330]: pgmap v4: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:10:33.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:33 smithi077 ceph-mon[26330]: mgrmap e30: smithi077.zpflzp(active, since 2s) 2024-04-25T02:10:33.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:33 smithi112 ceph-mon[33313]: pgmap v4: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:10:33.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:33 smithi112 ceph-mon[33313]: mgrmap e30: smithi077.zpflzp(active, since 2s) 2024-04-25T02:10:34.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:34 smithi077 ceph-mon[26330]: pgmap v5: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:10:34.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:34 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:34.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:34 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:34.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:34 smithi077 ceph-mon[26330]: mgrmap e31: smithi077.zpflzp(active, since 4s) 2024-04-25T02:10:35.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:34 smithi112 ceph-mon[33313]: pgmap v5: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:10:35.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:34 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:35.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:34 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:35.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:34 smithi112 ceph-mon[33313]: mgrmap e31: smithi077.zpflzp(active, since 4s) 2024-04-25T02:10:36.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:36 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:36.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:36 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:36.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:36 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:36.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:36 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:36.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:36 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:36.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:36 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:36.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:36 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:36.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:36 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:37.244 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:37 smithi112 ceph-mon[33313]: pgmap v6: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:10:37.244 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:37 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:37.245 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:37 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:37.390 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:37 smithi077 ceph-mon[26330]: pgmap v6: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:10:37.390 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:37 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:37.390 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:37 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:39.410 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:39 smithi077 ceph-mon[26330]: pgmap v7: 65 pgs: 65 active+clean; 241 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 50 KiB/s rd, 1.0 MiB/s wr, 289 op/s 2024-04-25T02:10:39.410 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:39 smithi077 ceph-mon[26330]: Standby manager daemon smithi112.cswrxs started 2024-04-25T02:10:39.410 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:39 smithi077 ceph-mon[26330]: from='mgr.? 172.21.15.112:0/823637783' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.cswrxs/crt"}]: dispatch 2024-04-25T02:10:39.410 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:39 smithi077 ceph-mon[26330]: from='mgr.? 172.21.15.112:0/823637783' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T02:10:39.410 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:39 smithi077 ceph-mon[26330]: from='mgr.? 172.21.15.112:0/823637783' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.cswrxs/key"}]: dispatch 2024-04-25T02:10:39.410 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:39 smithi077 ceph-mon[26330]: from='mgr.? 172.21.15.112:0/823637783' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T02:10:39.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:39 smithi112 ceph-mon[33313]: pgmap v7: 65 pgs: 65 active+clean; 241 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 50 KiB/s rd, 1.0 MiB/s wr, 289 op/s 2024-04-25T02:10:39.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:39 smithi112 ceph-mon[33313]: Standby manager daemon smithi112.cswrxs started 2024-04-25T02:10:39.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:39 smithi112 ceph-mon[33313]: from='mgr.? 172.21.15.112:0/823637783' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.cswrxs/crt"}]: dispatch 2024-04-25T02:10:39.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:39 smithi112 ceph-mon[33313]: from='mgr.? 172.21.15.112:0/823637783' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T02:10:39.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:39 smithi112 ceph-mon[33313]: from='mgr.? 172.21.15.112:0/823637783' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.cswrxs/key"}]: dispatch 2024-04-25T02:10:39.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:39 smithi112 ceph-mon[33313]: from='mgr.? 172.21.15.112:0/823637783' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T02:10:40.123 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-25T02:10:40.123 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-25T02:10:40.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:40 smithi077 ceph-mon[26330]: mgrmap e32: smithi077.zpflzp(active, since 9s), standbys: smithi112.cswrxs 2024-04-25T02:10:40.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:40 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr metadata", "who": "smithi112.cswrxs", "id": "smithi112.cswrxs"}]: dispatch 2024-04-25T02:10:40.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:40 smithi112 ceph-mon[33313]: mgrmap e32: smithi077.zpflzp(active, since 9s), standbys: smithi112.cswrxs 2024-04-25T02:10:40.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:40 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr metadata", "who": "smithi112.cswrxs", "id": "smithi112.cswrxs"}]: dispatch 2024-04-25T02:10:40.544 DEBUG:teuthology.parallel:result is None 2024-04-25T02:10:41.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:41 smithi077 ceph-mon[26330]: pgmap v8: 65 pgs: 65 active+clean; 241 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 833 KiB/s wr, 224 op/s 2024-04-25T02:10:41.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:41 smithi112 ceph-mon[33313]: pgmap v8: 65 pgs: 65 active+clean; 241 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 833 KiB/s wr, 224 op/s 2024-04-25T02:10:42.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:42 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:42.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:42 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:42.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:42 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:10:42.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:42 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:10:42.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:42 smithi077 ceph-mon[26330]: Updating smithi077:/etc/ceph/ceph.conf 2024-04-25T02:10:42.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:42 smithi077 ceph-mon[26330]: Updating smithi112:/etc/ceph/ceph.conf 2024-04-25T02:10:42.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:42 smithi077 ceph-mon[26330]: pgmap v9: 65 pgs: 65 active+clean; 236 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 1.5 MiB/s wr, 506 op/s 2024-04-25T02:10:42.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:42 smithi077 ceph-mon[26330]: Updating smithi077:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:10:42.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:42 smithi077 ceph-mon[26330]: Updating smithi112:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:10:42.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:42 smithi077 ceph-mon[26330]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:10:42.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:42 smithi077 ceph-mon[26330]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:10:42.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:42 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:42.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:42 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:42.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:42 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:10:42.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:42 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:10:42.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:42 smithi112 ceph-mon[33313]: Updating smithi077:/etc/ceph/ceph.conf 2024-04-25T02:10:42.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:42 smithi112 ceph-mon[33313]: Updating smithi112:/etc/ceph/ceph.conf 2024-04-25T02:10:42.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:42 smithi112 ceph-mon[33313]: pgmap v9: 65 pgs: 65 active+clean; 236 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 1.5 MiB/s wr, 506 op/s 2024-04-25T02:10:42.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:42 smithi112 ceph-mon[33313]: Updating smithi077:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:10:42.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:42 smithi112 ceph-mon[33313]: Updating smithi112:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:10:42.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:42 smithi112 ceph-mon[33313]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:10:42.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:42 smithi112 ceph-mon[33313]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:10:43.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:43 smithi077 ceph-mon[26330]: Updating smithi077:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:10:43.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:43 smithi077 ceph-mon[26330]: Updating smithi112:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:10:43.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:43 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:43.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:43 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:43.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:43 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:43.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:43 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:43.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:43 smithi077 ceph-mon[26330]: pgmap v10: 65 pgs: 65 active+clean; 236 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.5 MiB/s wr, 500 op/s 2024-04-25T02:10:43.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:43 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:43.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:43 smithi077 ceph-mon[26330]: Reconfiguring prometheus.smithi077 (dependencies changed)... 2024-04-25T02:10:43.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:43 smithi077 ceph-mon[26330]: Reconfiguring daemon prometheus.smithi077 on smithi077 2024-04-25T02:10:44.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:43 smithi112 ceph-mon[33313]: Updating smithi077:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:10:44.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:43 smithi112 ceph-mon[33313]: Updating smithi112:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:10:44.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:43 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:44.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:43 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:44.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:43 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:44.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:43 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:44.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:43 smithi112 ceph-mon[33313]: pgmap v10: 65 pgs: 65 active+clean; 236 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.5 MiB/s wr, 500 op/s 2024-04-25T02:10:44.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:43 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:44.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:43 smithi112 ceph-mon[33313]: Reconfiguring prometheus.smithi077 (dependencies changed)... 2024-04-25T02:10:44.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:43 smithi112 ceph-mon[33313]: Reconfiguring daemon prometheus.smithi077 on smithi077 2024-04-25T02:10:44.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:44 smithi077 ceph-mon[26330]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-25T02:10:45.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:44 smithi112 ceph-mon[33313]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-25T02:10:45.855 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:45 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:45.856 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:45 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:10:45.856 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:45 smithi077 ceph-mon[26330]: pgmap v11: 65 pgs: 65 active+clean; 236 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.5 MiB/s wr, 500 op/s 2024-04-25T02:10:46.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:45 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:46.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:45 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:10:46.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:45 smithi112 ceph-mon[33313]: pgmap v11: 65 pgs: 65 active+clean; 236 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.5 MiB/s wr, 500 op/s 2024-04-25T02:10:47.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:47 smithi077 ceph-mon[26330]: pgmap v12: 65 pgs: 65 active+clean; 225 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 61 KiB/s rd, 2.2 MiB/s wr, 900 op/s 2024-04-25T02:10:48.099 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:47 smithi112 ceph-mon[33313]: pgmap v12: 65 pgs: 65 active+clean; 225 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 61 KiB/s rd, 2.2 MiB/s wr, 900 op/s 2024-04-25T02:10:50.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:49 smithi077 ceph-mon[26330]: pgmap v13: 65 pgs: 65 active+clean; 225 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.5 MiB/s wr, 718 op/s 2024-04-25T02:10:50.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:49 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:50.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:49 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:50.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:49 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T02:10:50.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:49 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi077:9095"}]: dispatch 2024-04-25T02:10:50.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:49 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:50.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:49 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:10:50.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:49 smithi112 ceph-mon[33313]: pgmap v13: 65 pgs: 65 active+clean; 225 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.5 MiB/s wr, 718 op/s 2024-04-25T02:10:50.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:49 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:50.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:49 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:50.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:49 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T02:10:50.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:49 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi077:9095"}]: dispatch 2024-04-25T02:10:50.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:49 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:50.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:49 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:10:50.449 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-04-25T02:10:50.450 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-04-25T02:10:50.758 DEBUG:teuthology.parallel:result is None 2024-04-25T02:10:50.759 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T02:10:50.791 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T02:10:50.792 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-04-25T02:10:50.822 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-04-25T02:10:50.822 DEBUG:teuthology.parallel:result is None 2024-04-25T02:10:50.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:50 smithi077 ceph-mon[26330]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T02:10:50.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:50 smithi077 ceph-mon[26330]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi077:9095"}]: dispatch 2024-04-25T02:10:51.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:50 smithi112 ceph-mon[33313]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T02:10:51.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:50 smithi112 ceph-mon[33313]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi077:9095"}]: dispatch 2024-04-25T02:10:52.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:51 smithi112 ceph-mon[33313]: pgmap v14: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 2.2 MiB/s wr, 902 op/s 2024-04-25T02:10:52.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:51 smithi077 ceph-mon[26330]: pgmap v14: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 2.2 MiB/s wr, 902 op/s 2024-04-25T02:10:54.016 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:53 smithi112 ceph-mon[33313]: pgmap v15: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 584 op/s 2024-04-25T02:10:54.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:53 smithi077 ceph-mon[26330]: pgmap v15: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 584 op/s 2024-04-25T02:10:56.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:55 smithi112 ceph-mon[33313]: pgmap v16: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.3 MiB/s wr, 541 op/s 2024-04-25T02:10:56.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:55 smithi112 ceph-mon[33313]: Upgrade: Updating mgr.smithi112.cswrxs 2024-04-25T02:10:56.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:55 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.cswrxs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T02:10:56.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:55 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T02:10:56.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:55 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:10:56.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:55 smithi112 ceph-mon[33313]: Deploying daemon mgr.smithi112.cswrxs on smithi112 2024-04-25T02:10:56.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:55 smithi077 ceph-mon[26330]: pgmap v16: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.3 MiB/s wr, 541 op/s 2024-04-25T02:10:56.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:55 smithi077 ceph-mon[26330]: Upgrade: Updating mgr.smithi112.cswrxs 2024-04-25T02:10:56.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:55 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.cswrxs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T02:10:56.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:55 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T02:10:56.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:55 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:10:56.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:55 smithi077 ceph-mon[26330]: Deploying daemon mgr.smithi112.cswrxs on smithi112 2024-04-25T02:10:57.981 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:57 smithi112 ceph-mon[33313]: pgmap v17: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 556 op/s 2024-04-25T02:10:58.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:57 smithi077 ceph-mon[26330]: pgmap v17: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 556 op/s 2024-04-25T02:10:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.116+0000 7fbf687a0700 1 -- 172.21.15.77:0/2712310477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf600fcf90 msgr2=0x7fbf600fd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:59.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.116+0000 7fbf687a0700 1 --2- 172.21.15.77:0/2712310477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf600fcf90 0x7fbf600fd400 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbf50004940 tx=0x7fbf50009e30 comp rx=0 tx=0).stop 2024-04-25T02:10:59.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.117+0000 7fbf687a0700 1 -- 172.21.15.77:0/2712310477 shutdown_connections 2024-04-25T02:10:59.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.117+0000 7fbf687a0700 1 --2- 172.21.15.77:0/2712310477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf600fcf90 0x7fbf600fd400 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.117+0000 7fbf687a0700 1 --2- 172.21.15.77:0/2712310477 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf600fbce0 0x7fbf600fc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.117+0000 7fbf687a0700 1 -- 172.21.15.77:0/2712310477 >> 172.21.15.77:0/2712310477 conn(0x7fbf600f7420 msgr2=0x7fbf600f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:59.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.117+0000 7fbf687a0700 1 -- 172.21.15.77:0/2712310477 shutdown_connections 2024-04-25T02:10:59.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.117+0000 7fbf687a0700 1 -- 172.21.15.77:0/2712310477 wait complete. 2024-04-25T02:10:59.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.118+0000 7fbf687a0700 1 Processor -- start 2024-04-25T02:10:59.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.118+0000 7fbf687a0700 1 -- start start 2024-04-25T02:10:59.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.118+0000 7fbf687a0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf600fbce0 0x7fbf6010b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:59.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.118+0000 7fbf687a0700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf600fcf90 0x7fbf6010bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:59.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.118+0000 7fbf687a0700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6010c1f0 con 0x7fbf600fcf90 2024-04-25T02:10:59.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.118+0000 7fbf687a0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6010c360 con 0x7fbf600fbce0 2024-04-25T02:10:59.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.118+0000 7fbf65d3b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf600fcf90 0x7fbf6010bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:59.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.118+0000 7fbf65d3b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf600fcf90 0x7fbf6010bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50524/0 (socket says 172.21.15.77:50524) 2024-04-25T02:10:59.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.118+0000 7fbf65d3b700 1 -- 172.21.15.77:0/1512481313 learned_addr learned my addr 172.21.15.77:0/1512481313 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:10:59.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.118+0000 7fbf6653c700 1 --2- 172.21.15.77:0/1512481313 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf600fbce0 0x7fbf6010b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:59.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.118+0000 7fbf65d3b700 1 -- 172.21.15.77:0/1512481313 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf600fbce0 msgr2=0x7fbf6010b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:59.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.118+0000 7fbf65d3b700 1 --2- 172.21.15.77:0/1512481313 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf600fbce0 0x7fbf6010b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.118+0000 7fbf65d3b700 1 -- 172.21.15.77:0/1512481313 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf50005040 con 0x7fbf600fcf90 2024-04-25T02:10:59.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.118+0000 7fbf65d3b700 1 --2- 172.21.15.77:0/1512481313 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf600fcf90 0x7fbf6010bbf0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbf50013870 tx=0x7fbf50009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:59.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.119+0000 7fbf56ffd700 1 -- 172.21.15.77:0/1512481313 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf50021070 con 0x7fbf600fcf90 2024-04-25T02:10:59.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.119+0000 7fbf56ffd700 1 -- 172.21.15.77:0/1512481313 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbf50009430 con 0x7fbf600fcf90 2024-04-25T02:10:59.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.119+0000 7fbf56ffd700 1 -- 172.21.15.77:0/1512481313 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf5000e070 con 0x7fbf600fcf90 2024-04-25T02:10:59.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.119+0000 7fbf687a0700 1 -- 172.21.15.77:0/1512481313 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf60110d60 con 0x7fbf600fcf90 2024-04-25T02:10:59.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.119+0000 7fbf687a0700 1 -- 172.21.15.77:0/1512481313 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf601112a0 con 0x7fbf600fcf90 2024-04-25T02:10:59.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.120+0000 7fbf687a0700 1 -- 172.21.15.77:0/1512481313 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf6004c710 con 0x7fbf600fcf90 2024-04-25T02:10:59.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.120+0000 7fbf56ffd700 1 -- 172.21.15.77:0/1512481313 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 32) v1 ==== 92027+0+0 (secure 0 0 0) 0x7fbf5001c750 con 0x7fbf600fcf90 2024-04-25T02:10:59.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.121+0000 7fbf56ffd700 1 --2- 172.21.15.77:0/1512481313 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fbf4c06db70 0x7fbf4c070020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:59.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.121+0000 7fbf56ffd700 1 -- 172.21.15.77:0/1512481313 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fbf5008e4f0 con 0x7fbf600fcf90 2024-04-25T02:10:59.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.121+0000 7fbf6653c700 1 --2- 172.21.15.77:0/1512481313 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fbf4c06db70 0x7fbf4c070020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:59.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.121+0000 7fbf6653c700 1 --2- 172.21.15.77:0/1512481313 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fbf4c06db70 0x7fbf4c070020 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c009fd0 tx=0x7fbf5c00b040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:59.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.126+0000 7fbf56ffd700 1 -- 172.21.15.77:0/1512481313 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7fbf5005baf0 con 0x7fbf600fcf90 2024-04-25T02:10:59.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.359+0000 7fbf687a0700 1 -- 172.21.15.77:0/1512481313 --> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf60101300 con 0x7fbf4c06db70 2024-04-25T02:10:59.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.360+0000 7fbf56ffd700 1 -- 172.21.15.77:0/1512481313 <== mgr.14668 v2:172.21.15.77:6800/799251145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7fbf60101300 con 0x7fbf4c06db70 2024-04-25T02:10:59.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.362+0000 7fbf687a0700 1 -- 172.21.15.77:0/1512481313 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fbf4c06db70 msgr2=0x7fbf4c070020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:59.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.362+0000 7fbf687a0700 1 --2- 172.21.15.77:0/1512481313 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fbf4c06db70 0x7fbf4c070020 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c009fd0 tx=0x7fbf5c00b040 comp rx=0 tx=0).stop 2024-04-25T02:10:59.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.362+0000 7fbf687a0700 1 -- 172.21.15.77:0/1512481313 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf600fcf90 msgr2=0x7fbf6010bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:59.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.362+0000 7fbf687a0700 1 --2- 172.21.15.77:0/1512481313 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf600fcf90 0x7fbf6010bbf0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbf50013870 tx=0x7fbf50009e30 comp rx=0 tx=0).stop 2024-04-25T02:10:59.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.362+0000 7fbf687a0700 1 -- 172.21.15.77:0/1512481313 shutdown_connections 2024-04-25T02:10:59.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.362+0000 7fbf687a0700 1 --2- 172.21.15.77:0/1512481313 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fbf4c06db70 0x7fbf4c070020 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.362+0000 7fbf687a0700 1 --2- 172.21.15.77:0/1512481313 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf600fbce0 0x7fbf6010b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.362+0000 7fbf687a0700 1 --2- 172.21.15.77:0/1512481313 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf600fcf90 0x7fbf6010bbf0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.362+0000 7fbf687a0700 1 -- 172.21.15.77:0/1512481313 >> 172.21.15.77:0/1512481313 conn(0x7fbf600f7420 msgr2=0x7fbf600f8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:59.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.362+0000 7fbf687a0700 1 -- 172.21.15.77:0/1512481313 shutdown_connections 2024-04-25T02:10:59.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.362+0000 7fbf687a0700 1 -- 172.21.15.77:0/1512481313 wait complete. 2024-04-25T02:10:59.381 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-04-25T02:10:59.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.469+0000 7fdb3ebea700 1 -- 172.21.15.77:0/3539913150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb380fce90 msgr2=0x7fdb380fd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:59.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.469+0000 7fdb3ebea700 1 --2- 172.21.15.77:0/3539913150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb380fce90 0x7fdb380fd2a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c004940 tx=0x7fdb2c009e30 comp rx=0 tx=0).stop 2024-04-25T02:10:59.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.469+0000 7fdb3ebea700 1 -- 172.21.15.77:0/3539913150 shutdown_connections 2024-04-25T02:10:59.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.469+0000 7fdb3ebea700 1 --2- 172.21.15.77:0/3539913150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb380fe090 0x7fdb380fe500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.469+0000 7fdb3ebea700 1 --2- 172.21.15.77:0/3539913150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb380fce90 0x7fdb380fd2a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.469+0000 7fdb3ebea700 1 -- 172.21.15.77:0/3539913150 >> 172.21.15.77:0/3539913150 conn(0x7fdb380f85c0 msgr2=0x7fdb380fa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:59.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.469+0000 7fdb3ebea700 1 -- 172.21.15.77:0/3539913150 shutdown_connections 2024-04-25T02:10:59.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.469+0000 7fdb3ebea700 1 -- 172.21.15.77:0/3539913150 wait complete. 2024-04-25T02:10:59.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.469+0000 7fdb3ebea700 1 Processor -- start 2024-04-25T02:10:59.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.469+0000 7fdb3ebea700 1 -- start start 2024-04-25T02:10:59.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.470+0000 7fdb3ebea700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb380fce90 0x7fdb3810da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:59.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.470+0000 7fdb3ebea700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb380fe090 0x7fdb3810dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:59.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.470+0000 7fdb3ebea700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3810e5b0 con 0x7fdb380fe090 2024-04-25T02:10:59.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.470+0000 7fdb3ebea700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3810ee00 con 0x7fdb380fce90 2024-04-25T02:10:59.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.470+0000 7fdb37fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb380fe090 0x7fdb3810dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:59.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.470+0000 7fdb37fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb380fe090 0x7fdb3810dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50552/0 (socket says 172.21.15.77:50552) 2024-04-25T02:10:59.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.470+0000 7fdb37fff700 1 -- 172.21.15.77:0/1963025877 learned_addr learned my addr 172.21.15.77:0/1963025877 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:10:59.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.470+0000 7fdb3c986700 1 --2- 172.21.15.77:0/1963025877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb380fce90 0x7fdb3810da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:59.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.470+0000 7fdb37fff700 1 -- 172.21.15.77:0/1963025877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb380fce90 msgr2=0x7fdb3810da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:59.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.470+0000 7fdb37fff700 1 --2- 172.21.15.77:0/1963025877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb380fce90 0x7fdb3810da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.470+0000 7fdb37fff700 1 -- 172.21.15.77:0/1963025877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb2c005040 con 0x7fdb380fe090 2024-04-25T02:10:59.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.470+0000 7fdb37fff700 1 --2- 172.21.15.77:0/1963025877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb380fe090 0x7fdb3810dfb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdb24002a50 tx=0x7fdb240046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:59.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.470+0000 7fdb357fa700 1 -- 172.21.15.77:0/1963025877 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb24007cc0 con 0x7fdb380fe090 2024-04-25T02:10:59.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.470+0000 7fdb357fa700 1 -- 172.21.15.77:0/1963025877 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdb2400f040 con 0x7fdb380fe090 2024-04-25T02:10:59.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.470+0000 7fdb3ebea700 1 -- 172.21.15.77:0/1963025877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb3810f0e0 con 0x7fdb380fe090 2024-04-25T02:10:59.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.470+0000 7fdb357fa700 1 -- 172.21.15.77:0/1963025877 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb2400da30 con 0x7fdb380fe090 2024-04-25T02:10:59.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.471+0000 7fdb3ebea700 1 -- 172.21.15.77:0/1963025877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb3810f620 con 0x7fdb380fe090 2024-04-25T02:10:59.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.471+0000 7fdb3ebea700 1 -- 172.21.15.77:0/1963025877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb3805f5c0 con 0x7fdb380fe090 2024-04-25T02:10:59.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.472+0000 7fdb357fa700 1 -- 172.21.15.77:0/1963025877 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 32) v1 ==== 92027+0+0 (secure 0 0 0) 0x7fdb2400db90 con 0x7fdb380fe090 2024-04-25T02:10:59.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.472+0000 7fdb357fa700 1 --2- 172.21.15.77:0/1963025877 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fdb2806db60 0x7fdb28070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:59.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.472+0000 7fdb357fa700 1 -- 172.21.15.77:0/1963025877 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fdb2408d1e0 con 0x7fdb380fe090 2024-04-25T02:10:59.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.472+0000 7fdb3c986700 1 --2- 172.21.15.77:0/1963025877 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fdb2806db60 0x7fdb28070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:59.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.473+0000 7fdb3c986700 1 --2- 172.21.15.77:0/1963025877 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fdb2806db60 0x7fdb28070010 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c00b970 tx=0x7fdb2c009e30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:59.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.477+0000 7fdb357fa700 1 -- 172.21.15.77:0/1963025877 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7fdb2405a6c0 con 0x7fdb380fe090 2024-04-25T02:10:59.647 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:59 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:59.648 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:59 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:59.648 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:59 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:10:59.648 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:10:59 smithi077 ceph-mon[26330]: pgmap v18: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 672 KiB/s wr, 185 op/s 2024-04-25T02:10:59.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.736+0000 7fdb3ebea700 1 -- 172.21.15.77:0/1963025877 --> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb3810f950 con 0x7fdb2806db60 2024-04-25T02:10:59.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.737+0000 7fdb357fa700 1 -- 172.21.15.77:0/1963025877 <== mgr.14668 v2:172.21.15.77:6800/799251145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7fdb3810f950 con 0x7fdb2806db60 2024-04-25T02:10:59.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.739+0000 7fdb3ebea700 1 -- 172.21.15.77:0/1963025877 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fdb2806db60 msgr2=0x7fdb28070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:59.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.739+0000 7fdb3ebea700 1 --2- 172.21.15.77:0/1963025877 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fdb2806db60 0x7fdb28070010 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c00b970 tx=0x7fdb2c009e30 comp rx=0 tx=0).stop 2024-04-25T02:10:59.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.739+0000 7fdb3ebea700 1 -- 172.21.15.77:0/1963025877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb380fe090 msgr2=0x7fdb3810dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:59.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.739+0000 7fdb3ebea700 1 --2- 172.21.15.77:0/1963025877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb380fe090 0x7fdb3810dfb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdb24002a50 tx=0x7fdb240046b0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.739+0000 7fdb3ebea700 1 -- 172.21.15.77:0/1963025877 shutdown_connections 2024-04-25T02:10:59.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.739+0000 7fdb3ebea700 1 --2- 172.21.15.77:0/1963025877 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fdb2806db60 0x7fdb28070010 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.739+0000 7fdb3ebea700 1 --2- 172.21.15.77:0/1963025877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb380fce90 0x7fdb3810da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.739+0000 7fdb3ebea700 1 --2- 172.21.15.77:0/1963025877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb380fe090 0x7fdb3810dfb0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.739+0000 7fdb3ebea700 1 -- 172.21.15.77:0/1963025877 >> 172.21.15.77:0/1963025877 conn(0x7fdb380f85c0 msgr2=0x7fdb380f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:59.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.739+0000 7fdb3ebea700 1 -- 172.21.15.77:0/1963025877 shutdown_connections 2024-04-25T02:10:59.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.739+0000 7fdb3ebea700 1 -- 172.21.15.77:0/1963025877 wait complete. 2024-04-25T02:10:59.840 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:59 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:59.840 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:59 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:10:59.840 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:59 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:10:59.840 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:10:59 smithi112 ceph-mon[33313]: pgmap v18: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 672 KiB/s wr, 185 op/s 2024-04-25T02:10:59.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.853+0000 7fd140757700 1 -- 172.21.15.77:0/2199630262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1380fff70 msgr2=0x7fd138102350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:59.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.853+0000 7fd140757700 1 --2- 172.21.15.77:0/2199630262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1380fff70 0x7fd138102350 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd128004940 tx=0x7fd128009e30 comp rx=0 tx=0).stop 2024-04-25T02:10:59.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.853+0000 7fd140757700 1 -- 172.21.15.77:0/2199630262 shutdown_connections 2024-04-25T02:10:59.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.853+0000 7fd140757700 1 --2- 172.21.15.77:0/2199630262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1380fff70 0x7fd138102350 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.853+0000 7fd140757700 1 --2- 172.21.15.77:0/2199630262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd138066e70 0x7fd1380ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.853+0000 7fd140757700 1 -- 172.21.15.77:0/2199630262 >> 172.21.15.77:0/2199630262 conn(0x7fd1380f7420 msgr2=0x7fd1380f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:59.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.853+0000 7fd140757700 1 -- 172.21.15.77:0/2199630262 shutdown_connections 2024-04-25T02:10:59.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.853+0000 7fd140757700 1 -- 172.21.15.77:0/2199630262 wait complete. 2024-04-25T02:10:59.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.854+0000 7fd140757700 1 Processor -- start 2024-04-25T02:10:59.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.854+0000 7fd140757700 1 -- start start 2024-04-25T02:10:59.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.854+0000 7fd140757700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd138066e70 0x7fd13810d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:59.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.854+0000 7fd140757700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1380fff70 0x7fd13810deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:59.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.854+0000 7fd140757700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13810e4b0 con 0x7fd1380fff70 2024-04-25T02:10:59.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.854+0000 7fd140757700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13810e620 con 0x7fd138066e70 2024-04-25T02:10:59.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.854+0000 7fd13dcf2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1380fff70 0x7fd13810deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:59.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.854+0000 7fd13dcf2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1380fff70 0x7fd13810deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50568/0 (socket says 172.21.15.77:50568) 2024-04-25T02:10:59.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.854+0000 7fd13dcf2700 1 -- 172.21.15.77:0/2780612130 learned_addr learned my addr 172.21.15.77:0/2780612130 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:10:59.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.854+0000 7fd13e4f3700 1 --2- 172.21.15.77:0/2780612130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd138066e70 0x7fd13810d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:59.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.854+0000 7fd13dcf2700 1 -- 172.21.15.77:0/2780612130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd138066e70 msgr2=0x7fd13810d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:59.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.854+0000 7fd13dcf2700 1 --2- 172.21.15.77:0/2780612130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd138066e70 0x7fd13810d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.854+0000 7fd13dcf2700 1 -- 172.21.15.77:0/2780612130 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd128005040 con 0x7fd1380fff70 2024-04-25T02:10:59.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.855+0000 7fd13dcf2700 1 --2- 172.21.15.77:0/2780612130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1380fff70 0x7fd13810deb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd12800b3b0 tx=0x7fd128009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:59.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.855+0000 7fd12effd700 1 -- 172.21.15.77:0/2780612130 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd12800e040 con 0x7fd1380fff70 2024-04-25T02:10:59.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.855+0000 7fd12effd700 1 -- 172.21.15.77:0/2780612130 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd12800bbf0 con 0x7fd1380fff70 2024-04-25T02:10:59.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.855+0000 7fd140757700 1 -- 172.21.15.77:0/2780612130 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd138112fd0 con 0x7fd1380fff70 2024-04-25T02:10:59.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.855+0000 7fd12effd700 1 -- 172.21.15.77:0/2780612130 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd12801c630 con 0x7fd1380fff70 2024-04-25T02:10:59.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.855+0000 7fd140757700 1 -- 172.21.15.77:0/2780612130 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd138113560 con 0x7fd1380fff70 2024-04-25T02:10:59.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.856+0000 7fd140757700 1 -- 172.21.15.77:0/2780612130 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd13804c710 con 0x7fd1380fff70 2024-04-25T02:10:59.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.856+0000 7fd12effd700 1 -- 172.21.15.77:0/2780612130 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 32) v1 ==== 92027+0+0 (secure 0 0 0) 0x7fd12800bd60 con 0x7fd1380fff70 2024-04-25T02:10:59.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.857+0000 7fd12effd700 1 --2- 172.21.15.77:0/2780612130 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fd12406db70 0x7fd124070020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:59.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.857+0000 7fd12effd700 1 -- 172.21.15.77:0/2780612130 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fd12808df00 con 0x7fd1380fff70 2024-04-25T02:10:59.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.857+0000 7fd13e4f3700 1 --2- 172.21.15.77:0/2780612130 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fd12406db70 0x7fd124070020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:59.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.857+0000 7fd13e4f3700 1 --2- 172.21.15.77:0/2780612130 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fd12406db70 0x7fd124070020 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd138066bb0 tx=0x7fd13400b040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:59.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:10:59.863+0000 7fd12effd700 1 -- 172.21.15.77:0/2780612130 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7fd12805b500 con 0x7fd1380fff70 2024-04-25T02:11:00.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.072+0000 7fd140757700 1 -- 172.21.15.77:0/2780612130 --> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1380f8f80 con 0x7fd12406db70 2024-04-25T02:11:00.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.082+0000 7fd12effd700 1 -- 172.21.15.77:0/2780612130 <== mgr.14668 v2:172.21.15.77:6800/799251145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fd1380f8f80 con 0x7fd12406db70 2024-04-25T02:11:00.090 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T02:11:00.090 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (77s) 25s ago 10m 16.3M - 0.25.0 c8568f914cd2 0d354e136134 2024-04-25T02:11:00.091 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (10m) 25s ago 10m 6665k - 17.2.7-902-gc61472c8 0de407c1b3af 2ad2e3d2b09e 2024-04-25T02:11:00.091 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi112 smithi112 running (9m) 26s ago 9m 6660k - 17.2.7-902-gc61472c8 0de407c1b3af 9235dc5eb15d 2024-04-25T02:11:00.091 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 unknown 25s ago 9m - - 2024-04-25T02:11:00.091 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.gcfygj smithi077 running (4m) 25s ago 4m 13.9M - 17.2.7-902-gc61472c8 0de407c1b3af 382dd7abf674 2024-04-25T02:11:00.091 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.oadrkb smithi077 running (4m) 25s ago 4m 12.2M - 17.2.7-902-gc61472c8 0de407c1b3af 6992064a4b2a 2024-04-25T02:11:00.091 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.dvwudt smithi112 running (4m) 26s ago 4m 204M - 17.2.7-902-gc61472c8 0de407c1b3af 0792e451abfd 2024-04-25T02:11:00.091 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.fjnadi smithi112 running (4m) 26s ago 4m 13.5M - 17.2.7-902-gc61472c8 0de407c1b3af c8093f622f6b 2024-04-25T02:11:00.091 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.zpflzp smithi077 *:8443,9283,8765 running (45s) 25s ago 11m 476M - 19.0.0-2445-gd2c45d97 f68e37b807ef a1af92e027e5 2024-04-25T02:11:00.091 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi112.cswrxs smithi112 *:8443,9283,8765 starting - - - - 2024-04-25T02:11:00.091 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (11m) 25s ago 11m 52.1M 2048M 17.2.7-902-gc61472c8 0de407c1b3af adb57965a306 2024-04-25T02:11:00.091 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi112 smithi112 running (9m) 26s ago 9m 37.4M 2048M 17.2.7-902-gc61472c8 0de407c1b3af db2fb9b09789 2024-04-25T02:11:00.091 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (82s) 25s ago 10m 8316k - 1.5.0 0da6a335fe13 ded4bbea5bf6 2024-04-25T02:11:00.091 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi112 smithi112 *:9100 running (52s) 26s ago 9m 8522k - 1.5.0 0da6a335fe13 a1266cab6f22 2024-04-25T02:11:00.091 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (8m) 25s ago 8m 241M 1557M 17.2.7-902-gc61472c8 0de407c1b3af c741abec3b94 2024-04-25T02:11:00.091 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (7m) 25s ago 7m 244M 1557M 17.2.7-902-gc61472c8 0de407c1b3af 256ff3ced322 2024-04-25T02:11:00.092 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (7m) 25s ago 7m 210M 1557M 17.2.7-902-gc61472c8 0de407c1b3af c5d7d8c993f4 2024-04-25T02:11:00.092 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi112 running (7m) 26s ago 7m 280M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 68429d0dbf88 2024-04-25T02:11:00.092 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi112 running (6m) 26s ago 6m 249M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 66eb71201444 2024-04-25T02:11:00.092 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi112 running (6m) 26s ago 6m 222M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 963e700d6aea 2024-04-25T02:11:00.092 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 starting - - - - 2024-04-25T02:11:00.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.084+0000 7fd140757700 1 -- 172.21.15.77:0/2780612130 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fd12406db70 msgr2=0x7fd124070020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:00.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.084+0000 7fd140757700 1 --2- 172.21.15.77:0/2780612130 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fd12406db70 0x7fd124070020 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd138066bb0 tx=0x7fd13400b040 comp rx=0 tx=0).stop 2024-04-25T02:11:00.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.084+0000 7fd140757700 1 -- 172.21.15.77:0/2780612130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1380fff70 msgr2=0x7fd13810deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:00.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.084+0000 7fd140757700 1 --2- 172.21.15.77:0/2780612130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1380fff70 0x7fd13810deb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd12800b3b0 tx=0x7fd128009e30 comp rx=0 tx=0).stop 2024-04-25T02:11:00.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.084+0000 7fd140757700 1 -- 172.21.15.77:0/2780612130 shutdown_connections 2024-04-25T02:11:00.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.084+0000 7fd140757700 1 --2- 172.21.15.77:0/2780612130 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fd12406db70 0x7fd124070020 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:00.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.084+0000 7fd140757700 1 --2- 172.21.15.77:0/2780612130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd138066e70 0x7fd13810d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:00.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.084+0000 7fd140757700 1 --2- 172.21.15.77:0/2780612130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1380fff70 0x7fd13810deb0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:00.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.084+0000 7fd140757700 1 -- 172.21.15.77:0/2780612130 >> 172.21.15.77:0/2780612130 conn(0x7fd1380f7420 msgr2=0x7fd1380f7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:00.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.084+0000 7fd140757700 1 -- 172.21.15.77:0/2780612130 shutdown_connections 2024-04-25T02:11:00.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.084+0000 7fd140757700 1 -- 172.21.15.77:0/2780612130 wait complete. 2024-04-25T02:11:00.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.185+0000 7f4cdf8cd700 1 -- 172.21.15.77:0/110960248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cd80fbcb0 msgr2=0x7f4cd80fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:00.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.185+0000 7f4cdf8cd700 1 --2- 172.21.15.77:0/110960248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cd80fbcb0 0x7f4cd80fc0c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4004940 tx=0x7f4cd4009e30 comp rx=0 tx=0).stop 2024-04-25T02:11:00.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.185+0000 7f4cdf8cd700 1 -- 172.21.15.77:0/110960248 shutdown_connections 2024-04-25T02:11:00.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.185+0000 7f4cdf8cd700 1 --2- 172.21.15.77:0/110960248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4cd80fcf60 0x7f4cd80fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:00.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.185+0000 7f4cdf8cd700 1 --2- 172.21.15.77:0/110960248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cd80fbcb0 0x7f4cd80fc0c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:00.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.185+0000 7f4cdf8cd700 1 -- 172.21.15.77:0/110960248 >> 172.21.15.77:0/110960248 conn(0x7f4cd80f7430 msgr2=0x7f4cd80f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:00.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.185+0000 7f4cdf8cd700 1 -- 172.21.15.77:0/110960248 shutdown_connections 2024-04-25T02:11:00.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.185+0000 7f4cdf8cd700 1 -- 172.21.15.77:0/110960248 wait complete. 2024-04-25T02:11:00.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.185+0000 7f4cdf8cd700 1 Processor -- start 2024-04-25T02:11:00.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.185+0000 7f4cdf8cd700 1 -- start start 2024-04-25T02:11:00.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.186+0000 7f4cdf8cd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4cd80fbcb0 0x7f4cd810c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:00.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.186+0000 7f4cdf8cd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cd80fcf60 0x7f4cd810ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:00.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.186+0000 7f4cdf8cd700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd810d440 con 0x7f4cd80fcf60 2024-04-25T02:11:00.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.186+0000 7f4cdf8cd700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd810dc90 con 0x7f4cd80fbcb0 2024-04-25T02:11:00.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.186+0000 7f4cdce68700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cd80fcf60 0x7f4cd810ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:00.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.186+0000 7f4cdce68700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cd80fcf60 0x7f4cd810ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50592/0 (socket says 172.21.15.77:50592) 2024-04-25T02:11:00.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.186+0000 7f4cdce68700 1 -- 172.21.15.77:0/826410927 learned_addr learned my addr 172.21.15.77:0/826410927 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:11:00.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.186+0000 7f4cdd669700 1 --2- 172.21.15.77:0/826410927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4cd80fbcb0 0x7f4cd810c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:00.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.186+0000 7f4cdce68700 1 -- 172.21.15.77:0/826410927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4cd80fbcb0 msgr2=0x7f4cd810c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:00.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.186+0000 7f4cdce68700 1 --2- 172.21.15.77:0/826410927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4cd80fbcb0 0x7f4cd810c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:00.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.186+0000 7f4cdce68700 1 -- 172.21.15.77:0/826410927 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd4005040 con 0x7f4cd80fcf60 2024-04-25T02:11:00.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.186+0000 7f4cdce68700 1 --2- 172.21.15.77:0/826410927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cd80fcf60 0x7f4cd810ce40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4cc800ed20 tx=0x7f4cc8004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:00.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.186+0000 7f4ccdffb700 1 -- 172.21.15.77:0/826410927 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cc800cd10 con 0x7f4cd80fcf60 2024-04-25T02:11:00.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.186+0000 7f4ccdffb700 1 -- 172.21.15.77:0/826410927 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4cc800ce70 con 0x7f4cd80fcf60 2024-04-25T02:11:00.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.186+0000 7f4cdf8cd700 1 -- 172.21.15.77:0/826410927 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cd810df10 con 0x7f4cd80fcf60 2024-04-25T02:11:00.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.186+0000 7f4ccdffb700 1 -- 172.21.15.77:0/826410927 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cc8010870 con 0x7f4cd80fcf60 2024-04-25T02:11:00.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.187+0000 7f4cdf8cd700 1 -- 172.21.15.77:0/826410927 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cd810e4d0 con 0x7f4cd80fcf60 2024-04-25T02:11:00.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.188+0000 7f4cdf8cd700 1 -- 172.21.15.77:0/826410927 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cd805f5c0 con 0x7f4cd80fcf60 2024-04-25T02:11:00.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.188+0000 7f4ccdffb700 1 -- 172.21.15.77:0/826410927 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 32) v1 ==== 92027+0+0 (secure 0 0 0) 0x7f4cc8010ae0 con 0x7f4cd80fcf60 2024-04-25T02:11:00.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.188+0000 7f4ccdffb700 1 --2- 172.21.15.77:0/826410927 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f4cc406db60 0x7f4cc4070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:00.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.188+0000 7f4ccdffb700 1 -- 172.21.15.77:0/826410927 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f4cc808fd20 con 0x7f4cd80fcf60 2024-04-25T02:11:00.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.188+0000 7f4cdd669700 1 --2- 172.21.15.77:0/826410927 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f4cc406db60 0x7f4cc4070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:00.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.189+0000 7f4cdd669700 1 --2- 172.21.15.77:0/826410927 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f4cc406db60 0x7f4cc4070010 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400b3b0 tx=0x7f4cd4009e30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:00.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.193+0000 7f4ccdffb700 1 -- 172.21.15.77:0/826410927 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f4cc805d280 con 0x7f4cd80fcf60 2024-04-25T02:11:00.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.483+0000 7f4cdf8cd700 1 -- 172.21.15.77:0/826410927 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4cd804bed0 con 0x7f4cd80fcf60 2024-04-25T02:11:00.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.483+0000 7f4ccdffb700 1 -- 172.21.15.77:0/826410927 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f4cc805ce10 con 0x7f4cd80fcf60 2024-04-25T02:11:00.491 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:11:00.492 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-04-25T02:11:00.492 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2 2024-04-25T02:11:00.492 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:11:00.492 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-04-25T02:11:00.492 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:11:00.492 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:11:00.492 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-04-25T02:11:00.492 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 6 2024-04-25T02:11:00.492 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:11:00.492 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-04-25T02:11:00.492 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T02:11:00.492 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:11:00.492 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-04-25T02:11:00.492 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 12, 2024-04-25T02:11:00.492 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:11:00.493 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-25T02:11:00.493 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:11:00.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.485+0000 7f4cdf8cd700 1 -- 172.21.15.77:0/826410927 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f4cc406db60 msgr2=0x7f4cc4070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:00.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.485+0000 7f4cdf8cd700 1 --2- 172.21.15.77:0/826410927 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f4cc406db60 0x7f4cc4070010 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400b3b0 tx=0x7f4cd4009e30 comp rx=0 tx=0).stop 2024-04-25T02:11:00.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.485+0000 7f4cdf8cd700 1 -- 172.21.15.77:0/826410927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cd80fcf60 msgr2=0x7f4cd810ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:00.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.485+0000 7f4cdf8cd700 1 --2- 172.21.15.77:0/826410927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cd80fcf60 0x7f4cd810ce40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4cc800ed20 tx=0x7f4cc8004570 comp rx=0 tx=0).stop 2024-04-25T02:11:00.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.485+0000 7f4cdf8cd700 1 -- 172.21.15.77:0/826410927 shutdown_connections 2024-04-25T02:11:00.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.485+0000 7f4cdf8cd700 1 --2- 172.21.15.77:0/826410927 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f4cc406db60 0x7f4cc4070010 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:00.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.485+0000 7f4cdf8cd700 1 --2- 172.21.15.77:0/826410927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4cd80fbcb0 0x7f4cd810c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:00.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.485+0000 7f4cdf8cd700 1 --2- 172.21.15.77:0/826410927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cd80fcf60 0x7f4cd810ce40 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:00.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.485+0000 7f4cdf8cd700 1 -- 172.21.15.77:0/826410927 >> 172.21.15.77:0/826410927 conn(0x7f4cd80f7430 msgr2=0x7f4cd80f8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:00.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.485+0000 7f4cdf8cd700 1 -- 172.21.15.77:0/826410927 shutdown_connections 2024-04-25T02:11:00.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.485+0000 7f4cdf8cd700 1 -- 172.21.15.77:0/826410927 wait complete. 2024-04-25T02:11:00.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.589+0000 7f7ce21a1700 1 -- 172.21.15.77:0/3182420779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cdc0fda60 msgr2=0x7f7cdc0fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:00.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.589+0000 7f7ce21a1700 1 --2- 172.21.15.77:0/3182420779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cdc0fda60 0x7f7cdc0fbe70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc004940 tx=0x7f7ccc009e30 comp rx=0 tx=0).stop 2024-04-25T02:11:00.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.589+0000 7f7ce21a1700 1 -- 172.21.15.77:0/3182420779 shutdown_connections 2024-04-25T02:11:00.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.589+0000 7f7ce21a1700 1 --2- 172.21.15.77:0/3182420779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cdc0fda60 0x7f7cdc0fbe70 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:00.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.589+0000 7f7ce21a1700 1 --2- 172.21.15.77:0/3182420779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cdc0fd110 0x7f7cdc0fd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:00.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.589+0000 7f7ce21a1700 1 -- 172.21.15.77:0/3182420779 >> 172.21.15.77:0/3182420779 conn(0x7f7cdc0f69f0 msgr2=0x7f7cdc0f8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:00.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.589+0000 7f7ce21a1700 1 -- 172.21.15.77:0/3182420779 shutdown_connections 2024-04-25T02:11:00.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.589+0000 7f7ce21a1700 1 -- 172.21.15.77:0/3182420779 wait complete. 2024-04-25T02:11:00.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.589+0000 7f7ce21a1700 1 Processor -- start 2024-04-25T02:11:00.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.590+0000 7f7ce21a1700 1 -- start start 2024-04-25T02:11:00.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.590+0000 7f7ce21a1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cdc0fd110 0x7f7cdc10d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:00.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.590+0000 7f7ce21a1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cdc0fda60 0x7f7cdc10dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:00.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.590+0000 7f7ce21a1700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc10e340 con 0x7f7cdc0fd110 2024-04-25T02:11:00.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.590+0000 7f7ce21a1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc10eb90 con 0x7f7cdc0fda60 2024-04-25T02:11:00.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.590+0000 7f7ce119f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cdc0fd110 0x7f7cdc10d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:00.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.590+0000 7f7ce119f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cdc0fd110 0x7f7cdc10d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50600/0 (socket says 172.21.15.77:50600) 2024-04-25T02:11:00.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.590+0000 7f7ce119f700 1 -- 172.21.15.77:0/1594257079 learned_addr learned my addr 172.21.15.77:0/1594257079 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:11:00.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.590+0000 7f7ce099e700 1 --2- 172.21.15.77:0/1594257079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cdc0fda60 0x7f7cdc10dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:00.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.590+0000 7f7ce119f700 1 -- 172.21.15.77:0/1594257079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cdc0fda60 msgr2=0x7f7cdc10dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:00.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.590+0000 7f7ce119f700 1 --2- 172.21.15.77:0/1594257079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cdc0fda60 0x7f7cdc10dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:00.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.590+0000 7f7ce119f700 1 -- 172.21.15.77:0/1594257079 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ccc005040 con 0x7f7cdc0fd110 2024-04-25T02:11:00.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.590+0000 7f7ce119f700 1 --2- 172.21.15.77:0/1594257079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cdc0fd110 0x7f7cdc10d800 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8002a80 tx=0x7f7cd80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:00.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.590+0000 7f7cd1ffb700 1 -- 172.21.15.77:0/1594257079 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cd8007cc0 con 0x7f7cdc0fd110 2024-04-25T02:11:00.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.590+0000 7f7ce21a1700 1 -- 172.21.15.77:0/1594257079 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cdc10ee70 con 0x7f7cdc0fd110 2024-04-25T02:11:00.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.590+0000 7f7cd1ffb700 1 -- 172.21.15.77:0/1594257079 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7cd800f040 con 0x7f7cdc0fd110 2024-04-25T02:11:00.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.590+0000 7f7cd1ffb700 1 -- 172.21.15.77:0/1594257079 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cd800dac0 con 0x7f7cdc0fd110 2024-04-25T02:11:00.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.591+0000 7f7ce21a1700 1 -- 172.21.15.77:0/1594257079 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cdc10f3b0 con 0x7f7cdc0fd110 2024-04-25T02:11:00.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.591+0000 7f7ce21a1700 1 -- 172.21.15.77:0/1594257079 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cdc101a10 con 0x7f7cdc0fd110 2024-04-25T02:11:00.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.592+0000 7f7cd1ffb700 1 -- 172.21.15.77:0/1594257079 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 32) v1 ==== 92027+0+0 (secure 0 0 0) 0x7f7cd800dc20 con 0x7f7cdc0fd110 2024-04-25T02:11:00.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.592+0000 7f7cd1ffb700 1 --2- 172.21.15.77:0/1594257079 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f7cc806db70 0x7f7cc8070020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:00.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.593+0000 7f7ce099e700 1 --2- 172.21.15.77:0/1594257079 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f7cc806db70 0x7f7cc8070020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:00.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.593+0000 7f7cd1ffb700 1 -- 172.21.15.77:0/1594257079 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f7cd808d0a0 con 0x7f7cdc0fd110 2024-04-25T02:11:00.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.593+0000 7f7ce099e700 1 --2- 172.21.15.77:0/1594257079 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f7cc806db70 0x7f7cc8070020 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00b970 tx=0x7f7ccc009e30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:00.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.597+0000 7f7cd1ffb700 1 -- 172.21.15.77:0/1594257079 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f7cd805a580 con 0x7f7cdc0fd110 2024-04-25T02:11:00.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:00 smithi077 ceph-mon[26330]: from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:11:00.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:00 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:11:00.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:00 smithi077 ceph-mon[26330]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:11:00.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:00 smithi077 ceph-mon[26330]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:11:00.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:00 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/826410927' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:00.759 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:00 smithi112 ceph-mon[33313]: from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:11:00.759 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:00 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:11:00.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:00 smithi112 ceph-mon[33313]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:11:00.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:00 smithi112 ceph-mon[33313]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:11:00.760 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:00 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/826410927' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:00.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.823+0000 7f7ce21a1700 1 -- 172.21.15.77:0/1594257079 --> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7cdc10f5d0 con 0x7f7cc806db70 2024-04-25T02:11:00.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.825+0000 7f7cd1ffb700 1 -- 172.21.15.77:0/1594257079 <== mgr.14668 v2:172.21.15.77:6800/799251145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f7cdc10f5d0 con 0x7f7cc806db70 2024-04-25T02:11:00.833 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:11:00.833 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901", 2024-04-25T02:11:00.834 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-04-25T02:11:00.834 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-25T02:11:00.834 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [], 2024-04-25T02:11:00.834 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "", 2024-04-25T02:11:00.834 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading mgr daemons", 2024-04-25T02:11:00.834 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-04-25T02:11:00.834 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:11:00.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.827+0000 7f7ce21a1700 1 -- 172.21.15.77:0/1594257079 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f7cc806db70 msgr2=0x7f7cc8070020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:00.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.827+0000 7f7ce21a1700 1 --2- 172.21.15.77:0/1594257079 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f7cc806db70 0x7f7cc8070020 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00b970 tx=0x7f7ccc009e30 comp rx=0 tx=0).stop 2024-04-25T02:11:00.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.827+0000 7f7ce21a1700 1 -- 172.21.15.77:0/1594257079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cdc0fd110 msgr2=0x7f7cdc10d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:00.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.827+0000 7f7ce21a1700 1 --2- 172.21.15.77:0/1594257079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cdc0fd110 0x7f7cdc10d800 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8002a80 tx=0x7f7cd80046b0 comp rx=0 tx=0).stop 2024-04-25T02:11:00.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.827+0000 7f7ce21a1700 1 -- 172.21.15.77:0/1594257079 shutdown_connections 2024-04-25T02:11:00.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.827+0000 7f7ce21a1700 1 --2- 172.21.15.77:0/1594257079 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f7cc806db70 0x7f7cc8070020 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:00.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.827+0000 7f7ce21a1700 1 --2- 172.21.15.77:0/1594257079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cdc0fd110 0x7f7cdc10d800 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:00.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.827+0000 7f7ce21a1700 1 --2- 172.21.15.77:0/1594257079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7cdc0fda60 0x7f7cdc10dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:00.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.827+0000 7f7ce21a1700 1 -- 172.21.15.77:0/1594257079 >> 172.21.15.77:0/1594257079 conn(0x7f7cdc0f69f0 msgr2=0x7f7cdc0fb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:00.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.827+0000 7f7ce21a1700 1 -- 172.21.15.77:0/1594257079 shutdown_connections 2024-04-25T02:11:00.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:00.827+0000 7f7ce21a1700 1 -- 172.21.15.77:0/1594257079 wait complete. 2024-04-25T02:11:01.870 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:01 smithi077 ceph-mon[26330]: pgmap v19: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 673 KiB/s wr, 186 op/s 2024-04-25T02:11:01.871 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:01 smithi077 ceph-mon[26330]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:11:02.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:01 smithi112 ceph-mon[33313]: pgmap v19: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 673 KiB/s wr, 186 op/s 2024-04-25T02:11:02.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:01 smithi112 ceph-mon[33313]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:11:02.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:02 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:02.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:02 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:03.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:02 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:03.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:02 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:04.052 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:03 smithi112 ceph-mon[33313]: pgmap v20: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-04-25T02:11:04.052 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:03 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:04.052 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:03 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:04.188 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:03 smithi077 ceph-mon[26330]: pgmap v20: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-04-25T02:11:04.188 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:03 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:04.188 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:03 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:05.598 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:05 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:05.599 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:05 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:05.599 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:05 smithi112 ceph-mon[33313]: pgmap v21: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-04-25T02:11:05.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:05 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:05.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:05 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:05.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:05 smithi077 ceph-mon[26330]: pgmap v21: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-04-25T02:11:06.421 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:06 smithi112 ceph-mon[33313]: Standby manager daemon smithi112.cswrxs restarted 2024-04-25T02:11:06.421 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:06 smithi112 ceph-mon[33313]: Standby manager daemon smithi112.cswrxs started 2024-04-25T02:11:06.421 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:06 smithi112 ceph-mon[33313]: from='mgr.? 172.21.15.112:0/2065319522' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.cswrxs/crt"}]: dispatch 2024-04-25T02:11:06.421 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:06 smithi112 ceph-mon[33313]: from='mgr.? 172.21.15.112:0/2065319522' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T02:11:06.421 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:06 smithi112 ceph-mon[33313]: from='mgr.? 172.21.15.112:0/2065319522' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.cswrxs/key"}]: dispatch 2024-04-25T02:11:06.421 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:06 smithi112 ceph-mon[33313]: from='mgr.? 172.21.15.112:0/2065319522' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T02:11:06.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:06 smithi077 ceph-mon[26330]: Standby manager daemon smithi112.cswrxs restarted 2024-04-25T02:11:06.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:06 smithi077 ceph-mon[26330]: Standby manager daemon smithi112.cswrxs started 2024-04-25T02:11:06.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:06 smithi077 ceph-mon[26330]: from='mgr.? 172.21.15.112:0/2065319522' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.cswrxs/crt"}]: dispatch 2024-04-25T02:11:06.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:06 smithi077 ceph-mon[26330]: from='mgr.? 172.21.15.112:0/2065319522' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T02:11:06.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:06 smithi077 ceph-mon[26330]: from='mgr.? 172.21.15.112:0/2065319522' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.cswrxs/key"}]: dispatch 2024-04-25T02:11:06.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:06 smithi077 ceph-mon[26330]: from='mgr.? 172.21.15.112:0/2065319522' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T02:11:07.554 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: mgrmap e33: smithi077.zpflzp(active, since 36s), standbys: smithi112.cswrxs 2024-04-25T02:11:07.554 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:07.554 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:07.554 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:11:07.554 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:11:07.554 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: pgmap v22: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-04-25T02:11:07.554 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: pgmap v23: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 105 B/s rd, 843 B/s wr, 1 op/s 2024-04-25T02:11:07.555 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:07.555 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:11:07.555 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:07.555 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: Upgrade: Setting container_image for all mgr 2024-04-25T02:11:07.555 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:07.555 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi077.zpflzp"}]: dispatch 2024-04-25T02:11:07.555 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi077.zpflzp"}]': finished 2024-04-25T02:11:07.555 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi112.cswrxs"}]: dispatch 2024-04-25T02:11:07.555 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi112.cswrxs"}]': finished 2024-04-25T02:11:07.555 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:07.555 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: Upgrade: Setting container_image for all rgw 2024-04-25T02:11:07.555 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:07.555 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:07.555 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: Upgrade: Setting container_image for all rbd-mirror 2024-04-25T02:11:07.555 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:07.555 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:07.556 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: Upgrade: Setting container_image for all cephfs-mirror 2024-04-25T02:11:07.556 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:07.556 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:07.556 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: Upgrade: Setting container_image for all ceph-exporter 2024-04-25T02:11:07.556 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:07.556 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:07.556 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: Upgrade: Setting container_image for all iscsi 2024-04-25T02:11:07.556 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:07.556 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:07.556 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: Upgrade: Setting container_image for all nfs 2024-04-25T02:11:07.556 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:07.556 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:07.556 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: Upgrade: Setting container_image for all nvmeof 2024-04-25T02:11:07.556 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:07.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: mgrmap e33: smithi077.zpflzp(active, since 36s), standbys: smithi112.cswrxs 2024-04-25T02:11:07.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:07.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:07.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:11:07.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:11:07.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: pgmap v22: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-04-25T02:11:07.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: pgmap v23: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 105 B/s rd, 843 B/s wr, 1 op/s 2024-04-25T02:11:07.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:07.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:11:07.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:07.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: Upgrade: Setting container_image for all mgr 2024-04-25T02:11:07.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:07.782 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi077.zpflzp"}]: dispatch 2024-04-25T02:11:07.782 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi077.zpflzp"}]': finished 2024-04-25T02:11:07.782 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi112.cswrxs"}]: dispatch 2024-04-25T02:11:07.782 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi112.cswrxs"}]': finished 2024-04-25T02:11:07.782 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:07.782 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: Upgrade: Setting container_image for all rgw 2024-04-25T02:11:07.782 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:07.782 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:07.782 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: Upgrade: Setting container_image for all rbd-mirror 2024-04-25T02:11:07.782 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:07.782 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:07.782 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: Upgrade: Setting container_image for all cephfs-mirror 2024-04-25T02:11:07.782 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:07.782 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:07.783 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: Upgrade: Setting container_image for all ceph-exporter 2024-04-25T02:11:07.783 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:07.783 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:07.783 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: Upgrade: Setting container_image for all iscsi 2024-04-25T02:11:07.783 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:07.783 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:07.783 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: Upgrade: Setting container_image for all nfs 2024-04-25T02:11:07.783 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:07.783 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:07.783 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: Upgrade: Setting container_image for all nvmeof 2024-04-25T02:11:07.783 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:09.647 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:09 smithi077 ceph-mon[26330]: Upgrade: Updating node-exporter.smithi077 (1/2) 2024-04-25T02:11:09.647 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:09 smithi077 ceph-mon[26330]: Deploying daemon node-exporter.smithi077 on smithi077 2024-04-25T02:11:09.647 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:09 smithi077 ceph-mon[26330]: pgmap v24: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 105 B/s rd, 843 B/s wr, 1 op/s 2024-04-25T02:11:10.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:09 smithi112 ceph-mon[33313]: Upgrade: Updating node-exporter.smithi077 (1/2) 2024-04-25T02:11:10.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:09 smithi112 ceph-mon[33313]: Deploying daemon node-exporter.smithi077 on smithi077 2024-04-25T02:11:10.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:09 smithi112 ceph-mon[33313]: pgmap v24: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 105 B/s rd, 843 B/s wr, 1 op/s 2024-04-25T02:11:12.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:11 smithi077 ceph-mon[26330]: pgmap v25: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:12.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:11 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:12.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:11 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:12.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:11 smithi112 ceph-mon[33313]: pgmap v25: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:12.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:11 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:12.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:11 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:14.164 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:13 smithi112 ceph-mon[33313]: pgmap v26: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:14.164 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:13 smithi112 ceph-mon[33313]: Upgrade: Updating node-exporter.smithi112 (2/2) 2024-04-25T02:11:14.165 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:13 smithi112 ceph-mon[33313]: Deploying daemon node-exporter.smithi112 on smithi112 2024-04-25T02:11:14.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:13 smithi077 ceph-mon[26330]: pgmap v26: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:14.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:13 smithi077 ceph-mon[26330]: Upgrade: Updating node-exporter.smithi112 (2/2) 2024-04-25T02:11:14.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:13 smithi077 ceph-mon[26330]: Deploying daemon node-exporter.smithi112 on smithi112 2024-04-25T02:11:15.085 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:14 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:11:15.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:14 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:11:16.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:16 smithi112 ceph-mon[33313]: pgmap v27: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:16.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:16 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:16.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:16 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:16.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:16 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:11:16.344 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:16 smithi077 ceph-mon[26330]: pgmap v27: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:16.344 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:16 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:16.344 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:16 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:16.344 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:16 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:11:18.259 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:18 smithi112 ceph-mon[33313]: pgmap v28: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:18.259 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:18 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:18.259 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:18 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:18.370 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:18 smithi077 ceph-mon[26330]: pgmap v28: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:18.370 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:18 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:18.370 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:18 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:20.393 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:20 smithi112 ceph-mon[33313]: pgmap v29: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:20.393 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:20 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:20.393 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:20 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:20.394 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:20 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:20.394 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:20 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:20.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:20 smithi077 ceph-mon[26330]: pgmap v29: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:20.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:20 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:20.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:20 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:20.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:20 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:20.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:20 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:22.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:21 smithi112 ceph-mon[33313]: pgmap v30: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:22.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:21 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:22.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:21 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:22.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:21 smithi077 ceph-mon[26330]: pgmap v30: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:22.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:21 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:22.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:21 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:23.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:23 smithi077 ceph-mon[26330]: pgmap v31: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:23.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:23 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:23.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:23 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:24.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:23 smithi112 ceph-mon[33313]: pgmap v31: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:24.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:23 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:24.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:23 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:25.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:25 smithi077 ceph-mon[26330]: pgmap v32: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:25.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:25 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:25.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:25 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:25.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:25 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:11:25.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:25 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:11:25.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:25 smithi077 ceph-mon[26330]: pgmap v33: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:25.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:25 smithi077 ceph-mon[26330]: pgmap v34: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:25.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:25 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:25.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:25 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:11:25.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:25 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:25.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:25 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:25.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:25 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:25.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:25 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:25.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:25 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:25.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:25 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:25.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:25 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:25.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:25 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:25.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:25 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:26.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:25 smithi112 ceph-mon[33313]: pgmap v32: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:26.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:25 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:26.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:25 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:26.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:25 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:11:26.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:25 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:11:26.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:25 smithi112 ceph-mon[33313]: pgmap v33: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:26.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:25 smithi112 ceph-mon[33313]: pgmap v34: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:26.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:25 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:26.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:25 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:11:26.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:25 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:26.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:25 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:26.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:25 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:26.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:25 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:26.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:25 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:26.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:25 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:26.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:25 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:26.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:25 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:26.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:25 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:27.094 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:26 smithi077 ceph-mon[26330]: Upgrade: Updating prometheus.smithi077 2024-04-25T02:11:27.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:26 smithi112 ceph-mon[33313]: Upgrade: Updating prometheus.smithi077 2024-04-25T02:11:28.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:27 smithi077 ceph-mon[26330]: Deploying daemon prometheus.smithi077 on smithi077 2024-04-25T02:11:28.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:27 smithi077 ceph-mon[26330]: pgmap v35: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:28.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:27 smithi112 ceph-mon[33313]: Deploying daemon prometheus.smithi077 on smithi077 2024-04-25T02:11:28.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:27 smithi112 ceph-mon[33313]: pgmap v35: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:29.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:29 smithi077 ceph-mon[26330]: pgmap v36: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:29.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:29 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:11:30.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:29 smithi112 ceph-mon[33313]: pgmap v36: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:30.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:29 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:11:30.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.936+0000 7f77b21af700 1 -- 172.21.15.77:0/2136989437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77ac0ffee0 msgr2=0x7f77ac102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:30.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.936+0000 7f77b21af700 1 --2- 172.21.15.77:0/2136989437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77ac0ffee0 0x7f77ac102300 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f77a0004940 tx=0x7f77a0009e30 comp rx=0 tx=0).stop 2024-04-25T02:11:30.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.937+0000 7f77b21af700 1 -- 172.21.15.77:0/2136989437 shutdown_connections 2024-04-25T02:11:30.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.937+0000 7f77b21af700 1 --2- 172.21.15.77:0/2136989437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77ac0ffee0 0x7f77ac102300 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.937+0000 7f77b21af700 1 --2- 172.21.15.77:0/2136989437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77ac0662c0 0x7f77ac0ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.937+0000 7f77b21af700 1 -- 172.21.15.77:0/2136989437 >> 172.21.15.77:0/2136989437 conn(0x7f77ac0f7430 msgr2=0x7f77ac0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:30.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.937+0000 7f77b21af700 1 -- 172.21.15.77:0/2136989437 shutdown_connections 2024-04-25T02:11:30.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.937+0000 7f77b21af700 1 -- 172.21.15.77:0/2136989437 wait complete. 2024-04-25T02:11:30.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.937+0000 7f77b21af700 1 Processor -- start 2024-04-25T02:11:30.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.937+0000 7f77b21af700 1 -- start start 2024-04-25T02:11:30.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.938+0000 7f77b21af700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77ac0662c0 0x7f77ac10dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.938+0000 7f77b21af700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77ac0ffee0 0x7f77ac10e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.938+0000 7f77b21af700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac10e690 con 0x7f77ac0ffee0 2024-04-25T02:11:30.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.938+0000 7f77b21af700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac10ede0 con 0x7f77ac0662c0 2024-04-25T02:11:30.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.938+0000 7f77aaffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77ac0ffee0 0x7f77ac10e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.938+0000 7f77aaffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77ac0ffee0 0x7f77ac10e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37338/0 (socket says 172.21.15.77:37338) 2024-04-25T02:11:30.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.938+0000 7f77aaffd700 1 -- 172.21.15.77:0/1584172548 learned_addr learned my addr 172.21.15.77:0/1584172548 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:11:30.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.938+0000 7f77ab7fe700 1 --2- 172.21.15.77:0/1584172548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77ac0662c0 0x7f77ac10dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.938+0000 7f77aaffd700 1 -- 172.21.15.77:0/1584172548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77ac0662c0 msgr2=0x7f77ac10dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:30.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.938+0000 7f77aaffd700 1 --2- 172.21.15.77:0/1584172548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77ac0662c0 0x7f77ac10dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.938+0000 7f77aaffd700 1 -- 172.21.15.77:0/1584172548 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a0005040 con 0x7f77ac0ffee0 2024-04-25T02:11:30.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.938+0000 7f77aaffd700 1 --2- 172.21.15.77:0/1584172548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77ac0ffee0 0x7f77ac10e000 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f77a0009150 tx=0x7f77a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:30.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.938+0000 7f7793fff700 1 -- 172.21.15.77:0/1584172548 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77a000e040 con 0x7f77ac0ffee0 2024-04-25T02:11:30.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.938+0000 7f7793fff700 1 -- 172.21.15.77:0/1584172548 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f77a000bcc0 con 0x7f77ac0ffee0 2024-04-25T02:11:30.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.938+0000 7f7793fff700 1 -- 172.21.15.77:0/1584172548 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77a001c630 con 0x7f77ac0ffee0 2024-04-25T02:11:30.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.938+0000 7f77b21af700 1 -- 172.21.15.77:0/1584172548 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77ac10f060 con 0x7f77ac0ffee0 2024-04-25T02:11:30.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.939+0000 7f77b21af700 1 -- 172.21.15.77:0/1584172548 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77ac10f620 con 0x7f77ac0ffee0 2024-04-25T02:11:30.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.940+0000 7f77b21af700 1 -- 172.21.15.77:0/1584172548 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77ac05f5c0 con 0x7f77ac0ffee0 2024-04-25T02:11:30.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.940+0000 7f7793fff700 1 -- 172.21.15.77:0/1584172548 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 33) v1 ==== 92027+0+0 (secure 0 0 0) 0x7f77a0013420 con 0x7f77ac0ffee0 2024-04-25T02:11:30.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.941+0000 7f7793fff700 1 --2- 172.21.15.77:0/1584172548 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f779406db60 0x7f7794070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.941+0000 7f7793fff700 1 -- 172.21.15.77:0/1584172548 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f77a008e030 con 0x7f77ac0ffee0 2024-04-25T02:11:30.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.941+0000 7f77ab7fe700 1 --2- 172.21.15.77:0/1584172548 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f779406db60 0x7f7794070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.941+0000 7f77ab7fe700 1 --2- 172.21.15.77:0/1584172548 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f779406db60 0x7f7794070010 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f779c006fd0 tx=0x7f779c008040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:30.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:30.946+0000 7f7793fff700 1 -- 172.21.15.77:0/1584172548 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f77a005b630 con 0x7f77ac0ffee0 2024-04-25T02:11:31.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.207+0000 7f77b21af700 1 -- 172.21.15.77:0/1584172548 --> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f77ac10f900 con 0x7f779406db60 2024-04-25T02:11:31.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.209+0000 7f7793fff700 1 -- 172.21.15.77:0/1584172548 <== mgr.14668 v2:172.21.15.77:6800/799251145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f77ac10f900 con 0x7f779406db60 2024-04-25T02:11:31.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.210+0000 7f77b21af700 1 -- 172.21.15.77:0/1584172548 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f779406db60 msgr2=0x7f7794070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:31.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.210+0000 7f77b21af700 1 --2- 172.21.15.77:0/1584172548 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f779406db60 0x7f7794070010 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f779c006fd0 tx=0x7f779c008040 comp rx=0 tx=0).stop 2024-04-25T02:11:31.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.210+0000 7f77b21af700 1 -- 172.21.15.77:0/1584172548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77ac0ffee0 msgr2=0x7f77ac10e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:31.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.210+0000 7f77b21af700 1 --2- 172.21.15.77:0/1584172548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77ac0ffee0 0x7f77ac10e000 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f77a0009150 tx=0x7f77a0009e30 comp rx=0 tx=0).stop 2024-04-25T02:11:31.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.211+0000 7f77b21af700 1 -- 172.21.15.77:0/1584172548 shutdown_connections 2024-04-25T02:11:31.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.211+0000 7f77b21af700 1 --2- 172.21.15.77:0/1584172548 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f779406db60 0x7f7794070010 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:31.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.211+0000 7f77b21af700 1 --2- 172.21.15.77:0/1584172548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77ac0662c0 0x7f77ac10dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:31.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.211+0000 7f77b21af700 1 --2- 172.21.15.77:0/1584172548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77ac0ffee0 0x7f77ac10e000 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:31.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.211+0000 7f77b21af700 1 -- 172.21.15.77:0/1584172548 >> 172.21.15.77:0/1584172548 conn(0x7f77ac0f7430 msgr2=0x7f77ac0f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:31.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.211+0000 7f77b21af700 1 -- 172.21.15.77:0/1584172548 shutdown_connections 2024-04-25T02:11:31.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.211+0000 7f77b21af700 1 -- 172.21.15.77:0/1584172548 wait complete. 2024-04-25T02:11:31.228 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-04-25T02:11:31.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.317+0000 7fc44ffd9700 1 -- 172.21.15.77:0/1548965412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc448066f50 msgr2=0x7fc4480fd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:31.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.317+0000 7fc44ffd9700 1 --2- 172.21.15.77:0/1548965412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc448066f50 0x7fc4480fd7a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc438004940 tx=0x7fc438009e30 comp rx=0 tx=0).stop 2024-04-25T02:11:31.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.317+0000 7fc44ffd9700 1 -- 172.21.15.77:0/1548965412 shutdown_connections 2024-04-25T02:11:31.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.317+0000 7fc44ffd9700 1 --2- 172.21.15.77:0/1548965412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4480fdce0 0x7fc448100160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:31.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.317+0000 7fc44ffd9700 1 --2- 172.21.15.77:0/1548965412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc448066f50 0x7fc4480fd7a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:31.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.317+0000 7fc44ffd9700 1 -- 172.21.15.77:0/1548965412 >> 172.21.15.77:0/1548965412 conn(0x7fc4480f7440 msgr2=0x7fc4480f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:31.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.317+0000 7fc44ffd9700 1 -- 172.21.15.77:0/1548965412 shutdown_connections 2024-04-25T02:11:31.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.317+0000 7fc44ffd9700 1 -- 172.21.15.77:0/1548965412 wait complete. 2024-04-25T02:11:31.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.317+0000 7fc44ffd9700 1 Processor -- start 2024-04-25T02:11:31.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.317+0000 7fc44ffd9700 1 -- start start 2024-04-25T02:11:31.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.317+0000 7fc44ffd9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc448066f50 0x7fc448113fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:31.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.317+0000 7fc44ffd9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4480fdce0 0x7fc448114500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:31.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.317+0000 7fc44ffd9700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc448114b00 con 0x7fc448066f50 2024-04-25T02:11:31.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.317+0000 7fc44ffd9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc448114c70 con 0x7fc4480fdce0 2024-04-25T02:11:31.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.317+0000 7fc44dd75700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc448066f50 0x7fc448113fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:31.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.317+0000 7fc44dd75700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc448066f50 0x7fc448113fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37350/0 (socket says 172.21.15.77:37350) 2024-04-25T02:11:31.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.318+0000 7fc44dd75700 1 -- 172.21.15.77:0/433016643 learned_addr learned my addr 172.21.15.77:0/433016643 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:11:31.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.318+0000 7fc44d574700 1 --2- 172.21.15.77:0/433016643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4480fdce0 0x7fc448114500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:31.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.318+0000 7fc44dd75700 1 -- 172.21.15.77:0/433016643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4480fdce0 msgr2=0x7fc448114500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:31.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.318+0000 7fc44dd75700 1 --2- 172.21.15.77:0/433016643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4480fdce0 0x7fc448114500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:31.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.318+0000 7fc44dd75700 1 -- 172.21.15.77:0/433016643 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc438005040 con 0x7fc448066f50 2024-04-25T02:11:31.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.318+0000 7fc44d574700 1 --2- 172.21.15.77:0/433016643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4480fdce0 0x7fc448114500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:31.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.318+0000 7fc44dd75700 1 --2- 172.21.15.77:0/433016643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc448066f50 0x7fc448113fc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc438009fd0 tx=0x7fc438009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:31.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.318+0000 7fc43e7fc700 1 -- 172.21.15.77:0/433016643 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc43800e040 con 0x7fc448066f50 2024-04-25T02:11:31.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.318+0000 7fc44ffd9700 1 -- 172.21.15.77:0/433016643 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc448119670 con 0x7fc448066f50 2024-04-25T02:11:31.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.318+0000 7fc43e7fc700 1 -- 172.21.15.77:0/433016643 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc43800bbf0 con 0x7fc448066f50 2024-04-25T02:11:31.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.318+0000 7fc43e7fc700 1 -- 172.21.15.77:0/433016643 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc43801c630 con 0x7fc448066f50 2024-04-25T02:11:31.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.318+0000 7fc44ffd9700 1 -- 172.21.15.77:0/433016643 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc448119c30 con 0x7fc448066f50 2024-04-25T02:11:31.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.319+0000 7fc44ffd9700 1 -- 172.21.15.77:0/433016643 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc44804c710 con 0x7fc448066f50 2024-04-25T02:11:31.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.320+0000 7fc43e7fc700 1 -- 172.21.15.77:0/433016643 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 33) v1 ==== 92027+0+0 (secure 0 0 0) 0x7fc438013980 con 0x7fc448066f50 2024-04-25T02:11:31.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.320+0000 7fc43e7fc700 1 --2- 172.21.15.77:0/433016643 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fc43406db70 0x7fc434070020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:31.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.320+0000 7fc43e7fc700 1 -- 172.21.15.77:0/433016643 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fc43808e790 con 0x7fc448066f50 2024-04-25T02:11:31.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.320+0000 7fc44d574700 1 --2- 172.21.15.77:0/433016643 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fc43406db70 0x7fc434070020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:31.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.320+0000 7fc44d574700 1 --2- 172.21.15.77:0/433016643 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fc43406db70 0x7fc434070020 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc444009fd0 tx=0x7fc444009ee0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:31.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.324+0000 7fc43e7fc700 1 -- 172.21.15.77:0/433016643 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7fc43805bc70 con 0x7fc448066f50 2024-04-25T02:11:31.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.544+0000 7fc44ffd9700 1 -- 172.21.15.77:0/433016643 --> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4480f8f30 con 0x7fc43406db70 2024-04-25T02:11:31.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.545+0000 7fc43e7fc700 1 -- 172.21.15.77:0/433016643 <== mgr.14668 v2:172.21.15.77:6800/799251145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7fc4480f8f30 con 0x7fc43406db70 2024-04-25T02:11:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.547+0000 7fc44ffd9700 1 -- 172.21.15.77:0/433016643 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fc43406db70 msgr2=0x7fc434070020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.547+0000 7fc44ffd9700 1 --2- 172.21.15.77:0/433016643 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fc43406db70 0x7fc434070020 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc444009fd0 tx=0x7fc444009ee0 comp rx=0 tx=0).stop 2024-04-25T02:11:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.547+0000 7fc44ffd9700 1 -- 172.21.15.77:0/433016643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc448066f50 msgr2=0x7fc448113fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.547+0000 7fc44ffd9700 1 --2- 172.21.15.77:0/433016643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc448066f50 0x7fc448113fc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc438009fd0 tx=0x7fc438009e30 comp rx=0 tx=0).stop 2024-04-25T02:11:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.547+0000 7fc44ffd9700 1 -- 172.21.15.77:0/433016643 shutdown_connections 2024-04-25T02:11:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.547+0000 7fc44ffd9700 1 --2- 172.21.15.77:0/433016643 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fc43406db70 0x7fc434070020 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.547+0000 7fc44ffd9700 1 --2- 172.21.15.77:0/433016643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc448066f50 0x7fc448113fc0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.547+0000 7fc44ffd9700 1 --2- 172.21.15.77:0/433016643 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4480fdce0 0x7fc448114500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.547+0000 7fc44ffd9700 1 -- 172.21.15.77:0/433016643 >> 172.21.15.77:0/433016643 conn(0x7fc4480f7440 msgr2=0x7fc4480f7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.548+0000 7fc44ffd9700 1 -- 172.21.15.77:0/433016643 shutdown_connections 2024-04-25T02:11:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.548+0000 7fc44ffd9700 1 -- 172.21.15.77:0/433016643 wait complete. 2024-04-25T02:11:31.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.652+0000 7f46c8c2b700 1 -- 172.21.15.77:0/3489482654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46c40662c0 msgr2=0x7f46c40ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:31.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.652+0000 7f46c8c2b700 1 --2- 172.21.15.77:0/3489482654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46c40662c0 0x7f46c40ff9a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009ce0 tx=0x7f46bc004d10 comp rx=0 tx=0).stop 2024-04-25T02:11:31.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.652+0000 7f46c8c2b700 1 -- 172.21.15.77:0/3489482654 shutdown_connections 2024-04-25T02:11:31.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.652+0000 7f46c8c2b700 1 --2- 172.21.15.77:0/3489482654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46c40ffee0 0x7f46c4102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:31.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.652+0000 7f46c8c2b700 1 --2- 172.21.15.77:0/3489482654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46c40662c0 0x7f46c40ff9a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:31.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.652+0000 7f46c8c2b700 1 -- 172.21.15.77:0/3489482654 >> 172.21.15.77:0/3489482654 conn(0x7f46c40f7430 msgr2=0x7f46c40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:31.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.652+0000 7f46c8c2b700 1 -- 172.21.15.77:0/3489482654 shutdown_connections 2024-04-25T02:11:31.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.652+0000 7f46c8c2b700 1 -- 172.21.15.77:0/3489482654 wait complete. 2024-04-25T02:11:31.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.652+0000 7f46c8c2b700 1 Processor -- start 2024-04-25T02:11:31.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.652+0000 7f46c8c2b700 1 -- start start 2024-04-25T02:11:31.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.653+0000 7f46c8c2b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46c40662c0 0x7f46c40fd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:31.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.653+0000 7f46c8c2b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46c40ffee0 0x7f46c40fb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:31.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.653+0000 7f46c8c2b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c40fbe50 con 0x7f46c40ffee0 2024-04-25T02:11:31.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.653+0000 7f46c8c2b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c40fbfc0 con 0x7f46c40662c0 2024-04-25T02:11:31.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.653+0000 7f46c1d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46c40ffee0 0x7f46c40fb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:31.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.653+0000 7f46c1d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46c40ffee0 0x7f46c40fb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37370/0 (socket says 172.21.15.77:37370) 2024-04-25T02:11:31.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.653+0000 7f46c1d9b700 1 -- 172.21.15.77:0/53272799 learned_addr learned my addr 172.21.15.77:0/53272799 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:11:31.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.653+0000 7f46c259c700 1 --2- 172.21.15.77:0/53272799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46c40662c0 0x7f46c40fd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:31.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.653+0000 7f46c1d9b700 1 -- 172.21.15.77:0/53272799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46c40662c0 msgr2=0x7f46c40fd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:31.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.653+0000 7f46c1d9b700 1 --2- 172.21.15.77:0/53272799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46c40662c0 0x7f46c40fd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:31.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.653+0000 7f46c1d9b700 1 -- 172.21.15.77:0/53272799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46bc009940 con 0x7f46c40ffee0 2024-04-25T02:11:31.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.653+0000 7f46c1d9b700 1 --2- 172.21.15.77:0/53272799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46c40ffee0 0x7f46c40fb8a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f46b8002a50 tx=0x7f46b80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:31.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.653+0000 7f46b2ffd700 1 -- 172.21.15.77:0/53272799 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46b8007cc0 con 0x7f46c40ffee0 2024-04-25T02:11:31.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.653+0000 7f46c8c2b700 1 -- 172.21.15.77:0/53272799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c40fc2a0 con 0x7f46c40ffee0 2024-04-25T02:11:31.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.653+0000 7f46b2ffd700 1 -- 172.21.15.77:0/53272799 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f46b800f040 con 0x7f46c40ffee0 2024-04-25T02:11:31.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.653+0000 7f46b2ffd700 1 -- 172.21.15.77:0/53272799 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46b800da30 con 0x7f46c40ffee0 2024-04-25T02:11:31.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.654+0000 7f46c8c2b700 1 -- 172.21.15.77:0/53272799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c4115bc0 con 0x7f46c40ffee0 2024-04-25T02:11:31.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.654+0000 7f46c8c2b700 1 -- 172.21.15.77:0/53272799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c405f5c0 con 0x7f46c40ffee0 2024-04-25T02:11:31.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.655+0000 7f46b2ffd700 1 -- 172.21.15.77:0/53272799 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 33) v1 ==== 92027+0+0 (secure 0 0 0) 0x7f46b800db90 con 0x7f46c40ffee0 2024-04-25T02:11:31.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.655+0000 7f46b2ffd700 1 --2- 172.21.15.77:0/53272799 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f46ac06db60 0x7f46ac070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:31.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.655+0000 7f46b2ffd700 1 -- 172.21.15.77:0/53272799 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f46b808d1e0 con 0x7f46c40ffee0 2024-04-25T02:11:31.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.655+0000 7f46c259c700 1 --2- 172.21.15.77:0/53272799 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f46ac06db60 0x7f46ac070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:31.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.656+0000 7f46c259c700 1 --2- 172.21.15.77:0/53272799 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f46ac06db60 0x7f46ac070010 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009cb0 tx=0x7f46bc004d10 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.660+0000 7f46b2ffd700 1 -- 172.21.15.77:0/53272799 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f46b8056b90 con 0x7f46c40ffee0 2024-04-25T02:11:31.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.879+0000 7f46c8c2b700 1 -- 172.21.15.77:0/53272799 --> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f46c40f8f20 con 0x7f46ac06db60 2024-04-25T02:11:31.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.889+0000 7f46b2ffd700 1 -- 172.21.15.77:0/53272799 <== mgr.14668 v2:172.21.15.77:6800/799251145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f46c40f8f20 con 0x7f46ac06db60 2024-04-25T02:11:31.896 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T02:11:31.897 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (109s) 11s ago 10m 16.4M - 0.25.0 c8568f914cd2 0d354e136134 2024-04-25T02:11:31.897 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (10m) 11s ago 10m 6665k - 17.2.7-902-gc61472c8 0de407c1b3af 2ad2e3d2b09e 2024-04-25T02:11:31.897 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi112 smithi112 running (9m) 13s ago 9m 6660k - 17.2.7-902-gc61472c8 0de407c1b3af 9235dc5eb15d 2024-04-25T02:11:31.897 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 unknown 11s ago 10m - - 2024-04-25T02:11:31.897 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.gcfygj smithi077 running (5m) 11s ago 5m 14.2M - 17.2.7-902-gc61472c8 0de407c1b3af 382dd7abf674 2024-04-25T02:11:31.897 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.oadrkb smithi077 running (5m) 11s ago 5m 12.6M - 17.2.7-902-gc61472c8 0de407c1b3af 6992064a4b2a 2024-04-25T02:11:31.897 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.dvwudt smithi112 running (5m) 13s ago 5m 158M - 17.2.7-902-gc61472c8 0de407c1b3af 0792e451abfd 2024-04-25T02:11:31.897 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.fjnadi smithi112 running (5m) 13s ago 5m 13.9M - 17.2.7-902-gc61472c8 0de407c1b3af c8093f622f6b 2024-04-25T02:11:31.897 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.zpflzp smithi077 *:8443,9283,8765 running (77s) 11s ago 11m 497M - 19.0.0-2445-gd2c45d97 f68e37b807ef a1af92e027e5 2024-04-25T02:11:31.897 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi112.cswrxs smithi112 *:8443,9283,8765 running (33s) 13s ago 9m 449M - 19.0.0-2445-gd2c45d97 f68e37b807ef ccc7c57d35f2 2024-04-25T02:11:31.897 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (11m) 11s ago 12m 54.3M 2048M 17.2.7-902-gc61472c8 0de407c1b3af adb57965a306 2024-04-25T02:11:31.897 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi112 smithi112 running (9m) 13s ago 9m 40.8M 2048M 17.2.7-902-gc61472c8 0de407c1b3af db2fb9b09789 2024-04-25T02:11:31.898 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (21s) 11s ago 10m 3594k - 1.5.0 0da6a335fe13 2320132606fc 2024-04-25T02:11:31.898 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi112 smithi112 *:9100 running (17s) 13s ago 9m 3359k - 1.5.0 0da6a335fe13 49f285354791 2024-04-25T02:11:31.898 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (8m) 11s ago 8m 257M 1557M 17.2.7-902-gc61472c8 0de407c1b3af c741abec3b94 2024-04-25T02:11:31.898 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (8m) 11s ago 8m 257M 1557M 17.2.7-902-gc61472c8 0de407c1b3af 256ff3ced322 2024-04-25T02:11:31.898 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (8m) 11s ago 8m 221M 1557M 17.2.7-902-gc61472c8 0de407c1b3af c5d7d8c993f4 2024-04-25T02:11:31.898 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi112 running (7m) 13s ago 7m 288M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 68429d0dbf88 2024-04-25T02:11:31.898 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi112 running (7m) 13s ago 7m 258M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 66eb71201444 2024-04-25T02:11:31.898 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi112 running (6m) 13s ago 6m 236M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 963e700d6aea 2024-04-25T02:11:31.898 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (43s) 11s ago 10m 46.8M - 2.43.0 a07b618ecd1d c0184fc73e6e 2024-04-25T02:11:31.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.891+0000 7f46c8c2b700 1 -- 172.21.15.77:0/53272799 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f46ac06db60 msgr2=0x7f46ac070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:31.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.891+0000 7f46c8c2b700 1 --2- 172.21.15.77:0/53272799 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f46ac06db60 0x7f46ac070010 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009cb0 tx=0x7f46bc004d10 comp rx=0 tx=0).stop 2024-04-25T02:11:31.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.891+0000 7f46c8c2b700 1 -- 172.21.15.77:0/53272799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46c40ffee0 msgr2=0x7f46c40fb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:31.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.891+0000 7f46c8c2b700 1 --2- 172.21.15.77:0/53272799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46c40ffee0 0x7f46c40fb8a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f46b8002a50 tx=0x7f46b80046b0 comp rx=0 tx=0).stop 2024-04-25T02:11:31.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.891+0000 7f46c8c2b700 1 -- 172.21.15.77:0/53272799 shutdown_connections 2024-04-25T02:11:31.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.891+0000 7f46c8c2b700 1 --2- 172.21.15.77:0/53272799 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f46ac06db60 0x7f46ac070010 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:31.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.891+0000 7f46c8c2b700 1 --2- 172.21.15.77:0/53272799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46c40662c0 0x7f46c40fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:31.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.891+0000 7f46c8c2b700 1 --2- 172.21.15.77:0/53272799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46c40ffee0 0x7f46c40fb8a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:31.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.891+0000 7f46c8c2b700 1 -- 172.21.15.77:0/53272799 >> 172.21.15.77:0/53272799 conn(0x7f46c40f7430 msgr2=0x7f46c40f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:31.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.892+0000 7f46c8c2b700 1 -- 172.21.15.77:0/53272799 shutdown_connections 2024-04-25T02:11:31.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.892+0000 7f46c8c2b700 1 -- 172.21.15.77:0/53272799 wait complete. 2024-04-25T02:11:32.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.994+0000 7faad2bfa700 1 -- 172.21.15.77:0/631442258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faacc0fcf60 msgr2=0x7faacc0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:32.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.994+0000 7faad2bfa700 1 --2- 172.21.15.77:0/631442258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faacc0fcf60 0x7faacc0fd3d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7faab8004940 tx=0x7faab8009e30 comp rx=0 tx=0).stop 2024-04-25T02:11:32.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.994+0000 7faad2bfa700 1 -- 172.21.15.77:0/631442258 shutdown_connections 2024-04-25T02:11:32.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.994+0000 7faad2bfa700 1 --2- 172.21.15.77:0/631442258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faacc0fcf60 0x7faacc0fd3d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:32.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.994+0000 7faad2bfa700 1 --2- 172.21.15.77:0/631442258 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faacc0fbcb0 0x7faacc0fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:32.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.994+0000 7faad2bfa700 1 -- 172.21.15.77:0/631442258 >> 172.21.15.77:0/631442258 conn(0x7faacc0f7430 msgr2=0x7faacc0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:32.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.994+0000 7faad2bfa700 1 -- 172.21.15.77:0/631442258 shutdown_connections 2024-04-25T02:11:32.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.994+0000 7faad2bfa700 1 -- 172.21.15.77:0/631442258 wait complete. 2024-04-25T02:11:32.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.994+0000 7faad2bfa700 1 Processor -- start 2024-04-25T02:11:32.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.995+0000 7faad2bfa700 1 -- start start 2024-04-25T02:11:32.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.995+0000 7faad2bfa700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faacc0fbcb0 0x7faacc110730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:32.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.995+0000 7faad2bfa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faacc0fcf60 0x7faacc112c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:32.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.995+0000 7faad2bfa700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faacc066350 con 0x7faacc0fbcb0 2024-04-25T02:11:32.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.995+0000 7faad2bfa700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faacc066490 con 0x7faacc0fcf60 2024-04-25T02:11:32.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.995+0000 7faad0996700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faacc0fbcb0 0x7faacc110730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:32.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.995+0000 7faad0996700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faacc0fbcb0 0x7faacc110730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37400/0 (socket says 172.21.15.77:37400) 2024-04-25T02:11:32.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.995+0000 7faad0996700 1 -- 172.21.15.77:0/2727341528 learned_addr learned my addr 172.21.15.77:0/2727341528 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:11:32.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.995+0000 7faacbfff700 1 --2- 172.21.15.77:0/2727341528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faacc0fcf60 0x7faacc112c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:32.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.995+0000 7faad0996700 1 -- 172.21.15.77:0/2727341528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faacc0fcf60 msgr2=0x7faacc112c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:32.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.995+0000 7faad0996700 1 --2- 172.21.15.77:0/2727341528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faacc0fcf60 0x7faacc112c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:32.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.995+0000 7faad0996700 1 -- 172.21.15.77:0/2727341528 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab8005040 con 0x7faacc0fbcb0 2024-04-25T02:11:32.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.995+0000 7faacbfff700 1 --2- 172.21.15.77:0/2727341528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faacc0fcf60 0x7faacc112c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:32.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.995+0000 7faad0996700 1 --2- 172.21.15.77:0/2727341528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faacc0fbcb0 0x7faacc110730 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7faac000c830 tx=0x7faac0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:32.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.996+0000 7faac97fa700 1 -- 172.21.15.77:0/2727341528 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faac000a760 con 0x7faacc0fbcb0 2024-04-25T02:11:32.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.996+0000 7faac97fa700 1 -- 172.21.15.77:0/2727341528 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faac000ad90 con 0x7faacc0fbcb0 2024-04-25T02:11:32.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.996+0000 7faad2bfa700 1 -- 172.21.15.77:0/2727341528 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faacc113280 con 0x7faacc0fbcb0 2024-04-25T02:11:32.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.996+0000 7faac97fa700 1 -- 172.21.15.77:0/2727341528 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faac00113a0 con 0x7faacc0fbcb0 2024-04-25T02:11:32.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.996+0000 7faad2bfa700 1 -- 172.21.15.77:0/2727341528 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faacc113810 con 0x7faacc0fbcb0 2024-04-25T02:11:32.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.997+0000 7faad2bfa700 1 -- 172.21.15.77:0/2727341528 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faacc05f5c0 con 0x7faacc0fbcb0 2024-04-25T02:11:32.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.997+0000 7faac97fa700 1 -- 172.21.15.77:0/2727341528 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 33) v1 ==== 92027+0+0 (secure 0 0 0) 0x7faac0012400 con 0x7faacc0fbcb0 2024-04-25T02:11:32.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.998+0000 7faac97fa700 1 --2- 172.21.15.77:0/2727341528 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7faabc06db60 0x7faabc070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:32.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.998+0000 7faac97fa700 1 -- 172.21.15.77:0/2727341528 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7faac008d2a0 con 0x7faacc0fbcb0 2024-04-25T02:11:32.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.998+0000 7faacbfff700 1 --2- 172.21.15.77:0/2727341528 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7faabc06db60 0x7faabc070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:32.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:31.998+0000 7faacbfff700 1 --2- 172.21.15.77:0/2727341528 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7faabc06db60 0x7faabc070010 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7faab800b3b0 tx=0x7faab8009e30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:32.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.002+0000 7faac97fa700 1 -- 172.21.15.77:0/2727341528 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7faac0056e80 con 0x7faacc0fbcb0 2024-04-25T02:11:32.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:31 smithi077 ceph-mon[26330]: pgmap v37: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:32.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:31 smithi077 ceph-mon[26330]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:11:32.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:31 smithi112 ceph-mon[33313]: pgmap v37: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:32.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:31 smithi112 ceph-mon[33313]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:11:32.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.356+0000 7faad2bfa700 1 -- 172.21.15.77:0/2727341528 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faacc1047a0 con 0x7faacc0fbcb0 2024-04-25T02:11:32.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.356+0000 7faac97fa700 1 -- 172.21.15.77:0/2727341528 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7faac005a540 con 0x7faacc0fbcb0 2024-04-25T02:11:32.364 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:11:32.364 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-04-25T02:11:32.364 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2 2024-04-25T02:11:32.364 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:11:32.364 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-04-25T02:11:32.364 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:11:32.365 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:11:32.365 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-04-25T02:11:32.365 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 6 2024-04-25T02:11:32.365 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:11:32.365 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-04-25T02:11:32.365 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T02:11:32.365 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:11:32.365 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-04-25T02:11:32.365 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 12, 2024-04-25T02:11:32.365 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:11:32.365 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-25T02:11:32.365 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:11:32.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.359+0000 7faad2bfa700 1 -- 172.21.15.77:0/2727341528 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7faabc06db60 msgr2=0x7faabc070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:32.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.359+0000 7faad2bfa700 1 --2- 172.21.15.77:0/2727341528 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7faabc06db60 0x7faabc070010 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7faab800b3b0 tx=0x7faab8009e30 comp rx=0 tx=0).stop 2024-04-25T02:11:32.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.359+0000 7faad2bfa700 1 -- 172.21.15.77:0/2727341528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faacc0fbcb0 msgr2=0x7faacc110730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:32.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.359+0000 7faad2bfa700 1 --2- 172.21.15.77:0/2727341528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faacc0fbcb0 0x7faacc110730 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7faac000c830 tx=0x7faac0004470 comp rx=0 tx=0).stop 2024-04-25T02:11:32.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.359+0000 7faad2bfa700 1 -- 172.21.15.77:0/2727341528 shutdown_connections 2024-04-25T02:11:32.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.359+0000 7faad2bfa700 1 --2- 172.21.15.77:0/2727341528 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7faabc06db60 0x7faabc070010 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:32.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.359+0000 7faad2bfa700 1 --2- 172.21.15.77:0/2727341528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faacc0fbcb0 0x7faacc110730 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:32.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.359+0000 7faad2bfa700 1 --2- 172.21.15.77:0/2727341528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faacc0fcf60 0x7faacc112c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:32.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.359+0000 7faad2bfa700 1 -- 172.21.15.77:0/2727341528 >> 172.21.15.77:0/2727341528 conn(0x7faacc0f7430 msgr2=0x7faacc0f8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:32.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.359+0000 7faad2bfa700 1 -- 172.21.15.77:0/2727341528 shutdown_connections 2024-04-25T02:11:32.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.359+0000 7faad2bfa700 1 -- 172.21.15.77:0/2727341528 wait complete. 2024-04-25T02:11:32.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.464+0000 7fa0ce66a700 1 -- 172.21.15.77:0/3192879891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0c80fdff0 msgr2=0x7fa0c80fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:32.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.464+0000 7fa0ce66a700 1 --2- 172.21.15.77:0/3192879891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0c80fdff0 0x7fa0c80fe460 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc004940 tx=0x7fa0bc009e30 comp rx=0 tx=0).stop 2024-04-25T02:11:32.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.464+0000 7fa0ce66a700 1 -- 172.21.15.77:0/3192879891 shutdown_connections 2024-04-25T02:11:32.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.464+0000 7fa0ce66a700 1 --2- 172.21.15.77:0/3192879891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0c80fdff0 0x7fa0c80fe460 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:32.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.464+0000 7fa0ce66a700 1 --2- 172.21.15.77:0/3192879891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0c80fce80 0x7fa0c80fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:32.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.464+0000 7fa0ce66a700 1 -- 172.21.15.77:0/3192879891 >> 172.21.15.77:0/3192879891 conn(0x7fa0c80f8540 msgr2=0x7fa0c80fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:32.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.464+0000 7fa0ce66a700 1 -- 172.21.15.77:0/3192879891 shutdown_connections 2024-04-25T02:11:32.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.464+0000 7fa0ce66a700 1 -- 172.21.15.77:0/3192879891 wait complete. 2024-04-25T02:11:32.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.464+0000 7fa0ce66a700 1 Processor -- start 2024-04-25T02:11:32.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.465+0000 7fa0ce66a700 1 -- start start 2024-04-25T02:11:32.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.465+0000 7fa0ce66a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0c80fce80 0x7fa0c810da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:32.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.465+0000 7fa0ce66a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0c80fdff0 0x7fa0c810df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:32.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.465+0000 7fa0ce66a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c810e560 con 0x7fa0c80fce80 2024-04-25T02:11:32.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.465+0000 7fa0ce66a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c810edb0 con 0x7fa0c80fdff0 2024-04-25T02:11:32.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.465+0000 7fa0c77fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0c80fdff0 0x7fa0c810df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:32.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.465+0000 7fa0c7fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0c80fce80 0x7fa0c810da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:32.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.465+0000 7fa0c7fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0c80fce80 0x7fa0c810da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37412/0 (socket says 172.21.15.77:37412) 2024-04-25T02:11:32.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.465+0000 7fa0c7fff700 1 -- 172.21.15.77:0/2653142268 learned_addr learned my addr 172.21.15.77:0/2653142268 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:11:32.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.465+0000 7fa0c7fff700 1 -- 172.21.15.77:0/2653142268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0c80fdff0 msgr2=0x7fa0c810df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:32.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.465+0000 7fa0c7fff700 1 --2- 172.21.15.77:0/2653142268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0c80fdff0 0x7fa0c810df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:32.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.465+0000 7fa0c7fff700 1 -- 172.21.15.77:0/2653142268 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0bc005040 con 0x7fa0c80fce80 2024-04-25T02:11:32.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.465+0000 7fa0c77fe700 1 --2- 172.21.15.77:0/2653142268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0c80fdff0 0x7fa0c810df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:32.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.466+0000 7fa0c7fff700 1 --2- 172.21.15.77:0/2653142268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0c80fce80 0x7fa0c810da20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8002a50 tx=0x7fa0b80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:32.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.466+0000 7fa0c4ff9700 1 -- 172.21.15.77:0/2653142268 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0b8007cc0 con 0x7fa0c80fce80 2024-04-25T02:11:32.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.466+0000 7fa0c4ff9700 1 -- 172.21.15.77:0/2653142268 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa0b800f040 con 0x7fa0c80fce80 2024-04-25T02:11:32.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.466+0000 7fa0ce66a700 1 -- 172.21.15.77:0/2653142268 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c810f090 con 0x7fa0c80fce80 2024-04-25T02:11:32.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.466+0000 7fa0c4ff9700 1 -- 172.21.15.77:0/2653142268 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0b800da30 con 0x7fa0c80fce80 2024-04-25T02:11:32.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.466+0000 7fa0ce66a700 1 -- 172.21.15.77:0/2653142268 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c810f5d0 con 0x7fa0c80fce80 2024-04-25T02:11:32.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.467+0000 7fa0ce66a700 1 -- 172.21.15.77:0/2653142268 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c805f5c0 con 0x7fa0c80fce80 2024-04-25T02:11:32.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.468+0000 7fa0c4ff9700 1 -- 172.21.15.77:0/2653142268 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 33) v1 ==== 92027+0+0 (secure 0 0 0) 0x7fa0b800db90 con 0x7fa0c80fce80 2024-04-25T02:11:32.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.468+0000 7fa0c4ff9700 1 --2- 172.21.15.77:0/2653142268 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fa0b006db60 0x7fa0b0070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:32.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.468+0000 7fa0c4ff9700 1 -- 172.21.15.77:0/2653142268 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fa0b808d110 con 0x7fa0c80fce80 2024-04-25T02:11:32.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.468+0000 7fa0c77fe700 1 --2- 172.21.15.77:0/2653142268 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fa0b006db60 0x7fa0b0070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:32.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.469+0000 7fa0c77fe700 1 --2- 172.21.15.77:0/2653142268 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fa0b006db60 0x7fa0b0070010 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00b970 tx=0x7fa0bc009e30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:32.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.473+0000 7fa0c4ff9700 1 -- 172.21.15.77:0/2653142268 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7fa0b805a670 con 0x7fa0c80fce80 2024-04-25T02:11:32.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.704+0000 7fa0ce66a700 1 -- 172.21.15.77:0/2653142268 --> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0c810f9b0 con 0x7fa0b006db60 2024-04-25T02:11:32.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.705+0000 7fa0c4ff9700 1 -- 172.21.15.77:0/2653142268 <== mgr.14668 v2:172.21.15.77:6800/799251145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7fa0c810f9b0 con 0x7fa0b006db60 2024-04-25T02:11:32.712 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:11:32.712 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901", 2024-04-25T02:11:32.712 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-04-25T02:11:32.712 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-25T02:11:32.712 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-04-25T02:11:32.712 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr" 2024-04-25T02:11:32.712 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-25T02:11:32.712 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "2/2 daemons upgraded", 2024-04-25T02:11:32.712 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading prometheus daemons", 2024-04-25T02:11:32.712 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-04-25T02:11:32.713 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:11:32.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.707+0000 7fa0ce66a700 1 -- 172.21.15.77:0/2653142268 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fa0b006db60 msgr2=0x7fa0b0070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:32.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.707+0000 7fa0ce66a700 1 --2- 172.21.15.77:0/2653142268 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fa0b006db60 0x7fa0b0070010 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00b970 tx=0x7fa0bc009e30 comp rx=0 tx=0).stop 2024-04-25T02:11:32.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.707+0000 7fa0ce66a700 1 -- 172.21.15.77:0/2653142268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0c80fce80 msgr2=0x7fa0c810da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:32.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.707+0000 7fa0ce66a700 1 --2- 172.21.15.77:0/2653142268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0c80fce80 0x7fa0c810da20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8002a50 tx=0x7fa0b80046b0 comp rx=0 tx=0).stop 2024-04-25T02:11:32.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.707+0000 7fa0ce66a700 1 -- 172.21.15.77:0/2653142268 shutdown_connections 2024-04-25T02:11:32.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.707+0000 7fa0ce66a700 1 --2- 172.21.15.77:0/2653142268 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fa0b006db60 0x7fa0b0070010 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:32.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.707+0000 7fa0ce66a700 1 --2- 172.21.15.77:0/2653142268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0c80fce80 0x7fa0c810da20 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:32.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.707+0000 7fa0ce66a700 1 --2- 172.21.15.77:0/2653142268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0c80fdff0 0x7fa0c810df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:32.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.707+0000 7fa0ce66a700 1 -- 172.21.15.77:0/2653142268 >> 172.21.15.77:0/2653142268 conn(0x7fa0c80f8540 msgr2=0x7fa0c80f9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:32.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.707+0000 7fa0ce66a700 1 -- 172.21.15.77:0/2653142268 shutdown_connections 2024-04-25T02:11:32.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:11:32.707+0000 7fa0ce66a700 1 -- 172.21.15.77:0/2653142268 wait complete. 2024-04-25T02:11:32.969 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:32 smithi077 ceph-mon[26330]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:11:32.969 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:32 smithi077 ceph-mon[26330]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:11:32.969 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:32 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/2727341528' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:33.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:32 smithi112 ceph-mon[33313]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:11:33.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:32 smithi112 ceph-mon[33313]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:11:33.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:32 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/2727341528' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:34.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:34 smithi077 ceph-mon[26330]: pgmap v38: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:34.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:34 smithi077 ceph-mon[26330]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:11:34.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:34 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:34.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:34 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:34.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:34 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:11:34.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:34 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:34.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:34 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:34.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:34 smithi112 ceph-mon[33313]: pgmap v38: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:34.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:34 smithi112 ceph-mon[33313]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:11:34.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:34 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:34.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:34 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:34.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:34 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:11:34.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:34 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:34.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:34 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:36.407 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:36 smithi077 ceph-mon[26330]: pgmap v39: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:36.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:36 smithi112 ceph-mon[33313]: pgmap v39: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:38.370 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:38 smithi077 ceph-mon[26330]: pgmap v40: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:38.370 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:38 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:38.370 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:38 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:38.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:38 smithi112 ceph-mon[33313]: pgmap v40: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:38.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:38 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:38.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:38 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:39.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:39 smithi077 ceph-mon[26330]: pgmap v41: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:39.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:39 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:39.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:39 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:40.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:39 smithi112 ceph-mon[33313]: pgmap v41: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:40.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:39 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:40.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:39 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:42.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:41 smithi077 ceph-mon[26330]: pgmap v42: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:42.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:41 smithi112 ceph-mon[33313]: pgmap v42: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:44.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:43 smithi077 ceph-mon[26330]: pgmap v43: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:44.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:43 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:44.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:43 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:44.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:43 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:11:44.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:43 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:11:44.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:43 smithi077 ceph-mon[26330]: pgmap v44: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:44.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:43 smithi077 ceph-mon[26330]: pgmap v45: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:44.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:43 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:44.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:43 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T02:11:44.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:43 smithi077 ceph-mon[26330]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T02:11:44.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:43 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:11:44.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:43 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:44.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:43 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:44.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:43 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:44.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:43 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:44.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:43 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:44.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:43 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:44.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:43 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:44.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:43 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:44.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:43 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:44.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:43 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:44.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:43 smithi112 ceph-mon[33313]: pgmap v43: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:44.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:43 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:44.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:43 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:44.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:43 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:11:44.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:43 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:11:44.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:43 smithi112 ceph-mon[33313]: pgmap v44: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:44.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:43 smithi112 ceph-mon[33313]: pgmap v45: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:44.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:43 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:44.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:43 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T02:11:44.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:43 smithi112 ceph-mon[33313]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T02:11:44.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:43 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:11:44.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:43 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:44.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:43 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:44.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:43 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:44.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:43 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:44.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:43 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:44.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:43 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:44.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:43 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:44.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:43 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:44.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:43 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:44.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:43 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:11:45.184 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:44 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:11:45.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:44 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:11:46.033 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:45 smithi077 ceph-mon[26330]: Upgrade: Updating alertmanager.smithi077 2024-04-25T02:11:46.034 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:45 smithi077 ceph-mon[26330]: Deploying daemon alertmanager.smithi077 on smithi077 2024-04-25T02:11:46.034 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:45 smithi077 ceph-mon[26330]: pgmap v46: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:46.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:45 smithi112 ceph-mon[33313]: Upgrade: Updating alertmanager.smithi077 2024-04-25T02:11:46.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:45 smithi112 ceph-mon[33313]: Deploying daemon alertmanager.smithi077 on smithi077 2024-04-25T02:11:46.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:45 smithi112 ceph-mon[33313]: pgmap v46: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:48.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:47 smithi077 ceph-mon[26330]: pgmap v47: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:48.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:47 smithi112 ceph-mon[33313]: pgmap v47: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:50.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:49 smithi077 ceph-mon[26330]: pgmap v48: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:50.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:49 smithi112 ceph-mon[33313]: pgmap v48: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:51.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:51 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:51.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:51 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:51.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:51 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:11:51.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:51 smithi077 ceph-mon[26330]: pgmap v49: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:51.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:51 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:51.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:51 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:51.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:51 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:11:51.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:51 smithi112 ceph-mon[33313]: pgmap v49: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:54.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:53 smithi077 ceph-mon[26330]: pgmap v50: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:54.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:53 smithi112 ceph-mon[33313]: pgmap v50: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:56.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:55 smithi077 ceph-mon[26330]: pgmap v51: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:56.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:55 smithi112 ceph-mon[33313]: pgmap v51: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:57.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:57 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:57.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:57 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:57.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:57 smithi077 ceph-mon[26330]: pgmap v52: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:58.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:57 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:58.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:57 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:58.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:57 smithi112 ceph-mon[33313]: pgmap v52: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:11:58.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:58 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:58.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:58 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:59.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:58 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:59.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:58 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:11:59.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:11:59 smithi077 ceph-mon[26330]: pgmap v53: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:00.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:11:59 smithi112 ceph-mon[33313]: pgmap v53: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:00.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:00 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:12:01.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:00 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:12:02.126 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:02 smithi077 ceph-mon[26330]: pgmap v54: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-25T02:12:02.127 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:02 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:02.127 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:02 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:02.127 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:02 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:12:02.127 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:02 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:12:02.127 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:02 smithi077 ceph-mon[26330]: pgmap v55: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 302 B/s wr, 0 op/s 2024-04-25T02:12:02.127 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:02 smithi077 ceph-mon[26330]: pgmap v56: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 376 B/s wr, 0 op/s 2024-04-25T02:12:02.127 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:02 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:02.127 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:02 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-25T02:12:02.127 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:02 smithi077 ceph-mon[26330]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-25T02:12:02.127 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:02 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi077:9093"}]: dispatch 2024-04-25T02:12:02.127 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:02 smithi077 ceph-mon[26330]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi077:9093"}]: dispatch 2024-04-25T02:12:02.128 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:02 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:02.128 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:02 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:12:02.128 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:02 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:02.128 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:02 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:02.128 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:02 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:02.128 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:02 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:02.128 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:02 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:02.128 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:02 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:02.128 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:02 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:02.128 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:02 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:02.128 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:02 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:02.129 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:02 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:02.129 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:02 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:02.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:02 smithi112 ceph-mon[33313]: pgmap v54: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-25T02:12:02.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:02 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:02.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:02 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:02.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:02 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:12:02.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:02 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:12:02.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:02 smithi112 ceph-mon[33313]: pgmap v55: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 302 B/s wr, 0 op/s 2024-04-25T02:12:02.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:02 smithi112 ceph-mon[33313]: pgmap v56: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 376 B/s wr, 0 op/s 2024-04-25T02:12:02.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:02 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:02.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:02 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-25T02:12:02.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:02 smithi112 ceph-mon[33313]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-25T02:12:02.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:02 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi077:9093"}]: dispatch 2024-04-25T02:12:02.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:02 smithi112 ceph-mon[33313]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi077:9093"}]: dispatch 2024-04-25T02:12:02.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:02 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:02.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:02 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:12:02.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:02 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:02.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:02 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:02.531 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:02 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:02.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:02 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:02.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:02 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:02.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:02 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:02.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:02 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:02.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:02 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:02.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:02 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:02.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:02 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:02.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:02 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:02.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.817+0000 7f15fd83b700 1 -- 172.21.15.77:0/2766423709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15f80fcf90 msgr2=0x7f15f80fd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.817+0000 7f15fd83b700 1 --2- 172.21.15.77:0/2766423709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15f80fcf90 0x7f15f80fd400 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f15ec004940 tx=0x7f15ec009e30 comp rx=0 tx=0).stop 2024-04-25T02:12:02.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.817+0000 7f15fd83b700 1 -- 172.21.15.77:0/2766423709 shutdown_connections 2024-04-25T02:12:02.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.817+0000 7f15fd83b700 1 --2- 172.21.15.77:0/2766423709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15f80fcf90 0x7f15f80fd400 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.817+0000 7f15fd83b700 1 --2- 172.21.15.77:0/2766423709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15f80fbce0 0x7f15f80fc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.817+0000 7f15fd83b700 1 -- 172.21.15.77:0/2766423709 >> 172.21.15.77:0/2766423709 conn(0x7f15f80f7440 msgr2=0x7f15f80f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:02.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.818+0000 7f15fd83b700 1 -- 172.21.15.77:0/2766423709 shutdown_connections 2024-04-25T02:12:02.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.818+0000 7f15fd83b700 1 -- 172.21.15.77:0/2766423709 wait complete. 2024-04-25T02:12:02.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.818+0000 7f15fd83b700 1 Processor -- start 2024-04-25T02:12:02.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.818+0000 7f15fd83b700 1 -- start start 2024-04-25T02:12:02.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.819+0000 7f15fd83b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15f80fbce0 0x7f15f810fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.819+0000 7f15fd83b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15f80fcf90 0x7f15f8110160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.819+0000 7f15fd83b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f8110760 con 0x7f15f80fcf90 2024-04-25T02:12:02.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.819+0000 7f15fd83b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f8110fb0 con 0x7f15f80fbce0 2024-04-25T02:12:02.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.819+0000 7f15f67fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15f80fcf90 0x7f15f8110160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.819+0000 7f15f67fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15f80fcf90 0x7f15f8110160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45424/0 (socket says 172.21.15.77:45424) 2024-04-25T02:12:02.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.819+0000 7f15f67fc700 1 -- 172.21.15.77:0/3506505822 learned_addr learned my addr 172.21.15.77:0/3506505822 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:12:02.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.819+0000 7f15f6ffd700 1 --2- 172.21.15.77:0/3506505822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15f80fbce0 0x7f15f810fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.819+0000 7f15f67fc700 1 -- 172.21.15.77:0/3506505822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15f80fbce0 msgr2=0x7f15f810fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.819+0000 7f15f67fc700 1 --2- 172.21.15.77:0/3506505822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15f80fbce0 0x7f15f810fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.819+0000 7f15f67fc700 1 -- 172.21.15.77:0/3506505822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ec005040 con 0x7f15f80fcf90 2024-04-25T02:12:02.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.819+0000 7f15f6ffd700 1 --2- 172.21.15.77:0/3506505822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15f80fbce0 0x7f15f810fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:02.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.819+0000 7f15f67fc700 1 --2- 172.21.15.77:0/3506505822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15f80fcf90 0x7f15f8110160 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f15ec00b3b0 tx=0x7f15ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:02.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.819+0000 7f15df7fe700 1 -- 172.21.15.77:0/3506505822 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15ec00e040 con 0x7f15f80fcf90 2024-04-25T02:12:02.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.819+0000 7f15df7fe700 1 -- 172.21.15.77:0/3506505822 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f15ec00bcc0 con 0x7f15f80fcf90 2024-04-25T02:12:02.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.819+0000 7f15fd83b700 1 -- 172.21.15.77:0/3506505822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f8111230 con 0x7f15f80fcf90 2024-04-25T02:12:02.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.819+0000 7f15df7fe700 1 -- 172.21.15.77:0/3506505822 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15ec01c630 con 0x7f15f80fcf90 2024-04-25T02:12:02.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.819+0000 7f15fd83b700 1 -- 172.21.15.77:0/3506505822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f8111770 con 0x7f15f80fcf90 2024-04-25T02:12:02.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.820+0000 7f15fd83b700 1 -- 172.21.15.77:0/3506505822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f8101920 con 0x7f15f80fcf90 2024-04-25T02:12:02.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.821+0000 7f15df7fe700 1 -- 172.21.15.77:0/3506505822 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 34) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f15ec013980 con 0x7f15f80fcf90 2024-04-25T02:12:02.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.821+0000 7f15df7fe700 1 --2- 172.21.15.77:0/3506505822 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f15e006da40 0x7f15e006fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.822+0000 7f15df7fe700 1 -- 172.21.15.77:0/3506505822 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f15ec08def0 con 0x7f15f80fcf90 2024-04-25T02:12:02.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.822+0000 7f15f6ffd700 1 --2- 172.21.15.77:0/3506505822 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f15e006da40 0x7f15e006fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.822+0000 7f15f6ffd700 1 --2- 172.21.15.77:0/3506505822 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f15e006da40 0x7f15e006fef0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f15e80041d0 tx=0x7f15e8009040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:02.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:02.826+0000 7f15df7fe700 1 -- 172.21.15.77:0/3506505822 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f15ec05b5f0 con 0x7f15f80fcf90 2024-04-25T02:12:03.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.055+0000 7f15fd83b700 1 -- 172.21.15.77:0/3506505822 --> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f15f8104910 con 0x7f15e006da40 2024-04-25T02:12:03.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.067+0000 7f15df7fe700 1 -- 172.21.15.77:0/3506505822 <== mgr.14668 v2:172.21.15.77:6800/799251145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f15f8104910 con 0x7f15e006da40 2024-04-25T02:12:03.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.069+0000 7f15fd83b700 1 -- 172.21.15.77:0/3506505822 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f15e006da40 msgr2=0x7f15e006fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.069+0000 7f15fd83b700 1 --2- 172.21.15.77:0/3506505822 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f15e006da40 0x7f15e006fef0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f15e80041d0 tx=0x7f15e8009040 comp rx=0 tx=0).stop 2024-04-25T02:12:03.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.069+0000 7f15fd83b700 1 -- 172.21.15.77:0/3506505822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15f80fcf90 msgr2=0x7f15f8110160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.069+0000 7f15fd83b700 1 --2- 172.21.15.77:0/3506505822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15f80fcf90 0x7f15f8110160 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f15ec00b3b0 tx=0x7f15ec009e30 comp rx=0 tx=0).stop 2024-04-25T02:12:03.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.069+0000 7f15fd83b700 1 -- 172.21.15.77:0/3506505822 shutdown_connections 2024-04-25T02:12:03.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.069+0000 7f15fd83b700 1 --2- 172.21.15.77:0/3506505822 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f15e006da40 0x7f15e006fef0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:03.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.069+0000 7f15fd83b700 1 --2- 172.21.15.77:0/3506505822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15f80fbce0 0x7f15f810fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:03.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.069+0000 7f15fd83b700 1 --2- 172.21.15.77:0/3506505822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15f80fcf90 0x7f15f8110160 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:03.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.069+0000 7f15fd83b700 1 -- 172.21.15.77:0/3506505822 >> 172.21.15.77:0/3506505822 conn(0x7f15f80f7440 msgr2=0x7f15f80f8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:03.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.069+0000 7f15fd83b700 1 -- 172.21.15.77:0/3506505822 shutdown_connections 2024-04-25T02:12:03.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.069+0000 7f15fd83b700 1 -- 172.21.15.77:0/3506505822 wait complete. 2024-04-25T02:12:03.087 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-04-25T02:12:03.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.175+0000 7fec2cdff700 1 -- 172.21.15.77:0/3218068021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec280fcf60 msgr2=0x7fec280fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.175+0000 7fec2cdff700 1 --2- 172.21.15.77:0/3218068021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec280fcf60 0x7fec280fd3d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fec1c004940 tx=0x7fec1c009e30 comp rx=0 tx=0).stop 2024-04-25T02:12:03.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.176+0000 7fec2cdff700 1 -- 172.21.15.77:0/3218068021 shutdown_connections 2024-04-25T02:12:03.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.176+0000 7fec2cdff700 1 --2- 172.21.15.77:0/3218068021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec280fcf60 0x7fec280fd3d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:03.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.176+0000 7fec2cdff700 1 --2- 172.21.15.77:0/3218068021 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec280fbcb0 0x7fec280fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:03.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.176+0000 7fec2cdff700 1 -- 172.21.15.77:0/3218068021 >> 172.21.15.77:0/3218068021 conn(0x7fec280f7430 msgr2=0x7fec280f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:03.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.176+0000 7fec2cdff700 1 -- 172.21.15.77:0/3218068021 shutdown_connections 2024-04-25T02:12:03.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.176+0000 7fec2cdff700 1 -- 172.21.15.77:0/3218068021 wait complete. 2024-04-25T02:12:03.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.176+0000 7fec2cdff700 1 Processor -- start 2024-04-25T02:12:03.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.176+0000 7fec2cdff700 1 -- start start 2024-04-25T02:12:03.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.177+0000 7fec2cdff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec280fbcb0 0x7fec2810c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:03.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.177+0000 7fec2cdff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec280fcf60 0x7fec2810ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:03.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.177+0000 7fec2cdff700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2810d4b0 con 0x7fec280fcf60 2024-04-25T02:12:03.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.177+0000 7fec2cdff700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2810dca0 con 0x7fec280fbcb0 2024-04-25T02:12:03.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.177+0000 7fec25d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec280fcf60 0x7fec2810ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:03.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.177+0000 7fec25d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec280fcf60 0x7fec2810ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45436/0 (socket says 172.21.15.77:45436) 2024-04-25T02:12:03.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.177+0000 7fec25d9b700 1 -- 172.21.15.77:0/4207800330 learned_addr learned my addr 172.21.15.77:0/4207800330 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:12:03.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.177+0000 7fec2659c700 1 --2- 172.21.15.77:0/4207800330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec280fbcb0 0x7fec2810c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:03.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.177+0000 7fec25d9b700 1 -- 172.21.15.77:0/4207800330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec280fbcb0 msgr2=0x7fec2810c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.177+0000 7fec25d9b700 1 --2- 172.21.15.77:0/4207800330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec280fbcb0 0x7fec2810c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:03.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.177+0000 7fec25d9b700 1 -- 172.21.15.77:0/4207800330 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1c005040 con 0x7fec280fcf60 2024-04-25T02:12:03.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.177+0000 7fec25d9b700 1 --2- 172.21.15.77:0/4207800330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec280fcf60 0x7fec2810ce20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fec1c009fd0 tx=0x7fec1c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:03.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.178+0000 7fec16ffd700 1 -- 172.21.15.77:0/4207800330 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec1c00e040 con 0x7fec280fcf60 2024-04-25T02:12:03.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.178+0000 7fec16ffd700 1 -- 172.21.15.77:0/4207800330 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec1c00be00 con 0x7fec280fcf60 2024-04-25T02:12:03.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.178+0000 7fec2cdff700 1 -- 172.21.15.77:0/4207800330 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec2810df20 con 0x7fec280fcf60 2024-04-25T02:12:03.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.178+0000 7fec16ffd700 1 -- 172.21.15.77:0/4207800330 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec1c013710 con 0x7fec280fcf60 2024-04-25T02:12:03.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.178+0000 7fec2cdff700 1 -- 172.21.15.77:0/4207800330 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2810e480 con 0x7fec280fcf60 2024-04-25T02:12:03.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.179+0000 7fec2cdff700 1 -- 172.21.15.77:0/4207800330 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec2805f5c0 con 0x7fec280fcf60 2024-04-25T02:12:03.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.180+0000 7fec16ffd700 1 -- 172.21.15.77:0/4207800330 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 34) v1 ==== 91925+0+0 (secure 0 0 0) 0x7fec1c01eb10 con 0x7fec280fcf60 2024-04-25T02:12:03.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.181+0000 7fec16ffd700 1 --2- 172.21.15.77:0/4207800330 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fec1006da50 0x7fec1006ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:03.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.181+0000 7fec16ffd700 1 -- 172.21.15.77:0/4207800330 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fec1c091b70 con 0x7fec280fcf60 2024-04-25T02:12:03.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.181+0000 7fec2659c700 1 --2- 172.21.15.77:0/4207800330 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fec1006da50 0x7fec1006ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:03.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.182+0000 7fec2659c700 1 --2- 172.21.15.77:0/4207800330 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fec1006da50 0x7fec1006ff00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fec18009bf0 tx=0x7fec180091a0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:03.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.185+0000 7fec16ffd700 1 -- 172.21.15.77:0/4207800330 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7fec1c05f2f0 con 0x7fec280fcf60 2024-04-25T02:12:03.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.433+0000 7fec2cdff700 1 -- 172.21.15.77:0/4207800330 --> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fec2810e870 con 0x7fec1006da50 2024-04-25T02:12:03.441 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:03 smithi077 ceph-mon[26330]: mgrmap e34: smithi077.zpflzp(active, since 92s), standbys: smithi112.cswrxs 2024-04-25T02:12:03.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.435+0000 7fec16ffd700 1 -- 172.21.15.77:0/4207800330 <== mgr.14668 v2:172.21.15.77:6800/799251145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7fec2810e870 con 0x7fec1006da50 2024-04-25T02:12:03.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.437+0000 7fec2cdff700 1 -- 172.21.15.77:0/4207800330 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fec1006da50 msgr2=0x7fec1006ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.437+0000 7fec2cdff700 1 --2- 172.21.15.77:0/4207800330 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fec1006da50 0x7fec1006ff00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fec18009bf0 tx=0x7fec180091a0 comp rx=0 tx=0).stop 2024-04-25T02:12:03.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.437+0000 7fec2cdff700 1 -- 172.21.15.77:0/4207800330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec280fcf60 msgr2=0x7fec2810ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.437+0000 7fec2cdff700 1 --2- 172.21.15.77:0/4207800330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec280fcf60 0x7fec2810ce20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fec1c009fd0 tx=0x7fec1c009e30 comp rx=0 tx=0).stop 2024-04-25T02:12:03.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.437+0000 7fec2cdff700 1 -- 172.21.15.77:0/4207800330 shutdown_connections 2024-04-25T02:12:03.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.437+0000 7fec2cdff700 1 --2- 172.21.15.77:0/4207800330 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fec1006da50 0x7fec1006ff00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:03.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.437+0000 7fec2cdff700 1 --2- 172.21.15.77:0/4207800330 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec280fbcb0 0x7fec2810c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:03.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.437+0000 7fec2cdff700 1 --2- 172.21.15.77:0/4207800330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec280fcf60 0x7fec2810ce20 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:03.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.437+0000 7fec2cdff700 1 -- 172.21.15.77:0/4207800330 >> 172.21.15.77:0/4207800330 conn(0x7fec280f7430 msgr2=0x7fec280f8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:03.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.437+0000 7fec2cdff700 1 -- 172.21.15.77:0/4207800330 shutdown_connections 2024-04-25T02:12:03.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.437+0000 7fec2cdff700 1 -- 172.21.15.77:0/4207800330 wait complete. 2024-04-25T02:12:03.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:03 smithi112 ceph-mon[33313]: mgrmap e34: smithi077.zpflzp(active, since 92s), standbys: smithi112.cswrxs 2024-04-25T02:12:03.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.541+0000 7ff054f49700 1 -- 172.21.15.77:0/1122795466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0500fe080 msgr2=0x7ff0500fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.541+0000 7ff054f49700 1 --2- 172.21.15.77:0/1122795466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0500fe080 0x7ff0500fe4f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff038004940 tx=0x7ff038009e30 comp rx=0 tx=0).stop 2024-04-25T02:12:03.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.541+0000 7ff054f49700 1 -- 172.21.15.77:0/1122795466 shutdown_connections 2024-04-25T02:12:03.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.541+0000 7ff054f49700 1 --2- 172.21.15.77:0/1122795466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0500fe080 0x7ff0500fe4f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:03.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.541+0000 7ff054f49700 1 --2- 172.21.15.77:0/1122795466 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0500fcf10 0x7ff0500fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:03.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.541+0000 7ff054f49700 1 -- 172.21.15.77:0/1122795466 >> 172.21.15.77:0/1122795466 conn(0x7ff0500f8560 msgr2=0x7ff0500fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:03.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.542+0000 7ff054f49700 1 -- 172.21.15.77:0/1122795466 shutdown_connections 2024-04-25T02:12:03.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.542+0000 7ff054f49700 1 -- 172.21.15.77:0/1122795466 wait complete. 2024-04-25T02:12:03.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.542+0000 7ff054f49700 1 Processor -- start 2024-04-25T02:12:03.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.542+0000 7ff054f49700 1 -- start start 2024-04-25T02:12:03.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.542+0000 7ff054f49700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0500fcf10 0x7ff05010d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:03.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.542+0000 7ff054f49700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0500fe080 0x7ff05010df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:03.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.542+0000 7ff054f49700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05010e520 con 0x7ff0500fe080 2024-04-25T02:12:03.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.542+0000 7ff054f49700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05010ed70 con 0x7ff0500fcf10 2024-04-25T02:12:03.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.542+0000 7ff045d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0500fe080 0x7ff05010df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:03.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.543+0000 7ff045d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0500fe080 0x7ff05010df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45458/0 (socket says 172.21.15.77:45458) 2024-04-25T02:12:03.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.543+0000 7ff045d9b700 1 -- 172.21.15.77:0/302769109 learned_addr learned my addr 172.21.15.77:0/302769109 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:12:03.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.543+0000 7ff04e59c700 1 --2- 172.21.15.77:0/302769109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0500fcf10 0x7ff05010d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:03.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.543+0000 7ff045d9b700 1 -- 172.21.15.77:0/302769109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0500fcf10 msgr2=0x7ff05010d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.543+0000 7ff045d9b700 1 --2- 172.21.15.77:0/302769109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0500fcf10 0x7ff05010d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:03.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.543+0000 7ff045d9b700 1 -- 172.21.15.77:0/302769109 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff038005040 con 0x7ff0500fe080 2024-04-25T02:12:03.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.543+0000 7ff045d9b700 1 --2- 172.21.15.77:0/302769109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0500fe080 0x7ff05010df20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff03800b3b0 tx=0x7ff038009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:03.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.543+0000 7ff0477fe700 1 -- 172.21.15.77:0/302769109 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff03800e040 con 0x7ff0500fe080 2024-04-25T02:12:03.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.543+0000 7ff0477fe700 1 -- 172.21.15.77:0/302769109 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff03800bbf0 con 0x7ff0500fe080 2024-04-25T02:12:03.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.543+0000 7ff054f49700 1 -- 172.21.15.77:0/302769109 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff05010eff0 con 0x7ff0500fe080 2024-04-25T02:12:03.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.543+0000 7ff0477fe700 1 -- 172.21.15.77:0/302769109 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff03801c630 con 0x7ff0500fe080 2024-04-25T02:12:03.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.543+0000 7ff054f49700 1 -- 172.21.15.77:0/302769109 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff05010f530 con 0x7ff0500fe080 2024-04-25T02:12:03.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.544+0000 7ff054f49700 1 -- 172.21.15.77:0/302769109 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff05005f5c0 con 0x7ff0500fe080 2024-04-25T02:12:03.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.545+0000 7ff0477fe700 1 -- 172.21.15.77:0/302769109 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 34) v1 ==== 91925+0+0 (secure 0 0 0) 0x7ff03800bd60 con 0x7ff0500fe080 2024-04-25T02:12:03.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.545+0000 7ff0477fe700 1 --2- 172.21.15.77:0/302769109 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7ff03c06da40 0x7ff03c06fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:03.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.545+0000 7ff0477fe700 1 -- 172.21.15.77:0/302769109 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7ff03808dd80 con 0x7ff0500fe080 2024-04-25T02:12:03.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.545+0000 7ff04e59c700 1 --2- 172.21.15.77:0/302769109 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7ff03c06da40 0x7ff03c06fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:03.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.545+0000 7ff04e59c700 1 --2- 172.21.15.77:0/302769109 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7ff03c06da40 0x7ff03c06fef0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff040004f40 tx=0x7ff04000b040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:03.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.549+0000 7ff0477fe700 1 -- 172.21.15.77:0/302769109 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7ff03805b500 con 0x7ff0500fe080 2024-04-25T02:12:03.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.764+0000 7ff054f49700 1 -- 172.21.15.77:0/302769109 --> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff05010f860 con 0x7ff03c06da40 2024-04-25T02:12:03.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.774+0000 7ff0477fe700 1 -- 172.21.15.77:0/302769109 <== mgr.14668 v2:172.21.15.77:6800/799251145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7ff05010f860 con 0x7ff03c06da40 2024-04-25T02:12:03.781 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T02:12:03.781 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (13s) 7s ago 11m 17.0M - 0.25.0 c8568f914cd2 699c7fd25ea5 2024-04-25T02:12:03.781 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (11m) 7s ago 11m 6665k - 17.2.7-902-gc61472c8 0de407c1b3af 2ad2e3d2b09e 2024-04-25T02:12:03.781 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi112 smithi112 running (10m) 45s ago 10m 6660k - 17.2.7-902-gc61472c8 0de407c1b3af 9235dc5eb15d 2024-04-25T02:12:03.781 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 unknown 7s ago 10m - - 954c08fa6188 828f0a8283f1 2024-04-25T02:12:03.781 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.gcfygj smithi077 running (5m) 7s ago 5m 14.3M - 17.2.7-902-gc61472c8 0de407c1b3af 382dd7abf674 2024-04-25T02:12:03.782 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.oadrkb smithi077 running (5m) 7s ago 5m 12.7M - 17.2.7-902-gc61472c8 0de407c1b3af 6992064a4b2a 2024-04-25T02:12:03.782 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.dvwudt smithi112 running (5m) 45s ago 5m 158M - 17.2.7-902-gc61472c8 0de407c1b3af 0792e451abfd 2024-04-25T02:12:03.782 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.fjnadi smithi112 running (5m) 45s ago 5m 13.9M - 17.2.7-902-gc61472c8 0de407c1b3af c8093f622f6b 2024-04-25T02:12:03.782 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.zpflzp smithi077 *:8443,9283,8765 running (108s) 7s ago 12m 500M - 19.0.0-2445-gd2c45d97 f68e37b807ef a1af92e027e5 2024-04-25T02:12:03.782 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi112.cswrxs smithi112 *:8443,9283,8765 running (65s) 45s ago 10m 449M - 19.0.0-2445-gd2c45d97 f68e37b807ef ccc7c57d35f2 2024-04-25T02:12:03.782 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (12m) 7s ago 12m 55.3M 2048M 17.2.7-902-gc61472c8 0de407c1b3af adb57965a306 2024-04-25T02:12:03.782 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi112 smithi112 running (10m) 45s ago 10m 40.8M 2048M 17.2.7-902-gc61472c8 0de407c1b3af db2fb9b09789 2024-04-25T02:12:03.782 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (53s) 7s ago 11m 8460k - 1.5.0 0da6a335fe13 2320132606fc 2024-04-25T02:12:03.782 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi112 smithi112 *:9100 running (49s) 45s ago 10m 3359k - 1.5.0 0da6a335fe13 49f285354791 2024-04-25T02:12:03.782 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (9m) 7s ago 9m 257M 1557M 17.2.7-902-gc61472c8 0de407c1b3af c741abec3b94 2024-04-25T02:12:03.782 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (8m) 7s ago 8m 258M 1557M 17.2.7-902-gc61472c8 0de407c1b3af 256ff3ced322 2024-04-25T02:12:03.782 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (8m) 7s ago 8m 222M 1557M 17.2.7-902-gc61472c8 0de407c1b3af c5d7d8c993f4 2024-04-25T02:12:03.782 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi112 running (8m) 45s ago 8m 288M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 68429d0dbf88 2024-04-25T02:12:03.783 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi112 running (7m) 45s ago 7m 258M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 66eb71201444 2024-04-25T02:12:03.783 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi112 running (7m) 45s ago 7m 236M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 963e700d6aea 2024-04-25T02:12:03.783 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (31s) 7s ago 10m 41.6M - 2.43.0 a07b618ecd1d c5b8c6104d96 2024-04-25T02:12:03.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.776+0000 7ff054f49700 1 -- 172.21.15.77:0/302769109 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7ff03c06da40 msgr2=0x7ff03c06fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.776+0000 7ff054f49700 1 --2- 172.21.15.77:0/302769109 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7ff03c06da40 0x7ff03c06fef0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff040004f40 tx=0x7ff04000b040 comp rx=0 tx=0).stop 2024-04-25T02:12:03.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.776+0000 7ff054f49700 1 -- 172.21.15.77:0/302769109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0500fe080 msgr2=0x7ff05010df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.776+0000 7ff054f49700 1 --2- 172.21.15.77:0/302769109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0500fe080 0x7ff05010df20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff03800b3b0 tx=0x7ff038009e30 comp rx=0 tx=0).stop 2024-04-25T02:12:03.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.776+0000 7ff054f49700 1 -- 172.21.15.77:0/302769109 shutdown_connections 2024-04-25T02:12:03.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.776+0000 7ff054f49700 1 --2- 172.21.15.77:0/302769109 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7ff03c06da40 0x7ff03c06fef0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:03.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.776+0000 7ff054f49700 1 --2- 172.21.15.77:0/302769109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0500fcf10 0x7ff05010d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:03.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.776+0000 7ff054f49700 1 --2- 172.21.15.77:0/302769109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0500fe080 0x7ff05010df20 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:03.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.777+0000 7ff054f49700 1 -- 172.21.15.77:0/302769109 >> 172.21.15.77:0/302769109 conn(0x7ff0500f8560 msgr2=0x7ff0500f9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:03.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.777+0000 7ff054f49700 1 -- 172.21.15.77:0/302769109 shutdown_connections 2024-04-25T02:12:03.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.777+0000 7ff054f49700 1 -- 172.21.15.77:0/302769109 wait complete. 2024-04-25T02:12:03.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.880+0000 7f494419b700 1 -- 172.21.15.77:0/3731612616 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f493c0fe430 msgr2=0x7f493c0fe840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.880+0000 7f494419b700 1 --2- 172.21.15.77:0/3731612616 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f493c0fe430 0x7f493c0fe840 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4938004940 tx=0x7f4938009e30 comp rx=0 tx=0).stop 2024-04-25T02:12:03.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.880+0000 7f494419b700 1 -- 172.21.15.77:0/3731612616 shutdown_connections 2024-04-25T02:12:03.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.880+0000 7f494419b700 1 --2- 172.21.15.77:0/3731612616 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f493c0fed80 0x7f493c0faec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:03.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.880+0000 7f494419b700 1 --2- 172.21.15.77:0/3731612616 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f493c0fe430 0x7f493c0fe840 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:03.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.880+0000 7f494419b700 1 -- 172.21.15.77:0/3731612616 >> 172.21.15.77:0/3731612616 conn(0x7f493c0f6bd0 msgr2=0x7f493c0f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:03.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.880+0000 7f494419b700 1 -- 172.21.15.77:0/3731612616 shutdown_connections 2024-04-25T02:12:03.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.880+0000 7f494419b700 1 -- 172.21.15.77:0/3731612616 wait complete. 2024-04-25T02:12:03.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.880+0000 7f494419b700 1 Processor -- start 2024-04-25T02:12:03.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.880+0000 7f494419b700 1 -- start start 2024-04-25T02:12:03.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.880+0000 7f494419b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f493c0fe430 0x7f493c10d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:03.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.880+0000 7f494419b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f493c0fed80 0x7f493c10deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:03.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.880+0000 7f494419b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c10e4b0 con 0x7f493c0fe430 2024-04-25T02:12:03.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.880+0000 7f494419b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c10e620 con 0x7f493c0fed80 2024-04-25T02:12:03.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.880+0000 7f4941f37700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f493c0fe430 0x7f493c10d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:03.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.881+0000 7f4941f37700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f493c0fe430 0x7f493c10d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45472/0 (socket says 172.21.15.77:45472) 2024-04-25T02:12:03.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.881+0000 7f4941f37700 1 -- 172.21.15.77:0/1568722951 learned_addr learned my addr 172.21.15.77:0/1568722951 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:12:03.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.881+0000 7f4941736700 1 --2- 172.21.15.77:0/1568722951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f493c0fed80 0x7f493c10deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:03.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.881+0000 7f4941f37700 1 -- 172.21.15.77:0/1568722951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f493c0fed80 msgr2=0x7f493c10deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:03.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.881+0000 7f4941f37700 1 --2- 172.21.15.77:0/1568722951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f493c0fed80 0x7f493c10deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:03.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.881+0000 7f4941f37700 1 -- 172.21.15.77:0/1568722951 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4938005040 con 0x7f493c0fe430 2024-04-25T02:12:03.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.881+0000 7f4941736700 1 --2- 172.21.15.77:0/1568722951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f493c0fed80 0x7f493c10deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:03.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.881+0000 7f4941f37700 1 --2- 172.21.15.77:0/1568722951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f493c0fe430 0x7f493c10d970 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4938009150 tx=0x7f4938009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:03.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.881+0000 7f49327fc700 1 -- 172.21.15.77:0/1568722951 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f493800e040 con 0x7f493c0fe430 2024-04-25T02:12:03.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.881+0000 7f49327fc700 1 -- 172.21.15.77:0/1568722951 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f493800bcc0 con 0x7f493c0fe430 2024-04-25T02:12:03.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.881+0000 7f49327fc700 1 -- 172.21.15.77:0/1568722951 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f493801c630 con 0x7f493c0fe430 2024-04-25T02:12:03.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.881+0000 7f494419b700 1 -- 172.21.15.77:0/1568722951 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493c113020 con 0x7f493c0fe430 2024-04-25T02:12:03.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.881+0000 7f494419b700 1 -- 172.21.15.77:0/1568722951 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f493c113590 con 0x7f493c0fe430 2024-04-25T02:12:03.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.882+0000 7f494419b700 1 -- 172.21.15.77:0/1568722951 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f493c04c710 con 0x7f493c0fe430 2024-04-25T02:12:03.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.883+0000 7f49327fc700 1 -- 172.21.15.77:0/1568722951 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 34) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f4938013420 con 0x7f493c0fe430 2024-04-25T02:12:03.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.883+0000 7f49327fc700 1 --2- 172.21.15.77:0/1568722951 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f492806da40 0x7f492806fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:03.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.883+0000 7f49327fc700 1 -- 172.21.15.77:0/1568722951 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f493808de70 con 0x7f493c0fe430 2024-04-25T02:12:03.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.883+0000 7f4941736700 1 --2- 172.21.15.77:0/1568722951 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f492806da40 0x7f492806fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:03.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.884+0000 7f4941736700 1 --2- 172.21.15.77:0/1568722951 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f492806da40 0x7f492806fef0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f492c007fd0 tx=0x7f492c009040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:03.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:03.888+0000 7f49327fc700 1 -- 172.21.15.77:0/1568722951 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f493805b5d0 con 0x7f493c0fe430 2024-04-25T02:12:04.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.173+0000 7f494419b700 1 -- 172.21.15.77:0/1568722951 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f493c1139f0 con 0x7f493c0fe430 2024-04-25T02:12:04.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.173+0000 7f49327fc700 1 -- 172.21.15.77:0/1568722951 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f493805b160 con 0x7f493c0fe430 2024-04-25T02:12:04.180 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:12:04.180 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-04-25T02:12:04.180 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2 2024-04-25T02:12:04.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:12:04.180 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-04-25T02:12:04.180 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:12:04.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:12:04.180 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-04-25T02:12:04.181 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 6 2024-04-25T02:12:04.181 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:12:04.181 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-04-25T02:12:04.181 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T02:12:04.181 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:12:04.181 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-04-25T02:12:04.181 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 12, 2024-04-25T02:12:04.181 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:12:04.181 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-25T02:12:04.181 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:12:04.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.175+0000 7f494419b700 1 -- 172.21.15.77:0/1568722951 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f492806da40 msgr2=0x7f492806fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:04.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.175+0000 7f494419b700 1 --2- 172.21.15.77:0/1568722951 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f492806da40 0x7f492806fef0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f492c007fd0 tx=0x7f492c009040 comp rx=0 tx=0).stop 2024-04-25T02:12:04.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.175+0000 7f494419b700 1 -- 172.21.15.77:0/1568722951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f493c0fe430 msgr2=0x7f493c10d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:04.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.175+0000 7f494419b700 1 --2- 172.21.15.77:0/1568722951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f493c0fe430 0x7f493c10d970 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4938009150 tx=0x7f4938009e30 comp rx=0 tx=0).stop 2024-04-25T02:12:04.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.175+0000 7f494419b700 1 -- 172.21.15.77:0/1568722951 shutdown_connections 2024-04-25T02:12:04.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.175+0000 7f494419b700 1 --2- 172.21.15.77:0/1568722951 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f492806da40 0x7f492806fef0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.175+0000 7f494419b700 1 --2- 172.21.15.77:0/1568722951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f493c0fe430 0x7f493c10d970 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.175+0000 7f494419b700 1 --2- 172.21.15.77:0/1568722951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f493c0fed80 0x7f493c10deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.175+0000 7f494419b700 1 -- 172.21.15.77:0/1568722951 >> 172.21.15.77:0/1568722951 conn(0x7f493c0f6bd0 msgr2=0x7f493c0f8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:04.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.175+0000 7f494419b700 1 -- 172.21.15.77:0/1568722951 shutdown_connections 2024-04-25T02:12:04.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.175+0000 7f494419b700 1 -- 172.21.15.77:0/1568722951 wait complete. 2024-04-25T02:12:04.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.288+0000 7f33de008700 1 -- 172.21.15.77:0/3079811278 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33d80ffff0 msgr2=0x7f33d81023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:04.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.288+0000 7f33de008700 1 --2- 172.21.15.77:0/3079811278 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33d80ffff0 0x7f33d81023d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f33c8004940 tx=0x7f33c8009e30 comp rx=0 tx=0).stop 2024-04-25T02:12:04.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.288+0000 7f33de008700 1 -- 172.21.15.77:0/3079811278 shutdown_connections 2024-04-25T02:12:04.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.288+0000 7f33de008700 1 --2- 172.21.15.77:0/3079811278 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33d80ffff0 0x7f33d81023d0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.288+0000 7f33de008700 1 --2- 172.21.15.77:0/3079811278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33d8066ad0 0x7f33d80ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.288+0000 7f33de008700 1 -- 172.21.15.77:0/3079811278 >> 172.21.15.77:0/3079811278 conn(0x7f33d80f74c0 msgr2=0x7f33d80f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:04.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.288+0000 7f33de008700 1 -- 172.21.15.77:0/3079811278 shutdown_connections 2024-04-25T02:12:04.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.288+0000 7f33de008700 1 -- 172.21.15.77:0/3079811278 wait complete. 2024-04-25T02:12:04.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.289+0000 7f33de008700 1 Processor -- start 2024-04-25T02:12:04.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.289+0000 7f33de008700 1 -- start start 2024-04-25T02:12:04.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.289+0000 7f33de008700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33d8066ad0 0x7f33d810d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:04.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.289+0000 7f33de008700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33d80ffff0 0x7f33d810df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:04.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.289+0000 7f33de008700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d810e520 con 0x7f33d8066ad0 2024-04-25T02:12:04.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.289+0000 7f33de008700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d810ed20 con 0x7f33d80ffff0 2024-04-25T02:12:04.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.289+0000 7f33d77fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33d8066ad0 0x7f33d810d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:04.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.289+0000 7f33d77fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33d8066ad0 0x7f33d810d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45484/0 (socket says 172.21.15.77:45484) 2024-04-25T02:12:04.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.289+0000 7f33d77fe700 1 -- 172.21.15.77:0/933323328 learned_addr learned my addr 172.21.15.77:0/933323328 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:12:04.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.289+0000 7f33d6ffd700 1 --2- 172.21.15.77:0/933323328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33d80ffff0 0x7f33d810df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:04.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.289+0000 7f33d77fe700 1 -- 172.21.15.77:0/933323328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33d80ffff0 msgr2=0x7f33d810df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:04.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.289+0000 7f33d77fe700 1 --2- 172.21.15.77:0/933323328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33d80ffff0 0x7f33d810df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.290+0000 7f33d77fe700 1 -- 172.21.15.77:0/933323328 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c8005040 con 0x7f33d8066ad0 2024-04-25T02:12:04.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.290+0000 7f33d77fe700 1 --2- 172.21.15.77:0/933323328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33d8066ad0 0x7f33d810d9e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f33cc00eb70 tx=0x7f33cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:04.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.290+0000 7f33bffff700 1 -- 172.21.15.77:0/933323328 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33cc007cc0 con 0x7f33d8066ad0 2024-04-25T02:12:04.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.290+0000 7f33bffff700 1 -- 172.21.15.77:0/933323328 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f33cc00f040 con 0x7f33d8066ad0 2024-04-25T02:12:04.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.290+0000 7f33de008700 1 -- 172.21.15.77:0/933323328 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d810efa0 con 0x7f33d8066ad0 2024-04-25T02:12:04.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.290+0000 7f33bffff700 1 -- 172.21.15.77:0/933323328 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33cc00cb20 con 0x7f33d8066ad0 2024-04-25T02:12:04.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.290+0000 7f33de008700 1 -- 172.21.15.77:0/933323328 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d810f4e0 con 0x7f33d8066ad0 2024-04-25T02:12:04.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.291+0000 7f33de008700 1 -- 172.21.15.77:0/933323328 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d805f5c0 con 0x7f33d8066ad0 2024-04-25T02:12:04.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.291+0000 7f33bffff700 1 -- 172.21.15.77:0/933323328 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 34) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f33cc00cc80 con 0x7f33d8066ad0 2024-04-25T02:12:04.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.292+0000 7f33bffff700 1 --2- 172.21.15.77:0/933323328 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f33c006da40 0x7f33c006fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:04.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.292+0000 7f33bffff700 1 -- 172.21.15.77:0/933323328 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f33cc08cb40 con 0x7f33d8066ad0 2024-04-25T02:12:04.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.292+0000 7f33d6ffd700 1 --2- 172.21.15.77:0/933323328 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f33c006da40 0x7f33c006fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:04.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.292+0000 7f33d6ffd700 1 --2- 172.21.15.77:0/933323328 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f33c006da40 0x7f33c006fef0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f33c8009b30 tx=0x7f33c8009e30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:04.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.297+0000 7f33bffff700 1 -- 172.21.15.77:0/933323328 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f33cc05a370 con 0x7f33d8066ad0 2024-04-25T02:12:04.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:04 smithi077 ceph-mon[26330]: Upgrade: Updating grafana.smithi077 2024-04-25T02:12:04.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:04 smithi077 ceph-mon[26330]: Deploying daemon grafana.smithi077 on smithi077 2024-04-25T02:12:04.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:04 smithi077 ceph-mon[26330]: pgmap v57: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 376 B/s wr, 0 op/s 2024-04-25T02:12:04.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:04 smithi077 ceph-mon[26330]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:12:04.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:04 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/1568722951' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:04.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.520+0000 7f33de008700 1 -- 172.21.15.77:0/933323328 --> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f33d810f810 con 0x7f33c006da40 2024-04-25T02:12:04.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.521+0000 7f33bffff700 1 -- 172.21.15.77:0/933323328 <== mgr.14668 v2:172.21.15.77:6800/799251145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f33d810f810 con 0x7f33c006da40 2024-04-25T02:12:04.528 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:12:04.528 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901", 2024-04-25T02:12:04.528 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-04-25T02:12:04.528 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-25T02:12:04.528 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-04-25T02:12:04.528 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr" 2024-04-25T02:12:04.529 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-25T02:12:04.529 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "2/2 daemons upgraded", 2024-04-25T02:12:04.529 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading grafana daemons", 2024-04-25T02:12:04.529 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-04-25T02:12:04.529 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:12:04.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:04 smithi112 ceph-mon[33313]: Upgrade: Updating grafana.smithi077 2024-04-25T02:12:04.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:04 smithi112 ceph-mon[33313]: Deploying daemon grafana.smithi077 on smithi077 2024-04-25T02:12:04.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:04 smithi112 ceph-mon[33313]: pgmap v57: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 376 B/s wr, 0 op/s 2024-04-25T02:12:04.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:04 smithi112 ceph-mon[33313]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:12:04.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:04 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/1568722951' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:04.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.524+0000 7f33de008700 1 -- 172.21.15.77:0/933323328 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f33c006da40 msgr2=0x7f33c006fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:04.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.524+0000 7f33de008700 1 --2- 172.21.15.77:0/933323328 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f33c006da40 0x7f33c006fef0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f33c8009b30 tx=0x7f33c8009e30 comp rx=0 tx=0).stop 2024-04-25T02:12:04.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.524+0000 7f33de008700 1 -- 172.21.15.77:0/933323328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33d8066ad0 msgr2=0x7f33d810d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:04.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.524+0000 7f33de008700 1 --2- 172.21.15.77:0/933323328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33d8066ad0 0x7f33d810d9e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f33cc00eb70 tx=0x7f33cc00b040 comp rx=0 tx=0).stop 2024-04-25T02:12:04.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.524+0000 7f33de008700 1 -- 172.21.15.77:0/933323328 shutdown_connections 2024-04-25T02:12:04.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.524+0000 7f33de008700 1 --2- 172.21.15.77:0/933323328 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f33c006da40 0x7f33c006fef0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.524+0000 7f33de008700 1 --2- 172.21.15.77:0/933323328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33d8066ad0 0x7f33d810d9e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.524+0000 7f33de008700 1 --2- 172.21.15.77:0/933323328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33d80ffff0 0x7f33d810df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:04.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.524+0000 7f33de008700 1 -- 172.21.15.77:0/933323328 >> 172.21.15.77:0/933323328 conn(0x7f33d80f74c0 msgr2=0x7f33d80f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:04.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.524+0000 7f33de008700 1 -- 172.21.15.77:0/933323328 shutdown_connections 2024-04-25T02:12:04.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:04.524+0000 7f33de008700 1 -- 172.21.15.77:0/933323328 wait complete. 2024-04-25T02:12:05.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:05 smithi077 ceph-mon[26330]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:12:05.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:05 smithi077 ceph-mon[26330]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:12:05.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:05 smithi112 ceph-mon[33313]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:12:05.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:05 smithi112 ceph-mon[33313]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:12:06.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:06 smithi077 ceph-mon[26330]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:12:06.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:06 smithi077 ceph-mon[26330]: pgmap v58: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 376 B/s wr, 0 op/s 2024-04-25T02:12:06.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:06 smithi112 ceph-mon[33313]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:12:06.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:06 smithi112 ceph-mon[33313]: pgmap v58: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 376 B/s wr, 0 op/s 2024-04-25T02:12:08.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:08.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:08.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:07 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:12:08.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:07 smithi077 ceph-mon[26330]: pgmap v59: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 376 B/s wr, 0 op/s 2024-04-25T02:12:08.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:08.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:08.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:07 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:12:08.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:07 smithi112 ceph-mon[33313]: pgmap v59: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 376 B/s wr, 0 op/s 2024-04-25T02:12:10.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:10 smithi077 ceph-mon[26330]: pgmap v60: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:10.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:10 smithi112 ceph-mon[33313]: pgmap v60: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:12.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:12 smithi077 ceph-mon[26330]: pgmap v61: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:12.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:12 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:12.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:12 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:12.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:12 smithi112 ceph-mon[33313]: pgmap v61: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:12.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:12 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:12.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:12 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:14.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:14 smithi077 ceph-mon[26330]: pgmap v62: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:14.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:14 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:14.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:14 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:14.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:14 smithi112 ceph-mon[33313]: pgmap v62: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:14.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:14 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:14.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:14 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:15.363 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:15 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:12:15.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:15 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:12:16.274 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:16 smithi077 ceph-mon[26330]: pgmap v63: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:16.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:16 smithi112 ceph-mon[33313]: pgmap v63: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:17.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:17.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:17.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:12:17.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:12:17.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: pgmap v64: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:17.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:17.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-25T02:12:17.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-25T02:12:17.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi077:3000"}]: dispatch 2024-04-25T02:12:17.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi077:3000"}]: dispatch 2024-04-25T02:12:17.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:17.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:12:17.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:17.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:17.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:17.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:17.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:17.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:17.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:17.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:17.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:17.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:17.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:17.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:17.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:17.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:17.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: Upgrade: Finalizing container_image settings 2024-04-25T02:12:17.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:17.983 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-25T02:12:17.983 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-25T02:12:17.983 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:12:17.983 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-25T02:12:17.983 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-25T02:12:17.983 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-25T02:12:17.983 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-25T02:12:17.983 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-25T02:12:17.983 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-25T02:12:17.983 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-25T02:12:17.983 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-25T02:12:17.983 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:12:17.983 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-25T02:12:17.983 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-25T02:12:17.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-25T02:12:17.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-25T02:12:17.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-25T02:12:17.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-25T02:12:17.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-25T02:12:17.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-25T02:12:17.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:12:17.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:12:17.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:12:17.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:12:17.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:12:17.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:12:17.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: Upgrade: Complete! 2024-04-25T02:12:17.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-25T02:12:17.985 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-25T02:12:17.985 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:12:17.985 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:12:17.985 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:12:17.985 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:17.985 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:12:17.985 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:12:17.985 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:12:17.985 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:17 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:18.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:18.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:18.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:12:18.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:12:18.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: pgmap v64: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:18.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:18.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-25T02:12:18.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-25T02:12:18.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi077:3000"}]: dispatch 2024-04-25T02:12:18.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi077:3000"}]: dispatch 2024-04-25T02:12:18.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:18.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:12:18.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:18.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:18.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:18.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:18.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:18.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:18.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:18.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:18.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:18.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:18.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:18.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:18.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:18.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:18.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: Upgrade: Finalizing container_image settings 2024-04-25T02:12:18.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:18.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-25T02:12:18.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-25T02:12:18.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:12:18.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-25T02:12:18.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-25T02:12:18.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-25T02:12:18.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-25T02:12:18.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-25T02:12:18.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-25T02:12:18.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-25T02:12:18.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-25T02:12:18.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:12:18.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-25T02:12:18.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-25T02:12:18.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-25T02:12:18.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-25T02:12:18.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-25T02:12:18.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-25T02:12:18.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-25T02:12:18.034 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-25T02:12:18.034 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:12:18.034 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:12:18.034 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:12:18.034 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:12:18.034 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:12:18.034 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:12:18.034 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: Upgrade: Complete! 2024-04-25T02:12:18.034 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-25T02:12:18.034 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-25T02:12:18.035 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:12:18.035 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:12:18.035 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:12:18.035 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:18.035 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:12:18.035 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:12:18.035 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:12:18.035 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:17 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:18.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:18 smithi077 ceph-mon[26330]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-04-25T02:12:18.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:18 smithi077 ceph-mon[26330]: Cluster is now healthy 2024-04-25T02:12:19.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:18 smithi112 ceph-mon[33313]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-04-25T02:12:19.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:18 smithi112 ceph-mon[33313]: Cluster is now healthy 2024-04-25T02:12:19.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:19 smithi077 ceph-mon[26330]: pgmap v65: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:20.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:19 smithi112 ceph-mon[33313]: pgmap v65: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:21.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:20 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:21.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:20 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:22.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:21 smithi112 ceph-mon[33313]: pgmap v66: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:22.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:21 smithi077 ceph-mon[26330]: pgmap v66: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:24.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:23 smithi112 ceph-mon[33313]: pgmap v67: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:24.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:23 smithi077 ceph-mon[26330]: pgmap v67: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:26.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:25 smithi112 ceph-mon[33313]: pgmap v68: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:26.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:25 smithi077 ceph-mon[26330]: pgmap v68: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:28.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:27 smithi112 ceph-mon[33313]: pgmap v69: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:28.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:27 smithi077 ceph-mon[26330]: pgmap v69: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:30.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:29 smithi112 ceph-mon[33313]: pgmap v70: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:30.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:29 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:30.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:29 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:12:30.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:29 smithi077 ceph-mon[26330]: pgmap v70: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:30.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:29 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:30.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:29 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:12:32.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:31 smithi112 ceph-mon[33313]: pgmap v71: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:32.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:31 smithi077 ceph-mon[26330]: pgmap v71: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:34.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:33 smithi112 ceph-mon[33313]: pgmap v72: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:34.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:33 smithi077 ceph-mon[26330]: pgmap v72: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:34.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.637+0000 7f4d7166a700 1 -- 172.21.15.77:0/2466637062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d6c0fdfd0 msgr2=0x7f4d6c0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:34.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.637+0000 7f4d7166a700 1 --2- 172.21.15.77:0/2466637062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d6c0fdfd0 0x7f4d6c0fe440 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4d60004940 tx=0x7f4d60009e30 comp rx=0 tx=0).stop 2024-04-25T02:12:34.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.637+0000 7f4d7166a700 1 -- 172.21.15.77:0/2466637062 shutdown_connections 2024-04-25T02:12:34.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.637+0000 7f4d7166a700 1 --2- 172.21.15.77:0/2466637062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d6c0fdfd0 0x7f4d6c0fe440 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:34.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.638+0000 7f4d7166a700 1 --2- 172.21.15.77:0/2466637062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d6c0fce60 0x7f4d6c0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:34.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.638+0000 7f4d7166a700 1 -- 172.21.15.77:0/2466637062 >> 172.21.15.77:0/2466637062 conn(0x7f4d6c0f8520 msgr2=0x7f4d6c0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:34.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.638+0000 7f4d7166a700 1 -- 172.21.15.77:0/2466637062 shutdown_connections 2024-04-25T02:12:34.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.638+0000 7f4d7166a700 1 -- 172.21.15.77:0/2466637062 wait complete. 2024-04-25T02:12:34.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.638+0000 7f4d7166a700 1 Processor -- start 2024-04-25T02:12:34.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.638+0000 7f4d7166a700 1 -- start start 2024-04-25T02:12:34.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.638+0000 7f4d7166a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d6c0fce60 0x7f4d6c10d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:34.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.638+0000 7f4d7166a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d6c0fdfd0 0x7f4d6c10de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:34.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.638+0000 7f4d7166a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c10e430 con 0x7f4d6c0fdfd0 2024-04-25T02:12:34.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.638+0000 7f4d7166a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c10e5a0 con 0x7f4d6c0fce60 2024-04-25T02:12:34.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.639+0000 7f4d6a7fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d6c0fdfd0 0x7f4d6c10de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:34.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.639+0000 7f4d6a7fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d6c0fdfd0 0x7f4d6c10de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40528/0 (socket says 172.21.15.77:40528) 2024-04-25T02:12:34.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.639+0000 7f4d6a7fc700 1 -- 172.21.15.77:0/1494506407 learned_addr learned my addr 172.21.15.77:0/1494506407 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:12:34.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.639+0000 7f4d6affd700 1 --2- 172.21.15.77:0/1494506407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d6c0fce60 0x7f4d6c10d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:34.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.639+0000 7f4d6a7fc700 1 -- 172.21.15.77:0/1494506407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d6c0fce60 msgr2=0x7f4d6c10d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:34.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.639+0000 7f4d6a7fc700 1 --2- 172.21.15.77:0/1494506407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d6c0fce60 0x7f4d6c10d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:34.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.639+0000 7f4d6a7fc700 1 -- 172.21.15.77:0/1494506407 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d60005040 con 0x7f4d6c0fdfd0 2024-04-25T02:12:34.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.639+0000 7f4d6a7fc700 1 --2- 172.21.15.77:0/1494506407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d6c0fdfd0 0x7f4d6c10de30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000b3b0 tx=0x7f4d60009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:34.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.639+0000 7f4d537fe700 1 -- 172.21.15.77:0/1494506407 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d6000e040 con 0x7f4d6c0fdfd0 2024-04-25T02:12:34.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.639+0000 7f4d537fe700 1 -- 172.21.15.77:0/1494506407 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4d6000bbf0 con 0x7f4d6c0fdfd0 2024-04-25T02:12:34.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.639+0000 7f4d7166a700 1 -- 172.21.15.77:0/1494506407 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d6c112fa0 con 0x7f4d6c0fdfd0 2024-04-25T02:12:34.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.639+0000 7f4d537fe700 1 -- 172.21.15.77:0/1494506407 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d6001c630 con 0x7f4d6c0fdfd0 2024-04-25T02:12:34.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.639+0000 7f4d7166a700 1 -- 172.21.15.77:0/1494506407 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d6c113530 con 0x7f4d6c0fdfd0 2024-04-25T02:12:34.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.640+0000 7f4d7166a700 1 -- 172.21.15.77:0/1494506407 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6c04c710 con 0x7f4d6c0fdfd0 2024-04-25T02:12:34.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.641+0000 7f4d537fe700 1 -- 172.21.15.77:0/1494506407 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 34) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f4d6000bd60 con 0x7f4d6c0fdfd0 2024-04-25T02:12:34.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.641+0000 7f4d537fe700 1 --2- 172.21.15.77:0/1494506407 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f4d5406da40 0x7f4d5406fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:34.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.641+0000 7f4d537fe700 1 -- 172.21.15.77:0/1494506407 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f4d6008dd60 con 0x7f4d6c0fdfd0 2024-04-25T02:12:34.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.641+0000 7f4d6affd700 1 --2- 172.21.15.77:0/1494506407 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f4d5406da40 0x7f4d5406fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:34.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.642+0000 7f4d6affd700 1 --2- 172.21.15.77:0/1494506407 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f4d5406da40 0x7f4d5406fef0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c004f40 tx=0x7f4d5c00b040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:34.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.646+0000 7f4d537fe700 1 -- 172.21.15.77:0/1494506407 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f4d6005b4e0 con 0x7f4d6c0fdfd0 2024-04-25T02:12:34.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.864+0000 7f4d7166a700 1 -- 172.21.15.77:0/1494506407 --> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d6c102380 con 0x7f4d5406da40 2024-04-25T02:12:34.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.866+0000 7f4d537fe700 1 -- 172.21.15.77:0/1494506407 <== mgr.14668 v2:172.21.15.77:6800/799251145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f4d6c102380 con 0x7f4d5406da40 2024-04-25T02:12:34.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.868+0000 7f4d7166a700 1 -- 172.21.15.77:0/1494506407 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f4d5406da40 msgr2=0x7f4d5406fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:34.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.868+0000 7f4d7166a700 1 --2- 172.21.15.77:0/1494506407 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f4d5406da40 0x7f4d5406fef0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c004f40 tx=0x7f4d5c00b040 comp rx=0 tx=0).stop 2024-04-25T02:12:34.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.868+0000 7f4d7166a700 1 -- 172.21.15.77:0/1494506407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d6c0fdfd0 msgr2=0x7f4d6c10de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:34.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.868+0000 7f4d7166a700 1 --2- 172.21.15.77:0/1494506407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d6c0fdfd0 0x7f4d6c10de30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000b3b0 tx=0x7f4d60009e30 comp rx=0 tx=0).stop 2024-04-25T02:12:34.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.868+0000 7f4d7166a700 1 -- 172.21.15.77:0/1494506407 shutdown_connections 2024-04-25T02:12:34.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.868+0000 7f4d7166a700 1 --2- 172.21.15.77:0/1494506407 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f4d5406da40 0x7f4d5406fef0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:34.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.868+0000 7f4d7166a700 1 --2- 172.21.15.77:0/1494506407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d6c0fce60 0x7f4d6c10d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:34.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.868+0000 7f4d7166a700 1 --2- 172.21.15.77:0/1494506407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d6c0fdfd0 0x7f4d6c10de30 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:34.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.868+0000 7f4d7166a700 1 -- 172.21.15.77:0/1494506407 >> 172.21.15.77:0/1494506407 conn(0x7f4d6c0f8520 msgr2=0x7f4d6c0f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:34.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.868+0000 7f4d7166a700 1 -- 172.21.15.77:0/1494506407 shutdown_connections 2024-04-25T02:12:34.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:34.868+0000 7f4d7166a700 1 -- 172.21.15.77:0/1494506407 wait complete. 2024-04-25T02:12:35.630 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -e sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-04-25T02:12:35.888 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:12:35.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:35 smithi077 ceph-mon[26330]: pgmap v73: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:35.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:35 smithi077 ceph-mon[26330]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:12:36.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:35 smithi112 ceph-mon[33313]: pgmap v73: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:36.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:35 smithi112 ceph-mon[33313]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:12:37.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.651+0000 7f3b66ad2700 1 -- 172.21.15.77:0/3302726202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b60103780 msgr2=0x7f3b600fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:37.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.651+0000 7f3b66ad2700 1 --2- 172.21.15.77:0/3302726202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b60103780 0x7f3b600fcdf0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c004940 tx=0x7f3b4c009e30 comp rx=0 tx=0).stop 2024-04-25T02:12:37.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.651+0000 7f3b66ad2700 1 -- 172.21.15.77:0/3302726202 shutdown_connections 2024-04-25T02:12:37.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.651+0000 7f3b66ad2700 1 --2- 172.21.15.77:0/3302726202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b60103780 0x7f3b600fcdf0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.651+0000 7f3b66ad2700 1 --2- 172.21.15.77:0/3302726202 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b60102de0 0x7f3b601031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.651+0000 7f3b66ad2700 1 -- 172.21.15.77:0/3302726202 >> 172.21.15.77:0/3302726202 conn(0x7f3b600f8990 msgr2=0x7f3b600fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:37.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.651+0000 7f3b66ad2700 1 -- 172.21.15.77:0/3302726202 shutdown_connections 2024-04-25T02:12:37.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.651+0000 7f3b66ad2700 1 -- 172.21.15.77:0/3302726202 wait complete. 2024-04-25T02:12:37.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.651+0000 7f3b66ad2700 1 Processor -- start 2024-04-25T02:12:37.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.651+0000 7f3b66ad2700 1 -- start start 2024-04-25T02:12:37.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.652+0000 7f3b66ad2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b60102de0 0x7f3b60070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:37.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.652+0000 7f3b66ad2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b60103780 0x7f3b600707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:37.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.652+0000 7f3b66ad2700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b600721b0 con 0x7f3b60102de0 2024-04-25T02:12:37.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.652+0000 7f3b66ad2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b60070ce0 con 0x7f3b60103780 2024-04-25T02:12:37.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.652+0000 7f3b6486e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b60102de0 0x7f3b60070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:37.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.652+0000 7f3b6486e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b60102de0 0x7f3b60070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45012/0 (socket says 172.21.15.77:45012) 2024-04-25T02:12:37.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.652+0000 7f3b6486e700 1 -- 172.21.15.77:0/4164713437 learned_addr learned my addr 172.21.15.77:0/4164713437 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:12:37.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.652+0000 7f3b5ffff700 1 --2- 172.21.15.77:0/4164713437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b60103780 0x7f3b600707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:37.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.652+0000 7f3b6486e700 1 -- 172.21.15.77:0/4164713437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b60103780 msgr2=0x7f3b600707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:37.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.652+0000 7f3b6486e700 1 --2- 172.21.15.77:0/4164713437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b60103780 0x7f3b600707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.652+0000 7f3b6486e700 1 -- 172.21.15.77:0/4164713437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4c005040 con 0x7f3b60102de0 2024-04-25T02:12:37.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.652+0000 7f3b6486e700 1 --2- 172.21.15.77:0/4164713437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b60102de0 0x7f3b60070260 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3b5400c830 tx=0x7f3b54004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:37.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.653+0000 7f3b5d7fa700 1 -- 172.21.15.77:0/4164713437 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b540106f0 con 0x7f3b60102de0 2024-04-25T02:12:37.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.653+0000 7f3b5d7fa700 1 -- 172.21.15.77:0/4164713437 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b54010d20 con 0x7f3b60102de0 2024-04-25T02:12:37.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.653+0000 7f3b66ad2700 1 -- 172.21.15.77:0/4164713437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b60070fc0 con 0x7f3b60102de0 2024-04-25T02:12:37.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.653+0000 7f3b5d7fa700 1 -- 172.21.15.77:0/4164713437 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b540113a0 con 0x7f3b60102de0 2024-04-25T02:12:37.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.653+0000 7f3b66ad2700 1 -- 172.21.15.77:0/4164713437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b6011a140 con 0x7f3b60102de0 2024-04-25T02:12:37.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.654+0000 7f3b66ad2700 1 -- 172.21.15.77:0/4164713437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b600fe530 con 0x7f3b60102de0 2024-04-25T02:12:37.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.654+0000 7f3b5d7fa700 1 -- 172.21.15.77:0/4164713437 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 34) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f3b54012400 con 0x7f3b60102de0 2024-04-25T02:12:37.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.655+0000 7f3b5d7fa700 1 --2- 172.21.15.77:0/4164713437 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f3b5006da40 0x7f3b5006fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:37.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.655+0000 7f3b5ffff700 1 --2- 172.21.15.77:0/4164713437 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f3b5006da40 0x7f3b5006fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:37.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.655+0000 7f3b5d7fa700 1 -- 172.21.15.77:0/4164713437 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f3b5408d050 con 0x7f3b60102de0 2024-04-25T02:12:37.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.655+0000 7f3b5ffff700 1 --2- 172.21.15.77:0/4164713437 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f3b5006da40 0x7f3b5006fef0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3b60071990 tx=0x7f3b4c009e30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:37.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.659+0000 7f3b5d7fa700 1 -- 172.21.15.77:0/4164713437 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f3b54056d40 con 0x7f3b60102de0 2024-04-25T02:12:37.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.941+0000 7f3b66ad2700 1 -- 172.21.15.77:0/4164713437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3b6011a440 con 0x7f3b60102de0 2024-04-25T02:12:37.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.942+0000 7f3b5d7fa700 1 -- 172.21.15.77:0/4164713437 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f3b5405a400 con 0x7f3b60102de0 2024-04-25T02:12:37.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.944+0000 7f3b66ad2700 1 -- 172.21.15.77:0/4164713437 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f3b5006da40 msgr2=0x7f3b5006fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:37.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.944+0000 7f3b66ad2700 1 --2- 172.21.15.77:0/4164713437 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f3b5006da40 0x7f3b5006fef0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3b60071990 tx=0x7f3b4c009e30 comp rx=0 tx=0).stop 2024-04-25T02:12:37.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.944+0000 7f3b66ad2700 1 -- 172.21.15.77:0/4164713437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b60102de0 msgr2=0x7f3b60070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:37.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.944+0000 7f3b66ad2700 1 --2- 172.21.15.77:0/4164713437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b60102de0 0x7f3b60070260 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3b5400c830 tx=0x7f3b54004470 comp rx=0 tx=0).stop 2024-04-25T02:12:37.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.944+0000 7f3b66ad2700 1 -- 172.21.15.77:0/4164713437 shutdown_connections 2024-04-25T02:12:37.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.944+0000 7f3b66ad2700 1 --2- 172.21.15.77:0/4164713437 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f3b5006da40 0x7f3b5006fef0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.944+0000 7f3b66ad2700 1 --2- 172.21.15.77:0/4164713437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b60102de0 0x7f3b60070260 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.944+0000 7f3b66ad2700 1 --2- 172.21.15.77:0/4164713437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b60103780 0x7f3b600707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.944+0000 7f3b66ad2700 1 -- 172.21.15.77:0/4164713437 >> 172.21.15.77:0/4164713437 conn(0x7f3b600f8990 msgr2=0x7f3b600f9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:37.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.944+0000 7f3b66ad2700 1 -- 172.21.15.77:0/4164713437 shutdown_connections 2024-04-25T02:12:37.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:37.944+0000 7f3b66ad2700 1 -- 172.21.15.77:0/4164713437 wait complete. 2024-04-25T02:12:37.962 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-04-25T02:12:38.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:37 smithi112 ceph-mon[33313]: pgmap v74: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:38.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:37 smithi077 ceph-mon[26330]: pgmap v74: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:38.604 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -e sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-04-25T02:12:38.870 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:12:38.877 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:38 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/4164713437' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:39.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:38 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/4164713437' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:39.904 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:39 smithi077 ceph-mon[26330]: pgmap v75: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:40.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:39 smithi112 ceph-mon[33313]: pgmap v75: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:40.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.397+0000 7fc114a39700 1 -- 172.21.15.77:0/373624269 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc110101e20 msgr2=0x7fc1101021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:40.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.397+0000 7fc114a39700 1 --2- 172.21.15.77:0/373624269 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc110101e20 0x7fc1101021f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc104004940 tx=0x7fc104009e30 comp rx=0 tx=0).stop 2024-04-25T02:12:40.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.397+0000 7fc114a39700 1 -- 172.21.15.77:0/373624269 shutdown_connections 2024-04-25T02:12:40.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.397+0000 7fc114a39700 1 --2- 172.21.15.77:0/373624269 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1100fc710 0x7fc1100fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:40.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.397+0000 7fc114a39700 1 --2- 172.21.15.77:0/373624269 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc110101e20 0x7fc1101021f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:40.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.397+0000 7fc114a39700 1 -- 172.21.15.77:0/373624269 >> 172.21.15.77:0/373624269 conn(0x7fc110071460 msgr2=0x7fc110071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:40.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.397+0000 7fc114a39700 1 -- 172.21.15.77:0/373624269 shutdown_connections 2024-04-25T02:12:40.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.397+0000 7fc114a39700 1 -- 172.21.15.77:0/373624269 wait complete. 2024-04-25T02:12:40.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.398+0000 7fc114a39700 1 Processor -- start 2024-04-25T02:12:40.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.398+0000 7fc114a39700 1 -- start start 2024-04-25T02:12:40.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.398+0000 7fc114a39700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1100fc710 0x7fc11010ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:40.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.398+0000 7fc114a39700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc110101e20 0x7fc11010f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:40.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.398+0000 7fc114a39700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11010f830 con 0x7fc1100fc710 2024-04-25T02:12:40.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.398+0000 7fc114a39700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11010f970 con 0x7fc110101e20 2024-04-25T02:12:40.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.398+0000 7fc10e59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1100fc710 0x7fc11010ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:40.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.398+0000 7fc10e59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1100fc710 0x7fc11010ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45032/0 (socket says 172.21.15.77:45032) 2024-04-25T02:12:40.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.398+0000 7fc10e59c700 1 -- 172.21.15.77:0/3349509077 learned_addr learned my addr 172.21.15.77:0/3349509077 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:12:40.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.398+0000 7fc10dd9b700 1 --2- 172.21.15.77:0/3349509077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc110101e20 0x7fc11010f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:40.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.398+0000 7fc10e59c700 1 -- 172.21.15.77:0/3349509077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc110101e20 msgr2=0x7fc11010f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:40.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.398+0000 7fc10e59c700 1 --2- 172.21.15.77:0/3349509077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc110101e20 0x7fc11010f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:40.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.398+0000 7fc10e59c700 1 -- 172.21.15.77:0/3349509077 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc104005040 con 0x7fc1100fc710 2024-04-25T02:12:40.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.398+0000 7fc10dd9b700 1 --2- 172.21.15.77:0/3349509077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc110101e20 0x7fc11010f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:40.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.398+0000 7fc10e59c700 1 --2- 172.21.15.77:0/3349509077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1100fc710 0x7fc11010ed20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc10400b3b0 tx=0x7fc104009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:40.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.399+0000 7fc0feffd700 1 -- 172.21.15.77:0/3349509077 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc10400e040 con 0x7fc1100fc710 2024-04-25T02:12:40.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.399+0000 7fc0feffd700 1 -- 172.21.15.77:0/3349509077 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc10400bbc0 con 0x7fc1100fc710 2024-04-25T02:12:40.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.399+0000 7fc114a39700 1 -- 172.21.15.77:0/3349509077 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc110117c30 con 0x7fc1100fc710 2024-04-25T02:12:40.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.399+0000 7fc0feffd700 1 -- 172.21.15.77:0/3349509077 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc10401c3f0 con 0x7fc1100fc710 2024-04-25T02:12:40.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.399+0000 7fc114a39700 1 -- 172.21.15.77:0/3349509077 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc110118140 con 0x7fc1100fc710 2024-04-25T02:12:40.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.399+0000 7fc114a39700 1 -- 172.21.15.77:0/3349509077 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc110104260 con 0x7fc1100fc710 2024-04-25T02:12:40.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.400+0000 7fc0feffd700 1 -- 172.21.15.77:0/3349509077 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 34) v1 ==== 91925+0+0 (secure 0 0 0) 0x7fc10400bd30 con 0x7fc1100fc710 2024-04-25T02:12:40.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.400+0000 7fc0feffd700 1 --2- 172.21.15.77:0/3349509077 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fc0f806da40 0x7fc0f806fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:40.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.401+0000 7fc0feffd700 1 -- 172.21.15.77:0/3349509077 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fc10408e410 con 0x7fc1100fc710 2024-04-25T02:12:40.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.401+0000 7fc10dd9b700 1 --2- 172.21.15.77:0/3349509077 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fc0f806da40 0x7fc0f806fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:40.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.401+0000 7fc10dd9b700 1 --2- 172.21.15.77:0/3349509077 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fc0f806da40 0x7fc0f806fef0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc100006fd0 tx=0x7fc100008040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:40.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.405+0000 7fc0feffd700 1 -- 172.21.15.77:0/3349509077 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7fc104057fe0 con 0x7fc1100fc710 2024-04-25T02:12:40.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.684+0000 7fc114a39700 1 -- 172.21.15.77:0/3349509077 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc110108f90 con 0x7fc1100fc710 2024-04-25T02:12:40.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.685+0000 7fc0feffd700 1 -- 172.21.15.77:0/3349509077 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7fc10405b6a0 con 0x7fc1100fc710 2024-04-25T02:12:40.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.687+0000 7fc114a39700 1 -- 172.21.15.77:0/3349509077 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fc0f806da40 msgr2=0x7fc0f806fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:40.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.687+0000 7fc114a39700 1 --2- 172.21.15.77:0/3349509077 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fc0f806da40 0x7fc0f806fef0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc100006fd0 tx=0x7fc100008040 comp rx=0 tx=0).stop 2024-04-25T02:12:40.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.687+0000 7fc114a39700 1 -- 172.21.15.77:0/3349509077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1100fc710 msgr2=0x7fc11010ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:40.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.687+0000 7fc114a39700 1 --2- 172.21.15.77:0/3349509077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1100fc710 0x7fc11010ed20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc10400b3b0 tx=0x7fc104009e30 comp rx=0 tx=0).stop 2024-04-25T02:12:40.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.687+0000 7fc114a39700 1 -- 172.21.15.77:0/3349509077 shutdown_connections 2024-04-25T02:12:40.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.687+0000 7fc114a39700 1 --2- 172.21.15.77:0/3349509077 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fc0f806da40 0x7fc0f806fef0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:40.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.687+0000 7fc114a39700 1 --2- 172.21.15.77:0/3349509077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1100fc710 0x7fc11010ed20 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:40.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.687+0000 7fc114a39700 1 --2- 172.21.15.77:0/3349509077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc110101e20 0x7fc11010f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:40.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.687+0000 7fc114a39700 1 -- 172.21.15.77:0/3349509077 >> 172.21.15.77:0/3349509077 conn(0x7fc110071460 msgr2=0x7fc1100f9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:40.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.687+0000 7fc114a39700 1 -- 172.21.15.77:0/3349509077 shutdown_connections 2024-04-25T02:12:40.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:40.687+0000 7fc114a39700 1 -- 172.21.15.77:0/3349509077 wait complete. 2024-04-25T02:12:40.704 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)" 2024-04-25T02:12:40.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:40 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/3349509077' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:41.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:40 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/3349509077' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:41.338 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -e sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-04-25T02:12:41.592 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:12:41.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:41 smithi077 ceph-mon[26330]: pgmap v76: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:42.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:41 smithi112 ceph-mon[33313]: pgmap v76: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:43.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.245+0000 7f3be681f700 1 -- 172.21.15.77:0/3544562015 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3be0103780 msgr2=0x7f3be00fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:43.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.245+0000 7f3be681f700 1 --2- 172.21.15.77:0/3544562015 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3be0103780 0x7f3be00fcdf0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4004940 tx=0x7f3bd4009e30 comp rx=0 tx=0).stop 2024-04-25T02:12:43.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.245+0000 7f3be681f700 1 -- 172.21.15.77:0/3544562015 shutdown_connections 2024-04-25T02:12:43.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.245+0000 7f3be681f700 1 --2- 172.21.15.77:0/3544562015 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3be0103780 0x7f3be00fcdf0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:43.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.245+0000 7f3be681f700 1 --2- 172.21.15.77:0/3544562015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3be0102de0 0x7f3be01031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:43.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.245+0000 7f3be681f700 1 -- 172.21.15.77:0/3544562015 >> 172.21.15.77:0/3544562015 conn(0x7f3be00f8990 msgr2=0x7f3be00fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:43.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.245+0000 7f3be681f700 1 -- 172.21.15.77:0/3544562015 shutdown_connections 2024-04-25T02:12:43.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.245+0000 7f3be681f700 1 -- 172.21.15.77:0/3544562015 wait complete. 2024-04-25T02:12:43.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.246+0000 7f3be681f700 1 Processor -- start 2024-04-25T02:12:43.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.246+0000 7f3be681f700 1 -- start start 2024-04-25T02:12:43.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.246+0000 7f3be681f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3be0102de0 0x7f3be0070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:43.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.246+0000 7f3be681f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3be0103780 0x7f3be00707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:43.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.246+0000 7f3be681f700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be00721f0 con 0x7f3be0102de0 2024-04-25T02:12:43.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.246+0000 7f3be681f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be0070ce0 con 0x7f3be0103780 2024-04-25T02:12:43.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.246+0000 7f3bdffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3be0102de0 0x7f3be0070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:43.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.246+0000 7f3bdffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3be0102de0 0x7f3be0070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45054/0 (socket says 172.21.15.77:45054) 2024-04-25T02:12:43.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.246+0000 7f3bdffff700 1 -- 172.21.15.77:0/107956946 learned_addr learned my addr 172.21.15.77:0/107956946 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:12:43.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.246+0000 7f3bdf7fe700 1 --2- 172.21.15.77:0/107956946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3be0103780 0x7f3be00707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:43.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.246+0000 7f3bdffff700 1 -- 172.21.15.77:0/107956946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3be0103780 msgr2=0x7f3be00707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:43.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.246+0000 7f3bdffff700 1 --2- 172.21.15.77:0/107956946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3be0103780 0x7f3be00707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:43.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.246+0000 7f3bdffff700 1 -- 172.21.15.77:0/107956946 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd4005040 con 0x7f3be0102de0 2024-04-25T02:12:43.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.247+0000 7f3bdffff700 1 --2- 172.21.15.77:0/107956946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3be0102de0 0x7f3be0070260 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3bd000b790 tx=0x7f3bd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:43.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.247+0000 7f3bdcff9700 1 -- 172.21.15.77:0/107956946 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bd000f770 con 0x7f3be0102de0 2024-04-25T02:12:43.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.247+0000 7f3be681f700 1 -- 172.21.15.77:0/107956946 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be0070fc0 con 0x7f3be0102de0 2024-04-25T02:12:43.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.247+0000 7f3bdcff9700 1 -- 172.21.15.77:0/107956946 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3bd000fda0 con 0x7f3be0102de0 2024-04-25T02:12:43.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.247+0000 7f3bdcff9700 1 -- 172.21.15.77:0/107956946 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bd000d310 con 0x7f3be0102de0 2024-04-25T02:12:43.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.247+0000 7f3be681f700 1 -- 172.21.15.77:0/107956946 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be011a1d0 con 0x7f3be0102de0 2024-04-25T02:12:43.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.248+0000 7f3be681f700 1 -- 172.21.15.77:0/107956946 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be01000f0 con 0x7f3be0102de0 2024-04-25T02:12:43.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.248+0000 7f3bdcff9700 1 -- 172.21.15.77:0/107956946 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 34) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f3bd0010420 con 0x7f3be0102de0 2024-04-25T02:12:43.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.249+0000 7f3bdcff9700 1 --2- 172.21.15.77:0/107956946 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f3bc806da40 0x7f3bc806fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:43.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.249+0000 7f3bdcff9700 1 -- 172.21.15.77:0/107956946 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f3bd008d1f0 con 0x7f3be0102de0 2024-04-25T02:12:43.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.249+0000 7f3bdf7fe700 1 --2- 172.21.15.77:0/107956946 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f3bc806da40 0x7f3bc806fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:43.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.249+0000 7f3bdf7fe700 1 --2- 172.21.15.77:0/107956946 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f3bc806da40 0x7f3bc806fef0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3bd400b3b0 tx=0x7f3bd4009e30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:43.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.253+0000 7f3bdcff9700 1 -- 172.21.15.77:0/107956946 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f3bd0056e40 con 0x7f3be0102de0 2024-04-25T02:12:43.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.535+0000 7f3be681f700 1 -- 172.21.15.77:0/107956946 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3be00fe530 con 0x7f3be0102de0 2024-04-25T02:12:43.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.535+0000 7f3bdcff9700 1 -- 172.21.15.77:0/107956946 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f3bd005a500 con 0x7f3be0102de0 2024-04-25T02:12:43.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.537+0000 7f3be681f700 1 -- 172.21.15.77:0/107956946 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f3bc806da40 msgr2=0x7f3bc806fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:43.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.537+0000 7f3be681f700 1 --2- 172.21.15.77:0/107956946 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f3bc806da40 0x7f3bc806fef0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3bd400b3b0 tx=0x7f3bd4009e30 comp rx=0 tx=0).stop 2024-04-25T02:12:43.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.537+0000 7f3be681f700 1 -- 172.21.15.77:0/107956946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3be0102de0 msgr2=0x7f3be0070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:43.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.537+0000 7f3be681f700 1 --2- 172.21.15.77:0/107956946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3be0102de0 0x7f3be0070260 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3bd000b790 tx=0x7f3bd0009250 comp rx=0 tx=0).stop 2024-04-25T02:12:43.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.537+0000 7f3be681f700 1 -- 172.21.15.77:0/107956946 shutdown_connections 2024-04-25T02:12:43.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.537+0000 7f3be681f700 1 --2- 172.21.15.77:0/107956946 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f3bc806da40 0x7f3bc806fef0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:43.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.537+0000 7f3be681f700 1 --2- 172.21.15.77:0/107956946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3be0102de0 0x7f3be0070260 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:43.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.537+0000 7f3be681f700 1 --2- 172.21.15.77:0/107956946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3be0103780 0x7f3be00707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:43.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.537+0000 7f3be681f700 1 -- 172.21.15.77:0/107956946 >> 172.21.15.77:0/107956946 conn(0x7f3be00f8990 msgr2=0x7f3be0107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:43.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.537+0000 7f3be681f700 1 -- 172.21.15.77:0/107956946 shutdown_connections 2024-04-25T02:12:43.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:43.537+0000 7f3be681f700 1 -- 172.21.15.77:0/107956946 wait complete. 2024-04-25T02:12:43.555 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-04-25T02:12:43.869 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:43 smithi077 ceph-mon[26330]: pgmap v77: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:43.869 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:43 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/107956946' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:44.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:43 smithi112 ceph-mon[33313]: pgmap v77: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:44.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:43 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/107956946' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:12:44.189 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -e sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-04-25T02:12:44.443 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:12:44.818 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:44 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:12:45.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:44 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:12:45.954 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:45 smithi077 ceph-mon[26330]: pgmap v78: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:46.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.158+0000 7f83bc3a3700 1 -- 172.21.15.77:0/999166148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83b4102de0 msgr2=0x7f83b41031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:46.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.158+0000 7f83bc3a3700 1 --2- 172.21.15.77:0/999166148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83b4102de0 0x7f83b41031b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009ce0 tx=0x7f83b0004d10 comp rx=0 tx=0).stop 2024-04-25T02:12:46.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.158+0000 7f83bc3a3700 1 -- 172.21.15.77:0/999166148 shutdown_connections 2024-04-25T02:12:46.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.158+0000 7f83bc3a3700 1 --2- 172.21.15.77:0/999166148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83b4103780 0x7f83b40fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:46.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.158+0000 7f83bc3a3700 1 --2- 172.21.15.77:0/999166148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83b4102de0 0x7f83b41031b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:46.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.158+0000 7f83bc3a3700 1 -- 172.21.15.77:0/999166148 >> 172.21.15.77:0/999166148 conn(0x7f83b40f8950 msgr2=0x7f83b40fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:46.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.158+0000 7f83bc3a3700 1 -- 172.21.15.77:0/999166148 shutdown_connections 2024-04-25T02:12:46.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.158+0000 7f83bc3a3700 1 -- 172.21.15.77:0/999166148 wait complete. 2024-04-25T02:12:46.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.159+0000 7f83bc3a3700 1 Processor -- start 2024-04-25T02:12:46.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.159+0000 7f83bc3a3700 1 -- start start 2024-04-25T02:12:46.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.159+0000 7f83bc3a3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83b4102de0 0x7f83b4113d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:46.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.159+0000 7f83bc3a3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83b4103780 0x7f83b4114250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:46.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.159+0000 7f83bc3a3700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b41148a0 con 0x7f83b4103780 2024-04-25T02:12:46.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.159+0000 7f83bc3a3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b410dc70 con 0x7f83b4102de0 2024-04-25T02:12:46.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.159+0000 7f83b993e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83b4103780 0x7f83b4114250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:46.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.159+0000 7f83b993e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83b4103780 0x7f83b4114250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45082/0 (socket says 172.21.15.77:45082) 2024-04-25T02:12:46.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.159+0000 7f83b993e700 1 -- 172.21.15.77:0/1550230702 learned_addr learned my addr 172.21.15.77:0/1550230702 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:12:46.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.159+0000 7f83b993e700 1 -- 172.21.15.77:0/1550230702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83b4102de0 msgr2=0x7f83b4113d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:46.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.159+0000 7f83b993e700 1 --2- 172.21.15.77:0/1550230702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83b4102de0 0x7f83b4113d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:46.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.159+0000 7f83b993e700 1 -- 172.21.15.77:0/1550230702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b0009940 con 0x7f83b4103780 2024-04-25T02:12:46.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.159+0000 7f83b993e700 1 --2- 172.21.15.77:0/1550230702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83b4103780 0x7f83b4114250 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f83a400c7e0 tx=0x7f83a4007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:46.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.159+0000 7f83aaffd700 1 -- 172.21.15.77:0/1550230702 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83a4012810 con 0x7f83b4103780 2024-04-25T02:12:46.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.159+0000 7f83aaffd700 1 -- 172.21.15.77:0/1550230702 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f83a4012e40 con 0x7f83b4103780 2024-04-25T02:12:46.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.159+0000 7f83aaffd700 1 -- 172.21.15.77:0/1550230702 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83a400a550 con 0x7f83b4103780 2024-04-25T02:12:46.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.160+0000 7f83bc3a3700 1 -- 172.21.15.77:0/1550230702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b410df50 con 0x7f83b4103780 2024-04-25T02:12:46.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.160+0000 7f83bc3a3700 1 -- 172.21.15.77:0/1550230702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b410e510 con 0x7f83b4103780 2024-04-25T02:12:46.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.161+0000 7f83bc3a3700 1 -- 172.21.15.77:0/1550230702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b41000f0 con 0x7f83b4103780 2024-04-25T02:12:46.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.161+0000 7f83aaffd700 1 -- 172.21.15.77:0/1550230702 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 34) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f83a4011380 con 0x7f83b4103780 2024-04-25T02:12:46.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.161+0000 7f83aaffd700 1 --2- 172.21.15.77:0/1550230702 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f83a006da40 0x7f83a006fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:46.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.161+0000 7f83aaffd700 1 -- 172.21.15.77:0/1550230702 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f83a408d550 con 0x7f83b4103780 2024-04-25T02:12:46.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.161+0000 7f83ba13f700 1 --2- 172.21.15.77:0/1550230702 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f83a006da40 0x7f83a006fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:46.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.162+0000 7f83ba13f700 1 --2- 172.21.15.77:0/1550230702 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f83a006da40 0x7f83a006fef0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009cb0 tx=0x7f83b0004d10 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:46.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.166+0000 7f83aaffd700 1 -- 172.21.15.77:0/1550230702 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f83a405acd0 con 0x7f83b4103780 2024-04-25T02:12:46.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:45 smithi112 ceph-mon[33313]: pgmap v78: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:46.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:46.379+0000 7f83bc3a3700 1 -- 172.21.15.77:0/1550230702 --> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551", "target": ["mon-mgr", ""]}) v1 -- 0x7f83b410f3d0 con 0x7f83a006da40 2024-04-25T02:12:47.972 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:47 smithi077 ceph-mon[26330]: from='client.14798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:12:47.972 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:47 smithi077 ceph-mon[26330]: pgmap v79: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:48.081 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:47 smithi112 ceph-mon[33313]: from='client.14798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:12:48.082 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:47 smithi112 ceph-mon[33313]: pgmap v79: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:48.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:48.501+0000 7f83aaffd700 1 -- 172.21.15.77:0/1550230702 <== mgr.14668 v2:172.21.15.77:6800/799251145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5092 (secure 0 0 0) 0x7f83b410f3d0 con 0x7f83a006da40 2024-04-25T02:12:48.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:48.503+0000 7f83bc3a3700 1 -- 172.21.15.77:0/1550230702 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f83a006da40 msgr2=0x7f83a006fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:48.503+0000 7f83bc3a3700 1 --2- 172.21.15.77:0/1550230702 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f83a006da40 0x7f83a006fef0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009cb0 tx=0x7f83b0004d10 comp rx=0 tx=0).stop 2024-04-25T02:12:48.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:48.503+0000 7f83bc3a3700 1 -- 172.21.15.77:0/1550230702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83b4103780 msgr2=0x7f83b4114250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:48.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:48.503+0000 7f83bc3a3700 1 --2- 172.21.15.77:0/1550230702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83b4103780 0x7f83b4114250 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f83a400c7e0 tx=0x7f83a4007f90 comp rx=0 tx=0).stop 2024-04-25T02:12:48.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:48.503+0000 7f83bc3a3700 1 -- 172.21.15.77:0/1550230702 shutdown_connections 2024-04-25T02:12:48.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:48.503+0000 7f83bc3a3700 1 --2- 172.21.15.77:0/1550230702 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f83a006da40 0x7f83a006fef0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:48.503+0000 7f83bc3a3700 1 --2- 172.21.15.77:0/1550230702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83b4102de0 0x7f83b4113d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:48.503+0000 7f83bc3a3700 1 --2- 172.21.15.77:0/1550230702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83b4103780 0x7f83b4114250 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:48.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:48.503+0000 7f83bc3a3700 1 -- 172.21.15.77:0/1550230702 >> 172.21.15.77:0/1550230702 conn(0x7f83b40f8950 msgr2=0x7f83b41073d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:48.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:48.503+0000 7f83bc3a3700 1 -- 172.21.15.77:0/1550230702 shutdown_connections 2024-04-25T02:12:48.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:48.503+0000 7f83bc3a3700 1 -- 172.21.15.77:0/1550230702 wait complete. 2024-04-25T02:12:48.519 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-04-25T02:12:49.088 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -e sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 -- bash -c 'ceph orch ps' 2024-04-25T02:12:49.341 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:12:50.113 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:49 smithi077 ceph-mon[26330]: pgmap v80: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:50.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:49 smithi112 ceph-mon[33313]: pgmap v80: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:50.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.917+0000 7f6c5ea9f700 1 -- 172.21.15.77:0/3674540126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c580fb5c0 msgr2=0x7f6c580fb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:50.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.917+0000 7f6c5ea9f700 1 --2- 172.21.15.77:0/3674540126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c580fb5c0 0x7f6c580fb990 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c004940 tx=0x7f6c4c009e30 comp rx=0 tx=0).stop 2024-04-25T02:12:50.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.917+0000 7f6c5ea9f700 1 -- 172.21.15.77:0/3674540126 shutdown_connections 2024-04-25T02:12:50.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.917+0000 7f6c5ea9f700 1 --2- 172.21.15.77:0/3674540126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c580fbf60 0x7f6c58101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:50.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.917+0000 7f6c5ea9f700 1 --2- 172.21.15.77:0/3674540126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c580fb5c0 0x7f6c580fb990 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:50.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.917+0000 7f6c5ea9f700 1 -- 172.21.15.77:0/3674540126 >> 172.21.15.77:0/3674540126 conn(0x7f6c58073350 msgr2=0x7f6c58073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:50.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.917+0000 7f6c5ea9f700 1 -- 172.21.15.77:0/3674540126 shutdown_connections 2024-04-25T02:12:50.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.917+0000 7f6c5ea9f700 1 -- 172.21.15.77:0/3674540126 wait complete. 2024-04-25T02:12:50.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.918+0000 7f6c5ea9f700 1 Processor -- start 2024-04-25T02:12:50.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.918+0000 7f6c5ea9f700 1 -- start start 2024-04-25T02:12:50.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.918+0000 7f6c5ea9f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c580fb5c0 0x7f6c580fc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:50.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.918+0000 7f6c5ea9f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c580fbf60 0x7f6c580fca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:50.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.918+0000 7f6c5ea9f700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c580fe530 con 0x7f6c580fb5c0 2024-04-25T02:12:50.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.918+0000 7f6c5ea9f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c580fd000 con 0x7f6c580fbf60 2024-04-25T02:12:50.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.918+0000 7f6c5c83b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c580fb5c0 0x7f6c580fc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:50.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.918+0000 7f6c5c83b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c580fb5c0 0x7f6c580fc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43658/0 (socket says 172.21.15.77:43658) 2024-04-25T02:12:50.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.918+0000 7f6c5c83b700 1 -- 172.21.15.77:0/3345762405 learned_addr learned my addr 172.21.15.77:0/3345762405 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:12:50.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.918+0000 7f6c57fff700 1 --2- 172.21.15.77:0/3345762405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c580fbf60 0x7f6c580fca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:50.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.918+0000 7f6c5c83b700 1 -- 172.21.15.77:0/3345762405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c580fbf60 msgr2=0x7f6c580fca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:50.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.918+0000 7f6c5c83b700 1 --2- 172.21.15.77:0/3345762405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c580fbf60 0x7f6c580fca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:50.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.918+0000 7f6c5c83b700 1 -- 172.21.15.77:0/3345762405 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c005040 con 0x7f6c580fb5c0 2024-04-25T02:12:50.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.918+0000 7f6c5c83b700 1 --2- 172.21.15.77:0/3345762405 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c580fb5c0 0x7f6c580fc550 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c00b3b0 tx=0x7f6c4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:50.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.919+0000 7f6c557fa700 1 -- 172.21.15.77:0/3345762405 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c4c00e030 con 0x7f6c580fb5c0 2024-04-25T02:12:50.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.919+0000 7f6c557fa700 1 -- 172.21.15.77:0/3345762405 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6c4c00bde0 con 0x7f6c580fb5c0 2024-04-25T02:12:50.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.919+0000 7f6c557fa700 1 -- 172.21.15.77:0/3345762405 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c4c013e50 con 0x7f6c580fb5c0 2024-04-25T02:12:50.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.919+0000 7f6c5ea9f700 1 -- 172.21.15.77:0/3345762405 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c580fd280 con 0x7f6c580fb5c0 2024-04-25T02:12:50.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.919+0000 7f6c5ea9f700 1 -- 172.21.15.77:0/3345762405 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c5811a1a0 con 0x7f6c580fb5c0 2024-04-25T02:12:50.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.920+0000 7f6c5ea9f700 1 -- 172.21.15.77:0/3345762405 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c580fe690 con 0x7f6c580fb5c0 2024-04-25T02:12:50.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.920+0000 7f6c557fa700 1 -- 172.21.15.77:0/3345762405 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 34) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f6c4c0136b0 con 0x7f6c580fb5c0 2024-04-25T02:12:50.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.921+0000 7f6c557fa700 1 --2- 172.21.15.77:0/3345762405 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f6c4806d9e0 0x7f6c4806fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:50.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.921+0000 7f6c557fa700 1 -- 172.21.15.77:0/3345762405 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f6c4c08e860 con 0x7f6c580fb5c0 2024-04-25T02:12:50.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.921+0000 7f6c57fff700 1 --2- 172.21.15.77:0/3345762405 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f6c4806d9e0 0x7f6c4806fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:50.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.921+0000 7f6c57fff700 1 --2- 172.21.15.77:0/3345762405 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f6c4806d9e0 0x7f6c4806fe90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6c44006fd0 tx=0x7f6c44008040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:50.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:50.925+0000 7f6c557fa700 1 -- 172.21.15.77:0/3345762405 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f6c4c0584b0 con 0x7f6c580fb5c0 2024-04-25T02:12:51.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:51.133+0000 7f6c5ea9f700 1 -- 172.21.15.77:0/3345762405 --> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c580f9450 con 0x7f6c4806d9e0 2024-04-25T02:12:51.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:51.143+0000 7f6c557fa700 1 -- 172.21.15.77:0/3345762405 <== mgr.14668 v2:172.21.15.77:6800/799251145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f6c580f9450 con 0x7f6c4806d9e0 2024-04-25T02:12:51.150 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T02:12:51.150 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (61s) 39s ago 11m 17.0M - 0.25.0 c8568f914cd2 699c7fd25ea5 2024-04-25T02:12:51.150 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (12m) 39s ago 12m 6665k - 17.2.7-902-gc61472c8 0de407c1b3af 2ad2e3d2b09e 2024-04-25T02:12:51.150 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi112 smithi112 running (11m) 93s ago 11m 6660k - 17.2.7-902-gc61472c8 0de407c1b3af 9235dc5eb15d 2024-04-25T02:12:51.150 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (44s) 39s ago 11m 52.7M - 9.4.12 2bacad6d85d8 900138b0bcf0 2024-04-25T02:12:51.150 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.gcfygj smithi077 running (6m) 39s ago 6m 14.4M - 17.2.7-902-gc61472c8 0de407c1b3af 382dd7abf674 2024-04-25T02:12:51.150 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.oadrkb smithi077 running (6m) 39s ago 6m 12.8M - 17.2.7-902-gc61472c8 0de407c1b3af 6992064a4b2a 2024-04-25T02:12:51.151 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.dvwudt smithi112 running (6m) 93s ago 6m 158M - 17.2.7-902-gc61472c8 0de407c1b3af 0792e451abfd 2024-04-25T02:12:51.151 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.fjnadi smithi112 running (6m) 93s ago 6m 13.9M - 17.2.7-902-gc61472c8 0de407c1b3af c8093f622f6b 2024-04-25T02:12:51.151 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.zpflzp smithi077 *:8443,9283,8765 running (2m) 39s ago 13m 507M - 19.0.0-2445-gd2c45d97 f68e37b807ef a1af92e027e5 2024-04-25T02:12:51.151 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi112.cswrxs smithi112 *:8443,9283,8765 running (113s) 93s ago 11m 449M - 19.0.0-2445-gd2c45d97 f68e37b807ef ccc7c57d35f2 2024-04-25T02:12:51.151 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (13m) 39s ago 13m 55.5M 2048M 17.2.7-902-gc61472c8 0de407c1b3af adb57965a306 2024-04-25T02:12:51.151 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi112 smithi112 running (10m) 93s ago 10m 40.8M 2048M 17.2.7-902-gc61472c8 0de407c1b3af db2fb9b09789 2024-04-25T02:12:51.151 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (100s) 39s ago 12m 11.1M - 1.5.0 0da6a335fe13 2320132606fc 2024-04-25T02:12:51.151 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi112 smithi112 *:9100 running (96s) 93s ago 11m 3359k - 1.5.0 0da6a335fe13 49f285354791 2024-04-25T02:12:51.151 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (10m) 39s ago 10m 258M 1557M 17.2.7-902-gc61472c8 0de407c1b3af c741abec3b94 2024-04-25T02:12:51.151 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (9m) 39s ago 9m 258M 1557M 17.2.7-902-gc61472c8 0de407c1b3af 256ff3ced322 2024-04-25T02:12:51.151 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (9m) 39s ago 9m 221M 1557M 17.2.7-902-gc61472c8 0de407c1b3af c5d7d8c993f4 2024-04-25T02:12:51.151 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi112 running (8m) 93s ago 8m 288M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 68429d0dbf88 2024-04-25T02:12:51.151 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi112 running (8m) 93s ago 8m 258M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 66eb71201444 2024-04-25T02:12:51.151 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi112 running (8m) 93s ago 8m 236M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 963e700d6aea 2024-04-25T02:12:51.152 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (78s) 39s ago 11m 41.9M - 2.43.0 a07b618ecd1d c5b8c6104d96 2024-04-25T02:12:51.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:51.145+0000 7f6c5ea9f700 1 -- 172.21.15.77:0/3345762405 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f6c4806d9e0 msgr2=0x7f6c4806fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:51.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:51.145+0000 7f6c5ea9f700 1 --2- 172.21.15.77:0/3345762405 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f6c4806d9e0 0x7f6c4806fe90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6c44006fd0 tx=0x7f6c44008040 comp rx=0 tx=0).stop 2024-04-25T02:12:51.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:51.145+0000 7f6c5ea9f700 1 -- 172.21.15.77:0/3345762405 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c580fb5c0 msgr2=0x7f6c580fc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:51.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:51.145+0000 7f6c5ea9f700 1 --2- 172.21.15.77:0/3345762405 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c580fb5c0 0x7f6c580fc550 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c00b3b0 tx=0x7f6c4c009e30 comp rx=0 tx=0).stop 2024-04-25T02:12:51.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:51.145+0000 7f6c5ea9f700 1 -- 172.21.15.77:0/3345762405 shutdown_connections 2024-04-25T02:12:51.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:51.145+0000 7f6c5ea9f700 1 --2- 172.21.15.77:0/3345762405 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f6c4806d9e0 0x7f6c4806fe90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:51.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:51.145+0000 7f6c5ea9f700 1 --2- 172.21.15.77:0/3345762405 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c580fb5c0 0x7f6c580fc550 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:51.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:51.145+0000 7f6c5ea9f700 1 --2- 172.21.15.77:0/3345762405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c580fbf60 0x7f6c580fca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:51.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:51.145+0000 7f6c5ea9f700 1 -- 172.21.15.77:0/3345762405 >> 172.21.15.77:0/3345762405 conn(0x7f6c58073350 msgr2=0x7f6c580f8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:51.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:51.146+0000 7f6c5ea9f700 1 -- 172.21.15.77:0/3345762405 shutdown_connections 2024-04-25T02:12:51.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:51.146+0000 7f6c5ea9f700 1 -- 172.21.15.77:0/3345762405 wait complete. 2024-04-25T02:12:51.770 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-25T02:12:51.771 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T02:12:51.771 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -e sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-04-25T02:12:52.023 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:12:52.144 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:51 smithi077 ceph-mon[26330]: pgmap v81: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:52.144 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:51 smithi077 ceph-mon[26330]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:12:52.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:51 smithi112 ceph-mon[33313]: pgmap v81: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:52.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:51 smithi112 ceph-mon[33313]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:12:53.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.478+0000 7f1fbc791700 1 -- 172.21.15.77:0/1587853640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fb4102e10 msgr2=0x7f1fb41031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:53.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.478+0000 7f1fbc791700 1 --2- 172.21.15.77:0/1587853640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fb4102e10 0x7f1fb41031e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0004940 tx=0x7f1fb0009e30 comp rx=0 tx=0).stop 2024-04-25T02:12:53.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.478+0000 7f1fbc791700 1 -- 172.21.15.77:0/1587853640 shutdown_connections 2024-04-25T02:12:53.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.478+0000 7f1fbc791700 1 --2- 172.21.15.77:0/1587853640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fb41037b0 0x7f1fb40fb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:53.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.478+0000 7f1fbc791700 1 --2- 172.21.15.77:0/1587853640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fb4102e10 0x7f1fb41031e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:53.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.478+0000 7f1fbc791700 1 -- 172.21.15.77:0/1587853640 >> 172.21.15.77:0/1587853640 conn(0x7f1fb4073350 msgr2=0x7f1fb4073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:53.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.478+0000 7f1fbc791700 1 -- 172.21.15.77:0/1587853640 shutdown_connections 2024-04-25T02:12:53.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.478+0000 7f1fbc791700 1 -- 172.21.15.77:0/1587853640 wait complete. 2024-04-25T02:12:53.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.478+0000 7f1fbc791700 1 Processor -- start 2024-04-25T02:12:53.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.478+0000 7f1fbc791700 1 -- start start 2024-04-25T02:12:53.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.478+0000 7f1fbc791700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fb4102e10 0x7f1fb40fc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:53.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.478+0000 7f1fbc791700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fb41037b0 0x7f1fb40fcad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:53.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.478+0000 7f1fbc791700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb40fe570 con 0x7f1fb41037b0 2024-04-25T02:12:53.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.478+0000 7f1fbc791700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb40fd010 con 0x7f1fb4102e10 2024-04-25T02:12:53.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.479+0000 7f1fb9d2c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fb41037b0 0x7f1fb40fcad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:53.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.479+0000 7f1fb9d2c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fb41037b0 0x7f1fb40fcad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43672/0 (socket says 172.21.15.77:43672) 2024-04-25T02:12:53.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.479+0000 7f1fb9d2c700 1 -- 172.21.15.77:0/4260479433 learned_addr learned my addr 172.21.15.77:0/4260479433 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:12:53.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.479+0000 7f1fba52d700 1 --2- 172.21.15.77:0/4260479433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fb4102e10 0x7f1fb40fc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:53.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.479+0000 7f1fb9d2c700 1 -- 172.21.15.77:0/4260479433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fb4102e10 msgr2=0x7f1fb40fc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:53.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.479+0000 7f1fb9d2c700 1 --2- 172.21.15.77:0/4260479433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fb4102e10 0x7f1fb40fc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:53.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.479+0000 7f1fb9d2c700 1 -- 172.21.15.77:0/4260479433 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb0005040 con 0x7f1fb41037b0 2024-04-25T02:12:53.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.479+0000 7f1fb9d2c700 1 --2- 172.21.15.77:0/4260479433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fb41037b0 0x7f1fb40fcad0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1fa400b790 tx=0x7f1fa4009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:53.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.479+0000 7f1faaffd700 1 -- 172.21.15.77:0/4260479433 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fa400f6f0 con 0x7f1fb41037b0 2024-04-25T02:12:53.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.479+0000 7f1faaffd700 1 -- 172.21.15.77:0/4260479433 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1fa400fd20 con 0x7f1fb41037b0 2024-04-25T02:12:53.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.479+0000 7f1fbc791700 1 -- 172.21.15.77:0/4260479433 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb40fd2f0 con 0x7f1fb41037b0 2024-04-25T02:12:53.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.479+0000 7f1faaffd700 1 -- 172.21.15.77:0/4260479433 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fa40103a0 con 0x7f1fb41037b0 2024-04-25T02:12:53.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.479+0000 7f1fbc791700 1 -- 172.21.15.77:0/4260479433 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb411a200 con 0x7f1fb41037b0 2024-04-25T02:12:53.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.480+0000 7f1fbc791700 1 -- 172.21.15.77:0/4260479433 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb40fe6d0 con 0x7f1fb41037b0 2024-04-25T02:12:53.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.481+0000 7f1faaffd700 1 -- 172.21.15.77:0/4260479433 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 34) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f1fa4011400 con 0x7f1fb41037b0 2024-04-25T02:12:53.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.481+0000 7f1faaffd700 1 --2- 172.21.15.77:0/4260479433 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f1fa006da40 0x7f1fa006fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:53.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.481+0000 7f1faaffd700 1 -- 172.21.15.77:0/4260479433 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f1fa408cf60 con 0x7f1fb41037b0 2024-04-25T02:12:53.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.481+0000 7f1fba52d700 1 --2- 172.21.15.77:0/4260479433 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f1fa006da40 0x7f1fa006fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:53.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.482+0000 7f1fba52d700 1 --2- 172.21.15.77:0/4260479433 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f1fa006da40 0x7f1fa006fef0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0004f90 tx=0x7f1fb0009e30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:53.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.486+0000 7f1faaffd700 1 -- 172.21.15.77:0/4260479433 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f1fa40c1100 con 0x7f1fb41037b0 2024-04-25T02:12:53.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.681+0000 7f1fbc791700 1 -- 172.21.15.77:0/4260479433 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f1fb404c710 con 0x7f1fb41037b0 2024-04-25T02:12:53.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.686+0000 7f1faaffd700 1 -- 172.21.15.77:0/4260479433 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v52)=0 v52) v1 ==== 125+0+0 (secure 0 0 0) 0x7f1fa4056bb0 con 0x7f1fb41037b0 2024-04-25T02:12:53.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.688+0000 7f1fbc791700 1 -- 172.21.15.77:0/4260479433 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f1fa006da40 msgr2=0x7f1fa006fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:53.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.688+0000 7f1fbc791700 1 --2- 172.21.15.77:0/4260479433 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f1fa006da40 0x7f1fa006fef0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0004f90 tx=0x7f1fb0009e30 comp rx=0 tx=0).stop 2024-04-25T02:12:53.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.688+0000 7f1fbc791700 1 -- 172.21.15.77:0/4260479433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fb41037b0 msgr2=0x7f1fb40fcad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:53.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.688+0000 7f1fbc791700 1 --2- 172.21.15.77:0/4260479433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fb41037b0 0x7f1fb40fcad0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1fa400b790 tx=0x7f1fa4009220 comp rx=0 tx=0).stop 2024-04-25T02:12:53.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.688+0000 7f1fbc791700 1 -- 172.21.15.77:0/4260479433 shutdown_connections 2024-04-25T02:12:53.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.688+0000 7f1fbc791700 1 --2- 172.21.15.77:0/4260479433 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f1fa006da40 0x7f1fa006fef0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:53.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.688+0000 7f1fbc791700 1 --2- 172.21.15.77:0/4260479433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1fb4102e10 0x7f1fb40fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:53.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.688+0000 7f1fbc791700 1 --2- 172.21.15.77:0/4260479433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fb41037b0 0x7f1fb40fcad0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:53.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.688+0000 7f1fbc791700 1 -- 172.21.15.77:0/4260479433 >> 172.21.15.77:0/4260479433 conn(0x7f1fb4073350 msgr2=0x7f1fb40f9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:53.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.688+0000 7f1fbc791700 1 -- 172.21.15.77:0/4260479433 shutdown_connections 2024-04-25T02:12:53.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:53.688+0000 7f1fbc791700 1 -- 172.21.15.77:0/4260479433 wait complete. 2024-04-25T02:12:53.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:53 smithi077 ceph-mon[26330]: pgmap v82: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:53.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:53 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/4260479433' entity='client.admin' 2024-04-25T02:12:53.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:53 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:12:54.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:53 smithi112 ceph-mon[33313]: pgmap v82: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:54.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:53 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/4260479433' entity='client.admin' 2024-04-25T02:12:54.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:53 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:12:54.345 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-25T02:12:54.345 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T02:12:54.346 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -e sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-04-25T02:12:54.606 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:12:54.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:54 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:12:54.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:54 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:12:54.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:54 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:55.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:54 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:12:55.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:54 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:12:55.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:54 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:12:55.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:55 smithi077 ceph-mon[26330]: pgmap v83: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:56.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.186+0000 7fe7ce7da700 1 -- 172.21.15.77:0/2202112957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7c8103780 msgr2=0x7fe7c80fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:56.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.186+0000 7fe7ce7da700 1 --2- 172.21.15.77:0/2202112957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7c8103780 0x7fe7c80fcdf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc004940 tx=0x7fe7bc009e30 comp rx=0 tx=0).stop 2024-04-25T02:12:56.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.186+0000 7fe7ce7da700 1 -- 172.21.15.77:0/2202112957 shutdown_connections 2024-04-25T02:12:56.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.186+0000 7fe7ce7da700 1 --2- 172.21.15.77:0/2202112957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7c8103780 0x7fe7c80fcdf0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:56.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.186+0000 7fe7ce7da700 1 --2- 172.21.15.77:0/2202112957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7c8102de0 0x7fe7c81031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:56.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.186+0000 7fe7ce7da700 1 -- 172.21.15.77:0/2202112957 >> 172.21.15.77:0/2202112957 conn(0x7fe7c80f8990 msgr2=0x7fe7c80fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:56.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.186+0000 7fe7ce7da700 1 -- 172.21.15.77:0/2202112957 shutdown_connections 2024-04-25T02:12:56.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.186+0000 7fe7ce7da700 1 -- 172.21.15.77:0/2202112957 wait complete. 2024-04-25T02:12:56.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.186+0000 7fe7ce7da700 1 Processor -- start 2024-04-25T02:12:56.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.187+0000 7fe7ce7da700 1 -- start start 2024-04-25T02:12:56.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.187+0000 7fe7ce7da700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7c8102de0 0x7fe7c8113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:56.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.187+0000 7fe7ce7da700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7c8103780 0x7fe7c8113ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:56.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.187+0000 7fe7ce7da700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c8114520 con 0x7fe7c8103780 2024-04-25T02:12:56.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.187+0000 7fe7ce7da700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c810db20 con 0x7fe7c8102de0 2024-04-25T02:12:56.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.187+0000 7fe7c77fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7c8103780 0x7fe7c8113ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:56.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.187+0000 7fe7c77fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7c8103780 0x7fe7c8113ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43690/0 (socket says 172.21.15.77:43690) 2024-04-25T02:12:56.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.187+0000 7fe7c77fe700 1 -- 172.21.15.77:0/106864206 learned_addr learned my addr 172.21.15.77:0/106864206 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:12:56.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.187+0000 7fe7c7fff700 1 --2- 172.21.15.77:0/106864206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7c8102de0 0x7fe7c8113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:56.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.187+0000 7fe7c77fe700 1 -- 172.21.15.77:0/106864206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7c8102de0 msgr2=0x7fe7c8113990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:56.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.187+0000 7fe7c77fe700 1 --2- 172.21.15.77:0/106864206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7c8102de0 0x7fe7c8113990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:56.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.187+0000 7fe7c77fe700 1 -- 172.21.15.77:0/106864206 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7bc005040 con 0x7fe7c8103780 2024-04-25T02:12:56.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.187+0000 7fe7c7fff700 1 --2- 172.21.15.77:0/106864206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7c8102de0 0x7fe7c8113990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:56.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.187+0000 7fe7c77fe700 1 --2- 172.21.15.77:0/106864206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7c8103780 0x7fe7c8113ed0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc009100 tx=0x7fe7bc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:56.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.187+0000 7fe7c4ff9700 1 -- 172.21.15.77:0/106864206 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7bc00e040 con 0x7fe7c8103780 2024-04-25T02:12:56.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.187+0000 7fe7c4ff9700 1 -- 172.21.15.77:0/106864206 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe7bc013420 con 0x7fe7c8103780 2024-04-25T02:12:56.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.187+0000 7fe7ce7da700 1 -- 172.21.15.77:0/106864206 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c810dda0 con 0x7fe7c8103780 2024-04-25T02:12:56.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.188+0000 7fe7c4ff9700 1 -- 172.21.15.77:0/106864206 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7bc01c610 con 0x7fe7c8103780 2024-04-25T02:12:56.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.188+0000 7fe7ce7da700 1 -- 172.21.15.77:0/106864206 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c810e360 con 0x7fe7c8103780 2024-04-25T02:12:56.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.188+0000 7fe7ce7da700 1 -- 172.21.15.77:0/106864206 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c80fe530 con 0x7fe7c8103780 2024-04-25T02:12:56.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.189+0000 7fe7c4ff9700 1 -- 172.21.15.77:0/106864206 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 34) v1 ==== 91925+0+0 (secure 0 0 0) 0x7fe7bc013590 con 0x7fe7c8103780 2024-04-25T02:12:56.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.190+0000 7fe7c4ff9700 1 --2- 172.21.15.77:0/106864206 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fe7b006da40 0x7fe7b006fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:56.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.190+0000 7fe7c7fff700 1 --2- 172.21.15.77:0/106864206 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fe7b006da40 0x7fe7b006fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:56.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.190+0000 7fe7c4ff9700 1 -- 172.21.15.77:0/106864206 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fe7bc08e330 con 0x7fe7c8103780 2024-04-25T02:12:56.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.190+0000 7fe7c7fff700 1 --2- 172.21.15.77:0/106864206 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fe7b006da40 0x7fe7b006fef0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe7b80041d0 tx=0x7fe7b8009040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:56.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.194+0000 7fe7c4ff9700 1 -- 172.21.15.77:0/106864206 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7fe7bc05bb50 con 0x7fe7c8103780 2024-04-25T02:12:56.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:55 smithi112 ceph-mon[33313]: pgmap v83: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:56.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.389+0000 7fe7ce7da700 1 -- 172.21.15.77:0/106864206 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fe7c8109ec0 con 0x7fe7c8103780 2024-04-25T02:12:56.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.389+0000 7fe7c4ff9700 1 -- 172.21.15.77:0/106864206 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v52)=0 v52) v1 ==== 155+0+0 (secure 0 0 0) 0x7fe7bc05b6e0 con 0x7fe7c8103780 2024-04-25T02:12:56.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.391+0000 7fe7ce7da700 1 -- 172.21.15.77:0/106864206 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fe7b006da40 msgr2=0x7fe7b006fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:56.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.391+0000 7fe7ce7da700 1 --2- 172.21.15.77:0/106864206 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fe7b006da40 0x7fe7b006fef0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe7b80041d0 tx=0x7fe7b8009040 comp rx=0 tx=0).stop 2024-04-25T02:12:56.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.391+0000 7fe7ce7da700 1 -- 172.21.15.77:0/106864206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7c8103780 msgr2=0x7fe7c8113ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:56.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.391+0000 7fe7ce7da700 1 --2- 172.21.15.77:0/106864206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7c8103780 0x7fe7c8113ed0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc009100 tx=0x7fe7bc009e30 comp rx=0 tx=0).stop 2024-04-25T02:12:56.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.391+0000 7fe7ce7da700 1 -- 172.21.15.77:0/106864206 shutdown_connections 2024-04-25T02:12:56.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.391+0000 7fe7ce7da700 1 --2- 172.21.15.77:0/106864206 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fe7b006da40 0x7fe7b006fef0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:56.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.391+0000 7fe7ce7da700 1 --2- 172.21.15.77:0/106864206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7c8102de0 0x7fe7c8113990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:56.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.391+0000 7fe7ce7da700 1 --2- 172.21.15.77:0/106864206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7c8103780 0x7fe7c8113ed0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:56.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.391+0000 7fe7ce7da700 1 -- 172.21.15.77:0/106864206 >> 172.21.15.77:0/106864206 conn(0x7fe7c80f8990 msgr2=0x7fe7c80f9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:56.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.392+0000 7fe7ce7da700 1 -- 172.21.15.77:0/106864206 shutdown_connections 2024-04-25T02:12:56.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:56.392+0000 7fe7ce7da700 1 -- 172.21.15.77:0/106864206 wait complete. 2024-04-25T02:12:57.002 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -e sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-04-25T02:12:57.253 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:12:57.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:57 smithi077 ceph-mon[26330]: pgmap v84: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:58.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:57 smithi112 ceph-mon[33313]: pgmap v84: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:58.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.778+0000 7f7eb40a3700 1 -- 172.21.15.77:0/2306097583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7eac101d10 msgr2=0x7f7eac1020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:58.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.778+0000 7f7eb40a3700 1 --2- 172.21.15.77:0/2306097583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7eac101d10 0x7f7eac1020e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4009ce0 tx=0x7f7ea4004d10 comp rx=0 tx=0).stop 2024-04-25T02:12:58.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.778+0000 7f7eb40a3700 1 -- 172.21.15.77:0/2306097583 shutdown_connections 2024-04-25T02:12:58.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.778+0000 7f7eb40a3700 1 --2- 172.21.15.77:0/2306097583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7eac1026b0 0x7f7eac0fbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:58.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.778+0000 7f7eb40a3700 1 --2- 172.21.15.77:0/2306097583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7eac101d10 0x7f7eac1020e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:58.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.778+0000 7f7eb40a3700 1 -- 172.21.15.77:0/2306097583 >> 172.21.15.77:0/2306097583 conn(0x7f7eac0f7860 msgr2=0x7f7eac0f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:58.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.778+0000 7f7eb40a3700 1 -- 172.21.15.77:0/2306097583 shutdown_connections 2024-04-25T02:12:58.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.778+0000 7f7eb40a3700 1 -- 172.21.15.77:0/2306097583 wait complete. 2024-04-25T02:12:58.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.779+0000 7f7eb40a3700 1 Processor -- start 2024-04-25T02:12:58.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.779+0000 7f7eb40a3700 1 -- start start 2024-04-25T02:12:58.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.779+0000 7f7eb40a3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7eac101d10 0x7f7eac113b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:58.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.779+0000 7f7eb40a3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7eac1026b0 0x7f7eac114080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:58.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.779+0000 7f7eb40a3700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac114760 con 0x7f7eac1026b0 2024-04-25T02:12:58.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.779+0000 7f7eb40a3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac10dcb0 con 0x7f7eac101d10 2024-04-25T02:12:58.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.779+0000 7f7eb163e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7eac1026b0 0x7f7eac114080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:58.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.779+0000 7f7eb163e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7eac1026b0 0x7f7eac114080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50918/0 (socket says 172.21.15.77:50918) 2024-04-25T02:12:58.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.779+0000 7f7eb163e700 1 -- 172.21.15.77:0/3564498930 learned_addr learned my addr 172.21.15.77:0/3564498930 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:12:58.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.779+0000 7f7eb1e3f700 1 --2- 172.21.15.77:0/3564498930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7eac101d10 0x7f7eac113b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:58.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.780+0000 7f7eb163e700 1 -- 172.21.15.77:0/3564498930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7eac101d10 msgr2=0x7f7eac113b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:58.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.780+0000 7f7eb163e700 1 --2- 172.21.15.77:0/3564498930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7eac101d10 0x7f7eac113b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:58.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.780+0000 7f7eb163e700 1 -- 172.21.15.77:0/3564498930 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea4009940 con 0x7f7eac1026b0 2024-04-25T02:12:58.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.780+0000 7f7eb1e3f700 1 --2- 172.21.15.77:0/3564498930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7eac101d10 0x7f7eac113b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:58.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.780+0000 7f7eb163e700 1 --2- 172.21.15.77:0/3564498930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7eac1026b0 0x7f7eac114080 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7ea000b790 tx=0x7f7ea0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:58.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.780+0000 7f7eaa7fc700 1 -- 172.21.15.77:0/3564498930 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ea000f6f0 con 0x7f7eac1026b0 2024-04-25T02:12:58.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.780+0000 7f7eb40a3700 1 -- 172.21.15.77:0/3564498930 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eac10df30 con 0x7f7eac1026b0 2024-04-25T02:12:58.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.780+0000 7f7eaa7fc700 1 -- 172.21.15.77:0/3564498930 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ea000fd20 con 0x7f7eac1026b0 2024-04-25T02:12:58.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.780+0000 7f7eaa7fc700 1 -- 172.21.15.77:0/3564498930 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ea00103a0 con 0x7f7eac1026b0 2024-04-25T02:12:58.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.780+0000 7f7eb40a3700 1 -- 172.21.15.77:0/3564498930 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eac10e4f0 con 0x7f7eac1026b0 2024-04-25T02:12:58.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.781+0000 7f7eb40a3700 1 -- 172.21.15.77:0/3564498930 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eac0fd460 con 0x7f7eac1026b0 2024-04-25T02:12:58.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.781+0000 7f7eaa7fc700 1 -- 172.21.15.77:0/3564498930 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 34) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f7ea0011400 con 0x7f7eac1026b0 2024-04-25T02:12:58.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.782+0000 7f7eaa7fc700 1 --2- 172.21.15.77:0/3564498930 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f7e9406da40 0x7f7e9406fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:58.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.782+0000 7f7eaa7fc700 1 -- 172.21.15.77:0/3564498930 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f7ea008d070 con 0x7f7eac1026b0 2024-04-25T02:12:58.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.782+0000 7f7eb1e3f700 1 --2- 172.21.15.77:0/3564498930 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f7e9406da40 0x7f7e9406fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:58.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.782+0000 7f7eb1e3f700 1 --2- 172.21.15.77:0/3564498930 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f7e9406da40 0x7f7e9406fef0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7ea400b740 tx=0x7f7ea4004d10 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:58.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.786+0000 7f7eaa7fc700 1 -- 172.21.15.77:0/3564498930 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f7ea005a770 con 0x7f7eac1026b0 2024-04-25T02:12:58.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.981+0000 7f7eb40a3700 1 -- 172.21.15.77:0/3564498930 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f7eac10a010 con 0x7f7eac1026b0 2024-04-25T02:12:58.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.982+0000 7f7eaa7fc700 1 -- 172.21.15.77:0/3564498930 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v52)=0 v52) v1 ==== 163+0+0 (secure 0 0 0) 0x7f7ea005a300 con 0x7f7eac1026b0 2024-04-25T02:12:58.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.984+0000 7f7eb40a3700 1 -- 172.21.15.77:0/3564498930 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f7e9406da40 msgr2=0x7f7e9406fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:58.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.984+0000 7f7eb40a3700 1 --2- 172.21.15.77:0/3564498930 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f7e9406da40 0x7f7e9406fef0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7ea400b740 tx=0x7f7ea4004d10 comp rx=0 tx=0).stop 2024-04-25T02:12:58.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.984+0000 7f7eb40a3700 1 -- 172.21.15.77:0/3564498930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7eac1026b0 msgr2=0x7f7eac114080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:58.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.984+0000 7f7eb40a3700 1 --2- 172.21.15.77:0/3564498930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7eac1026b0 0x7f7eac114080 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7ea000b790 tx=0x7f7ea0009220 comp rx=0 tx=0).stop 2024-04-25T02:12:58.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.984+0000 7f7eb40a3700 1 -- 172.21.15.77:0/3564498930 shutdown_connections 2024-04-25T02:12:58.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.984+0000 7f7eb40a3700 1 --2- 172.21.15.77:0/3564498930 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f7e9406da40 0x7f7e9406fef0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:58.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.984+0000 7f7eb40a3700 1 --2- 172.21.15.77:0/3564498930 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7eac101d10 0x7f7eac113b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:58.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.984+0000 7f7eb40a3700 1 --2- 172.21.15.77:0/3564498930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7eac1026b0 0x7f7eac114080 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:58.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.984+0000 7f7eb40a3700 1 -- 172.21.15.77:0/3564498930 >> 172.21.15.77:0/3564498930 conn(0x7f7eac0f7860 msgr2=0x7f7eac0f8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:58.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.984+0000 7f7eb40a3700 1 -- 172.21.15.77:0/3564498930 shutdown_connections 2024-04-25T02:12:58.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:12:58.984+0000 7f7eb40a3700 1 -- 172.21.15.77:0/3564498930 wait complete. 2024-04-25T02:12:59.644 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -e sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 -- bash -c 'ceph config set global log_to_journald false --force' 2024-04-25T02:12:59.900 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:12:59.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:59 smithi077 ceph-mon[26330]: pgmap v85: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:12:59.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:12:59 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:13:00.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:59 smithi112 ceph-mon[33313]: pgmap v85: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:00.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:12:59 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:13:01.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.495+0000 7fd6f595e700 1 -- 172.21.15.77:0/2429783688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6f0103780 msgr2=0x7fd6f00fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:01.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.495+0000 7fd6f595e700 1 --2- 172.21.15.77:0/2429783688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6f0103780 0x7fd6f00fcdf0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0004940 tx=0x7fd6e0009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:01.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.495+0000 7fd6f595e700 1 -- 172.21.15.77:0/2429783688 shutdown_connections 2024-04-25T02:13:01.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.495+0000 7fd6f595e700 1 --2- 172.21.15.77:0/2429783688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6f0103780 0x7fd6f00fcdf0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:01.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.495+0000 7fd6f595e700 1 --2- 172.21.15.77:0/2429783688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6f0102de0 0x7fd6f01031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:01.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.495+0000 7fd6f595e700 1 -- 172.21.15.77:0/2429783688 >> 172.21.15.77:0/2429783688 conn(0x7fd6f00f8990 msgr2=0x7fd6f00fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:01.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.495+0000 7fd6f595e700 1 -- 172.21.15.77:0/2429783688 shutdown_connections 2024-04-25T02:13:01.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.496+0000 7fd6f595e700 1 -- 172.21.15.77:0/2429783688 wait complete. 2024-04-25T02:13:01.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.497+0000 7fd6f595e700 1 Processor -- start 2024-04-25T02:13:01.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.497+0000 7fd6f595e700 1 -- start start 2024-04-25T02:13:01.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.497+0000 7fd6f595e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6f0102de0 0x7fd6f0113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:01.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.497+0000 7fd6f595e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6f0103780 0x7fd6f0113ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:01.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.497+0000 7fd6f595e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f01145b0 con 0x7fd6f0103780 2024-04-25T02:13:01.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.497+0000 7fd6f595e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f010db20 con 0x7fd6f0102de0 2024-04-25T02:13:01.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.497+0000 7fd6ee7fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6f0103780 0x7fd6f0113ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:01.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.497+0000 7fd6ee7fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6f0103780 0x7fd6f0113ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50934/0 (socket says 172.21.15.77:50934) 2024-04-25T02:13:01.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.497+0000 7fd6ee7fc700 1 -- 172.21.15.77:0/2413379812 learned_addr learned my addr 172.21.15.77:0/2413379812 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:13:01.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.497+0000 7fd6eeffd700 1 --2- 172.21.15.77:0/2413379812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6f0102de0 0x7fd6f0113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:01.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.497+0000 7fd6ee7fc700 1 -- 172.21.15.77:0/2413379812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6f0102de0 msgr2=0x7fd6f0113990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:01.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.497+0000 7fd6ee7fc700 1 --2- 172.21.15.77:0/2413379812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6f0102de0 0x7fd6f0113990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:01.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.497+0000 7fd6ee7fc700 1 -- 172.21.15.77:0/2413379812 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e0005040 con 0x7fd6f0103780 2024-04-25T02:13:01.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.497+0000 7fd6ee7fc700 1 --2- 172.21.15.77:0/2413379812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6f0103780 0x7fd6f0113ed0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009100 tx=0x7fd6e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:01.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.498+0000 7fd6e77fe700 1 -- 172.21.15.77:0/2413379812 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6e000e040 con 0x7fd6f0103780 2024-04-25T02:13:01.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.498+0000 7fd6f595e700 1 -- 172.21.15.77:0/2413379812 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f010dda0 con 0x7fd6f0103780 2024-04-25T02:13:01.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.498+0000 7fd6e77fe700 1 -- 172.21.15.77:0/2413379812 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd6e0009af0 con 0x7fd6f0103780 2024-04-25T02:13:01.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.498+0000 7fd6e77fe700 1 -- 172.21.15.77:0/2413379812 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6e001c3f0 con 0x7fd6f0103780 2024-04-25T02:13:01.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.498+0000 7fd6f595e700 1 -- 172.21.15.77:0/2413379812 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f010e360 con 0x7fd6f0103780 2024-04-25T02:13:01.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.499+0000 7fd6f595e700 1 -- 172.21.15.77:0/2413379812 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f01000f0 con 0x7fd6f0103780 2024-04-25T02:13:01.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.499+0000 7fd6e77fe700 1 -- 172.21.15.77:0/2413379812 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 34) v1 ==== 91925+0+0 (secure 0 0 0) 0x7fd6e000baf0 con 0x7fd6f0103780 2024-04-25T02:13:01.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.499+0000 7fd6e77fe700 1 --2- 172.21.15.77:0/2413379812 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fd6dc06da40 0x7fd6dc06fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:01.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.500+0000 7fd6e77fe700 1 -- 172.21.15.77:0/2413379812 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fd6e008e400 con 0x7fd6f0103780 2024-04-25T02:13:01.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.500+0000 7fd6eeffd700 1 --2- 172.21.15.77:0/2413379812 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fd6dc06da40 0x7fd6dc06fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:01.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.500+0000 7fd6eeffd700 1 --2- 172.21.15.77:0/2413379812 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fd6dc06da40 0x7fd6dc06fef0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8009b60 tx=0x7fd6d80091a0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:01.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.504+0000 7fd6e77fe700 1 -- 172.21.15.77:0/2413379812 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7fd6e005bb80 con 0x7fd6f0103780 2024-04-25T02:13:01.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.698+0000 7fd6f595e700 1 -- 172.21.15.77:0/2413379812 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fd6f00fe530 con 0x7fd6f0103780 2024-04-25T02:13:01.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.698+0000 7fd6e77fe700 1 -- 172.21.15.77:0/2413379812 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v52)=0 v52) v1 ==== 135+0+0 (secure 0 0 0) 0x7fd6e005b710 con 0x7fd6f0103780 2024-04-25T02:13:01.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.700+0000 7fd6f595e700 1 -- 172.21.15.77:0/2413379812 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fd6dc06da40 msgr2=0x7fd6dc06fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:01.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.700+0000 7fd6f595e700 1 --2- 172.21.15.77:0/2413379812 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fd6dc06da40 0x7fd6dc06fef0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8009b60 tx=0x7fd6d80091a0 comp rx=0 tx=0).stop 2024-04-25T02:13:01.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.700+0000 7fd6f595e700 1 -- 172.21.15.77:0/2413379812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6f0103780 msgr2=0x7fd6f0113ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:01.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.700+0000 7fd6f595e700 1 --2- 172.21.15.77:0/2413379812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6f0103780 0x7fd6f0113ed0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009100 tx=0x7fd6e0009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:01.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.700+0000 7fd6f595e700 1 -- 172.21.15.77:0/2413379812 shutdown_connections 2024-04-25T02:13:01.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.700+0000 7fd6f595e700 1 --2- 172.21.15.77:0/2413379812 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fd6dc06da40 0x7fd6dc06fef0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:01.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.700+0000 7fd6f595e700 1 --2- 172.21.15.77:0/2413379812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6f0102de0 0x7fd6f0113990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:01.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.700+0000 7fd6f595e700 1 --2- 172.21.15.77:0/2413379812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6f0103780 0x7fd6f0113ed0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:01.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.700+0000 7fd6f595e700 1 -- 172.21.15.77:0/2413379812 >> 172.21.15.77:0/2413379812 conn(0x7fd6f00f8990 msgr2=0x7fd6f00fa6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:01.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.700+0000 7fd6f595e700 1 -- 172.21.15.77:0/2413379812 shutdown_connections 2024-04-25T02:13:01.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:01.700+0000 7fd6f595e700 1 -- 172.21.15.77:0/2413379812 wait complete. 2024-04-25T02:13:02.052 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:01 smithi077 ceph-mon[26330]: pgmap v86: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:02.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:01 smithi112 ceph-mon[33313]: pgmap v86: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:02.310 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -e sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-04-25T02:13:02.562 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:13:04.045 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:03 smithi077 ceph-mon[26330]: pgmap v87: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:04.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.243+0000 7f64fbbcd700 1 -- 172.21.15.77:0/1547317018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64f4103780 msgr2=0x7f64f40fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:04.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.243+0000 7f64fbbcd700 1 --2- 172.21.15.77:0/1547317018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64f4103780 0x7f64f40fcdf0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f64e4004940 tx=0x7f64e4009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:04.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.244+0000 7f64fbbcd700 1 -- 172.21.15.77:0/1547317018 shutdown_connections 2024-04-25T02:13:04.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.244+0000 7f64fbbcd700 1 --2- 172.21.15.77:0/1547317018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64f4103780 0x7f64f40fcdf0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:04.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.244+0000 7f64fbbcd700 1 --2- 172.21.15.77:0/1547317018 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64f4102de0 0x7f64f41031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:04.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.244+0000 7f64fbbcd700 1 -- 172.21.15.77:0/1547317018 >> 172.21.15.77:0/1547317018 conn(0x7f64f40f8990 msgr2=0x7f64f40fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:04.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.244+0000 7f64fbbcd700 1 -- 172.21.15.77:0/1547317018 shutdown_connections 2024-04-25T02:13:04.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.244+0000 7f64fbbcd700 1 -- 172.21.15.77:0/1547317018 wait complete. 2024-04-25T02:13:04.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.244+0000 7f64fbbcd700 1 Processor -- start 2024-04-25T02:13:04.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.244+0000 7f64fbbcd700 1 -- start start 2024-04-25T02:13:04.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.245+0000 7f64fbbcd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64f4102de0 0x7f64f4113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:04.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.245+0000 7f64fbbcd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64f4103780 0x7f64f4113ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:04.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.245+0000 7f64fbbcd700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f4114520 con 0x7f64f4103780 2024-04-25T02:13:04.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.245+0000 7f64fbbcd700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f410db20 con 0x7f64f4102de0 2024-04-25T02:13:04.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.245+0000 7f64f9168700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64f4103780 0x7f64f4113ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:04.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.245+0000 7f64f9168700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64f4103780 0x7f64f4113ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50952/0 (socket says 172.21.15.77:50952) 2024-04-25T02:13:04.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.245+0000 7f64f9168700 1 -- 172.21.15.77:0/4176084345 learned_addr learned my addr 172.21.15.77:0/4176084345 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:13:04.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.245+0000 7f64f9168700 1 -- 172.21.15.77:0/4176084345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64f4102de0 msgr2=0x7f64f4113990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:04.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.245+0000 7f64f9168700 1 --2- 172.21.15.77:0/4176084345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64f4102de0 0x7f64f4113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:04.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.245+0000 7f64f9168700 1 -- 172.21.15.77:0/4176084345 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e4005040 con 0x7f64f4103780 2024-04-25T02:13:04.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.245+0000 7f64f9168700 1 --2- 172.21.15.77:0/4176084345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64f4103780 0x7f64f4113ed0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f64e4009100 tx=0x7f64e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:04.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.245+0000 7f64ea7fc700 1 -- 172.21.15.77:0/4176084345 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64e400e040 con 0x7f64f4103780 2024-04-25T02:13:04.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.245+0000 7f64ea7fc700 1 -- 172.21.15.77:0/4176084345 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f64e4013420 con 0x7f64f4103780 2024-04-25T02:13:04.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.245+0000 7f64fbbcd700 1 -- 172.21.15.77:0/4176084345 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f410dda0 con 0x7f64f4103780 2024-04-25T02:13:04.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.245+0000 7f64ea7fc700 1 -- 172.21.15.77:0/4176084345 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64e401c610 con 0x7f64f4103780 2024-04-25T02:13:04.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.245+0000 7f64fbbcd700 1 -- 172.21.15.77:0/4176084345 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f410e360 con 0x7f64f4103780 2024-04-25T02:13:04.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.246+0000 7f64fbbcd700 1 -- 172.21.15.77:0/4176084345 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f40fe530 con 0x7f64f4103780 2024-04-25T02:13:04.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.247+0000 7f64ea7fc700 1 -- 172.21.15.77:0/4176084345 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 34) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f64e4013590 con 0x7f64f4103780 2024-04-25T02:13:04.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.247+0000 7f64ea7fc700 1 --2- 172.21.15.77:0/4176084345 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f64e006da40 0x7f64e006fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:04.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.247+0000 7f64ea7fc700 1 -- 172.21.15.77:0/4176084345 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f64e408e460 con 0x7f64f4103780 2024-04-25T02:13:04.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.247+0000 7f64f9969700 1 --2- 172.21.15.77:0/4176084345 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f64e006da40 0x7f64e006fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:04.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.248+0000 7f64f9969700 1 --2- 172.21.15.77:0/4176084345 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f64e006da40 0x7f64e006fef0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f64f0004af0 tx=0x7f64f0007c30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:04.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.252+0000 7f64ea7fc700 1 -- 172.21.15.77:0/4176084345 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f64e405bbe0 con 0x7f64f4103780 2024-04-25T02:13:04.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:03 smithi112 ceph-mon[33313]: pgmap v87: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:04.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.466+0000 7f64fbbcd700 1 -- 172.21.15.77:0/4176084345 --> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551", "target": ["mon-mgr", ""]}) v1 -- 0x7f64f4109ec0 con 0x7f64e006da40 2024-04-25T02:13:04.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.472+0000 7f64ea7fc700 1 -- 172.21.15.77:0/4176084345 <== mgr.14668 v2:172.21.15.77:6800/799251145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f64f4109ec0 con 0x7f64e006da40 2024-04-25T02:13:04.478 INFO:teuthology.orchestra.run.smithi077.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:13:04.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.474+0000 7f64fbbcd700 1 -- 172.21.15.77:0/4176084345 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f64e006da40 msgr2=0x7f64e006fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:04.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.474+0000 7f64fbbcd700 1 --2- 172.21.15.77:0/4176084345 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f64e006da40 0x7f64e006fef0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f64f0004af0 tx=0x7f64f0007c30 comp rx=0 tx=0).stop 2024-04-25T02:13:04.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.474+0000 7f64fbbcd700 1 -- 172.21.15.77:0/4176084345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64f4103780 msgr2=0x7f64f4113ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:04.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.474+0000 7f64fbbcd700 1 --2- 172.21.15.77:0/4176084345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64f4103780 0x7f64f4113ed0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f64e4009100 tx=0x7f64e4009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:04.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.474+0000 7f64fbbcd700 1 -- 172.21.15.77:0/4176084345 shutdown_connections 2024-04-25T02:13:04.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.474+0000 7f64fbbcd700 1 --2- 172.21.15.77:0/4176084345 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f64e006da40 0x7f64e006fef0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:04.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.474+0000 7f64fbbcd700 1 --2- 172.21.15.77:0/4176084345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64f4102de0 0x7f64f4113990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:04.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.474+0000 7f64fbbcd700 1 --2- 172.21.15.77:0/4176084345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64f4103780 0x7f64f4113ed0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:04.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.474+0000 7f64fbbcd700 1 -- 172.21.15.77:0/4176084345 >> 172.21.15.77:0/4176084345 conn(0x7f64f40f8990 msgr2=0x7f64f40f9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:04.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.474+0000 7f64fbbcd700 1 -- 172.21.15.77:0/4176084345 shutdown_connections 2024-04-25T02:13:04.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:04.474+0000 7f64fbbcd700 1 -- 172.21.15.77:0/4176084345 wait complete. 2024-04-25T02:13:05.104 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-25T02:13:05.104 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T02:13:05.104 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -e sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-04-25T02:13:05.362 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:13:05.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:05 smithi077 ceph-mon[26330]: from='client.14822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:13:05.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:05 smithi077 ceph-mon[26330]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:13:05.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:05 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:05.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:05 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:13:05.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:05 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:13:05.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:05 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:13:05.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:05 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:05.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:05 smithi077 ceph-mon[26330]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:13:05.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:05 smithi077 ceph-mon[26330]: pgmap v88: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:05.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:05 smithi112 ceph-mon[33313]: from='client.14822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:13:05.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:05 smithi112 ceph-mon[33313]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:13:05.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:05 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:05.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:05 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:13:05.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:05 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:13:05.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:05 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:13:05.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:05 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:05.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:05 smithi112 ceph-mon[33313]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:13:05.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:05 smithi112 ceph-mon[33313]: pgmap v88: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:07.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.051+0000 7f4e1c192700 1 -- 172.21.15.77:0/1127094854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e140fbd40 msgr2=0x7f4e140fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:07.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.051+0000 7f4e1c192700 1 --2- 172.21.15.77:0/1127094854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e140fbd40 0x7f4e140fc1b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4e04004940 tx=0x7f4e04009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:07.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.051+0000 7f4e1c192700 1 -- 172.21.15.77:0/1127094854 shutdown_connections 2024-04-25T02:13:07.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.051+0000 7f4e1c192700 1 --2- 172.21.15.77:0/1127094854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e140fbd40 0x7f4e140fc1b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:07.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.051+0000 7f4e1c192700 1 --2- 172.21.15.77:0/1127094854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e14101d90 0x7f4e14102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:07.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.051+0000 7f4e1c192700 1 -- 172.21.15.77:0/1127094854 >> 172.21.15.77:0/1127094854 conn(0x7f4e14071d00 msgr2=0x7f4e14072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:07.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.051+0000 7f4e1c192700 1 -- 172.21.15.77:0/1127094854 shutdown_connections 2024-04-25T02:13:07.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.051+0000 7f4e1c192700 1 -- 172.21.15.77:0/1127094854 wait complete. 2024-04-25T02:13:07.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.051+0000 7f4e1c192700 1 Processor -- start 2024-04-25T02:13:07.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.051+0000 7f4e1c192700 1 -- start start 2024-04-25T02:13:07.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.052+0000 7f4e1c192700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e140fbd40 0x7f4e14113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:07.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.052+0000 7f4e1c192700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e14101d90 0x7f4e141140e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:07.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.052+0000 7f4e1c192700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e141147c0 con 0x7f4e14101d90 2024-04-25T02:13:07.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.052+0000 7f4e1c192700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1410db20 con 0x7f4e140fbd40 2024-04-25T02:13:07.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.052+0000 7f4e1972d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e14101d90 0x7f4e141140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:07.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.052+0000 7f4e1972d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e14101d90 0x7f4e141140e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50974/0 (socket says 172.21.15.77:50974) 2024-04-25T02:13:07.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.052+0000 7f4e1972d700 1 -- 172.21.15.77:0/1026850980 learned_addr learned my addr 172.21.15.77:0/1026850980 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:13:07.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.052+0000 7f4e19f2e700 1 --2- 172.21.15.77:0/1026850980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e140fbd40 0x7f4e14113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:07.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.052+0000 7f4e1972d700 1 -- 172.21.15.77:0/1026850980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e140fbd40 msgr2=0x7f4e14113ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:07.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.052+0000 7f4e1972d700 1 --2- 172.21.15.77:0/1026850980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e140fbd40 0x7f4e14113ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:07.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.052+0000 7f4e1972d700 1 -- 172.21.15.77:0/1026850980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e04005040 con 0x7f4e14101d90 2024-04-25T02:13:07.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.052+0000 7f4e19f2e700 1 --2- 172.21.15.77:0/1026850980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e140fbd40 0x7f4e14113ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:07.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.052+0000 7f4e1972d700 1 --2- 172.21.15.77:0/1026850980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e14101d90 0x7f4e141140e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4e0400b3b0 tx=0x7f4e04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:07.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.052+0000 7f4e0a7fc700 1 -- 172.21.15.77:0/1026850980 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e0400e040 con 0x7f4e14101d90 2024-04-25T02:13:07.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.052+0000 7f4e1c192700 1 -- 172.21.15.77:0/1026850980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1410dda0 con 0x7f4e14101d90 2024-04-25T02:13:07.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.052+0000 7f4e0a7fc700 1 -- 172.21.15.77:0/1026850980 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e0400bbc0 con 0x7f4e14101d90 2024-04-25T02:13:07.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.052+0000 7f4e0a7fc700 1 -- 172.21.15.77:0/1026850980 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e0401c3f0 con 0x7f4e14101d90 2024-04-25T02:13:07.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.053+0000 7f4e1c192700 1 -- 172.21.15.77:0/1026850980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e1410e360 con 0x7f4e14101d90 2024-04-25T02:13:07.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.053+0000 7f4e1c192700 1 -- 172.21.15.77:0/1026850980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e140fd430 con 0x7f4e14101d90 2024-04-25T02:13:07.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.054+0000 7f4e0a7fc700 1 -- 172.21.15.77:0/1026850980 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 34) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f4e0400bd30 con 0x7f4e14101d90 2024-04-25T02:13:07.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.055+0000 7f4e0a7fc700 1 --2- 172.21.15.77:0/1026850980 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f4e0006da40 0x7f4e0006fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:07.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.055+0000 7f4e0a7fc700 1 -- 172.21.15.77:0/1026850980 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f4e0408e4f0 con 0x7f4e14101d90 2024-04-25T02:13:07.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.055+0000 7f4e19f2e700 1 --2- 172.21.15.77:0/1026850980 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f4e0006da40 0x7f4e0006fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:07.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.055+0000 7f4e19f2e700 1 --2- 172.21.15.77:0/1026850980 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f4e0006da40 0x7f4e0006fef0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4e10006fd0 tx=0x7f4e10008040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:07.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.059+0000 7f4e0a7fc700 1 -- 172.21.15.77:0/1026850980 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f4e0405bbf0 con 0x7f4e14101d90 2024-04-25T02:13:07.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.288+0000 7f4e1c192700 1 -- 172.21.15.77:0/1026850980 --> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e14108f10 con 0x7f4e0006da40 2024-04-25T02:13:07.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.289+0000 7f4e0a7fc700 1 -- 172.21.15.77:0/1026850980 <== mgr.14668 v2:172.21.15.77:6800/799251145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f4e1000c690 con 0x7f4e0006da40 2024-04-25T02:13:07.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.292+0000 7f4e1c192700 1 -- 172.21.15.77:0/1026850980 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f4e0006da40 msgr2=0x7f4e0006fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:07.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.292+0000 7f4e1c192700 1 --2- 172.21.15.77:0/1026850980 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f4e0006da40 0x7f4e0006fef0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4e10006fd0 tx=0x7f4e10008040 comp rx=0 tx=0).stop 2024-04-25T02:13:07.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.292+0000 7f4e1c192700 1 -- 172.21.15.77:0/1026850980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e14101d90 msgr2=0x7f4e141140e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:07.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.292+0000 7f4e1c192700 1 --2- 172.21.15.77:0/1026850980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e14101d90 0x7f4e141140e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4e0400b3b0 tx=0x7f4e04009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:07.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.292+0000 7f4e1c192700 1 -- 172.21.15.77:0/1026850980 shutdown_connections 2024-04-25T02:13:07.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.292+0000 7f4e1c192700 1 --2- 172.21.15.77:0/1026850980 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f4e0006da40 0x7f4e0006fef0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:07.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.292+0000 7f4e1c192700 1 --2- 172.21.15.77:0/1026850980 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e140fbd40 0x7f4e14113ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:07.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.292+0000 7f4e1c192700 1 --2- 172.21.15.77:0/1026850980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e14101d90 0x7f4e141140e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:07.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.292+0000 7f4e1c192700 1 -- 172.21.15.77:0/1026850980 >> 172.21.15.77:0/1026850980 conn(0x7f4e14071d00 msgr2=0x7f4e140fa800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:07.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.292+0000 7f4e1c192700 1 -- 172.21.15.77:0/1026850980 shutdown_connections 2024-04-25T02:13:07.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.292+0000 7f4e1c192700 1 -- 172.21.15.77:0/1026850980 wait complete. 2024-04-25T02:13:07.309 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-04-25T02:13:07.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.398+0000 7f56158ae700 1 -- 172.21.15.77:0/1722798290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5610103760 msgr2=0x7f56100fcdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:07.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.398+0000 7f56158ae700 1 --2- 172.21.15.77:0/1722798290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5610103760 0x7f56100fcdd0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5604004940 tx=0x7f5604009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:07.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.398+0000 7f56158ae700 1 -- 172.21.15.77:0/1722798290 shutdown_connections 2024-04-25T02:13:07.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.398+0000 7f56158ae700 1 --2- 172.21.15.77:0/1722798290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5610103760 0x7f56100fcdd0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:07.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.398+0000 7f56158ae700 1 --2- 172.21.15.77:0/1722798290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5610102dc0 0x7f5610103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:07.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.398+0000 7f56158ae700 1 -- 172.21.15.77:0/1722798290 >> 172.21.15.77:0/1722798290 conn(0x7f56100f8930 msgr2=0x7f56100fad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:07.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.398+0000 7f56158ae700 1 -- 172.21.15.77:0/1722798290 shutdown_connections 2024-04-25T02:13:07.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.398+0000 7f56158ae700 1 -- 172.21.15.77:0/1722798290 wait complete. 2024-04-25T02:13:07.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.399+0000 7f56158ae700 1 Processor -- start 2024-04-25T02:13:07.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.399+0000 7f56158ae700 1 -- start start 2024-04-25T02:13:07.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.399+0000 7f56158ae700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5610102dc0 0x7f5610070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:07.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.399+0000 7f56158ae700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5610103760 0x7f56100707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:07.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.399+0000 7f56158ae700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56100721b0 con 0x7f5610103760 2024-04-25T02:13:07.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.399+0000 7f56158ae700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5610070ce0 con 0x7f5610102dc0 2024-04-25T02:13:07.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.399+0000 7f560e7fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5610103760 0x7f56100707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:07.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.399+0000 7f560e7fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5610103760 0x7f56100707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50998/0 (socket says 172.21.15.77:50998) 2024-04-25T02:13:07.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.399+0000 7f560e7fc700 1 -- 172.21.15.77:0/3609584473 learned_addr learned my addr 172.21.15.77:0/3609584473 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:13:07.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.399+0000 7f560effd700 1 --2- 172.21.15.77:0/3609584473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5610102dc0 0x7f5610070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:07.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.400+0000 7f560e7fc700 1 -- 172.21.15.77:0/3609584473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5610102dc0 msgr2=0x7f5610070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:07.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.400+0000 7f560e7fc700 1 --2- 172.21.15.77:0/3609584473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5610102dc0 0x7f5610070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:07.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.400+0000 7f560e7fc700 1 -- 172.21.15.77:0/3609584473 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5604005040 con 0x7f5610103760 2024-04-25T02:13:07.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.400+0000 7f560e7fc700 1 --2- 172.21.15.77:0/3609584473 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5610103760 0x7f56100707a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f560400b3b0 tx=0x7f5604009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:07.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.400+0000 7f55f77fe700 1 -- 172.21.15.77:0/3609584473 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f560400e040 con 0x7f5610103760 2024-04-25T02:13:07.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.400+0000 7f55f77fe700 1 -- 172.21.15.77:0/3609584473 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5604009b10 con 0x7f5610103760 2024-04-25T02:13:07.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.400+0000 7f56158ae700 1 -- 172.21.15.77:0/3609584473 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5610070f60 con 0x7f5610103760 2024-04-25T02:13:07.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.400+0000 7f55f77fe700 1 -- 172.21.15.77:0/3609584473 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5604013420 con 0x7f5610103760 2024-04-25T02:13:07.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.400+0000 7f56158ae700 1 -- 172.21.15.77:0/3609584473 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f561011a0a0 con 0x7f5610103760 2024-04-25T02:13:07.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.401+0000 7f56158ae700 1 -- 172.21.15.77:0/3609584473 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56100fe510 con 0x7f5610103760 2024-04-25T02:13:07.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.402+0000 7f55f77fe700 1 -- 172.21.15.77:0/3609584473 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 34) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f560401c7c0 con 0x7f5610103760 2024-04-25T02:13:07.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.402+0000 7f55f77fe700 1 --2- 172.21.15.77:0/3609584473 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f55f806da40 0x7f55f806fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:07.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.402+0000 7f55f77fe700 1 -- 172.21.15.77:0/3609584473 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f560408dca0 con 0x7f5610103760 2024-04-25T02:13:07.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.402+0000 7f560effd700 1 --2- 172.21.15.77:0/3609584473 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f55f806da40 0x7f55f806fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:07.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.403+0000 7f560effd700 1 --2- 172.21.15.77:0/3609584473 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f55f806da40 0x7f55f806fef0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f56000041d0 tx=0x7f56000043c0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:07.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.407+0000 7f55f77fe700 1 -- 172.21.15.77:0/3609584473 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f5604092070 con 0x7f5610103760 2024-04-25T02:13:07.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.649+0000 7f56158ae700 1 -- 172.21.15.77:0/3609584473 --> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f56100fa000 con 0x7f55f806da40 2024-04-25T02:13:07.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.651+0000 7f55f77fe700 1 -- 172.21.15.77:0/3609584473 <== mgr.14668 v2:172.21.15.77:6800/799251145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f56100fa000 con 0x7f55f806da40 2024-04-25T02:13:07.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.654+0000 7f56158ae700 1 -- 172.21.15.77:0/3609584473 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f55f806da40 msgr2=0x7f55f806fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:07.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.654+0000 7f56158ae700 1 --2- 172.21.15.77:0/3609584473 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f55f806da40 0x7f55f806fef0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f56000041d0 tx=0x7f56000043c0 comp rx=0 tx=0).stop 2024-04-25T02:13:07.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.654+0000 7f56158ae700 1 -- 172.21.15.77:0/3609584473 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5610103760 msgr2=0x7f56100707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:07.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.654+0000 7f56158ae700 1 --2- 172.21.15.77:0/3609584473 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5610103760 0x7f56100707a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f560400b3b0 tx=0x7f5604009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:07.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.654+0000 7f56158ae700 1 -- 172.21.15.77:0/3609584473 shutdown_connections 2024-04-25T02:13:07.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.654+0000 7f56158ae700 1 --2- 172.21.15.77:0/3609584473 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f55f806da40 0x7f55f806fef0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:07.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.654+0000 7f56158ae700 1 --2- 172.21.15.77:0/3609584473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5610102dc0 0x7f5610070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:07.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.654+0000 7f56158ae700 1 --2- 172.21.15.77:0/3609584473 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5610103760 0x7f56100707a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:07.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.654+0000 7f56158ae700 1 -- 172.21.15.77:0/3609584473 >> 172.21.15.77:0/3609584473 conn(0x7f56100f8930 msgr2=0x7f56100f98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:07.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.654+0000 7f56158ae700 1 -- 172.21.15.77:0/3609584473 shutdown_connections 2024-04-25T02:13:07.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.654+0000 7f56158ae700 1 -- 172.21.15.77:0/3609584473 wait complete. 2024-04-25T02:13:07.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.763+0000 7f6fad1fc700 1 -- 172.21.15.77:0/47140554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fa8102e00 msgr2=0x7f6fa81031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:07.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.763+0000 7f6fad1fc700 1 --2- 172.21.15.77:0/47140554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fa8102e00 0x7f6fa81031d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6f98004940 tx=0x7f6f98009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:07.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.763+0000 7f6fad1fc700 1 -- 172.21.15.77:0/47140554 shutdown_connections 2024-04-25T02:13:07.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.763+0000 7f6fad1fc700 1 --2- 172.21.15.77:0/47140554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fa81037a0 0x7f6fa80fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:07.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.763+0000 7f6fad1fc700 1 --2- 172.21.15.77:0/47140554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fa8102e00 0x7f6fa81031d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:07.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.763+0000 7f6fad1fc700 1 -- 172.21.15.77:0/47140554 >> 172.21.15.77:0/47140554 conn(0x7f6fa80f89b0 msgr2=0x7f6fa80fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:07.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.764+0000 7f6fad1fc700 1 -- 172.21.15.77:0/47140554 shutdown_connections 2024-04-25T02:13:07.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.764+0000 7f6fad1fc700 1 -- 172.21.15.77:0/47140554 wait complete. 2024-04-25T02:13:07.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.764+0000 7f6fad1fc700 1 Processor -- start 2024-04-25T02:13:07.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.764+0000 7f6fad1fc700 1 -- start start 2024-04-25T02:13:07.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.764+0000 7f6fad1fc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fa8102e00 0x7f6fa8070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:07.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.764+0000 7f6fad1fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fa81037a0 0x7f6fa80707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:07.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.764+0000 7f6fad1fc700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa8070ce0 con 0x7f6fa81037a0 2024-04-25T02:13:07.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.764+0000 7f6fad1fc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa8070e20 con 0x7f6fa8102e00 2024-04-25T02:13:07.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.765+0000 7f6fa659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fa81037a0 0x7f6fa80707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:07.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.765+0000 7f6fa659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fa81037a0 0x7f6fa80707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55754/0 (socket says 172.21.15.77:55754) 2024-04-25T02:13:07.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.765+0000 7f6fa659c700 1 -- 172.21.15.77:0/1584879536 learned_addr learned my addr 172.21.15.77:0/1584879536 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:13:07.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.765+0000 7f6fa6d9d700 1 --2- 172.21.15.77:0/1584879536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fa8102e00 0x7f6fa8070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:07.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.765+0000 7f6fa659c700 1 -- 172.21.15.77:0/1584879536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fa8102e00 msgr2=0x7f6fa8070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:07.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.765+0000 7f6fa659c700 1 --2- 172.21.15.77:0/1584879536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fa8102e00 0x7f6fa8070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:07.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.765+0000 7f6fa659c700 1 -- 172.21.15.77:0/1584879536 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f98005040 con 0x7f6fa81037a0 2024-04-25T02:13:07.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.765+0000 7f6fa659c700 1 --2- 172.21.15.77:0/1584879536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fa81037a0 0x7f6fa80707a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c00c800 tx=0x7f6f9c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:07.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.765+0000 7f6f8f7fe700 1 -- 172.21.15.77:0/1584879536 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f9c00a760 con 0x7f6fa81037a0 2024-04-25T02:13:07.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.765+0000 7f6fad1fc700 1 -- 172.21.15.77:0/1584879536 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa80710d0 con 0x7f6fa81037a0 2024-04-25T02:13:07.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.765+0000 7f6f8f7fe700 1 -- 172.21.15.77:0/1584879536 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6f9c00ad90 con 0x7f6fa81037a0 2024-04-25T02:13:07.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.765+0000 7f6f8f7fe700 1 -- 172.21.15.77:0/1584879536 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f9c0113a0 con 0x7f6fa81037a0 2024-04-25T02:13:07.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.765+0000 7f6fad1fc700 1 -- 172.21.15.77:0/1584879536 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa811a340 con 0x7f6fa81037a0 2024-04-25T02:13:07.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.766+0000 7f6fad1fc700 1 -- 172.21.15.77:0/1584879536 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa8100110 con 0x7f6fa81037a0 2024-04-25T02:13:07.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.767+0000 7f6f8f7fe700 1 -- 172.21.15.77:0/1584879536 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 34) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f6f9c012400 con 0x7f6fa81037a0 2024-04-25T02:13:07.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.767+0000 7f6f8f7fe700 1 --2- 172.21.15.77:0/1584879536 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f6f9006da40 0x7f6f9006fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:07.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.768+0000 7f6f8f7fe700 1 -- 172.21.15.77:0/1584879536 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f6f9c08d0c0 con 0x7f6fa81037a0 2024-04-25T02:13:07.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.768+0000 7f6fa6d9d700 1 --2- 172.21.15.77:0/1584879536 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f6f9006da40 0x7f6f9006fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:07.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.768+0000 7f6fa6d9d700 1 --2- 172.21.15.77:0/1584879536 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f6f9006da40 0x7f6f9006fef0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6f98004f90 tx=0x7f6f98009e30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:07.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.772+0000 7f6f8f7fe700 1 -- 172.21.15.77:0/1584879536 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f6f9c056c70 con 0x7f6fa81037a0 2024-04-25T02:13:07.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:07 smithi077 ceph-mon[26330]: pgmap v89: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:07.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:07 smithi077 ceph-mon[26330]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:13:07.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.989+0000 7f6fad1fc700 1 -- 172.21.15.77:0/1584879536 --> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6fa80710d0 con 0x7f6f9006da40 2024-04-25T02:13:08.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:07.999+0000 7f6f8f7fe700 1 -- 172.21.15.77:0/1584879536 <== mgr.14668 v2:172.21.15.77:6800/799251145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f6fa80710d0 con 0x7f6f9006da40 2024-04-25T02:13:08.005 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T02:13:08.005 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (78s) 55s ago 12m 17.0M - 0.25.0 c8568f914cd2 699c7fd25ea5 2024-04-25T02:13:08.005 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (12m) 55s ago 12m 6665k - 17.2.7-902-gc61472c8 0de407c1b3af 2ad2e3d2b09e 2024-04-25T02:13:08.005 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi112 smithi112 running (11m) 110s ago 11m 6660k - 17.2.7-902-gc61472c8 0de407c1b3af 9235dc5eb15d 2024-04-25T02:13:08.005 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (61s) 55s ago 11m 52.7M - 9.4.12 2bacad6d85d8 900138b0bcf0 2024-04-25T02:13:08.005 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.gcfygj smithi077 running (6m) 55s ago 6m 14.4M - 17.2.7-902-gc61472c8 0de407c1b3af 382dd7abf674 2024-04-25T02:13:08.005 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.oadrkb smithi077 running (6m) 55s ago 6m 12.8M - 17.2.7-902-gc61472c8 0de407c1b3af 6992064a4b2a 2024-04-25T02:13:08.006 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.dvwudt smithi112 running (6m) 110s ago 6m 158M - 17.2.7-902-gc61472c8 0de407c1b3af 0792e451abfd 2024-04-25T02:13:08.006 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.fjnadi smithi112 running (6m) 110s ago 6m 13.9M - 17.2.7-902-gc61472c8 0de407c1b3af c8093f622f6b 2024-04-25T02:13:08.006 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.zpflzp smithi077 *:8443,9283,8765 running (2m) 55s ago 13m 507M - 19.0.0-2445-gd2c45d97 f68e37b807ef a1af92e027e5 2024-04-25T02:13:08.006 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi112.cswrxs smithi112 *:8443,9283,8765 running (2m) 110s ago 11m 449M - 19.0.0-2445-gd2c45d97 f68e37b807ef ccc7c57d35f2 2024-04-25T02:13:08.006 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (13m) 55s ago 13m 55.5M 2048M 17.2.7-902-gc61472c8 0de407c1b3af adb57965a306 2024-04-25T02:13:08.006 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi112 smithi112 running (11m) 110s ago 11m 40.8M 2048M 17.2.7-902-gc61472c8 0de407c1b3af db2fb9b09789 2024-04-25T02:13:08.006 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (117s) 55s ago 12m 11.1M - 1.5.0 0da6a335fe13 2320132606fc 2024-04-25T02:13:08.006 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi112 smithi112 *:9100 running (113s) 110s ago 11m 3359k - 1.5.0 0da6a335fe13 49f285354791 2024-04-25T02:13:08.006 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (10m) 55s ago 10m 258M 1557M 17.2.7-902-gc61472c8 0de407c1b3af c741abec3b94 2024-04-25T02:13:08.006 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (10m) 55s ago 10m 258M 1557M 17.2.7-902-gc61472c8 0de407c1b3af 256ff3ced322 2024-04-25T02:13:08.006 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (9m) 55s ago 9m 221M 1557M 17.2.7-902-gc61472c8 0de407c1b3af c5d7d8c993f4 2024-04-25T02:13:08.006 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi112 running (9m) 110s ago 9m 288M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 68429d0dbf88 2024-04-25T02:13:08.006 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi112 running (8m) 110s ago 8m 258M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 66eb71201444 2024-04-25T02:13:08.006 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi112 running (8m) 110s ago 8m 236M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 963e700d6aea 2024-04-25T02:13:08.007 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (95s) 55s ago 11m 41.9M - 2.43.0 a07b618ecd1d c5b8c6104d96 2024-04-25T02:13:08.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.001+0000 7f6fad1fc700 1 -- 172.21.15.77:0/1584879536 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f6f9006da40 msgr2=0x7f6f9006fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:08.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.001+0000 7f6fad1fc700 1 --2- 172.21.15.77:0/1584879536 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f6f9006da40 0x7f6f9006fef0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6f98004f90 tx=0x7f6f98009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:08.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.001+0000 7f6fad1fc700 1 -- 172.21.15.77:0/1584879536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fa81037a0 msgr2=0x7f6fa80707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:08.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.001+0000 7f6fad1fc700 1 --2- 172.21.15.77:0/1584879536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fa81037a0 0x7f6fa80707a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c00c800 tx=0x7f6f9c004470 comp rx=0 tx=0).stop 2024-04-25T02:13:08.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.001+0000 7f6fad1fc700 1 -- 172.21.15.77:0/1584879536 shutdown_connections 2024-04-25T02:13:08.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.001+0000 7f6fad1fc700 1 --2- 172.21.15.77:0/1584879536 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f6f9006da40 0x7f6f9006fef0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:08.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.001+0000 7f6fad1fc700 1 --2- 172.21.15.77:0/1584879536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6fa8102e00 0x7f6fa8070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:08.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.001+0000 7f6fad1fc700 1 --2- 172.21.15.77:0/1584879536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6fa81037a0 0x7f6fa80707a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:08.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.001+0000 7f6fad1fc700 1 -- 172.21.15.77:0/1584879536 >> 172.21.15.77:0/1584879536 conn(0x7f6fa80f89b0 msgr2=0x7f6fa81073c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:08.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.001+0000 7f6fad1fc700 1 -- 172.21.15.77:0/1584879536 shutdown_connections 2024-04-25T02:13:08.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.001+0000 7f6fad1fc700 1 -- 172.21.15.77:0/1584879536 wait complete. 2024-04-25T02:13:08.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:07 smithi112 ceph-mon[33313]: pgmap v89: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:08.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:07 smithi112 ceph-mon[33313]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:13:08.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.103+0000 7f74859d8700 1 -- 172.21.15.77:0/2143946332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7480101e20 msgr2=0x7f74801021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:08.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.103+0000 7f74859d8700 1 --2- 172.21.15.77:0/2143946332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7480101e20 0x7f74801021f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7470004940 tx=0x7f7470009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:08.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.103+0000 7f74859d8700 1 -- 172.21.15.77:0/2143946332 shutdown_connections 2024-04-25T02:13:08.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.103+0000 7f74859d8700 1 --2- 172.21.15.77:0/2143946332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74800fc710 0x7f74800fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:08.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.103+0000 7f74859d8700 1 --2- 172.21.15.77:0/2143946332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7480101e20 0x7f74801021f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:08.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.103+0000 7f74859d8700 1 -- 172.21.15.77:0/2143946332 >> 172.21.15.77:0/2143946332 conn(0x7f7480071460 msgr2=0x7f7480071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:08.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.103+0000 7f74859d8700 1 -- 172.21.15.77:0/2143946332 shutdown_connections 2024-04-25T02:13:08.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.103+0000 7f74859d8700 1 -- 172.21.15.77:0/2143946332 wait complete. 2024-04-25T02:13:08.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.104+0000 7f74859d8700 1 Processor -- start 2024-04-25T02:13:08.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.104+0000 7f74859d8700 1 -- start start 2024-04-25T02:13:08.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.104+0000 7f74859d8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74800fc710 0x7f748010ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:08.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.104+0000 7f74859d8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7480101e20 0x7f748010f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:08.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.104+0000 7f74859d8700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748010f6e0 con 0x7f74800fc710 2024-04-25T02:13:08.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.104+0000 7f74859d8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748010f820 con 0x7f7480101e20 2024-04-25T02:13:08.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.104+0000 7f747effd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74800fc710 0x7f748010ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:08.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.104+0000 7f747effd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74800fc710 0x7f748010ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55778/0 (socket says 172.21.15.77:55778) 2024-04-25T02:13:08.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.104+0000 7f747effd700 1 -- 172.21.15.77:0/3635483035 learned_addr learned my addr 172.21.15.77:0/3635483035 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:13:08.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.104+0000 7f747e7fc700 1 --2- 172.21.15.77:0/3635483035 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7480101e20 0x7f748010f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:08.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.105+0000 7f747effd700 1 -- 172.21.15.77:0/3635483035 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7480101e20 msgr2=0x7f748010f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:08.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.105+0000 7f747effd700 1 --2- 172.21.15.77:0/3635483035 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7480101e20 0x7f748010f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:08.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.105+0000 7f747effd700 1 -- 172.21.15.77:0/3635483035 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7470005040 con 0x7f74800fc710 2024-04-25T02:13:08.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.105+0000 7f747e7fc700 1 --2- 172.21.15.77:0/3635483035 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7480101e20 0x7f748010f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:13:08.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.105+0000 7f747effd700 1 --2- 172.21.15.77:0/3635483035 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74800fc710 0x7f748010ec60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7470009b30 tx=0x7f7470009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:08.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.105+0000 7f74677fe700 1 -- 172.21.15.77:0/3635483035 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f747000e070 con 0x7f74800fc710 2024-04-25T02:13:08.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.105+0000 7f74859d8700 1 -- 172.21.15.77:0/3635483035 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7480117b10 con 0x7f74800fc710 2024-04-25T02:13:08.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.105+0000 7f74677fe700 1 -- 172.21.15.77:0/3635483035 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7470013cd0 con 0x7f74800fc710 2024-04-25T02:13:08.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.105+0000 7f74677fe700 1 -- 172.21.15.77:0/3635483035 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f747000b6e0 con 0x7f74800fc710 2024-04-25T02:13:08.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.105+0000 7f74859d8700 1 -- 172.21.15.77:0/3635483035 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7480117fc0 con 0x7f74800fc710 2024-04-25T02:13:08.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.106+0000 7f74859d8700 1 -- 172.21.15.77:0/3635483035 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7480104260 con 0x7f74800fc710 2024-04-25T02:13:08.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.106+0000 7f74677fe700 1 -- 172.21.15.77:0/3635483035 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 34) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f747001cab0 con 0x7f74800fc710 2024-04-25T02:13:08.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.107+0000 7f74677fe700 1 --2- 172.21.15.77:0/3635483035 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f746806da40 0x7f746806fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:08.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.107+0000 7f74677fe700 1 -- 172.21.15.77:0/3635483035 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f747008ebc0 con 0x7f74800fc710 2024-04-25T02:13:08.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.107+0000 7f747e7fc700 1 --2- 172.21.15.77:0/3635483035 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f746806da40 0x7f746806fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:08.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.107+0000 7f747e7fc700 1 --2- 172.21.15.77:0/3635483035 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f746806da40 0x7f746806fef0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7474004600 tx=0x7f747400b040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:08.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.111+0000 7f74677fe700 1 -- 172.21.15.77:0/3635483035 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f7470058770 con 0x7f74800fc710 2024-04-25T02:13:08.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.401+0000 7f74859d8700 1 -- 172.21.15.77:0/3635483035 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f748004bed0 con 0x7f74800fc710 2024-04-25T02:13:08.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.401+0000 7f74677fe700 1 -- 172.21.15.77:0/3635483035 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f7470004490 con 0x7f74800fc710 2024-04-25T02:13:08.407 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:13:08.407 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-04-25T02:13:08.407 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2 2024-04-25T02:13:08.408 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:13:08.408 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-04-25T02:13:08.408 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:13:08.408 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:13:08.408 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-04-25T02:13:08.408 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 6 2024-04-25T02:13:08.408 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:13:08.408 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-04-25T02:13:08.408 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T02:13:08.408 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:13:08.408 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-04-25T02:13:08.408 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 12, 2024-04-25T02:13:08.408 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:13:08.408 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-25T02:13:08.408 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:13:08.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.403+0000 7f74859d8700 1 -- 172.21.15.77:0/3635483035 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f746806da40 msgr2=0x7f746806fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:08.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.403+0000 7f74859d8700 1 --2- 172.21.15.77:0/3635483035 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f746806da40 0x7f746806fef0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7474004600 tx=0x7f747400b040 comp rx=0 tx=0).stop 2024-04-25T02:13:08.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.403+0000 7f74859d8700 1 -- 172.21.15.77:0/3635483035 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74800fc710 msgr2=0x7f748010ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:08.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.403+0000 7f74859d8700 1 --2- 172.21.15.77:0/3635483035 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74800fc710 0x7f748010ec60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7470009b30 tx=0x7f7470009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:08.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.403+0000 7f74859d8700 1 -- 172.21.15.77:0/3635483035 shutdown_connections 2024-04-25T02:13:08.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.403+0000 7f74859d8700 1 --2- 172.21.15.77:0/3635483035 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7f746806da40 0x7f746806fef0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:08.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.403+0000 7f74859d8700 1 --2- 172.21.15.77:0/3635483035 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74800fc710 0x7f748010ec60 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:08.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.403+0000 7f74859d8700 1 --2- 172.21.15.77:0/3635483035 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7480101e20 0x7f748010f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:08.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.403+0000 7f74859d8700 1 -- 172.21.15.77:0/3635483035 >> 172.21.15.77:0/3635483035 conn(0x7f7480071460 msgr2=0x7f74800f9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:08.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.404+0000 7f74859d8700 1 -- 172.21.15.77:0/3635483035 shutdown_connections 2024-04-25T02:13:08.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.404+0000 7f74859d8700 1 -- 172.21.15.77:0/3635483035 wait complete. 2024-04-25T02:13:08.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.516+0000 7ff437ca5700 1 -- 172.21.15.77:0/1221456110 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4300fde00 msgr2=0x7ff4300fe1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:08.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.516+0000 7ff437ca5700 1 --2- 172.21.15.77:0/1221456110 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4300fde00 0x7ff4300fe1d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff42c004940 tx=0x7ff42c009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:08.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.516+0000 7ff437ca5700 1 -- 172.21.15.77:0/1221456110 shutdown_connections 2024-04-25T02:13:08.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.516+0000 7ff437ca5700 1 --2- 172.21.15.77:0/1221456110 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4300fe7a0 0x7ff430106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:08.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.516+0000 7ff437ca5700 1 --2- 172.21.15.77:0/1221456110 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4300fde00 0x7ff4300fe1d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:08.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.516+0000 7ff437ca5700 1 -- 172.21.15.77:0/1221456110 >> 172.21.15.77:0/1221456110 conn(0x7ff4300f78d0 msgr2=0x7ff4300f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:08.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.516+0000 7ff437ca5700 1 -- 172.21.15.77:0/1221456110 shutdown_connections 2024-04-25T02:13:08.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.516+0000 7ff437ca5700 1 -- 172.21.15.77:0/1221456110 wait complete. 2024-04-25T02:13:08.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.516+0000 7ff437ca5700 1 Processor -- start 2024-04-25T02:13:08.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.516+0000 7ff437ca5700 1 -- start start 2024-04-25T02:13:08.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.517+0000 7ff437ca5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4300fde00 0x7ff430113b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:08.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.517+0000 7ff437ca5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4300fe7a0 0x7ff4301140b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:08.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.517+0000 7ff437ca5700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff430114700 con 0x7ff4300fe7a0 2024-04-25T02:13:08.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.517+0000 7ff437ca5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43010daf0 con 0x7ff4300fde00 2024-04-25T02:13:08.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.517+0000 7ff435240700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4300fe7a0 0x7ff4301140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:08.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.517+0000 7ff435240700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4300fe7a0 0x7ff4301140b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55806/0 (socket says 172.21.15.77:55806) 2024-04-25T02:13:08.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.517+0000 7ff435240700 1 -- 172.21.15.77:0/4268314300 learned_addr learned my addr 172.21.15.77:0/4268314300 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:13:08.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.517+0000 7ff435a41700 1 --2- 172.21.15.77:0/4268314300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4300fde00 0x7ff430113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:08.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.517+0000 7ff435240700 1 -- 172.21.15.77:0/4268314300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4300fde00 msgr2=0x7ff430113b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:08.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.517+0000 7ff435240700 1 --2- 172.21.15.77:0/4268314300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4300fde00 0x7ff430113b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:08.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.517+0000 7ff435240700 1 -- 172.21.15.77:0/4268314300 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42c005040 con 0x7ff4300fe7a0 2024-04-25T02:13:08.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.517+0000 7ff435a41700 1 --2- 172.21.15.77:0/4268314300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4300fde00 0x7ff430113b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:13:08.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.517+0000 7ff435240700 1 --2- 172.21.15.77:0/4268314300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4300fe7a0 0x7ff4301140b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff42000c830 tx=0x7ff420004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:08.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.517+0000 7ff4267fc700 1 -- 172.21.15.77:0/4268314300 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff42000a760 con 0x7ff4300fe7a0 2024-04-25T02:13:08.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.517+0000 7ff4267fc700 1 -- 172.21.15.77:0/4268314300 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff42000ad90 con 0x7ff4300fe7a0 2024-04-25T02:13:08.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.517+0000 7ff437ca5700 1 -- 172.21.15.77:0/4268314300 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff43010ddd0 con 0x7ff4300fe7a0 2024-04-25T02:13:08.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.518+0000 7ff4267fc700 1 -- 172.21.15.77:0/4268314300 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4200113a0 con 0x7ff4300fe7a0 2024-04-25T02:13:08.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.518+0000 7ff437ca5700 1 -- 172.21.15.77:0/4268314300 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43010e310 con 0x7ff4300fe7a0 2024-04-25T02:13:08.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.518+0000 7ff437ca5700 1 -- 172.21.15.77:0/4268314300 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff430066750 con 0x7ff4300fe7a0 2024-04-25T02:13:08.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.519+0000 7ff4267fc700 1 -- 172.21.15.77:0/4268314300 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 34) v1 ==== 91925+0+0 (secure 0 0 0) 0x7ff420012400 con 0x7ff4300fe7a0 2024-04-25T02:13:08.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.519+0000 7ff4267fc700 1 --2- 172.21.15.77:0/4268314300 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7ff41c06da40 0x7ff41c06fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:08.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.520+0000 7ff4267fc700 1 -- 172.21.15.77:0/4268314300 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7ff42008d230 con 0x7ff4300fe7a0 2024-04-25T02:13:08.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.520+0000 7ff435a41700 1 --2- 172.21.15.77:0/4268314300 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7ff41c06da40 0x7ff41c06fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:08.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.520+0000 7ff435a41700 1 --2- 172.21.15.77:0/4268314300 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7ff41c06da40 0x7ff41c06fef0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff42c000c00 tx=0x7ff42c009e30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:08.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.528+0000 7ff4267fc700 1 -- 172.21.15.77:0/4268314300 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7ff42005a9b0 con 0x7ff4300fe7a0 2024-04-25T02:13:08.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.779+0000 7ff437ca5700 1 -- 172.21.15.77:0/4268314300 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff430109e90 con 0x7ff4300fe7a0 2024-04-25T02:13:08.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.780+0000 7ff4267fc700 1 -- 172.21.15.77:0/4268314300 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1806 (secure 0 0 0) 0x7ff42005a540 con 0x7ff4300fe7a0 2024-04-25T02:13:08.786 INFO:teuthology.orchestra.run.smithi077.stdout:e15 2024-04-25T02:13:08.786 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T02:13:08.786 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:13:08.786 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-04-25T02:13:08.786 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:13:08.787 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-04-25T02:13:08.787 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-04-25T02:13:08.787 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 15 2024-04-25T02:13:08.787 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-25T02:13:08.787 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-04-25T02:06:10.008979+0000 2024-04-25T02:13:08.787 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-04-25T02:06:27.849984+0000 2024-04-25T02:13:08.787 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-04-25T02:13:08.787 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-04-25T02:13:08.787 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-04-25T02:13:08.787 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-04-25T02:13:08.787 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-04-25T02:13:08.787 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-04-25T02:13:08.787 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-04-25T02:13:08.787 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 47 2024-04-25T02:13:08.787 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:13:08.788 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-04-25T02:13:08.788 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-04-25T02:13:08.788 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=24257} 2024-04-25T02:13:08.788 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-04-25T02:13:08.788 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-04-25T02:13:08.788 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-04-25T02:13:08.788 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-04-25T02:13:08.788 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-04-25T02:13:08.788 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-04-25T02:13:08.788 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-04-25T02:13:08.788 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-04-25T02:13:08.788 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi112.dvwudt{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.112:6824/3687767796,v1:172.21.15.112:6825/3687767796] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:13:08.788 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:13:08.788 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:13:08.788 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-04-25T02:13:08.788 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:13:08.789 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.gcfygj{-1:14462} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/691698671,v1:172.21.15.77:6829/691698671] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:13:08.789 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.oadrkb{-1:14474} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.77:6826/26222645,v1:172.21.15.77:6827/26222645] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:13:08.789 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi112.fjnadi{-1:24269} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/2036319817,v1:172.21.15.112:6827/2036319817] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:13:08.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.782+0000 7ff437ca5700 1 -- 172.21.15.77:0/4268314300 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7ff41c06da40 msgr2=0x7ff41c06fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:08.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.782+0000 7ff437ca5700 1 --2- 172.21.15.77:0/4268314300 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7ff41c06da40 0x7ff41c06fef0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff42c000c00 tx=0x7ff42c009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:08.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.782+0000 7ff437ca5700 1 -- 172.21.15.77:0/4268314300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4300fe7a0 msgr2=0x7ff4301140b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:08.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.782+0000 7ff437ca5700 1 --2- 172.21.15.77:0/4268314300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4300fe7a0 0x7ff4301140b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff42000c830 tx=0x7ff420004470 comp rx=0 tx=0).stop 2024-04-25T02:13:08.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.782+0000 7ff437ca5700 1 -- 172.21.15.77:0/4268314300 shutdown_connections 2024-04-25T02:13:08.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.782+0000 7ff437ca5700 1 --2- 172.21.15.77:0/4268314300 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7ff41c06da40 0x7ff41c06fef0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:08.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.782+0000 7ff437ca5700 1 --2- 172.21.15.77:0/4268314300 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4300fde00 0x7ff430113b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:08.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.782+0000 7ff437ca5700 1 --2- 172.21.15.77:0/4268314300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4300fe7a0 0x7ff4301140b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:08.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.782+0000 7ff437ca5700 1 -- 172.21.15.77:0/4268314300 >> 172.21.15.77:0/4268314300 conn(0x7ff4300f78d0 msgr2=0x7ff4300f8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:08.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.782+0000 7ff437ca5700 1 -- 172.21.15.77:0/4268314300 shutdown_connections 2024-04-25T02:13:08.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.782+0000 7ff437ca5700 1 -- 172.21.15.77:0/4268314300 wait complete. 2024-04-25T02:13:08.790 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 15 2024-04-25T02:13:08.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.887+0000 7efe23d57700 1 -- 172.21.15.77:0/4049368502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe1c103780 msgr2=0x7efe1c0fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:08.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.887+0000 7efe23d57700 1 --2- 172.21.15.77:0/4049368502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe1c103780 0x7efe1c0fcdf0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7efe0c004940 tx=0x7efe0c009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:08.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.887+0000 7efe23d57700 1 -- 172.21.15.77:0/4049368502 shutdown_connections 2024-04-25T02:13:08.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.887+0000 7efe23d57700 1 --2- 172.21.15.77:0/4049368502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe1c103780 0x7efe1c0fcdf0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:08.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.887+0000 7efe23d57700 1 --2- 172.21.15.77:0/4049368502 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe1c102de0 0x7efe1c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:08.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.887+0000 7efe23d57700 1 -- 172.21.15.77:0/4049368502 >> 172.21.15.77:0/4049368502 conn(0x7efe1c0f8950 msgr2=0x7efe1c0fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:08.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.888+0000 7efe23d57700 1 -- 172.21.15.77:0/4049368502 shutdown_connections 2024-04-25T02:13:08.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.888+0000 7efe23d57700 1 -- 172.21.15.77:0/4049368502 wait complete. 2024-04-25T02:13:08.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.888+0000 7efe23d57700 1 Processor -- start 2024-04-25T02:13:08.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.888+0000 7efe23d57700 1 -- start start 2024-04-25T02:13:08.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.888+0000 7efe23d57700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe1c102de0 0x7efe1c10e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:08.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.889+0000 7efe23d57700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe1c103780 0x7efe1c10eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:08.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.889+0000 7efe23d57700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c10ba00 con 0x7efe1c103780 2024-04-25T02:13:08.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.889+0000 7efe23d57700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c10bb40 con 0x7efe1c102de0 2024-04-25T02:13:08.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.889+0000 7efe212f2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe1c103780 0x7efe1c10eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:08.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.889+0000 7efe212f2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe1c103780 0x7efe1c10eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55826/0 (socket says 172.21.15.77:55826) 2024-04-25T02:13:08.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.889+0000 7efe212f2700 1 -- 172.21.15.77:0/1181369915 learned_addr learned my addr 172.21.15.77:0/1181369915 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:13:08.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.889+0000 7efe212f2700 1 -- 172.21.15.77:0/1181369915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe1c102de0 msgr2=0x7efe1c10e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:08.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.889+0000 7efe212f2700 1 --2- 172.21.15.77:0/1181369915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe1c102de0 0x7efe1c10e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:08.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.889+0000 7efe212f2700 1 -- 172.21.15.77:0/1181369915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c005040 con 0x7efe1c103780 2024-04-25T02:13:08.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.889+0000 7efe212f2700 1 --2- 172.21.15.77:0/1181369915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe1c103780 0x7efe1c10eea0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7efe0c009180 tx=0x7efe0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:08.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.889+0000 7efe127fc700 1 -- 172.21.15.77:0/1181369915 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe0c00e040 con 0x7efe1c103780 2024-04-25T02:13:08.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.889+0000 7efe23d57700 1 -- 172.21.15.77:0/1181369915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe1c10bdc0 con 0x7efe1c103780 2024-04-25T02:13:08.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.889+0000 7efe127fc700 1 -- 172.21.15.77:0/1181369915 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe0c00bbc0 con 0x7efe1c103780 2024-04-25T02:13:08.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.889+0000 7efe127fc700 1 -- 172.21.15.77:0/1181369915 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe0c01c3f0 con 0x7efe1c103780 2024-04-25T02:13:08.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.889+0000 7efe23d57700 1 -- 172.21.15.77:0/1181369915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe1c10c380 con 0x7efe1c103780 2024-04-25T02:13:08.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.891+0000 7efe23d57700 1 -- 172.21.15.77:0/1181369915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe1c0fe530 con 0x7efe1c103780 2024-04-25T02:13:08.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.891+0000 7efe127fc700 1 -- 172.21.15.77:0/1181369915 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 34) v1 ==== 91925+0+0 (secure 0 0 0) 0x7efe0c01c6b0 con 0x7efe1c103780 2024-04-25T02:13:08.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.891+0000 7efe127fc700 1 --2- 172.21.15.77:0/1181369915 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7efe0806da40 0x7efe0806fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:08.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.892+0000 7efe127fc700 1 -- 172.21.15.77:0/1181369915 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7efe0c08e530 con 0x7efe1c103780 2024-04-25T02:13:08.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.892+0000 7efe21af3700 1 --2- 172.21.15.77:0/1181369915 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7efe0806da40 0x7efe0806fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:08.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.892+0000 7efe21af3700 1 --2- 172.21.15.77:0/1181369915 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7efe0806da40 0x7efe0806fef0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efe18004b70 tx=0x7efe18007cc0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:08.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:08.897+0000 7efe127fc700 1 -- 172.21.15.77:0/1181369915 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7efe0c058180 con 0x7efe1c103780 2024-04-25T02:13:08.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:08 smithi077 ceph-mon[26330]: from='client.14830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:13:08.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:08 smithi077 ceph-mon[26330]: from='client.14834 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:13:08.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:08 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/3635483035' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:13:08.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:08 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:08.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:08 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:13:08.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:08 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:13:08.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:08 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:08.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:08 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-25T02:13:09.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:08 smithi112 ceph-mon[33313]: from='client.14830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:13:09.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:08 smithi112 ceph-mon[33313]: from='client.14834 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:13:09.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:08 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/3635483035' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:13:09.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:08 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:09.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:08 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:13:09.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:08 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:13:09.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:08 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:09.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:08 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-25T02:13:09.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.134+0000 7efe23d57700 1 -- 172.21.15.77:0/1181369915 --> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efe1c109f30 con 0x7efe0806da40 2024-04-25T02:13:09.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.136+0000 7efe127fc700 1 -- 172.21.15.77:0/1181369915 <== mgr.14668 v2:172.21.15.77:6800/799251145 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7efe1c109f30 con 0x7efe0806da40 2024-04-25T02:13:09.142 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:13:09.142 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901", 2024-04-25T02:13:09.142 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-04-25T02:13:09.142 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T02:13:09.142 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-04-25T02:13:09.142 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr" 2024-04-25T02:13:09.142 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-25T02:13:09.142 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "2/21 daemons upgraded", 2024-04-25T02:13:09.142 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading mon daemons", 2024-04-25T02:13:09.143 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-04-25T02:13:09.143 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:13:09.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.138+0000 7efe23d57700 1 -- 172.21.15.77:0/1181369915 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7efe0806da40 msgr2=0x7efe0806fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:09.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.138+0000 7efe23d57700 1 --2- 172.21.15.77:0/1181369915 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7efe0806da40 0x7efe0806fef0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efe18004b70 tx=0x7efe18007cc0 comp rx=0 tx=0).stop 2024-04-25T02:13:09.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.138+0000 7efe23d57700 1 -- 172.21.15.77:0/1181369915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe1c103780 msgr2=0x7efe1c10eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:09.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.138+0000 7efe23d57700 1 --2- 172.21.15.77:0/1181369915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe1c103780 0x7efe1c10eea0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7efe0c009180 tx=0x7efe0c009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:09.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.138+0000 7efe23d57700 1 -- 172.21.15.77:0/1181369915 shutdown_connections 2024-04-25T02:13:09.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.138+0000 7efe23d57700 1 --2- 172.21.15.77:0/1181369915 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7efe0806da40 0x7efe0806fef0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:09.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.138+0000 7efe23d57700 1 --2- 172.21.15.77:0/1181369915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe1c102de0 0x7efe1c10e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:09.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.138+0000 7efe23d57700 1 --2- 172.21.15.77:0/1181369915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe1c103780 0x7efe1c10eea0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:09.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.138+0000 7efe23d57700 1 -- 172.21.15.77:0/1181369915 >> 172.21.15.77:0/1181369915 conn(0x7efe1c0f8950 msgr2=0x7efe1c070620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:09.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.138+0000 7efe23d57700 1 -- 172.21.15.77:0/1181369915 shutdown_connections 2024-04-25T02:13:09.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.138+0000 7efe23d57700 1 -- 172.21.15.77:0/1181369915 wait complete. 2024-04-25T02:13:09.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.243+0000 7fb553aea700 1 -- 172.21.15.77:0/3122293411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb54c101cd0 msgr2=0x7fb54c1020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:09.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.243+0000 7fb553aea700 1 --2- 172.21.15.77:0/3122293411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb54c101cd0 0x7fb54c1020a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb548004940 tx=0x7fb548009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:09.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.243+0000 7fb553aea700 1 -- 172.21.15.77:0/3122293411 shutdown_connections 2024-04-25T02:13:09.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.243+0000 7fb553aea700 1 --2- 172.21.15.77:0/3122293411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb54c102670 0x7fb54c0fb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:09.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.243+0000 7fb553aea700 1 --2- 172.21.15.77:0/3122293411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb54c101cd0 0x7fb54c1020a0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:09.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.243+0000 7fb553aea700 1 -- 172.21.15.77:0/3122293411 >> 172.21.15.77:0/3122293411 conn(0x7fb54c071460 msgr2=0x7fb54c071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:09.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.243+0000 7fb553aea700 1 -- 172.21.15.77:0/3122293411 shutdown_connections 2024-04-25T02:13:09.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.243+0000 7fb553aea700 1 -- 172.21.15.77:0/3122293411 wait complete. 2024-04-25T02:13:09.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.244+0000 7fb553aea700 1 Processor -- start 2024-04-25T02:13:09.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.244+0000 7fb553aea700 1 -- start start 2024-04-25T02:13:09.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.244+0000 7fb553aea700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb54c101cd0 0x7fb54c113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:09.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.244+0000 7fb553aea700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb54c102670 0x7fb54c1140e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:09.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.244+0000 7fb553aea700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c114730 con 0x7fb54c101cd0 2024-04-25T02:13:09.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.244+0000 7fb553aea700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c10db20 con 0x7fb54c102670 2024-04-25T02:13:09.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.244+0000 7fb551886700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb54c101cd0 0x7fb54c113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:09.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.244+0000 7fb551886700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb54c101cd0 0x7fb54c113ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55856/0 (socket says 172.21.15.77:55856) 2024-04-25T02:13:09.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.244+0000 7fb551886700 1 -- 172.21.15.77:0/1634754162 learned_addr learned my addr 172.21.15.77:0/1634754162 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:13:09.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.244+0000 7fb551886700 1 -- 172.21.15.77:0/1634754162 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb54c102670 msgr2=0x7fb54c1140e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:09.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.244+0000 7fb551886700 1 --2- 172.21.15.77:0/1634754162 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb54c102670 0x7fb54c1140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:09.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.244+0000 7fb551886700 1 -- 172.21.15.77:0/1634754162 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb548005040 con 0x7fb54c101cd0 2024-04-25T02:13:09.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.245+0000 7fb551886700 1 --2- 172.21.15.77:0/1634754162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb54c101cd0 0x7fb54c113ba0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb548009150 tx=0x7fb548009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:09.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.245+0000 7fb5427fc700 1 -- 172.21.15.77:0/1634754162 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb54800e040 con 0x7fb54c101cd0 2024-04-25T02:13:09.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.245+0000 7fb5427fc700 1 -- 172.21.15.77:0/1634754162 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb548013420 con 0x7fb54c101cd0 2024-04-25T02:13:09.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.245+0000 7fb553aea700 1 -- 172.21.15.77:0/1634754162 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54c10dda0 con 0x7fb54c101cd0 2024-04-25T02:13:09.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.245+0000 7fb553aea700 1 -- 172.21.15.77:0/1634754162 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54c10e360 con 0x7fb54c101cd0 2024-04-25T02:13:09.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.245+0000 7fb5427fc700 1 -- 172.21.15.77:0/1634754162 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb54801c630 con 0x7fb54c101cd0 2024-04-25T02:13:09.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.246+0000 7fb553aea700 1 -- 172.21.15.77:0/1634754162 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5300052b0 con 0x7fb54c101cd0 2024-04-25T02:13:09.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.247+0000 7fb5427fc700 1 -- 172.21.15.77:0/1634754162 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 34) v1 ==== 91925+0+0 (secure 0 0 0) 0x7fb548013590 con 0x7fb54c101cd0 2024-04-25T02:13:09.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.247+0000 7fb5427fc700 1 --2- 172.21.15.77:0/1634754162 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fb53806da50 0x7fb53806ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:09.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.247+0000 7fb5427fc700 1 -- 172.21.15.77:0/1634754162 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fb54808e340 con 0x7fb54c101cd0 2024-04-25T02:13:09.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.247+0000 7fb551085700 1 --2- 172.21.15.77:0/1634754162 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fb53806da50 0x7fb53806ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:09.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.247+0000 7fb551085700 1 --2- 172.21.15.77:0/1634754162 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fb53806da50 0x7fb53806ff00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb54c10ece0 tx=0x7fb53c007cc0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:09.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.252+0000 7fb5427fc700 1 -- 172.21.15.77:0/1634754162 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7fb54805bb60 con 0x7fb54c101cd0 2024-04-25T02:13:09.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.545+0000 7fb553aea700 1 -- 172.21.15.77:0/1634754162 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb530005560 con 0x7fb54c101cd0 2024-04-25T02:13:09.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.546+0000 7fb5427fc700 1 -- 172.21.15.77:0/1634754162 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fb54805b6f0 con 0x7fb54c101cd0 2024-04-25T02:13:09.552 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-04-25T02:13:09.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.548+0000 7fb553aea700 1 -- 172.21.15.77:0/1634754162 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fb53806da50 msgr2=0x7fb53806ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:09.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.548+0000 7fb553aea700 1 --2- 172.21.15.77:0/1634754162 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fb53806da50 0x7fb53806ff00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb54c10ece0 tx=0x7fb53c007cc0 comp rx=0 tx=0).stop 2024-04-25T02:13:09.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.548+0000 7fb553aea700 1 -- 172.21.15.77:0/1634754162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb54c101cd0 msgr2=0x7fb54c113ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:09.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.548+0000 7fb553aea700 1 --2- 172.21.15.77:0/1634754162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb54c101cd0 0x7fb54c113ba0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb548009150 tx=0x7fb548009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:09.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.548+0000 7fb553aea700 1 -- 172.21.15.77:0/1634754162 shutdown_connections 2024-04-25T02:13:09.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.548+0000 7fb553aea700 1 --2- 172.21.15.77:0/1634754162 >> [v2:172.21.15.77:6800/799251145,v1:172.21.15.77:6801/799251145] conn(0x7fb53806da50 0x7fb53806ff00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:09.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.548+0000 7fb553aea700 1 --2- 172.21.15.77:0/1634754162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb54c101cd0 0x7fb54c113ba0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:09.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.548+0000 7fb553aea700 1 --2- 172.21.15.77:0/1634754162 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb54c102670 0x7fb54c1140e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:09.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.548+0000 7fb553aea700 1 -- 172.21.15.77:0/1634754162 >> 172.21.15.77:0/1634754162 conn(0x7fb54c071460 msgr2=0x7fb54c0f9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:09.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.548+0000 7fb553aea700 1 -- 172.21.15.77:0/1634754162 shutdown_connections 2024-04-25T02:13:09.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:09.548+0000 7fb553aea700 1 -- 172.21.15.77:0/1634754162 wait complete. 2024-04-25T02:13:10.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:09 smithi112 ceph-mon[33313]: Upgrade: Target is version 19.0.0-2445-gd2c45d97 (squid) 2024-04-25T02:13:10.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:09 smithi112 ceph-mon[33313]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901'] 2024-04-25T02:13:10.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:09 smithi112 ceph-mon[33313]: Upgrade: Setting container_image for all mgr 2024-04-25T02:13:10.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:09 smithi112 ceph-mon[33313]: pgmap v90: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:10.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:09 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/4268314300' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:13:10.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:09 smithi112 ceph-mon[33313]: from='client.14846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:13:10.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:09 smithi112 ceph-mon[33313]: from='client.? 172.21.15.77:0/1634754162' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T02:13:10.134 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:09 smithi077 ceph-mon[26330]: Upgrade: Target is version 19.0.0-2445-gd2c45d97 (squid) 2024-04-25T02:13:10.134 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:09 smithi077 ceph-mon[26330]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901'] 2024-04-25T02:13:10.135 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:09 smithi077 ceph-mon[26330]: Upgrade: Setting container_image for all mgr 2024-04-25T02:13:10.135 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:09 smithi077 ceph-mon[26330]: pgmap v90: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:10.135 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:09 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/4268314300' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:13:10.135 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:09 smithi077 ceph-mon[26330]: from='client.14846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:13:10.135 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:09 smithi077 ceph-mon[26330]: from='client.? 172.21.15.77:0/1634754162' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T02:13:11.419 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:11 smithi077 ceph-mon[26330]: Upgrade: Updating mon.smithi077 2024-04-25T02:13:11.419 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:11 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:11.419 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:11 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:13:11.419 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:11 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T02:13:11.419 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:11 smithi077 ceph-mon[26330]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:13:11.420 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:11 smithi077 ceph-mon[26330]: Deploying daemon mon.smithi077 on smithi077 2024-04-25T02:13:11.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:11 smithi112 ceph-mon[33313]: Upgrade: Updating mon.smithi077 2024-04-25T02:13:11.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:11 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:11.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:11 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:13:11.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:11 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T02:13:11.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:11 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:13:11.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:11 smithi112 ceph-mon[33313]: Deploying daemon mon.smithi077 on smithi077 2024-04-25T02:13:12.329 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:12 smithi077 systemd[1]: Stopping Ceph mon.smithi077 for 4bb93d82-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:13:12.329 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:12 smithi077 ceph-mon[26330]: pgmap v91: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:12.329 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:12 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi077[26326]: 2024-04-25T02:13:12.300+0000 7fab0eb1e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi077 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:13:12.329 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:12 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi077[26326]: 2024-04-25T02:13:12.300+0000 7fab0eb1e700 -1 mon.smithi077@0(leader) e2 *** Got Signal Terminated *** 2024-04-25T02:13:12.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:12 smithi112 ceph-mon[33313]: pgmap v91: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:12.642 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:12 smithi077 podman[110267]: 2024-04-25 02:13:12.348879693 +0000 UTC m=+0.141755892 container died adb57965a306d2c8d91a35d5e8d13e6576037a1dc774ee46816d4486f2155519 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi077, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=quincy-c61472c) 2024-04-25T02:13:12.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:12 smithi077 podman[110267]: 2024-04-25 02:13:12.735648702 +0000 UTC m=+0.528524903 container cleanup adb57965a306d2c8d91a35d5e8d13e6576037a1dc774ee46816d4486f2155519 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi077, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, RELEASE=quincy-c61472c, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-04-25T02:13:12.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:12 smithi077 bash[110267]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi077 2024-04-25T02:13:13.363 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:12 smithi077 podman[110292]: 2024-04-25 02:13:12.978886174 +0000 UTC m=+0.628119111 container remove adb57965a306d2c8d91a35d5e8d13e6576037a1dc774ee46816d4486f2155519 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi077, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=quincy-c61472c, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T02:13:13.363 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 systemd[1]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@mon.smithi077.service: Deactivated successfully. 2024-04-25T02:13:13.363 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 systemd[1]: Stopped Ceph mon.smithi077 for 4bb93d82-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:13:13.363 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 systemd[1]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@mon.smithi077.service: Consumed 12.614s CPU time. 2024-04-25T02:13:13.726 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 systemd[1]: Starting Ceph mon.smithi077 for 4bb93d82-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:13:13.726 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 podman[110422]: 2024-04-25 02:13:13.572292513 +0000 UTC m=+0.113849386 container create 06490c2ecc449edf566ac9ec9f04ab5b8888478e05a1ed4ba67e37fa05f178d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi077, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-d2c45d9, org.label-schema.schema-version=1.0) 2024-04-25T02:13:13.726 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 podman[110422]: 2024-04-25 02:13:13.476248373 +0000 UTC m=+0.017805232 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:13:13.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 podman[110422]: 2024-04-25 02:13:13.81690366 +0000 UTC m=+0.358460492 container init 06490c2ecc449edf566ac9ec9f04ab5b8888478e05a1ed4ba67e37fa05f178d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi077, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-04-25T02:13:13.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 podman[110422]: 2024-04-25 02:13:13.81997789 +0000 UTC m=+0.361534724 container start 06490c2ecc449edf566ac9ec9f04ab5b8888478e05a1ed4ba67e37fa05f178d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi077, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, ceph=True, RELEASE=squid-d2c45d9) 2024-04-25T02:13:13.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: set uid:gid to 167:167 (ceph:ceph) 2024-04-25T02:13:13.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev), process ceph-mon, pid 2 2024-04-25T02:13:13.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: pidfile_write: ignore empty --pid-file 2024-04-25T02:13:13.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: load: jerasure load: lrc 2024-04-25T02:13:13.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: RocksDB version: 7.9.2 2024-04-25T02:13:13.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Git sha 0 2024-04-25T02:13:13.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Compile date 2024-04-24 16:41:23 2024-04-25T02:13:13.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: DB SUMMARY 2024-04-25T02:13:13.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: DB Session ID: HH1JDCBOS7LHT6T70CYP 2024-04-25T02:13:13.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: CURRENT file: CURRENT 2024-04-25T02:13:13.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: IDENTITY file: IDENTITY 2024-04-25T02:13:13.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1166 Bytes 2024-04-25T02:13:13.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi077/store.db dir, Total Num: 1, files: 000033.sst 2024-04-25T02:13:13.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi077/store.db: 000031.log size: 1725573 ; 2024-04-25T02:13:13.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.error_if_exists: 0 2024-04-25T02:13:13.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.create_if_missing: 0 2024-04-25T02:13:13.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.paranoid_checks: 1 2024-04-25T02:13:13.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-25T02:13:13.981 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-25T02:13:13.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-25T02:13:13.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.env: 0x560041dacc60 2024-04-25T02:13:13.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.fs: PosixFileSystem 2024-04-25T02:13:13.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.info_log: 0x560042b45960 2024-04-25T02:13:13.982 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.max_file_opening_threads: 16 2024-04-25T02:13:13.983 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.statistics: (nil) 2024-04-25T02:13:13.983 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.use_fsync: 0 2024-04-25T02:13:13.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.max_log_file_size: 0 2024-04-25T02:13:13.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-25T02:13:13.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-25T02:13:13.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.keep_log_file_num: 1000 2024-04-25T02:13:13.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.recycle_log_file_num: 0 2024-04-25T02:13:13.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.allow_fallocate: 1 2024-04-25T02:13:13.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.allow_mmap_reads: 0 2024-04-25T02:13:13.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.allow_mmap_writes: 0 2024-04-25T02:13:13.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.use_direct_reads: 0 2024-04-25T02:13:13.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-25T02:13:13.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.create_missing_column_families: 0 2024-04-25T02:13:13.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.db_log_dir: 2024-04-25T02:13:13.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.wal_dir: 2024-04-25T02:13:13.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-25T02:13:13.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-25T02:13:13.984 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-25T02:13:13.985 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-25T02:13:13.985 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-25T02:13:13.985 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-25T02:13:13.985 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.advise_random_on_open: 1 2024-04-25T02:13:13.985 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.db_write_buffer_size: 0 2024-04-25T02:13:13.985 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.write_buffer_manager: 0x560042b181e0 2024-04-25T02:13:13.985 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-25T02:13:13.985 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-25T02:13:13.985 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-25T02:13:13.985 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.rate_limiter: (nil) 2024-04-25T02:13:13.985 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-25T02:13:13.985 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.wal_recovery_mode: 2 2024-04-25T02:13:13.985 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.enable_thread_tracking: 0 2024-04-25T02:13:13.985 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.enable_pipelined_write: 0 2024-04-25T02:13:13.986 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.unordered_write: 0 2024-04-25T02:13:13.986 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-25T02:13:13.986 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-25T02:13:13.986 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-25T02:13:13.986 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-25T02:13:13.986 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.row_cache: None 2024-04-25T02:13:13.986 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.wal_filter: None 2024-04-25T02:13:13.986 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-25T02:13:13.986 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.allow_ingest_behind: 0 2024-04-25T02:13:13.986 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.two_write_queues: 0 2024-04-25T02:13:13.986 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.manual_wal_flush: 0 2024-04-25T02:13:13.986 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.wal_compression: 0 2024-04-25T02:13:13.986 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.atomic_flush: 0 2024-04-25T02:13:13.987 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-25T02:13:13.987 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-25T02:13:13.987 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-25T02:13:13.987 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.log_readahead_size: 0 2024-04-25T02:13:13.987 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-25T02:13:13.987 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.best_efforts_recovery: 0 2024-04-25T02:13:13.987 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-25T02:13:13.987 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-25T02:13:13.987 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.allow_data_in_errors: 0 2024-04-25T02:13:13.987 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.db_host_id: __hostname__ 2024-04-25T02:13:13.987 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-25T02:13:13.987 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.max_background_jobs: 2 2024-04-25T02:13:13.987 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.max_background_compactions: -1 2024-04-25T02:13:13.987 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.max_subcompactions: 1 2024-04-25T02:13:13.988 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-25T02:13:13.988 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-25T02:13:13.988 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-25T02:13:13.988 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.max_total_wal_size: 0 2024-04-25T02:13:13.988 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-25T02:13:13.988 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-25T02:13:13.988 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-25T02:13:13.988 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-25T02:13:13.988 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.max_open_files: -1 2024-04-25T02:13:13.988 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.bytes_per_sync: 0 2024-04-25T02:13:13.988 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-25T02:13:13.988 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-25T02:13:13.988 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.compaction_readahead_size: 0 2024-04-25T02:13:13.988 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.max_background_flushes: -1 2024-04-25T02:13:13.988 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Compression algorithms supported: 2024-04-25T02:13:13.988 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-25T02:13:13.989 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: kZSTD supported: 0 2024-04-25T02:13:13.989 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: kXpressCompression supported: 0 2024-04-25T02:13:13.989 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: kLZ4HCCompression supported: 1 2024-04-25T02:13:13.989 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: kZlibCompression supported: 1 2024-04-25T02:13:13.989 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: kSnappyCompression supported: 1 2024-04-25T02:13:13.989 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: kLZ4Compression supported: 1 2024-04-25T02:13:13.989 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: kBZip2Compression supported: 0 2024-04-25T02:13:13.989 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-25T02:13:13.989 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-25T02:13:13.989 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi077/store.db/MANIFEST-000015 2024-04-25T02:13:13.989 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-25T02:13:13.989 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-25T02:13:13.989 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.merge_operator: 2024-04-25T02:13:13.989 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.compaction_filter: None 2024-04-25T02:13:13.989 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.compaction_filter_factory: None 2024-04-25T02:13:13.990 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.sst_partitioner_factory: None 2024-04-25T02:13:13.990 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-25T02:13:13.990 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-25T02:13:13.990 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560042b45a60) 2024-04-25T02:13:13.990 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: cache_index_and_filter_blocks: 1 2024-04-25T02:13:13.990 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-25T02:13:13.990 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-25T02:13:13.990 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: pin_top_level_index_and_filter: 1 2024-04-25T02:13:13.990 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: index_type: 0 2024-04-25T02:13:13.990 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: data_block_index_type: 0 2024-04-25T02:13:13.990 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: index_shortening: 1 2024-04-25T02:13:13.990 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-25T02:13:13.990 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: checksum: 4 2024-04-25T02:13:13.990 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: no_block_cache: 0 2024-04-25T02:13:13.990 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_cache: 0x560042b49090 2024-04-25T02:13:13.991 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_cache_name: BinnedLRUCache 2024-04-25T02:13:13.991 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_cache_options: 2024-04-25T02:13:13.991 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: capacity : 536870912 2024-04-25T02:13:13.991 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: num_shard_bits : 4 2024-04-25T02:13:13.991 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: strict_capacity_limit : 0 2024-04-25T02:13:13.991 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: high_pri_pool_ratio: 0.000 2024-04-25T02:13:13.991 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_cache_compressed: (nil) 2024-04-25T02:13:13.991 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: persistent_cache: (nil) 2024-04-25T02:13:13.991 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_size: 4096 2024-04-25T02:13:13.991 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_size_deviation: 10 2024-04-25T02:13:13.991 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_restart_interval: 16 2024-04-25T02:13:13.991 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: index_block_restart_interval: 1 2024-04-25T02:13:13.991 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: metadata_block_size: 4096 2024-04-25T02:13:13.991 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: partition_filters: 0 2024-04-25T02:13:13.991 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: use_delta_encoding: 1 2024-04-25T02:13:13.992 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: filter_policy: bloomfilter 2024-04-25T02:13:13.992 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: whole_key_filtering: 1 2024-04-25T02:13:13.992 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: verify_compression: 0 2024-04-25T02:13:13.992 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: read_amp_bytes_per_bit: 0 2024-04-25T02:13:13.992 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: format_version: 5 2024-04-25T02:13:13.992 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: enable_index_compression: 1 2024-04-25T02:13:13.992 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_align: 0 2024-04-25T02:13:13.992 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: max_auto_readahead_size: 262144 2024-04-25T02:13:13.992 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: prepopulate_block_cache: 0 2024-04-25T02:13:13.992 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: initial_auto_readahead_size: 8192 2024-04-25T02:13:13.992 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: num_file_reads_for_auto_readahead: 2 2024-04-25T02:13:13.992 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.write_buffer_size: 33554432 2024-04-25T02:13:13.992 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.max_write_buffer_number: 2 2024-04-25T02:13:13.993 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.compression: NoCompression 2024-04-25T02:13:13.993 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.bottommost_compression: Disabled 2024-04-25T02:13:13.993 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.prefix_extractor: nullptr 2024-04-25T02:13:13.993 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-25T02:13:13.993 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.num_levels: 7 2024-04-25T02:13:13.993 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-25T02:13:13.993 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-25T02:13:13.993 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-25T02:13:13.993 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-25T02:13:13.993 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-25T02:13:13.993 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-25T02:13:13.993 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-25T02:13:13.993 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-25T02:13:13.993 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-25T02:13:13.993 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-25T02:13:13.993 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-25T02:13:13.994 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-25T02:13:13.994 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-25T02:13:13.994 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.compression_opts.level: 32767 2024-04-25T02:13:13.994 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.compression_opts.strategy: 0 2024-04-25T02:13:13.994 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-25T02:13:13.994 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-25T02:13:13.994 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-25T02:13:13.994 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-25T02:13:13.994 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.compression_opts.enabled: false 2024-04-25T02:13:13.994 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-25T02:13:13.994 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-25T02:13:13.994 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-25T02:13:13.994 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-25T02:13:13.994 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.target_file_size_base: 67108864 2024-04-25T02:13:13.995 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-25T02:13:13.995 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-25T02:13:13.995 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-25T02:13:13.995 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-25T02:13:13.995 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-25T02:13:13.995 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-25T02:13:13.995 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-25T02:13:13.995 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-25T02:13:13.995 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-25T02:13:13.995 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-25T02:13:13.995 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-25T02:13:13.995 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-25T02:13:13.995 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-25T02:13:13.995 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-25T02:13:13.996 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.arena_block_size: 1048576 2024-04-25T02:13:13.996 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-25T02:13:13.996 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-25T02:13:13.996 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.disable_auto_compactions: 0 2024-04-25T02:13:13.996 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-25T02:13:13.996 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-25T02:13:13.996 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-25T02:13:13.996 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-25T02:13:13.996 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-25T02:13:13.996 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-25T02:13:13.996 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-25T02:13:13.996 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-25T02:13:13.996 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-25T02:13:13.996 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-25T02:13:13.996 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.table_properties_collectors: 2024-04-25T02:13:13.996 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.inplace_update_support: 0 2024-04-25T02:13:13.997 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-25T02:13:13.997 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-25T02:13:13.997 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-25T02:13:13.997 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-25T02:13:13.997 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.bloom_locality: 0 2024-04-25T02:13:13.997 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.max_successive_merges: 0 2024-04-25T02:13:13.997 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-25T02:13:13.997 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.paranoid_file_checks: 0 2024-04-25T02:13:13.997 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.force_consistency_checks: 1 2024-04-25T02:13:13.997 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.report_bg_io_stats: 0 2024-04-25T02:13:13.997 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.ttl: 2592000 2024-04-25T02:13:13.997 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-25T02:13:13.997 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-25T02:13:13.997 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-25T02:13:13.997 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.enable_blob_files: false 2024-04-25T02:13:13.997 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.min_blob_size: 0 2024-04-25T02:13:13.998 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.blob_file_size: 268435456 2024-04-25T02:13:13.998 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-25T02:13:13.998 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-25T02:13:13.998 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-25T02:13:13.998 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-25T02:13:13.998 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-25T02:13:13.998 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.blob_file_starting_level: 0 2024-04-25T02:13:13.998 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-25T02:13:13.998 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 33.sst 2024-04-25T02:13:13.998 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-25T02:13:13.998 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi077/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 35, last_sequence is 12016, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-25T02:13:13.998 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2024-04-25T02:13:13.998 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8dd475b3-51d4-4330-9ef2-27d90d7c1e8d 2024-04-25T02:13:13.998 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714011193849336, "job": 1, "event": "recovery_started", "wal_files": [31]} 2024-04-25T02:13:13.998 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2024-04-25T02:13:13.999 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714011193855207, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 1545060, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12017, "largest_seqno": 13437, "table_properties": {"data_size": 1538458, "index_size": 3923, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1669, "raw_key_size": 15848, "raw_average_key_size": 24, "raw_value_size": 1524641, "raw_average_value_size": 2349, "num_data_blocks": 178, "num_entries": 649, "num_filter_entries": 649, "num_deletions": 7, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714011193, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8dd475b3-51d4-4330-9ef2-27d90d7c1e8d", "db_session_id": "HH1JDCBOS7LHT6T70CYP", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2024-04-25T02:13:13.999 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714011193855278, "job": 1, "event": "recovery_finished"} 2024-04-25T02:13:13.999 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2024-04-25T02:13:13.999 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-25T02:13:13.999 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi077/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-25T02:13:13.999 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x560042c3a000 2024-04-25T02:13:13.999 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: DB pointer 0x560042c24000 2024-04-25T02:13:13.999 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-25T02:13:13.999 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-25T02:13:13.999 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ** DB Stats ** 2024-04-25T02:13:13.999 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T02:13:13.999 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-25T02:13:13.999 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T02:13:13.999 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T02:13:13.999 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-25T02:13:14.000 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T02:13:14.000 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T02:13:14.000 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-04-25T02:13:14.000 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ** Compaction Stats [default] ** 2024-04-25T02:13:14.000 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-25T02:13:14.000 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-25T02:13:14.000 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: L0 1/0 1.47 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 486.9 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-04-25T02:13:14.000 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: L6 1/0 7.06 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-25T02:13:14.000 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Sum 2/0 8.53 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 486.9 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-04-25T02:13:14.000 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 486.9 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-04-25T02:13:14.000 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-04-25T02:13:14.000 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ** Compaction Stats [default] ** 2024-04-25T02:13:14.000 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-25T02:13:14.000 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T02:13:14.000 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 486.9 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-04-25T02:13:14.000 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-04-25T02:13:14.001 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-25T02:13:14.001 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-04-25T02:13:14.001 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T02:13:14.001 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-04-25T02:13:14.001 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-25T02:13:14.001 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-25T02:13:14.001 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-25T02:13:14.001 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-25T02:13:14.001 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Cumulative compaction: 0.00 GB write, 161.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T02:13:14.001 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Interval compaction: 0.00 GB write, 161.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T02:13:14.001 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-25T02:13:14.001 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Block cache BinnedLRUCache@0x560042b49090#2 capacity: 512.00 MB usage: 5.86 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-04-25T02:13:14.001 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.78 KB,0.000339746%) IndexBlock(1,4.08 KB,0.000777841%) Misc(1,0.00 KB,0%) 2024-04-25T02:13:14.001 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-04-25T02:13:14.001 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-25T02:13:14.001 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: starting mon.smithi077 rank 0 at public addrs [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] at bind addrs [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi077 fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 2024-04-25T02:13:14.002 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: mon.smithi077@-1(???) e2 preinit fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 2024-04-25T02:13:14.002 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: mon.smithi077@-1(???).mds e15 new map 2024-04-25T02:13:14.002 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: mon.smithi077@-1(???).mds e15 print_map 2024-04-25T02:13:14.002 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: e15 2024-04-25T02:13:14.002 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T02:13:14.002 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:13:14.002 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: legacy client fscid: 1 2024-04-25T02:13:14.002 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-04-25T02:13:14.002 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Filesystem 'cephfs' (1) 2024-04-25T02:13:14.002 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: fs_name cephfs 2024-04-25T02:13:14.003 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: epoch 15 2024-04-25T02:13:14.003 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-25T02:13:14.003 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: created 2024-04-25T02:06:10.008979+0000 2024-04-25T02:13:14.003 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: modified 2024-04-25T02:06:27.849984+0000 2024-04-25T02:13:14.003 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: tableserver 0 2024-04-25T02:13:14.003 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: root 0 2024-04-25T02:13:14.003 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: session_timeout 60 2024-04-25T02:13:14.003 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: session_autoclose 300 2024-04-25T02:13:14.003 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: max_file_size 1099511627776 2024-04-25T02:13:14.003 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: max_xattr_size 65536 2024-04-25T02:13:14.003 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: required_client_features {} 2024-04-25T02:13:14.003 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: last_failure 0 2024-04-25T02:13:14.003 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: last_failure_osd_epoch 47 2024-04-25T02:13:14.003 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:13:14.003 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: max_mds 1 2024-04-25T02:13:14.003 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: in 0 2024-04-25T02:13:14.004 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: up {0=24257} 2024-04-25T02:13:14.004 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: failed 2024-04-25T02:13:14.004 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: damaged 2024-04-25T02:13:14.004 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: stopped 2024-04-25T02:13:14.004 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: data_pools [3] 2024-04-25T02:13:14.004 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: metadata_pool 2 2024-04-25T02:13:14.004 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: inline_data disabled 2024-04-25T02:13:14.004 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: balancer 2024-04-25T02:13:14.004 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: bal_rank_mask -1 2024-04-25T02:13:14.004 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: standby_count_wanted 1 2024-04-25T02:13:14.004 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: qdb_cluster leader: 0 members: 2024-04-25T02:13:14.005 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: [mds.cephfs.smithi112.dvwudt{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.112:6824/3687767796,v1:172.21.15.112:6825/3687767796] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:13:14.005 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-04-25T02:13:14.005 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-04-25T02:13:14.005 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Standby daemons: 2024-04-25T02:13:14.005 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-04-25T02:13:14.005 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: [mds.cephfs.smithi077.gcfygj{-1:14462} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/691698671,v1:172.21.15.77:6829/691698671] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:13:14.005 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: [mds.cephfs.smithi077.oadrkb{-1:14474} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.77:6826/26222645,v1:172.21.15.77:6827/26222645] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:13:14.005 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: [mds.cephfs.smithi112.fjnadi{-1:24269} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/2036319817,v1:172.21.15.112:6827/2036319817] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:13:14.005 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: mon.smithi077@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-04-25T02:13:14.005 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: mon.smithi077@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-25T02:13:14.005 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: mon.smithi077@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-25T02:13:14.005 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: mon.smithi077@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-25T02:13:14.005 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 ceph-mon[110441]: mon.smithi077@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-04-25T02:13:14.005 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 bash[110422]: 06490c2ecc449edf566ac9ec9f04ab5b8888478e05a1ed4ba67e37fa05f178d1 2024-04-25T02:13:14.005 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:13 smithi077 systemd[1]: Started Ceph mon.smithi077 for 4bb93d82-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:13:17.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:16 smithi077 ceph-mon[110441]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-04-25T02:13:17.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:16 smithi077 ceph-mon[110441]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-04-25T02:13:17.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:16 smithi077 ceph-mon[110441]: pgmap v92: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:17.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:16 smithi077 ceph-mon[110441]: pgmap v93: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:17.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:16 smithi077 ceph-mon[110441]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:13:17.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:16 smithi077 ceph-mon[110441]: mon.smithi077 calling monitor election 2024-04-25T02:13:17.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:16 smithi077 ceph-mon[110441]: mon.smithi077 is new leader, mons smithi077,smithi112 in quorum (ranks 0,1) 2024-04-25T02:13:17.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:16 smithi077 ceph-mon[110441]: monmap epoch 2 2024-04-25T02:13:17.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:16 smithi077 ceph-mon[110441]: fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 2024-04-25T02:13:17.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:16 smithi077 ceph-mon[110441]: last_changed 2024-04-25T02:01:55.055250+0000 2024-04-25T02:13:17.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:16 smithi077 ceph-mon[110441]: created 2024-04-25T01:59:19.321779+0000 2024-04-25T02:13:17.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:16 smithi077 ceph-mon[110441]: min_mon_release 17 (quincy) 2024-04-25T02:13:17.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:16 smithi077 ceph-mon[110441]: election_strategy: 1 2024-04-25T02:13:17.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:16 smithi077 ceph-mon[110441]: 0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.smithi077 2024-04-25T02:13:17.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:16 smithi077 ceph-mon[110441]: 1: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.smithi112 2024-04-25T02:13:17.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:16 smithi077 ceph-mon[110441]: fsmap cephfs:1 {0=cephfs.smithi112.dvwudt=up:active} 3 up:standby 2024-04-25T02:13:17.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:16 smithi077 ceph-mon[110441]: osdmap e49: 6 total, 6 up, 6 in 2024-04-25T02:13:17.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:16 smithi077 ceph-mon[110441]: mgrmap e34: smithi077.zpflzp(active, since 2m), standbys: smithi112.cswrxs 2024-04-25T02:13:17.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:16 smithi077 ceph-mon[110441]: overall HEALTH_OK 2024-04-25T02:13:17.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:16 smithi077 ceph-mon[110441]: from='mgr.14668 ' entity='' 2024-04-25T02:13:17.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:16 smithi077 ceph-mon[110441]: mgrmap e35: smithi077.zpflzp(active, since 2m), standbys: smithi112.cswrxs 2024-04-25T02:13:17.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:16 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-04-25T02:13:17.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:16 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-04-25T02:13:17.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:16 smithi112 ceph-mon[33313]: pgmap v92: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:17.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:16 smithi112 ceph-mon[33313]: pgmap v93: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:17.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:16 smithi112 ceph-mon[33313]: from='mgr.14668 172.21.15.77:0/3349334965' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:13:17.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:16 smithi112 ceph-mon[33313]: mon.smithi077 calling monitor election 2024-04-25T02:13:17.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:16 smithi112 ceph-mon[33313]: mon.smithi077 is new leader, mons smithi077,smithi112 in quorum (ranks 0,1) 2024-04-25T02:13:17.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:16 smithi112 ceph-mon[33313]: monmap epoch 2 2024-04-25T02:13:17.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:16 smithi112 ceph-mon[33313]: fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 2024-04-25T02:13:17.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:16 smithi112 ceph-mon[33313]: last_changed 2024-04-25T02:01:55.055250+0000 2024-04-25T02:13:17.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:16 smithi112 ceph-mon[33313]: created 2024-04-25T01:59:19.321779+0000 2024-04-25T02:13:17.260 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:16 smithi112 ceph-mon[33313]: min_mon_release 17 (quincy) 2024-04-25T02:13:17.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:16 smithi112 ceph-mon[33313]: election_strategy: 1 2024-04-25T02:13:17.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:16 smithi112 ceph-mon[33313]: 0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.smithi077 2024-04-25T02:13:17.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:16 smithi112 ceph-mon[33313]: 1: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.smithi112 2024-04-25T02:13:17.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:16 smithi112 ceph-mon[33313]: fsmap cephfs:1 {0=cephfs.smithi112.dvwudt=up:active} 3 up:standby 2024-04-25T02:13:17.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:16 smithi112 ceph-mon[33313]: osdmap e49: 6 total, 6 up, 6 in 2024-04-25T02:13:17.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:16 smithi112 ceph-mon[33313]: mgrmap e34: smithi077.zpflzp(active, since 2m), standbys: smithi112.cswrxs 2024-04-25T02:13:17.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:16 smithi112 ceph-mon[33313]: overall HEALTH_OK 2024-04-25T02:13:17.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:16 smithi112 ceph-mon[33313]: from='mgr.14668 ' entity='' 2024-04-25T02:13:17.261 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:16 smithi112 ceph-mon[33313]: mgrmap e35: smithi077.zpflzp(active, since 2m), standbys: smithi112.cswrxs 2024-04-25T02:13:23.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: Active manager daemon smithi077.zpflzp restarted 2024-04-25T02:13:23.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: Activating manager daemon smithi077.zpflzp 2024-04-25T02:13:23.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: osdmap e50: 6 total, 6 up, 6 in 2024-04-25T02:13:23.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: mgrmap e36: smithi077.zpflzp(active, starting, since 0.00638966s), standbys: smithi112.cswrxs 2024-04-25T02:13:23.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-04-25T02:13:23.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-04-25T02:13:23.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.gcfygj"}]: dispatch 2024-04-25T02:13:23.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.oadrkb"}]: dispatch 2024-04-25T02:13:23.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.dvwudt"}]: dispatch 2024-04-25T02:13:23.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.fjnadi"}]: dispatch 2024-04-25T02:13:23.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr metadata", "who": "smithi077.zpflzp", "id": "smithi077.zpflzp"}]: dispatch 2024-04-25T02:13:23.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr metadata", "who": "smithi112.cswrxs", "id": "smithi112.cswrxs"}]: dispatch 2024-04-25T02:13:23.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:13:23.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:13:23.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:13:23.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:13:23.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:13:23.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:13:23.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T02:13:23.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T02:13:23.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T02:13:23.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: Manager daemon smithi077.zpflzp is now available 2024-04-25T02:13:23.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: Standby manager daemon smithi112.cswrxs restarted 2024-04-25T02:13:23.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: Standby manager daemon smithi112.cswrxs started 2024-04-25T02:13:23.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: from='mgr.? 172.21.15.112:0/3284025228' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.cswrxs/crt"}]: dispatch 2024-04-25T02:13:23.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: from='mgr.? 172.21.15.112:0/3284025228' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T02:13:23.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:13:23.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: from='mgr.? 172.21.15.112:0/3284025228' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.cswrxs/key"}]: dispatch 2024-04-25T02:13:23.781 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:23 smithi112 ceph-mon[33313]: from='mgr.? 172.21.15.112:0/3284025228' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T02:13:24.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: Active manager daemon smithi077.zpflzp restarted 2024-04-25T02:13:24.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: Activating manager daemon smithi077.zpflzp 2024-04-25T02:13:24.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: osdmap e50: 6 total, 6 up, 6 in 2024-04-25T02:13:24.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: mgrmap e36: smithi077.zpflzp(active, starting, since 0.00638966s), standbys: smithi112.cswrxs 2024-04-25T02:13:24.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-04-25T02:13:24.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-04-25T02:13:24.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.gcfygj"}]: dispatch 2024-04-25T02:13:24.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.oadrkb"}]: dispatch 2024-04-25T02:13:24.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.dvwudt"}]: dispatch 2024-04-25T02:13:24.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.fjnadi"}]: dispatch 2024-04-25T02:13:24.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr metadata", "who": "smithi077.zpflzp", "id": "smithi077.zpflzp"}]: dispatch 2024-04-25T02:13:24.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr metadata", "who": "smithi112.cswrxs", "id": "smithi112.cswrxs"}]: dispatch 2024-04-25T02:13:24.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:13:24.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:13:24.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:13:24.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:13:24.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:13:24.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:13:24.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T02:13:24.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T02:13:24.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T02:13:24.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: Manager daemon smithi077.zpflzp is now available 2024-04-25T02:13:24.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: Standby manager daemon smithi112.cswrxs restarted 2024-04-25T02:13:24.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: Standby manager daemon smithi112.cswrxs started 2024-04-25T02:13:24.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: from='mgr.? 172.21.15.112:0/3284025228' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.cswrxs/crt"}]: dispatch 2024-04-25T02:13:24.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: from='mgr.? 172.21.15.112:0/3284025228' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T02:13:24.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:13:24.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: from='mgr.? 172.21.15.112:0/3284025228' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.cswrxs/key"}]: dispatch 2024-04-25T02:13:24.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:23 smithi077 ceph-mon[110441]: from='mgr.? 172.21.15.112:0/3284025228' entity='mgr.smithi112.cswrxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T02:13:24.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:24 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:13:24.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:24 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.zpflzp/mirror_snapshot_schedule"}]: dispatch 2024-04-25T02:13:24.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:24 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.zpflzp/trash_purge_schedule"}]: dispatch 2024-04-25T02:13:24.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:24 smithi077 ceph-mon[110441]: mgrmap e37: smithi077.zpflzp(active, since 1.01012s), standbys: smithi112.cswrxs 2024-04-25T02:13:25.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:24 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:13:25.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:24 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.zpflzp/mirror_snapshot_schedule"}]: dispatch 2024-04-25T02:13:25.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:24 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.zpflzp/trash_purge_schedule"}]: dispatch 2024-04-25T02:13:25.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:24 smithi112 ceph-mon[33313]: mgrmap e37: smithi077.zpflzp(active, since 1.01012s), standbys: smithi112.cswrxs 2024-04-25T02:13:25.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:25 smithi077 ceph-mon[110441]: [25/Apr/2024:02:13:24] ENGINE Bus STARTING 2024-04-25T02:13:25.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:25 smithi077 ceph-mon[110441]: pgmap v3: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:25.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:25 smithi077 ceph-mon[110441]: [25/Apr/2024:02:13:24] ENGINE Serving on http://172.21.15.77:8765 2024-04-25T02:13:25.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:25 smithi077 ceph-mon[110441]: [25/Apr/2024:02:13:24] ENGINE Serving on https://172.21.15.77:7150 2024-04-25T02:13:25.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:25 smithi077 ceph-mon[110441]: [25/Apr/2024:02:13:24] ENGINE Bus STARTED 2024-04-25T02:13:26.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:25 smithi112 ceph-mon[33313]: [25/Apr/2024:02:13:24] ENGINE Bus STARTING 2024-04-25T02:13:26.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:25 smithi112 ceph-mon[33313]: pgmap v3: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:26.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:25 smithi112 ceph-mon[33313]: [25/Apr/2024:02:13:24] ENGINE Serving on http://172.21.15.77:8765 2024-04-25T02:13:26.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:25 smithi112 ceph-mon[33313]: [25/Apr/2024:02:13:24] ENGINE Serving on https://172.21.15.77:7150 2024-04-25T02:13:26.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:25 smithi112 ceph-mon[33313]: [25/Apr/2024:02:13:24] ENGINE Bus STARTED 2024-04-25T02:13:27.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:26 smithi112 ceph-mon[33313]: pgmap v4: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:27.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:26 smithi112 ceph-mon[33313]: mgrmap e38: smithi077.zpflzp(active, since 2s), standbys: smithi112.cswrxs 2024-04-25T02:13:27.096 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:26 smithi077 ceph-mon[110441]: pgmap v4: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:27.096 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:26 smithi077 ceph-mon[110441]: mgrmap e38: smithi077.zpflzp(active, since 2s), standbys: smithi112.cswrxs 2024-04-25T02:13:27.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:27 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:27.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:27 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:28.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:27 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:28.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:27 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:28.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:28 smithi077 ceph-mon[110441]: pgmap v5: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:28.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:28 smithi077 ceph-mon[110441]: mgrmap e39: smithi077.zpflzp(active, since 4s), standbys: smithi112.cswrxs 2024-04-25T02:13:28.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:28 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:28.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:28 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:29.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:28 smithi112 ceph-mon[33313]: pgmap v5: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:29.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:28 smithi112 ceph-mon[33313]: mgrmap e39: smithi077.zpflzp(active, since 4s), standbys: smithi112.cswrxs 2024-04-25T02:13:29.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:28 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:29.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:28 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:30.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:30 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:30.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:30 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:30.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:30 smithi077 ceph-mon[110441]: pgmap v6: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:30.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:30 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:30.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:30 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:30.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:30 smithi112 ceph-mon[33313]: pgmap v6: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:31.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:31 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:31.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:31 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:31.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:31 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:31.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:31 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:32.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:32 smithi077 ceph-mon[110441]: pgmap v7: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-25T02:13:32.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:32 smithi112 ceph-mon[33313]: pgmap v7: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-25T02:13:34.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:34 smithi077 ceph-mon[110441]: Detected new or changed devices on smithi077 2024-04-25T02:13:34.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:34 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:34.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:34 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:34.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:34 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:13:34.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:34 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:13:34.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:34 smithi077 ceph-mon[110441]: Updating smithi077:/etc/ceph/ceph.conf 2024-04-25T02:13:34.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:34 smithi077 ceph-mon[110441]: Updating smithi112:/etc/ceph/ceph.conf 2024-04-25T02:13:34.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:34 smithi077 ceph-mon[110441]: Updating smithi077:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:13:34.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:34 smithi077 ceph-mon[110441]: Updating smithi112:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:13:34.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:34 smithi077 ceph-mon[110441]: pgmap v8: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-25T02:13:34.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:34 smithi077 ceph-mon[110441]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:13:34.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:34 smithi077 ceph-mon[110441]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:13:34.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:34 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:34.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:34 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:34.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:34 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:34.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:34 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:34.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:34 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:34.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:34 smithi112 ceph-mon[33313]: Detected new or changed devices on smithi077 2024-04-25T02:13:34.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:34 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:34.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:34 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:34.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:34 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:13:34.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:34 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:13:34.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:34 smithi112 ceph-mon[33313]: Updating smithi077:/etc/ceph/ceph.conf 2024-04-25T02:13:34.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:34 smithi112 ceph-mon[33313]: Updating smithi112:/etc/ceph/ceph.conf 2024-04-25T02:13:34.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:34 smithi112 ceph-mon[33313]: Updating smithi077:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:13:34.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:34 smithi112 ceph-mon[33313]: Updating smithi112:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:13:34.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:34 smithi112 ceph-mon[33313]: pgmap v8: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-25T02:13:34.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:34 smithi112 ceph-mon[33313]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:13:34.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:34 smithi112 ceph-mon[33313]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:13:34.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:34 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:34.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:34 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:34.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:34 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:34.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:34 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:34.780 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:34 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:35.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:35 smithi112 ceph-mon[33313]: Updating smithi077:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:13:35.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:35 smithi112 ceph-mon[33313]: Updating smithi112:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:13:35.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:35 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:13:35.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:35 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:13:35.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:35 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-25T02:13:35.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:35 smithi077 ceph-mon[110441]: Updating smithi077:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:13:35.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:35 smithi077 ceph-mon[110441]: Updating smithi112:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:13:35.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:35 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:13:35.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:35 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:13:35.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:35 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-25T02:13:36.593 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:36 smithi112 ceph-mon[33313]: pgmap v9: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-25T02:13:36.594 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:36 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:36.594 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:36 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:13:36.594 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:36 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T02:13:36.594 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:36 smithi112 ceph-mon[33313]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:13:36.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:36 smithi077 ceph-mon[110441]: pgmap v9: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-25T02:13:36.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:36 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:36.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:36 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:13:36.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:36 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T02:13:36.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:36 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:13:37.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:37 smithi112 ceph-mon[33313]: Upgrade: Updating mon.smithi112 2024-04-25T02:13:37.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:37 smithi112 ceph-mon[33313]: Deploying daemon mon.smithi112 on smithi112 2024-04-25T02:13:37.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:37 smithi077 ceph-mon[110441]: Upgrade: Updating mon.smithi112 2024-04-25T02:13:37.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:37 smithi077 ceph-mon[110441]: Deploying daemon mon.smithi112 on smithi112 2024-04-25T02:13:38.180 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:37 smithi112 systemd[1]: Stopping Ceph mon.smithi112 for 4bb93d82-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:13:38.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:38 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi112[33295]: 2024-04-25T02:13:38.173+0000 7f23fa758700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi112 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:13:38.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:38 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi112[33295]: 2024-04-25T02:13:38.173+0000 7f23fa758700 -1 mon.smithi112@1(peon) e2 *** Got Signal Terminated *** 2024-04-25T02:13:38.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:38 smithi112 podman[80328]: 2024-04-25 02:13:38.316567521 +0000 UTC m=+0.272878134 container died db2fb9b097899b1beeded6fdda300057100e9f712d58f0a2ac03a0ffd98f7fbb (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi112, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=quincy-c61472c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T02:13:38.954 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:38 smithi112 podman[80328]: 2024-04-25 02:13:38.689667394 +0000 UTC m=+0.645978015 container cleanup db2fb9b097899b1beeded6fdda300057100e9f712d58f0a2ac03a0ffd98f7fbb (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi112, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=quincy-c61472c, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2) 2024-04-25T02:13:38.955 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:38 smithi112 bash[80328]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi112 2024-04-25T02:13:39.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:38 smithi112 podman[80342]: 2024-04-25 02:13:38.949534467 +0000 UTC m=+0.628367787 container remove db2fb9b097899b1beeded6fdda300057100e9f712d58f0a2ac03a0ffd98f7fbb (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi112, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=quincy-c61472c, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:13:39.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 systemd[1]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@mon.smithi112.service: Deactivated successfully. 2024-04-25T02:13:39.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 systemd[1]: Stopped Ceph mon.smithi112 for 4bb93d82-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:13:39.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 systemd[1]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@mon.smithi112.service: Consumed 6.626s CPU time. 2024-04-25T02:13:39.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.655+0000 7f9ccb0b8700 1 -- 172.21.15.77:0/2728502116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cc4101d90 msgr2=0x7f9cc4102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:39.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.655+0000 7f9ccb0b8700 1 --2- 172.21.15.77:0/2728502116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cc4101d90 0x7f9cc4102160 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8004940 tx=0x7f9cb8009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:39.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.655+0000 7f9ccb0b8700 1 -- 172.21.15.77:0/2728502116 shutdown_connections 2024-04-25T02:13:39.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.655+0000 7f9ccb0b8700 1 --2- 172.21.15.77:0/2728502116 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cc40fbd40 0x7f9cc40fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:39.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.655+0000 7f9ccb0b8700 1 --2- 172.21.15.77:0/2728502116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cc4101d90 0x7f9cc4102160 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:39.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.655+0000 7f9ccb0b8700 1 -- 172.21.15.77:0/2728502116 >> 172.21.15.77:0/2728502116 conn(0x7f9cc4071d00 msgr2=0x7f9cc4072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:39.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.655+0000 7f9ccb0b8700 1 -- 172.21.15.77:0/2728502116 shutdown_connections 2024-04-25T02:13:39.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.655+0000 7f9ccb0b8700 1 -- 172.21.15.77:0/2728502116 wait complete. 2024-04-25T02:13:39.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.655+0000 7f9ccb0b8700 1 Processor -- start 2024-04-25T02:13:39.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.655+0000 7f9ccb0b8700 1 -- start start 2024-04-25T02:13:39.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.656+0000 7f9ccb0b8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cc40fbd40 0x7f9cc4113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:39.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.656+0000 7f9ccb0b8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cc4101d90 0x7f9cc41140f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:39.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.656+0000 7f9ccb0b8700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc41147d0 con 0x7f9cc4101d90 2024-04-25T02:13:39.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.656+0000 7f9ccb0b8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc410db30 con 0x7f9cc40fbd40 2024-04-25T02:13:39.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.656+0000 7f9cc8e54700 1 -- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cc40fbd40 msgr2=0x7f9cc4113bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.112:3300/0 2024-04-25T02:13:39.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.656+0000 7f9cc8e54700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cc40fbd40 0x7f9cc4113bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:13:39.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.656+0000 7f9cc3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cc4101d90 0x7f9cc41140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:39.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.656+0000 7f9cc3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cc4101d90 0x7f9cc41140f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57028/0 (socket says 172.21.15.77:57028) 2024-04-25T02:13:39.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.656+0000 7f9cc3fff700 1 -- 172.21.15.77:0/2535690002 learned_addr learned my addr 172.21.15.77:0/2535690002 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:13:39.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.656+0000 7f9cc3fff700 1 -- 172.21.15.77:0/2535690002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cc40fbd40 msgr2=0x7f9cc4113bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:13:39.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.656+0000 7f9cc3fff700 1 --2- 172.21.15.77:0/2535690002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cc40fbd40 0x7f9cc4113bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:39.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.656+0000 7f9cc3fff700 1 -- 172.21.15.77:0/2535690002 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb8005040 con 0x7f9cc4101d90 2024-04-25T02:13:39.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.656+0000 7f9cc3fff700 1 --2- 172.21.15.77:0/2535690002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cc4101d90 0x7f9cc41140f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000b760 tx=0x7f9cb0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:39.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.656+0000 7f9cc17fa700 1 -- 172.21.15.77:0/2535690002 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cb0010790 con 0x7f9cc4101d90 2024-04-25T02:13:39.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.657+0000 7f9cc17fa700 1 -- 172.21.15.77:0/2535690002 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9cb0010dc0 con 0x7f9cc4101d90 2024-04-25T02:13:39.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.657+0000 7f9ccb0b8700 1 -- 172.21.15.77:0/2535690002 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc410de10 con 0x7f9cc4101d90 2024-04-25T02:13:39.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.657+0000 7f9cc17fa700 1 -- 172.21.15.77:0/2535690002 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cb000f300 con 0x7f9cc4101d90 2024-04-25T02:13:39.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.657+0000 7f9ccb0b8700 1 -- 172.21.15.77:0/2535690002 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc410e3d0 con 0x7f9cc4101d90 2024-04-25T02:13:39.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.658+0000 7f9ccb0b8700 1 -- 172.21.15.77:0/2535690002 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc40fd430 con 0x7f9cc4101d90 2024-04-25T02:13:39.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.658+0000 7f9cc17fa700 1 -- 172.21.15.77:0/2535690002 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f9cb000f5a0 con 0x7f9cc4101d90 2024-04-25T02:13:39.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.658+0000 7f9cc17fa700 1 --2- 172.21.15.77:0/2535690002 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f9cb406e1b0 0x7f9cb4070660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:39.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.658+0000 7f9cc17fa700 1 -- 172.21.15.77:0/2535690002 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f9cb008ddb0 con 0x7f9cc4101d90 2024-04-25T02:13:39.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.659+0000 7f9cc8e54700 1 --2- 172.21.15.77:0/2535690002 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f9cb406e1b0 0x7f9cb4070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:39.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.659+0000 7f9cc8e54700 1 --2- 172.21.15.77:0/2535690002 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f9cb406e1b0 0x7f9cb4070660 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8004890 tx=0x7f9cb8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:39.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.664+0000 7f9cc17fa700 1 -- 172.21.15.77:0/2535690002 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f9cb005aba0 con 0x7f9cc4101d90 2024-04-25T02:13:39.694 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 systemd[1]: Starting Ceph mon.smithi112 for 4bb93d82-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:13:39.694 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 podman[80474]: 2024-04-25 02:13:39.412484018 +0000 UTC m=+0.018151536 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:13:39.694 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 podman[80474]: 2024-04-25 02:13:39.542264403 +0000 UTC m=+0.147931970 container create ccd1398acbc5a479337cac5f14f1d1711d786c61de43cdeabbbc2f3bbab006d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi112, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:13:39.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.885+0000 7f9ccb0b8700 1 -- 172.21.15.77:0/2535690002 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9cc4108e90 con 0x7f9cb406e1b0 2024-04-25T02:13:39.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.886+0000 7f9cc17fa700 1 -- 172.21.15.77:0/2535690002 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f9cc4108e90 con 0x7f9cb406e1b0 2024-04-25T02:13:39.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.888+0000 7f9ccb0b8700 1 -- 172.21.15.77:0/2535690002 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f9cb406e1b0 msgr2=0x7f9cb4070660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:39.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.888+0000 7f9ccb0b8700 1 --2- 172.21.15.77:0/2535690002 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f9cb406e1b0 0x7f9cb4070660 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8004890 tx=0x7f9cb8009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:39.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.888+0000 7f9ccb0b8700 1 -- 172.21.15.77:0/2535690002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cc4101d90 msgr2=0x7f9cc41140f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:39.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.888+0000 7f9ccb0b8700 1 --2- 172.21.15.77:0/2535690002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cc4101d90 0x7f9cc41140f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000b760 tx=0x7f9cb0009220 comp rx=0 tx=0).stop 2024-04-25T02:13:39.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.888+0000 7f9ccb0b8700 1 -- 172.21.15.77:0/2535690002 shutdown_connections 2024-04-25T02:13:39.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.889+0000 7f9ccb0b8700 1 --2- 172.21.15.77:0/2535690002 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f9cb406e1b0 0x7f9cb4070660 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:39.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.889+0000 7f9ccb0b8700 1 --2- 172.21.15.77:0/2535690002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9cc40fbd40 0x7f9cc4113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:39.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.889+0000 7f9ccb0b8700 1 --2- 172.21.15.77:0/2535690002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cc4101d90 0x7f9cc41140f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:39.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.889+0000 7f9ccb0b8700 1 -- 172.21.15.77:0/2535690002 >> 172.21.15.77:0/2535690002 conn(0x7f9cc4071d00 msgr2=0x7f9cc40655e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:39.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.889+0000 7f9ccb0b8700 1 -- 172.21.15.77:0/2535690002 shutdown_connections 2024-04-25T02:13:39.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.889+0000 7f9ccb0b8700 1 -- 172.21.15.77:0/2535690002 wait complete. 2024-04-25T02:13:39.904 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-04-25T02:13:39.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.991+0000 7fd1d89ad700 1 -- 172.21.15.77:0/2729162639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d4102dc0 msgr2=0x7fd1d4103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:39.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.991+0000 7fd1d89ad700 1 --2- 172.21.15.77:0/2729162639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d4102dc0 0x7fd1d4103190 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4004940 tx=0x7fd1c4009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:39.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.991+0000 7fd1d89ad700 1 -- 172.21.15.77:0/2729162639 shutdown_connections 2024-04-25T02:13:39.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.991+0000 7fd1d89ad700 1 --2- 172.21.15.77:0/2729162639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1d4103760 0x7fd1d40fcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:39.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.991+0000 7fd1d89ad700 1 --2- 172.21.15.77:0/2729162639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d4102dc0 0x7fd1d4103190 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.991+0000 7fd1d89ad700 1 -- 172.21.15.77:0/2729162639 >> 172.21.15.77:0/2729162639 conn(0x7fd1d40f8930 msgr2=0x7fd1d40fad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:40.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.992+0000 7fd1d89ad700 1 -- 172.21.15.77:0/2729162639 shutdown_connections 2024-04-25T02:13:40.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.992+0000 7fd1d89ad700 1 -- 172.21.15.77:0/2729162639 wait complete. 2024-04-25T02:13:40.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.992+0000 7fd1d89ad700 1 Processor -- start 2024-04-25T02:13:40.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.992+0000 7fd1d89ad700 1 -- start start 2024-04-25T02:13:40.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.992+0000 7fd1d89ad700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1d4102dc0 0x7fd1d4113960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.992+0000 7fd1d89ad700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d4103760 0x7fd1d4113ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.992+0000 7fd1d89ad700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d41144f0 con 0x7fd1d4103760 2024-04-25T02:13:40.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.992+0000 7fd1d89ad700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d410daf0 con 0x7fd1d4102dc0 2024-04-25T02:13:40.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.993+0000 7fd1d1d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d4103760 0x7fd1d4113ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:40.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.993+0000 7fd1d1d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d4103760 0x7fd1d4113ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57050/0 (socket says 172.21.15.77:57050) 2024-04-25T02:13:40.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.993+0000 7fd1d1d9b700 1 -- 172.21.15.77:0/1927208078 learned_addr learned my addr 172.21.15.77:0/1927208078 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:13:40.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.993+0000 7fd1d259c700 1 --2- 172.21.15.77:0/1927208078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1d4102dc0 0x7fd1d4113960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:40.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.993+0000 7fd1d1d9b700 1 -- 172.21.15.77:0/1927208078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1d4102dc0 msgr2=0x7fd1d4113960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:40.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.993+0000 7fd1d1d9b700 1 --2- 172.21.15.77:0/1927208078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1d4102dc0 0x7fd1d4113960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.993+0000 7fd1d1d9b700 1 -- 172.21.15.77:0/1927208078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c4005040 con 0x7fd1d4103760 2024-04-25T02:13:40.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.993+0000 7fd1d1d9b700 1 --2- 172.21.15.77:0/1927208078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d4103760 0x7fd1d4113ea0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd1c800c800 tx=0x7fd1c8004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:40.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.993+0000 7fd1c2ffd700 1 -- 172.21.15.77:0/1927208078 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1c800a760 con 0x7fd1d4103760 2024-04-25T02:13:40.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.993+0000 7fd1c2ffd700 1 -- 172.21.15.77:0/1927208078 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd1c800ad90 con 0x7fd1d4103760 2024-04-25T02:13:40.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.993+0000 7fd1d89ad700 1 -- 172.21.15.77:0/1927208078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d410ddd0 con 0x7fd1d4103760 2024-04-25T02:13:40.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.993+0000 7fd1c2ffd700 1 -- 172.21.15.77:0/1927208078 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1c80113a0 con 0x7fd1d4103760 2024-04-25T02:13:40.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.993+0000 7fd1d89ad700 1 -- 172.21.15.77:0/1927208078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d410e390 con 0x7fd1d4103760 2024-04-25T02:13:40.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.994+0000 7fd1d89ad700 1 -- 172.21.15.77:0/1927208078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d40fe510 con 0x7fd1d4103760 2024-04-25T02:13:40.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.995+0000 7fd1c2ffd700 1 -- 172.21.15.77:0/1927208078 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fd1c8012400 con 0x7fd1d4103760 2024-04-25T02:13:40.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.995+0000 7fd1c2ffd700 1 --2- 172.21.15.77:0/1927208078 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd1bc06e270 0x7fd1bc070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.995+0000 7fd1c2ffd700 1 -- 172.21.15.77:0/1927208078 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd1c808dc70 con 0x7fd1d4103760 2024-04-25T02:13:40.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.995+0000 7fd1d259c700 1 --2- 172.21.15.77:0/1927208078 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd1bc06e270 0x7fd1bc070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:40.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:39.995+0000 7fd1d259c700 1 --2- 172.21.15.77:0/1927208078 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd1bc06e270 0x7fd1bc070720 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4004560 tx=0x7fd1c4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:40.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.000+0000 7fd1c2ffd700 1 -- 172.21.15.77:0/1927208078 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fd1c805aae0 con 0x7fd1d4103760 2024-04-25T02:13:40.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 podman[80474]: 2024-04-25 02:13:39.811697742 +0000 UTC m=+0.417365247 container init ccd1398acbc5a479337cac5f14f1d1711d786c61de43cdeabbbc2f3bbab006d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi112, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:13:40.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 podman[80474]: 2024-04-25 02:13:39.81473439 +0000 UTC m=+0.420401909 container start ccd1398acbc5a479337cac5f14f1d1711d786c61de43cdeabbbc2f3bbab006d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi112, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:13:40.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: set uid:gid to 167:167 (ceph:ceph) 2024-04-25T02:13:40.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev), process ceph-mon, pid 2 2024-04-25T02:13:40.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: pidfile_write: ignore empty --pid-file 2024-04-25T02:13:40.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: load: jerasure load: lrc 2024-04-25T02:13:40.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: RocksDB version: 7.9.2 2024-04-25T02:13:40.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Git sha 0 2024-04-25T02:13:40.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Compile date 2024-04-24 16:41:23 2024-04-25T02:13:40.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: DB SUMMARY 2024-04-25T02:13:40.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: DB Session ID: 00JP23LNSY15HDTIE4OH 2024-04-25T02:13:40.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: CURRENT file: CURRENT 2024-04-25T02:13:40.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: IDENTITY file: IDENTITY 2024-04-25T02:13:40.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1091 Bytes 2024-04-25T02:13:40.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi112/store.db dir, Total Num: 1, files: 000027.sst 2024-04-25T02:13:40.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi112/store.db: 000025.log size: 5159248 ; 2024-04-25T02:13:40.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.error_if_exists: 0 2024-04-25T02:13:40.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.create_if_missing: 0 2024-04-25T02:13:40.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.paranoid_checks: 1 2024-04-25T02:13:40.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-25T02:13:40.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-25T02:13:40.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-25T02:13:40.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.env: 0x561ae5080c60 2024-04-25T02:13:40.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.fs: PosixFileSystem 2024-04-25T02:13:40.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.info_log: 0x561ae6989960 2024-04-25T02:13:40.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.max_file_opening_threads: 16 2024-04-25T02:13:40.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.statistics: (nil) 2024-04-25T02:13:40.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.use_fsync: 0 2024-04-25T02:13:40.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.max_log_file_size: 0 2024-04-25T02:13:40.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-25T02:13:40.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-25T02:13:40.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.keep_log_file_num: 1000 2024-04-25T02:13:40.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.recycle_log_file_num: 0 2024-04-25T02:13:40.031 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.allow_fallocate: 1 2024-04-25T02:13:40.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.allow_mmap_reads: 0 2024-04-25T02:13:40.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.allow_mmap_writes: 0 2024-04-25T02:13:40.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.use_direct_reads: 0 2024-04-25T02:13:40.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-25T02:13:40.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.create_missing_column_families: 0 2024-04-25T02:13:40.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.db_log_dir: 2024-04-25T02:13:40.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.wal_dir: 2024-04-25T02:13:40.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-25T02:13:40.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-25T02:13:40.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-25T02:13:40.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-25T02:13:40.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-25T02:13:40.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-25T02:13:40.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.advise_random_on_open: 1 2024-04-25T02:13:40.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.db_write_buffer_size: 0 2024-04-25T02:13:40.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.write_buffer_manager: 0x561ae695c1e0 2024-04-25T02:13:40.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-25T02:13:40.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-25T02:13:40.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-25T02:13:40.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.rate_limiter: (nil) 2024-04-25T02:13:40.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-25T02:13:40.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.wal_recovery_mode: 2 2024-04-25T02:13:40.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.enable_thread_tracking: 0 2024-04-25T02:13:40.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.enable_pipelined_write: 0 2024-04-25T02:13:40.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.unordered_write: 0 2024-04-25T02:13:40.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-25T02:13:40.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-25T02:13:40.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-25T02:13:40.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-25T02:13:40.033 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.row_cache: None 2024-04-25T02:13:40.034 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.wal_filter: None 2024-04-25T02:13:40.035 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-25T02:13:40.035 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.allow_ingest_behind: 0 2024-04-25T02:13:40.035 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.two_write_queues: 0 2024-04-25T02:13:40.035 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.manual_wal_flush: 0 2024-04-25T02:13:40.035 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.wal_compression: 0 2024-04-25T02:13:40.035 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.atomic_flush: 0 2024-04-25T02:13:40.035 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-25T02:13:40.035 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-25T02:13:40.035 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-25T02:13:40.035 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.log_readahead_size: 0 2024-04-25T02:13:40.036 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-25T02:13:40.036 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.best_efforts_recovery: 0 2024-04-25T02:13:40.036 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-25T02:13:40.036 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-25T02:13:40.036 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.allow_data_in_errors: 0 2024-04-25T02:13:40.036 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.db_host_id: __hostname__ 2024-04-25T02:13:40.036 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-25T02:13:40.036 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.max_background_jobs: 2 2024-04-25T02:13:40.036 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.max_background_compactions: -1 2024-04-25T02:13:40.036 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.max_subcompactions: 1 2024-04-25T02:13:40.036 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-25T02:13:40.036 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-25T02:13:40.036 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-25T02:13:40.036 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.max_total_wal_size: 0 2024-04-25T02:13:40.036 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-25T02:13:40.037 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-25T02:13:40.037 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-25T02:13:40.037 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-25T02:13:40.037 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.max_open_files: -1 2024-04-25T02:13:40.037 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.bytes_per_sync: 0 2024-04-25T02:13:40.037 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-25T02:13:40.037 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-25T02:13:40.037 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.compaction_readahead_size: 0 2024-04-25T02:13:40.037 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.max_background_flushes: -1 2024-04-25T02:13:40.037 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Compression algorithms supported: 2024-04-25T02:13:40.037 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-25T02:13:40.037 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: kZSTD supported: 0 2024-04-25T02:13:40.037 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: kXpressCompression supported: 0 2024-04-25T02:13:40.037 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: kLZ4HCCompression supported: 1 2024-04-25T02:13:40.037 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: kZlibCompression supported: 1 2024-04-25T02:13:40.038 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: kSnappyCompression supported: 1 2024-04-25T02:13:40.038 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: kLZ4Compression supported: 1 2024-04-25T02:13:40.038 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: kBZip2Compression supported: 0 2024-04-25T02:13:40.038 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-25T02:13:40.038 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-25T02:13:40.038 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi112/store.db/MANIFEST-000009 2024-04-25T02:13:40.038 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-25T02:13:40.038 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-25T02:13:40.038 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.merge_operator: 2024-04-25T02:13:40.038 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.compaction_filter: None 2024-04-25T02:13:40.038 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.compaction_filter_factory: None 2024-04-25T02:13:40.038 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.sst_partitioner_factory: None 2024-04-25T02:13:40.038 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-25T02:13:40.038 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-25T02:13:40.038 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561ae6989a60) 2024-04-25T02:13:40.039 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: cache_index_and_filter_blocks: 1 2024-04-25T02:13:40.039 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-25T02:13:40.039 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-25T02:13:40.039 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: pin_top_level_index_and_filter: 1 2024-04-25T02:13:40.039 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: index_type: 0 2024-04-25T02:13:40.039 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: data_block_index_type: 0 2024-04-25T02:13:40.039 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: index_shortening: 1 2024-04-25T02:13:40.039 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-25T02:13:40.039 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: checksum: 4 2024-04-25T02:13:40.039 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: no_block_cache: 0 2024-04-25T02:13:40.039 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache: 0x561ae698d090 2024-04-25T02:13:40.039 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache_name: BinnedLRUCache 2024-04-25T02:13:40.039 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache_options: 2024-04-25T02:13:40.039 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: capacity : 536870912 2024-04-25T02:13:40.039 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: num_shard_bits : 4 2024-04-25T02:13:40.040 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: strict_capacity_limit : 0 2024-04-25T02:13:40.040 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: high_pri_pool_ratio: 0.000 2024-04-25T02:13:40.040 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache_compressed: (nil) 2024-04-25T02:13:40.040 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: persistent_cache: (nil) 2024-04-25T02:13:40.040 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_size: 4096 2024-04-25T02:13:40.040 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_size_deviation: 10 2024-04-25T02:13:40.040 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_restart_interval: 16 2024-04-25T02:13:40.040 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: index_block_restart_interval: 1 2024-04-25T02:13:40.040 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: metadata_block_size: 4096 2024-04-25T02:13:40.040 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: partition_filters: 0 2024-04-25T02:13:40.040 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: use_delta_encoding: 1 2024-04-25T02:13:40.040 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: filter_policy: bloomfilter 2024-04-25T02:13:40.040 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: whole_key_filtering: 1 2024-04-25T02:13:40.040 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: verify_compression: 0 2024-04-25T02:13:40.040 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: read_amp_bytes_per_bit: 0 2024-04-25T02:13:40.041 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: format_version: 5 2024-04-25T02:13:40.041 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: enable_index_compression: 1 2024-04-25T02:13:40.041 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_align: 0 2024-04-25T02:13:40.041 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: max_auto_readahead_size: 262144 2024-04-25T02:13:40.041 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: prepopulate_block_cache: 0 2024-04-25T02:13:40.041 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: initial_auto_readahead_size: 8192 2024-04-25T02:13:40.041 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: num_file_reads_for_auto_readahead: 2 2024-04-25T02:13:40.041 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.write_buffer_size: 33554432 2024-04-25T02:13:40.041 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.max_write_buffer_number: 2 2024-04-25T02:13:40.041 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.compression: NoCompression 2024-04-25T02:13:40.041 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.bottommost_compression: Disabled 2024-04-25T02:13:40.041 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.prefix_extractor: nullptr 2024-04-25T02:13:40.041 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-25T02:13:40.041 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.num_levels: 7 2024-04-25T02:13:40.041 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-25T02:13:40.042 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-25T02:13:40.042 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-25T02:13:40.042 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-25T02:13:40.042 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-25T02:13:40.042 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-25T02:13:40.042 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-25T02:13:40.042 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-25T02:13:40.042 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-25T02:13:40.042 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-25T02:13:40.042 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-25T02:13:40.042 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-25T02:13:40.042 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-25T02:13:40.042 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.compression_opts.level: 32767 2024-04-25T02:13:40.042 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.compression_opts.strategy: 0 2024-04-25T02:13:40.042 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-25T02:13:40.043 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-25T02:13:40.043 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-25T02:13:40.043 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-25T02:13:40.043 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.compression_opts.enabled: false 2024-04-25T02:13:40.043 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-25T02:13:40.043 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-25T02:13:40.043 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-25T02:13:40.043 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-25T02:13:40.043 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.target_file_size_base: 67108864 2024-04-25T02:13:40.043 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-25T02:13:40.043 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-25T02:13:40.043 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-25T02:13:40.043 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-25T02:13:40.043 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-25T02:13:40.044 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-25T02:13:40.044 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-25T02:13:40.044 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-25T02:13:40.044 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-25T02:13:40.044 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-25T02:13:40.044 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-25T02:13:40.044 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-25T02:13:40.044 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-25T02:13:40.044 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-25T02:13:40.044 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.arena_block_size: 1048576 2024-04-25T02:13:40.044 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-25T02:13:40.044 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-25T02:13:40.044 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.disable_auto_compactions: 0 2024-04-25T02:13:40.044 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-25T02:13:40.044 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-25T02:13:40.045 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-25T02:13:40.045 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-25T02:13:40.045 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-25T02:13:40.045 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-25T02:13:40.045 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-25T02:13:40.045 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-25T02:13:40.045 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-25T02:13:40.045 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-25T02:13:40.045 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.table_properties_collectors: 2024-04-25T02:13:40.045 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.inplace_update_support: 0 2024-04-25T02:13:40.045 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-25T02:13:40.045 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-25T02:13:40.045 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-25T02:13:40.045 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-25T02:13:40.045 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.bloom_locality: 0 2024-04-25T02:13:40.045 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.max_successive_merges: 0 2024-04-25T02:13:40.046 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-25T02:13:40.046 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.paranoid_file_checks: 0 2024-04-25T02:13:40.046 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.force_consistency_checks: 1 2024-04-25T02:13:40.046 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.report_bg_io_stats: 0 2024-04-25T02:13:40.046 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.ttl: 2592000 2024-04-25T02:13:40.046 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-25T02:13:40.046 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-25T02:13:40.046 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-25T02:13:40.046 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.enable_blob_files: false 2024-04-25T02:13:40.046 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.min_blob_size: 0 2024-04-25T02:13:40.046 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.blob_file_size: 268435456 2024-04-25T02:13:40.046 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-25T02:13:40.046 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-25T02:13:40.046 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-25T02:13:40.047 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-25T02:13:40.047 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-25T02:13:40.047 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.blob_file_starting_level: 0 2024-04-25T02:13:40.047 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-25T02:13:40.047 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2024-04-25T02:13:40.047 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-25T02:13:40.047 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi112/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 12294, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-25T02:13:40.047 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-04-25T02:13:40.047 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 4704c66f-d3e9-44c7-acab-36912c372c6e 2024-04-25T02:13:40.047 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714011219855035, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-04-25T02:13:40.047 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-04-25T02:13:40.047 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714011219866837, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 3159868, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12299, "largest_seqno": 14357, "table_properties": {"data_size": 3151326, "index_size": 5346, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2181, "raw_key_size": 20837, "raw_average_key_size": 24, "raw_value_size": 3133010, "raw_average_value_size": 3638, "num_data_blocks": 241, "num_entries": 861, "num_filter_entries": 861, "num_deletions": 7, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714011219, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "4704c66f-d3e9-44c7-acab-36912c372c6e", "db_session_id": "00JP23LNSY15HDTIE4OH", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-04-25T02:13:40.047 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714011219866953, "job": 1, "event": "recovery_finished"} 2024-04-25T02:13:40.047 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-04-25T02:13:40.047 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-25T02:13:40.048 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi112/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-25T02:13:40.048 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x561ae6a7e000 2024-04-25T02:13:40.048 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: DB pointer 0x561ae6a68000 2024-04-25T02:13:40.048 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-25T02:13:40.048 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-25T02:13:40.048 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** DB Stats ** 2024-04-25T02:13:40.048 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T02:13:40.048 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-25T02:13:40.048 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T02:13:40.048 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T02:13:40.048 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-25T02:13:40.048 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T02:13:40.048 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T02:13:40.048 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-04-25T02:13:40.048 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** Compaction Stats [default] ** 2024-04-25T02:13:40.049 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-25T02:13:40.049 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-25T02:13:40.049 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: L0 1/0 3.01 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 665.5 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-04-25T02:13:40.049 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: L6 1/0 7.06 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-25T02:13:40.049 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Sum 2/0 10.07 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 665.5 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-04-25T02:13:40.049 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 665.5 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-04-25T02:13:40.049 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-04-25T02:13:40.049 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** Compaction Stats [default] ** 2024-04-25T02:13:40.049 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-25T02:13:40.049 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T02:13:40.049 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 665.5 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-04-25T02:13:40.049 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-04-25T02:13:40.049 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-25T02:13:40.049 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-04-25T02:13:40.049 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T02:13:40.049 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-04-25T02:13:40.050 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-25T02:13:40.050 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-25T02:13:40.050 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-25T02:13:40.050 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-25T02:13:40.050 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative compaction: 0.00 GB write, 103.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T02:13:40.050 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval compaction: 0.00 GB write, 103.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T02:13:40.050 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-25T02:13:40.050 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Block cache BinnedLRUCache@0x561ae698d090#2 capacity: 512.00 MB usage: 8.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-04-25T02:13:40.050 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.28 KB,0.000435114%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2024-04-25T02:13:40.050 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-04-25T02:13:40.050 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-25T02:13:40.050 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: starting mon.smithi112 rank 1 at public addrs [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] at bind addrs [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi112 fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 2024-04-25T02:13:40.050 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: mon.smithi112@-1(???) e2 preinit fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 2024-04-25T02:13:40.050 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: mon.smithi112@-1(???).mds e15 new map 2024-04-25T02:13:40.051 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: mon.smithi112@-1(???).mds e15 print_map 2024-04-25T02:13:40.051 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: e15 2024-04-25T02:13:40.051 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T02:13:40.051 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:13:40.051 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: legacy client fscid: 1 2024-04-25T02:13:40.051 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-04-25T02:13:40.051 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Filesystem 'cephfs' (1) 2024-04-25T02:13:40.051 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: fs_name cephfs 2024-04-25T02:13:40.051 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: epoch 15 2024-04-25T02:13:40.051 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-25T02:13:40.051 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: created 2024-04-25T02:06:10.008979+0000 2024-04-25T02:13:40.051 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: modified 2024-04-25T02:06:27.849984+0000 2024-04-25T02:13:40.051 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: tableserver 0 2024-04-25T02:13:40.051 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: root 0 2024-04-25T02:13:40.051 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: session_timeout 60 2024-04-25T02:13:40.051 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: session_autoclose 300 2024-04-25T02:13:40.052 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: max_file_size 1099511627776 2024-04-25T02:13:40.052 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: max_xattr_size 65536 2024-04-25T02:13:40.052 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: required_client_features {} 2024-04-25T02:13:40.052 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: last_failure 0 2024-04-25T02:13:40.052 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: last_failure_osd_epoch 47 2024-04-25T02:13:40.052 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:13:40.052 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: max_mds 1 2024-04-25T02:13:40.052 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: in 0 2024-04-25T02:13:40.052 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: up {0=24257} 2024-04-25T02:13:40.052 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: failed 2024-04-25T02:13:40.052 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: damaged 2024-04-25T02:13:40.052 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: stopped 2024-04-25T02:13:40.052 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: data_pools [3] 2024-04-25T02:13:40.053 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: metadata_pool 2 2024-04-25T02:13:40.053 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: inline_data disabled 2024-04-25T02:13:40.053 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: balancer 2024-04-25T02:13:40.053 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: bal_rank_mask -1 2024-04-25T02:13:40.053 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: standby_count_wanted 1 2024-04-25T02:13:40.053 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: qdb_cluster leader: 0 members: 2024-04-25T02:13:40.053 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: [mds.cephfs.smithi112.dvwudt{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.112:6824/3687767796,v1:172.21.15.112:6825/3687767796] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:13:40.053 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-04-25T02:13:40.053 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-04-25T02:13:40.053 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Standby daemons: 2024-04-25T02:13:40.053 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-04-25T02:13:40.053 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: [mds.cephfs.smithi077.gcfygj{-1:14462} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/691698671,v1:172.21.15.77:6829/691698671] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:13:40.053 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: [mds.cephfs.smithi077.oadrkb{-1:14474} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.77:6826/26222645,v1:172.21.15.77:6827/26222645] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:13:40.054 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: [mds.cephfs.smithi112.fjnadi{-1:24269} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/2036319817,v1:172.21.15.112:6827/2036319817] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:13:40.054 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: mon.smithi112@-1(???).osd e50 crush map has features 3314933000852226048, adjusting msgr requires 2024-04-25T02:13:40.054 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: mon.smithi112@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-04-25T02:13:40.054 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: mon.smithi112@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-04-25T02:13:40.054 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: mon.smithi112@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-04-25T02:13:40.054 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 ceph-mon[80494]: mon.smithi112@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-04-25T02:13:40.054 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 bash[80474]: ccd1398acbc5a479337cac5f14f1d1711d786c61de43cdeabbbc2f3bbab006d1 2024-04-25T02:13:40.054 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:39 smithi112 systemd[1]: Started Ceph mon.smithi112 for 4bb93d82-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:13:40.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.214+0000 7fd1d89ad700 1 -- 172.21.15.77:0/1927208078 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1d4109ec0 con 0x7fd1bc06e270 2024-04-25T02:13:40.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.215+0000 7fd1c2ffd700 1 -- 172.21.15.77:0/1927208078 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fd1d4109ec0 con 0x7fd1bc06e270 2024-04-25T02:13:40.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.217+0000 7fd1d89ad700 1 -- 172.21.15.77:0/1927208078 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd1bc06e270 msgr2=0x7fd1bc070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:40.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.217+0000 7fd1d89ad700 1 --2- 172.21.15.77:0/1927208078 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd1bc06e270 0x7fd1bc070720 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4004560 tx=0x7fd1c4009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:40.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.217+0000 7fd1d89ad700 1 -- 172.21.15.77:0/1927208078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d4103760 msgr2=0x7fd1d4113ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:40.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.217+0000 7fd1d89ad700 1 --2- 172.21.15.77:0/1927208078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d4103760 0x7fd1d4113ea0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd1c800c800 tx=0x7fd1c8004470 comp rx=0 tx=0).stop 2024-04-25T02:13:40.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.217+0000 7fd1d89ad700 1 -- 172.21.15.77:0/1927208078 shutdown_connections 2024-04-25T02:13:40.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.217+0000 7fd1d89ad700 1 --2- 172.21.15.77:0/1927208078 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd1bc06e270 0x7fd1bc070720 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.218+0000 7fd1d89ad700 1 --2- 172.21.15.77:0/1927208078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1d4102dc0 0x7fd1d4113960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.218+0000 7fd1d89ad700 1 --2- 172.21.15.77:0/1927208078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d4103760 0x7fd1d4113ea0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.218+0000 7fd1d89ad700 1 -- 172.21.15.77:0/1927208078 >> 172.21.15.77:0/1927208078 conn(0x7fd1d40f8930 msgr2=0x7fd1d40f98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:40.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.218+0000 7fd1d89ad700 1 -- 172.21.15.77:0/1927208078 shutdown_connections 2024-04-25T02:13:40.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.218+0000 7fd1d89ad700 1 -- 172.21.15.77:0/1927208078 wait complete. 2024-04-25T02:13:40.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.317+0000 7f14b94e2700 1 -- 172.21.15.77:0/4205614086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14b4103780 msgr2=0x7f14b40fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:40.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.317+0000 7f14b94e2700 1 --2- 172.21.15.77:0/4205614086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14b4103780 0x7f14b40fcdf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f14a8004940 tx=0x7f14a8009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:40.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.317+0000 7f14b94e2700 1 -- 172.21.15.77:0/4205614086 shutdown_connections 2024-04-25T02:13:40.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.317+0000 7f14b94e2700 1 --2- 172.21.15.77:0/4205614086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14b4103780 0x7f14b40fcdf0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.317+0000 7f14b94e2700 1 --2- 172.21.15.77:0/4205614086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14b4102de0 0x7f14b41031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.317+0000 7f14b94e2700 1 -- 172.21.15.77:0/4205614086 >> 172.21.15.77:0/4205614086 conn(0x7f14b40f8950 msgr2=0x7f14b40fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:40.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.317+0000 7f14b94e2700 1 -- 172.21.15.77:0/4205614086 shutdown_connections 2024-04-25T02:13:40.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.317+0000 7f14b94e2700 1 -- 172.21.15.77:0/4205614086 wait complete. 2024-04-25T02:13:40.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.318+0000 7f14b94e2700 1 Processor -- start 2024-04-25T02:13:40.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.318+0000 7f14b94e2700 1 -- start start 2024-04-25T02:13:40.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.318+0000 7f14b94e2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14b4102de0 0x7f14b4070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.318+0000 7f14b94e2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14b4103780 0x7f14b40707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.318+0000 7f14b94e2700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b4070d30 con 0x7f14b4103780 2024-04-25T02:13:40.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.318+0000 7f14b94e2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b4070e70 con 0x7f14b4102de0 2024-04-25T02:13:40.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.319+0000 7f14b27fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14b4103780 0x7f14b40707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:40.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.319+0000 7f14b27fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14b4103780 0x7f14b40707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57070/0 (socket says 172.21.15.77:57070) 2024-04-25T02:13:40.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.319+0000 7f14b27fc700 1 -- 172.21.15.77:0/2080459699 learned_addr learned my addr 172.21.15.77:0/2080459699 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:13:40.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.319+0000 7f14b2ffd700 1 --2- 172.21.15.77:0/2080459699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14b4102de0 0x7f14b4070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:40.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.319+0000 7f14b2ffd700 1 -- 172.21.15.77:0/2080459699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14b4102de0 msgr2=0x7f14b4070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-25T02:13:40.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.319+0000 7f14b2ffd700 1 -- 172.21.15.77:0/2080459699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14b4102de0 msgr2=0x7f14b4070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T02:13:40.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.319+0000 7f14b2ffd700 1 --2- 172.21.15.77:0/2080459699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14b4102de0 0x7f14b4070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:13:40.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.319+0000 7f14b2ffd700 1 --2- 172.21.15.77:0/2080459699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14b4102de0 0x7f14b4070260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:13:40.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.319+0000 7f14b27fc700 1 -- 172.21.15.77:0/2080459699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14b4102de0 msgr2=0x7f14b4070260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:13:40.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.319+0000 7f14b27fc700 1 --2- 172.21.15.77:0/2080459699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14b4102de0 0x7f14b4070260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.319+0000 7f14b27fc700 1 -- 172.21.15.77:0/2080459699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a8005040 con 0x7f14b4103780 2024-04-25T02:13:40.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.319+0000 7f14b27fc700 1 --2- 172.21.15.77:0/2080459699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14b4103780 0x7f14b40707a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f14a8009100 tx=0x7f14a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:40.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.319+0000 7f149b7fe700 1 -- 172.21.15.77:0/2080459699 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14a800e040 con 0x7f14b4103780 2024-04-25T02:13:40.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.319+0000 7f149b7fe700 1 -- 172.21.15.77:0/2080459699 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f14a8013420 con 0x7f14b4103780 2024-04-25T02:13:40.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.319+0000 7f14b94e2700 1 -- 172.21.15.77:0/2080459699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b40710c0 con 0x7f14b4103780 2024-04-25T02:13:40.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.319+0000 7f149b7fe700 1 -- 172.21.15.77:0/2080459699 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14a801c610 con 0x7f14b4103780 2024-04-25T02:13:40.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.319+0000 7f14b94e2700 1 -- 172.21.15.77:0/2080459699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b411a2a0 con 0x7f14b4103780 2024-04-25T02:13:40.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.320+0000 7f14b94e2700 1 -- 172.21.15.77:0/2080459699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b41052b0 con 0x7f14b4103780 2024-04-25T02:13:40.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.321+0000 7f149b7fe700 1 -- 172.21.15.77:0/2080459699 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f14a800baf0 con 0x7f14b4103780 2024-04-25T02:13:40.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.321+0000 7f149b7fe700 1 --2- 172.21.15.77:0/2080459699 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f149c06e260 0x7f149c070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.321+0000 7f149b7fe700 1 -- 172.21.15.77:0/2080459699 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f14a808eec0 con 0x7f14b4103780 2024-04-25T02:13:40.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.321+0000 7f14b2ffd700 1 --2- 172.21.15.77:0/2080459699 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f149c06e260 0x7f149c070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:40.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.322+0000 7f14b2ffd700 1 --2- 172.21.15.77:0/2080459699 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f149c06e260 0x7f149c070710 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f14a4009e90 tx=0x7f14a4009ec0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:40.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.326+0000 7f149b7fe700 1 -- 172.21.15.77:0/2080459699 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f14a8058190 con 0x7f14b4103780 2024-04-25T02:13:40.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.531+0000 7f14b94e2700 1 -- 172.21.15.77:0/2080459699 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f14b40719f0 con 0x7f149c06e260 2024-04-25T02:13:40.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.541+0000 7f149b7fe700 1 -- 172.21.15.77:0/2080459699 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f14b40719f0 con 0x7f149c06e260 2024-04-25T02:13:40.547 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T02:13:40.547 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (110s) 11s ago 12m 17.4M - 0.25.0 c8568f914cd2 699c7fd25ea5 2024-04-25T02:13:40.547 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (12m) 11s ago 12m 6665k - 17.2.7-902-gc61472c8 0de407c1b3af 2ad2e3d2b09e 2024-04-25T02:13:40.547 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi112 smithi112 running (11m) 13s ago 11m 6660k - 17.2.7-902-gc61472c8 0de407c1b3af 9235dc5eb15d 2024-04-25T02:13:40.547 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (94s) 11s ago 12m 77.3M - 9.4.12 2bacad6d85d8 900138b0bcf0 2024-04-25T02:13:40.547 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.gcfygj smithi077 running (7m) 11s ago 7m 15.2M - 17.2.7-902-gc61472c8 0de407c1b3af 382dd7abf674 2024-04-25T02:13:40.548 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.oadrkb smithi077 running (7m) 11s ago 7m 13.3M - 17.2.7-902-gc61472c8 0de407c1b3af 6992064a4b2a 2024-04-25T02:13:40.548 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.dvwudt smithi112 running (7m) 13s ago 7m 157M - 17.2.7-902-gc61472c8 0de407c1b3af 0792e451abfd 2024-04-25T02:13:40.548 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.fjnadi smithi112 running (7m) 13s ago 7m 14.6M - 17.2.7-902-gc61472c8 0de407c1b3af c8093f622f6b 2024-04-25T02:13:40.548 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.zpflzp smithi077 *:8443,9283,8765 running (3m) 11s ago 14m 472M - 19.0.0-2445-gd2c45d97 f68e37b807ef a1af92e027e5 2024-04-25T02:13:40.548 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi112.cswrxs smithi112 *:8443,9283,8765 running (2m) 13s ago 11m 447M - 19.0.0-2445-gd2c45d97 f68e37b807ef ccc7c57d35f2 2024-04-25T02:13:40.548 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (27s) 11s ago 14m 27.3M 2048M 19.0.0-2445-gd2c45d97 f68e37b807ef 06490c2ecc44 2024-04-25T02:13:40.548 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi112 smithi112 starting - - - 2048M 2024-04-25T02:13:40.548 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (2m) 11s ago 12m 16.5M - 1.5.0 0da6a335fe13 2320132606fc 2024-04-25T02:13:40.548 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi112 smithi112 *:9100 running (2m) 13s ago 11m 15.4M - 1.5.0 0da6a335fe13 49f285354791 2024-04-25T02:13:40.548 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (11m) 11s ago 11m 259M 1557M 17.2.7-902-gc61472c8 0de407c1b3af c741abec3b94 2024-04-25T02:13:40.548 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (10m) 11s ago 10m 259M 1557M 17.2.7-902-gc61472c8 0de407c1b3af 256ff3ced322 2024-04-25T02:13:40.548 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (10m) 11s ago 10m 222M 1557M 17.2.7-902-gc61472c8 0de407c1b3af c5d7d8c993f4 2024-04-25T02:13:40.548 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi112 running (9m) 13s ago 9m 290M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 68429d0dbf88 2024-04-25T02:13:40.548 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi112 running (9m) 13s ago 9m 259M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 66eb71201444 2024-04-25T02:13:40.548 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi112 running (8m) 13s ago 8m 239M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 963e700d6aea 2024-04-25T02:13:40.548 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (2m) 11s ago 12m 57.0M - 2.43.0 a07b618ecd1d c5b8c6104d96 2024-04-25T02:13:40.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.544+0000 7f14b94e2700 1 -- 172.21.15.77:0/2080459699 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f149c06e260 msgr2=0x7f149c070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.544+0000 7f14b94e2700 1 --2- 172.21.15.77:0/2080459699 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f149c06e260 0x7f149c070710 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f14a4009e90 tx=0x7f14a4009ec0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.544+0000 7f14b94e2700 1 -- 172.21.15.77:0/2080459699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14b4103780 msgr2=0x7f14b40707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.544+0000 7f14b94e2700 1 --2- 172.21.15.77:0/2080459699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14b4103780 0x7f14b40707a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f14a8009100 tx=0x7f14a8009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.544+0000 7f14b94e2700 1 -- 172.21.15.77:0/2080459699 shutdown_connections 2024-04-25T02:13:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.544+0000 7f14b94e2700 1 --2- 172.21.15.77:0/2080459699 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f149c06e260 0x7f149c070710 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.544+0000 7f14b94e2700 1 --2- 172.21.15.77:0/2080459699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14b4102de0 0x7f14b4070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.544+0000 7f14b94e2700 1 --2- 172.21.15.77:0/2080459699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14b4103780 0x7f14b40707a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.544+0000 7f14b94e2700 1 -- 172.21.15.77:0/2080459699 >> 172.21.15.77:0/2080459699 conn(0x7f14b40f8950 msgr2=0x7f14b4102210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.544+0000 7f14b94e2700 1 -- 172.21.15.77:0/2080459699 shutdown_connections 2024-04-25T02:13:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.544+0000 7f14b94e2700 1 -- 172.21.15.77:0/2080459699 wait complete. 2024-04-25T02:13:40.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.643+0000 7f9f99a56700 1 -- 172.21.15.77:0/3186640982 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f940fc190 msgr2=0x7f9f94101a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:40.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.643+0000 7f9f99a56700 1 --2- 172.21.15.77:0/3186640982 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f940fc190 0x7f9f94101a70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9f88004940 tx=0x7f9f88009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:40.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.644+0000 7f9f99a56700 1 -- 172.21.15.77:0/3186640982 shutdown_connections 2024-04-25T02:13:40.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.644+0000 7f9f99a56700 1 --2- 172.21.15.77:0/3186640982 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f940fc190 0x7f9f94101a70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.644+0000 7f9f99a56700 1 --2- 172.21.15.77:0/3186640982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f940fb7f0 0x7f9f940fbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.644+0000 7f9f99a56700 1 -- 172.21.15.77:0/3186640982 >> 172.21.15.77:0/3186640982 conn(0x7f9f94071460 msgr2=0x7f9f94071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:40.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.644+0000 7f9f99a56700 1 -- 172.21.15.77:0/3186640982 shutdown_connections 2024-04-25T02:13:40.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.644+0000 7f9f99a56700 1 -- 172.21.15.77:0/3186640982 wait complete. 2024-04-25T02:13:40.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.644+0000 7f9f99a56700 1 Processor -- start 2024-04-25T02:13:40.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.645+0000 7f9f99a56700 1 -- start start 2024-04-25T02:13:40.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.645+0000 7f9f99a56700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f940fb7f0 0x7f9f941139a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.645+0000 7f9f99a56700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f940fc190 0x7f9f94113ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.645+0000 7f9f99a56700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f94114530 con 0x7f9f940fc190 2024-04-25T02:13:40.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.645+0000 7f9f99a56700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9410db50 con 0x7f9f940fb7f0 2024-04-25T02:13:40.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.645+0000 7f9f927fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f940fc190 0x7f9f94113ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:40.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.645+0000 7f9f927fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f940fc190 0x7f9f94113ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57088/0 (socket says 172.21.15.77:57088) 2024-04-25T02:13:40.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.645+0000 7f9f927fc700 1 -- 172.21.15.77:0/2889509197 learned_addr learned my addr 172.21.15.77:0/2889509197 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:13:40.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.645+0000 7f9f92ffd700 1 --2- 172.21.15.77:0/2889509197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f940fb7f0 0x7f9f941139a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:40.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.645+0000 7f9f92ffd700 1 -- 172.21.15.77:0/2889509197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f940fb7f0 msgr2=0x7f9f941139a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-25T02:13:40.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.645+0000 7f9f92ffd700 1 -- 172.21.15.77:0/2889509197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f940fb7f0 msgr2=0x7f9f941139a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T02:13:40.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.645+0000 7f9f92ffd700 1 --2- 172.21.15.77:0/2889509197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f940fb7f0 0x7f9f941139a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:13:40.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.645+0000 7f9f92ffd700 1 --2- 172.21.15.77:0/2889509197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f940fb7f0 0x7f9f941139a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:13:40.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.645+0000 7f9f927fc700 1 -- 172.21.15.77:0/2889509197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f940fb7f0 msgr2=0x7f9f941139a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:13:40.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.645+0000 7f9f927fc700 1 --2- 172.21.15.77:0/2889509197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f940fb7f0 0x7f9f941139a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.645+0000 7f9f927fc700 1 -- 172.21.15.77:0/2889509197 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f88005040 con 0x7f9f940fc190 2024-04-25T02:13:40.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.645+0000 7f9f927fc700 1 --2- 172.21.15.77:0/2889509197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f940fc190 0x7f9f94113ee0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9f88009030 tx=0x7f9f88009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:40.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.646+0000 7f9f7b7fe700 1 -- 172.21.15.77:0/2889509197 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f8800e040 con 0x7f9f940fc190 2024-04-25T02:13:40.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.646+0000 7f9f7b7fe700 1 -- 172.21.15.77:0/2889509197 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9f88004290 con 0x7f9f940fc190 2024-04-25T02:13:40.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.646+0000 7f9f99a56700 1 -- 172.21.15.77:0/2889509197 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9410ddd0 con 0x7f9f940fc190 2024-04-25T02:13:40.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.646+0000 7f9f7b7fe700 1 -- 172.21.15.77:0/2889509197 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f8801c3f0 con 0x7f9f940fc190 2024-04-25T02:13:40.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.646+0000 7f9f99a56700 1 -- 172.21.15.77:0/2889509197 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9410e310 con 0x7f9f940fc190 2024-04-25T02:13:40.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.647+0000 7f9f99a56700 1 -- 172.21.15.77:0/2889509197 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f94065f30 con 0x7f9f940fc190 2024-04-25T02:13:40.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.648+0000 7f9f7b7fe700 1 -- 172.21.15.77:0/2889509197 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f9f88013420 con 0x7f9f940fc190 2024-04-25T02:13:40.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.648+0000 7f9f7b7fe700 1 --2- 172.21.15.77:0/2889509197 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f9f7c06e270 0x7f9f7c070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:40.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.648+0000 7f9f7b7fe700 1 -- 172.21.15.77:0/2889509197 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f9f8808f010 con 0x7f9f940fc190 2024-04-25T02:13:40.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.648+0000 7f9f92ffd700 1 --2- 172.21.15.77:0/2889509197 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f9f7c06e270 0x7f9f7c070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:40.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.649+0000 7f9f92ffd700 1 --2- 172.21.15.77:0/2889509197 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f9f7c06e270 0x7f9f7c070720 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9f84009ce0 tx=0x7f9f84009f70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:40.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.653+0000 7f9f7b7fe700 1 -- 172.21.15.77:0/2889509197 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f9f88058240 con 0x7f9f940fc190 2024-04-25T02:13:40.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.937+0000 7f9f99a56700 1 -- 172.21.15.77:0/2889509197 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9f9410eff0 con 0x7f9f940fc190 2024-04-25T02:13:40.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.938+0000 7f9f7b7fe700 1 -- 172.21.15.77:0/2889509197 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+843 (secure 0 0 0) 0x7f9f8805b900 con 0x7f9f940fc190 2024-04-25T02:13:40.944 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:13:40.944 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-04-25T02:13:40.944 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 1, 2024-04-25T02:13:40.944 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 1 2024-04-25T02:13:40.944 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:13:40.944 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-04-25T02:13:40.944 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:13:40.944 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:13:40.944 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-04-25T02:13:40.944 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 6 2024-04-25T02:13:40.944 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:13:40.944 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-04-25T02:13:40.945 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T02:13:40.945 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:13:40.945 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-04-25T02:13:40.945 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 11, 2024-04-25T02:13:40.945 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 3 2024-04-25T02:13:40.945 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-25T02:13:40.945 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:13:40.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.940+0000 7f9f99a56700 1 -- 172.21.15.77:0/2889509197 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f9f7c06e270 msgr2=0x7f9f7c070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:40.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.940+0000 7f9f99a56700 1 --2- 172.21.15.77:0/2889509197 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f9f7c06e270 0x7f9f7c070720 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9f84009ce0 tx=0x7f9f84009f70 comp rx=0 tx=0).stop 2024-04-25T02:13:40.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.940+0000 7f9f99a56700 1 -- 172.21.15.77:0/2889509197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f940fc190 msgr2=0x7f9f94113ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:40.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.940+0000 7f9f99a56700 1 --2- 172.21.15.77:0/2889509197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f940fc190 0x7f9f94113ee0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9f88009030 tx=0x7f9f88009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:40.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.940+0000 7f9f99a56700 1 -- 172.21.15.77:0/2889509197 shutdown_connections 2024-04-25T02:13:40.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.940+0000 7f9f99a56700 1 --2- 172.21.15.77:0/2889509197 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f9f7c06e270 0x7f9f7c070720 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.940+0000 7f9f99a56700 1 --2- 172.21.15.77:0/2889509197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f940fb7f0 0x7f9f941139a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.940+0000 7f9f99a56700 1 --2- 172.21.15.77:0/2889509197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f940fc190 0x7f9f94113ee0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:40.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.940+0000 7f9f99a56700 1 -- 172.21.15.77:0/2889509197 >> 172.21.15.77:0/2889509197 conn(0x7f9f94071460 msgr2=0x7f9f94100a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:40.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.940+0000 7f9f99a56700 1 -- 172.21.15.77:0/2889509197 shutdown_connections 2024-04-25T02:13:40.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:40.940+0000 7f9f99a56700 1 -- 172.21.15.77:0/2889509197 wait complete. 2024-04-25T02:13:41.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.042+0000 7f3979f77700 1 -- 172.21.15.77:0/3581112206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3974103780 msgr2=0x7f39740fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:41.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.042+0000 7f3979f77700 1 --2- 172.21.15.77:0/3581112206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3974103780 0x7f39740fcdf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3968004940 tx=0x7f3968009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:41.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.042+0000 7f3979f77700 1 -- 172.21.15.77:0/3581112206 shutdown_connections 2024-04-25T02:13:41.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.042+0000 7f3979f77700 1 --2- 172.21.15.77:0/3581112206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3974103780 0x7f39740fcdf0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.042+0000 7f3979f77700 1 --2- 172.21.15.77:0/3581112206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3974102de0 0x7f39741031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.042+0000 7f3979f77700 1 -- 172.21.15.77:0/3581112206 >> 172.21.15.77:0/3581112206 conn(0x7f39740f8990 msgr2=0x7f39740fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:41.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.042+0000 7f3979f77700 1 -- 172.21.15.77:0/3581112206 shutdown_connections 2024-04-25T02:13:41.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.042+0000 7f3979f77700 1 -- 172.21.15.77:0/3581112206 wait complete. 2024-04-25T02:13:41.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.042+0000 7f3979f77700 1 Processor -- start 2024-04-25T02:13:41.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.043+0000 7f3979f77700 1 -- start start 2024-04-25T02:13:41.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.043+0000 7f3979f77700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3974102de0 0x7f3974070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:41.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.043+0000 7f3979f77700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3974103780 0x7f39740707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:41.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.043+0000 7f3979f77700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39740721b0 con 0x7f3974103780 2024-04-25T02:13:41.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.043+0000 7f3979f77700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3974070ce0 con 0x7f3974102de0 2024-04-25T02:13:41.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.043+0000 7f3972ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3974103780 0x7f39740707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:41.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.043+0000 7f3972ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3974103780 0x7f39740707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57100/0 (socket says 172.21.15.77:57100) 2024-04-25T02:13:41.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.043+0000 7f3972ffd700 1 -- 172.21.15.77:0/1546157214 learned_addr learned my addr 172.21.15.77:0/1546157214 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:13:41.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.043+0000 7f39737fe700 1 --2- 172.21.15.77:0/1546157214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3974102de0 0x7f3974070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:41.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.043+0000 7f39737fe700 1 -- 172.21.15.77:0/1546157214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3974102de0 msgr2=0x7f3974070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-25T02:13:41.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.043+0000 7f39737fe700 1 -- 172.21.15.77:0/1546157214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3974102de0 msgr2=0x7f3974070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T02:13:41.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.043+0000 7f3972ffd700 1 -- 172.21.15.77:0/1546157214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3974102de0 msgr2=0x7f3974070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:41.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.043+0000 7f39737fe700 1 --2- 172.21.15.77:0/1546157214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3974102de0 0x7f3974070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:13:41.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.043+0000 7f39737fe700 1 --2- 172.21.15.77:0/1546157214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3974102de0 0x7f3974070260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:13:41.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.043+0000 7f3972ffd700 1 --2- 172.21.15.77:0/1546157214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3974102de0 0x7f3974070260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.043+0000 7f3972ffd700 1 -- 172.21.15.77:0/1546157214 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3968005040 con 0x7f3974103780 2024-04-25T02:13:41.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.043+0000 7f3972ffd700 1 --2- 172.21.15.77:0/1546157214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3974103780 0x7f39740707a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3968009100 tx=0x7f3968009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:41.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.043+0000 7f395bfff700 1 -- 172.21.15.77:0/1546157214 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f396800e040 con 0x7f3974103780 2024-04-25T02:13:41.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.043+0000 7f395bfff700 1 -- 172.21.15.77:0/1546157214 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3968013420 con 0x7f3974103780 2024-04-25T02:13:41.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.043+0000 7f3979f77700 1 -- 172.21.15.77:0/1546157214 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3974070f60 con 0x7f3974103780 2024-04-25T02:13:41.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.044+0000 7f395bfff700 1 -- 172.21.15.77:0/1546157214 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f396801c610 con 0x7f3974103780 2024-04-25T02:13:41.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.044+0000 7f3979f77700 1 -- 172.21.15.77:0/1546157214 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f397411a0e0 con 0x7f3974103780 2024-04-25T02:13:41.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.045+0000 7f3979f77700 1 -- 172.21.15.77:0/1546157214 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39740fe530 con 0x7f3974103780 2024-04-25T02:13:41.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.045+0000 7f395bfff700 1 -- 172.21.15.77:0/1546157214 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f3968013590 con 0x7f3974103780 2024-04-25T02:13:41.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.045+0000 7f395bfff700 1 --2- 172.21.15.77:0/1546157214 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f395c06e270 0x7f395c070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:41.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.046+0000 7f395bfff700 1 -- 172.21.15.77:0/1546157214 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f396808eea0 con 0x7f3974103780 2024-04-25T02:13:41.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.046+0000 7f39737fe700 1 --2- 172.21.15.77:0/1546157214 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f395c06e270 0x7f395c070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:41.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.046+0000 7f39737fe700 1 --2- 172.21.15.77:0/1546157214 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f395c06e270 0x7f395c070720 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3964007fd0 tx=0x7f3964009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:41.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.050+0000 7f395bfff700 1 -- 172.21.15.77:0/1546157214 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f3968058170 con 0x7f3974103780 2024-04-25T02:13:41.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.290+0000 7f3979f77700 1 -- 172.21.15.77:0/1546157214 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3974109ec0 con 0x7f3974103780 2024-04-25T02:13:41.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.290+0000 7f395bfff700 1 -- 172.21.15.77:0/1546157214 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1876 (secure 0 0 0) 0x7f396805b830 con 0x7f3974103780 2024-04-25T02:13:41.296 INFO:teuthology.orchestra.run.smithi077.stdout:e15 2024-04-25T02:13:41.296 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T02:13:41.296 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:13:41.296 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-04-25T02:13:41.297 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:13:41.297 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-04-25T02:13:41.297 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-04-25T02:13:41.297 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 15 2024-04-25T02:13:41.297 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-25T02:13:41.297 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-04-25T02:06:10.008979+0000 2024-04-25T02:13:41.297 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-04-25T02:06:27.849984+0000 2024-04-25T02:13:41.297 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-04-25T02:13:41.297 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-04-25T02:13:41.297 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-04-25T02:13:41.297 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-04-25T02:13:41.297 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-04-25T02:13:41.297 INFO:teuthology.orchestra.run.smithi077.stdout:max_xattr_size 65536 2024-04-25T02:13:41.297 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-04-25T02:13:41.297 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-04-25T02:13:41.297 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 47 2024-04-25T02:13:41.297 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:13:41.298 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-04-25T02:13:41.298 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-04-25T02:13:41.298 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=24257} 2024-04-25T02:13:41.298 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-04-25T02:13:41.298 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-04-25T02:13:41.298 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-04-25T02:13:41.298 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-04-25T02:13:41.298 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-04-25T02:13:41.298 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-04-25T02:13:41.298 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-04-25T02:13:41.298 INFO:teuthology.orchestra.run.smithi077.stdout:bal_rank_mask -1 2024-04-25T02:13:41.298 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-04-25T02:13:41.298 INFO:teuthology.orchestra.run.smithi077.stdout:qdb_cluster leader: 0 members: 2024-04-25T02:13:41.298 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi112.dvwudt{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.112:6824/3687767796,v1:172.21.15.112:6825/3687767796] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:13:41.299 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:13:41.299 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:13:41.299 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-04-25T02:13:41.299 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:13:41.299 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.gcfygj{-1:14462} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/691698671,v1:172.21.15.77:6829/691698671] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:13:41.299 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.oadrkb{-1:14474} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.77:6826/26222645,v1:172.21.15.77:6827/26222645] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:13:41.299 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi112.fjnadi{-1:24269} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/2036319817,v1:172.21.15.112:6827/2036319817] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:13:41.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.292+0000 7f3979f77700 1 -- 172.21.15.77:0/1546157214 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f395c06e270 msgr2=0x7f395c070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:41.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.292+0000 7f3979f77700 1 --2- 172.21.15.77:0/1546157214 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f395c06e270 0x7f395c070720 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3964007fd0 tx=0x7f3964009040 comp rx=0 tx=0).stop 2024-04-25T02:13:41.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.292+0000 7f3979f77700 1 -- 172.21.15.77:0/1546157214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3974103780 msgr2=0x7f39740707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:41.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.292+0000 7f3979f77700 1 --2- 172.21.15.77:0/1546157214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3974103780 0x7f39740707a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3968009100 tx=0x7f3968009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:41.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.292+0000 7f3979f77700 1 -- 172.21.15.77:0/1546157214 shutdown_connections 2024-04-25T02:13:41.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.292+0000 7f3979f77700 1 --2- 172.21.15.77:0/1546157214 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f395c06e270 0x7f395c070720 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.292+0000 7f3979f77700 1 --2- 172.21.15.77:0/1546157214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3974102de0 0x7f3974070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.292+0000 7f3979f77700 1 --2- 172.21.15.77:0/1546157214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3974103780 0x7f39740707a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.292+0000 7f3979f77700 1 -- 172.21.15.77:0/1546157214 >> 172.21.15.77:0/1546157214 conn(0x7f39740f8990 msgr2=0x7f39740f9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:41.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.293+0000 7f3979f77700 1 -- 172.21.15.77:0/1546157214 shutdown_connections 2024-04-25T02:13:41.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.293+0000 7f3979f77700 1 -- 172.21.15.77:0/1546157214 wait complete. 2024-04-25T02:13:41.301 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 15 2024-04-25T02:13:41.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.401+0000 7f8d7f7a2700 1 -- 172.21.15.77:0/226910622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d78101d00 msgr2=0x7f8d781020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:41.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.401+0000 7f8d7f7a2700 1 --2- 172.21.15.77:0/226910622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d78101d00 0x7f8d781020d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8d74004940 tx=0x7f8d74009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:41.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.401+0000 7f8d7f7a2700 1 -- 172.21.15.77:0/226910622 shutdown_connections 2024-04-25T02:13:41.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.401+0000 7f8d7f7a2700 1 --2- 172.21.15.77:0/226910622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d781026a0 0x7f8d780fbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.401+0000 7f8d7f7a2700 1 --2- 172.21.15.77:0/226910622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d78101d00 0x7f8d781020d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.401+0000 7f8d7f7a2700 1 -- 172.21.15.77:0/226910622 >> 172.21.15.77:0/226910622 conn(0x7f8d780f78d0 msgr2=0x7f8d780f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:41.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.401+0000 7f8d7f7a2700 1 -- 172.21.15.77:0/226910622 shutdown_connections 2024-04-25T02:13:41.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.401+0000 7f8d7f7a2700 1 -- 172.21.15.77:0/226910622 wait complete. 2024-04-25T02:13:41.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.401+0000 7f8d7f7a2700 1 Processor -- start 2024-04-25T02:13:41.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.401+0000 7f8d7f7a2700 1 -- start start 2024-04-25T02:13:41.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.401+0000 7f8d7f7a2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d78101d00 0x7f8d7810eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:41.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.401+0000 7f8d7f7a2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d781026a0 0x7f8d7810f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:41.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.401+0000 7f8d7f7a2700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7810f710 con 0x7f8d781026a0 2024-04-25T02:13:41.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.402+0000 7f8d7f7a2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7810f850 con 0x7f8d78101d00 2024-04-25T02:13:41.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.402+0000 7f8d7cd3d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d781026a0 0x7f8d7810f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:41.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.402+0000 7f8d7cd3d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d781026a0 0x7f8d7810f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57114/0 (socket says 172.21.15.77:57114) 2024-04-25T02:13:41.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.402+0000 7f8d7cd3d700 1 -- 172.21.15.77:0/1712979032 learned_addr learned my addr 172.21.15.77:0/1712979032 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:13:41.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.402+0000 7f8d7d53e700 1 --2- 172.21.15.77:0/1712979032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d78101d00 0x7f8d7810eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:41.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.402+0000 7f8d7d53e700 1 -- 172.21.15.77:0/1712979032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d78101d00 msgr2=0x7f8d7810eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-25T02:13:41.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.402+0000 7f8d7d53e700 1 -- 172.21.15.77:0/1712979032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d78101d00 msgr2=0x7f8d7810eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T02:13:41.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.402+0000 7f8d7d53e700 1 --2- 172.21.15.77:0/1712979032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d78101d00 0x7f8d7810eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:13:41.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.402+0000 7f8d7cd3d700 1 -- 172.21.15.77:0/1712979032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d78101d00 msgr2=0x7f8d7810eb80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:13:41.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.402+0000 7f8d7d53e700 1 --2- 172.21.15.77:0/1712979032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d78101d00 0x7f8d7810eb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:13:41.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.402+0000 7f8d7cd3d700 1 --2- 172.21.15.77:0/1712979032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d78101d00 0x7f8d7810eb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.402+0000 7f8d7cd3d700 1 -- 172.21.15.77:0/1712979032 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d74005040 con 0x7f8d781026a0 2024-04-25T02:13:41.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.402+0000 7f8d7cd3d700 1 --2- 172.21.15.77:0/1712979032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d781026a0 0x7f8d7810f0c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8d68002a80 tx=0x7f8d68004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:41.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.402+0000 7f8d6dffb700 1 -- 172.21.15.77:0/1712979032 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d68007cc0 con 0x7f8d781026a0 2024-04-25T02:13:41.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.402+0000 7f8d6dffb700 1 -- 172.21.15.77:0/1712979032 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8d6800f040 con 0x7f8d781026a0 2024-04-25T02:13:41.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.402+0000 7f8d7f7a2700 1 -- 172.21.15.77:0/1712979032 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d78117bf0 con 0x7f8d781026a0 2024-04-25T02:13:41.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.402+0000 7f8d6dffb700 1 -- 172.21.15.77:0/1712979032 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d6800daf0 con 0x7f8d781026a0 2024-04-25T02:13:41.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.402+0000 7f8d7f7a2700 1 -- 172.21.15.77:0/1712979032 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d78118150 con 0x7f8d781026a0 2024-04-25T02:13:41.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.403+0000 7f8d7f7a2700 1 -- 172.21.15.77:0/1712979032 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d780fd450 con 0x7f8d781026a0 2024-04-25T02:13:41.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.404+0000 7f8d6dffb700 1 -- 172.21.15.77:0/1712979032 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f8d6800dd30 con 0x7f8d781026a0 2024-04-25T02:13:41.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.404+0000 7f8d6dffb700 1 --2- 172.21.15.77:0/1712979032 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f8d6406e260 0x7f8d64070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:41.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.404+0000 7f8d6dffb700 1 -- 172.21.15.77:0/1712979032 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f8d6808d400 con 0x7f8d781026a0 2024-04-25T02:13:41.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.404+0000 7f8d7d53e700 1 --2- 172.21.15.77:0/1712979032 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f8d6406e260 0x7f8d64070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:41.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.405+0000 7f8d7d53e700 1 --2- 172.21.15.77:0/1712979032 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f8d6406e260 0x7f8d64070710 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8d74004f90 tx=0x7f8d74009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:41.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.409+0000 7f8d6dffb700 1 -- 172.21.15.77:0/1712979032 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f8d680565b0 con 0x7f8d781026a0 2024-04-25T02:13:41.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.628+0000 7f8d7f7a2700 1 -- 172.21.15.77:0/1712979032 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d7804bed0 con 0x7f8d6406e260 2024-04-25T02:13:41.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.629+0000 7f8d6dffb700 1 -- 172.21.15.77:0/1712979032 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f8d7804bed0 con 0x7f8d6406e260 2024-04-25T02:13:41.635 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:13:41.635 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901", 2024-04-25T02:13:41.635 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-04-25T02:13:41.635 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T02:13:41.635 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-04-25T02:13:41.635 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr" 2024-04-25T02:13:41.635 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-25T02:13:41.635 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "3/21 daemons upgraded", 2024-04-25T02:13:41.635 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading mon daemons", 2024-04-25T02:13:41.635 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-04-25T02:13:41.635 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:13:41.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.632+0000 7f8d7f7a2700 1 -- 172.21.15.77:0/1712979032 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f8d6406e260 msgr2=0x7f8d64070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:41.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.632+0000 7f8d7f7a2700 1 --2- 172.21.15.77:0/1712979032 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f8d6406e260 0x7f8d64070710 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8d74004f90 tx=0x7f8d74009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:41.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.632+0000 7f8d7f7a2700 1 -- 172.21.15.77:0/1712979032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d781026a0 msgr2=0x7f8d7810f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:41.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.632+0000 7f8d7f7a2700 1 --2- 172.21.15.77:0/1712979032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d781026a0 0x7f8d7810f0c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8d68002a80 tx=0x7f8d68004630 comp rx=0 tx=0).stop 2024-04-25T02:13:41.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.632+0000 7f8d7f7a2700 1 -- 172.21.15.77:0/1712979032 shutdown_connections 2024-04-25T02:13:41.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.632+0000 7f8d7f7a2700 1 --2- 172.21.15.77:0/1712979032 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f8d6406e260 0x7f8d64070710 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.632+0000 7f8d7f7a2700 1 --2- 172.21.15.77:0/1712979032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d78101d00 0x7f8d7810eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.632+0000 7f8d7f7a2700 1 --2- 172.21.15.77:0/1712979032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d781026a0 0x7f8d7810f0c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.632+0000 7f8d7f7a2700 1 -- 172.21.15.77:0/1712979032 >> 172.21.15.77:0/1712979032 conn(0x7f8d780f78d0 msgr2=0x7f8d780f88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:41.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.632+0000 7f8d7f7a2700 1 -- 172.21.15.77:0/1712979032 shutdown_connections 2024-04-25T02:13:41.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.632+0000 7f8d7f7a2700 1 -- 172.21.15.77:0/1712979032 wait complete. 2024-04-25T02:13:41.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.733+0000 7f479523e700 1 -- 172.21.15.77:0/2898812378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47900fbf40 msgr2=0x7f4790101a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:41.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.733+0000 7f479523e700 1 --2- 172.21.15.77:0/2898812378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47900fbf40 0x7f4790101a30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4784004940 tx=0x7f4784009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:41.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.733+0000 7f479523e700 1 -- 172.21.15.77:0/2898812378 shutdown_connections 2024-04-25T02:13:41.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.733+0000 7f479523e700 1 --2- 172.21.15.77:0/2898812378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47900fbf40 0x7f4790101a30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.733+0000 7f479523e700 1 --2- 172.21.15.77:0/2898812378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47900fb5a0 0x7f47900fb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.733+0000 7f479523e700 1 -- 172.21.15.77:0/2898812378 >> 172.21.15.77:0/2898812378 conn(0x7f4790073350 msgr2=0x7f4790073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:41.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.733+0000 7f479523e700 1 -- 172.21.15.77:0/2898812378 shutdown_connections 2024-04-25T02:13:41.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.733+0000 7f479523e700 1 -- 172.21.15.77:0/2898812378 wait complete. 2024-04-25T02:13:41.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.734+0000 7f479523e700 1 Processor -- start 2024-04-25T02:13:41.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.734+0000 7f479523e700 1 -- start start 2024-04-25T02:13:41.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.734+0000 7f479523e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47900fb5a0 0x7f47900fc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:41.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.734+0000 7f479523e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47900fbf40 0x7f47900fca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:41.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.734+0000 7f479523e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47900fe480 con 0x7f47900fb5a0 2024-04-25T02:13:41.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.734+0000 7f479523e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47900fcfb0 con 0x7f47900fbf40 2024-04-25T02:13:41.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.734+0000 7f478ed9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47900fb5a0 0x7f47900fc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:41.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.735+0000 7f478ed9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47900fb5a0 0x7f47900fc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57126/0 (socket says 172.21.15.77:57126) 2024-04-25T02:13:41.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.735+0000 7f478ed9d700 1 -- 172.21.15.77:0/725261815 learned_addr learned my addr 172.21.15.77:0/725261815 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:13:41.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.735+0000 7f478e59c700 1 --2- 172.21.15.77:0/725261815 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47900fbf40 0x7f47900fca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:41.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.735+0000 7f478e59c700 1 -- 172.21.15.77:0/725261815 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47900fbf40 msgr2=0x7f47900fca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-25T02:13:41.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.735+0000 7f478e59c700 1 -- 172.21.15.77:0/725261815 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47900fbf40 msgr2=0x7f47900fca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T02:13:41.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.735+0000 7f478e59c700 1 --2- 172.21.15.77:0/725261815 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47900fbf40 0x7f47900fca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:13:41.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.735+0000 7f478e59c700 1 --2- 172.21.15.77:0/725261815 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47900fbf40 0x7f47900fca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:13:41.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.735+0000 7f478ed9d700 1 -- 172.21.15.77:0/725261815 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47900fbf40 msgr2=0x7f47900fca70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:13:41.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.735+0000 7f478ed9d700 1 --2- 172.21.15.77:0/725261815 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47900fbf40 0x7f47900fca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:41.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.735+0000 7f478ed9d700 1 -- 172.21.15.77:0/725261815 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4784005040 con 0x7f47900fb5a0 2024-04-25T02:13:41.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.735+0000 7f478ed9d700 1 --2- 172.21.15.77:0/725261815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47900fb5a0 0x7f47900fc530 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f47800041d0 tx=0x7f47800046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:41.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.735+0000 7f47777fe700 1 -- 172.21.15.77:0/725261815 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4780007cc0 con 0x7f47900fb5a0 2024-04-25T02:13:41.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.735+0000 7f47777fe700 1 -- 172.21.15.77:0/725261815 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f478000f040 con 0x7f47900fb5a0 2024-04-25T02:13:41.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.735+0000 7f479523e700 1 -- 172.21.15.77:0/725261815 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47900fd290 con 0x7f47900fb5a0 2024-04-25T02:13:41.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.735+0000 7f47777fe700 1 -- 172.21.15.77:0/725261815 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f478000dbe0 con 0x7f47900fb5a0 2024-04-25T02:13:41.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.735+0000 7f479523e700 1 -- 172.21.15.77:0/725261815 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479011a150 con 0x7f47900fb5a0 2024-04-25T02:13:41.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.736+0000 7f479523e700 1 -- 172.21.15.77:0/725261815 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47900fe670 con 0x7f47900fb5a0 2024-04-25T02:13:41.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.737+0000 7f47777fe700 1 -- 172.21.15.77:0/725261815 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f478000dd40 con 0x7f47900fb5a0 2024-04-25T02:13:41.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.737+0000 7f47777fe700 1 --2- 172.21.15.77:0/725261815 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f477806e270 0x7f4778070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:13:41.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.737+0000 7f47777fe700 1 -- 172.21.15.77:0/725261815 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f478008d4d0 con 0x7f47900fb5a0 2024-04-25T02:13:41.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.737+0000 7f478e59c700 1 --2- 172.21.15.77:0/725261815 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f477806e270 0x7f4778070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:13:41.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.737+0000 7f478e59c700 1 --2- 172.21.15.77:0/725261815 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f477806e270 0x7f4778070720 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f47900fdc60 tx=0x7f4784009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:13:41.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:41.742+0000 7f47777fe700 1 -- 172.21.15.77:0/725261815 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f4780056680 con 0x7f47900fb5a0 2024-04-25T02:13:42.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:42.019+0000 7f479523e700 1 -- 172.21.15.77:0/725261815 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4790109f80 con 0x7f47900fb5a0 2024-04-25T02:13:42.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:42.019+0000 7f47777fe700 1 -- 172.21.15.77:0/725261815 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f4780059d40 con 0x7f47900fb5a0 2024-04-25T02:13:42.025 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-04-25T02:13:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:42.021+0000 7f479523e700 1 -- 172.21.15.77:0/725261815 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f477806e270 msgr2=0x7f4778070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:42.021+0000 7f479523e700 1 --2- 172.21.15.77:0/725261815 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f477806e270 0x7f4778070720 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f47900fdc60 tx=0x7f4784009e30 comp rx=0 tx=0).stop 2024-04-25T02:13:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:42.021+0000 7f479523e700 1 -- 172.21.15.77:0/725261815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47900fb5a0 msgr2=0x7f47900fc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:13:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:42.021+0000 7f479523e700 1 --2- 172.21.15.77:0/725261815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47900fb5a0 0x7f47900fc530 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f47800041d0 tx=0x7f47800046b0 comp rx=0 tx=0).stop 2024-04-25T02:13:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:42.021+0000 7f479523e700 1 -- 172.21.15.77:0/725261815 shutdown_connections 2024-04-25T02:13:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:42.022+0000 7f479523e700 1 --2- 172.21.15.77:0/725261815 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f477806e270 0x7f4778070720 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:42.022+0000 7f479523e700 1 --2- 172.21.15.77:0/725261815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47900fb5a0 0x7f47900fc530 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:42.022+0000 7f479523e700 1 --2- 172.21.15.77:0/725261815 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47900fbf40 0x7f47900fca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:13:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:42.022+0000 7f479523e700 1 -- 172.21.15.77:0/725261815 >> 172.21.15.77:0/725261815 conn(0x7f4790073350 msgr2=0x7f4790100a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:13:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:42.022+0000 7f479523e700 1 -- 172.21.15.77:0/725261815 shutdown_connections 2024-04-25T02:13:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:13:42.022+0000 7f479523e700 1 -- 172.21.15.77:0/725261815 wait complete. 2024-04-25T02:13:42.352 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:42 smithi112 ceph-mon[80494]: osdmap e50: 6 total, 6 up, 6 in 2024-04-25T02:13:42.352 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:42 smithi112 ceph-mon[80494]: mgrmap e39: smithi077.zpflzp(active, since 17s), standbys: smithi112.cswrxs 2024-04-25T02:13:42.353 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:42 smithi112 ceph-mon[80494]: overall HEALTH_OK 2024-04-25T02:13:42.353 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:42 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-04-25T02:13:42.353 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:42 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-04-25T02:13:42.353 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:42 smithi112 ceph-mon[80494]: mon.smithi077 calling monitor election 2024-04-25T02:13:42.353 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:42 smithi112 ceph-mon[80494]: mon.smithi112 calling monitor election 2024-04-25T02:13:42.353 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:42 smithi112 ceph-mon[80494]: mon.smithi077 is new leader, mons smithi077,smithi112 in quorum (ranks 0,1) 2024-04-25T02:13:42.353 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:42 smithi112 ceph-mon[80494]: monmap epoch 3 2024-04-25T02:13:42.353 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:42 smithi112 ceph-mon[80494]: fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 2024-04-25T02:13:42.353 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:42 smithi112 ceph-mon[80494]: last_changed 2024-04-25T02:13:41.340468+0000 2024-04-25T02:13:42.353 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:42 smithi112 ceph-mon[80494]: created 2024-04-25T01:59:19.321779+0000 2024-04-25T02:13:42.353 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:42 smithi112 ceph-mon[80494]: min_mon_release 19 (squid) 2024-04-25T02:13:42.353 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:42 smithi112 ceph-mon[80494]: election_strategy: 1 2024-04-25T02:13:42.353 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:42 smithi112 ceph-mon[80494]: 0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.smithi077 2024-04-25T02:13:42.353 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:42 smithi112 ceph-mon[80494]: 1: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.smithi112 2024-04-25T02:13:42.354 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:42 smithi112 ceph-mon[80494]: fsmap cephfs:1 {0=cephfs.smithi112.dvwudt=up:active} 3 up:standby 2024-04-25T02:13:42.354 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:42 smithi112 ceph-mon[80494]: osdmap e50: 6 total, 6 up, 6 in 2024-04-25T02:13:42.354 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:42 smithi112 ceph-mon[80494]: mgrmap e39: smithi077.zpflzp(active, since 17s), standbys: smithi112.cswrxs 2024-04-25T02:13:42.354 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:42 smithi112 ceph-mon[80494]: overall HEALTH_OK 2024-04-25T02:13:42.354 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:42 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:42.354 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:42 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:42.354 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:42 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:13:42.354 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:42 smithi112 ceph-mon[80494]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:13:42.354 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:42 smithi112 ceph-mon[80494]: pgmap v12: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-25T02:13:42.354 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:42 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/725261815' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T02:13:42.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:42 smithi077 ceph-mon[110441]: osdmap e50: 6 total, 6 up, 6 in 2024-04-25T02:13:42.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:42 smithi077 ceph-mon[110441]: mgrmap e39: smithi077.zpflzp(active, since 17s), standbys: smithi112.cswrxs 2024-04-25T02:13:42.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:42 smithi077 ceph-mon[110441]: overall HEALTH_OK 2024-04-25T02:13:42.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:42 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-04-25T02:13:42.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:42 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-04-25T02:13:42.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:42 smithi077 ceph-mon[110441]: mon.smithi077 calling monitor election 2024-04-25T02:13:42.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:42 smithi077 ceph-mon[110441]: mon.smithi112 calling monitor election 2024-04-25T02:13:42.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:42 smithi077 ceph-mon[110441]: mon.smithi077 is new leader, mons smithi077,smithi112 in quorum (ranks 0,1) 2024-04-25T02:13:42.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:42 smithi077 ceph-mon[110441]: monmap epoch 3 2024-04-25T02:13:42.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:42 smithi077 ceph-mon[110441]: fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 2024-04-25T02:13:42.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:42 smithi077 ceph-mon[110441]: last_changed 2024-04-25T02:13:41.340468+0000 2024-04-25T02:13:42.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:42 smithi077 ceph-mon[110441]: created 2024-04-25T01:59:19.321779+0000 2024-04-25T02:13:42.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:42 smithi077 ceph-mon[110441]: min_mon_release 19 (squid) 2024-04-25T02:13:42.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:42 smithi077 ceph-mon[110441]: election_strategy: 1 2024-04-25T02:13:42.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:42 smithi077 ceph-mon[110441]: 0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.smithi077 2024-04-25T02:13:42.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:42 smithi077 ceph-mon[110441]: 1: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.smithi112 2024-04-25T02:13:42.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:42 smithi077 ceph-mon[110441]: fsmap cephfs:1 {0=cephfs.smithi112.dvwudt=up:active} 3 up:standby 2024-04-25T02:13:42.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:42 smithi077 ceph-mon[110441]: osdmap e50: 6 total, 6 up, 6 in 2024-04-25T02:13:42.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:42 smithi077 ceph-mon[110441]: mgrmap e39: smithi077.zpflzp(active, since 17s), standbys: smithi112.cswrxs 2024-04-25T02:13:42.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:42 smithi077 ceph-mon[110441]: overall HEALTH_OK 2024-04-25T02:13:42.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:42 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:42.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:42 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:42.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:42 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:13:42.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:42 smithi077 ceph-mon[110441]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:13:42.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:42 smithi077 ceph-mon[110441]: pgmap v12: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-25T02:13:42.731 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:42 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/725261815' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T02:13:45.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:44 smithi112 ceph-mon[80494]: pgmap v13: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:45.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:44 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:45.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:44 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:45.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:44 smithi077 ceph-mon[110441]: pgmap v13: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:45.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:44 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:45.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:44 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:46.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:46 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:46.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:46 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:46.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:46 smithi112 ceph-mon[80494]: pgmap v14: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:46.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:46 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:46.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:46 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:46.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:46 smithi077 ceph-mon[110441]: pgmap v14: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:48.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:48 smithi077 ceph-mon[110441]: pgmap v15: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:48.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:48 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:48.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:48 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:48.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:48 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:13:48.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:48 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:13:48.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:48 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:48.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:48 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:13:48.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:48 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T02:13:48.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:48 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:13:49.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:48 smithi112 ceph-mon[80494]: pgmap v15: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:49.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:48 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:49.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:48 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:49.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:48 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:13:49.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:48 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:13:49.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:48 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:49.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:48 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:13:49.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:48 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T02:13:49.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:48 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:13:50.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:49 smithi112 ceph-mon[80494]: Detected new or changed devices on smithi112 2024-04-25T02:13:50.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:49 smithi112 ceph-mon[80494]: Reconfiguring mon.smithi077 (monmap changed)... 2024-04-25T02:13:50.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:49 smithi112 ceph-mon[80494]: Reconfiguring daemon mon.smithi077 on smithi077 2024-04-25T02:13:50.165 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:49 smithi077 ceph-mon[110441]: Detected new or changed devices on smithi112 2024-04-25T02:13:50.165 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:49 smithi077 ceph-mon[110441]: Reconfiguring mon.smithi077 (monmap changed)... 2024-04-25T02:13:50.165 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:49 smithi077 ceph-mon[110441]: Reconfiguring daemon mon.smithi077 on smithi077 2024-04-25T02:13:51.043 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:50 smithi077 ceph-mon[110441]: pgmap v16: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:51.043 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:50 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:51.043 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:50 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:51.043 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:50 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi077.zpflzp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T02:13:51.043 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:50 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T02:13:51.043 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:50 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:13:51.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:50 smithi112 ceph-mon[80494]: pgmap v16: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:51.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:50 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:51.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:50 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:51.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:50 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi077.zpflzp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T02:13:51.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:50 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T02:13:51.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:50 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:13:52.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:51 smithi077 ceph-mon[110441]: Reconfiguring mgr.smithi077.zpflzp (monmap changed)... 2024-04-25T02:13:52.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:51 smithi077 ceph-mon[110441]: Reconfiguring daemon mgr.smithi077.zpflzp on smithi077 2024-04-25T02:13:52.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:51 smithi112 ceph-mon[80494]: Reconfiguring mgr.smithi077.zpflzp (monmap changed)... 2024-04-25T02:13:52.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:51 smithi112 ceph-mon[80494]: Reconfiguring daemon mgr.smithi077.zpflzp on smithi077 2024-04-25T02:13:52.936 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:52 smithi077 ceph-mon[110441]: pgmap v17: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:52.936 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:52 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:52.937 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:52 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:52.937 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:52 smithi077 ceph-mon[110441]: Reconfiguring crash.smithi077 (monmap changed)... 2024-04-25T02:13:52.937 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:52 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi077", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T02:13:52.937 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:52 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:13:52.937 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:52 smithi077 ceph-mon[110441]: Reconfiguring daemon crash.smithi077 on smithi077 2024-04-25T02:13:53.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:52 smithi112 ceph-mon[80494]: pgmap v17: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:53.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:52 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:53.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:52 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:53.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:52 smithi112 ceph-mon[80494]: Reconfiguring crash.smithi077 (monmap changed)... 2024-04-25T02:13:53.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:52 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi077", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T02:13:53.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:52 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:13:53.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:52 smithi112 ceph-mon[80494]: Reconfiguring daemon crash.smithi077 on smithi077 2024-04-25T02:13:54.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:54 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:54.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:54 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:54.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:54 smithi077 ceph-mon[110441]: Reconfiguring osd.0 (monmap changed)... 2024-04-25T02:13:54.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:54 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-25T02:13:54.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:54 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:13:54.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:54 smithi077 ceph-mon[110441]: Reconfiguring daemon osd.0 on smithi077 2024-04-25T02:13:54.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:54 smithi077 ceph-mon[110441]: pgmap v18: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:54.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:54 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:13:54.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:54 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:54.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:54 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:54.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:54 smithi112 ceph-mon[80494]: Reconfiguring osd.0 (monmap changed)... 2024-04-25T02:13:54.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:54 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-25T02:13:54.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:54 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:13:54.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:54 smithi112 ceph-mon[80494]: Reconfiguring daemon osd.0 on smithi077 2024-04-25T02:13:54.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:54 smithi112 ceph-mon[80494]: pgmap v18: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:54.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:54 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:13:55.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:55 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:55.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:55 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:55.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:55 smithi077 ceph-mon[110441]: Reconfiguring osd.1 (monmap changed)... 2024-04-25T02:13:55.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:55 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-25T02:13:55.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:55 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:13:55.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:55 smithi077 ceph-mon[110441]: Reconfiguring daemon osd.1 on smithi077 2024-04-25T02:13:56.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:55 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:56.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:55 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:56.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:55 smithi112 ceph-mon[80494]: Reconfiguring osd.1 (monmap changed)... 2024-04-25T02:13:56.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:55 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-25T02:13:56.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:55 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:13:56.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:55 smithi112 ceph-mon[80494]: Reconfiguring daemon osd.1 on smithi077 2024-04-25T02:13:57.104 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:56 smithi077 ceph-mon[110441]: pgmap v19: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:57.104 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:56 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:57.104 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:56 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:57.104 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:56 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-25T02:13:57.104 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:56 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:13:57.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:56 smithi112 ceph-mon[80494]: pgmap v19: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:57.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:56 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:57.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:56 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:57.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:56 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-25T02:13:57.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:56 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:13:58.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:57 smithi077 ceph-mon[110441]: Reconfiguring osd.2 (monmap changed)... 2024-04-25T02:13:58.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:57 smithi077 ceph-mon[110441]: Reconfiguring daemon osd.2 on smithi077 2024-04-25T02:13:58.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:57 smithi112 ceph-mon[80494]: Reconfiguring osd.2 (monmap changed)... 2024-04-25T02:13:58.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:57 smithi112 ceph-mon[80494]: Reconfiguring daemon osd.2 on smithi077 2024-04-25T02:13:58.939 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:58 smithi077 ceph-mon[110441]: pgmap v20: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:58.939 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:58 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:58.939 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:58 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:58.939 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:58 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.oadrkb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:13:58.939 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:58 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:13:59.193 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:58 smithi112 ceph-mon[80494]: pgmap v20: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:13:59.193 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:58 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:59.193 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:58 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:13:59.194 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:58 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.oadrkb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:13:59.194 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:58 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:00.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:59 smithi112 ceph-mon[80494]: Reconfiguring mds.cephfs.smithi077.oadrkb (monmap changed)... 2024-04-25T02:14:00.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:59 smithi112 ceph-mon[80494]: Reconfiguring daemon mds.cephfs.smithi077.oadrkb on smithi077 2024-04-25T02:14:00.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:59 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:00.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:59 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:00.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:59 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.gcfygj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:14:00.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:13:59 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:00.187 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:59 smithi077 ceph-mon[110441]: Reconfiguring mds.cephfs.smithi077.oadrkb (monmap changed)... 2024-04-25T02:14:00.187 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:59 smithi077 ceph-mon[110441]: Reconfiguring daemon mds.cephfs.smithi077.oadrkb on smithi077 2024-04-25T02:14:00.187 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:59 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:00.187 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:59 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:00.187 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:59 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.gcfygj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:14:00.187 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:13:59 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:01.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:00 smithi077 ceph-mon[110441]: Reconfiguring mds.cephfs.smithi077.gcfygj (monmap changed)... 2024-04-25T02:14:01.215 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:00 smithi077 ceph-mon[110441]: Reconfiguring daemon mds.cephfs.smithi077.gcfygj on smithi077 2024-04-25T02:14:01.215 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:00 smithi077 ceph-mon[110441]: pgmap v21: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:01.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:00 smithi112 ceph-mon[80494]: Reconfiguring mds.cephfs.smithi077.gcfygj (monmap changed)... 2024-04-25T02:14:01.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:00 smithi112 ceph-mon[80494]: Reconfiguring daemon mds.cephfs.smithi077.gcfygj on smithi077 2024-04-25T02:14:01.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:00 smithi112 ceph-mon[80494]: pgmap v21: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:02.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:02 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:02.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:02 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:02.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:02 smithi077 ceph-mon[110441]: Reconfiguring crash.smithi112 (monmap changed)... 2024-04-25T02:14:02.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:02 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T02:14:02.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:02 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:02.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:02 smithi077 ceph-mon[110441]: Reconfiguring daemon crash.smithi112 on smithi112 2024-04-25T02:14:02.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:02 smithi077 ceph-mon[110441]: pgmap v22: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:02.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:02 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:02.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:02 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:02.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:02 smithi112 ceph-mon[80494]: Reconfiguring crash.smithi112 (monmap changed)... 2024-04-25T02:14:02.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:02 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T02:14:02.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:02 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:02.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:02 smithi112 ceph-mon[80494]: Reconfiguring daemon crash.smithi112 on smithi112 2024-04-25T02:14:02.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:02 smithi112 ceph-mon[80494]: pgmap v22: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:04.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:03 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:04.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:03 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:04.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:03 smithi112 ceph-mon[80494]: Reconfiguring mgr.smithi112.cswrxs (monmap changed)... 2024-04-25T02:14:04.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:03 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.cswrxs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T02:14:04.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:03 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T02:14:04.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:03 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:04.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:03 smithi112 ceph-mon[80494]: Reconfiguring daemon mgr.smithi112.cswrxs on smithi112 2024-04-25T02:14:04.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:03 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:04.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:03 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:04.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:03 smithi077 ceph-mon[110441]: Reconfiguring mgr.smithi112.cswrxs (monmap changed)... 2024-04-25T02:14:04.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:03 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.cswrxs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T02:14:04.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:03 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T02:14:04.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:03 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:04.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:03 smithi077 ceph-mon[110441]: Reconfiguring daemon mgr.smithi112.cswrxs on smithi112 2024-04-25T02:14:05.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:04 smithi112 ceph-mon[80494]: pgmap v23: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:05.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:04 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:05.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:04 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:05.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:04 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:14:05.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:04 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T02:14:05.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:04 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:05.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:04 smithi077 ceph-mon[110441]: pgmap v23: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:05.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:04 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:05.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:04 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:05.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:04 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:14:05.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:04 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T02:14:05.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:04 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:05.973 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:05 smithi112 ceph-mon[80494]: Reconfiguring mon.smithi112 (monmap changed)... 2024-04-25T02:14:05.973 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:05 smithi112 ceph-mon[80494]: Reconfiguring daemon mon.smithi112 on smithi112 2024-04-25T02:14:06.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:05 smithi077 ceph-mon[110441]: Reconfiguring mon.smithi112 (monmap changed)... 2024-04-25T02:14:06.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:05 smithi077 ceph-mon[110441]: Reconfiguring daemon mon.smithi112 on smithi112 2024-04-25T02:14:07.048 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:06 smithi112 ceph-mon[80494]: pgmap v24: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:07.048 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:06 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:07.048 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:06 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:07.048 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:06 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-25T02:14:07.048 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:06 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:07.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:06 smithi077 ceph-mon[110441]: pgmap v24: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:07.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:06 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:07.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:06 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:07.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:06 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-25T02:14:07.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:06 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:08.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:07 smithi077 ceph-mon[110441]: Reconfiguring osd.3 (monmap changed)... 2024-04-25T02:14:08.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:07 smithi077 ceph-mon[110441]: Reconfiguring daemon osd.3 on smithi112 2024-04-25T02:14:08.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:07 smithi112 ceph-mon[80494]: Reconfiguring osd.3 (monmap changed)... 2024-04-25T02:14:08.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:07 smithi112 ceph-mon[80494]: Reconfiguring daemon osd.3 on smithi112 2024-04-25T02:14:08.908 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:08 smithi112 ceph-mon[80494]: pgmap v25: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:08.908 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:08.908 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:08.909 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-25T02:14:08.909 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:08.909 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:14:08.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:08 smithi077 ceph-mon[110441]: pgmap v25: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:08.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:08.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:08.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-25T02:14:08.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:08.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:14:10.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:09 smithi112 ceph-mon[80494]: Reconfiguring osd.4 (monmap changed)... 2024-04-25T02:14:10.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:09 smithi112 ceph-mon[80494]: Reconfiguring daemon osd.4 on smithi112 2024-04-25T02:14:10.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:09 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:10.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:09 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:10.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:09 smithi077 ceph-mon[110441]: Reconfiguring osd.4 (monmap changed)... 2024-04-25T02:14:10.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:09 smithi077 ceph-mon[110441]: Reconfiguring daemon osd.4 on smithi112 2024-04-25T02:14:10.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:09 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:10.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:09 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:11.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:10 smithi112 ceph-mon[80494]: pgmap v26: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:11.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:10 smithi112 ceph-mon[80494]: Reconfiguring osd.5 (monmap changed)... 2024-04-25T02:14:11.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:10 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-25T02:14:11.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:10 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:11.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:10 smithi112 ceph-mon[80494]: Reconfiguring daemon osd.5 on smithi112 2024-04-25T02:14:11.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:10 smithi077 ceph-mon[110441]: pgmap v26: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:11.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:10 smithi077 ceph-mon[110441]: Reconfiguring osd.5 (monmap changed)... 2024-04-25T02:14:11.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:10 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-25T02:14:11.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:10 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:11.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:10 smithi077 ceph-mon[110441]: Reconfiguring daemon osd.5 on smithi112 2024-04-25T02:14:12.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.135+0000 7fb751f56700 1 -- 172.21.15.77:0/2547797429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb74c102de0 msgr2=0x7fb74c1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:12.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.135+0000 7fb751f56700 1 --2- 172.21.15.77:0/2547797429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb74c102de0 0x7fb74c1031b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb73c004940 tx=0x7fb73c009e30 comp rx=0 tx=0).stop 2024-04-25T02:14:12.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.135+0000 7fb751f56700 1 -- 172.21.15.77:0/2547797429 shutdown_connections 2024-04-25T02:14:12.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.135+0000 7fb751f56700 1 --2- 172.21.15.77:0/2547797429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb74c103780 0x7fb74c0fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:12.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.135+0000 7fb751f56700 1 --2- 172.21.15.77:0/2547797429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb74c102de0 0x7fb74c1031b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:12.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.135+0000 7fb751f56700 1 -- 172.21.15.77:0/2547797429 >> 172.21.15.77:0/2547797429 conn(0x7fb74c0f8990 msgr2=0x7fb74c0fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:12.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.135+0000 7fb751f56700 1 -- 172.21.15.77:0/2547797429 shutdown_connections 2024-04-25T02:14:12.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.135+0000 7fb751f56700 1 -- 172.21.15.77:0/2547797429 wait complete. 2024-04-25T02:14:12.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.135+0000 7fb751f56700 1 Processor -- start 2024-04-25T02:14:12.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.135+0000 7fb751f56700 1 -- start start 2024-04-25T02:14:12.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.136+0000 7fb751f56700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb74c102de0 0x7fb74c113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:12.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.136+0000 7fb751f56700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb74c103780 0x7fb74c113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:12.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.136+0000 7fb751f56700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c114500 con 0x7fb74c102de0 2024-04-25T02:14:12.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.136+0000 7fb751f56700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c10db50 con 0x7fb74c103780 2024-04-25T02:14:12.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.136+0000 7fb74b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb74c102de0 0x7fb74c113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:12.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.136+0000 7fb74b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb74c102de0 0x7fb74c113970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37474/0 (socket says 172.21.15.77:37474) 2024-04-25T02:14:12.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.136+0000 7fb74b7fe700 1 -- 172.21.15.77:0/1966158189 learned_addr learned my addr 172.21.15.77:0/1966158189 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:14:12.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.136+0000 7fb742ffd700 1 --2- 172.21.15.77:0/1966158189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb74c103780 0x7fb74c113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:12.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.136+0000 7fb74b7fe700 1 -- 172.21.15.77:0/1966158189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb74c103780 msgr2=0x7fb74c113eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:12.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.136+0000 7fb74b7fe700 1 --2- 172.21.15.77:0/1966158189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb74c103780 0x7fb74c113eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:12.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.136+0000 7fb74b7fe700 1 -- 172.21.15.77:0/1966158189 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb73c005040 con 0x7fb74c102de0 2024-04-25T02:14:12.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.136+0000 7fb74b7fe700 1 --2- 172.21.15.77:0/1966158189 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb74c102de0 0x7fb74c113970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb73c009150 tx=0x7fb73c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:12.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.136+0000 7fb748ff9700 1 -- 172.21.15.77:0/1966158189 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb73c00e040 con 0x7fb74c102de0 2024-04-25T02:14:12.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.136+0000 7fb748ff9700 1 -- 172.21.15.77:0/1966158189 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb73c013420 con 0x7fb74c102de0 2024-04-25T02:14:12.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.136+0000 7fb751f56700 1 -- 172.21.15.77:0/1966158189 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb74c10ddd0 con 0x7fb74c102de0 2024-04-25T02:14:12.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.136+0000 7fb748ff9700 1 -- 172.21.15.77:0/1966158189 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb73c01c610 con 0x7fb74c102de0 2024-04-25T02:14:12.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.136+0000 7fb751f56700 1 -- 172.21.15.77:0/1966158189 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb74c10e390 con 0x7fb74c102de0 2024-04-25T02:14:12.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.137+0000 7fb751f56700 1 -- 172.21.15.77:0/1966158189 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb74c1000f0 con 0x7fb74c102de0 2024-04-25T02:14:12.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.138+0000 7fb748ff9700 1 -- 172.21.15.77:0/1966158189 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fb73c00baf0 con 0x7fb74c102de0 2024-04-25T02:14:12.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.138+0000 7fb748ff9700 1 --2- 172.21.15.77:0/1966158189 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb73806e270 0x7fb738070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:12.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.139+0000 7fb748ff9700 1 -- 172.21.15.77:0/1966158189 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb73c08ef80 con 0x7fb74c102de0 2024-04-25T02:14:12.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.139+0000 7fb742ffd700 1 --2- 172.21.15.77:0/1966158189 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb73806e270 0x7fb738070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:12.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.139+0000 7fb742ffd700 1 --2- 172.21.15.77:0/1966158189 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb73806e270 0x7fb738070720 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb74c10ecc0 tx=0x7fb73400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:12.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.143+0000 7fb748ff9700 1 -- 172.21.15.77:0/1966158189 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fb73c05bce0 con 0x7fb74c102de0 2024-04-25T02:14:12.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.360+0000 7fb751f56700 1 -- 172.21.15.77:0/1966158189 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb74c10f030 con 0x7fb73806e270 2024-04-25T02:14:12.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.361+0000 7fb748ff9700 1 -- 172.21.15.77:0/1966158189 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fb74c10f030 con 0x7fb73806e270 2024-04-25T02:14:12.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.363+0000 7fb751f56700 1 -- 172.21.15.77:0/1966158189 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb73806e270 msgr2=0x7fb738070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:12.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.363+0000 7fb751f56700 1 --2- 172.21.15.77:0/1966158189 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb73806e270 0x7fb738070720 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb74c10ecc0 tx=0x7fb73400b040 comp rx=0 tx=0).stop 2024-04-25T02:14:12.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.363+0000 7fb751f56700 1 -- 172.21.15.77:0/1966158189 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb74c102de0 msgr2=0x7fb74c113970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:12.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.363+0000 7fb751f56700 1 --2- 172.21.15.77:0/1966158189 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb74c102de0 0x7fb74c113970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb73c009150 tx=0x7fb73c009e30 comp rx=0 tx=0).stop 2024-04-25T02:14:12.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.363+0000 7fb751f56700 1 -- 172.21.15.77:0/1966158189 shutdown_connections 2024-04-25T02:14:12.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.363+0000 7fb751f56700 1 --2- 172.21.15.77:0/1966158189 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb73806e270 0x7fb738070720 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:12.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.363+0000 7fb751f56700 1 --2- 172.21.15.77:0/1966158189 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb74c102de0 0x7fb74c113970 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:12.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.363+0000 7fb751f56700 1 --2- 172.21.15.77:0/1966158189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb74c103780 0x7fb74c113eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:12.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.363+0000 7fb751f56700 1 -- 172.21.15.77:0/1966158189 >> 172.21.15.77:0/1966158189 conn(0x7fb74c0f8990 msgr2=0x7fb74c107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:12.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.364+0000 7fb751f56700 1 -- 172.21.15.77:0/1966158189 shutdown_connections 2024-04-25T02:14:12.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.364+0000 7fb751f56700 1 -- 172.21.15.77:0/1966158189 wait complete. 2024-04-25T02:14:12.381 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-04-25T02:14:12.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.466+0000 7f0cc608b700 1 -- 172.21.15.77:0/2669465286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0cc00fe7a0 msgr2=0x7f0cc0106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:12.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.466+0000 7f0cc608b700 1 --2- 172.21.15.77:0/2669465286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0cc00fe7a0 0x7f0cc0106de0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4004940 tx=0x7f0cb4009e30 comp rx=0 tx=0).stop 2024-04-25T02:14:12.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.466+0000 7f0cc608b700 1 -- 172.21.15.77:0/2669465286 shutdown_connections 2024-04-25T02:14:12.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.466+0000 7f0cc608b700 1 --2- 172.21.15.77:0/2669465286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0cc00fe7a0 0x7f0cc0106de0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:12.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.466+0000 7f0cc608b700 1 --2- 172.21.15.77:0/2669465286 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0cc00fde00 0x7f0cc00fe1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:12.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.466+0000 7f0cc608b700 1 -- 172.21.15.77:0/2669465286 >> 172.21.15.77:0/2669465286 conn(0x7f0cc00f7850 msgr2=0x7f0cc00f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:12.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.467+0000 7f0cc608b700 1 -- 172.21.15.77:0/2669465286 shutdown_connections 2024-04-25T02:14:12.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.467+0000 7f0cc608b700 1 -- 172.21.15.77:0/2669465286 wait complete. 2024-04-25T02:14:12.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.467+0000 7f0cc608b700 1 Processor -- start 2024-04-25T02:14:12.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.467+0000 7f0cc608b700 1 -- start start 2024-04-25T02:14:12.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.468+0000 7f0cc608b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0cc00fde00 0x7f0cc0113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:12.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.468+0000 7f0cc608b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0cc00fe7a0 0x7f0cc01140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:12.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.468+0000 7f0cc608b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc0114710 con 0x7f0cc00fe7a0 2024-04-25T02:14:12.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.468+0000 7f0cc608b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc010db20 con 0x7f0cc00fde00 2024-04-25T02:14:12.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.468+0000 7f0cbeffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0cc00fe7a0 0x7f0cc01140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:12.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.468+0000 7f0cbeffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0cc00fe7a0 0x7f0cc01140c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37504/0 (socket says 172.21.15.77:37504) 2024-04-25T02:14:12.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.468+0000 7f0cbeffd700 1 -- 172.21.15.77:0/536163437 learned_addr learned my addr 172.21.15.77:0/536163437 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:14:12.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.468+0000 7f0cbf7fe700 1 --2- 172.21.15.77:0/536163437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0cc00fde00 0x7f0cc0113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:12.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.468+0000 7f0cbeffd700 1 -- 172.21.15.77:0/536163437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0cc00fde00 msgr2=0x7f0cc0113b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:12.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.468+0000 7f0cbeffd700 1 --2- 172.21.15.77:0/536163437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0cc00fde00 0x7f0cc0113b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:12.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.468+0000 7f0cbeffd700 1 -- 172.21.15.77:0/536163437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb4005040 con 0x7f0cc00fe7a0 2024-04-25T02:14:12.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.468+0000 7f0cbf7fe700 1 --2- 172.21.15.77:0/536163437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0cc00fde00 0x7f0cc0113b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:14:12.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.468+0000 7f0cbeffd700 1 --2- 172.21.15.77:0/536163437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0cc00fe7a0 0x7f0cc01140c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400b3b0 tx=0x7f0cb4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:12.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.468+0000 7f0ca7fff700 1 -- 172.21.15.77:0/536163437 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cb400e040 con 0x7f0cc00fe7a0 2024-04-25T02:14:12.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.468+0000 7f0ca7fff700 1 -- 172.21.15.77:0/536163437 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0cb4013420 con 0x7f0cc00fe7a0 2024-04-25T02:14:12.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.468+0000 7f0cc608b700 1 -- 172.21.15.77:0/536163437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc010dda0 con 0x7f0cc00fe7a0 2024-04-25T02:14:12.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.468+0000 7f0ca7fff700 1 -- 172.21.15.77:0/536163437 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cb401c610 con 0x7f0cc00fe7a0 2024-04-25T02:14:12.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.468+0000 7f0cc608b700 1 -- 172.21.15.77:0/536163437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc010e2e0 con 0x7f0cc00fe7a0 2024-04-25T02:14:12.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.469+0000 7f0cc608b700 1 -- 172.21.15.77:0/536163437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc0066730 con 0x7f0cc00fe7a0 2024-04-25T02:14:12.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.470+0000 7f0ca7fff700 1 -- 172.21.15.77:0/536163437 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f0cb4013590 con 0x7f0cc00fe7a0 2024-04-25T02:14:12.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.470+0000 7f0ca7fff700 1 --2- 172.21.15.77:0/536163437 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f0ca806e260 0x7f0ca8070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:12.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.470+0000 7f0cbf7fe700 1 --2- 172.21.15.77:0/536163437 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f0ca806e260 0x7f0ca8070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:12.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.470+0000 7f0ca7fff700 1 -- 172.21.15.77:0/536163437 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f0cb408efd0 con 0x7f0cc00fe7a0 2024-04-25T02:14:12.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.471+0000 7f0cbf7fe700 1 --2- 172.21.15.77:0/536163437 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f0ca806e260 0x7f0ca8070710 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0009fd0 tx=0x7f0cb0009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:12.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.475+0000 7f0ca7fff700 1 -- 172.21.15.77:0/536163437 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f0cb4058200 con 0x7f0cc00fe7a0 2024-04-25T02:14:12.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.692+0000 7f0cc608b700 1 -- 172.21.15.77:0/536163437 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0cc0109e80 con 0x7f0ca806e260 2024-04-25T02:14:12.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.694+0000 7f0ca7fff700 1 -- 172.21.15.77:0/536163437 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f0cc0109e80 con 0x7f0ca806e260 2024-04-25T02:14:12.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.696+0000 7f0cc608b700 1 -- 172.21.15.77:0/536163437 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f0ca806e260 msgr2=0x7f0ca8070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:12.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.696+0000 7f0cc608b700 1 --2- 172.21.15.77:0/536163437 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f0ca806e260 0x7f0ca8070710 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0009fd0 tx=0x7f0cb0009ee0 comp rx=0 tx=0).stop 2024-04-25T02:14:12.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.696+0000 7f0cc608b700 1 -- 172.21.15.77:0/536163437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0cc00fe7a0 msgr2=0x7f0cc01140c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:12.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.696+0000 7f0cc608b700 1 --2- 172.21.15.77:0/536163437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0cc00fe7a0 0x7f0cc01140c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400b3b0 tx=0x7f0cb4009e30 comp rx=0 tx=0).stop 2024-04-25T02:14:12.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.696+0000 7f0cc608b700 1 -- 172.21.15.77:0/536163437 shutdown_connections 2024-04-25T02:14:12.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.696+0000 7f0cc608b700 1 --2- 172.21.15.77:0/536163437 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f0ca806e260 0x7f0ca8070710 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:12.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.696+0000 7f0cc608b700 1 --2- 172.21.15.77:0/536163437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0cc00fde00 0x7f0cc0113b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:12.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.696+0000 7f0cc608b700 1 --2- 172.21.15.77:0/536163437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0cc00fe7a0 0x7f0cc01140c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:12.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.696+0000 7f0cc608b700 1 -- 172.21.15.77:0/536163437 >> 172.21.15.77:0/536163437 conn(0x7f0cc00f7850 msgr2=0x7f0cc00f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:12.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.696+0000 7f0cc608b700 1 -- 172.21.15.77:0/536163437 shutdown_connections 2024-04-25T02:14:12.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.696+0000 7f0cc608b700 1 -- 172.21.15.77:0/536163437 wait complete. 2024-04-25T02:14:12.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:12.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:12.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:12 smithi077 ceph-mon[110441]: Reconfiguring mds.cephfs.smithi112.dvwudt (monmap changed)... 2024-04-25T02:14:12.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.dvwudt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:14:12.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:12.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:12 smithi077 ceph-mon[110441]: Reconfiguring daemon mds.cephfs.smithi112.dvwudt on smithi112 2024-04-25T02:14:12.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:12 smithi077 ceph-mon[110441]: pgmap v27: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:12.768 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:12.768 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:12.768 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:12 smithi112 ceph-mon[80494]: Reconfiguring mds.cephfs.smithi112.dvwudt (monmap changed)... 2024-04-25T02:14:12.768 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.dvwudt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:14:12.768 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:12.768 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:12 smithi112 ceph-mon[80494]: Reconfiguring daemon mds.cephfs.smithi112.dvwudt on smithi112 2024-04-25T02:14:12.768 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:12 smithi112 ceph-mon[80494]: pgmap v27: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:12.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.798+0000 7f35df781700 1 -- 172.21.15.77:0/3877380027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35d8065640 msgr2=0x7f35d8065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:12.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.798+0000 7f35df781700 1 --2- 172.21.15.77:0/3877380027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35d8065640 0x7f35d8065ab0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f35c8004940 tx=0x7f35c8009e30 comp rx=0 tx=0).stop 2024-04-25T02:14:12.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.798+0000 7f35df781700 1 -- 172.21.15.77:0/3877380027 shutdown_connections 2024-04-25T02:14:12.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.798+0000 7f35df781700 1 --2- 172.21.15.77:0/3877380027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35d8065640 0x7f35d8065ab0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:12.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.798+0000 7f35df781700 1 --2- 172.21.15.77:0/3877380027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35d8102e50 0x7f35d8103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:12.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.798+0000 7f35df781700 1 -- 172.21.15.77:0/3877380027 >> 172.21.15.77:0/3877380027 conn(0x7f35d8071d00 msgr2=0x7f35d8072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:12.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.798+0000 7f35df781700 1 -- 172.21.15.77:0/3877380027 shutdown_connections 2024-04-25T02:14:12.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.798+0000 7f35df781700 1 -- 172.21.15.77:0/3877380027 wait complete. 2024-04-25T02:14:12.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.799+0000 7f35df781700 1 Processor -- start 2024-04-25T02:14:12.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.799+0000 7f35df781700 1 -- start start 2024-04-25T02:14:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.799+0000 7f35df781700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35d8065640 0x7f35d80fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.799+0000 7f35df781700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35d8102e50 0x7f35d80fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.799+0000 7f35df781700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d80fc880 con 0x7f35d8102e50 2024-04-25T02:14:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.799+0000 7f35df781700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d80fc9c0 con 0x7f35d8065640 2024-04-25T02:14:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.799+0000 7f35dcd1c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35d8102e50 0x7f35d80fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.799+0000 7f35dcd1c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35d8102e50 0x7f35d80fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37520/0 (socket says 172.21.15.77:37520) 2024-04-25T02:14:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.799+0000 7f35dcd1c700 1 -- 172.21.15.77:0/2806988047 learned_addr learned my addr 172.21.15.77:0/2806988047 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:14:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.799+0000 7f35dd51d700 1 --2- 172.21.15.77:0/2806988047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35d8065640 0x7f35d80fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.799+0000 7f35dcd1c700 1 -- 172.21.15.77:0/2806988047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35d8065640 msgr2=0x7f35d80fbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.799+0000 7f35dcd1c700 1 --2- 172.21.15.77:0/2806988047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35d8065640 0x7f35d80fbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.799+0000 7f35dcd1c700 1 -- 172.21.15.77:0/2806988047 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c8005040 con 0x7f35d8102e50 2024-04-25T02:14:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.799+0000 7f35dcd1c700 1 --2- 172.21.15.77:0/2806988047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35d8102e50 0x7f35d80fc2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f35c800b8b0 tx=0x7f35c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.799+0000 7f35cdffb700 1 -- 172.21.15.77:0/2806988047 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35c800e040 con 0x7f35d8102e50 2024-04-25T02:14:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.800+0000 7f35cdffb700 1 -- 172.21.15.77:0/2806988047 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f35c8004290 con 0x7f35d8102e50 2024-04-25T02:14:12.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.800+0000 7f35df781700 1 -- 172.21.15.77:0/2806988047 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d80fcc10 con 0x7f35d8102e50 2024-04-25T02:14:12.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.800+0000 7f35cdffb700 1 -- 172.21.15.77:0/2806988047 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35c801c3f0 con 0x7f35d8102e50 2024-04-25T02:14:12.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.800+0000 7f35df781700 1 -- 172.21.15.77:0/2806988047 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d811a2a0 con 0x7f35d8102e50 2024-04-25T02:14:12.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.801+0000 7f35df781700 1 -- 172.21.15.77:0/2806988047 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d8100100 con 0x7f35d8102e50 2024-04-25T02:14:12.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.801+0000 7f35cdffb700 1 -- 172.21.15.77:0/2806988047 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f35c80137b0 con 0x7f35d8102e50 2024-04-25T02:14:12.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.801+0000 7f35cdffb700 1 --2- 172.21.15.77:0/2806988047 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f35c406e260 0x7f35c4070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:12.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.802+0000 7f35cdffb700 1 -- 172.21.15.77:0/2806988047 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f35c808f070 con 0x7f35d8102e50 2024-04-25T02:14:12.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.802+0000 7f35dd51d700 1 --2- 172.21.15.77:0/2806988047 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f35c406e260 0x7f35c4070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:12.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.802+0000 7f35dd51d700 1 --2- 172.21.15.77:0/2806988047 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f35c406e260 0x7f35c4070710 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f35d4007fd0 tx=0x7f35d4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:12.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:12.806+0000 7f35cdffb700 1 -- 172.21.15.77:0/2806988047 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f35c80582a0 con 0x7f35d8102e50 2024-04-25T02:14:13.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.011+0000 7f35df781700 1 -- 172.21.15.77:0/2806988047 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f35d8109f00 con 0x7f35c406e260 2024-04-25T02:14:13.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.021+0000 7f35cdffb700 1 -- 172.21.15.77:0/2806988047 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f35d8109f00 con 0x7f35c406e260 2024-04-25T02:14:13.027 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T02:14:13.028 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (2m) 43s ago 13m 17.4M - 0.25.0 c8568f914cd2 699c7fd25ea5 2024-04-25T02:14:13.028 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (13m) 43s ago 13m 6665k - 17.2.7-902-gc61472c8 0de407c1b3af 2ad2e3d2b09e 2024-04-25T02:14:13.028 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi112 smithi112 running (12m) 28s ago 12m 6660k - 17.2.7-902-gc61472c8 0de407c1b3af 9235dc5eb15d 2024-04-25T02:14:13.028 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (2m) 43s ago 13m 77.3M - 9.4.12 2bacad6d85d8 900138b0bcf0 2024-04-25T02:14:13.028 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.gcfygj smithi077 running (7m) 43s ago 7m 15.2M - 17.2.7-902-gc61472c8 0de407c1b3af 382dd7abf674 2024-04-25T02:14:13.028 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.oadrkb smithi077 running (7m) 43s ago 7m 13.3M - 17.2.7-902-gc61472c8 0de407c1b3af 6992064a4b2a 2024-04-25T02:14:13.028 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.dvwudt smithi112 running (7m) 28s ago 7m 156M - 17.2.7-902-gc61472c8 0de407c1b3af 0792e451abfd 2024-04-25T02:14:13.028 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.fjnadi smithi112 running (7m) 28s ago 7m 15.0M - 17.2.7-902-gc61472c8 0de407c1b3af c8093f622f6b 2024-04-25T02:14:13.028 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.zpflzp smithi077 *:8443,9283,8765 running (3m) 43s ago 14m 472M - 19.0.0-2445-gd2c45d97 f68e37b807ef a1af92e027e5 2024-04-25T02:14:13.028 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi112.cswrxs smithi112 *:8443,9283,8765 running (3m) 28s ago 12m 448M - 19.0.0-2445-gd2c45d97 f68e37b807ef ccc7c57d35f2 2024-04-25T02:14:13.028 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (59s) 43s ago 14m 27.3M 2048M 19.0.0-2445-gd2c45d97 f68e37b807ef 06490c2ecc44 2024-04-25T02:14:13.028 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi112 smithi112 running (33s) 28s ago 12m 22.3M 2048M 19.0.0-2445-gd2c45d97 f68e37b807ef ccd1398acbc5 2024-04-25T02:14:13.028 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (3m) 43s ago 13m 16.5M - 1.5.0 0da6a335fe13 2320132606fc 2024-04-25T02:14:13.028 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi112 smithi112 *:9100 running (2m) 28s ago 12m 15.1M - 1.5.0 0da6a335fe13 49f285354791 2024-04-25T02:14:13.029 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (11m) 43s ago 11m 259M 1557M 17.2.7-902-gc61472c8 0de407c1b3af c741abec3b94 2024-04-25T02:14:13.029 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (11m) 43s ago 11m 259M 1557M 17.2.7-902-gc61472c8 0de407c1b3af 256ff3ced322 2024-04-25T02:14:13.029 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (10m) 43s ago 10m 222M 1557M 17.2.7-902-gc61472c8 0de407c1b3af c5d7d8c993f4 2024-04-25T02:14:13.029 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi112 running (10m) 28s ago 10m 290M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 68429d0dbf88 2024-04-25T02:14:13.029 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi112 running (9m) 28s ago 9m 260M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 66eb71201444 2024-04-25T02:14:13.029 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi112 running (9m) 28s ago 9m 239M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 963e700d6aea 2024-04-25T02:14:13.029 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (2m) 43s ago 12m 57.0M - 2.43.0 a07b618ecd1d c5b8c6104d96 2024-04-25T02:14:13.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.023+0000 7f35df781700 1 -- 172.21.15.77:0/2806988047 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f35c406e260 msgr2=0x7f35c4070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:13.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.023+0000 7f35df781700 1 --2- 172.21.15.77:0/2806988047 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f35c406e260 0x7f35c4070710 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f35d4007fd0 tx=0x7f35d4009040 comp rx=0 tx=0).stop 2024-04-25T02:14:13.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.024+0000 7f35df781700 1 -- 172.21.15.77:0/2806988047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35d8102e50 msgr2=0x7f35d80fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:13.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.024+0000 7f35df781700 1 --2- 172.21.15.77:0/2806988047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35d8102e50 0x7f35d80fc2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f35c800b8b0 tx=0x7f35c8009e30 comp rx=0 tx=0).stop 2024-04-25T02:14:13.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.024+0000 7f35df781700 1 -- 172.21.15.77:0/2806988047 shutdown_connections 2024-04-25T02:14:13.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.024+0000 7f35df781700 1 --2- 172.21.15.77:0/2806988047 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f35c406e260 0x7f35c4070710 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:13.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.024+0000 7f35df781700 1 --2- 172.21.15.77:0/2806988047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35d8065640 0x7f35d80fbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:13.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.024+0000 7f35df781700 1 --2- 172.21.15.77:0/2806988047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35d8102e50 0x7f35d80fc2f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:13.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.024+0000 7f35df781700 1 -- 172.21.15.77:0/2806988047 >> 172.21.15.77:0/2806988047 conn(0x7f35d8071d00 msgr2=0x7f35d80fb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:13.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.024+0000 7f35df781700 1 -- 172.21.15.77:0/2806988047 shutdown_connections 2024-04-25T02:14:13.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.024+0000 7f35df781700 1 -- 172.21.15.77:0/2806988047 wait complete. 2024-04-25T02:14:13.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.123+0000 7fc24c1a8700 1 -- 172.21.15.77:0/4069171608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2440fde10 msgr2=0x7fc2440fe1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:13.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.123+0000 7fc24c1a8700 1 --2- 172.21.15.77:0/4069171608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2440fde10 0x7fc2440fe1e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc23c004940 tx=0x7fc23c009e30 comp rx=0 tx=0).stop 2024-04-25T02:14:13.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.123+0000 7fc24c1a8700 1 -- 172.21.15.77:0/4069171608 shutdown_connections 2024-04-25T02:14:13.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.123+0000 7fc24c1a8700 1 --2- 172.21.15.77:0/4069171608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2440fe7b0 0x7fc244106e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:13.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.123+0000 7fc24c1a8700 1 --2- 172.21.15.77:0/4069171608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2440fde10 0x7fc2440fe1e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:13.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.123+0000 7fc24c1a8700 1 -- 172.21.15.77:0/4069171608 >> 172.21.15.77:0/4069171608 conn(0x7fc2440f7850 msgr2=0x7fc2440f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:13.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.123+0000 7fc24c1a8700 1 -- 172.21.15.77:0/4069171608 shutdown_connections 2024-04-25T02:14:13.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.123+0000 7fc24c1a8700 1 -- 172.21.15.77:0/4069171608 wait complete. 2024-04-25T02:14:13.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.123+0000 7fc24c1a8700 1 Processor -- start 2024-04-25T02:14:13.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.124+0000 7fc24c1a8700 1 -- start start 2024-04-25T02:14:13.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.124+0000 7fc24c1a8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2440fde10 0x7fc2440fbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:13.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.124+0000 7fc24c1a8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2440fe7b0 0x7fc2440fc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:13.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.124+0000 7fc24c1a8700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440fc7a0 con 0x7fc2440fde10 2024-04-25T02:14:13.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.124+0000 7fc24c1a8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440fc8e0 con 0x7fc2440fe7b0 2024-04-25T02:14:13.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.124+0000 7fc249f44700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2440fde10 0x7fc2440fbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:13.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.124+0000 7fc249f44700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2440fde10 0x7fc2440fbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37542/0 (socket says 172.21.15.77:37542) 2024-04-25T02:14:13.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.124+0000 7fc249f44700 1 -- 172.21.15.77:0/1423578681 learned_addr learned my addr 172.21.15.77:0/1423578681 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:14:13.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.124+0000 7fc249743700 1 --2- 172.21.15.77:0/1423578681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2440fe7b0 0x7fc2440fc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:13.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.124+0000 7fc249f44700 1 -- 172.21.15.77:0/1423578681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2440fe7b0 msgr2=0x7fc2440fc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:13.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.124+0000 7fc249f44700 1 --2- 172.21.15.77:0/1423578681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2440fe7b0 0x7fc2440fc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:13.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.124+0000 7fc249f44700 1 -- 172.21.15.77:0/1423578681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23c005040 con 0x7fc2440fde10 2024-04-25T02:14:13.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.124+0000 7fc249f44700 1 --2- 172.21.15.77:0/1423578681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2440fde10 0x7fc2440fbcd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc23c00b3b0 tx=0x7fc23c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:13.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.125+0000 7fc23a7fc700 1 -- 172.21.15.77:0/1423578681 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc23c00e040 con 0x7fc2440fde10 2024-04-25T02:14:13.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.125+0000 7fc23a7fc700 1 -- 172.21.15.77:0/1423578681 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc23c013420 con 0x7fc2440fde10 2024-04-25T02:14:13.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.125+0000 7fc24c1a8700 1 -- 172.21.15.77:0/1423578681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2440fcb30 con 0x7fc2440fde10 2024-04-25T02:14:13.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.125+0000 7fc23a7fc700 1 -- 172.21.15.77:0/1423578681 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc23c01c610 con 0x7fc2440fde10 2024-04-25T02:14:13.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.125+0000 7fc24c1a8700 1 -- 172.21.15.77:0/1423578681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc24411a270 con 0x7fc2440fde10 2024-04-25T02:14:13.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.126+0000 7fc24c1a8700 1 -- 172.21.15.77:0/1423578681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc244066690 con 0x7fc2440fde10 2024-04-25T02:14:13.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.126+0000 7fc23a7fc700 1 -- 172.21.15.77:0/1423578681 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fc23c013590 con 0x7fc2440fde10 2024-04-25T02:14:13.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.126+0000 7fc23a7fc700 1 --2- 172.21.15.77:0/1423578681 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc23006e260 0x7fc230070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:13.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.127+0000 7fc23a7fc700 1 -- 172.21.15.77:0/1423578681 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc23c08eef0 con 0x7fc2440fde10 2024-04-25T02:14:13.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.127+0000 7fc249743700 1 --2- 172.21.15.77:0/1423578681 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc23006e260 0x7fc230070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:13.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.127+0000 7fc249743700 1 --2- 172.21.15.77:0/1423578681 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc23006e260 0x7fc230070710 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc2440fd610 tx=0x7fc234009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:13.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.132+0000 7fc23a7fc700 1 -- 172.21.15.77:0/1423578681 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fc23c0581c0 con 0x7fc2440fde10 2024-04-25T02:14:13.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.417+0000 7fc24c1a8700 1 -- 172.21.15.77:0/1423578681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc24404bed0 con 0x7fc2440fde10 2024-04-25T02:14:13.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.418+0000 7fc23a7fc700 1 -- 172.21.15.77:0/1423578681 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7fc23c013840 con 0x7fc2440fde10 2024-04-25T02:14:13.424 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:14:13.424 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-04-25T02:14:13.424 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:14:13.424 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:14:13.424 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-04-25T02:14:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:14:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:14:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-04-25T02:14:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 6 2024-04-25T02:14:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:14:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-04-25T02:14:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T02:14:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:14:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-04-25T02:14:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 10, 2024-04-25T02:14:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 4 2024-04-25T02:14:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-25T02:14:13.425 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:14:13.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.419+0000 7fc24c1a8700 1 -- 172.21.15.77:0/1423578681 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc23006e260 msgr2=0x7fc230070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:13.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.419+0000 7fc24c1a8700 1 --2- 172.21.15.77:0/1423578681 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc23006e260 0x7fc230070710 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc2440fd610 tx=0x7fc234009ee0 comp rx=0 tx=0).stop 2024-04-25T02:14:13.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.419+0000 7fc24c1a8700 1 -- 172.21.15.77:0/1423578681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2440fde10 msgr2=0x7fc2440fbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:13.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.419+0000 7fc24c1a8700 1 --2- 172.21.15.77:0/1423578681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2440fde10 0x7fc2440fbcd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc23c00b3b0 tx=0x7fc23c009e30 comp rx=0 tx=0).stop 2024-04-25T02:14:13.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.420+0000 7fc24c1a8700 1 -- 172.21.15.77:0/1423578681 shutdown_connections 2024-04-25T02:14:13.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.420+0000 7fc24c1a8700 1 --2- 172.21.15.77:0/1423578681 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc23006e260 0x7fc230070710 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:13.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.420+0000 7fc24c1a8700 1 --2- 172.21.15.77:0/1423578681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2440fde10 0x7fc2440fbcd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:13.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.420+0000 7fc24c1a8700 1 --2- 172.21.15.77:0/1423578681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2440fe7b0 0x7fc2440fc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:13.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.420+0000 7fc24c1a8700 1 -- 172.21.15.77:0/1423578681 >> 172.21.15.77:0/1423578681 conn(0x7fc2440f7850 msgr2=0x7fc2440f8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:13.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.420+0000 7fc24c1a8700 1 -- 172.21.15.77:0/1423578681 shutdown_connections 2024-04-25T02:14:13.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.420+0000 7fc24c1a8700 1 -- 172.21.15.77:0/1423578681 wait complete. 2024-04-25T02:14:13.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.522+0000 7f7b01a5b700 1 -- 172.21.15.77:0/1530239138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7afc103790 msgr2=0x7f7afc0fce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:13.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.522+0000 7f7b01a5b700 1 --2- 172.21.15.77:0/1530239138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7afc103790 0x7f7afc0fce00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7af0004940 tx=0x7f7af0009e30 comp rx=0 tx=0).stop 2024-04-25T02:14:13.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.522+0000 7f7b01a5b700 1 -- 172.21.15.77:0/1530239138 shutdown_connections 2024-04-25T02:14:13.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.522+0000 7f7b01a5b700 1 --2- 172.21.15.77:0/1530239138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7afc103790 0x7f7afc0fce00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:13.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.522+0000 7f7b01a5b700 1 --2- 172.21.15.77:0/1530239138 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7afc102df0 0x7f7afc1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:13.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.522+0000 7f7b01a5b700 1 -- 172.21.15.77:0/1530239138 >> 172.21.15.77:0/1530239138 conn(0x7f7afc0f8920 msgr2=0x7f7afc0fad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:13.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.522+0000 7f7b01a5b700 1 -- 172.21.15.77:0/1530239138 shutdown_connections 2024-04-25T02:14:13.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.522+0000 7f7b01a5b700 1 -- 172.21.15.77:0/1530239138 wait complete. 2024-04-25T02:14:13.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.523+0000 7f7b01a5b700 1 Processor -- start 2024-04-25T02:14:13.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.523+0000 7f7b01a5b700 1 -- start start 2024-04-25T02:14:13.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.523+0000 7f7b01a5b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7afc102df0 0x7f7afc113870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:13.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.523+0000 7f7b01a5b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7afc103790 0x7f7afc113db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:13.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.523+0000 7f7b01a5b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc114400 con 0x7f7afc103790 2024-04-25T02:14:13.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.523+0000 7f7b01a5b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc10da40 con 0x7f7afc102df0 2024-04-25T02:14:13.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.523+0000 7f7afa7fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7afc103790 0x7f7afc113db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:13.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.523+0000 7f7afa7fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7afc103790 0x7f7afc113db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37562/0 (socket says 172.21.15.77:37562) 2024-04-25T02:14:13.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.523+0000 7f7afa7fc700 1 -- 172.21.15.77:0/747080983 learned_addr learned my addr 172.21.15.77:0/747080983 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:14:13.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.524+0000 7f7afaffd700 1 --2- 172.21.15.77:0/747080983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7afc102df0 0x7f7afc113870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:13.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.524+0000 7f7afa7fc700 1 -- 172.21.15.77:0/747080983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7afc102df0 msgr2=0x7f7afc113870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:13.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.524+0000 7f7afa7fc700 1 --2- 172.21.15.77:0/747080983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7afc102df0 0x7f7afc113870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:13.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.524+0000 7f7afa7fc700 1 -- 172.21.15.77:0/747080983 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af0005040 con 0x7f7afc103790 2024-04-25T02:14:13.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.524+0000 7f7afaffd700 1 --2- 172.21.15.77:0/747080983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7afc102df0 0x7f7afc113870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:14:13.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.524+0000 7f7afa7fc700 1 --2- 172.21.15.77:0/747080983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7afc103790 0x7f7afc113db0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7af0000c00 tx=0x7f7af0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:13.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.524+0000 7f7ae37fe700 1 -- 172.21.15.77:0/747080983 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7af0021070 con 0x7f7afc103790 2024-04-25T02:14:13.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.524+0000 7f7b01a5b700 1 -- 172.21.15.77:0/747080983 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7afc10dcc0 con 0x7f7afc103790 2024-04-25T02:14:13.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.524+0000 7f7ae37fe700 1 -- 172.21.15.77:0/747080983 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7af0013c00 con 0x7f7afc103790 2024-04-25T02:14:13.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.524+0000 7f7ae37fe700 1 -- 172.21.15.77:0/747080983 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7af000e070 con 0x7f7afc103790 2024-04-25T02:14:13.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.524+0000 7f7b01a5b700 1 -- 172.21.15.77:0/747080983 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7afc10e1a0 con 0x7f7afc103790 2024-04-25T02:14:13.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.525+0000 7f7b01a5b700 1 -- 172.21.15.77:0/747080983 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7afc0fe540 con 0x7f7afc103790 2024-04-25T02:14:13.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.526+0000 7f7ae37fe700 1 -- 172.21.15.77:0/747080983 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f7af001ca60 con 0x7f7afc103790 2024-04-25T02:14:13.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.526+0000 7f7ae37fe700 1 --2- 172.21.15.77:0/747080983 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f7ae406e270 0x7f7ae4070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:13.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.526+0000 7f7ae37fe700 1 -- 172.21.15.77:0/747080983 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f7af008f170 con 0x7f7afc103790 2024-04-25T02:14:13.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.526+0000 7f7afaffd700 1 --2- 172.21.15.77:0/747080983 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f7ae406e270 0x7f7ae4070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:13.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.527+0000 7f7afaffd700 1 --2- 172.21.15.77:0/747080983 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f7ae406e270 0x7f7ae4070720 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7aec004fd0 tx=0x7f7aec00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:13.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.531+0000 7f7ae37fe700 1 -- 172.21.15.77:0/747080983 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f7af005bed0 con 0x7f7afc103790 2024-04-25T02:14:13.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:13 smithi077 ceph-mon[110441]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:14:13.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:13 smithi077 ceph-mon[110441]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:14:13.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:13 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:13.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:13 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:13.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:13 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.fjnadi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:14:13.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:13 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:13.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:13 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/1423578681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:14:13.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:13 smithi112 ceph-mon[80494]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:14:13.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:13 smithi112 ceph-mon[80494]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:14:13.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:13 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:13.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:13 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:13.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:13 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.fjnadi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:14:13.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:13 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:13.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:13 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/1423578681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:14:13.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.785+0000 7f7b01a5b700 1 -- 172.21.15.77:0/747080983 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7afc109ed0 con 0x7f7afc103790 2024-04-25T02:14:13.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.785+0000 7f7ae37fe700 1 -- 172.21.15.77:0/747080983 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1876 (secure 0 0 0) 0x7f7af0004490 con 0x7f7afc103790 2024-04-25T02:14:13.792 INFO:teuthology.orchestra.run.smithi077.stdout:e15 2024-04-25T02:14:13.792 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T02:14:13.792 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:14:13.792 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-04-25T02:14:13.793 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:14:13.793 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-04-25T02:14:13.793 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-04-25T02:14:13.793 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 15 2024-04-25T02:14:13.793 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-25T02:14:13.793 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-04-25T02:06:10.008979+0000 2024-04-25T02:14:13.793 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-04-25T02:06:27.849984+0000 2024-04-25T02:14:13.793 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-04-25T02:14:13.793 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-04-25T02:14:13.793 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-04-25T02:14:13.793 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-04-25T02:14:13.793 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-04-25T02:14:13.793 INFO:teuthology.orchestra.run.smithi077.stdout:max_xattr_size 65536 2024-04-25T02:14:13.793 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-04-25T02:14:13.793 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-04-25T02:14:13.793 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 47 2024-04-25T02:14:13.794 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:14:13.794 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-04-25T02:14:13.794 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-04-25T02:14:13.794 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=24257} 2024-04-25T02:14:13.794 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-04-25T02:14:13.794 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-04-25T02:14:13.794 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-04-25T02:14:13.794 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-04-25T02:14:13.794 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-04-25T02:14:13.794 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-04-25T02:14:13.794 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-04-25T02:14:13.794 INFO:teuthology.orchestra.run.smithi077.stdout:bal_rank_mask -1 2024-04-25T02:14:13.794 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-04-25T02:14:13.795 INFO:teuthology.orchestra.run.smithi077.stdout:qdb_cluster leader: 0 members: 2024-04-25T02:14:13.795 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi112.dvwudt{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.112:6824/3687767796,v1:172.21.15.112:6825/3687767796] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:14:13.795 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:14:13.795 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:14:13.795 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-04-25T02:14:13.795 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:14:13.795 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.gcfygj{-1:14462} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/691698671,v1:172.21.15.77:6829/691698671] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:14:13.795 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.oadrkb{-1:14474} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.77:6826/26222645,v1:172.21.15.77:6827/26222645] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:14:13.795 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi112.fjnadi{-1:24269} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/2036319817,v1:172.21.15.112:6827/2036319817] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:14:13.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.787+0000 7f7b01a5b700 1 -- 172.21.15.77:0/747080983 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f7ae406e270 msgr2=0x7f7ae4070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:13.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.787+0000 7f7b01a5b700 1 --2- 172.21.15.77:0/747080983 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f7ae406e270 0x7f7ae4070720 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7aec004fd0 tx=0x7f7aec00b040 comp rx=0 tx=0).stop 2024-04-25T02:14:13.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.788+0000 7f7b01a5b700 1 -- 172.21.15.77:0/747080983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7afc103790 msgr2=0x7f7afc113db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:13.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.788+0000 7f7b01a5b700 1 --2- 172.21.15.77:0/747080983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7afc103790 0x7f7afc113db0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7af0000c00 tx=0x7f7af0009e30 comp rx=0 tx=0).stop 2024-04-25T02:14:13.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.788+0000 7f7b01a5b700 1 -- 172.21.15.77:0/747080983 shutdown_connections 2024-04-25T02:14:13.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.788+0000 7f7b01a5b700 1 --2- 172.21.15.77:0/747080983 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f7ae406e270 0x7f7ae4070720 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:13.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.788+0000 7f7b01a5b700 1 --2- 172.21.15.77:0/747080983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7afc102df0 0x7f7afc113870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:13.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.788+0000 7f7b01a5b700 1 --2- 172.21.15.77:0/747080983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7afc103790 0x7f7afc113db0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:13.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.788+0000 7f7b01a5b700 1 -- 172.21.15.77:0/747080983 >> 172.21.15.77:0/747080983 conn(0x7f7afc0f8920 msgr2=0x7f7afc0f9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:13.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.788+0000 7f7b01a5b700 1 -- 172.21.15.77:0/747080983 shutdown_connections 2024-04-25T02:14:13.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.788+0000 7f7b01a5b700 1 -- 172.21.15.77:0/747080983 wait complete. 2024-04-25T02:14:13.797 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 15 2024-04-25T02:14:13.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.889+0000 7faac20d1700 1 -- 172.21.15.77:0/3507975710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faabc1014f0 msgr2=0x7faabc1018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:13.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.889+0000 7faac20d1700 1 --2- 172.21.15.77:0/3507975710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faabc1014f0 0x7faabc1018c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faab0004940 tx=0x7faab0009e30 comp rx=0 tx=0).stop 2024-04-25T02:14:13.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.889+0000 7faac20d1700 1 -- 172.21.15.77:0/3507975710 shutdown_connections 2024-04-25T02:14:13.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.889+0000 7faac20d1700 1 --2- 172.21.15.77:0/3507975710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faabc0fb4e0 0x7faabc0fb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:13.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.889+0000 7faac20d1700 1 --2- 172.21.15.77:0/3507975710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faabc1014f0 0x7faabc1018c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:13.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.889+0000 7faac20d1700 1 -- 172.21.15.77:0/3507975710 >> 172.21.15.77:0/3507975710 conn(0x7faabc073350 msgr2=0x7faabc073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:13.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.889+0000 7faac20d1700 1 -- 172.21.15.77:0/3507975710 shutdown_connections 2024-04-25T02:14:13.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.889+0000 7faac20d1700 1 -- 172.21.15.77:0/3507975710 wait complete. 2024-04-25T02:14:13.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.890+0000 7faac20d1700 1 Processor -- start 2024-04-25T02:14:13.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.890+0000 7faac20d1700 1 -- start start 2024-04-25T02:14:13.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.890+0000 7faac20d1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faabc0fb4e0 0x7faabc115b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:13.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.890+0000 7faac20d1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faabc1014f0 0x7faabc116050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:13.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.890+0000 7faac20d1700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc1166a0 con 0x7faabc1014f0 2024-04-25T02:14:13.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.890+0000 7faac20d1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc10fc80 con 0x7faabc0fb4e0 2024-04-25T02:14:13.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.891+0000 7faabaffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faabc1014f0 0x7faabc116050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:13.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.891+0000 7faabaffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faabc1014f0 0x7faabc116050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37574/0 (socket says 172.21.15.77:37574) 2024-04-25T02:14:13.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.891+0000 7faabaffd700 1 -- 172.21.15.77:0/2733361454 learned_addr learned my addr 172.21.15.77:0/2733361454 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:14:13.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.891+0000 7faabb7fe700 1 --2- 172.21.15.77:0/2733361454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faabc0fb4e0 0x7faabc115b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:13.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.891+0000 7faabaffd700 1 -- 172.21.15.77:0/2733361454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faabc0fb4e0 msgr2=0x7faabc115b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:13.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.891+0000 7faabaffd700 1 --2- 172.21.15.77:0/2733361454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faabc0fb4e0 0x7faabc115b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:13.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.891+0000 7faabaffd700 1 -- 172.21.15.77:0/2733361454 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab0005040 con 0x7faabc1014f0 2024-04-25T02:14:13.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.891+0000 7faabaffd700 1 --2- 172.21.15.77:0/2733361454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faabc1014f0 0x7faabc116050 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faaac002a80 tx=0x7faaac0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:13.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.891+0000 7faaa3fff700 1 -- 172.21.15.77:0/2733361454 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faaac004ea0 con 0x7faabc1014f0 2024-04-25T02:14:13.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.891+0000 7faaa3fff700 1 -- 172.21.15.77:0/2733361454 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faaac00f040 con 0x7faabc1014f0 2024-04-25T02:14:13.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.891+0000 7faac20d1700 1 -- 172.21.15.77:0/2733361454 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faabc10ff60 con 0x7faabc1014f0 2024-04-25T02:14:13.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.891+0000 7faaa3fff700 1 -- 172.21.15.77:0/2733361454 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faaac00d9c0 con 0x7faabc1014f0 2024-04-25T02:14:13.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.891+0000 7faac20d1700 1 -- 172.21.15.77:0/2733361454 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faabc110520 con 0x7faabc1014f0 2024-04-25T02:14:13.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.892+0000 7faac20d1700 1 -- 172.21.15.77:0/2733361454 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faabc0fcbd0 con 0x7faabc1014f0 2024-04-25T02:14:13.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.893+0000 7faaa3fff700 1 -- 172.21.15.77:0/2733361454 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7faaac007cc0 con 0x7faabc1014f0 2024-04-25T02:14:13.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.893+0000 7faaa3fff700 1 --2- 172.21.15.77:0/2733361454 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7faaa406e270 0x7faaa4070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:13.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.893+0000 7faaa3fff700 1 -- 172.21.15.77:0/2733361454 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6324+0+0 (secure 0 0 0) 0x7faaac08d2d0 con 0x7faabc1014f0 2024-04-25T02:14:13.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.893+0000 7faabb7fe700 1 --2- 172.21.15.77:0/2733361454 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7faaa406e270 0x7faaa4070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:13.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.893+0000 7faabb7fe700 1 --2- 172.21.15.77:0/2733361454 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7faaa406e270 0x7faaa4070720 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7faab0004f90 tx=0x7faab0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:13.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:13.898+0000 7faaa3fff700 1 -- 172.21.15.77:0/2733361454 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7faaac05a030 con 0x7faabc1014f0 2024-04-25T02:14:14.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.112+0000 7faac20d1700 1 -- 172.21.15.77:0/2733361454 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faabc1085d0 con 0x7faaa406e270 2024-04-25T02:14:14.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.114+0000 7faaa3fff700 1 -- 172.21.15.77:0/2733361454 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7faabc1085d0 con 0x7faaa406e270 2024-04-25T02:14:14.120 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:14:14.120 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901", 2024-04-25T02:14:14.120 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-04-25T02:14:14.120 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T02:14:14.120 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-04-25T02:14:14.120 INFO:teuthology.orchestra.run.smithi077.stdout: "mon", 2024-04-25T02:14:14.121 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr" 2024-04-25T02:14:14.121 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-25T02:14:14.121 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "4/21 daemons upgraded", 2024-04-25T02:14:14.121 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading mon daemons", 2024-04-25T02:14:14.121 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-04-25T02:14:14.121 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:14:14.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.116+0000 7faac20d1700 1 -- 172.21.15.77:0/2733361454 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7faaa406e270 msgr2=0x7faaa4070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:14.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.116+0000 7faac20d1700 1 --2- 172.21.15.77:0/2733361454 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7faaa406e270 0x7faaa4070720 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7faab0004f90 tx=0x7faab0009e30 comp rx=0 tx=0).stop 2024-04-25T02:14:14.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.116+0000 7faac20d1700 1 -- 172.21.15.77:0/2733361454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faabc1014f0 msgr2=0x7faabc116050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:14.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.116+0000 7faac20d1700 1 --2- 172.21.15.77:0/2733361454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faabc1014f0 0x7faabc116050 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faaac002a80 tx=0x7faaac0046b0 comp rx=0 tx=0).stop 2024-04-25T02:14:14.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.116+0000 7faac20d1700 1 -- 172.21.15.77:0/2733361454 shutdown_connections 2024-04-25T02:14:14.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.116+0000 7faac20d1700 1 --2- 172.21.15.77:0/2733361454 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7faaa406e270 0x7faaa4070720 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:14.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.116+0000 7faac20d1700 1 --2- 172.21.15.77:0/2733361454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faabc0fb4e0 0x7faabc115b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:14.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.116+0000 7faac20d1700 1 --2- 172.21.15.77:0/2733361454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faabc1014f0 0x7faabc116050 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:14.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.116+0000 7faac20d1700 1 -- 172.21.15.77:0/2733361454 >> 172.21.15.77:0/2733361454 conn(0x7faabc073350 msgr2=0x7faabc0f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:14.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.117+0000 7faac20d1700 1 -- 172.21.15.77:0/2733361454 shutdown_connections 2024-04-25T02:14:14.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.117+0000 7faac20d1700 1 -- 172.21.15.77:0/2733361454 wait complete. 2024-04-25T02:14:14.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.216+0000 7fecd38ac700 1 -- 172.21.15.77:0/783860887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feccc0fb5a0 msgr2=0x7feccc0fb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:14.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.216+0000 7fecd38ac700 1 --2- 172.21.15.77:0/783860887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feccc0fb5a0 0x7feccc0fb970 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fecbc004940 tx=0x7fecbc009e30 comp rx=0 tx=0).stop 2024-04-25T02:14:14.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.216+0000 7fecd38ac700 1 -- 172.21.15.77:0/783860887 shutdown_connections 2024-04-25T02:14:14.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.216+0000 7fecd38ac700 1 --2- 172.21.15.77:0/783860887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feccc0fbf40 0x7feccc101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:14.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.216+0000 7fecd38ac700 1 --2- 172.21.15.77:0/783860887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feccc0fb5a0 0x7feccc0fb970 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:14.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.216+0000 7fecd38ac700 1 -- 172.21.15.77:0/783860887 >> 172.21.15.77:0/783860887 conn(0x7feccc073350 msgr2=0x7feccc073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:14.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.216+0000 7fecd38ac700 1 -- 172.21.15.77:0/783860887 shutdown_connections 2024-04-25T02:14:14.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.216+0000 7fecd38ac700 1 -- 172.21.15.77:0/783860887 wait complete. 2024-04-25T02:14:14.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.217+0000 7fecd38ac700 1 Processor -- start 2024-04-25T02:14:14.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.217+0000 7fecd38ac700 1 -- start start 2024-04-25T02:14:14.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.217+0000 7fecd38ac700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feccc0fb5a0 0x7feccc0fc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:14.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.217+0000 7fecd38ac700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feccc0fbf40 0x7feccc0fca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:14.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.217+0000 7fecd38ac700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc0fe480 con 0x7feccc0fbf40 2024-04-25T02:14:14.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.217+0000 7fecd38ac700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc0fcfb0 con 0x7feccc0fb5a0 2024-04-25T02:14:14.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.217+0000 7fecd0e47700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feccc0fbf40 0x7feccc0fca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:14.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.217+0000 7fecd0e47700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feccc0fbf40 0x7feccc0fca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37586/0 (socket says 172.21.15.77:37586) 2024-04-25T02:14:14.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.217+0000 7fecd0e47700 1 -- 172.21.15.77:0/3364052235 learned_addr learned my addr 172.21.15.77:0/3364052235 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:14:14.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.217+0000 7fecd1648700 1 --2- 172.21.15.77:0/3364052235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feccc0fb5a0 0x7feccc0fc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:14.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.218+0000 7fecd0e47700 1 -- 172.21.15.77:0/3364052235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feccc0fb5a0 msgr2=0x7feccc0fc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:14.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.218+0000 7fecd0e47700 1 --2- 172.21.15.77:0/3364052235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feccc0fb5a0 0x7feccc0fc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:14.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.218+0000 7fecd0e47700 1 -- 172.21.15.77:0/3364052235 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecbc005040 con 0x7feccc0fbf40 2024-04-25T02:14:14.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.218+0000 7fecd0e47700 1 --2- 172.21.15.77:0/3364052235 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feccc0fbf40 0x7feccc0fca70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fecc80044e0 tx=0x7fecc800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:14.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.218+0000 7fecc1ffb700 1 -- 172.21.15.77:0/3364052235 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecc8007cc0 con 0x7feccc0fbf40 2024-04-25T02:14:14.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.218+0000 7fecc1ffb700 1 -- 172.21.15.77:0/3364052235 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fecc800f040 con 0x7feccc0fbf40 2024-04-25T02:14:14.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.218+0000 7fecc1ffb700 1 -- 172.21.15.77:0/3364052235 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecc800ca50 con 0x7feccc0fbf40 2024-04-25T02:14:14.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.218+0000 7fecd38ac700 1 -- 172.21.15.77:0/3364052235 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feccc0fd230 con 0x7feccc0fbf40 2024-04-25T02:14:14.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.218+0000 7fecd38ac700 1 -- 172.21.15.77:0/3364052235 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feccc11a030 con 0x7feccc0fbf40 2024-04-25T02:14:14.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.219+0000 7fecd38ac700 1 -- 172.21.15.77:0/3364052235 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feccc0fe670 con 0x7feccc0fbf40 2024-04-25T02:14:14.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.219+0000 7fecc1ffb700 1 -- 172.21.15.77:0/3364052235 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fecc800cbb0 con 0x7feccc0fbf40 2024-04-25T02:14:14.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.220+0000 7fecc1ffb700 1 --2- 172.21.15.77:0/3364052235 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fecb806e270 0x7fecb8070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:14.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.220+0000 7fecc1ffb700 1 -- 172.21.15.77:0/3364052235 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fecc808d720 con 0x7feccc0fbf40 2024-04-25T02:14:14.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.220+0000 7fecd1648700 1 --2- 172.21.15.77:0/3364052235 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fecb806e270 0x7fecb8070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:14.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.220+0000 7fecd1648700 1 --2- 172.21.15.77:0/3364052235 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fecb806e270 0x7fecb8070720 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009b30 tx=0x7fecbc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:14.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.224+0000 7fecc1ffb700 1 -- 172.21.15.77:0/3364052235 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fecc8056980 con 0x7feccc0fbf40 2024-04-25T02:14:14.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.507+0000 7fecd38ac700 1 -- 172.21.15.77:0/3364052235 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7feccc109fa0 con 0x7feccc0fbf40 2024-04-25T02:14:14.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.508+0000 7fecc1ffb700 1 -- 172.21.15.77:0/3364052235 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fecc800ce60 con 0x7feccc0fbf40 2024-04-25T02:14:14.514 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-04-25T02:14:14.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.510+0000 7fecd38ac700 1 -- 172.21.15.77:0/3364052235 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fecb806e270 msgr2=0x7fecb8070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:14.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.510+0000 7fecd38ac700 1 --2- 172.21.15.77:0/3364052235 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fecb806e270 0x7fecb8070720 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009b30 tx=0x7fecbc009e30 comp rx=0 tx=0).stop 2024-04-25T02:14:14.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.510+0000 7fecd38ac700 1 -- 172.21.15.77:0/3364052235 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feccc0fbf40 msgr2=0x7feccc0fca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:14.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.510+0000 7fecd38ac700 1 --2- 172.21.15.77:0/3364052235 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feccc0fbf40 0x7feccc0fca70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fecc80044e0 tx=0x7fecc800b040 comp rx=0 tx=0).stop 2024-04-25T02:14:14.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.510+0000 7fecd38ac700 1 -- 172.21.15.77:0/3364052235 shutdown_connections 2024-04-25T02:14:14.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.510+0000 7fecd38ac700 1 --2- 172.21.15.77:0/3364052235 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fecb806e270 0x7fecb8070720 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:14.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.510+0000 7fecd38ac700 1 --2- 172.21.15.77:0/3364052235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feccc0fb5a0 0x7feccc0fc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:14.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.510+0000 7fecd38ac700 1 --2- 172.21.15.77:0/3364052235 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feccc0fbf40 0x7feccc0fca70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:14.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.510+0000 7fecd38ac700 1 -- 172.21.15.77:0/3364052235 >> 172.21.15.77:0/3364052235 conn(0x7feccc073350 msgr2=0x7feccc100a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:14.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.510+0000 7fecd38ac700 1 -- 172.21.15.77:0/3364052235 shutdown_connections 2024-04-25T02:14:14.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:14.510+0000 7fecd38ac700 1 -- 172.21.15.77:0/3364052235 wait complete. 2024-04-25T02:14:14.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:14 smithi077 ceph-mon[110441]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:14:14.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:14 smithi077 ceph-mon[110441]: Reconfiguring mds.cephfs.smithi112.fjnadi (monmap changed)... 2024-04-25T02:14:14.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:14 smithi077 ceph-mon[110441]: Reconfiguring daemon mds.cephfs.smithi112.fjnadi on smithi112 2024-04-25T02:14:14.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:14 smithi077 ceph-mon[110441]: pgmap v28: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:14.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:14 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/747080983' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:14:14.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:14 smithi112 ceph-mon[80494]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:14:14.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:14 smithi112 ceph-mon[80494]: Reconfiguring mds.cephfs.smithi112.fjnadi (monmap changed)... 2024-04-25T02:14:14.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:14 smithi112 ceph-mon[80494]: Reconfiguring daemon mds.cephfs.smithi112.fjnadi on smithi112 2024-04-25T02:14:14.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:14 smithi112 ceph-mon[80494]: pgmap v28: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:14.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:14 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/747080983' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:14:15.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:15 smithi077 ceph-mon[110441]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:14:15.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:15 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/3364052235' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T02:14:15.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:15 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:15.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:15 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:15.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:15 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:14:15.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:15 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:14:15.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:15 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:14:15.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:15 smithi077 ceph-mon[110441]: Upgrade: Setting container_image for all mon 2024-04-25T02:14:15.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:15 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:15.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:15 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi077"}]: dispatch 2024-04-25T02:14:15.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:15 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi077"}]': finished 2024-04-25T02:14:15.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:15 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi112"}]: dispatch 2024-04-25T02:14:15.730 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:15 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi112"}]': finished 2024-04-25T02:14:15.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:15 smithi112 ceph-mon[80494]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:14:15.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:15 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/3364052235' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T02:14:15.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:15 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:15.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:15 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:15.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:15 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:14:15.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:15 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:14:15.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:15 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:14:15.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:15 smithi112 ceph-mon[80494]: Upgrade: Setting container_image for all mon 2024-04-25T02:14:15.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:15 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:15.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:15 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi077"}]: dispatch 2024-04-25T02:14:15.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:15 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi077"}]': finished 2024-04-25T02:14:15.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:15 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi112"}]: dispatch 2024-04-25T02:14:15.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:15 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi112"}]': finished 2024-04-25T02:14:16.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:16 smithi077 ceph-mon[110441]: pgmap v29: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:16.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:16 smithi112 ceph-mon[80494]: pgmap v29: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:17.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:17 smithi077 ceph-mon[110441]: Upgrade: Updating crash.smithi077 (1/2) 2024-04-25T02:14:17.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:17 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:17.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:17 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi077", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T02:14:17.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:17 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:17.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:17 smithi077 ceph-mon[110441]: Deploying daemon crash.smithi077 on smithi077 2024-04-25T02:14:17.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:17 smithi112 ceph-mon[80494]: Upgrade: Updating crash.smithi077 (1/2) 2024-04-25T02:14:17.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:17 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:17.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:17 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi077", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T02:14:17.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:17 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:17.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:17 smithi112 ceph-mon[80494]: Deploying daemon crash.smithi077 on smithi077 2024-04-25T02:14:18.645 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:18 smithi077 ceph-mon[110441]: pgmap v30: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:18.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:18 smithi112 ceph-mon[80494]: pgmap v30: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:21.113 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:20 smithi112 ceph-mon[80494]: pgmap v31: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:21.113 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:20 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:21.113 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:20 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:21.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:20 smithi077 ceph-mon[110441]: pgmap v31: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:21.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:20 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:21.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:20 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:23.165 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:22 smithi112 ceph-mon[80494]: pgmap v32: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:23.165 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:22 smithi112 ceph-mon[80494]: Upgrade: Updating crash.smithi112 (2/2) 2024-04-25T02:14:23.165 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:22 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:23.165 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:22 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T02:14:23.165 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:22 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:23.165 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:22 smithi112 ceph-mon[80494]: Deploying daemon crash.smithi112 on smithi112 2024-04-25T02:14:23.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:22 smithi077 ceph-mon[110441]: pgmap v32: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:23.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:22 smithi077 ceph-mon[110441]: Upgrade: Updating crash.smithi112 (2/2) 2024-04-25T02:14:23.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:22 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:23.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:22 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T02:14:23.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:22 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:23.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:22 smithi077 ceph-mon[110441]: Deploying daemon crash.smithi112 on smithi112 2024-04-25T02:14:23.980 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:23 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:14:24.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:23 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:14:25.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:24 smithi077 ceph-mon[110441]: pgmap v33: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:25.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:24 smithi112 ceph-mon[80494]: pgmap v33: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:26.830 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:26 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:26.830 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:26 smithi112 ceph-mon[80494]: pgmap v34: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:26.830 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:26 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:26.830 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:26 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:14:26.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:26 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:26.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:26 smithi077 ceph-mon[110441]: pgmap v34: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:26.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:26 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:26.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:26 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:14:28.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:28 smithi077 ceph-mon[110441]: pgmap v35: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:28.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:28 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:28.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:28 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:29.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:28 smithi112 ceph-mon[80494]: pgmap v35: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:29.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:28 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:29.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:28 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:30.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:30 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:30.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:30 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:30.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:30 smithi077 ceph-mon[110441]: pgmap v36: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:30.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:30 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:30.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:30 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:31.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:30 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:31.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:30 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:31.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:30 smithi112 ceph-mon[80494]: pgmap v36: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:31.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:30 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:31.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:30 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:32.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:32 smithi112 ceph-mon[80494]: pgmap v37: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:32.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:32 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:32.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:32 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:32.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:32 smithi077 ceph-mon[110441]: pgmap v37: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:32.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:32 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:32.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:32 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:34.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:34 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:34.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:34 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:34.729 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:34 smithi077 ceph-mon[110441]: pgmap v38: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:34.778 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:34 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:34.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:34 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:34.779 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:34 smithi112 ceph-mon[80494]: pgmap v38: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:36.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:36 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:36.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:36 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:36.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:36 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:36.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:36 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:14:36.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:36 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:36.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:36 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:14:36.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:36 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:14:36.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:36 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:14:36.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:36 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:14:36.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:36 smithi077 ceph-mon[110441]: Upgrade: Setting container_image for all crash 2024-04-25T02:14:36.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:36 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:36.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:36 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi077"}]: dispatch 2024-04-25T02:14:36.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:36 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi077"}]': finished 2024-04-25T02:14:36.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:36 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi112"}]: dispatch 2024-04-25T02:14:36.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:36 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi112"}]': finished 2024-04-25T02:14:36.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:36 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-25T02:14:36.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:36 smithi077 ceph-mon[110441]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-25T02:14:36.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:36 smithi077 ceph-mon[110441]: Upgrade: osd.0 is safe to restart 2024-04-25T02:14:36.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:36 smithi077 ceph-mon[110441]: pgmap v39: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:36.528 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:36 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:36.528 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:36 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:36.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:36 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:36.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:36 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:14:36.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:36 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:36.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:36 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:14:36.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:36 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:14:36.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:36 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:14:36.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:36 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:14:36.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:36 smithi112 ceph-mon[80494]: Upgrade: Setting container_image for all crash 2024-04-25T02:14:36.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:36 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:36.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:36 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi077"}]: dispatch 2024-04-25T02:14:36.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:36 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi077"}]': finished 2024-04-25T02:14:36.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:36 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi112"}]: dispatch 2024-04-25T02:14:36.529 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:36 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi112"}]': finished 2024-04-25T02:14:36.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:36 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-25T02:14:36.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:36 smithi112 ceph-mon[80494]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-25T02:14:36.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:36 smithi112 ceph-mon[80494]: Upgrade: osd.0 is safe to restart 2024-04-25T02:14:36.530 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:36 smithi112 ceph-mon[80494]: pgmap v39: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:38.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:37 smithi077 ceph-mon[110441]: Upgrade: Updating osd.0 2024-04-25T02:14:38.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:37 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:38.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:37 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-25T02:14:38.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:37 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:38.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:37 smithi077 ceph-mon[110441]: Deploying daemon osd.0 on smithi077 2024-04-25T02:14:38.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:37 smithi077 ceph-mon[110441]: pgmap v40: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:38.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:37 smithi112 ceph-mon[80494]: Upgrade: Updating osd.0 2024-04-25T02:14:38.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:37 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:38.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:37 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-25T02:14:38.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:37 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:38.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:37 smithi112 ceph-mon[80494]: Deploying daemon osd.0 on smithi077 2024-04-25T02:14:38.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:37 smithi112 ceph-mon[80494]: pgmap v40: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:39.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:38 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:14:39.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:38 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:14:40.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:39 smithi077 ceph-mon[110441]: pgmap v41: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:40.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:39 smithi112 ceph-mon[80494]: pgmap v41: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:40.729 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:40 smithi077 systemd[1]: Stopping Ceph osd.0 for 4bb93d82-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:14:40.729 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:40 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0[44888]: 2024-04-25T02:14:40.513+0000 7fe764dbe700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:14:40.729 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:40 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0[44888]: 2024-04-25T02:14:40.513+0000 7fe764dbe700 -1 osd.0 50 *** Got signal Terminated *** 2024-04-25T02:14:40.729 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:40 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0[44888]: 2024-04-25T02:14:40.513+0000 7fe764dbe700 -1 osd.0 50 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T02:14:41.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:41 smithi112 ceph-mon[80494]: osd.0 marked itself down and dead 2024-04-25T02:14:41.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:41 smithi077 ceph-mon[110441]: osd.0 marked itself down and dead 2024-04-25T02:14:41.978 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:41 smithi077 podman[121172]: 2024-04-25 02:14:41.544772518 +0000 UTC m=+1.126080159 container died c741abec3b9496448b9f7d7c4ddae8fb535988537b9209d24484aed34f257a4d (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=quincy-c61472c, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:14:42.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:42 smithi112 ceph-mon[80494]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-25T02:14:42.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:42 smithi112 ceph-mon[80494]: osdmap e51: 6 total, 5 up, 6 in 2024-04-25T02:14:42.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:42 smithi112 ceph-mon[80494]: pgmap v43: 65 pgs: 9 stale+active+clean, 56 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:42.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:42 smithi077 ceph-mon[110441]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-25T02:14:42.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:42 smithi077 ceph-mon[110441]: osdmap e51: 6 total, 5 up, 6 in 2024-04-25T02:14:42.479 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:42 smithi077 ceph-mon[110441]: pgmap v43: 65 pgs: 9 stale+active+clean, 56 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:42.479 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:41 smithi077 podman[121172]: 2024-04-25 02:14:41.989272817 +0000 UTC m=+1.570580462 container cleanup c741abec3b9496448b9f7d7c4ddae8fb535988537b9209d24484aed34f257a4d (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0, maintainer=Guillaume Abrioux , RELEASE=quincy-c61472c, ceph=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-04-25T02:14:42.479 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:41 smithi077 bash[121172]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0 2024-04-25T02:14:42.479 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:42 smithi077 podman[121189]: 2024-04-25 02:14:42.216325688 +0000 UTC m=+0.671133943 container remove c741abec3b9496448b9f7d7c4ddae8fb535988537b9209d24484aed34f257a4d (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-c61472c, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-25T02:14:42.917 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:42 smithi077 podman[121277]: 2024-04-25 02:14:42.600663085 +0000 UTC m=+0.105913289 container create 6b1c97be0ac21962ff077d83a3ff8fcc66272637212157cdc32e9683b043d789 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0-deactivate, ceph=True, RELEASE=squid-d2c45d9, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-25T02:14:42.917 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:42 smithi077 podman[121277]: 2024-04-25 02:14:42.512781663 +0000 UTC m=+0.018031892 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:14:42.917 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:42 smithi077 podman[121277]: 2024-04-25 02:14:42.820923103 +0000 UTC m=+0.326173309 container init 6b1c97be0ac21962ff077d83a3ff8fcc66272637212157cdc32e9683b043d789 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-d2c45d9) 2024-04-25T02:14:42.917 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:42 smithi077 podman[121277]: 2024-04-25 02:14:42.824164437 +0000 UTC m=+0.329414648 container start 6b1c97be0ac21962ff077d83a3ff8fcc66272637212157cdc32e9683b043d789 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , RELEASE=squid-d2c45d9, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-25T02:14:42.918 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:42 smithi077 podman[121277]: 2024-04-25 02:14:42.911922773 +0000 UTC m=+0.417172976 container attach 6b1c97be0ac21962ff077d83a3ff8fcc66272637212157cdc32e9683b043d789 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=squid-d2c45d9, org.label-schema.license=GPLv2) 2024-04-25T02:14:43.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:43 smithi077 ceph-mon[110441]: osdmap e52: 6 total, 5 up, 6 in 2024-04-25T02:14:43.228 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:43 smithi077 podman[121277]: 2024-04-25 02:14:43.123993231 +0000 UTC m=+0.629243444 container died 6b1c97be0ac21962ff077d83a3ff8fcc66272637212157cdc32e9683b043d789 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , RELEASE=squid-d2c45d9, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-04-25T02:14:43.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:43 smithi112 ceph-mon[80494]: osdmap e52: 6 total, 5 up, 6 in 2024-04-25T02:14:43.978 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:43 smithi077 podman[121303]: 2024-04-25 02:14:43.682886527 +0000 UTC m=+0.552270193 container remove 6b1c97be0ac21962ff077d83a3ff8fcc66272637212157cdc32e9683b043d789 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-d2c45d9, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:14:43.978 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:43 smithi077 systemd[1]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.0.service: Deactivated successfully. 2024-04-25T02:14:43.979 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:43 smithi077 systemd[1]: Stopped Ceph osd.0 for 4bb93d82-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:14:43.979 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:43 smithi077 systemd[1]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.0.service: Consumed 1min 3.020s CPU time. 2024-04-25T02:14:43.979 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:43 smithi077 systemd[1]: Starting Ceph osd.0 for 4bb93d82-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:14:44.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:44 smithi112 ceph-mon[80494]: pgmap v45: 65 pgs: 9 stale+active+clean, 56 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:44.383 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:44 smithi077 ceph-mon[110441]: pgmap v45: 65 pgs: 9 stale+active+clean, 56 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:14:44.383 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:44 smithi077 podman[121407]: 2024-04-25 02:14:44.02517627 +0000 UTC m=+0.018522419 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:14:44.383 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:44 smithi077 podman[121407]: 2024-04-25 02:14:44.133922896 +0000 UTC m=+0.127269019 container create 69404d55b6d0759373102c5b05397ff92977679ddb1402a2cd3a3b65689228e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0-activate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux ) 2024-04-25T02:14:44.383 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:44 smithi077 podman[121407]: 2024-04-25 02:14:44.378193579 +0000 UTC m=+0.371539712 container init 69404d55b6d0759373102c5b05397ff92977679ddb1402a2cd3a3b65689228e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0-activate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-04-25T02:14:44.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.618+0000 7efe68ed8700 1 -- 172.21.15.77:0/1772276478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe64102680 msgr2=0x7efe640fbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:44.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.618+0000 7efe68ed8700 1 --2- 172.21.15.77:0/1772276478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe64102680 0x7efe640fbcf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efe54004940 tx=0x7efe54009e30 comp rx=0 tx=0).stop 2024-04-25T02:14:44.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.618+0000 7efe68ed8700 1 -- 172.21.15.77:0/1772276478 shutdown_connections 2024-04-25T02:14:44.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.618+0000 7efe68ed8700 1 --2- 172.21.15.77:0/1772276478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe64102680 0x7efe640fbcf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:44.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.618+0000 7efe68ed8700 1 --2- 172.21.15.77:0/1772276478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe64101ce0 0x7efe641020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:44.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.618+0000 7efe68ed8700 1 -- 172.21.15.77:0/1772276478 >> 172.21.15.77:0/1772276478 conn(0x7efe640f7850 msgr2=0x7efe640f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:44.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.618+0000 7efe68ed8700 1 -- 172.21.15.77:0/1772276478 shutdown_connections 2024-04-25T02:14:44.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.618+0000 7efe68ed8700 1 -- 172.21.15.77:0/1772276478 wait complete. 2024-04-25T02:14:44.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.619+0000 7efe68ed8700 1 Processor -- start 2024-04-25T02:14:44.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.619+0000 7efe68ed8700 1 -- start start 2024-04-25T02:14:44.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.619+0000 7efe68ed8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe64101ce0 0x7efe6410eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:44.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.619+0000 7efe68ed8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe64102680 0x7efe6410f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:44.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.619+0000 7efe68ed8700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6410f680 con 0x7efe64102680 2024-04-25T02:14:44.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.619+0000 7efe68ed8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6410f7c0 con 0x7efe64101ce0 2024-04-25T02:14:44.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.619+0000 7efe61d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe64102680 0x7efe6410f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:44.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.619+0000 7efe61d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe64102680 0x7efe6410f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45860/0 (socket says 172.21.15.77:45860) 2024-04-25T02:14:44.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.619+0000 7efe61d9b700 1 -- 172.21.15.77:0/2411882995 learned_addr learned my addr 172.21.15.77:0/2411882995 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:14:44.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.619+0000 7efe6259c700 1 --2- 172.21.15.77:0/2411882995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe64101ce0 0x7efe6410eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:44.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.620+0000 7efe61d9b700 1 -- 172.21.15.77:0/2411882995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe64101ce0 msgr2=0x7efe6410eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:44.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.620+0000 7efe61d9b700 1 --2- 172.21.15.77:0/2411882995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe64101ce0 0x7efe6410eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:44.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.620+0000 7efe61d9b700 1 -- 172.21.15.77:0/2411882995 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe54005040 con 0x7efe64102680 2024-04-25T02:14:44.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.620+0000 7efe61d9b700 1 --2- 172.21.15.77:0/2411882995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe64102680 0x7efe6410f030 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efe54009180 tx=0x7efe54009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:44.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.620+0000 7efe52ffd700 1 -- 172.21.15.77:0/2411882995 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe5400e040 con 0x7efe64102680 2024-04-25T02:14:44.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.620+0000 7efe68ed8700 1 -- 172.21.15.77:0/2411882995 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe64117b60 con 0x7efe64102680 2024-04-25T02:14:44.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.620+0000 7efe52ffd700 1 -- 172.21.15.77:0/2411882995 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe54013420 con 0x7efe64102680 2024-04-25T02:14:44.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.620+0000 7efe52ffd700 1 -- 172.21.15.77:0/2411882995 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe5401c610 con 0x7efe64102680 2024-04-25T02:14:44.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.620+0000 7efe68ed8700 1 -- 172.21.15.77:0/2411882995 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe64118070 con 0x7efe64102680 2024-04-25T02:14:44.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.621+0000 7efe68ed8700 1 -- 172.21.15.77:0/2411882995 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe640fd430 con 0x7efe64102680 2024-04-25T02:14:44.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.622+0000 7efe52ffd700 1 -- 172.21.15.77:0/2411882995 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7efe54013a00 con 0x7efe64102680 2024-04-25T02:14:44.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.622+0000 7efe52ffd700 1 --2- 172.21.15.77:0/2411882995 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7efe4c06e260 0x7efe4c070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:44.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.622+0000 7efe6259c700 1 --2- 172.21.15.77:0/2411882995 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7efe4c06e260 0x7efe4c070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:44.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.622+0000 7efe52ffd700 1 -- 172.21.15.77:0/2411882995 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6324+0+0 (secure 0 0 0) 0x7efe5408ed70 con 0x7efe64102680 2024-04-25T02:14:44.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.623+0000 7efe6259c700 1 --2- 172.21.15.77:0/2411882995 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7efe4c06e260 0x7efe4c070710 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efe58004f40 tx=0x7efe5800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:44.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.627+0000 7efe52ffd700 1 -- 172.21.15.77:0/2411882995 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7efe54058040 con 0x7efe64102680 2024-04-25T02:14:44.633 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:44 smithi077 podman[121407]: 2024-04-25 02:14:44.381237254 +0000 UTC m=+0.374583381 container start 69404d55b6d0759373102c5b05397ff92977679ddb1402a2cd3a3b65689228e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0-activate, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-25T02:14:44.633 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:44 smithi077 podman[121407]: 2024-04-25 02:14:44.461537977 +0000 UTC m=+0.454884116 container attach 69404d55b6d0759373102c5b05397ff92977679ddb1402a2cd3a3b65689228e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0-activate, RELEASE=squid-d2c45d9, ceph=True, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-04-25T02:14:44.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.860+0000 7efe68ed8700 1 -- 172.21.15.77:0/2411882995 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efe6404bed0 con 0x7efe4c06e260 2024-04-25T02:14:44.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.861+0000 7efe52ffd700 1 -- 172.21.15.77:0/2411882995 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7efe6404bed0 con 0x7efe4c06e260 2024-04-25T02:14:44.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.863+0000 7efe68ed8700 1 -- 172.21.15.77:0/2411882995 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7efe4c06e260 msgr2=0x7efe4c070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:44.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.863+0000 7efe68ed8700 1 --2- 172.21.15.77:0/2411882995 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7efe4c06e260 0x7efe4c070710 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efe58004f40 tx=0x7efe5800b040 comp rx=0 tx=0).stop 2024-04-25T02:14:44.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.863+0000 7efe68ed8700 1 -- 172.21.15.77:0/2411882995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe64102680 msgr2=0x7efe6410f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:44.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.863+0000 7efe68ed8700 1 --2- 172.21.15.77:0/2411882995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe64102680 0x7efe6410f030 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efe54009180 tx=0x7efe54009e30 comp rx=0 tx=0).stop 2024-04-25T02:14:44.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.864+0000 7efe68ed8700 1 -- 172.21.15.77:0/2411882995 shutdown_connections 2024-04-25T02:14:44.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.864+0000 7efe68ed8700 1 --2- 172.21.15.77:0/2411882995 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7efe4c06e260 0x7efe4c070710 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:44.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.864+0000 7efe68ed8700 1 --2- 172.21.15.77:0/2411882995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe64101ce0 0x7efe6410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:44.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.864+0000 7efe68ed8700 1 --2- 172.21.15.77:0/2411882995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe64102680 0x7efe6410f030 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:44.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.864+0000 7efe68ed8700 1 -- 172.21.15.77:0/2411882995 >> 172.21.15.77:0/2411882995 conn(0x7efe640f7850 msgr2=0x7efe640f8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:44.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.864+0000 7efe68ed8700 1 -- 172.21.15.77:0/2411882995 shutdown_connections 2024-04-25T02:14:44.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.864+0000 7efe68ed8700 1 -- 172.21.15.77:0/2411882995 wait complete. 2024-04-25T02:14:44.881 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-04-25T02:14:44.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.969+0000 7fcdd2633700 1 -- 172.21.15.77:0/890371770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc102e20 msgr2=0x7fcdcc1031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:44.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.969+0000 7fcdd2633700 1 --2- 172.21.15.77:0/890371770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc102e20 0x7fcdcc1031f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc004940 tx=0x7fcdbc009e30 comp rx=0 tx=0).stop 2024-04-25T02:14:44.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.969+0000 7fcdd2633700 1 -- 172.21.15.77:0/890371770 shutdown_connections 2024-04-25T02:14:44.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.969+0000 7fcdd2633700 1 --2- 172.21.15.77:0/890371770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdcc1037c0 0x7fcdcc0fb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:44.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.969+0000 7fcdd2633700 1 --2- 172.21.15.77:0/890371770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc102e20 0x7fcdcc1031f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:44.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.969+0000 7fcdd2633700 1 -- 172.21.15.77:0/890371770 >> 172.21.15.77:0/890371770 conn(0x7fcdcc072380 msgr2=0x7fcdcc072780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:44.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.969+0000 7fcdd2633700 1 -- 172.21.15.77:0/890371770 shutdown_connections 2024-04-25T02:14:44.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.969+0000 7fcdd2633700 1 -- 172.21.15.77:0/890371770 wait complete. 2024-04-25T02:14:44.978 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:44 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0-activate[121422]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T02:14:44.978 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:44 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0-activate[121422]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-25T02:14:44.978 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:44 smithi077 bash[121407]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T02:14:44.978 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:44 smithi077 bash[121407]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-25T02:14:44.978 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:44 smithi077 bash[121407]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-25T02:14:44.978 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:44 smithi077 bash[121407]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-25T02:14:44.978 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:44 smithi077 bash[121407]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-04-25T02:14:44.978 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:44 smithi077 bash[121407]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T02:14:44.978 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:44 smithi077 bash[121407]: --> ceph-volume raw activate successful for osd ID: 0 2024-04-25T02:14:44.979 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:44 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0-activate[121422]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-25T02:14:44.979 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:44 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0-activate[121422]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-25T02:14:44.979 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:44 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0-activate[121422]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-04-25T02:14:44.979 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:44 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0-activate[121422]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T02:14:44.979 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:44 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0-activate[121422]: --> ceph-volume raw activate successful for osd ID: 0 2024-04-25T02:14:44.979 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:44 smithi077 podman[121407]: 2024-04-25 02:14:44.858793757 +0000 UTC m=+0.852139897 container died 69404d55b6d0759373102c5b05397ff92977679ddb1402a2cd3a3b65689228e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0-activate, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-d2c45d9, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424) 2024-04-25T02:14:44.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.970+0000 7fcdd2633700 1 Processor -- start 2024-04-25T02:14:44.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.970+0000 7fcdd2633700 1 -- start start 2024-04-25T02:14:44.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.970+0000 7fcdd2633700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdcc102e20 0x7fcdcc113930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:44.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.970+0000 7fcdd2633700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc1037c0 0x7fcdcc113e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:44.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.970+0000 7fcdd2633700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc1144c0 con 0x7fcdcc1037c0 2024-04-25T02:14:44.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.970+0000 7fcdd2633700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc10dac0 con 0x7fcdcc102e20 2024-04-25T02:14:44.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.970+0000 7fcdcb7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc1037c0 0x7fcdcc113e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:44.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.970+0000 7fcdcb7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc1037c0 0x7fcdcc113e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45868/0 (socket says 172.21.15.77:45868) 2024-04-25T02:14:44.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.970+0000 7fcdcb7fe700 1 -- 172.21.15.77:0/690078477 learned_addr learned my addr 172.21.15.77:0/690078477 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:14:44.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.970+0000 7fcdcbfff700 1 --2- 172.21.15.77:0/690078477 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdcc102e20 0x7fcdcc113930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:44.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.971+0000 7fcdcb7fe700 1 -- 172.21.15.77:0/690078477 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdcc102e20 msgr2=0x7fcdcc113930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:44.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.971+0000 7fcdcb7fe700 1 --2- 172.21.15.77:0/690078477 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdcc102e20 0x7fcdcc113930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:44.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.971+0000 7fcdcb7fe700 1 -- 172.21.15.77:0/690078477 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdbc005040 con 0x7fcdcc1037c0 2024-04-25T02:14:44.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.971+0000 7fcdcb7fe700 1 --2- 172.21.15.77:0/690078477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc1037c0 0x7fcdcc113e70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000eb40 tx=0x7fcdc000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:44.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.971+0000 7fcdc8ff9700 1 -- 172.21.15.77:0/690078477 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdc0007cc0 con 0x7fcdcc1037c0 2024-04-25T02:14:44.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.971+0000 7fcdc8ff9700 1 -- 172.21.15.77:0/690078477 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcdc000f040 con 0x7fcdcc1037c0 2024-04-25T02:14:44.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.971+0000 7fcdc8ff9700 1 -- 172.21.15.77:0/690078477 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdc000c9d0 con 0x7fcdcc1037c0 2024-04-25T02:14:44.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.971+0000 7fcdd2633700 1 -- 172.21.15.77:0/690078477 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdcc10dd40 con 0x7fcdcc1037c0 2024-04-25T02:14:44.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.971+0000 7fcdd2633700 1 -- 172.21.15.77:0/690078477 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdcc10e280 con 0x7fcdcc1037c0 2024-04-25T02:14:44.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.972+0000 7fcdd2633700 1 -- 172.21.15.77:0/690078477 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdcc100160 con 0x7fcdcc1037c0 2024-04-25T02:14:44.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.972+0000 7fcdc8ff9700 1 -- 172.21.15.77:0/690078477 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fcdc000cc40 con 0x7fcdcc1037c0 2024-04-25T02:14:44.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.973+0000 7fcdc8ff9700 1 --2- 172.21.15.77:0/690078477 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fcdb406e270 0x7fcdb4070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:44.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.973+0000 7fcdc8ff9700 1 -- 172.21.15.77:0/690078477 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fcdc008d7b0 con 0x7fcdcc1037c0 2024-04-25T02:14:44.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.973+0000 7fcdcbfff700 1 --2- 172.21.15.77:0/690078477 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fcdb406e270 0x7fcdb4070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:44.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.973+0000 7fcdcbfff700 1 --2- 172.21.15.77:0/690078477 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fcdb406e270 0x7fcdb4070720 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc004890 tx=0x7fcdbc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:44.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:44.977+0000 7fcdc8ff9700 1 -- 172.21.15.77:0/690078477 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fcdc005a540 con 0x7fcdcc1037c0 2024-04-25T02:14:45.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.194+0000 7fcdd2633700 1 -- 172.21.15.77:0/690078477 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcdcc113600 con 0x7fcdb406e270 2024-04-25T02:14:45.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.195+0000 7fcdc8ff9700 1 -- 172.21.15.77:0/690078477 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fcdcc113600 con 0x7fcdb406e270 2024-04-25T02:14:45.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.197+0000 7fcdd2633700 1 -- 172.21.15.77:0/690078477 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fcdb406e270 msgr2=0x7fcdb4070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:45.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.197+0000 7fcdd2633700 1 --2- 172.21.15.77:0/690078477 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fcdb406e270 0x7fcdb4070720 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc004890 tx=0x7fcdbc009e30 comp rx=0 tx=0).stop 2024-04-25T02:14:45.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.197+0000 7fcdd2633700 1 -- 172.21.15.77:0/690078477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc1037c0 msgr2=0x7fcdcc113e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:45.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.197+0000 7fcdd2633700 1 --2- 172.21.15.77:0/690078477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc1037c0 0x7fcdcc113e70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000eb40 tx=0x7fcdc000b040 comp rx=0 tx=0).stop 2024-04-25T02:14:45.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.197+0000 7fcdd2633700 1 -- 172.21.15.77:0/690078477 shutdown_connections 2024-04-25T02:14:45.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.197+0000 7fcdd2633700 1 --2- 172.21.15.77:0/690078477 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fcdb406e270 0x7fcdb4070720 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:45.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.197+0000 7fcdd2633700 1 --2- 172.21.15.77:0/690078477 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcdcc102e20 0x7fcdcc113930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:45.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.197+0000 7fcdd2633700 1 --2- 172.21.15.77:0/690078477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc1037c0 0x7fcdcc113e70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:45.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.197+0000 7fcdd2633700 1 -- 172.21.15.77:0/690078477 >> 172.21.15.77:0/690078477 conn(0x7fcdcc072380 msgr2=0x7fcdcc0fac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:45.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.197+0000 7fcdd2633700 1 -- 172.21.15.77:0/690078477 shutdown_connections 2024-04-25T02:14:45.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.197+0000 7fcdd2633700 1 -- 172.21.15.77:0/690078477 wait complete. 2024-04-25T02:14:45.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:45 smithi077 ceph-mon[110441]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:14:45.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:45 smithi112 ceph-mon[80494]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:14:45.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.299+0000 7f0f39f82700 1 -- 172.21.15.77:0/2224167509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f340fde40 msgr2=0x7f0f340fe210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:45.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.299+0000 7f0f39f82700 1 --2- 172.21.15.77:0/2224167509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f340fde40 0x7f0f340fe210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0f24004940 tx=0x7f0f24009e30 comp rx=0 tx=0).stop 2024-04-25T02:14:45.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.299+0000 7f0f39f82700 1 -- 172.21.15.77:0/2224167509 shutdown_connections 2024-04-25T02:14:45.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.299+0000 7f0f39f82700 1 --2- 172.21.15.77:0/2224167509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f340fe7e0 0x7f0f34106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:45.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.299+0000 7f0f39f82700 1 --2- 172.21.15.77:0/2224167509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f340fde40 0x7f0f340fe210 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:45.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.299+0000 7f0f39f82700 1 -- 172.21.15.77:0/2224167509 >> 172.21.15.77:0/2224167509 conn(0x7f0f340f7850 msgr2=0x7f0f340f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:45.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.299+0000 7f0f39f82700 1 -- 172.21.15.77:0/2224167509 shutdown_connections 2024-04-25T02:14:45.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.300+0000 7f0f39f82700 1 -- 172.21.15.77:0/2224167509 wait complete. 2024-04-25T02:14:45.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.300+0000 7f0f39f82700 1 Processor -- start 2024-04-25T02:14:45.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.300+0000 7f0f39f82700 1 -- start start 2024-04-25T02:14:45.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.300+0000 7f0f39f82700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f340fde40 0x7f0f34113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:45.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.300+0000 7f0f39f82700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f340fe7e0 0x7f0f341140e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:45.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.300+0000 7f0f39f82700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f34114730 con 0x7f0f340fe7e0 2024-04-25T02:14:45.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.300+0000 7f0f39f82700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3410db20 con 0x7f0f340fde40 2024-04-25T02:14:45.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.301+0000 7f0f32ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f340fe7e0 0x7f0f341140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:45.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.301+0000 7f0f32ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f340fe7e0 0x7f0f341140e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45878/0 (socket says 172.21.15.77:45878) 2024-04-25T02:14:45.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.301+0000 7f0f32ffd700 1 -- 172.21.15.77:0/2071102402 learned_addr learned my addr 172.21.15.77:0/2071102402 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:14:45.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.301+0000 7f0f337fe700 1 --2- 172.21.15.77:0/2071102402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f340fde40 0x7f0f34113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:45.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.301+0000 7f0f32ffd700 1 -- 172.21.15.77:0/2071102402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f340fde40 msgr2=0x7f0f34113ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:45.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.301+0000 7f0f32ffd700 1 --2- 172.21.15.77:0/2071102402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f340fde40 0x7f0f34113ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:45.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.301+0000 7f0f32ffd700 1 -- 172.21.15.77:0/2071102402 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f24005040 con 0x7f0f340fe7e0 2024-04-25T02:14:45.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.301+0000 7f0f32ffd700 1 --2- 172.21.15.77:0/2071102402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f340fe7e0 0x7f0f341140e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0f28002a50 tx=0x7f0f280046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:45.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.301+0000 7f0f1bfff700 1 -- 172.21.15.77:0/2071102402 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f28007cc0 con 0x7f0f340fe7e0 2024-04-25T02:14:45.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.301+0000 7f0f39f82700 1 -- 172.21.15.77:0/2071102402 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f3410de00 con 0x7f0f340fe7e0 2024-04-25T02:14:45.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.301+0000 7f0f39f82700 1 -- 172.21.15.77:0/2071102402 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f3410e340 con 0x7f0f340fe7e0 2024-04-25T02:14:45.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.301+0000 7f0f1bfff700 1 -- 172.21.15.77:0/2071102402 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0f2800f040 con 0x7f0f340fe7e0 2024-04-25T02:14:45.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.301+0000 7f0f1bfff700 1 -- 172.21.15.77:0/2071102402 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f28009430 con 0x7f0f340fe7e0 2024-04-25T02:14:45.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.302+0000 7f0f39f82700 1 -- 172.21.15.77:0/2071102402 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f200052b0 con 0x7f0f340fe7e0 2024-04-25T02:14:45.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.303+0000 7f0f1bfff700 1 -- 172.21.15.77:0/2071102402 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f0f28009590 con 0x7f0f340fe7e0 2024-04-25T02:14:45.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.303+0000 7f0f1bfff700 1 --2- 172.21.15.77:0/2071102402 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f0f1c06e260 0x7f0f1c070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:45.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.303+0000 7f0f337fe700 1 --2- 172.21.15.77:0/2071102402 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f0f1c06e260 0x7f0f1c070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:45.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.303+0000 7f0f1bfff700 1 -- 172.21.15.77:0/2071102402 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f0f2808d2f0 con 0x7f0f340fe7e0 2024-04-25T02:14:45.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.304+0000 7f0f337fe700 1 --2- 172.21.15.77:0/2071102402 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f0f1c06e260 0x7f0f1c070710 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0f24004f90 tx=0x7f0f24009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:45.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.308+0000 7f0f1bfff700 1 -- 172.21.15.77:0/2071102402 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f0f28059fd0 con 0x7f0f340fe7e0 2024-04-25T02:14:45.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.517+0000 7f0f39f82700 1 -- 172.21.15.77:0/2071102402 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f20000bc0 con 0x7f0f1c06e260 2024-04-25T02:14:45.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.528+0000 7f0f1bfff700 1 -- 172.21.15.77:0/2071102402 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f0f20000bc0 con 0x7f0f1c06e260 2024-04-25T02:14:45.533 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T02:14:45.533 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (2m) 14s ago 13m 26.8M - 0.25.0 c8568f914cd2 699c7fd25ea5 2024-04-25T02:14:45.533 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (25s) 14s ago 14m 6660k - 19.0.0-2445-gd2c45d97 f68e37b807ef f3c45d31e2e3 2024-04-25T02:14:45.533 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi112 smithi112 running (20s) 16s ago 13m 6656k - 19.0.0-2445-gd2c45d97 f68e37b807ef e16d9899ed11 2024-04-25T02:14:45.533 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (2m) 14s ago 13m 77.0M - 9.4.12 2bacad6d85d8 900138b0bcf0 2024-04-25T02:14:45.533 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.gcfygj smithi077 running (8m) 14s ago 8m 15.7M - 17.2.7-902-gc61472c8 0de407c1b3af 382dd7abf674 2024-04-25T02:14:45.533 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.oadrkb smithi077 running (8m) 14s ago 8m 13.9M - 17.2.7-902-gc61472c8 0de407c1b3af 6992064a4b2a 2024-04-25T02:14:45.533 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.dvwudt smithi112 running (8m) 16s ago 8m 156M - 17.2.7-902-gc61472c8 0de407c1b3af 0792e451abfd 2024-04-25T02:14:45.533 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.fjnadi smithi112 running (8m) 16s ago 8m 15.2M - 17.2.7-902-gc61472c8 0de407c1b3af c8093f622f6b 2024-04-25T02:14:45.533 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.zpflzp smithi077 *:8443,9283,8765 running (4m) 14s ago 15m 495M - 19.0.0-2445-gd2c45d97 f68e37b807ef a1af92e027e5 2024-04-25T02:14:45.534 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi112.cswrxs smithi112 *:8443,9283,8765 running (3m) 16s ago 12m 448M - 19.0.0-2445-gd2c45d97 f68e37b807ef ccc7c57d35f2 2024-04-25T02:14:45.534 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (92s) 14s ago 15m 40.0M 2048M 19.0.0-2445-gd2c45d97 f68e37b807ef 06490c2ecc44 2024-04-25T02:14:45.534 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi112 smithi112 running (66s) 16s ago 12m 33.0M 2048M 19.0.0-2445-gd2c45d97 f68e37b807ef ccd1398acbc5 2024-04-25T02:14:45.534 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (3m) 14s ago 13m 16.9M - 1.5.0 0da6a335fe13 2320132606fc 2024-04-25T02:14:45.534 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi112 smithi112 *:9100 running (3m) 16s ago 12m 14.8M - 1.5.0 0da6a335fe13 49f285354791 2024-04-25T02:14:45.534 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (12m) 14s ago 12m 259M 1557M 17.2.7-902-gc61472c8 0de407c1b3af c741abec3b94 2024-04-25T02:14:45.534 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (11m) 14s ago 11m 260M 1557M 17.2.7-902-gc61472c8 0de407c1b3af 256ff3ced322 2024-04-25T02:14:45.534 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (11m) 14s ago 11m 223M 1557M 17.2.7-902-gc61472c8 0de407c1b3af c5d7d8c993f4 2024-04-25T02:14:45.534 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi112 running (10m) 16s ago 10m 292M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 68429d0dbf88 2024-04-25T02:14:45.534 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi112 running (10m) 16s ago 10m 261M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 66eb71201444 2024-04-25T02:14:45.534 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi112 running (9m) 16s ago 9m 240M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 963e700d6aea 2024-04-25T02:14:45.534 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (3m) 14s ago 13m 59.3M - 2.43.0 a07b618ecd1d c5b8c6104d96 2024-04-25T02:14:45.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.530+0000 7f0f39f82700 1 -- 172.21.15.77:0/2071102402 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f0f1c06e260 msgr2=0x7f0f1c070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:45.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.530+0000 7f0f39f82700 1 --2- 172.21.15.77:0/2071102402 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f0f1c06e260 0x7f0f1c070710 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0f24004f90 tx=0x7f0f24009e30 comp rx=0 tx=0).stop 2024-04-25T02:14:45.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.530+0000 7f0f39f82700 1 -- 172.21.15.77:0/2071102402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f340fe7e0 msgr2=0x7f0f341140e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:45.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.530+0000 7f0f39f82700 1 --2- 172.21.15.77:0/2071102402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f340fe7e0 0x7f0f341140e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0f28002a50 tx=0x7f0f280046b0 comp rx=0 tx=0).stop 2024-04-25T02:14:45.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.530+0000 7f0f39f82700 1 -- 172.21.15.77:0/2071102402 shutdown_connections 2024-04-25T02:14:45.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.530+0000 7f0f39f82700 1 --2- 172.21.15.77:0/2071102402 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f0f1c06e260 0x7f0f1c070710 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:45.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.530+0000 7f0f39f82700 1 --2- 172.21.15.77:0/2071102402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f340fde40 0x7f0f34113ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:45.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.530+0000 7f0f39f82700 1 --2- 172.21.15.77:0/2071102402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f340fe7e0 0x7f0f341140e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:45.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.530+0000 7f0f39f82700 1 -- 172.21.15.77:0/2071102402 >> 172.21.15.77:0/2071102402 conn(0x7f0f340f7850 msgr2=0x7f0f340f8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:45.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.530+0000 7f0f39f82700 1 -- 172.21.15.77:0/2071102402 shutdown_connections 2024-04-25T02:14:45.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.530+0000 7f0f39f82700 1 -- 172.21.15.77:0/2071102402 wait complete. 2024-04-25T02:14:45.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.632+0000 7f4cab428700 1 -- 172.21.15.77:0/4172858805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ca40fb7f0 msgr2=0x7f4ca40fbbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:45.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.632+0000 7f4cab428700 1 --2- 172.21.15.77:0/4172858805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ca40fb7f0 0x7f4ca40fbbc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0004940 tx=0x7f4ca0009e30 comp rx=0 tx=0).stop 2024-04-25T02:14:45.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.632+0000 7f4cab428700 1 -- 172.21.15.77:0/4172858805 shutdown_connections 2024-04-25T02:14:45.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.632+0000 7f4cab428700 1 --2- 172.21.15.77:0/4172858805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ca40fc190 0x7f4ca4101a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:45.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.632+0000 7f4cab428700 1 --2- 172.21.15.77:0/4172858805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ca40fb7f0 0x7f4ca40fbbc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:45.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.632+0000 7f4cab428700 1 -- 172.21.15.77:0/4172858805 >> 172.21.15.77:0/4172858805 conn(0x7f4ca4071460 msgr2=0x7f4ca4071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:45.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.632+0000 7f4cab428700 1 -- 172.21.15.77:0/4172858805 shutdown_connections 2024-04-25T02:14:45.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.632+0000 7f4cab428700 1 -- 172.21.15.77:0/4172858805 wait complete. 2024-04-25T02:14:45.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.633+0000 7f4cab428700 1 Processor -- start 2024-04-25T02:14:45.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.633+0000 7f4cab428700 1 -- start start 2024-04-25T02:14:45.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.633+0000 7f4cab428700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ca40fb7f0 0x7f4ca40fc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:45.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.633+0000 7f4cab428700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ca40fc190 0x7f4ca40fccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:45.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.633+0000 7f4cab428700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca40fe720 con 0x7f4ca40fc190 2024-04-25T02:14:45.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.633+0000 7f4cab428700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca40fd200 con 0x7f4ca40fb7f0 2024-04-25T02:14:45.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.633+0000 7f4ca89c3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ca40fc190 0x7f4ca40fccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:45.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.633+0000 7f4ca89c3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ca40fc190 0x7f4ca40fccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45908/0 (socket says 172.21.15.77:45908) 2024-04-25T02:14:45.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.633+0000 7f4ca89c3700 1 -- 172.21.15.77:0/3777729675 learned_addr learned my addr 172.21.15.77:0/3777729675 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:14:45.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.633+0000 7f4ca91c4700 1 --2- 172.21.15.77:0/3777729675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ca40fb7f0 0x7f4ca40fc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:45.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.633+0000 7f4ca89c3700 1 -- 172.21.15.77:0/3777729675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ca40fb7f0 msgr2=0x7f4ca40fc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:45.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.633+0000 7f4ca89c3700 1 --2- 172.21.15.77:0/3777729675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ca40fb7f0 0x7f4ca40fc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:45.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.633+0000 7f4ca89c3700 1 -- 172.21.15.77:0/3777729675 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca0005040 con 0x7f4ca40fc190 2024-04-25T02:14:45.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.634+0000 7f4ca89c3700 1 --2- 172.21.15.77:0/3777729675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ca40fc190 0x7f4ca40fccc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4c94009b80 tx=0x7f4c94004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:45.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.634+0000 7f4c99ffb700 1 -- 172.21.15.77:0/3777729675 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c94004e70 con 0x7f4ca40fc190 2024-04-25T02:14:45.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.634+0000 7f4c99ffb700 1 -- 172.21.15.77:0/3777729675 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4c9400f040 con 0x7f4ca40fc190 2024-04-25T02:14:45.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.634+0000 7f4c99ffb700 1 -- 172.21.15.77:0/3777729675 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c9400da60 con 0x7f4ca40fc190 2024-04-25T02:14:45.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.634+0000 7f4cab428700 1 -- 172.21.15.77:0/3777729675 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca40fd4b0 con 0x7f4ca40fc190 2024-04-25T02:14:45.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.634+0000 7f4cab428700 1 -- 172.21.15.77:0/3777729675 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca411a210 con 0x7f4ca40fc190 2024-04-25T02:14:45.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.635+0000 7f4c99ffb700 1 -- 172.21.15.77:0/3777729675 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f4c94007cc0 con 0x7f4ca40fc190 2024-04-25T02:14:45.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.635+0000 7f4cab428700 1 -- 172.21.15.77:0/3777729675 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca4065f30 con 0x7f4ca40fc190 2024-04-25T02:14:45.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.636+0000 7f4c99ffb700 1 --2- 172.21.15.77:0/3777729675 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f4c9006e270 0x7f4c90070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:45.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.636+0000 7f4ca91c4700 1 --2- 172.21.15.77:0/3777729675 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f4c9006e270 0x7f4c90070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:45.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.636+0000 7f4c99ffb700 1 -- 172.21.15.77:0/3777729675 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f4c9408d9b0 con 0x7f4ca40fc190 2024-04-25T02:14:45.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.637+0000 7f4ca91c4700 1 --2- 172.21.15.77:0/3777729675 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f4c9006e270 0x7f4c90070720 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0004f90 tx=0x7f4ca0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:45.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.641+0000 7f4c99ffb700 1 -- 172.21.15.77:0/3777729675 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f4c94056be0 con 0x7f4ca40fc190 2024-04-25T02:14:45.872 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:45 smithi077 podman[121573]: 2024-04-25 02:14:45.616585254 +0000 UTC m=+0.752824701 container remove 69404d55b6d0759373102c5b05397ff92977679ddb1402a2cd3a3b65689228e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0-activate, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-25T02:14:45.872 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:45 smithi077 podman[121704]: 2024-04-25 02:14:45.737679473 +0000 UTC m=+0.022374252 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:14:45.872 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:45 smithi077 podman[121704]: 2024-04-25 02:14:45.867688221 +0000 UTC m=+0.152382985 container create 7035e288ddaed293a9975987137a82ec2ac550646e4b02eb47041f5965db3bac (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-d2c45d9, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-25T02:14:45.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.942+0000 7f4cab428700 1 -- 172.21.15.77:0/3777729675 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4ca4109f90 con 0x7f4ca40fc190 2024-04-25T02:14:45.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.942+0000 7f4c99ffb700 1 -- 172.21.15.77:0/3777729675 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f4c9405a2a0 con 0x7f4ca40fc190 2024-04-25T02:14:45.947 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:14:45.947 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-04-25T02:14:45.948 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:14:45.948 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:14:45.948 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-04-25T02:14:45.948 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:14:45.948 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:14:45.948 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-04-25T02:14:45.948 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 5 2024-04-25T02:14:45.948 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:14:45.948 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-04-25T02:14:45.948 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T02:14:45.948 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:14:45.948 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-04-25T02:14:45.948 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 9, 2024-04-25T02:14:45.949 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 4 2024-04-25T02:14:45.949 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-25T02:14:45.949 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:14:45.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.944+0000 7f4cab428700 1 -- 172.21.15.77:0/3777729675 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f4c9006e270 msgr2=0x7f4c90070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:45.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.944+0000 7f4cab428700 1 --2- 172.21.15.77:0/3777729675 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f4c9006e270 0x7f4c90070720 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0004f90 tx=0x7f4ca0009e30 comp rx=0 tx=0).stop 2024-04-25T02:14:45.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.944+0000 7f4cab428700 1 -- 172.21.15.77:0/3777729675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ca40fc190 msgr2=0x7f4ca40fccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:45.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.944+0000 7f4cab428700 1 --2- 172.21.15.77:0/3777729675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ca40fc190 0x7f4ca40fccc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4c94009b80 tx=0x7f4c94004600 comp rx=0 tx=0).stop 2024-04-25T02:14:45.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.944+0000 7f4cab428700 1 -- 172.21.15.77:0/3777729675 shutdown_connections 2024-04-25T02:14:45.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.944+0000 7f4cab428700 1 --2- 172.21.15.77:0/3777729675 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f4c9006e270 0x7f4c90070720 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:45.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.944+0000 7f4cab428700 1 --2- 172.21.15.77:0/3777729675 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ca40fb7f0 0x7f4ca40fc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:45.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.944+0000 7f4cab428700 1 --2- 172.21.15.77:0/3777729675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ca40fc190 0x7f4ca40fccc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:45.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.944+0000 7f4cab428700 1 -- 172.21.15.77:0/3777729675 >> 172.21.15.77:0/3777729675 conn(0x7f4ca4071460 msgr2=0x7f4ca40f93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:45.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.944+0000 7f4cab428700 1 -- 172.21.15.77:0/3777729675 shutdown_connections 2024-04-25T02:14:45.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:45.944+0000 7f4cab428700 1 -- 172.21.15.77:0/3777729675 wait complete. 2024-04-25T02:14:46.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.048+0000 7f9dd16c1700 1 -- 172.21.15.77:0/2334667002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dcc101d90 msgr2=0x7f9dcc102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:46.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.048+0000 7f9dd16c1700 1 --2- 172.21.15.77:0/2334667002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dcc101d90 0x7f9dcc102160 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0004940 tx=0x7f9dc0009e30 comp rx=0 tx=0).stop 2024-04-25T02:14:46.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.048+0000 7f9dd16c1700 1 -- 172.21.15.77:0/2334667002 shutdown_connections 2024-04-25T02:14:46.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.048+0000 7f9dd16c1700 1 --2- 172.21.15.77:0/2334667002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dcc0fbd40 0x7f9dcc0fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:46.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.048+0000 7f9dd16c1700 1 --2- 172.21.15.77:0/2334667002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dcc101d90 0x7f9dcc102160 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:46.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.048+0000 7f9dd16c1700 1 -- 172.21.15.77:0/2334667002 >> 172.21.15.77:0/2334667002 conn(0x7f9dcc071d00 msgr2=0x7f9dcc072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:46.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.048+0000 7f9dd16c1700 1 -- 172.21.15.77:0/2334667002 shutdown_connections 2024-04-25T02:14:46.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.048+0000 7f9dd16c1700 1 -- 172.21.15.77:0/2334667002 wait complete. 2024-04-25T02:14:46.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.049+0000 7f9dd16c1700 1 Processor -- start 2024-04-25T02:14:46.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.049+0000 7f9dd16c1700 1 -- start start 2024-04-25T02:14:46.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.049+0000 7f9dd16c1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dcc0fbd40 0x7f9dcc10eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:46.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.049+0000 7f9dd16c1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dcc101d90 0x7f9dcc10f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:46.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.049+0000 7f9dd16c1700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc10f740 con 0x7f9dcc101d90 2024-04-25T02:14:46.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.049+0000 7f9dd16c1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc10f880 con 0x7f9dcc0fbd40 2024-04-25T02:14:46.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.049+0000 7f9dca7fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dcc101d90 0x7f9dcc10f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:46.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.050+0000 7f9dca7fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dcc101d90 0x7f9dcc10f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45936/0 (socket says 172.21.15.77:45936) 2024-04-25T02:14:46.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.050+0000 7f9dca7fc700 1 -- 172.21.15.77:0/1862634714 learned_addr learned my addr 172.21.15.77:0/1862634714 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:14:46.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.050+0000 7f9dcaffd700 1 --2- 172.21.15.77:0/1862634714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dcc0fbd40 0x7f9dcc10eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:46.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.050+0000 7f9dca7fc700 1 -- 172.21.15.77:0/1862634714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dcc0fbd40 msgr2=0x7f9dcc10eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:46.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.050+0000 7f9dca7fc700 1 --2- 172.21.15.77:0/1862634714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dcc0fbd40 0x7f9dcc10eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:46.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.050+0000 7f9dca7fc700 1 -- 172.21.15.77:0/1862634714 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc0005040 con 0x7f9dcc101d90 2024-04-25T02:14:46.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.050+0000 7f9dca7fc700 1 --2- 172.21.15.77:0/1862634714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dcc101d90 0x7f9dcc10f060 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00b790 tx=0x7f9dbc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:46.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.050+0000 7f9db37fe700 1 -- 172.21.15.77:0/1862634714 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dbc00f6f0 con 0x7f9dcc101d90 2024-04-25T02:14:46.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.050+0000 7f9db37fe700 1 -- 172.21.15.77:0/1862634714 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9dbc00fd20 con 0x7f9dcc101d90 2024-04-25T02:14:46.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.050+0000 7f9dd16c1700 1 -- 172.21.15.77:0/1862634714 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dcc117bf0 con 0x7f9dcc101d90 2024-04-25T02:14:46.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.050+0000 7f9dd16c1700 1 -- 172.21.15.77:0/1862634714 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dcc118180 con 0x7f9dcc101d90 2024-04-25T02:14:46.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.050+0000 7f9db37fe700 1 -- 172.21.15.77:0/1862634714 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dbc0103a0 con 0x7f9dcc101d90 2024-04-25T02:14:46.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.051+0000 7f9dd16c1700 1 -- 172.21.15.77:0/1862634714 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dcc0fd430 con 0x7f9dcc101d90 2024-04-25T02:14:46.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.052+0000 7f9db37fe700 1 -- 172.21.15.77:0/1862634714 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f9dbc011400 con 0x7f9dcc101d90 2024-04-25T02:14:46.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.052+0000 7f9db37fe700 1 --2- 172.21.15.77:0/1862634714 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f9db406e260 0x7f9db4070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:46.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.052+0000 7f9dcaffd700 1 --2- 172.21.15.77:0/1862634714 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f9db406e260 0x7f9db4070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:46.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.053+0000 7f9db37fe700 1 -- 172.21.15.77:0/1862634714 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f9dbc08da40 con 0x7f9dcc101d90 2024-04-25T02:14:46.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.053+0000 7f9dcaffd700 1 --2- 172.21.15.77:0/1862634714 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f9db406e260 0x7f9db4070710 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9dc000b3b0 tx=0x7f9dc0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:46.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.057+0000 7f9db37fe700 1 -- 172.21.15.77:0/1862634714 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f9dbc056d80 con 0x7f9dcc101d90 2024-04-25T02:14:46.124 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:46 smithi077 ceph-mon[110441]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:14:46.124 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:46 smithi077 ceph-mon[110441]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:14:46.124 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:46 smithi077 ceph-mon[110441]: pgmap v46: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-04-25T02:14:46.124 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:46 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/3777729675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:14:46.124 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:46 smithi077 podman[121704]: 2024-04-25 02:14:46.095675152 +0000 UTC m=+0.380369917 container init 7035e288ddaed293a9975987137a82ec2ac550646e4b02eb47041f5965db3bac (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0, GIT_BRANCH=HEAD, RELEASE=squid-d2c45d9, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-25T02:14:46.124 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:46 smithi077 podman[121704]: 2024-04-25 02:14:46.098687764 +0000 UTC m=+0.383382530 container start 7035e288ddaed293a9975987137a82ec2ac550646e4b02eb47041f5965db3bac (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:14:46.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:46 smithi112 ceph-mon[80494]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:14:46.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:46 smithi112 ceph-mon[80494]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:14:46.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:46 smithi112 ceph-mon[80494]: pgmap v46: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-04-25T02:14:46.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:46 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/3777729675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:14:46.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.309+0000 7f9dd16c1700 1 -- 172.21.15.77:0/1862634714 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9dcc04bed0 con 0x7f9dcc101d90 2024-04-25T02:14:46.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.310+0000 7f9db37fe700 1 -- 172.21.15.77:0/1862634714 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1876 (secure 0 0 0) 0x7f9dbc05a440 con 0x7f9dcc101d90 2024-04-25T02:14:46.315 INFO:teuthology.orchestra.run.smithi077.stdout:e15 2024-04-25T02:14:46.315 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T02:14:46.315 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:14:46.315 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-04-25T02:14:46.315 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:14:46.315 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-04-25T02:14:46.315 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-04-25T02:14:46.315 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 15 2024-04-25T02:14:46.316 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-25T02:14:46.316 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-04-25T02:06:10.008979+0000 2024-04-25T02:14:46.316 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-04-25T02:06:27.849984+0000 2024-04-25T02:14:46.316 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-04-25T02:14:46.316 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-04-25T02:14:46.316 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-04-25T02:14:46.316 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-04-25T02:14:46.316 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-04-25T02:14:46.316 INFO:teuthology.orchestra.run.smithi077.stdout:max_xattr_size 65536 2024-04-25T02:14:46.316 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-04-25T02:14:46.316 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-04-25T02:14:46.316 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 47 2024-04-25T02:14:46.316 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:14:46.316 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-04-25T02:14:46.316 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-04-25T02:14:46.317 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=24257} 2024-04-25T02:14:46.317 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-04-25T02:14:46.317 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-04-25T02:14:46.317 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-04-25T02:14:46.317 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-04-25T02:14:46.317 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-04-25T02:14:46.317 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-04-25T02:14:46.317 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-04-25T02:14:46.317 INFO:teuthology.orchestra.run.smithi077.stdout:bal_rank_mask -1 2024-04-25T02:14:46.317 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-04-25T02:14:46.317 INFO:teuthology.orchestra.run.smithi077.stdout:qdb_cluster leader: 0 members: 2024-04-25T02:14:46.317 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi112.dvwudt{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.112:6824/3687767796,v1:172.21.15.112:6825/3687767796] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:14:46.317 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:14:46.317 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:14:46.317 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-04-25T02:14:46.318 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:14:46.318 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.gcfygj{-1:14462} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/691698671,v1:172.21.15.77:6829/691698671] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:14:46.318 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.oadrkb{-1:14474} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.77:6826/26222645,v1:172.21.15.77:6827/26222645] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:14:46.318 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi112.fjnadi{-1:24269} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/2036319817,v1:172.21.15.112:6827/2036319817] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:14:46.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.312+0000 7f9dd16c1700 1 -- 172.21.15.77:0/1862634714 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f9db406e260 msgr2=0x7f9db4070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:46.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.312+0000 7f9dd16c1700 1 --2- 172.21.15.77:0/1862634714 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f9db406e260 0x7f9db4070710 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9dc000b3b0 tx=0x7f9dc0009e30 comp rx=0 tx=0).stop 2024-04-25T02:14:46.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.312+0000 7f9dd16c1700 1 -- 172.21.15.77:0/1862634714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dcc101d90 msgr2=0x7f9dcc10f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:46.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.312+0000 7f9dd16c1700 1 --2- 172.21.15.77:0/1862634714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dcc101d90 0x7f9dcc10f060 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00b790 tx=0x7f9dbc009250 comp rx=0 tx=0).stop 2024-04-25T02:14:46.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.312+0000 7f9dd16c1700 1 -- 172.21.15.77:0/1862634714 shutdown_connections 2024-04-25T02:14:46.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.312+0000 7f9dd16c1700 1 --2- 172.21.15.77:0/1862634714 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f9db406e260 0x7f9db4070710 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:46.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.312+0000 7f9dd16c1700 1 --2- 172.21.15.77:0/1862634714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9dcc0fbd40 0x7f9dcc10eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:46.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.312+0000 7f9dd16c1700 1 --2- 172.21.15.77:0/1862634714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dcc101d90 0x7f9dcc10f060 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:46.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.312+0000 7f9dd16c1700 1 -- 172.21.15.77:0/1862634714 >> 172.21.15.77:0/1862634714 conn(0x7f9dcc071d00 msgr2=0x7f9dcc0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:46.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.312+0000 7f9dd16c1700 1 -- 172.21.15.77:0/1862634714 shutdown_connections 2024-04-25T02:14:46.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.312+0000 7f9dd16c1700 1 -- 172.21.15.77:0/1862634714 wait complete. 2024-04-25T02:14:46.319 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 15 2024-04-25T02:14:46.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.422+0000 7fb756775700 1 -- 172.21.15.77:0/1171197862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb750102de0 msgr2=0x7fb7501031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:46.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.422+0000 7fb756775700 1 --2- 172.21.15.77:0/1171197862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb750102de0 0x7fb7501031b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb740004940 tx=0x7fb740009e30 comp rx=0 tx=0).stop 2024-04-25T02:14:46.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.422+0000 7fb756775700 1 -- 172.21.15.77:0/1171197862 shutdown_connections 2024-04-25T02:14:46.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.422+0000 7fb756775700 1 --2- 172.21.15.77:0/1171197862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb750103780 0x7fb7500fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:46.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.422+0000 7fb756775700 1 --2- 172.21.15.77:0/1171197862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb750102de0 0x7fb7501031b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:46.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.422+0000 7fb756775700 1 -- 172.21.15.77:0/1171197862 >> 172.21.15.77:0/1171197862 conn(0x7fb7500f8950 msgr2=0x7fb7500fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:46.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.422+0000 7fb756775700 1 -- 172.21.15.77:0/1171197862 shutdown_connections 2024-04-25T02:14:46.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.422+0000 7fb756775700 1 -- 172.21.15.77:0/1171197862 wait complete. 2024-04-25T02:14:46.428 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:46 smithi077 ceph-osd[121746]: -- 172.21.15.77:0/3001115967 <== mon.0 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a5af4e7680 con 0x55a5af4b1000 2024-04-25T02:14:46.428 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:46 smithi077 bash[121704]: 7035e288ddaed293a9975987137a82ec2ac550646e4b02eb47041f5965db3bac 2024-04-25T02:14:46.429 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:46 smithi077 systemd[1]: Started Ceph osd.0 for 4bb93d82-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:14:46.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.423+0000 7fb756775700 1 Processor -- start 2024-04-25T02:14:46.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.423+0000 7fb756775700 1 -- start start 2024-04-25T02:14:46.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.423+0000 7fb756775700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb750102de0 0x7fb750070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:46.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.423+0000 7fb756775700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb750103780 0x7fb7500707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:46.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.423+0000 7fb756775700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb750070d30 con 0x7fb750102de0 2024-04-25T02:14:46.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.423+0000 7fb756775700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb750070e70 con 0x7fb750103780 2024-04-25T02:14:46.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.423+0000 7fb74ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb750102de0 0x7fb750070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:46.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.423+0000 7fb74ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb750102de0 0x7fb750070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45962/0 (socket says 172.21.15.77:45962) 2024-04-25T02:14:46.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.423+0000 7fb74ffff700 1 -- 172.21.15.77:0/2871211687 learned_addr learned my addr 172.21.15.77:0/2871211687 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:14:46.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.423+0000 7fb74f7fe700 1 --2- 172.21.15.77:0/2871211687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb750103780 0x7fb7500707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:46.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.423+0000 7fb74ffff700 1 -- 172.21.15.77:0/2871211687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb750103780 msgr2=0x7fb7500707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:46.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.423+0000 7fb74ffff700 1 --2- 172.21.15.77:0/2871211687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb750103780 0x7fb7500707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:46.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.424+0000 7fb74ffff700 1 -- 172.21.15.77:0/2871211687 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb740005040 con 0x7fb750102de0 2024-04-25T02:14:46.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.424+0000 7fb74f7fe700 1 --2- 172.21.15.77:0/2871211687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb750103780 0x7fb7500707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:14:46.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.424+0000 7fb74ffff700 1 --2- 172.21.15.77:0/2871211687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb750102de0 0x7fb750070260 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb740009b30 tx=0x7fb740009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:46.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.424+0000 7fb74cff9700 1 -- 172.21.15.77:0/2871211687 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb74000e070 con 0x7fb750102de0 2024-04-25T02:14:46.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.424+0000 7fb74cff9700 1 -- 172.21.15.77:0/2871211687 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb740013cd0 con 0x7fb750102de0 2024-04-25T02:14:46.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.424+0000 7fb74cff9700 1 -- 172.21.15.77:0/2871211687 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb74000b630 con 0x7fb750102de0 2024-04-25T02:14:46.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.424+0000 7fb756775700 1 -- 172.21.15.77:0/2871211687 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7500710c0 con 0x7fb750102de0 2024-04-25T02:14:46.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.424+0000 7fb756775700 1 -- 172.21.15.77:0/2871211687 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb75011a100 con 0x7fb750102de0 2024-04-25T02:14:46.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.425+0000 7fb756775700 1 -- 172.21.15.77:0/2871211687 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7501000f0 con 0x7fb750102de0 2024-04-25T02:14:46.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.426+0000 7fb74cff9700 1 -- 172.21.15.77:0/2871211687 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fb74001c400 con 0x7fb750102de0 2024-04-25T02:14:46.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.426+0000 7fb74cff9700 1 --2- 172.21.15.77:0/2871211687 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb73806e260 0x7fb738070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:46.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.426+0000 7fb74cff9700 1 -- 172.21.15.77:0/2871211687 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb74008f6c0 con 0x7fb750102de0 2024-04-25T02:14:46.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.426+0000 7fb74f7fe700 1 --2- 172.21.15.77:0/2871211687 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb73806e260 0x7fb738070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:46.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.427+0000 7fb74f7fe700 1 --2- 172.21.15.77:0/2871211687 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb73806e260 0x7fb738070710 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb744004600 tx=0x7fb74400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:46.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.431+0000 7fb74cff9700 1 -- 172.21.15.77:0/2871211687 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fb740058990 con 0x7fb750102de0 2024-04-25T02:14:46.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.659+0000 7fb756775700 1 -- 172.21.15.77:0/2871211687 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb75004bed0 con 0x7fb73806e260 2024-04-25T02:14:46.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.661+0000 7fb74cff9700 1 -- 172.21.15.77:0/2871211687 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb75004bed0 con 0x7fb73806e260 2024-04-25T02:14:46.666 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:14:46.666 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901", 2024-04-25T02:14:46.666 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-04-25T02:14:46.666 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T02:14:46.666 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-04-25T02:14:46.666 INFO:teuthology.orchestra.run.smithi077.stdout: "mon", 2024-04-25T02:14:46.666 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr", 2024-04-25T02:14:46.666 INFO:teuthology.orchestra.run.smithi077.stdout: "crash" 2024-04-25T02:14:46.666 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-25T02:14:46.666 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "6/21 daemons upgraded", 2024-04-25T02:14:46.666 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading osd daemons", 2024-04-25T02:14:46.667 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-04-25T02:14:46.667 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:14:46.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.663+0000 7fb756775700 1 -- 172.21.15.77:0/2871211687 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb73806e260 msgr2=0x7fb738070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:46.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.663+0000 7fb756775700 1 --2- 172.21.15.77:0/2871211687 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb73806e260 0x7fb738070710 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb744004600 tx=0x7fb74400b040 comp rx=0 tx=0).stop 2024-04-25T02:14:46.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.663+0000 7fb756775700 1 -- 172.21.15.77:0/2871211687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb750102de0 msgr2=0x7fb750070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:46.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.663+0000 7fb756775700 1 --2- 172.21.15.77:0/2871211687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb750102de0 0x7fb750070260 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb740009b30 tx=0x7fb740009e30 comp rx=0 tx=0).stop 2024-04-25T02:14:46.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.663+0000 7fb756775700 1 -- 172.21.15.77:0/2871211687 shutdown_connections 2024-04-25T02:14:46.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.663+0000 7fb756775700 1 --2- 172.21.15.77:0/2871211687 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb73806e260 0x7fb738070710 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:46.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.663+0000 7fb756775700 1 --2- 172.21.15.77:0/2871211687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb750102de0 0x7fb750070260 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:46.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.663+0000 7fb756775700 1 --2- 172.21.15.77:0/2871211687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb750103780 0x7fb7500707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:46.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.663+0000 7fb756775700 1 -- 172.21.15.77:0/2871211687 >> 172.21.15.77:0/2871211687 conn(0x7fb7500f8950 msgr2=0x7fb750107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:46.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.663+0000 7fb756775700 1 -- 172.21.15.77:0/2871211687 shutdown_connections 2024-04-25T02:14:46.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.663+0000 7fb756775700 1 -- 172.21.15.77:0/2871211687 wait complete. 2024-04-25T02:14:46.728 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:46 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0[121722]: 2024-04-25T02:14:46.644+0000 7f35c36567c0 -1 Falling back to public interface 2024-04-25T02:14:46.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.774+0000 7f3ef51e2700 1 -- 172.21.15.77:0/2540166487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ef0101d90 msgr2=0x7f3ef0102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:46.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.774+0000 7f3ef51e2700 1 --2- 172.21.15.77:0/2540166487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ef0101d90 0x7f3ef0102160 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0004940 tx=0x7f3ee0009e30 comp rx=0 tx=0).stop 2024-04-25T02:14:46.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.775+0000 7f3ef51e2700 1 -- 172.21.15.77:0/2540166487 shutdown_connections 2024-04-25T02:14:46.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.775+0000 7f3ef51e2700 1 --2- 172.21.15.77:0/2540166487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ef00fbd40 0x7f3ef00fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:46.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.775+0000 7f3ef51e2700 1 --2- 172.21.15.77:0/2540166487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ef0101d90 0x7f3ef0102160 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:46.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.775+0000 7f3ef51e2700 1 -- 172.21.15.77:0/2540166487 >> 172.21.15.77:0/2540166487 conn(0x7f3ef0071d00 msgr2=0x7f3ef0072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:46.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.775+0000 7f3ef51e2700 1 -- 172.21.15.77:0/2540166487 shutdown_connections 2024-04-25T02:14:46.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.775+0000 7f3ef51e2700 1 -- 172.21.15.77:0/2540166487 wait complete. 2024-04-25T02:14:46.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.775+0000 7f3ef51e2700 1 Processor -- start 2024-04-25T02:14:46.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.775+0000 7f3ef51e2700 1 -- start start 2024-04-25T02:14:46.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.775+0000 7f3ef51e2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ef00fbd40 0x7f3ef010c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:46.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.775+0000 7f3ef51e2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ef0101d90 0x7f3ef010ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:46.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.776+0000 7f3ef51e2700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef010d380 con 0x7f3ef0101d90 2024-04-25T02:14:46.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.776+0000 7f3ef51e2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef010d4f0 con 0x7f3ef00fbd40 2024-04-25T02:14:46.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.776+0000 7f3eee59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ef0101d90 0x7f3ef010ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:46.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.776+0000 7f3eee59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ef0101d90 0x7f3ef010ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45982/0 (socket says 172.21.15.77:45982) 2024-04-25T02:14:46.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.776+0000 7f3eee59c700 1 -- 172.21.15.77:0/1083579135 learned_addr learned my addr 172.21.15.77:0/1083579135 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:14:46.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.776+0000 7f3eeed9d700 1 --2- 172.21.15.77:0/1083579135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ef00fbd40 0x7f3ef010c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:46.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.776+0000 7f3eee59c700 1 -- 172.21.15.77:0/1083579135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ef00fbd40 msgr2=0x7f3ef010c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:46.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.776+0000 7f3eee59c700 1 --2- 172.21.15.77:0/1083579135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ef00fbd40 0x7f3ef010c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:46.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.776+0000 7f3eee59c700 1 -- 172.21.15.77:0/1083579135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee0005040 con 0x7f3ef0101d90 2024-04-25T02:14:46.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.776+0000 7f3eee59c700 1 --2- 172.21.15.77:0/1083579135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ef0101d90 0x7f3ef010ce40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3ee400c810 tx=0x7f3ee4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:46.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.776+0000 7f3ed77fe700 1 -- 172.21.15.77:0/1083579135 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ee4012810 con 0x7f3ef0101d90 2024-04-25T02:14:46.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.776+0000 7f3ef51e2700 1 -- 172.21.15.77:0/1083579135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef0119f70 con 0x7f3ef0101d90 2024-04-25T02:14:46.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.776+0000 7f3ed77fe700 1 -- 172.21.15.77:0/1083579135 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ee4012e40 con 0x7f3ef0101d90 2024-04-25T02:14:46.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.776+0000 7f3ed77fe700 1 -- 172.21.15.77:0/1083579135 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ee40102e0 con 0x7f3ef0101d90 2024-04-25T02:14:46.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.776+0000 7f3ef51e2700 1 -- 172.21.15.77:0/1083579135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef011a340 con 0x7f3ef0101d90 2024-04-25T02:14:46.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.778+0000 7f3ef51e2700 1 -- 172.21.15.77:0/1083579135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef00fd430 con 0x7f3ef0101d90 2024-04-25T02:14:46.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.778+0000 7f3ed77fe700 1 -- 172.21.15.77:0/1083579135 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f3ee4010550 con 0x7f3ef0101d90 2024-04-25T02:14:46.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.778+0000 7f3ed77fe700 1 --2- 172.21.15.77:0/1083579135 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f3ed806e260 0x7f3ed8070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:14:46.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.778+0000 7f3ed77fe700 1 -- 172.21.15.77:0/1083579135 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f3ee408ded0 con 0x7f3ef0101d90 2024-04-25T02:14:46.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.778+0000 7f3eeed9d700 1 --2- 172.21.15.77:0/1083579135 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f3ed806e260 0x7f3ed8070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:14:46.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.779+0000 7f3eeed9d700 1 --2- 172.21.15.77:0/1083579135 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f3ed806e260 0x7f3ed8070710 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3ee000b8b0 tx=0x7f3ee0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:14:46.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:46.783+0000 7f3ed77fe700 1 -- 172.21.15.77:0/1083579135 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f3ee405ad40 con 0x7f3ef0101d90 2024-04-25T02:14:47.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:47.077+0000 7f3ef51e2700 1 -- 172.21.15.77:0/1083579135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3ef005f5c0 con 0x7f3ef0101d90 2024-04-25T02:14:47.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:47.078+0000 7f3ed77fe700 1 -- 172.21.15.77:0/1083579135 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1216 (secure 0 0 0) 0x7f3ee40164d0 con 0x7f3ef0101d90 2024-04-25T02:14:47.084 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:47 smithi077 ceph-mon[110441]: Health check failed: Degraded data redundancy: 43/219 objects degraded (19.635%), 17 pgs degraded (PG_DEGRADED) 2024-04-25T02:14:47.084 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:47 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:47.084 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:47 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:47.084 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:47 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:14:47.084 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:47 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/1862634714' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:14:47.084 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:47 smithi077 ceph-mon[110441]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:14:47.084 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 43/219 objects degraded (19.635%), 17 pgs degraded 2024-04-25T02:14:47.084 INFO:teuthology.orchestra.run.smithi077.stdout:[WRN] OSD_DOWN: 1 osds down 2024-04-25T02:14:47.084 INFO:teuthology.orchestra.run.smithi077.stdout: osd.0 (root=default,host=smithi077) is down 2024-04-25T02:14:47.084 INFO:teuthology.orchestra.run.smithi077.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 43/219 objects degraded (19.635%), 17 pgs degraded 2024-04-25T02:14:47.084 INFO:teuthology.orchestra.run.smithi077.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-04-25T02:14:47.085 INFO:teuthology.orchestra.run.smithi077.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-04-25T02:14:47.085 INFO:teuthology.orchestra.run.smithi077.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-04-25T02:14:47.085 INFO:teuthology.orchestra.run.smithi077.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-04-25T02:14:47.085 INFO:teuthology.orchestra.run.smithi077.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-04-25T02:14:47.085 INFO:teuthology.orchestra.run.smithi077.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-04-25T02:14:47.085 INFO:teuthology.orchestra.run.smithi077.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-04-25T02:14:47.085 INFO:teuthology.orchestra.run.smithi077.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-04-25T02:14:47.085 INFO:teuthology.orchestra.run.smithi077.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-04-25T02:14:47.085 INFO:teuthology.orchestra.run.smithi077.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-04-25T02:14:47.085 INFO:teuthology.orchestra.run.smithi077.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-04-25T02:14:47.085 INFO:teuthology.orchestra.run.smithi077.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-04-25T02:14:47.085 INFO:teuthology.orchestra.run.smithi077.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-04-25T02:14:47.085 INFO:teuthology.orchestra.run.smithi077.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-04-25T02:14:47.085 INFO:teuthology.orchestra.run.smithi077.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-04-25T02:14:47.085 INFO:teuthology.orchestra.run.smithi077.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-04-25T02:14:47.085 INFO:teuthology.orchestra.run.smithi077.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-04-25T02:14:47.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:47.080+0000 7f3ef51e2700 1 -- 172.21.15.77:0/1083579135 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f3ed806e260 msgr2=0x7f3ed8070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:47.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:47.080+0000 7f3ef51e2700 1 --2- 172.21.15.77:0/1083579135 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f3ed806e260 0x7f3ed8070710 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3ee000b8b0 tx=0x7f3ee0009e30 comp rx=0 tx=0).stop 2024-04-25T02:14:47.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:47.080+0000 7f3ef51e2700 1 -- 172.21.15.77:0/1083579135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ef0101d90 msgr2=0x7f3ef010ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:14:47.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:47.080+0000 7f3ef51e2700 1 --2- 172.21.15.77:0/1083579135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ef0101d90 0x7f3ef010ce40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3ee400c810 tx=0x7f3ee4004470 comp rx=0 tx=0).stop 2024-04-25T02:14:47.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:47.080+0000 7f3ef51e2700 1 -- 172.21.15.77:0/1083579135 shutdown_connections 2024-04-25T02:14:47.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:47.080+0000 7f3ef51e2700 1 --2- 172.21.15.77:0/1083579135 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f3ed806e260 0x7f3ed8070710 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:47.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:47.080+0000 7f3ef51e2700 1 --2- 172.21.15.77:0/1083579135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ef00fbd40 0x7f3ef010c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:47.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:47.080+0000 7f3ef51e2700 1 --2- 172.21.15.77:0/1083579135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ef0101d90 0x7f3ef010ce40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:14:47.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:47.080+0000 7f3ef51e2700 1 -- 172.21.15.77:0/1083579135 >> 172.21.15.77:0/1083579135 conn(0x7f3ef0071d00 msgr2=0x7f3ef00fa100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:14:47.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:47.080+0000 7f3ef51e2700 1 -- 172.21.15.77:0/1083579135 shutdown_connections 2024-04-25T02:14:47.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:14:47.080+0000 7f3ef51e2700 1 -- 172.21.15.77:0/1083579135 wait complete. 2024-04-25T02:14:47.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:47 smithi112 ceph-mon[80494]: Health check failed: Degraded data redundancy: 43/219 objects degraded (19.635%), 17 pgs degraded (PG_DEGRADED) 2024-04-25T02:14:47.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:47 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:47.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:47 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:47.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:47 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:14:47.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:47 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/1862634714' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:14:47.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:47 smithi112 ceph-mon[80494]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:14:48.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:48 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/1083579135' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T02:14:48.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:48 smithi077 ceph-mon[110441]: pgmap v47: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-04-25T02:14:48.445 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:48 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/1083579135' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T02:14:48.445 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:48 smithi112 ceph-mon[80494]: pgmap v47: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-04-25T02:14:51.081 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:50 smithi077 ceph-mon[110441]: pgmap v48: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-04-25T02:14:51.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:50 smithi112 ceph-mon[80494]: pgmap v48: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-04-25T02:14:51.978 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:51 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0[121722]: 2024-04-25T02:14:51.686+0000 7f35c36567c0 -1 osd.0 50 log_to_monitors true 2024-04-25T02:14:52.978 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:14:52 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0[121722]: 2024-04-25T02:14:52.699+0000 7f35b4aae700 -1 osd.0 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:14:52.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:52 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:52.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:52 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:52.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:52 smithi077 ceph-mon[110441]: from='osd.0 [v2:172.21.15.77:6802/1934093025,v1:172.21.15.77:6803/1934093025]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-25T02:14:52.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:52 smithi077 ceph-mon[110441]: pgmap v49: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-04-25T02:14:53.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:52 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:53.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:52 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:53.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:52 smithi112 ceph-mon[80494]: from='osd.0 [v2:172.21.15.77:6802/1934093025,v1:172.21.15.77:6803/1934093025]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-25T02:14:53.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:52 smithi112 ceph-mon[80494]: pgmap v49: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-04-25T02:14:53.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:53 smithi077 ceph-mon[110441]: from='osd.0 [v2:172.21.15.77:6802/1934093025,v1:172.21.15.77:6803/1934093025]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-25T02:14:53.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:53 smithi077 ceph-mon[110441]: osdmap e53: 6 total, 5 up, 6 in 2024-04-25T02:14:53.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:53 smithi077 ceph-mon[110441]: from='osd.0 [v2:172.21.15.77:6802/1934093025,v1:172.21.15.77:6803/1934093025]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-04-25T02:14:53.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:53 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:53.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:53 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:54.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:53 smithi112 ceph-mon[80494]: from='osd.0 [v2:172.21.15.77:6802/1934093025,v1:172.21.15.77:6803/1934093025]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-25T02:14:54.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:53 smithi112 ceph-mon[80494]: osdmap e53: 6 total, 5 up, 6 in 2024-04-25T02:14:54.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:53 smithi112 ceph-mon[80494]: from='osd.0 [v2:172.21.15.77:6802/1934093025,v1:172.21.15.77:6803/1934093025]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-04-25T02:14:54.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:53 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:54.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:53 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:54.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:54 smithi077 ceph-mon[110441]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-25T02:14:54.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:54 smithi077 ceph-mon[110441]: osd.0 [v2:172.21.15.77:6802/1934093025,v1:172.21.15.77:6803/1934093025] boot 2024-04-25T02:14:54.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:54 smithi077 ceph-mon[110441]: osdmap e54: 6 total, 6 up, 6 in 2024-04-25T02:14:54.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:54 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:14:54.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:54 smithi077 ceph-mon[110441]: pgmap v52: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-04-25T02:14:54.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:54 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:54.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:54 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:14:54.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:54 smithi077 ceph-mon[110441]: osdmap e55: 6 total, 6 up, 6 in 2024-04-25T02:14:55.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:54 smithi112 ceph-mon[80494]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-25T02:14:55.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:54 smithi112 ceph-mon[80494]: osd.0 [v2:172.21.15.77:6802/1934093025,v1:172.21.15.77:6803/1934093025] boot 2024-04-25T02:14:55.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:54 smithi112 ceph-mon[80494]: osdmap e54: 6 total, 6 up, 6 in 2024-04-25T02:14:55.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:54 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:14:55.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:54 smithi112 ceph-mon[80494]: pgmap v52: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-04-25T02:14:55.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:54 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:55.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:54 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:14:55.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:54 smithi112 ceph-mon[80494]: osdmap e55: 6 total, 6 up, 6 in 2024-04-25T02:14:57.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:56 smithi077 ceph-mon[110441]: pgmap v54: 65 pgs: 1 activating, 2 active+undersized+degraded, 7 active+undersized, 55 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s; 5/219 objects degraded (2.283%) 2024-04-25T02:14:57.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:56 smithi077 ceph-mon[110441]: mgrmap e40: smithi077.zpflzp(active, since 92s), standbys: smithi112.cswrxs 2024-04-25T02:14:57.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:56 smithi077 ceph-mon[110441]: Health check update: Degraded data redundancy: 5/219 objects degraded (2.283%), 2 pgs degraded (PG_DEGRADED) 2024-04-25T02:14:57.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:56 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:57.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:56 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:57.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:56 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:57.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:56 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:14:57.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:56 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:57.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:56 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:14:57.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:56 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:14:57.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:56 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:14:57.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:56 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:14:57.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:56 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-25T02:14:57.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:56 smithi112 ceph-mon[80494]: pgmap v54: 65 pgs: 1 activating, 2 active+undersized+degraded, 7 active+undersized, 55 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s; 5/219 objects degraded (2.283%) 2024-04-25T02:14:57.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:56 smithi112 ceph-mon[80494]: mgrmap e40: smithi077.zpflzp(active, since 92s), standbys: smithi112.cswrxs 2024-04-25T02:14:57.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:56 smithi112 ceph-mon[80494]: Health check update: Degraded data redundancy: 5/219 objects degraded (2.283%), 2 pgs degraded (PG_DEGRADED) 2024-04-25T02:14:57.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:56 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:57.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:56 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:57.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:56 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:57.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:56 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:14:57.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:56 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:14:57.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:56 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:14:57.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:56 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:14:57.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:56 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:14:57.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:56 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:14:57.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:56 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-25T02:14:58.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:57 smithi077 ceph-mon[110441]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-25T02:14:58.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:57 smithi077 ceph-mon[110441]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2024-04-25T02:14:58.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:57 smithi112 ceph-mon[80494]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-25T02:14:58.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:57 smithi112 ceph-mon[80494]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2024-04-25T02:14:59.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:58 smithi077 ceph-mon[110441]: pgmap v55: 65 pgs: 1 activating, 64 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-25T02:14:59.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:58 smithi077 ceph-mon[110441]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/219 objects degraded (2.283%), 2 pgs degraded) 2024-04-25T02:14:59.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:14:58 smithi077 ceph-mon[110441]: Cluster is now healthy 2024-04-25T02:14:59.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:58 smithi112 ceph-mon[80494]: pgmap v55: 65 pgs: 1 activating, 64 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-25T02:14:59.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:58 smithi112 ceph-mon[80494]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/219 objects degraded (2.283%), 2 pgs degraded) 2024-04-25T02:14:59.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:14:58 smithi112 ceph-mon[80494]: Cluster is now healthy 2024-04-25T02:15:01.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:00 smithi077 ceph-mon[110441]: pgmap v56: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 435 B/s wr, 0 op/s 2024-04-25T02:15:01.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:00 smithi112 ceph-mon[80494]: pgmap v56: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 435 B/s wr, 0 op/s 2024-04-25T02:15:03.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:02 smithi077 ceph-mon[110441]: pgmap v57: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 381 B/s wr, 0 op/s 2024-04-25T02:15:03.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:02 smithi112 ceph-mon[80494]: pgmap v57: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 381 B/s wr, 0 op/s 2024-04-25T02:15:05.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:04 smithi077 ceph-mon[110441]: pgmap v58: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 307 B/s wr, 0 op/s 2024-04-25T02:15:05.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:04 smithi112 ceph-mon[80494]: pgmap v58: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 307 B/s wr, 0 op/s 2024-04-25T02:15:07.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:06 smithi077 ceph-mon[110441]: pgmap v59: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 278 B/s wr, 0 op/s 2024-04-25T02:15:07.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:06 smithi112 ceph-mon[80494]: pgmap v59: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 278 B/s wr, 0 op/s 2024-04-25T02:15:09.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:08 smithi077 ceph-mon[110441]: pgmap v60: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:15:09.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:09.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:15:09.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:09.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:08 smithi112 ceph-mon[80494]: pgmap v60: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:15:09.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:09.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:15:09.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:11.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:10 smithi077 ceph-mon[110441]: pgmap v61: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:15:11.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:10 smithi112 ceph-mon[80494]: pgmap v61: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:15:12.082 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:11 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-25T02:15:12.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:11 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-25T02:15:13.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:12 smithi077 ceph-mon[110441]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-25T02:15:13.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:12 smithi077 ceph-mon[110441]: Upgrade: osd.1 is safe to restart 2024-04-25T02:15:13.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:12 smithi077 ceph-mon[110441]: pgmap v62: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:15:13.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:12 smithi112 ceph-mon[80494]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-25T02:15:13.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:12 smithi112 ceph-mon[80494]: Upgrade: osd.1 is safe to restart 2024-04-25T02:15:13.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:12 smithi112 ceph-mon[80494]: pgmap v62: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:15:14.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:14 smithi077 ceph-mon[110441]: Upgrade: Updating osd.1 2024-04-25T02:15:14.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:14 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:14.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:14 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-25T02:15:14.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:14 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:15:14.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:14 smithi077 ceph-mon[110441]: Deploying daemon osd.1 on smithi077 2024-04-25T02:15:14.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:14 smithi077 ceph-mon[110441]: pgmap v63: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:15:14.528 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:14 smithi112 ceph-mon[80494]: Upgrade: Updating osd.1 2024-04-25T02:15:14.528 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:14 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:14.528 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:14 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-25T02:15:14.528 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:14 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:15:14.528 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:14 smithi112 ceph-mon[80494]: Deploying daemon osd.1 on smithi077 2024-04-25T02:15:14.528 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:14 smithi112 ceph-mon[80494]: pgmap v63: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:15:16.478 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:16 smithi077 systemd[1]: Stopping Ceph osd.1 for 4bb93d82-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:15:16.478 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:16 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1[53044]: 2024-04-25T02:15:16.387+0000 7fdafa303700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:15:16.478 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:16 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1[53044]: 2024-04-25T02:15:16.387+0000 7fdafa303700 -1 osd.1 55 *** Got signal Terminated *** 2024-04-25T02:15:16.479 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:16 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1[53044]: 2024-04-25T02:15:16.387+0000 7fdafa303700 -1 osd.1 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T02:15:17.194 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:16 smithi077 ceph-mon[110441]: pgmap v64: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:15:17.194 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:16 smithi077 ceph-mon[110441]: osd.1 marked itself down and dead 2024-04-25T02:15:17.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.188+0000 7fda679d8700 1 -- 172.21.15.77:0/1097673075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda600fbd40 msgr2=0x7fda600fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:17.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.188+0000 7fda679d8700 1 --2- 172.21.15.77:0/1097673075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda600fbd40 0x7fda600fc1b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fda5c004940 tx=0x7fda5c009e30 comp rx=0 tx=0).stop 2024-04-25T02:15:17.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.188+0000 7fda679d8700 1 -- 172.21.15.77:0/1097673075 shutdown_connections 2024-04-25T02:15:17.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.188+0000 7fda679d8700 1 --2- 172.21.15.77:0/1097673075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda600fbd40 0x7fda600fc1b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:17.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.188+0000 7fda679d8700 1 --2- 172.21.15.77:0/1097673075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda60101d90 0x7fda60102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:17.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.188+0000 7fda679d8700 1 -- 172.21.15.77:0/1097673075 >> 172.21.15.77:0/1097673075 conn(0x7fda60071d00 msgr2=0x7fda60072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:17.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.188+0000 7fda679d8700 1 -- 172.21.15.77:0/1097673075 shutdown_connections 2024-04-25T02:15:17.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.188+0000 7fda679d8700 1 -- 172.21.15.77:0/1097673075 wait complete. 2024-04-25T02:15:17.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.189+0000 7fda679d8700 1 Processor -- start 2024-04-25T02:15:17.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.189+0000 7fda679d8700 1 -- start start 2024-04-25T02:15:17.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.189+0000 7fda679d8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda600fbd40 0x7fda60112ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:17.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.189+0000 7fda679d8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda60101d90 0x7fda60112ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:17.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.189+0000 7fda679d8700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda60113640 con 0x7fda600fbd40 2024-04-25T02:15:17.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.189+0000 7fda679d8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6010ca30 con 0x7fda60101d90 2024-04-25T02:15:17.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.189+0000 7fda65774700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda600fbd40 0x7fda60112ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:17.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.189+0000 7fda65774700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda600fbd40 0x7fda60112ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60720/0 (socket says 172.21.15.77:60720) 2024-04-25T02:15:17.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.189+0000 7fda65774700 1 -- 172.21.15.77:0/501162357 learned_addr learned my addr 172.21.15.77:0/501162357 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:15:17.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.189+0000 7fda64f73700 1 --2- 172.21.15.77:0/501162357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda60101d90 0x7fda60112ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:17.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.189+0000 7fda65774700 1 -- 172.21.15.77:0/501162357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda60101d90 msgr2=0x7fda60112ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:17.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.189+0000 7fda65774700 1 --2- 172.21.15.77:0/501162357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda60101d90 0x7fda60112ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:17.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.189+0000 7fda65774700 1 -- 172.21.15.77:0/501162357 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c005040 con 0x7fda600fbd40 2024-04-25T02:15:17.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.190+0000 7fda65774700 1 --2- 172.21.15.77:0/501162357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda600fbd40 0x7fda60112ab0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fda5000c830 tx=0x7fda50004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:17.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.190+0000 7fda55ffb700 1 -- 172.21.15.77:0/501162357 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda500106f0 con 0x7fda600fbd40 2024-04-25T02:15:17.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.190+0000 7fda55ffb700 1 -- 172.21.15.77:0/501162357 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda50010d20 con 0x7fda600fbd40 2024-04-25T02:15:17.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.190+0000 7fda679d8700 1 -- 172.21.15.77:0/501162357 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda6010cd10 con 0x7fda600fbd40 2024-04-25T02:15:17.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.190+0000 7fda55ffb700 1 -- 172.21.15.77:0/501162357 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda500113a0 con 0x7fda600fbd40 2024-04-25T02:15:17.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.190+0000 7fda679d8700 1 -- 172.21.15.77:0/501162357 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda6010d2a0 con 0x7fda600fbd40 2024-04-25T02:15:17.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.191+0000 7fda679d8700 1 -- 172.21.15.77:0/501162357 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda600fd430 con 0x7fda600fbd40 2024-04-25T02:15:17.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.191+0000 7fda55ffb700 1 -- 172.21.15.77:0/501162357 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fda50012400 con 0x7fda600fbd40 2024-04-25T02:15:17.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.192+0000 7fda55ffb700 1 --2- 172.21.15.77:0/501162357 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fda4c06e140 0x7fda4c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:17.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.192+0000 7fda55ffb700 1 -- 172.21.15.77:0/501162357 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fda5008da20 con 0x7fda600fbd40 2024-04-25T02:15:17.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.192+0000 7fda64f73700 1 --2- 172.21.15.77:0/501162357 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fda4c06e140 0x7fda4c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:17.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.192+0000 7fda64f73700 1 --2- 172.21.15.77:0/501162357 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fda4c06e140 0x7fda4c0705f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fda6010dd10 tx=0x7fda5c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:17.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.196+0000 7fda55ffb700 1 -- 172.21.15.77:0/501162357 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fda5005a9a0 con 0x7fda600fbd40 2024-04-25T02:15:17.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:16 smithi112 ceph-mon[80494]: pgmap v64: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:15:17.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:16 smithi112 ceph-mon[80494]: osd.1 marked itself down and dead 2024-04-25T02:15:17.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.418+0000 7fda679d8700 1 -- 172.21.15.77:0/501162357 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fda60108df0 con 0x7fda4c06e140 2024-04-25T02:15:17.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.420+0000 7fda55ffb700 1 -- 172.21.15.77:0/501162357 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fda60108df0 con 0x7fda4c06e140 2024-04-25T02:15:17.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.422+0000 7fda679d8700 1 -- 172.21.15.77:0/501162357 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fda4c06e140 msgr2=0x7fda4c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:17.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.422+0000 7fda679d8700 1 --2- 172.21.15.77:0/501162357 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fda4c06e140 0x7fda4c0705f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fda6010dd10 tx=0x7fda5c009e30 comp rx=0 tx=0).stop 2024-04-25T02:15:17.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.422+0000 7fda679d8700 1 -- 172.21.15.77:0/501162357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda600fbd40 msgr2=0x7fda60112ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:17.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.422+0000 7fda679d8700 1 --2- 172.21.15.77:0/501162357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda600fbd40 0x7fda60112ab0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fda5000c830 tx=0x7fda50004470 comp rx=0 tx=0).stop 2024-04-25T02:15:17.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.422+0000 7fda679d8700 1 -- 172.21.15.77:0/501162357 shutdown_connections 2024-04-25T02:15:17.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.422+0000 7fda679d8700 1 --2- 172.21.15.77:0/501162357 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fda4c06e140 0x7fda4c0705f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:17.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.422+0000 7fda679d8700 1 --2- 172.21.15.77:0/501162357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda600fbd40 0x7fda60112ab0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:17.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.422+0000 7fda679d8700 1 --2- 172.21.15.77:0/501162357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda60101d90 0x7fda60112ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:17.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.422+0000 7fda679d8700 1 -- 172.21.15.77:0/501162357 >> 172.21.15.77:0/501162357 conn(0x7fda60071d00 msgr2=0x7fda600fa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:17.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.422+0000 7fda679d8700 1 -- 172.21.15.77:0/501162357 shutdown_connections 2024-04-25T02:15:17.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.422+0000 7fda679d8700 1 -- 172.21.15.77:0/501162357 wait complete. 2024-04-25T02:15:17.438 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-04-25T02:15:17.478 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:17 smithi077 podman[126530]: 2024-04-25 02:15:17.294924076 +0000 UTC m=+1.004852179 container died 256ff3ced3227d9f680102da573b6909c31cb0a218c6a3277cadf3917f8b4f99 (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-c61472c, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-25T02:15:17.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.528+0000 7f4ed3811700 1 -- 172.21.15.77:0/1610999808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ecc102e50 msgr2=0x7f4ecc103220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:17.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.528+0000 7f4ed3811700 1 --2- 172.21.15.77:0/1610999808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ecc102e50 0x7f4ecc103220 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8004940 tx=0x7f4ec8009e30 comp rx=0 tx=0).stop 2024-04-25T02:15:17.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.528+0000 7f4ed3811700 1 -- 172.21.15.77:0/1610999808 shutdown_connections 2024-04-25T02:15:17.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.528+0000 7f4ed3811700 1 --2- 172.21.15.77:0/1610999808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ecc065640 0x7f4ecc065ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:17.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.528+0000 7f4ed3811700 1 --2- 172.21.15.77:0/1610999808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ecc102e50 0x7f4ecc103220 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:17.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.528+0000 7f4ed3811700 1 -- 172.21.15.77:0/1610999808 >> 172.21.15.77:0/1610999808 conn(0x7f4ecc071d00 msgr2=0x7f4ecc072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:17.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.529+0000 7f4ed3811700 1 -- 172.21.15.77:0/1610999808 shutdown_connections 2024-04-25T02:15:17.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.529+0000 7f4ed3811700 1 -- 172.21.15.77:0/1610999808 wait complete. 2024-04-25T02:15:17.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.529+0000 7f4ed3811700 1 Processor -- start 2024-04-25T02:15:17.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.529+0000 7f4ed3811700 1 -- start start 2024-04-25T02:15:17.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.529+0000 7f4ed3811700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ecc065640 0x7f4ecc0fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:17.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.529+0000 7f4ed3811700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ecc102e50 0x7f4ecc0fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:17.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.529+0000 7f4ed3811700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc0fc880 con 0x7f4ecc065640 2024-04-25T02:15:17.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.529+0000 7f4ed3811700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc0fc9c0 con 0x7f4ecc102e50 2024-04-25T02:15:17.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.529+0000 7f4ed15ad700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ecc065640 0x7f4ecc0fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:17.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.529+0000 7f4ed15ad700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ecc065640 0x7f4ecc0fbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54650/0 (socket says 172.21.15.77:54650) 2024-04-25T02:15:17.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.529+0000 7f4ed15ad700 1 -- 172.21.15.77:0/1548236299 learned_addr learned my addr 172.21.15.77:0/1548236299 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:15:17.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.529+0000 7f4ed0dac700 1 --2- 172.21.15.77:0/1548236299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ecc102e50 0x7f4ecc0fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:17.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.530+0000 7f4ed15ad700 1 -- 172.21.15.77:0/1548236299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ecc102e50 msgr2=0x7f4ecc0fc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:17.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.530+0000 7f4ed15ad700 1 --2- 172.21.15.77:0/1548236299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ecc102e50 0x7f4ecc0fc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:17.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.530+0000 7f4ed15ad700 1 -- 172.21.15.77:0/1548236299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec8005040 con 0x7f4ecc065640 2024-04-25T02:15:17.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.530+0000 7f4ed15ad700 1 --2- 172.21.15.77:0/1548236299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ecc065640 0x7f4ecc0fbdb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4ec800b3b0 tx=0x7f4ec8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:17.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.530+0000 7f4ec1ffb700 1 -- 172.21.15.77:0/1548236299 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ec800e040 con 0x7f4ecc065640 2024-04-25T02:15:17.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.530+0000 7f4ec1ffb700 1 -- 172.21.15.77:0/1548236299 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ec8013420 con 0x7f4ecc065640 2024-04-25T02:15:17.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.530+0000 7f4ed3811700 1 -- 172.21.15.77:0/1548236299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ecc0fcc10 con 0x7f4ecc065640 2024-04-25T02:15:17.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.530+0000 7f4ec1ffb700 1 -- 172.21.15.77:0/1548236299 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ec801c630 con 0x7f4ecc065640 2024-04-25T02:15:17.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.530+0000 7f4ed3811700 1 -- 172.21.15.77:0/1548236299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ecc11a210 con 0x7f4ecc065640 2024-04-25T02:15:17.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.531+0000 7f4ed3811700 1 -- 172.21.15.77:0/1548236299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ecc100100 con 0x7f4ecc065640 2024-04-25T02:15:17.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.532+0000 7f4ec1ffb700 1 -- 172.21.15.77:0/1548236299 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4ec8013590 con 0x7f4ecc065640 2024-04-25T02:15:17.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.532+0000 7f4ec1ffb700 1 --2- 172.21.15.77:0/1548236299 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f4eb806e140 0x7f4eb80705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:17.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.532+0000 7f4ec1ffb700 1 -- 172.21.15.77:0/1548236299 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f4ec808ebb0 con 0x7f4ecc065640 2024-04-25T02:15:17.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.532+0000 7f4ed0dac700 1 --2- 172.21.15.77:0/1548236299 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f4eb806e140 0x7f4eb80705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:17.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.532+0000 7f4ed0dac700 1 --2- 172.21.15.77:0/1548236299 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f4eb806e140 0x7f4eb80705f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc0fd6f0 tx=0x7f4ebc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:17.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.537+0000 7f4ec1ffb700 1 -- 172.21.15.77:0/1548236299 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f4ec8095080 con 0x7f4ecc065640 2024-04-25T02:15:17.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.764+0000 7f4ed3811700 1 -- 172.21.15.77:0/1548236299 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ecc109f60 con 0x7f4eb806e140 2024-04-25T02:15:17.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.765+0000 7f4ec1ffb700 1 -- 172.21.15.77:0/1548236299 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f4ecc109f60 con 0x7f4eb806e140 2024-04-25T02:15:17.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.767+0000 7f4ed3811700 1 -- 172.21.15.77:0/1548236299 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f4eb806e140 msgr2=0x7f4eb80705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:17.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.767+0000 7f4ed3811700 1 --2- 172.21.15.77:0/1548236299 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f4eb806e140 0x7f4eb80705f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc0fd6f0 tx=0x7f4ebc00b040 comp rx=0 tx=0).stop 2024-04-25T02:15:17.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.767+0000 7f4ed3811700 1 -- 172.21.15.77:0/1548236299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ecc065640 msgr2=0x7f4ecc0fbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:17.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.767+0000 7f4ed3811700 1 --2- 172.21.15.77:0/1548236299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ecc065640 0x7f4ecc0fbdb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4ec800b3b0 tx=0x7f4ec8009e30 comp rx=0 tx=0).stop 2024-04-25T02:15:17.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.768+0000 7f4ed3811700 1 -- 172.21.15.77:0/1548236299 shutdown_connections 2024-04-25T02:15:17.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.768+0000 7f4ed3811700 1 --2- 172.21.15.77:0/1548236299 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f4eb806e140 0x7f4eb80705f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:17.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.768+0000 7f4ed3811700 1 --2- 172.21.15.77:0/1548236299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ecc065640 0x7f4ecc0fbdb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:17.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.768+0000 7f4ed3811700 1 --2- 172.21.15.77:0/1548236299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ecc102e50 0x7f4ecc0fc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:17.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.768+0000 7f4ed3811700 1 -- 172.21.15.77:0/1548236299 >> 172.21.15.77:0/1548236299 conn(0x7f4ecc071d00 msgr2=0x7f4ecc0faf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:17.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.768+0000 7f4ed3811700 1 -- 172.21.15.77:0/1548236299 shutdown_connections 2024-04-25T02:15:17.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.768+0000 7f4ed3811700 1 -- 172.21.15.77:0/1548236299 wait complete. 2024-04-25T02:15:17.805 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:17 smithi077 podman[126530]: 2024-04-25 02:15:17.637317982 +0000 UTC m=+1.347246066 container cleanup 256ff3ced3227d9f680102da573b6909c31cb0a218c6a3277cadf3917f8b4f99 (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, RELEASE=quincy-c61472c, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-04-25T02:15:17.805 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:17 smithi077 bash[126530]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1 2024-04-25T02:15:17.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.892+0000 7f5dad114700 1 -- 172.21.15.77:0/4121736660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5da8102680 msgr2=0x7f5da80fbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:17.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.892+0000 7f5dad114700 1 --2- 172.21.15.77:0/4121736660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5da8102680 0x7f5da80fbcf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c004940 tx=0x7f5d9c009e30 comp rx=0 tx=0).stop 2024-04-25T02:15:17.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.892+0000 7f5dad114700 1 -- 172.21.15.77:0/4121736660 shutdown_connections 2024-04-25T02:15:17.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.892+0000 7f5dad114700 1 --2- 172.21.15.77:0/4121736660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5da8102680 0x7f5da80fbcf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:17.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.892+0000 7f5dad114700 1 --2- 172.21.15.77:0/4121736660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5da8101ce0 0x7f5da81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:17.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.892+0000 7f5dad114700 1 -- 172.21.15.77:0/4121736660 >> 172.21.15.77:0/4121736660 conn(0x7f5da80f7850 msgr2=0x7f5da80f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:17.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.892+0000 7f5dad114700 1 -- 172.21.15.77:0/4121736660 shutdown_connections 2024-04-25T02:15:17.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.892+0000 7f5dad114700 1 -- 172.21.15.77:0/4121736660 wait complete. 2024-04-25T02:15:17.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.893+0000 7f5dad114700 1 Processor -- start 2024-04-25T02:15:17.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.893+0000 7f5dad114700 1 -- start start 2024-04-25T02:15:17.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.893+0000 7f5dad114700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5da8101ce0 0x7f5da8115db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:17.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.893+0000 7f5dad114700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5da8102680 0x7f5da81162f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:17.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.893+0000 7f5dad114700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da8116940 con 0x7f5da8102680 2024-04-25T02:15:17.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.893+0000 7f5dad114700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da810fd10 con 0x7f5da8101ce0 2024-04-25T02:15:17.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.893+0000 7f5da659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5da8102680 0x7f5da81162f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:17.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.893+0000 7f5da659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5da8102680 0x7f5da81162f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54680/0 (socket says 172.21.15.77:54680) 2024-04-25T02:15:17.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.893+0000 7f5da659c700 1 -- 172.21.15.77:0/3684145985 learned_addr learned my addr 172.21.15.77:0/3684145985 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:15:17.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.893+0000 7f5da6d9d700 1 --2- 172.21.15.77:0/3684145985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5da8101ce0 0x7f5da8115db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:17.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.893+0000 7f5da659c700 1 -- 172.21.15.77:0/3684145985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5da8101ce0 msgr2=0x7f5da8115db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:17.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.893+0000 7f5da659c700 1 --2- 172.21.15.77:0/3684145985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5da8101ce0 0x7f5da8115db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:17.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.893+0000 7f5da659c700 1 -- 172.21.15.77:0/3684145985 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9c005040 con 0x7f5da8102680 2024-04-25T02:15:17.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.894+0000 7f5da659c700 1 --2- 172.21.15.77:0/3684145985 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5da8102680 0x7f5da81162f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c009100 tx=0x7f5d9c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:17.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.894+0000 7f5d8f7fe700 1 -- 172.21.15.77:0/3684145985 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d9c00e040 con 0x7f5da8102680 2024-04-25T02:15:17.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.894+0000 7f5dad114700 1 -- 172.21.15.77:0/3684145985 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da810ff90 con 0x7f5da8102680 2024-04-25T02:15:17.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.894+0000 7f5d8f7fe700 1 -- 172.21.15.77:0/3684145985 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5d9c009af0 con 0x7f5da8102680 2024-04-25T02:15:17.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.894+0000 7f5d8f7fe700 1 -- 172.21.15.77:0/3684145985 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d9c01c3f0 con 0x7f5da8102680 2024-04-25T02:15:17.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.894+0000 7f5dad114700 1 -- 172.21.15.77:0/3684145985 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da8110550 con 0x7f5da8102680 2024-04-25T02:15:17.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.895+0000 7f5dad114700 1 -- 172.21.15.77:0/3684145985 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da80fd430 con 0x7f5da8102680 2024-04-25T02:15:17.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.896+0000 7f5d8f7fe700 1 -- 172.21.15.77:0/3684145985 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5d9c00baf0 con 0x7f5da8102680 2024-04-25T02:15:17.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.896+0000 7f5d8f7fe700 1 --2- 172.21.15.77:0/3684145985 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5d9006e140 0x7f5d900705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:17.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.896+0000 7f5d8f7fe700 1 -- 172.21.15.77:0/3684145985 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f5d9c08edb0 con 0x7f5da8102680 2024-04-25T02:15:17.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.896+0000 7f5da6d9d700 1 --2- 172.21.15.77:0/3684145985 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5d9006e140 0x7f5d900705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:17.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.897+0000 7f5da6d9d700 1 --2- 172.21.15.77:0/3684145985 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5d9006e140 0x7f5d900705f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5d980041d0 tx=0x7f5d980043c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:17.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:17.901+0000 7f5d8f7fe700 1 -- 172.21.15.77:0/3684145985 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f5d9c05bc90 con 0x7f5da8102680 2024-04-25T02:15:18.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.140+0000 7f5dad114700 1 -- 172.21.15.77:0/3684145985 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5da80fd430 con 0x7f5d9006e140 2024-04-25T02:15:18.146 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:17 smithi077 podman[126568]: 2024-04-25 02:15:17.81730323 +0000 UTC m=+0.521487480 container remove 256ff3ced3227d9f680102da573b6909c31cb0a218c6a3277cadf3917f8b4f99 (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-c61472c, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-04-25T02:15:18.146 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:17 smithi077 ceph-mon[110441]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-25T02:15:18.146 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:17 smithi077 ceph-mon[110441]: osdmap e56: 6 total, 5 up, 6 in 2024-04-25T02:15:18.146 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:17 smithi077 ceph-mon[110441]: osdmap e57: 6 total, 5 up, 6 in 2024-04-25T02:15:18.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.152+0000 7f5d8f7fe700 1 -- 172.21.15.77:0/3684145985 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f5da80fd430 con 0x7f5d9006e140 2024-04-25T02:15:18.157 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T02:15:18.157 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (3m) 26s ago 14m 26.8M - 0.25.0 c8568f914cd2 699c7fd25ea5 2024-04-25T02:15:18.158 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (58s) 26s ago 14m 6660k - 19.0.0-2445-gd2c45d97 f68e37b807ef f3c45d31e2e3 2024-04-25T02:15:18.158 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi112 smithi112 running (53s) 49s ago 13m 6656k - 19.0.0-2445-gd2c45d97 f68e37b807ef e16d9899ed11 2024-04-25T02:15:18.158 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (3m) 26s ago 14m 77.9M - 9.4.12 2bacad6d85d8 900138b0bcf0 2024-04-25T02:15:18.158 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.gcfygj smithi077 running (8m) 26s ago 8m 15.7M - 17.2.7-902-gc61472c8 0de407c1b3af 382dd7abf674 2024-04-25T02:15:18.158 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.oadrkb smithi077 running (9m) 26s ago 9m 14.0M - 17.2.7-902-gc61472c8 0de407c1b3af 6992064a4b2a 2024-04-25T02:15:18.158 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.dvwudt smithi112 running (9m) 49s ago 9m 156M - 17.2.7-902-gc61472c8 0de407c1b3af 0792e451abfd 2024-04-25T02:15:18.158 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.fjnadi smithi112 running (8m) 49s ago 8m 15.2M - 17.2.7-902-gc61472c8 0de407c1b3af c8093f622f6b 2024-04-25T02:15:18.158 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.zpflzp smithi077 *:8443,9283,8765 running (5m) 26s ago 15m 498M - 19.0.0-2445-gd2c45d97 f68e37b807ef a1af92e027e5 2024-04-25T02:15:18.158 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi112.cswrxs smithi112 *:8443,9283,8765 running (4m) 49s ago 13m 448M - 19.0.0-2445-gd2c45d97 f68e37b807ef ccc7c57d35f2 2024-04-25T02:15:18.158 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (2m) 26s ago 15m 42.3M 2048M 19.0.0-2445-gd2c45d97 f68e37b807ef 06490c2ecc44 2024-04-25T02:15:18.158 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi112 smithi112 running (98s) 49s ago 13m 33.0M 2048M 19.0.0-2445-gd2c45d97 f68e37b807ef ccd1398acbc5 2024-04-25T02:15:18.158 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (4m) 26s ago 14m 17.0M - 1.5.0 0da6a335fe13 2320132606fc 2024-04-25T02:15:18.158 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi112 smithi112 *:9100 running (4m) 49s ago 13m 14.8M - 1.5.0 0da6a335fe13 49f285354791 2024-04-25T02:15:18.158 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (32s) 26s ago 12m 11.9M 1557M 19.0.0-2445-gd2c45d97 f68e37b807ef 7035e288ddae 2024-04-25T02:15:18.159 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (12m) 26s ago 12m 260M 1557M 17.2.7-902-gc61472c8 0de407c1b3af 256ff3ced322 2024-04-25T02:15:18.159 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (11m) 26s ago 11m 221M 1557M 17.2.7-902-gc61472c8 0de407c1b3af c5d7d8c993f4 2024-04-25T02:15:18.159 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi112 running (11m) 49s ago 11m 292M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 68429d0dbf88 2024-04-25T02:15:18.159 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi112 running (10m) 49s ago 10m 261M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 66eb71201444 2024-04-25T02:15:18.159 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi112 running (10m) 49s ago 10m 240M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 963e700d6aea 2024-04-25T02:15:18.159 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (3m) 26s ago 13m 59.3M - 2.43.0 a07b618ecd1d c5b8c6104d96 2024-04-25T02:15:18.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.155+0000 7f5dad114700 1 -- 172.21.15.77:0/3684145985 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5d9006e140 msgr2=0x7f5d900705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:18.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.155+0000 7f5dad114700 1 --2- 172.21.15.77:0/3684145985 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5d9006e140 0x7f5d900705f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5d980041d0 tx=0x7f5d980043c0 comp rx=0 tx=0).stop 2024-04-25T02:15:18.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.155+0000 7f5dad114700 1 -- 172.21.15.77:0/3684145985 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5da8102680 msgr2=0x7f5da81162f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:18.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.155+0000 7f5dad114700 1 --2- 172.21.15.77:0/3684145985 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5da8102680 0x7f5da81162f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c009100 tx=0x7f5d9c009e30 comp rx=0 tx=0).stop 2024-04-25T02:15:18.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.155+0000 7f5dad114700 1 -- 172.21.15.77:0/3684145985 shutdown_connections 2024-04-25T02:15:18.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.155+0000 7f5dad114700 1 --2- 172.21.15.77:0/3684145985 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5d9006e140 0x7f5d900705f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:18.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.155+0000 7f5dad114700 1 --2- 172.21.15.77:0/3684145985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5da8101ce0 0x7f5da8115db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:18.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.155+0000 7f5dad114700 1 --2- 172.21.15.77:0/3684145985 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5da8102680 0x7f5da81162f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:18.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.155+0000 7f5dad114700 1 -- 172.21.15.77:0/3684145985 >> 172.21.15.77:0/3684145985 conn(0x7f5da80f7850 msgr2=0x7f5da80f8820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:18.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.155+0000 7f5dad114700 1 -- 172.21.15.77:0/3684145985 shutdown_connections 2024-04-25T02:15:18.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.155+0000 7f5dad114700 1 -- 172.21.15.77:0/3684145985 wait complete. 2024-04-25T02:15:18.179 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:17 smithi112 ceph-mon[80494]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-25T02:15:18.179 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:17 smithi112 ceph-mon[80494]: osdmap e56: 6 total, 5 up, 6 in 2024-04-25T02:15:18.179 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:17 smithi112 ceph-mon[80494]: osdmap e57: 6 total, 5 up, 6 in 2024-04-25T02:15:18.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.260+0000 7f315708b700 1 -- 172.21.15.77:0/2293418531 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3150102e50 msgr2=0x7f3150103220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:18.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.260+0000 7f315708b700 1 --2- 172.21.15.77:0/2293418531 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3150102e50 0x7f3150103220 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3148009ce0 tx=0x7f3148004d10 comp rx=0 tx=0).stop 2024-04-25T02:15:18.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.260+0000 7f315708b700 1 -- 172.21.15.77:0/2293418531 shutdown_connections 2024-04-25T02:15:18.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.260+0000 7f315708b700 1 --2- 172.21.15.77:0/2293418531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3150065640 0x7f3150065ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:18.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.260+0000 7f315708b700 1 --2- 172.21.15.77:0/2293418531 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3150102e50 0x7f3150103220 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:18.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.260+0000 7f315708b700 1 -- 172.21.15.77:0/2293418531 >> 172.21.15.77:0/2293418531 conn(0x7f3150071d00 msgr2=0x7f3150072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:18.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.260+0000 7f315708b700 1 -- 172.21.15.77:0/2293418531 shutdown_connections 2024-04-25T02:15:18.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.260+0000 7f315708b700 1 -- 172.21.15.77:0/2293418531 wait complete. 2024-04-25T02:15:18.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.260+0000 7f315708b700 1 Processor -- start 2024-04-25T02:15:18.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.260+0000 7f315708b700 1 -- start start 2024-04-25T02:15:18.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.261+0000 7f315708b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3150065640 0x7f31500fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:18.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.261+0000 7f315708b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3150102e50 0x7f31500fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:18.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.261+0000 7f315708b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31500fc880 con 0x7f3150065640 2024-04-25T02:15:18.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.261+0000 7f315708b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31500fc9c0 con 0x7f3150102e50 2024-04-25T02:15:18.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.261+0000 7f3154e27700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3150065640 0x7f31500fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:18.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.261+0000 7f3154e27700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3150065640 0x7f31500fbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54692/0 (socket says 172.21.15.77:54692) 2024-04-25T02:15:18.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.261+0000 7f3154e27700 1 -- 172.21.15.77:0/2427313155 learned_addr learned my addr 172.21.15.77:0/2427313155 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:15:18.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.261+0000 7f314ffff700 1 --2- 172.21.15.77:0/2427313155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3150102e50 0x7f31500fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:18.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.261+0000 7f3154e27700 1 -- 172.21.15.77:0/2427313155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3150102e50 msgr2=0x7f31500fc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:18.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.261+0000 7f3154e27700 1 --2- 172.21.15.77:0/2427313155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3150102e50 0x7f31500fc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:18.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.261+0000 7f3154e27700 1 -- 172.21.15.77:0/2427313155 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3148009940 con 0x7f3150065640 2024-04-25T02:15:18.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.261+0000 7f3154e27700 1 --2- 172.21.15.77:0/2427313155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3150065640 0x7f31500fbdb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3148003400 tx=0x7f3148004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:18.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.261+0000 7f314d7fa700 1 -- 172.21.15.77:0/2427313155 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f314800e040 con 0x7f3150065640 2024-04-25T02:15:18.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.262+0000 7f315708b700 1 -- 172.21.15.77:0/2427313155 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31500fcc10 con 0x7f3150065640 2024-04-25T02:15:18.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.262+0000 7f314d7fa700 1 -- 172.21.15.77:0/2427313155 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3148004610 con 0x7f3150065640 2024-04-25T02:15:18.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.262+0000 7f314d7fa700 1 -- 172.21.15.77:0/2427313155 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f314801c6d0 con 0x7f3150065640 2024-04-25T02:15:18.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.262+0000 7f315708b700 1 -- 172.21.15.77:0/2427313155 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315011a3f0 con 0x7f3150065640 2024-04-25T02:15:18.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.263+0000 7f315708b700 1 -- 172.21.15.77:0/2427313155 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3150100100 con 0x7f3150065640 2024-04-25T02:15:18.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.263+0000 7f314d7fa700 1 -- 172.21.15.77:0/2427313155 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3148012b00 con 0x7f3150065640 2024-04-25T02:15:18.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.263+0000 7f314d7fa700 1 --2- 172.21.15.77:0/2427313155 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f313806e140 0x7f31380705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:18.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.264+0000 7f314d7fa700 1 -- 172.21.15.77:0/2427313155 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f314808f580 con 0x7f3150065640 2024-04-25T02:15:18.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.264+0000 7f314ffff700 1 --2- 172.21.15.77:0/2427313155 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f313806e140 0x7f31380705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:18.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.264+0000 7f314ffff700 1 --2- 172.21.15.77:0/2427313155 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f313806e140 0x7f31380705f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f31500fd6f0 tx=0x7f3144009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:18.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.268+0000 7f314d7fa700 1 -- 172.21.15.77:0/2427313155 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f3148058950 con 0x7f3150065640 2024-04-25T02:15:18.405 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:18 smithi077 podman[126714]: 2024-04-25 02:15:18.179864853 +0000 UTC m=+0.018861123 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:15:18.405 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:18 smithi077 podman[126714]: 2024-04-25 02:15:18.281257556 +0000 UTC m=+0.120253818 container create 973829605d954524ddece323f54697815aefaf6786b0789af14265733824ac13 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-d2c45d9, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-04-25T02:15:18.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.568+0000 7f315708b700 1 -- 172.21.15.77:0/2427313155 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3150109ef0 con 0x7f3150065640 2024-04-25T02:15:18.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.568+0000 7f314d7fa700 1 -- 172.21.15.77:0/2427313155 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f3148004e10 con 0x7f3150065640 2024-04-25T02:15:18.574 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:15:18.574 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-04-25T02:15:18.575 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:15:18.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:15:18.575 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-04-25T02:15:18.575 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:15:18.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:15:18.575 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-04-25T02:15:18.575 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4, 2024-04-25T02:15:18.575 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 1 2024-04-25T02:15:18.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:15:18.575 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-04-25T02:15:18.575 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T02:15:18.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:15:18.575 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-04-25T02:15:18.576 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 8, 2024-04-25T02:15:18.576 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 5 2024-04-25T02:15:18.576 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-25T02:15:18.576 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:15:18.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.571+0000 7f315708b700 1 -- 172.21.15.77:0/2427313155 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f313806e140 msgr2=0x7f31380705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:18.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.571+0000 7f315708b700 1 --2- 172.21.15.77:0/2427313155 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f313806e140 0x7f31380705f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f31500fd6f0 tx=0x7f3144009ee0 comp rx=0 tx=0).stop 2024-04-25T02:15:18.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.571+0000 7f315708b700 1 -- 172.21.15.77:0/2427313155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3150065640 msgr2=0x7f31500fbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:18.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.571+0000 7f315708b700 1 --2- 172.21.15.77:0/2427313155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3150065640 0x7f31500fbdb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3148003400 tx=0x7f3148004d10 comp rx=0 tx=0).stop 2024-04-25T02:15:18.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.571+0000 7f315708b700 1 -- 172.21.15.77:0/2427313155 shutdown_connections 2024-04-25T02:15:18.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.571+0000 7f315708b700 1 --2- 172.21.15.77:0/2427313155 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f313806e140 0x7f31380705f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:18.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.571+0000 7f315708b700 1 --2- 172.21.15.77:0/2427313155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3150065640 0x7f31500fbdb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:18.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.571+0000 7f315708b700 1 --2- 172.21.15.77:0/2427313155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3150102e50 0x7f31500fc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:18.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.571+0000 7f315708b700 1 -- 172.21.15.77:0/2427313155 >> 172.21.15.77:0/2427313155 conn(0x7f3150071d00 msgr2=0x7f31500fb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:18.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.571+0000 7f315708b700 1 -- 172.21.15.77:0/2427313155 shutdown_connections 2024-04-25T02:15:18.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.571+0000 7f315708b700 1 -- 172.21.15.77:0/2427313155 wait complete. 2024-04-25T02:15:18.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.675+0000 7f7ef9b89700 1 -- 172.21.15.77:0/3130066542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef40fdde0 msgr2=0x7f7ef40fe1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:18.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.675+0000 7f7ef9b89700 1 --2- 172.21.15.77:0/3130066542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef40fdde0 0x7f7ef40fe1b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4004940 tx=0x7f7ee4009e30 comp rx=0 tx=0).stop 2024-04-25T02:15:18.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.675+0000 7f7ef9b89700 1 -- 172.21.15.77:0/3130066542 shutdown_connections 2024-04-25T02:15:18.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.675+0000 7f7ef9b89700 1 --2- 172.21.15.77:0/3130066542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ef40fe780 0x7f7ef4106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:18.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.675+0000 7f7ef9b89700 1 --2- 172.21.15.77:0/3130066542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef40fdde0 0x7f7ef40fe1b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:18.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.675+0000 7f7ef9b89700 1 -- 172.21.15.77:0/3130066542 >> 172.21.15.77:0/3130066542 conn(0x7f7ef40f7850 msgr2=0x7f7ef40f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:18.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.675+0000 7f7ef9b89700 1 -- 172.21.15.77:0/3130066542 shutdown_connections 2024-04-25T02:15:18.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.675+0000 7f7ef9b89700 1 -- 172.21.15.77:0/3130066542 wait complete. 2024-04-25T02:15:18.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.676+0000 7f7ef9b89700 1 Processor -- start 2024-04-25T02:15:18.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.676+0000 7f7ef9b89700 1 -- start start 2024-04-25T02:15:18.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.676+0000 7f7ef9b89700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ef40fdde0 0x7f7ef40fbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:18.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.676+0000 7f7ef9b89700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef40fe780 0x7f7ef40fc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:18.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.676+0000 7f7ef9b89700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef40fc770 con 0x7f7ef40fe780 2024-04-25T02:15:18.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.676+0000 7f7ef9b89700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef40fc8b0 con 0x7f7ef40fdde0 2024-04-25T02:15:18.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.676+0000 7f7ef2ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef40fe780 0x7f7ef40fc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:18.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.676+0000 7f7ef2ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef40fe780 0x7f7ef40fc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54700/0 (socket says 172.21.15.77:54700) 2024-04-25T02:15:18.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.676+0000 7f7ef2ffd700 1 -- 172.21.15.77:0/2090201122 learned_addr learned my addr 172.21.15.77:0/2090201122 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:15:18.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.676+0000 7f7ef37fe700 1 --2- 172.21.15.77:0/2090201122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ef40fdde0 0x7f7ef40fbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:18.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.677+0000 7f7ef2ffd700 1 -- 172.21.15.77:0/2090201122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ef40fdde0 msgr2=0x7f7ef40fbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:18.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.677+0000 7f7ef2ffd700 1 --2- 172.21.15.77:0/2090201122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ef40fdde0 0x7f7ef40fbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:18.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.677+0000 7f7ef2ffd700 1 -- 172.21.15.77:0/2090201122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee4005040 con 0x7f7ef40fe780 2024-04-25T02:15:18.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.677+0000 7f7ef2ffd700 1 --2- 172.21.15.77:0/2090201122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef40fe780 0x7f7ef40fc150 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7ee800b790 tx=0x7f7ee8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:18.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.677+0000 7f7edbfff700 1 -- 172.21.15.77:0/2090201122 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ee800f6f0 con 0x7f7ef40fe780 2024-04-25T02:15:18.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.677+0000 7f7edbfff700 1 -- 172.21.15.77:0/2090201122 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ee800fd20 con 0x7f7ef40fe780 2024-04-25T02:15:18.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.677+0000 7f7ef9b89700 1 -- 172.21.15.77:0/2090201122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef4119e60 con 0x7f7ef40fe780 2024-04-25T02:15:18.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.677+0000 7f7edbfff700 1 -- 172.21.15.77:0/2090201122 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ee80103a0 con 0x7f7ef40fe780 2024-04-25T02:15:18.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.677+0000 7f7ef9b89700 1 -- 172.21.15.77:0/2090201122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef411a260 con 0x7f7ef40fe780 2024-04-25T02:15:18.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.679+0000 7f7ef9b89700 1 -- 172.21.15.77:0/2090201122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef4066750 con 0x7f7ef40fe780 2024-04-25T02:15:18.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.679+0000 7f7edbfff700 1 -- 172.21.15.77:0/2090201122 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7ee8011400 con 0x7f7ef40fe780 2024-04-25T02:15:18.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.679+0000 7f7edbfff700 1 --2- 172.21.15.77:0/2090201122 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f7edc06e140 0x7f7edc0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:18.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.679+0000 7f7edbfff700 1 -- 172.21.15.77:0/2090201122 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f7ee808d890 con 0x7f7ef40fe780 2024-04-25T02:15:18.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.679+0000 7f7ef37fe700 1 --2- 172.21.15.77:0/2090201122 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f7edc06e140 0x7f7edc0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:18.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.680+0000 7f7ef37fe700 1 --2- 172.21.15.77:0/2090201122 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f7edc06e140 0x7f7edc0705f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4004f90 tx=0x7f7ee4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.684+0000 7f7edbfff700 1 -- 172.21.15.77:0/2090201122 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f7ee8056ce0 con 0x7f7ef40fe780 2024-04-25T02:15:18.807 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:18 smithi077 podman[126714]: 2024-04-25 02:15:18.526303405 +0000 UTC m=+0.365299679 container init 973829605d954524ddece323f54697815aefaf6786b0789af14265733824ac13 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, org.label-schema.license=GPLv2) 2024-04-25T02:15:18.807 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:18 smithi077 podman[126714]: 2024-04-25 02:15:18.529410595 +0000 UTC m=+0.368406868 container start 973829605d954524ddece323f54697815aefaf6786b0789af14265733824ac13 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424) 2024-04-25T02:15:18.807 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:18 smithi077 podman[126714]: 2024-04-25 02:15:18.601274078 +0000 UTC m=+0.440270351 container attach 973829605d954524ddece323f54697815aefaf6786b0789af14265733824ac13 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-25T02:15:18.807 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:18 smithi077 ceph-mon[110441]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:15:18.807 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:18 smithi077 ceph-mon[110441]: pgmap v66: 65 pgs: 5 peering, 9 stale+active+clean, 51 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:15:18.808 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:18 smithi077 ceph-mon[110441]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:15:18.808 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:18 smithi077 ceph-mon[110441]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-04-25T02:15:18.808 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:18 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/2427313155' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:15:18.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.937+0000 7f7ef9b89700 1 -- 172.21.15.77:0/2090201122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7ef404bed0 con 0x7f7ef40fe780 2024-04-25T02:15:18.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.938+0000 7f7edbfff700 1 -- 172.21.15.77:0/2090201122 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1876 (secure 0 0 0) 0x7f7ee805a3a0 con 0x7f7ef40fe780 2024-04-25T02:15:18.943 INFO:teuthology.orchestra.run.smithi077.stdout:e15 2024-04-25T02:15:18.943 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T02:15:18.943 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:15:18.943 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-04-25T02:15:18.943 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:15:18.943 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-04-25T02:15:18.943 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-04-25T02:15:18.943 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 15 2024-04-25T02:15:18.943 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-25T02:15:18.944 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-04-25T02:06:10.008979+0000 2024-04-25T02:15:18.944 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-04-25T02:06:27.849984+0000 2024-04-25T02:15:18.944 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-04-25T02:15:18.944 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-04-25T02:15:18.944 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-04-25T02:15:18.944 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-04-25T02:15:18.944 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-04-25T02:15:18.944 INFO:teuthology.orchestra.run.smithi077.stdout:max_xattr_size 65536 2024-04-25T02:15:18.944 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-04-25T02:15:18.944 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-04-25T02:15:18.944 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 47 2024-04-25T02:15:18.944 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:15:18.944 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-04-25T02:15:18.944 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-04-25T02:15:18.945 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=24257} 2024-04-25T02:15:18.945 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-04-25T02:15:18.945 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-04-25T02:15:18.945 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-04-25T02:15:18.945 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-04-25T02:15:18.945 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-04-25T02:15:18.945 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-04-25T02:15:18.945 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-04-25T02:15:18.945 INFO:teuthology.orchestra.run.smithi077.stdout:bal_rank_mask -1 2024-04-25T02:15:18.945 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-04-25T02:15:18.945 INFO:teuthology.orchestra.run.smithi077.stdout:qdb_cluster leader: 0 members: 2024-04-25T02:15:18.945 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi112.dvwudt{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.112:6824/3687767796,v1:172.21.15.112:6825/3687767796] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:15:18.945 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:15:18.945 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:15:18.945 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-04-25T02:15:18.946 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:15:18.946 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.gcfygj{-1:14462} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/691698671,v1:172.21.15.77:6829/691698671] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:15:18.946 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.oadrkb{-1:14474} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.77:6826/26222645,v1:172.21.15.77:6827/26222645] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:15:18.946 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi112.fjnadi{-1:24269} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/2036319817,v1:172.21.15.112:6827/2036319817] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:15:18.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.940+0000 7f7ef9b89700 1 -- 172.21.15.77:0/2090201122 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f7edc06e140 msgr2=0x7f7edc0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:18.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.940+0000 7f7ef9b89700 1 --2- 172.21.15.77:0/2090201122 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f7edc06e140 0x7f7edc0705f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4004f90 tx=0x7f7ee4009e30 comp rx=0 tx=0).stop 2024-04-25T02:15:18.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.940+0000 7f7ef9b89700 1 -- 172.21.15.77:0/2090201122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef40fe780 msgr2=0x7f7ef40fc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:18.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.940+0000 7f7ef9b89700 1 --2- 172.21.15.77:0/2090201122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef40fe780 0x7f7ef40fc150 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7ee800b790 tx=0x7f7ee8009250 comp rx=0 tx=0).stop 2024-04-25T02:15:18.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.940+0000 7f7ef9b89700 1 -- 172.21.15.77:0/2090201122 shutdown_connections 2024-04-25T02:15:18.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.940+0000 7f7ef9b89700 1 --2- 172.21.15.77:0/2090201122 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f7edc06e140 0x7f7edc0705f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:18.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.940+0000 7f7ef9b89700 1 --2- 172.21.15.77:0/2090201122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ef40fdde0 0x7f7ef40fbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:18.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.940+0000 7f7ef9b89700 1 --2- 172.21.15.77:0/2090201122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef40fe780 0x7f7ef40fc150 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:18.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.940+0000 7f7ef9b89700 1 -- 172.21.15.77:0/2090201122 >> 172.21.15.77:0/2090201122 conn(0x7f7ef40f7850 msgr2=0x7f7ef4103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:18.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.940+0000 7f7ef9b89700 1 -- 172.21.15.77:0/2090201122 shutdown_connections 2024-04-25T02:15:18.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:18.940+0000 7f7ef9b89700 1 -- 172.21.15.77:0/2090201122 wait complete. 2024-04-25T02:15:18.947 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 15 2024-04-25T02:15:19.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.043+0000 7ff0bf0c7700 1 -- 172.21.15.77:0/1372458738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b8103780 msgr2=0x7ff0b80fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:19.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.043+0000 7ff0bf0c7700 1 --2- 172.21.15.77:0/1372458738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b8103780 0x7ff0b80fcdf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4004940 tx=0x7ff0a4009e30 comp rx=0 tx=0).stop 2024-04-25T02:15:19.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.043+0000 7ff0bf0c7700 1 -- 172.21.15.77:0/1372458738 shutdown_connections 2024-04-25T02:15:19.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.043+0000 7ff0bf0c7700 1 --2- 172.21.15.77:0/1372458738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b8103780 0x7ff0b80fcdf0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:19.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.043+0000 7ff0bf0c7700 1 --2- 172.21.15.77:0/1372458738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0b8102de0 0x7ff0b81031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:19.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.043+0000 7ff0bf0c7700 1 -- 172.21.15.77:0/1372458738 >> 172.21.15.77:0/1372458738 conn(0x7ff0b80f8990 msgr2=0x7ff0b80fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:19.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.043+0000 7ff0bf0c7700 1 -- 172.21.15.77:0/1372458738 shutdown_connections 2024-04-25T02:15:19.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.043+0000 7ff0bf0c7700 1 -- 172.21.15.77:0/1372458738 wait complete. 2024-04-25T02:15:19.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.044+0000 7ff0bf0c7700 1 Processor -- start 2024-04-25T02:15:19.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.044+0000 7ff0bf0c7700 1 -- start start 2024-04-25T02:15:19.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.044+0000 7ff0bf0c7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0b8102de0 0x7ff0b8113950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:19.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.044+0000 7ff0bf0c7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b8103780 0x7ff0b8113e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:19.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.044+0000 7ff0bf0c7700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b81144e0 con 0x7ff0b8103780 2024-04-25T02:15:19.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.044+0000 7ff0bf0c7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b810dae0 con 0x7ff0b8102de0 2024-04-25T02:15:19.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.044+0000 7ff0b7fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b8103780 0x7ff0b8113e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:19.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.044+0000 7ff0b7fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b8103780 0x7ff0b8113e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54726/0 (socket says 172.21.15.77:54726) 2024-04-25T02:15:19.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.044+0000 7ff0b7fff700 1 -- 172.21.15.77:0/2929607684 learned_addr learned my addr 172.21.15.77:0/2929607684 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:15:19.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.044+0000 7ff0bce63700 1 --2- 172.21.15.77:0/2929607684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0b8102de0 0x7ff0b8113950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:19.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.045+0000 7ff0b7fff700 1 -- 172.21.15.77:0/2929607684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0b8102de0 msgr2=0x7ff0b8113950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:19.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.045+0000 7ff0b7fff700 1 --2- 172.21.15.77:0/2929607684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0b8102de0 0x7ff0b8113950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:19.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.045+0000 7ff0b7fff700 1 -- 172.21.15.77:0/2929607684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a4005040 con 0x7ff0b8103780 2024-04-25T02:15:19.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.045+0000 7ff0b7fff700 1 --2- 172.21.15.77:0/2929607684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b8103780 0x7ff0b8113e90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4009100 tx=0x7ff0a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:19.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.045+0000 7ff0b57fa700 1 -- 172.21.15.77:0/2929607684 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0a400e040 con 0x7ff0b8103780 2024-04-25T02:15:19.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.045+0000 7ff0b57fa700 1 -- 172.21.15.77:0/2929607684 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff0a4013420 con 0x7ff0b8103780 2024-04-25T02:15:19.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.045+0000 7ff0bf0c7700 1 -- 172.21.15.77:0/2929607684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b810dd60 con 0x7ff0b8103780 2024-04-25T02:15:19.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.045+0000 7ff0b57fa700 1 -- 172.21.15.77:0/2929607684 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0a401c630 con 0x7ff0b8103780 2024-04-25T02:15:19.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.045+0000 7ff0bf0c7700 1 -- 172.21.15.77:0/2929607684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b810e320 con 0x7ff0b8103780 2024-04-25T02:15:19.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.046+0000 7ff0bf0c7700 1 -- 172.21.15.77:0/2929607684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b80fe530 con 0x7ff0b8103780 2024-04-25T02:15:19.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.047+0000 7ff0b57fa700 1 -- 172.21.15.77:0/2929607684 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff0a4013a00 con 0x7ff0b8103780 2024-04-25T02:15:19.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.047+0000 7ff0b57fa700 1 --2- 172.21.15.77:0/2929607684 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7ff0a806e140 0x7ff0a80705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:19.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.047+0000 7ff0b57fa700 1 -- 172.21.15.77:0/2929607684 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ff0a408ead0 con 0x7ff0b8103780 2024-04-25T02:15:19.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.047+0000 7ff0bce63700 1 --2- 172.21.15.77:0/2929607684 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7ff0a806e140 0x7ff0a80705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:19.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.047+0000 7ff0bce63700 1 --2- 172.21.15.77:0/2929607684 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7ff0a806e140 0x7ff0a80705f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac007fd0 tx=0x7ff0ac009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:19.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.052+0000 7ff0b57fa700 1 -- 172.21.15.77:0/2929607684 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7ff0a405baf0 con 0x7ff0b8103780 2024-04-25T02:15:19.057 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:18 smithi077 podman[126714]: 2024-04-25 02:15:18.831837667 +0000 UTC m=+0.670833937 container died 973829605d954524ddece323f54697815aefaf6786b0789af14265733824ac13 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240424, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-25T02:15:19.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.273+0000 7ff0bf0c7700 1 -- 172.21.15.77:0/2929607684 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0b8109ec0 con 0x7ff0a806e140 2024-04-25T02:15:19.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:18 smithi112 ceph-mon[80494]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:15:19.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:18 smithi112 ceph-mon[80494]: pgmap v66: 65 pgs: 5 peering, 9 stale+active+clean, 51 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-04-25T02:15:19.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:18 smithi112 ceph-mon[80494]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:15:19.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:18 smithi112 ceph-mon[80494]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-04-25T02:15:19.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:18 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/2427313155' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:15:19.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.274+0000 7ff0b57fa700 1 -- 172.21.15.77:0/2929607684 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff0b8109ec0 con 0x7ff0a806e140 2024-04-25T02:15:19.279 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:15:19.279 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901", 2024-04-25T02:15:19.279 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-04-25T02:15:19.279 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T02:15:19.279 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-04-25T02:15:19.279 INFO:teuthology.orchestra.run.smithi077.stdout: "mon", 2024-04-25T02:15:19.280 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr", 2024-04-25T02:15:19.280 INFO:teuthology.orchestra.run.smithi077.stdout: "crash" 2024-04-25T02:15:19.280 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-25T02:15:19.280 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "7/21 daemons upgraded", 2024-04-25T02:15:19.280 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading osd daemons", 2024-04-25T02:15:19.280 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-04-25T02:15:19.280 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:15:19.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.276+0000 7ff0bf0c7700 1 -- 172.21.15.77:0/2929607684 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7ff0a806e140 msgr2=0x7ff0a80705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:19.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.276+0000 7ff0bf0c7700 1 --2- 172.21.15.77:0/2929607684 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7ff0a806e140 0x7ff0a80705f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac007fd0 tx=0x7ff0ac009040 comp rx=0 tx=0).stop 2024-04-25T02:15:19.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.276+0000 7ff0bf0c7700 1 -- 172.21.15.77:0/2929607684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b8103780 msgr2=0x7ff0b8113e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:19.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.276+0000 7ff0bf0c7700 1 --2- 172.21.15.77:0/2929607684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b8103780 0x7ff0b8113e90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4009100 tx=0x7ff0a4009e30 comp rx=0 tx=0).stop 2024-04-25T02:15:19.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.276+0000 7ff0bf0c7700 1 -- 172.21.15.77:0/2929607684 shutdown_connections 2024-04-25T02:15:19.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.276+0000 7ff0bf0c7700 1 --2- 172.21.15.77:0/2929607684 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7ff0a806e140 0x7ff0a80705f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:19.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.276+0000 7ff0bf0c7700 1 --2- 172.21.15.77:0/2929607684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0b8102de0 0x7ff0b8113950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:19.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.276+0000 7ff0bf0c7700 1 --2- 172.21.15.77:0/2929607684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b8103780 0x7ff0b8113e90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:19.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.276+0000 7ff0bf0c7700 1 -- 172.21.15.77:0/2929607684 >> 172.21.15.77:0/2929607684 conn(0x7ff0b80f8990 msgr2=0x7ff0b80f9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:19.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.276+0000 7ff0bf0c7700 1 -- 172.21.15.77:0/2929607684 shutdown_connections 2024-04-25T02:15:19.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.276+0000 7ff0bf0c7700 1 -- 172.21.15.77:0/2929607684 wait complete. 2024-04-25T02:15:19.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.378+0000 7f88c79b3700 1 -- 172.21.15.77:0/1396788470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88c0101d10 msgr2=0x7f88c01020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:19.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.378+0000 7f88c79b3700 1 --2- 172.21.15.77:0/1396788470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88c0101d10 0x7f88c01020e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f88bc004940 tx=0x7f88bc009e30 comp rx=0 tx=0).stop 2024-04-25T02:15:19.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.379+0000 7f88c79b3700 1 -- 172.21.15.77:0/1396788470 shutdown_connections 2024-04-25T02:15:19.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.379+0000 7f88c79b3700 1 --2- 172.21.15.77:0/1396788470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88c01026b0 0x7f88c00fbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:19.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.379+0000 7f88c79b3700 1 --2- 172.21.15.77:0/1396788470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88c0101d10 0x7f88c01020e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:19.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.379+0000 7f88c79b3700 1 -- 172.21.15.77:0/1396788470 >> 172.21.15.77:0/1396788470 conn(0x7f88c00f78e0 msgr2=0x7f88c00f9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:19.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.379+0000 7f88c79b3700 1 -- 172.21.15.77:0/1396788470 shutdown_connections 2024-04-25T02:15:19.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.379+0000 7f88c79b3700 1 -- 172.21.15.77:0/1396788470 wait complete. 2024-04-25T02:15:19.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.379+0000 7f88c79b3700 1 Processor -- start 2024-04-25T02:15:19.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.379+0000 7f88c79b3700 1 -- start start 2024-04-25T02:15:19.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.380+0000 7f88c79b3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88c0101d10 0x7f88c0113960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:19.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.380+0000 7f88c79b3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88c01026b0 0x7f88c0113ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:19.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.380+0000 7f88c79b3700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c01144f0 con 0x7f88c01026b0 2024-04-25T02:15:19.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.380+0000 7f88c79b3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c010daf0 con 0x7f88c0101d10 2024-04-25T02:15:19.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.380+0000 7f88c4f4e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88c01026b0 0x7f88c0113ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:19.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.380+0000 7f88c4f4e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88c01026b0 0x7f88c0113ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54740/0 (socket says 172.21.15.77:54740) 2024-04-25T02:15:19.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.380+0000 7f88c4f4e700 1 -- 172.21.15.77:0/745458947 learned_addr learned my addr 172.21.15.77:0/745458947 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:15:19.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.380+0000 7f88c574f700 1 --2- 172.21.15.77:0/745458947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88c0101d10 0x7f88c0113960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:19.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.380+0000 7f88c4f4e700 1 -- 172.21.15.77:0/745458947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88c0101d10 msgr2=0x7f88c0113960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:19.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.380+0000 7f88c4f4e700 1 --2- 172.21.15.77:0/745458947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88c0101d10 0x7f88c0113960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:19.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.380+0000 7f88c4f4e700 1 -- 172.21.15.77:0/745458947 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88bc005040 con 0x7f88c01026b0 2024-04-25T02:15:19.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.380+0000 7f88c4f4e700 1 --2- 172.21.15.77:0/745458947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88c01026b0 0x7f88c0113ea0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f88b0002a50 tx=0x7f88b0004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:19.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.380+0000 7f88b5ffb700 1 -- 172.21.15.77:0/745458947 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88b0007cc0 con 0x7f88c01026b0 2024-04-25T02:15:19.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.380+0000 7f88b5ffb700 1 -- 172.21.15.77:0/745458947 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f88b000f040 con 0x7f88c01026b0 2024-04-25T02:15:19.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.380+0000 7f88b5ffb700 1 -- 172.21.15.77:0/745458947 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88b000db30 con 0x7f88c01026b0 2024-04-25T02:15:19.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.380+0000 7f88c79b3700 1 -- 172.21.15.77:0/745458947 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c010ddd0 con 0x7f88c01026b0 2024-04-25T02:15:19.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.381+0000 7f88c79b3700 1 -- 172.21.15.77:0/745458947 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c010e390 con 0x7f88c01026b0 2024-04-25T02:15:19.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.382+0000 7f88c79b3700 1 -- 172.21.15.77:0/745458947 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c00fd460 con 0x7f88c01026b0 2024-04-25T02:15:19.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.382+0000 7f88b5ffb700 1 -- 172.21.15.77:0/745458947 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f88b000dcd0 con 0x7f88c01026b0 2024-04-25T02:15:19.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.382+0000 7f88b5ffb700 1 --2- 172.21.15.77:0/745458947 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f88ac06e140 0x7f88ac0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:19.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.382+0000 7f88b5ffb700 1 -- 172.21.15.77:0/745458947 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f88b008d190 con 0x7f88c01026b0 2024-04-25T02:15:19.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.383+0000 7f88c574f700 1 --2- 172.21.15.77:0/745458947 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f88ac06e140 0x7f88ac0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:19.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.383+0000 7f88c574f700 1 --2- 172.21.15.77:0/745458947 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f88ac06e140 0x7f88ac0705f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f88bc00b020 tx=0x7f88bc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:19.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.387+0000 7f88b5ffb700 1 -- 172.21.15.77:0/745458947 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f88b005a090 con 0x7f88c01026b0 2024-04-25T02:15:19.661 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:19 smithi077 podman[126783]: 2024-04-25 02:15:19.407043849 +0000 UTC m=+0.569809769 container remove 973829605d954524ddece323f54697815aefaf6786b0789af14265733824ac13 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=squid-d2c45d9, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0) 2024-04-25T02:15:19.661 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:19 smithi077 systemd[1]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.1.service: Deactivated successfully. 2024-04-25T02:15:19.661 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:19 smithi077 systemd[1]: Stopped Ceph osd.1 for 4bb93d82-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:15:19.661 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:19 smithi077 systemd[1]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.1.service: Consumed 1min 7.173s CPU time. 2024-04-25T02:15:19.696 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_WARN 1 osds down; Reduced data availability: 3 pgs peering 2024-04-25T02:15:19.696 INFO:teuthology.orchestra.run.smithi077.stdout:[WRN] OSD_DOWN: 1 osds down 2024-04-25T02:15:19.696 INFO:teuthology.orchestra.run.smithi077.stdout: osd.1 (root=default,host=smithi077) is down 2024-04-25T02:15:19.696 INFO:teuthology.orchestra.run.smithi077.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 3 pgs peering 2024-04-25T02:15:19.696 INFO:teuthology.orchestra.run.smithi077.stdout: pg 2.4 is stuck peering for 4m, current state peering, last acting [0,4] 2024-04-25T02:15:19.696 INFO:teuthology.orchestra.run.smithi077.stdout: pg 2.1b is stuck peering for 4m, current state peering, last acting [0,5] 2024-04-25T02:15:19.696 INFO:teuthology.orchestra.run.smithi077.stdout: pg 3.b is stuck peering for 4m, current state peering, last acting [0,4] 2024-04-25T02:15:19.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.689+0000 7f88c79b3700 1 -- 172.21.15.77:0/745458947 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f88c0108e10 con 0x7f88c01026b0 2024-04-25T02:15:19.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.690+0000 7f88b5ffb700 1 -- 172.21.15.77:0/745458947 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+438 (secure 0 0 0) 0x7f88b0059c20 con 0x7f88c01026b0 2024-04-25T02:15:19.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.694+0000 7f88c79b3700 1 -- 172.21.15.77:0/745458947 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f88ac06e140 msgr2=0x7f88ac0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:19.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.694+0000 7f88c79b3700 1 --2- 172.21.15.77:0/745458947 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f88ac06e140 0x7f88ac0705f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f88bc00b020 tx=0x7f88bc009e30 comp rx=0 tx=0).stop 2024-04-25T02:15:19.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.694+0000 7f88c79b3700 1 -- 172.21.15.77:0/745458947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88c01026b0 msgr2=0x7f88c0113ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:19.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.694+0000 7f88c79b3700 1 --2- 172.21.15.77:0/745458947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88c01026b0 0x7f88c0113ea0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f88b0002a50 tx=0x7f88b0004630 comp rx=0 tx=0).stop 2024-04-25T02:15:19.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.694+0000 7f88c79b3700 1 -- 172.21.15.77:0/745458947 shutdown_connections 2024-04-25T02:15:19.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.694+0000 7f88c79b3700 1 --2- 172.21.15.77:0/745458947 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f88ac06e140 0x7f88ac0705f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:19.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.694+0000 7f88c79b3700 1 --2- 172.21.15.77:0/745458947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88c0101d10 0x7f88c0113960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:19.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.694+0000 7f88c79b3700 1 --2- 172.21.15.77:0/745458947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88c01026b0 0x7f88c0113ea0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:19.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.694+0000 7f88c79b3700 1 -- 172.21.15.77:0/745458947 >> 172.21.15.77:0/745458947 conn(0x7f88c00f78e0 msgr2=0x7f88c0066290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:19.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.694+0000 7f88c79b3700 1 -- 172.21.15.77:0/745458947 shutdown_connections 2024-04-25T02:15:19.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:19.694+0000 7f88c79b3700 1 -- 172.21.15.77:0/745458947 wait complete. 2024-04-25T02:15:19.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:19 smithi077 ceph-mon[110441]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:15:19.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:19 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/2090201122' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:15:19.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:19 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/745458947' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T02:15:19.979 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:19 smithi077 systemd[1]: Starting Ceph osd.1 for 4bb93d82-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:15:19.979 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:19 smithi077 podman[126936]: 2024-04-25 02:15:19.786419805 +0000 UTC m=+0.021134192 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:15:19.979 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:19 smithi077 podman[126936]: 2024-04-25 02:15:19.8977439 +0000 UTC m=+0.132458280 container create 9187fbfa161d6a275eee527066df13ff3938459e65c6590a02e2f6e6b6b2c797 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1-activate, GIT_CLEAN=True, RELEASE=squid-d2c45d9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-25T02:15:20.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:19 smithi112 ceph-mon[80494]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:15:20.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:19 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/2090201122' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:15:20.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:19 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/745458947' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T02:15:20.478 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:20 smithi077 podman[126936]: 2024-04-25 02:15:20.126274148 +0000 UTC m=+0.360988539 container init 9187fbfa161d6a275eee527066df13ff3938459e65c6590a02e2f6e6b6b2c797 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-d2c45d9, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:15:20.478 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:20 smithi077 podman[126936]: 2024-04-25 02:15:20.130530874 +0000 UTC m=+0.365245252 container start 9187fbfa161d6a275eee527066df13ff3938459e65c6590a02e2f6e6b6b2c797 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1-activate, org.label-schema.vendor=CentOS, RELEASE=squid-d2c45d9, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD) 2024-04-25T02:15:20.478 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:20 smithi077 podman[126936]: 2024-04-25 02:15:20.208976046 +0000 UTC m=+0.443690432 container attach 9187fbfa161d6a275eee527066df13ff3938459e65c6590a02e2f6e6b6b2c797 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1-activate, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-04-25T02:15:20.905 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:20 smithi077 ceph-mon[110441]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:15:20.905 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:20 smithi077 ceph-mon[110441]: pgmap v68: 65 pgs: 11 active+undersized+degraded, 5 peering, 18 active+undersized, 31 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-04-25T02:15:20.905 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:20 smithi077 ceph-mon[110441]: Health check failed: Degraded data redundancy: 29/219 objects degraded (13.242%), 11 pgs degraded (PG_DEGRADED) 2024-04-25T02:15:20.906 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:20 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1-activate[126958]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T02:15:20.906 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:20 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1-activate[126958]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-25T02:15:20.906 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:20 smithi077 bash[126936]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T02:15:20.906 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:20 smithi077 bash[126936]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-25T02:15:20.906 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:20 smithi077 bash[126936]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-25T02:15:20.906 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:20 smithi077 bash[126936]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-25T02:15:20.906 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:20 smithi077 bash[126936]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-04-25T02:15:20.906 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:20 smithi077 bash[126936]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T02:15:20.906 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:20 smithi077 bash[126936]: --> ceph-volume raw activate successful for osd ID: 1 2024-04-25T02:15:20.906 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:20 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1-activate[126958]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-25T02:15:20.906 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:20 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1-activate[126958]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-25T02:15:20.907 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:20 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1-activate[126958]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-04-25T02:15:20.907 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:20 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1-activate[126958]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T02:15:20.907 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:20 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1-activate[126958]: --> ceph-volume raw activate successful for osd ID: 1 2024-04-25T02:15:20.907 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:20 smithi077 podman[126936]: 2024-04-25 02:15:20.603902641 +0000 UTC m=+0.838617013 container died 9187fbfa161d6a275eee527066df13ff3938459e65c6590a02e2f6e6b6b2c797 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1-activate, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424) 2024-04-25T02:15:21.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:20 smithi112 ceph-mon[80494]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:15:21.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:20 smithi112 ceph-mon[80494]: pgmap v68: 65 pgs: 11 active+undersized+degraded, 5 peering, 18 active+undersized, 31 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-04-25T02:15:21.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:20 smithi112 ceph-mon[80494]: Health check failed: Degraded data redundancy: 29/219 objects degraded (13.242%), 11 pgs degraded (PG_DEGRADED) 2024-04-25T02:15:21.478 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:21 smithi077 podman[127094]: 2024-04-25 02:15:21.171241309 +0000 UTC m=+0.562546174 container remove 9187fbfa161d6a275eee527066df13ff3938459e65c6590a02e2f6e6b6b2c797 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1-activate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-d2c45d9, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-25T02:15:21.478 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:21 smithi077 podman[127159]: 2024-04-25 02:15:21.286822156 +0000 UTC m=+0.018307045 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:15:21.478 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:21 smithi077 podman[127159]: 2024-04-25 02:15:21.388674196 +0000 UTC m=+0.120159076 container create 6e514f700c365ce5acc1b742ee9376ebb9c9aa53a7e0da8282e0f5fa42f9fb01 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-d2c45d9, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T02:15:21.978 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:21 smithi077 podman[127159]: 2024-04-25 02:15:21.56634028 +0000 UTC m=+0.297825160 container init 6e514f700c365ce5acc1b742ee9376ebb9c9aa53a7e0da8282e0f5fa42f9fb01 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:15:21.979 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:21 smithi077 podman[127159]: 2024-04-25 02:15:21.569359269 +0000 UTC m=+0.300844156 container start 6e514f700c365ce5acc1b742ee9376ebb9c9aa53a7e0da8282e0f5fa42f9fb01 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240424) 2024-04-25T02:15:21.979 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:21 smithi077 ceph-osd[127178]: -- 172.21.15.77:0/826642414 <== mon.0 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5570cb21b680 con 0x5570cb1e5000 2024-04-25T02:15:21.979 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:21 smithi077 bash[127159]: 6e514f700c365ce5acc1b742ee9376ebb9c9aa53a7e0da8282e0f5fa42f9fb01 2024-04-25T02:15:21.979 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:21 smithi077 systemd[1]: Started Ceph osd.1 for 4bb93d82-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:15:22.479 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:22 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1[127174]: 2024-04-25T02:15:22.116+0000 7f7455b1c7c0 -1 Falling back to public interface 2024-04-25T02:15:22.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:22 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:22.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:22 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:22.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:22 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:15:22.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:22 smithi077 ceph-mon[110441]: pgmap v69: 65 pgs: 11 active+undersized+degraded, 5 peering, 18 active+undersized, 31 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-04-25T02:15:23.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:22 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:23.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:22 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:23.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:22 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:15:23.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:22 smithi112 ceph-mon[80494]: pgmap v69: 65 pgs: 11 active+undersized+degraded, 5 peering, 18 active+undersized, 31 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-04-25T02:15:24.917 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:24 smithi077 ceph-mon[110441]: pgmap v70: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-04-25T02:15:24.917 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:24 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:24.917 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:24 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:15:24.917 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:24 smithi077 ceph-mon[110441]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-04-25T02:15:25.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:24 smithi112 ceph-mon[80494]: pgmap v70: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-04-25T02:15:25.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:24 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:25.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:24 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:15:25.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:24 smithi112 ceph-mon[80494]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-04-25T02:15:27.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:26 smithi077 ceph-mon[110441]: pgmap v71: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-04-25T02:15:27.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:26 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:27.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:26 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:27.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:26 smithi112 ceph-mon[80494]: pgmap v71: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-04-25T02:15:27.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:26 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:27.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:26 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:27.729 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:27 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1[127174]: 2024-04-25T02:15:27.242+0000 7f7455b1c7c0 -1 osd.1 55 log_to_monitors true 2024-04-25T02:15:28.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:27 smithi077 ceph-mon[110441]: from='osd.1 [v2:172.21.15.77:6810/79281053,v1:172.21.15.77:6811/79281053]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T02:15:28.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:27 smithi112 ceph-mon[80494]: from='osd.1 [v2:172.21.15.77:6810/79281053,v1:172.21.15.77:6811/79281053]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T02:15:28.728 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:15:28 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1[127174]: 2024-04-25T02:15:28.602+0000 7f7442f6c700 -1 osd.1 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:15:29.086 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:28 smithi077 ceph-mon[110441]: pgmap v72: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-04-25T02:15:29.087 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:28 smithi077 ceph-mon[110441]: from='osd.1 [v2:172.21.15.77:6810/79281053,v1:172.21.15.77:6811/79281053]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-25T02:15:29.087 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:28 smithi077 ceph-mon[110441]: osdmap e58: 6 total, 5 up, 6 in 2024-04-25T02:15:29.087 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:28 smithi077 ceph-mon[110441]: from='osd.1 [v2:172.21.15.77:6810/79281053,v1:172.21.15.77:6811/79281053]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-04-25T02:15:29.087 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:28 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:29.087 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:28 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:29.087 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:28 smithi077 ceph-mon[110441]: from='osd.1 [v2:172.21.15.77:6810/79281053,v1:172.21.15.77:6811/79281053]' entity='osd.1' 2024-04-25T02:15:29.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:28 smithi112 ceph-mon[80494]: pgmap v72: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-04-25T02:15:29.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:28 smithi112 ceph-mon[80494]: from='osd.1 [v2:172.21.15.77:6810/79281053,v1:172.21.15.77:6811/79281053]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-25T02:15:29.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:28 smithi112 ceph-mon[80494]: osdmap e58: 6 total, 5 up, 6 in 2024-04-25T02:15:29.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:28 smithi112 ceph-mon[80494]: from='osd.1 [v2:172.21.15.77:6810/79281053,v1:172.21.15.77:6811/79281053]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-04-25T02:15:29.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:28 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:29.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:28 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:29.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:28 smithi112 ceph-mon[80494]: from='osd.1 [v2:172.21.15.77:6810/79281053,v1:172.21.15.77:6811/79281053]' entity='osd.1' 2024-04-25T02:15:30.075 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:29 smithi077 ceph-mon[110441]: Health check update: Degraded data redundancy: 31/219 objects degraded (14.155%), 13 pgs degraded (PG_DEGRADED) 2024-04-25T02:15:30.075 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:29 smithi077 ceph-mon[110441]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-25T02:15:30.075 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:29 smithi077 ceph-mon[110441]: osd.1 [v2:172.21.15.77:6810/79281053,v1:172.21.15.77:6811/79281053] boot 2024-04-25T02:15:30.075 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:29 smithi077 ceph-mon[110441]: osdmap e59: 6 total, 6 up, 6 in 2024-04-25T02:15:30.075 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:29 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:15:30.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:29 smithi112 ceph-mon[80494]: Health check update: Degraded data redundancy: 31/219 objects degraded (14.155%), 13 pgs degraded (PG_DEGRADED) 2024-04-25T02:15:30.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:29 smithi112 ceph-mon[80494]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-25T02:15:30.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:29 smithi112 ceph-mon[80494]: osd.1 [v2:172.21.15.77:6810/79281053,v1:172.21.15.77:6811/79281053] boot 2024-04-25T02:15:30.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:29 smithi112 ceph-mon[80494]: osdmap e59: 6 total, 6 up, 6 in 2024-04-25T02:15:30.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:29 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:15:31.066 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:30 smithi077 ceph-mon[110441]: pgmap v75: 65 pgs: 20 peering, 7 active+undersized+degraded, 7 active+undersized, 31 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2024-04-25T02:15:31.067 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:30 smithi077 ceph-mon[110441]: osdmap e60: 6 total, 6 up, 6 in 2024-04-25T02:15:31.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:30 smithi112 ceph-mon[80494]: pgmap v75: 65 pgs: 20 peering, 7 active+undersized+degraded, 7 active+undersized, 31 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2024-04-25T02:15:31.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:30 smithi112 ceph-mon[80494]: osdmap e60: 6 total, 6 up, 6 in 2024-04-25T02:15:33.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:32 smithi112 ceph-mon[80494]: pgmap v77: 65 pgs: 20 peering, 7 active+undersized+degraded, 7 active+undersized, 31 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2024-04-25T02:15:33.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:32 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:33.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:32 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:33.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:32 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:15:33.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:32 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:15:33.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:32 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:33.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:32 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:15:33.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:32 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:15:33.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:32 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:15:33.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:32 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:15:33.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:32 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-25T02:15:33.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:32 smithi112 ceph-mon[80494]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-25T02:15:33.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:32 smithi112 ceph-mon[80494]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-04-25T02:15:33.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:32 smithi077 ceph-mon[110441]: pgmap v77: 65 pgs: 20 peering, 7 active+undersized+degraded, 7 active+undersized, 31 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2024-04-25T02:15:33.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:32 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:33.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:32 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:33.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:32 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:15:33.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:32 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:15:33.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:32 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:33.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:32 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:15:33.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:32 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:15:33.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:32 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:15:33.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:32 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:15:33.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:32 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-25T02:15:33.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:32 smithi077 ceph-mon[110441]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-25T02:15:33.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:32 smithi077 ceph-mon[110441]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-04-25T02:15:34.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:33 smithi077 ceph-mon[110441]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/219 objects degraded (7.306%), 7 pgs degraded) 2024-04-25T02:15:34.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:33 smithi077 ceph-mon[110441]: Cluster is now healthy 2024-04-25T02:15:34.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:33 smithi112 ceph-mon[80494]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/219 objects degraded (7.306%), 7 pgs degraded) 2024-04-25T02:15:34.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:33 smithi112 ceph-mon[80494]: Cluster is now healthy 2024-04-25T02:15:35.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:34 smithi077 ceph-mon[110441]: pgmap v78: 65 pgs: 20 peering, 45 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:15:35.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:34 smithi112 ceph-mon[80494]: pgmap v78: 65 pgs: 20 peering, 45 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:15:37.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:36 smithi077 ceph-mon[110441]: pgmap v79: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:15:37.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:36 smithi112 ceph-mon[80494]: pgmap v79: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:15:39.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:38 smithi077 ceph-mon[110441]: pgmap v80: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:15:39.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:38 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:39.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:38 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:15:39.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:38 smithi112 ceph-mon[80494]: pgmap v80: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:15:39.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:38 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:39.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:38 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:15:41.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:40 smithi077 ceph-mon[110441]: pgmap v81: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:15:41.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:40 smithi112 ceph-mon[80494]: pgmap v81: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:15:43.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:42 smithi077 ceph-mon[110441]: pgmap v82: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:15:43.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:42 smithi112 ceph-mon[80494]: pgmap v82: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:15:45.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:44 smithi077 ceph-mon[110441]: pgmap v83: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:15:45.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:44 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:45.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:44 smithi112 ceph-mon[80494]: pgmap v83: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:15:45.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:44 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:47.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:46 smithi077 ceph-mon[110441]: pgmap v84: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:15:47.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:46 smithi112 ceph-mon[80494]: pgmap v84: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:15:48.179 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:47 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-25T02:15:48.179 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:47 smithi112 ceph-mon[80494]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-25T02:15:48.180 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:47 smithi112 ceph-mon[80494]: Upgrade: osd.2 is safe to restart 2024-04-25T02:15:48.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:47 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-25T02:15:48.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:47 smithi077 ceph-mon[110441]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-25T02:15:48.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:47 smithi077 ceph-mon[110441]: Upgrade: osd.2 is safe to restart 2024-04-25T02:15:49.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:48 smithi077 ceph-mon[110441]: pgmap v85: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:15:49.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:48 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:49.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:48 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-25T02:15:49.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:48 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:15:49.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:48 smithi112 ceph-mon[80494]: pgmap v85: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:15:49.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:48 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:49.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:48 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-25T02:15:49.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:48 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:15:49.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.815+0000 7fd11a926700 1 -- 172.21.15.77:0/2210904340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd114101d70 msgr2=0x7fd114102140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:49.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.815+0000 7fd11a926700 1 --2- 172.21.15.77:0/2210904340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd114101d70 0x7fd114102140 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd104004940 tx=0x7fd104009e30 comp rx=0 tx=0).stop 2024-04-25T02:15:49.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.817+0000 7fd11a926700 1 -- 172.21.15.77:0/2210904340 shutdown_connections 2024-04-25T02:15:49.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.817+0000 7fd11a926700 1 --2- 172.21.15.77:0/2210904340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1140fc4d0 0x7fd1140fc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:49.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.817+0000 7fd11a926700 1 --2- 172.21.15.77:0/2210904340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd114101d70 0x7fd114102140 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:49.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.817+0000 7fd11a926700 1 -- 172.21.15.77:0/2210904340 >> 172.21.15.77:0/2210904340 conn(0x7fd114072320 msgr2=0x7fd114072720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:49.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.817+0000 7fd11a926700 1 -- 172.21.15.77:0/2210904340 shutdown_connections 2024-04-25T02:15:49.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.817+0000 7fd11a926700 1 -- 172.21.15.77:0/2210904340 wait complete. 2024-04-25T02:15:49.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.818+0000 7fd11a926700 1 Processor -- start 2024-04-25T02:15:49.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.818+0000 7fd11a926700 1 -- start start 2024-04-25T02:15:49.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.819+0000 7fd11a926700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1140fc4d0 0x7fd114112920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:49.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.819+0000 7fd11a926700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd114101d70 0x7fd114112e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:49.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.819+0000 7fd11a926700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1141134b0 con 0x7fd114101d70 2024-04-25T02:15:49.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.819+0000 7fd11a926700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11410cab0 con 0x7fd1140fc4d0 2024-04-25T02:15:49.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.819+0000 7fd1137fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd114101d70 0x7fd114112e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:49.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.819+0000 7fd1137fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd114101d70 0x7fd114112e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38062/0 (socket says 172.21.15.77:38062) 2024-04-25T02:15:49.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.819+0000 7fd1137fe700 1 -- 172.21.15.77:0/3597045068 learned_addr learned my addr 172.21.15.77:0/3597045068 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:15:49.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.819+0000 7fd113fff700 1 --2- 172.21.15.77:0/3597045068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1140fc4d0 0x7fd114112920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:49.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.819+0000 7fd1137fe700 1 -- 172.21.15.77:0/3597045068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1140fc4d0 msgr2=0x7fd114112920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:49.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.819+0000 7fd1137fe700 1 --2- 172.21.15.77:0/3597045068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1140fc4d0 0x7fd114112920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:49.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.819+0000 7fd1137fe700 1 -- 172.21.15.77:0/3597045068 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd104005040 con 0x7fd114101d70 2024-04-25T02:15:49.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.819+0000 7fd113fff700 1 --2- 172.21.15.77:0/3597045068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1140fc4d0 0x7fd114112920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:15:49.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.819+0000 7fd1137fe700 1 --2- 172.21.15.77:0/3597045068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd114101d70 0x7fd114112e60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd10800fce0 tx=0x7fd1080046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:49.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.820+0000 7fd110ff9700 1 -- 172.21.15.77:0/3597045068 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd108007ea0 con 0x7fd114101d70 2024-04-25T02:15:49.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.820+0000 7fd11a926700 1 -- 172.21.15.77:0/3597045068 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd11410cd30 con 0x7fd114101d70 2024-04-25T02:15:49.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.820+0000 7fd110ff9700 1 -- 172.21.15.77:0/3597045068 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd10800dda0 con 0x7fd114101d70 2024-04-25T02:15:49.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.820+0000 7fd11a926700 1 -- 172.21.15.77:0/3597045068 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd11410d270 con 0x7fd114101d70 2024-04-25T02:15:49.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.820+0000 7fd110ff9700 1 -- 172.21.15.77:0/3597045068 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd108012640 con 0x7fd114101d70 2024-04-25T02:15:49.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.821+0000 7fd11a926700 1 -- 172.21.15.77:0/3597045068 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1140fd4e0 con 0x7fd114101d70 2024-04-25T02:15:49.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.822+0000 7fd110ff9700 1 -- 172.21.15.77:0/3597045068 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd10800d8d0 con 0x7fd114101d70 2024-04-25T02:15:49.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.822+0000 7fd110ff9700 1 --2- 172.21.15.77:0/3597045068 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd0fc06e140 0x7fd0fc0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:49.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.822+0000 7fd110ff9700 1 -- 172.21.15.77:0/3597045068 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd108090560 con 0x7fd114101d70 2024-04-25T02:15:49.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.822+0000 7fd113fff700 1 --2- 172.21.15.77:0/3597045068 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd0fc06e140 0x7fd0fc0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:49.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.823+0000 7fd113fff700 1 --2- 172.21.15.77:0/3597045068 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd0fc06e140 0x7fd0fc0705f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd104004890 tx=0x7fd104009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:49.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:49.829+0000 7fd110ff9700 1 -- 172.21.15.77:0/3597045068 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fd10805d460 con 0x7fd114101d70 2024-04-25T02:15:50.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.054+0000 7fd11a926700 1 -- 172.21.15.77:0/3597045068 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd114108df0 con 0x7fd0fc06e140 2024-04-25T02:15:50.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.055+0000 7fd110ff9700 1 -- 172.21.15.77:0/3597045068 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd114108df0 con 0x7fd0fc06e140 2024-04-25T02:15:50.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.057+0000 7fd11a926700 1 -- 172.21.15.77:0/3597045068 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd0fc06e140 msgr2=0x7fd0fc0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:50.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.057+0000 7fd11a926700 1 --2- 172.21.15.77:0/3597045068 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd0fc06e140 0x7fd0fc0705f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd104004890 tx=0x7fd104009e30 comp rx=0 tx=0).stop 2024-04-25T02:15:50.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.057+0000 7fd11a926700 1 -- 172.21.15.77:0/3597045068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd114101d70 msgr2=0x7fd114112e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:50.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.057+0000 7fd11a926700 1 --2- 172.21.15.77:0/3597045068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd114101d70 0x7fd114112e60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd10800fce0 tx=0x7fd1080046b0 comp rx=0 tx=0).stop 2024-04-25T02:15:50.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.057+0000 7fd11a926700 1 -- 172.21.15.77:0/3597045068 shutdown_connections 2024-04-25T02:15:50.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.057+0000 7fd11a926700 1 --2- 172.21.15.77:0/3597045068 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd0fc06e140 0x7fd0fc0705f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:50.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.057+0000 7fd11a926700 1 --2- 172.21.15.77:0/3597045068 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1140fc4d0 0x7fd114112920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:50.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.057+0000 7fd11a926700 1 --2- 172.21.15.77:0/3597045068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd114101d70 0x7fd114112e60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:50.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.057+0000 7fd11a926700 1 -- 172.21.15.77:0/3597045068 >> 172.21.15.77:0/3597045068 conn(0x7fd114072320 msgr2=0x7fd114104aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:50.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.057+0000 7fd11a926700 1 -- 172.21.15.77:0/3597045068 shutdown_connections 2024-04-25T02:15:50.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.057+0000 7fd11a926700 1 -- 172.21.15.77:0/3597045068 wait complete. 2024-04-25T02:15:50.073 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-04-25T02:15:50.073 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:49 smithi077 ceph-mon[110441]: Upgrade: Updating osd.2 2024-04-25T02:15:50.073 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:49 smithi077 ceph-mon[110441]: Deploying daemon osd.2 on smithi077 2024-04-25T02:15:50.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.164+0000 7fc1ef0d7700 1 -- 172.21.15.77:0/2958887685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1e8102e50 msgr2=0x7fc1e8103220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:50.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.164+0000 7fc1ef0d7700 1 --2- 172.21.15.77:0/2958887685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1e8102e50 0x7fc1e8103220 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc004940 tx=0x7fc1dc009e30 comp rx=0 tx=0).stop 2024-04-25T02:15:50.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.164+0000 7fc1ef0d7700 1 -- 172.21.15.77:0/2958887685 shutdown_connections 2024-04-25T02:15:50.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.164+0000 7fc1ef0d7700 1 --2- 172.21.15.77:0/2958887685 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1e8065640 0x7fc1e8065ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:50.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.164+0000 7fc1ef0d7700 1 --2- 172.21.15.77:0/2958887685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1e8102e50 0x7fc1e8103220 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:50.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.164+0000 7fc1ef0d7700 1 -- 172.21.15.77:0/2958887685 >> 172.21.15.77:0/2958887685 conn(0x7fc1e8071d00 msgr2=0x7fc1e8072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:50.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.164+0000 7fc1ef0d7700 1 -- 172.21.15.77:0/2958887685 shutdown_connections 2024-04-25T02:15:50.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.164+0000 7fc1ef0d7700 1 -- 172.21.15.77:0/2958887685 wait complete. 2024-04-25T02:15:50.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.164+0000 7fc1ef0d7700 1 Processor -- start 2024-04-25T02:15:50.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.165+0000 7fc1ef0d7700 1 -- start start 2024-04-25T02:15:50.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.165+0000 7fc1ef0d7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1e8065640 0x7fc1e8113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:50.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.165+0000 7fc1ef0d7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1e8102e50 0x7fc1e81140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:50.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.165+0000 7fc1ef0d7700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e8114710 con 0x7fc1e8065640 2024-04-25T02:15:50.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.165+0000 7fc1ef0d7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e810db00 con 0x7fc1e8102e50 2024-04-25T02:15:50.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.165+0000 7fc1ece73700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1e8065640 0x7fc1e8113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:50.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.165+0000 7fc1ece73700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1e8065640 0x7fc1e8113b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38078/0 (socket says 172.21.15.77:38078) 2024-04-25T02:15:50.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.165+0000 7fc1ece73700 1 -- 172.21.15.77:0/1017168156 learned_addr learned my addr 172.21.15.77:0/1017168156 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:15:50.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.165+0000 7fc1e7fff700 1 --2- 172.21.15.77:0/1017168156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1e8102e50 0x7fc1e81140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:50.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.165+0000 7fc1ece73700 1 -- 172.21.15.77:0/1017168156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1e8102e50 msgr2=0x7fc1e81140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:50.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.165+0000 7fc1ece73700 1 --2- 172.21.15.77:0/1017168156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1e8102e50 0x7fc1e81140c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:50.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.165+0000 7fc1ece73700 1 -- 172.21.15.77:0/1017168156 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1dc005040 con 0x7fc1e8065640 2024-04-25T02:15:50.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.166+0000 7fc1ece73700 1 --2- 172.21.15.77:0/1017168156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1e8065640 0x7fc1e8113b80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc00b3b0 tx=0x7fc1dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:50.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.166+0000 7fc1e57fa700 1 -- 172.21.15.77:0/1017168156 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1dc00e040 con 0x7fc1e8065640 2024-04-25T02:15:50.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.166+0000 7fc1ef0d7700 1 -- 172.21.15.77:0/1017168156 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e810dd80 con 0x7fc1e8065640 2024-04-25T02:15:50.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.166+0000 7fc1e57fa700 1 -- 172.21.15.77:0/1017168156 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc1dc013420 con 0x7fc1e8065640 2024-04-25T02:15:50.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.166+0000 7fc1ef0d7700 1 -- 172.21.15.77:0/1017168156 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e810e340 con 0x7fc1e8065640 2024-04-25T02:15:50.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.166+0000 7fc1e57fa700 1 -- 172.21.15.77:0/1017168156 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1dc01c630 con 0x7fc1e8065640 2024-04-25T02:15:50.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.167+0000 7fc1ef0d7700 1 -- 172.21.15.77:0/1017168156 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e8100100 con 0x7fc1e8065640 2024-04-25T02:15:50.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.167+0000 7fc1e57fa700 1 -- 172.21.15.77:0/1017168156 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc1dc013590 con 0x7fc1e8065640 2024-04-25T02:15:50.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.168+0000 7fc1e57fa700 1 --2- 172.21.15.77:0/1017168156 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc1d806e140 0x7fc1d80705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:50.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.168+0000 7fc1e57fa700 1 -- 172.21.15.77:0/1017168156 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc1dc08ebd0 con 0x7fc1e8065640 2024-04-25T02:15:50.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.168+0000 7fc1e7fff700 1 --2- 172.21.15.77:0/1017168156 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc1d806e140 0x7fc1d80705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:50.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.168+0000 7fc1e7fff700 1 --2- 172.21.15.77:0/1017168156 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc1d806e140 0x7fc1d80705f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc1e810ecc0 tx=0x7fc1d400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:50.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.172+0000 7fc1e57fa700 1 -- 172.21.15.77:0/1017168156 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fc1dc05bb50 con 0x7fc1e8065640 2024-04-25T02:15:50.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:49 smithi112 ceph-mon[80494]: Upgrade: Updating osd.2 2024-04-25T02:15:50.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:49 smithi112 ceph-mon[80494]: Deploying daemon osd.2 on smithi077 2024-04-25T02:15:50.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.406+0000 7fc1ef0d7700 1 -- 172.21.15.77:0/1017168156 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1e810f1d0 con 0x7fc1d806e140 2024-04-25T02:15:50.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.408+0000 7fc1e57fa700 1 -- 172.21.15.77:0/1017168156 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc1e810f1d0 con 0x7fc1d806e140 2024-04-25T02:15:50.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.410+0000 7fc1ef0d7700 1 -- 172.21.15.77:0/1017168156 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc1d806e140 msgr2=0x7fc1d80705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:50.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.410+0000 7fc1ef0d7700 1 --2- 172.21.15.77:0/1017168156 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc1d806e140 0x7fc1d80705f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc1e810ecc0 tx=0x7fc1d400b040 comp rx=0 tx=0).stop 2024-04-25T02:15:50.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.410+0000 7fc1ef0d7700 1 -- 172.21.15.77:0/1017168156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1e8065640 msgr2=0x7fc1e8113b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:50.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.410+0000 7fc1ef0d7700 1 --2- 172.21.15.77:0/1017168156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1e8065640 0x7fc1e8113b80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc00b3b0 tx=0x7fc1dc009e30 comp rx=0 tx=0).stop 2024-04-25T02:15:50.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.410+0000 7fc1ef0d7700 1 -- 172.21.15.77:0/1017168156 shutdown_connections 2024-04-25T02:15:50.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.410+0000 7fc1ef0d7700 1 --2- 172.21.15.77:0/1017168156 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc1d806e140 0x7fc1d80705f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:50.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.410+0000 7fc1ef0d7700 1 --2- 172.21.15.77:0/1017168156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1e8065640 0x7fc1e8113b80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:50.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.410+0000 7fc1ef0d7700 1 --2- 172.21.15.77:0/1017168156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1e8102e50 0x7fc1e81140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:50.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.410+0000 7fc1ef0d7700 1 -- 172.21.15.77:0/1017168156 >> 172.21.15.77:0/1017168156 conn(0x7fc1e8071d00 msgr2=0x7fc1e80fb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:50.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.410+0000 7fc1ef0d7700 1 -- 172.21.15.77:0/1017168156 shutdown_connections 2024-04-25T02:15:50.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.410+0000 7fc1ef0d7700 1 -- 172.21.15.77:0/1017168156 wait complete. 2024-04-25T02:15:50.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.514+0000 7f811432d700 1 -- 172.21.15.77:0/3227599285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f810c0fc4d0 msgr2=0x7f810c0fc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:50.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.514+0000 7f811432d700 1 --2- 172.21.15.77:0/3227599285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f810c0fc4d0 0x7f810c0fc940 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f80fc004940 tx=0x7f80fc009e30 comp rx=0 tx=0).stop 2024-04-25T02:15:50.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.515+0000 7f811432d700 1 -- 172.21.15.77:0/3227599285 shutdown_connections 2024-04-25T02:15:50.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.515+0000 7f811432d700 1 --2- 172.21.15.77:0/3227599285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f810c0fc4d0 0x7f810c0fc940 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:50.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.515+0000 7f811432d700 1 --2- 172.21.15.77:0/3227599285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f810c101d70 0x7f810c102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:50.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.515+0000 7f811432d700 1 -- 172.21.15.77:0/3227599285 >> 172.21.15.77:0/3227599285 conn(0x7f810c072320 msgr2=0x7f810c072720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:50.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.515+0000 7f811432d700 1 -- 172.21.15.77:0/3227599285 shutdown_connections 2024-04-25T02:15:50.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.515+0000 7f811432d700 1 -- 172.21.15.77:0/3227599285 wait complete. 2024-04-25T02:15:50.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.515+0000 7f811432d700 1 Processor -- start 2024-04-25T02:15:50.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.515+0000 7f811432d700 1 -- start start 2024-04-25T02:15:50.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.516+0000 7f811432d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f810c0fc4d0 0x7f810c112800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:50.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.516+0000 7f811432d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f810c101d70 0x7f810c112d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:50.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.516+0000 7f811432d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c113390 con 0x7f810c0fc4d0 2024-04-25T02:15:50.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.516+0000 7f811432d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c10c990 con 0x7f810c101d70 2024-04-25T02:15:50.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.516+0000 7f81120c9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f810c0fc4d0 0x7f810c112800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.516+0000 7f81120c9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f810c0fc4d0 0x7f810c112800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38100/0 (socket says 172.21.15.77:38100) 2024-04-25T02:15:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.516+0000 7f81120c9700 1 -- 172.21.15.77:0/3466127298 learned_addr learned my addr 172.21.15.77:0/3466127298 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:15:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.516+0000 7f81120c9700 1 -- 172.21.15.77:0/3466127298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f810c101d70 msgr2=0x7f810c112d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.516+0000 7f81118c8700 1 --2- 172.21.15.77:0/3466127298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f810c101d70 0x7f810c112d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.516+0000 7f81120c9700 1 --2- 172.21.15.77:0/3466127298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f810c101d70 0x7f810c112d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.516+0000 7f81120c9700 1 -- 172.21.15.77:0/3466127298 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80fc005040 con 0x7f810c0fc4d0 2024-04-25T02:15:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.516+0000 7f81120c9700 1 --2- 172.21.15.77:0/3466127298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f810c0fc4d0 0x7f810c112800 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f810800eb70 tx=0x7f810800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.517+0000 7f8102ffd700 1 -- 172.21.15.77:0/3466127298 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8108007cc0 con 0x7f810c0fc4d0 2024-04-25T02:15:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.517+0000 7f8102ffd700 1 -- 172.21.15.77:0/3466127298 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f810800f040 con 0x7f810c0fc4d0 2024-04-25T02:15:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.517+0000 7f8102ffd700 1 -- 172.21.15.77:0/3466127298 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f810800cbd0 con 0x7f810c0fc4d0 2024-04-25T02:15:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.517+0000 7f811432d700 1 -- 172.21.15.77:0/3466127298 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810c10cc10 con 0x7f810c0fc4d0 2024-04-25T02:15:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.517+0000 7f811432d700 1 -- 172.21.15.77:0/3466127298 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810c10d150 con 0x7f810c0fc4d0 2024-04-25T02:15:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.518+0000 7f811432d700 1 -- 172.21.15.77:0/3466127298 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810c0fd4e0 con 0x7f810c0fc4d0 2024-04-25T02:15:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.518+0000 7f8102ffd700 1 -- 172.21.15.77:0/3466127298 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f810800cd30 con 0x7f810c0fc4d0 2024-04-25T02:15:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.519+0000 7f8102ffd700 1 --2- 172.21.15.77:0/3466127298 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f80f806e140 0x7f80f80705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:50.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.519+0000 7f8102ffd700 1 -- 172.21.15.77:0/3466127298 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f810808d4e0 con 0x7f810c0fc4d0 2024-04-25T02:15:50.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.519+0000 7f81118c8700 1 --2- 172.21.15.77:0/3466127298 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f80f806e140 0x7f80f80705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:50.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.519+0000 7f81118c8700 1 --2- 172.21.15.77:0/3466127298 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f80f806e140 0x7f80f80705f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00b0d0 tx=0x7f80fc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:50.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.524+0000 7f8102ffd700 1 -- 172.21.15.77:0/3466127298 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f810805a510 con 0x7f810c0fc4d0 2024-04-25T02:15:50.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.750+0000 7f811432d700 1 -- 172.21.15.77:0/3466127298 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f810c108e60 con 0x7f80f806e140 2024-04-25T02:15:50.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.769+0000 7f8102ffd700 1 -- 172.21.15.77:0/3466127298 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f810c108e60 con 0x7f80f806e140 2024-04-25T02:15:50.776 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T02:15:50.776 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (4m) 24s ago 14m 26.8M - 0.25.0 c8568f914cd2 699c7fd25ea5 2024-04-25T02:15:50.776 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (90s) 24s ago 15m 6660k - 19.0.0-2445-gd2c45d97 f68e37b807ef f3c45d31e2e3 2024-04-25T02:15:50.776 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi112 smithi112 running (85s) 82s ago 14m 6656k - 19.0.0-2445-gd2c45d97 f68e37b807ef e16d9899ed11 2024-04-25T02:15:50.776 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (3m) 24s ago 14m 80.8M - 9.4.12 2bacad6d85d8 900138b0bcf0 2024-04-25T02:15:50.776 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.gcfygj smithi077 running (9m) 24s ago 9m 15.9M - 17.2.7-902-gc61472c8 0de407c1b3af 382dd7abf674 2024-04-25T02:15:50.776 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.oadrkb smithi077 running (9m) 24s ago 9m 14.1M - 17.2.7-902-gc61472c8 0de407c1b3af 6992064a4b2a 2024-04-25T02:15:50.777 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.dvwudt smithi112 running (9m) 82s ago 9m 156M - 17.2.7-902-gc61472c8 0de407c1b3af 0792e451abfd 2024-04-25T02:15:50.777 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.fjnadi smithi112 running (9m) 82s ago 9m 15.2M - 17.2.7-902-gc61472c8 0de407c1b3af c8093f622f6b 2024-04-25T02:15:50.777 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.zpflzp smithi077 *:8443,9283,8765 running (5m) 24s ago 16m 499M - 19.0.0-2445-gd2c45d97 f68e37b807ef a1af92e027e5 2024-04-25T02:15:50.777 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi112.cswrxs smithi112 *:8443,9283,8765 running (4m) 82s ago 14m 448M - 19.0.0-2445-gd2c45d97 f68e37b807ef ccc7c57d35f2 2024-04-25T02:15:50.777 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (2m) 24s ago 16m 44.8M 2048M 19.0.0-2445-gd2c45d97 f68e37b807ef 06490c2ecc44 2024-04-25T02:15:50.777 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi112 smithi112 running (2m) 82s ago 13m 33.0M 2048M 19.0.0-2445-gd2c45d97 f68e37b807ef ccd1398acbc5 2024-04-25T02:15:50.777 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (4m) 24s ago 15m 16.7M - 1.5.0 0da6a335fe13 2320132606fc 2024-04-25T02:15:50.777 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi112 smithi112 *:9100 running (4m) 82s ago 14m 14.8M - 1.5.0 0da6a335fe13 49f285354791 2024-04-25T02:15:50.777 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (65s) 24s ago 13m 93.6M 1557M 19.0.0-2445-gd2c45d97 f68e37b807ef 7035e288ddae 2024-04-25T02:15:50.777 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (29s) 24s ago 12m 15.1M 1557M 19.0.0-2445-gd2c45d97 f68e37b807ef 6e514f700c36 2024-04-25T02:15:50.777 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (12m) 24s ago 12m 222M 1557M 17.2.7-902-gc61472c8 0de407c1b3af c5d7d8c993f4 2024-04-25T02:15:50.778 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi112 running (11m) 82s ago 11m 292M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 68429d0dbf88 2024-04-25T02:15:50.778 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi112 running (11m) 82s ago 11m 261M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 66eb71201444 2024-04-25T02:15:50.778 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi112 running (11m) 82s ago 11m 240M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 963e700d6aea 2024-04-25T02:15:50.778 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (4m) 24s ago 14m 59.3M - 2.43.0 a07b618ecd1d c5b8c6104d96 2024-04-25T02:15:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.772+0000 7f811432d700 1 -- 172.21.15.77:0/3466127298 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f80f806e140 msgr2=0x7f80f80705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.772+0000 7f811432d700 1 --2- 172.21.15.77:0/3466127298 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f80f806e140 0x7f80f80705f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00b0d0 tx=0x7f80fc009e30 comp rx=0 tx=0).stop 2024-04-25T02:15:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.772+0000 7f811432d700 1 -- 172.21.15.77:0/3466127298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f810c0fc4d0 msgr2=0x7f810c112800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.772+0000 7f811432d700 1 --2- 172.21.15.77:0/3466127298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f810c0fc4d0 0x7f810c112800 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f810800eb70 tx=0x7f810800b040 comp rx=0 tx=0).stop 2024-04-25T02:15:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.772+0000 7f811432d700 1 -- 172.21.15.77:0/3466127298 shutdown_connections 2024-04-25T02:15:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.772+0000 7f811432d700 1 --2- 172.21.15.77:0/3466127298 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f80f806e140 0x7f80f80705f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.772+0000 7f811432d700 1 --2- 172.21.15.77:0/3466127298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f810c0fc4d0 0x7f810c112800 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:50.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.772+0000 7f811432d700 1 --2- 172.21.15.77:0/3466127298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f810c101d70 0x7f810c112d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:50.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.772+0000 7f811432d700 1 -- 172.21.15.77:0/3466127298 >> 172.21.15.77:0/3466127298 conn(0x7f810c072320 msgr2=0x7f810c104aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:50.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.772+0000 7f811432d700 1 -- 172.21.15.77:0/3466127298 shutdown_connections 2024-04-25T02:15:50.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.772+0000 7f811432d700 1 -- 172.21.15.77:0/3466127298 wait complete. 2024-04-25T02:15:50.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.875+0000 7f6f29ed4700 1 -- 172.21.15.77:0/2582791696 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f240fe780 msgr2=0x7f6f24106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:50.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.875+0000 7f6f29ed4700 1 --2- 172.21.15.77:0/2582791696 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f240fe780 0x7f6f24106dc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6f14004940 tx=0x7f6f14009e30 comp rx=0 tx=0).stop 2024-04-25T02:15:50.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.875+0000 7f6f29ed4700 1 -- 172.21.15.77:0/2582791696 shutdown_connections 2024-04-25T02:15:50.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.875+0000 7f6f29ed4700 1 --2- 172.21.15.77:0/2582791696 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f240fe780 0x7f6f24106dc0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:50.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.875+0000 7f6f29ed4700 1 --2- 172.21.15.77:0/2582791696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f240fdde0 0x7f6f240fe1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:50.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.875+0000 7f6f29ed4700 1 -- 172.21.15.77:0/2582791696 >> 172.21.15.77:0/2582791696 conn(0x7f6f240f7850 msgr2=0x7f6f240f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:50.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.875+0000 7f6f29ed4700 1 -- 172.21.15.77:0/2582791696 shutdown_connections 2024-04-25T02:15:50.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.875+0000 7f6f29ed4700 1 -- 172.21.15.77:0/2582791696 wait complete. 2024-04-25T02:15:50.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.875+0000 7f6f29ed4700 1 Processor -- start 2024-04-25T02:15:50.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.876+0000 7f6f29ed4700 1 -- start start 2024-04-25T02:15:50.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.876+0000 7f6f29ed4700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f240fdde0 0x7f6f24113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:50.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.876+0000 7f6f29ed4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f240fe780 0x7f6f241140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:50.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.876+0000 7f6f29ed4700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f24114710 con 0x7f6f240fdde0 2024-04-25T02:15:50.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.876+0000 7f6f29ed4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2410db00 con 0x7f6f240fe780 2024-04-25T02:15:50.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.876+0000 7f6f237fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f240fdde0 0x7f6f24113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:50.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.876+0000 7f6f237fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f240fdde0 0x7f6f24113b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38124/0 (socket says 172.21.15.77:38124) 2024-04-25T02:15:50.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.876+0000 7f6f237fe700 1 -- 172.21.15.77:0/2233945213 learned_addr learned my addr 172.21.15.77:0/2233945213 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:15:50.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.876+0000 7f6f22ffd700 1 --2- 172.21.15.77:0/2233945213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f240fe780 0x7f6f241140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:50.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.876+0000 7f6f237fe700 1 -- 172.21.15.77:0/2233945213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f240fe780 msgr2=0x7f6f241140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:50.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.876+0000 7f6f237fe700 1 --2- 172.21.15.77:0/2233945213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f240fe780 0x7f6f241140c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:50.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.876+0000 7f6f237fe700 1 -- 172.21.15.77:0/2233945213 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f14005040 con 0x7f6f240fdde0 2024-04-25T02:15:50.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.876+0000 7f6f237fe700 1 --2- 172.21.15.77:0/2233945213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f240fdde0 0x7f6f24113b80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6f1800c8c0 tx=0x7f6f180044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:50.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.877+0000 7f6f0bfff700 1 -- 172.21.15.77:0/2233945213 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f1800a760 con 0x7f6f240fdde0 2024-04-25T02:15:50.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.877+0000 7f6f29ed4700 1 -- 172.21.15.77:0/2233945213 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f2410dde0 con 0x7f6f240fdde0 2024-04-25T02:15:50.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.877+0000 7f6f0bfff700 1 -- 172.21.15.77:0/2233945213 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6f1800ad90 con 0x7f6f240fdde0 2024-04-25T02:15:50.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.877+0000 7f6f0bfff700 1 -- 172.21.15.77:0/2233945213 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f180113a0 con 0x7f6f240fdde0 2024-04-25T02:15:50.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.877+0000 7f6f29ed4700 1 -- 172.21.15.77:0/2233945213 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f2410e320 con 0x7f6f240fdde0 2024-04-25T02:15:50.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.878+0000 7f6f29ed4700 1 -- 172.21.15.77:0/2233945213 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f24066750 con 0x7f6f240fdde0 2024-04-25T02:15:50.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.878+0000 7f6f0bfff700 1 -- 172.21.15.77:0/2233945213 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6f18012400 con 0x7f6f240fdde0 2024-04-25T02:15:50.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.879+0000 7f6f0bfff700 1 --2- 172.21.15.77:0/2233945213 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f6f0c06e150 0x7f6f0c070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:50.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.879+0000 7f6f0bfff700 1 -- 172.21.15.77:0/2233945213 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f6f1808db10 con 0x7f6f240fdde0 2024-04-25T02:15:50.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.879+0000 7f6f22ffd700 1 --2- 172.21.15.77:0/2233945213 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f6f0c06e150 0x7f6f0c070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:50.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.879+0000 7f6f22ffd700 1 --2- 172.21.15.77:0/2233945213 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f6f0c06e150 0x7f6f0c070600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6f2410ecc0 tx=0x7f6f14009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:50.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:50.883+0000 7f6f0bfff700 1 -- 172.21.15.77:0/2233945213 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f6f1805aa90 con 0x7f6f240fdde0 2024-04-25T02:15:50.910 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:50 smithi077 ceph-mon[110441]: pgmap v86: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:15:51.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.177+0000 7f6f29ed4700 1 -- 172.21.15.77:0/2233945213 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6f24109e70 con 0x7f6f240fdde0 2024-04-25T02:15:51.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.177+0000 7f6f0bfff700 1 -- 172.21.15.77:0/2233945213 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f6f1805a620 con 0x7f6f240fdde0 2024-04-25T02:15:51.183 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:15:51.183 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-04-25T02:15:51.183 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:15:51.183 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:15:51.184 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-04-25T02:15:51.184 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:15:51.184 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:15:51.184 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-04-25T02:15:51.184 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4, 2024-04-25T02:15:51.184 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:15:51.184 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:15:51.184 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-04-25T02:15:51.184 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T02:15:51.184 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:15:51.184 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-04-25T02:15:51.184 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 8, 2024-04-25T02:15:51.184 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 6 2024-04-25T02:15:51.184 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-25T02:15:51.184 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:15:51.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.179+0000 7f6f29ed4700 1 -- 172.21.15.77:0/2233945213 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f6f0c06e150 msgr2=0x7f6f0c070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:51.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.179+0000 7f6f29ed4700 1 --2- 172.21.15.77:0/2233945213 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f6f0c06e150 0x7f6f0c070600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6f2410ecc0 tx=0x7f6f14009e30 comp rx=0 tx=0).stop 2024-04-25T02:15:51.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.179+0000 7f6f29ed4700 1 -- 172.21.15.77:0/2233945213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f240fdde0 msgr2=0x7f6f24113b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:51.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.179+0000 7f6f29ed4700 1 --2- 172.21.15.77:0/2233945213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f240fdde0 0x7f6f24113b80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6f1800c8c0 tx=0x7f6f180044c0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.179+0000 7f6f29ed4700 1 -- 172.21.15.77:0/2233945213 shutdown_connections 2024-04-25T02:15:51.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.179+0000 7f6f29ed4700 1 --2- 172.21.15.77:0/2233945213 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f6f0c06e150 0x7f6f0c070600 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.179+0000 7f6f29ed4700 1 --2- 172.21.15.77:0/2233945213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f240fdde0 0x7f6f24113b80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.179+0000 7f6f29ed4700 1 --2- 172.21.15.77:0/2233945213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f240fe780 0x7f6f241140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.180+0000 7f6f29ed4700 1 -- 172.21.15.77:0/2233945213 >> 172.21.15.77:0/2233945213 conn(0x7f6f240f7850 msgr2=0x7f6f240f8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:51.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.180+0000 7f6f29ed4700 1 -- 172.21.15.77:0/2233945213 shutdown_connections 2024-04-25T02:15:51.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.180+0000 7f6f29ed4700 1 -- 172.21.15.77:0/2233945213 wait complete. 2024-04-25T02:15:51.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:50 smithi112 ceph-mon[80494]: pgmap v86: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:15:51.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.281+0000 7f9402af2700 1 -- 172.21.15.77:0/3851355781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93fc0fb770 msgr2=0x7f93fc0fbb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:51.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.281+0000 7f9402af2700 1 --2- 172.21.15.77:0/3851355781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93fc0fb770 0x7f93fc0fbb40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f93f0004970 tx=0x7f93f0009e30 comp rx=0 tx=0).stop 2024-04-25T02:15:51.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.282+0000 7f9402af2700 1 -- 172.21.15.77:0/3851355781 shutdown_connections 2024-04-25T02:15:51.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.282+0000 7f9402af2700 1 --2- 172.21.15.77:0/3851355781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93fc0fc080 0x7f93fc10d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.282+0000 7f9402af2700 1 --2- 172.21.15.77:0/3851355781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93fc0fb770 0x7f93fc0fbb40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.282+0000 7f9402af2700 1 -- 172.21.15.77:0/3851355781 >> 172.21.15.77:0/3851355781 conn(0x7f93fc0714d0 msgr2=0x7f93fc0718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:51.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.282+0000 7f9402af2700 1 -- 172.21.15.77:0/3851355781 shutdown_connections 2024-04-25T02:15:51.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.282+0000 7f9402af2700 1 -- 172.21.15.77:0/3851355781 wait complete. 2024-04-25T02:15:51.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.282+0000 7f9402af2700 1 Processor -- start 2024-04-25T02:15:51.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.282+0000 7f9402af2700 1 -- start start 2024-04-25T02:15:51.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.283+0000 7f9402af2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93fc0fb770 0x7f93fc119f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:51.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.283+0000 7f9402af2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93fc0fc080 0x7f93fc11a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:51.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.283+0000 7f9402af2700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc11ab00 con 0x7f93fc0fb770 2024-04-25T02:15:51.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.283+0000 7f9402af2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc114130 con 0x7f93fc0fc080 2024-04-25T02:15:51.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.283+0000 7f940088e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93fc0fb770 0x7f93fc119f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:51.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.283+0000 7f940088e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93fc0fb770 0x7f93fc119f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38134/0 (socket says 172.21.15.77:38134) 2024-04-25T02:15:51.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.283+0000 7f940088e700 1 -- 172.21.15.77:0/2599489466 learned_addr learned my addr 172.21.15.77:0/2599489466 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:15:51.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.283+0000 7f93fbfff700 1 --2- 172.21.15.77:0/2599489466 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93fc0fc080 0x7f93fc11a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:51.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.283+0000 7f940088e700 1 -- 172.21.15.77:0/2599489466 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93fc0fc080 msgr2=0x7f93fc11a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:51.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.283+0000 7f940088e700 1 --2- 172.21.15.77:0/2599489466 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93fc0fc080 0x7f93fc11a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.283+0000 7f940088e700 1 -- 172.21.15.77:0/2599489466 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f0005040 con 0x7f93fc0fb770 2024-04-25T02:15:51.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.283+0000 7f93fbfff700 1 --2- 172.21.15.77:0/2599489466 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93fc0fc080 0x7f93fc11a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:15:51.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.283+0000 7f940088e700 1 --2- 172.21.15.77:0/2599489466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93fc0fb770 0x7f93fc119f70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f93f000b370 tx=0x7f93f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:51.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.283+0000 7f93f97fa700 1 -- 172.21.15.77:0/2599489466 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93f000e040 con 0x7f93fc0fb770 2024-04-25T02:15:51.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.284+0000 7f9402af2700 1 -- 172.21.15.77:0/2599489466 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93fc1143b0 con 0x7f93fc0fb770 2024-04-25T02:15:51.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.284+0000 7f93f97fa700 1 -- 172.21.15.77:0/2599489466 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f93f0009af0 con 0x7f93fc0fb770 2024-04-25T02:15:51.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.284+0000 7f93f97fa700 1 -- 172.21.15.77:0/2599489466 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93f001c630 con 0x7f93fc0fb770 2024-04-25T02:15:51.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.284+0000 7f9402af2700 1 -- 172.21.15.77:0/2599489466 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93fc1148f0 con 0x7f93fc0fb770 2024-04-25T02:15:51.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.285+0000 7f9402af2700 1 -- 172.21.15.77:0/2599489466 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93fc0fe0f0 con 0x7f93fc0fb770 2024-04-25T02:15:51.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.285+0000 7f93f97fa700 1 -- 172.21.15.77:0/2599489466 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f93f000bc10 con 0x7f93fc0fb770 2024-04-25T02:15:51.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.286+0000 7f93f97fa700 1 --2- 172.21.15.77:0/2599489466 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f93ec06e140 0x7f93ec0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:51.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.286+0000 7f93f97fa700 1 -- 172.21.15.77:0/2599489466 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f93f008ed30 con 0x7f93fc0fb770 2024-04-25T02:15:51.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.286+0000 7f93fbfff700 1 --2- 172.21.15.77:0/2599489466 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f93ec06e140 0x7f93ec0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:51.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.286+0000 7f93fbfff700 1 --2- 172.21.15.77:0/2599489466 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f93ec06e140 0x7f93ec0705f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f93fc115810 tx=0x7f93e8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:51.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.290+0000 7f93f97fa700 1 -- 172.21.15.77:0/2599489466 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f93f005bcb0 con 0x7f93fc0fb770 2024-04-25T02:15:51.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.536+0000 7f9402af2700 1 -- 172.21.15.77:0/2599489466 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f93fc04c770 con 0x7f93fc0fb770 2024-04-25T02:15:51.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.537+0000 7f93f97fa700 1 -- 172.21.15.77:0/2599489466 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1876 (secure 0 0 0) 0x7f93f0013e60 con 0x7f93fc0fb770 2024-04-25T02:15:51.543 INFO:teuthology.orchestra.run.smithi077.stdout:e15 2024-04-25T02:15:51.543 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T02:15:51.543 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:15:51.543 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-04-25T02:15:51.543 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:15:51.543 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-04-25T02:15:51.543 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-04-25T02:15:51.543 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 15 2024-04-25T02:15:51.543 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-25T02:15:51.544 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-04-25T02:06:10.008979+0000 2024-04-25T02:15:51.544 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-04-25T02:06:27.849984+0000 2024-04-25T02:15:51.544 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-04-25T02:15:51.544 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-04-25T02:15:51.544 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-04-25T02:15:51.544 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-04-25T02:15:51.544 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-04-25T02:15:51.544 INFO:teuthology.orchestra.run.smithi077.stdout:max_xattr_size 65536 2024-04-25T02:15:51.544 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-04-25T02:15:51.544 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-04-25T02:15:51.544 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 47 2024-04-25T02:15:51.544 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:15:51.545 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-04-25T02:15:51.545 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-04-25T02:15:51.545 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=24257} 2024-04-25T02:15:51.545 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-04-25T02:15:51.545 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-04-25T02:15:51.545 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-04-25T02:15:51.545 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-04-25T02:15:51.545 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-04-25T02:15:51.545 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-04-25T02:15:51.545 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-04-25T02:15:51.545 INFO:teuthology.orchestra.run.smithi077.stdout:bal_rank_mask -1 2024-04-25T02:15:51.545 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-04-25T02:15:51.546 INFO:teuthology.orchestra.run.smithi077.stdout:qdb_cluster leader: 0 members: 2024-04-25T02:15:51.546 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi112.dvwudt{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.112:6824/3687767796,v1:172.21.15.112:6825/3687767796] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:15:51.546 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:15:51.546 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:15:51.546 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-04-25T02:15:51.546 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:15:51.546 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.gcfygj{-1:14462} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/691698671,v1:172.21.15.77:6829/691698671] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:15:51.546 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.oadrkb{-1:14474} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.77:6826/26222645,v1:172.21.15.77:6827/26222645] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:15:51.546 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi112.fjnadi{-1:24269} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/2036319817,v1:172.21.15.112:6827/2036319817] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:15:51.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.539+0000 7f9402af2700 1 -- 172.21.15.77:0/2599489466 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f93ec06e140 msgr2=0x7f93ec0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:51.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.539+0000 7f9402af2700 1 --2- 172.21.15.77:0/2599489466 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f93ec06e140 0x7f93ec0705f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f93fc115810 tx=0x7f93e8009040 comp rx=0 tx=0).stop 2024-04-25T02:15:51.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.539+0000 7f9402af2700 1 -- 172.21.15.77:0/2599489466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93fc0fb770 msgr2=0x7f93fc119f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:51.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.539+0000 7f9402af2700 1 --2- 172.21.15.77:0/2599489466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93fc0fb770 0x7f93fc119f70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f93f000b370 tx=0x7f93f0009e30 comp rx=0 tx=0).stop 2024-04-25T02:15:51.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.539+0000 7f9402af2700 1 -- 172.21.15.77:0/2599489466 shutdown_connections 2024-04-25T02:15:51.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.539+0000 7f9402af2700 1 --2- 172.21.15.77:0/2599489466 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f93ec06e140 0x7f93ec0705f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.539+0000 7f9402af2700 1 --2- 172.21.15.77:0/2599489466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93fc0fb770 0x7f93fc119f70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.539+0000 7f9402af2700 1 --2- 172.21.15.77:0/2599489466 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93fc0fc080 0x7f93fc11a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.539+0000 7f9402af2700 1 -- 172.21.15.77:0/2599489466 >> 172.21.15.77:0/2599489466 conn(0x7f93fc0714d0 msgr2=0x7f93fc102030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:51.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.539+0000 7f9402af2700 1 -- 172.21.15.77:0/2599489466 shutdown_connections 2024-04-25T02:15:51.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.539+0000 7f9402af2700 1 -- 172.21.15.77:0/2599489466 wait complete. 2024-04-25T02:15:51.548 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 15 2024-04-25T02:15:51.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.644+0000 7f0f808f0700 1 -- 172.21.15.77:0/1099120449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f7c0fbf40 msgr2=0x7f0f7c101a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:51.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.644+0000 7f0f808f0700 1 --2- 172.21.15.77:0/1099120449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f7c0fbf40 0x7f0f7c101a30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0f70004940 tx=0x7f0f70009e30 comp rx=0 tx=0).stop 2024-04-25T02:15:51.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.644+0000 7f0f808f0700 1 -- 172.21.15.77:0/1099120449 shutdown_connections 2024-04-25T02:15:51.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.644+0000 7f0f808f0700 1 --2- 172.21.15.77:0/1099120449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f7c0fbf40 0x7f0f7c101a30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.644+0000 7f0f808f0700 1 --2- 172.21.15.77:0/1099120449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f7c0fb5a0 0x7f0f7c0fb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.644+0000 7f0f808f0700 1 -- 172.21.15.77:0/1099120449 >> 172.21.15.77:0/1099120449 conn(0x7f0f7c073350 msgr2=0x7f0f7c073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:51.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.644+0000 7f0f808f0700 1 -- 172.21.15.77:0/1099120449 shutdown_connections 2024-04-25T02:15:51.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.644+0000 7f0f808f0700 1 -- 172.21.15.77:0/1099120449 wait complete. 2024-04-25T02:15:51.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.644+0000 7f0f808f0700 1 Processor -- start 2024-04-25T02:15:51.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.644+0000 7f0f808f0700 1 -- start start 2024-04-25T02:15:51.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.644+0000 7f0f808f0700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f7c0fb5a0 0x7f0f7c113a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:51.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.644+0000 7f0f808f0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f7c0fbf40 0x7f0f7c113f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:51.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.645+0000 7f0f808f0700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c1145d0 con 0x7f0f7c0fb5a0 2024-04-25T02:15:51.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.645+0000 7f0f808f0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c10dbb0 con 0x7f0f7c0fbf40 2024-04-25T02:15:51.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.645+0000 7f0f7a59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f7c0fb5a0 0x7f0f7c113a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:51.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.645+0000 7f0f7a59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f7c0fb5a0 0x7f0f7c113a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38154/0 (socket says 172.21.15.77:38154) 2024-04-25T02:15:51.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.645+0000 7f0f7a59c700 1 -- 172.21.15.77:0/1425316590 learned_addr learned my addr 172.21.15.77:0/1425316590 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:15:51.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.645+0000 7f0f79d9b700 1 --2- 172.21.15.77:0/1425316590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f7c0fbf40 0x7f0f7c113f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:51.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.645+0000 7f0f7a59c700 1 -- 172.21.15.77:0/1425316590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f7c0fbf40 msgr2=0x7f0f7c113f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:51.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.645+0000 7f0f7a59c700 1 --2- 172.21.15.77:0/1425316590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f7c0fbf40 0x7f0f7c113f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.645+0000 7f0f7a59c700 1 -- 172.21.15.77:0/1425316590 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f70005040 con 0x7f0f7c0fb5a0 2024-04-25T02:15:51.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.645+0000 7f0f7a59c700 1 --2- 172.21.15.77:0/1425316590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f7c0fb5a0 0x7f0f7c113a40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00c8c0 tx=0x7f0f6c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:51.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.645+0000 7f0f6affd700 1 -- 172.21.15.77:0/1425316590 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f6c00a980 con 0x7f0f7c0fb5a0 2024-04-25T02:15:51.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.645+0000 7f0f6affd700 1 -- 172.21.15.77:0/1425316590 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0f6c00ce60 con 0x7f0f7c0fb5a0 2024-04-25T02:15:51.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.645+0000 7f0f808f0700 1 -- 172.21.15.77:0/1425316590 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f7c10de90 con 0x7f0f7c0fb5a0 2024-04-25T02:15:51.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.645+0000 7f0f6affd700 1 -- 172.21.15.77:0/1425316590 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f6c0115e0 con 0x7f0f7c0fb5a0 2024-04-25T02:15:51.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.645+0000 7f0f808f0700 1 -- 172.21.15.77:0/1425316590 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f7c10e3d0 con 0x7f0f7c0fb5a0 2024-04-25T02:15:51.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.646+0000 7f0f808f0700 1 -- 172.21.15.77:0/1425316590 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f7c0fe670 con 0x7f0f7c0fb5a0 2024-04-25T02:15:51.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.647+0000 7f0f6affd700 1 -- 172.21.15.77:0/1425316590 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0f6c012400 con 0x7f0f7c0fb5a0 2024-04-25T02:15:51.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.647+0000 7f0f6affd700 1 --2- 172.21.15.77:0/1425316590 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f0f6406e140 0x7f0f640705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:51.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.647+0000 7f0f79d9b700 1 --2- 172.21.15.77:0/1425316590 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f0f6406e140 0x7f0f640705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:51.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.647+0000 7f0f6affd700 1 -- 172.21.15.77:0/1425316590 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f0f6c08dbb0 con 0x7f0f7c0fb5a0 2024-04-25T02:15:51.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.647+0000 7f0f79d9b700 1 --2- 172.21.15.77:0/1425316590 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f0f6406e140 0x7f0f640705f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0f70009fd0 tx=0x7f0f70009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:51.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.652+0000 7f0f6affd700 1 -- 172.21.15.77:0/1425316590 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f0f6c094080 con 0x7f0f7c0fb5a0 2024-04-25T02:15:51.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.877+0000 7f0f808f0700 1 -- 172.21.15.77:0/1425316590 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f7c10f090 con 0x7f0f6406e140 2024-04-25T02:15:51.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.879+0000 7f0f6affd700 1 -- 172.21.15.77:0/1425316590 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0f7c10f090 con 0x7f0f6406e140 2024-04-25T02:15:51.884 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:15:51.884 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901", 2024-04-25T02:15:51.884 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-04-25T02:15:51.884 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T02:15:51.884 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-04-25T02:15:51.884 INFO:teuthology.orchestra.run.smithi077.stdout: "mon", 2024-04-25T02:15:51.885 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr", 2024-04-25T02:15:51.885 INFO:teuthology.orchestra.run.smithi077.stdout: "crash" 2024-04-25T02:15:51.885 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-25T02:15:51.885 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "8/21 daemons upgraded", 2024-04-25T02:15:51.885 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading osd daemons", 2024-04-25T02:15:51.885 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-04-25T02:15:51.885 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:15:51.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.881+0000 7f0f808f0700 1 -- 172.21.15.77:0/1425316590 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f0f6406e140 msgr2=0x7f0f640705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:51.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.881+0000 7f0f808f0700 1 --2- 172.21.15.77:0/1425316590 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f0f6406e140 0x7f0f640705f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0f70009fd0 tx=0x7f0f70009e30 comp rx=0 tx=0).stop 2024-04-25T02:15:51.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.881+0000 7f0f808f0700 1 -- 172.21.15.77:0/1425316590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f7c0fb5a0 msgr2=0x7f0f7c113a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:51.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.881+0000 7f0f808f0700 1 --2- 172.21.15.77:0/1425316590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f7c0fb5a0 0x7f0f7c113a40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00c8c0 tx=0x7f0f6c0044c0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.881+0000 7f0f808f0700 1 -- 172.21.15.77:0/1425316590 shutdown_connections 2024-04-25T02:15:51.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.881+0000 7f0f808f0700 1 --2- 172.21.15.77:0/1425316590 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f0f6406e140 0x7f0f640705f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.881+0000 7f0f808f0700 1 --2- 172.21.15.77:0/1425316590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f7c0fb5a0 0x7f0f7c113a40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.881+0000 7f0f808f0700 1 --2- 172.21.15.77:0/1425316590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f7c0fbf40 0x7f0f7c113f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:51.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.881+0000 7f0f808f0700 1 -- 172.21.15.77:0/1425316590 >> 172.21.15.77:0/1425316590 conn(0x7f0f7c073350 msgr2=0x7f0f7c100a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:51.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.881+0000 7f0f808f0700 1 -- 172.21.15.77:0/1425316590 shutdown_connections 2024-04-25T02:15:51.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.881+0000 7f0f808f0700 1 -- 172.21.15.77:0/1425316590 wait complete. 2024-04-25T02:15:52.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.994+0000 7f0548e77700 1 -- 172.21.15.77:0/3972637313 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0544102670 msgr2=0x7f05440fb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:52.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.994+0000 7f0548e77700 1 --2- 172.21.15.77:0/3972637313 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0544102670 0x7f05440fb600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0538004940 tx=0x7f0538009e30 comp rx=0 tx=0).stop 2024-04-25T02:15:52.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.994+0000 7f0548e77700 1 -- 172.21.15.77:0/3972637313 shutdown_connections 2024-04-25T02:15:52.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.994+0000 7f0548e77700 1 --2- 172.21.15.77:0/3972637313 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0544102670 0x7f05440fb600 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.994+0000 7f0548e77700 1 --2- 172.21.15.77:0/3972637313 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0544101cd0 0x7f05441020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.994+0000 7f0548e77700 1 -- 172.21.15.77:0/3972637313 >> 172.21.15.77:0/3972637313 conn(0x7f0544071460 msgr2=0x7f0544071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:52.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.994+0000 7f0548e77700 1 -- 172.21.15.77:0/3972637313 shutdown_connections 2024-04-25T02:15:52.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.994+0000 7f0548e77700 1 -- 172.21.15.77:0/3972637313 wait complete. 2024-04-25T02:15:52.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.995+0000 7f0548e77700 1 Processor -- start 2024-04-25T02:15:52.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.995+0000 7f0548e77700 1 -- start start 2024-04-25T02:15:52.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.995+0000 7f0548e77700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0544101cd0 0x7f05440fc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.995+0000 7f0548e77700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0544102670 0x7f05440fcd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.995+0000 7f0548e77700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05440fd2b0 con 0x7f0544101cd0 2024-04-25T02:15:52.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.995+0000 7f0548e77700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05440fd3f0 con 0x7f0544102670 2024-04-25T02:15:52.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.995+0000 7f054259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0544101cd0 0x7f05440fc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.995+0000 7f054259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0544101cd0 0x7f05440fc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38168/0 (socket says 172.21.15.77:38168) 2024-04-25T02:15:52.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.995+0000 7f054259c700 1 -- 172.21.15.77:0/4057050367 learned_addr learned my addr 172.21.15.77:0/4057050367 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:15:52.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.996+0000 7f0541d9b700 1 --2- 172.21.15.77:0/4057050367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0544102670 0x7f05440fcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.996+0000 7f054259c700 1 -- 172.21.15.77:0/4057050367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0544102670 msgr2=0x7f05440fcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:52.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.996+0000 7f054259c700 1 --2- 172.21.15.77:0/4057050367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0544102670 0x7f05440fcd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.996+0000 7f054259c700 1 -- 172.21.15.77:0/4057050367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0538005040 con 0x7f0544101cd0 2024-04-25T02:15:52.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.996+0000 7f054259c700 1 --2- 172.21.15.77:0/4057050367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0544101cd0 0x7f05440fc7e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f053400eb40 tx=0x7f053400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:52.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.996+0000 7f0532ffd700 1 -- 172.21.15.77:0/4057050367 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0534007cc0 con 0x7f0544101cd0 2024-04-25T02:15:52.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.996+0000 7f0532ffd700 1 -- 172.21.15.77:0/4057050367 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f053400f040 con 0x7f0544101cd0 2024-04-25T02:15:52.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.996+0000 7f0548e77700 1 -- 172.21.15.77:0/4057050367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05440fd640 con 0x7f0544101cd0 2024-04-25T02:15:52.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.996+0000 7f0548e77700 1 -- 172.21.15.77:0/4057050367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f054411a170 con 0x7f0544101cd0 2024-04-25T02:15:52.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.996+0000 7f0532ffd700 1 -- 172.21.15.77:0/4057050367 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f053400ca10 con 0x7f0544101cd0 2024-04-25T02:15:52.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.997+0000 7f0548e77700 1 -- 172.21.15.77:0/4057050367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0544065200 con 0x7f0544101cd0 2024-04-25T02:15:52.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.997+0000 7f0532ffd700 1 -- 172.21.15.77:0/4057050367 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f053400cc80 con 0x7f0544101cd0 2024-04-25T02:15:52.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.998+0000 7f0532ffd700 1 --2- 172.21.15.77:0/4057050367 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f052c06e150 0x7f052c070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:15:52.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.998+0000 7f0541d9b700 1 --2- 172.21.15.77:0/4057050367 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f052c06e150 0x7f052c070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:15:52.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.998+0000 7f0532ffd700 1 -- 172.21.15.77:0/4057050367 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f053408d6c0 con 0x7f0544101cd0 2024-04-25T02:15:52.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:51.998+0000 7f0541d9b700 1 --2- 172.21.15.77:0/4057050367 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f052c06e150 0x7f052c070600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f053800b0d0 tx=0x7f0538009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:15:52.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:52.003+0000 7f0532ffd700 1 -- 172.21.15.77:0/4057050367 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f0534056b40 con 0x7f0544101cd0 2024-04-25T02:15:52.135 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:51 smithi077 ceph-mon[110441]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:15:52.135 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:51 smithi077 ceph-mon[110441]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:15:52.135 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:51 smithi077 ceph-mon[110441]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:15:52.135 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:51 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/2233945213' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:15:52.135 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:51 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/2599489466' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:15:52.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:51 smithi112 ceph-mon[80494]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:15:52.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:51 smithi112 ceph-mon[80494]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:15:52.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:51 smithi112 ceph-mon[80494]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:15:52.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:51 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/2233945213' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:15:52.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:51 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/2599489466' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:15:52.311 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-04-25T02:15:52.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:52.304+0000 7f0548e77700 1 -- 172.21.15.77:0/4057050367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f054404bf00 con 0x7f0544101cd0 2024-04-25T02:15:52.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:52.305+0000 7f0532ffd700 1 -- 172.21.15.77:0/4057050367 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f053405a200 con 0x7f0544101cd0 2024-04-25T02:15:52.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:52.307+0000 7f0548e77700 1 -- 172.21.15.77:0/4057050367 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f052c06e150 msgr2=0x7f052c070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:52.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:52.307+0000 7f0548e77700 1 --2- 172.21.15.77:0/4057050367 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f052c06e150 0x7f052c070600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f053800b0d0 tx=0x7f0538009e30 comp rx=0 tx=0).stop 2024-04-25T02:15:52.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:52.307+0000 7f0548e77700 1 -- 172.21.15.77:0/4057050367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0544101cd0 msgr2=0x7f05440fc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:15:52.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:52.307+0000 7f0548e77700 1 --2- 172.21.15.77:0/4057050367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0544101cd0 0x7f05440fc7e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f053400eb40 tx=0x7f053400b040 comp rx=0 tx=0).stop 2024-04-25T02:15:52.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:52.307+0000 7f0548e77700 1 -- 172.21.15.77:0/4057050367 shutdown_connections 2024-04-25T02:15:52.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:52.307+0000 7f0548e77700 1 --2- 172.21.15.77:0/4057050367 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f052c06e150 0x7f052c070600 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:52.307+0000 7f0548e77700 1 --2- 172.21.15.77:0/4057050367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0544101cd0 0x7f05440fc7e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:52.307+0000 7f0548e77700 1 --2- 172.21.15.77:0/4057050367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0544102670 0x7f05440fcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:15:52.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:52.307+0000 7f0548e77700 1 -- 172.21.15.77:0/4057050367 >> 172.21.15.77:0/4057050367 conn(0x7f0544071460 msgr2=0x7f05441009d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:15:52.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:52.307+0000 7f0548e77700 1 -- 172.21.15.77:0/4057050367 shutdown_connections 2024-04-25T02:15:52.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:15:52.307+0000 7f0548e77700 1 -- 172.21.15.77:0/4057050367 wait complete. 2024-04-25T02:15:52.401 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:52 smithi077 systemd[1]: Stopping Ceph osd.2 for 4bb93d82-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:15:52.728 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:52 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2[60507]: 2024-04-25T02:15:52.395+0000 7f462bfa6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:15:52.728 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:52 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2[60507]: 2024-04-25T02:15:52.395+0000 7f462bfa6700 -1 osd.2 60 *** Got signal Terminated *** 2024-04-25T02:15:52.728 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:52 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2[60507]: 2024-04-25T02:15:52.395+0000 7f462bfa6700 -1 osd.2 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T02:15:53.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:52 smithi077 ceph-mon[110441]: pgmap v87: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:15:53.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:52 smithi077 ceph-mon[110441]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:15:53.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:52 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/4057050367' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T02:15:53.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:52 smithi077 ceph-mon[110441]: osd.2 marked itself down and dead 2024-04-25T02:15:53.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:52 smithi112 ceph-mon[80494]: pgmap v87: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:15:53.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:52 smithi112 ceph-mon[80494]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:15:53.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:52 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/4057050367' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T02:15:53.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:52 smithi112 ceph-mon[80494]: osd.2 marked itself down and dead 2024-04-25T02:15:53.635 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:53 smithi077 podman[132547]: 2024-04-25 02:15:53.356591036 +0000 UTC m=+1.080827809 container died c5d7d8c993f4d84e9f364dc3974d50fb578c624a3814260b8ed4223fd700b462 (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, RELEASE=quincy-c61472c, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:15:53.978 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:53 smithi077 podman[132547]: 2024-04-25 02:15:53.721487602 +0000 UTC m=+1.445724372 container cleanup c5d7d8c993f4d84e9f364dc3974d50fb578c624a3814260b8ed4223fd700b462 (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2, RELEASE=quincy-c61472c, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-04-25T02:15:53.978 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:53 smithi077 bash[132547]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2 2024-04-25T02:15:53.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:53 smithi077 ceph-mon[110441]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-25T02:15:53.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:53 smithi077 ceph-mon[110441]: osdmap e61: 6 total, 5 up, 6 in 2024-04-25T02:15:53.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:53 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:53.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:53 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:15:54.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:53 smithi112 ceph-mon[80494]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-25T02:15:54.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:53 smithi112 ceph-mon[80494]: osdmap e61: 6 total, 5 up, 6 in 2024-04-25T02:15:54.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:53 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:54.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:53 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:15:54.322 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:53 smithi077 podman[132569]: 2024-04-25 02:15:53.998145749 +0000 UTC m=+0.634896647 container remove c5d7d8c993f4d84e9f364dc3974d50fb578c624a3814260b8ed4223fd700b462 (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=quincy-c61472c, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:15:54.598 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:54 smithi077 podman[132662]: 2024-04-25 02:15:54.221160556 +0000 UTC m=+0.018267074 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:15:54.598 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:54 smithi077 podman[132662]: 2024-04-25 02:15:54.332551125 +0000 UTC m=+0.129657612 container create 8653c2a9d9808ed822b34801935524d9f3efed1ef1d74f845bec5606edfb9b89 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-d2c45d9, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:15:54.598 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:54 smithi077 podman[132662]: 2024-04-25 02:15:54.593775314 +0000 UTC m=+0.390881807 container init 8653c2a9d9808ed822b34801935524d9f3efed1ef1d74f845bec5606edfb9b89 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-d2c45d9, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-25T02:15:54.898 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:54 smithi077 ceph-mon[110441]: pgmap v89: 65 pgs: 9 stale+active+clean, 56 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:15:54.898 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:54 smithi077 ceph-mon[110441]: osdmap e62: 6 total, 5 up, 6 in 2024-04-25T02:15:54.898 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:54 smithi077 podman[132662]: 2024-04-25 02:15:54.596996035 +0000 UTC m=+0.394102538 container start 8653c2a9d9808ed822b34801935524d9f3efed1ef1d74f845bec5606edfb9b89 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-d2c45d9, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:15:54.898 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:54 smithi077 podman[132662]: 2024-04-25 02:15:54.685360532 +0000 UTC m=+0.482467024 container attach 8653c2a9d9808ed822b34801935524d9f3efed1ef1d74f845bec5606edfb9b89 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2-deactivate, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS) 2024-04-25T02:15:55.160 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:54 smithi077 podman[132688]: 2024-04-25 02:15:54.923322574 +0000 UTC m=+0.018420401 container died 8653c2a9d9808ed822b34801935524d9f3efed1ef1d74f845bec5606edfb9b89 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2-deactivate, io.buildah.version=1.33.5, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240424, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-25T02:15:55.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:54 smithi112 ceph-mon[80494]: pgmap v89: 65 pgs: 9 stale+active+clean, 56 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:15:55.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:54 smithi112 ceph-mon[80494]: osdmap e62: 6 total, 5 up, 6 in 2024-04-25T02:15:55.728 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:55 smithi077 podman[132688]: 2024-04-25 02:15:55.439123833 +0000 UTC m=+0.534221663 container remove 8653c2a9d9808ed822b34801935524d9f3efed1ef1d74f845bec5606edfb9b89 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-d2c45d9, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-04-25T02:15:55.728 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:55 smithi077 systemd[1]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.2.service: Deactivated successfully. 2024-04-25T02:15:55.728 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:55 smithi077 systemd[1]: Stopped Ceph osd.2 for 4bb93d82-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:15:55.728 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:55 smithi077 systemd[1]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.2.service: Consumed 57.581s CPU time. 2024-04-25T02:15:55.728 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:55 smithi077 systemd[1]: Starting Ceph osd.2 for 4bb93d82-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:15:56.197 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:55 smithi077 ceph-mon[110441]: Health check failed: Degraded data redundancy: 8/219 objects degraded (3.653%), 5 pgs degraded (PG_DEGRADED) 2024-04-25T02:15:56.197 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:55 smithi077 podman[132794]: 2024-04-25 02:15:55.786658796 +0000 UTC m=+0.018389019 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:15:56.197 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:55 smithi077 podman[132794]: 2024-04-25 02:15:55.927729573 +0000 UTC m=+0.159459822 container create c7144122b5b12994949fc316f9795942fb282b90368000263922a91784ccc9a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2-activate, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-d2c45d9, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:15:56.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:55 smithi112 ceph-mon[80494]: Health check failed: Degraded data redundancy: 8/219 objects degraded (3.653%), 5 pgs degraded (PG_DEGRADED) 2024-04-25T02:15:56.478 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:56 smithi077 podman[132794]: 2024-04-25 02:15:56.192885199 +0000 UTC m=+0.424615414 container init c7144122b5b12994949fc316f9795942fb282b90368000263922a91784ccc9a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2-activate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, ceph=True, RELEASE=squid-d2c45d9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD) 2024-04-25T02:15:56.478 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:56 smithi077 podman[132794]: 2024-04-25 02:15:56.196151174 +0000 UTC m=+0.427881390 container start c7144122b5b12994949fc316f9795942fb282b90368000263922a91784ccc9a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2-activate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2) 2024-04-25T02:15:56.478 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:56 smithi077 podman[132794]: 2024-04-25 02:15:56.292939941 +0000 UTC m=+0.524670166 container attach c7144122b5b12994949fc316f9795942fb282b90368000263922a91784ccc9a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2-activate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5) 2024-04-25T02:15:56.898 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:56 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2-activate[132809]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T02:15:56.898 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:56 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2-activate[132809]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-25T02:15:56.899 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:56 smithi077 bash[132794]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T02:15:56.899 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:56 smithi077 bash[132794]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-25T02:15:56.899 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:56 smithi077 bash[132794]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-25T02:15:56.899 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:56 smithi077 bash[132794]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-25T02:15:56.899 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:56 smithi077 bash[132794]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-04-25T02:15:56.899 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:56 smithi077 bash[132794]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T02:15:56.899 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:56 smithi077 bash[132794]: --> ceph-volume raw activate successful for osd ID: 2 2024-04-25T02:15:56.899 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:56 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2-activate[132809]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-25T02:15:56.899 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:56 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2-activate[132809]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-25T02:15:56.899 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:56 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2-activate[132809]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-04-25T02:15:56.899 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:56 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2-activate[132809]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T02:15:56.899 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:56 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2-activate[132809]: --> ceph-volume raw activate successful for osd ID: 2 2024-04-25T02:15:56.899 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:56 smithi077 podman[132794]: 2024-04-25 02:15:56.660950136 +0000 UTC m=+0.892680359 container died c7144122b5b12994949fc316f9795942fb282b90368000263922a91784ccc9a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2-activate, RELEASE=squid-d2c45d9, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T02:15:57.217 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:56 smithi077 ceph-mon[110441]: pgmap v91: 65 pgs: 5 active+undersized+degraded, 7 stale+active+clean, 7 active+undersized, 46 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 8/219 objects degraded (3.653%) 2024-04-25T02:15:57.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:56 smithi112 ceph-mon[80494]: pgmap v91: 65 pgs: 5 active+undersized+degraded, 7 stale+active+clean, 7 active+undersized, 46 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 8/219 objects degraded (3.653%) 2024-04-25T02:15:57.469 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:57 smithi077 podman[132942]: 2024-04-25 02:15:57.213482441 +0000 UTC m=+0.547271909 container remove c7144122b5b12994949fc316f9795942fb282b90368000263922a91784ccc9a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2-activate, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=) 2024-04-25T02:15:57.469 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:57 smithi077 podman[133007]: 2024-04-25 02:15:57.33019515 +0000 UTC m=+0.018379307 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:15:57.469 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:57 smithi077 podman[133007]: 2024-04-25 02:15:57.464659304 +0000 UTC m=+0.152843446 container create 392fd2036c1677a3f4fdaeeb8182acd4a4589eba372713842f185810e726f603 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T02:15:57.728 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:57 smithi077 podman[133007]: 2024-04-25 02:15:57.683592529 +0000 UTC m=+0.371776676 container init 392fd2036c1677a3f4fdaeeb8182acd4a4589eba372713842f185810e726f603 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-25T02:15:57.728 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:57 smithi077 podman[133007]: 2024-04-25 02:15:57.686641428 +0000 UTC m=+0.374825578 container start 392fd2036c1677a3f4fdaeeb8182acd4a4589eba372713842f185810e726f603 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-d2c45d9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:15:57.729 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:57 smithi077 ceph-osd[133027]: -- 172.21.15.77:0/4160127303 <== mon.0 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563ef792d680 con 0x563ef78f7000 2024-04-25T02:15:58.228 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:57 smithi077 bash[133007]: 392fd2036c1677a3f4fdaeeb8182acd4a4589eba372713842f185810e726f603 2024-04-25T02:15:58.228 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:57 smithi077 systemd[1]: Started Ceph osd.2 for 4bb93d82-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:15:58.627 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:15:58 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2[133023]: 2024-04-25T02:15:58.238+0000 7f6b7042b7c0 -1 Falling back to public interface 2024-04-25T02:15:58.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:58 smithi077 ceph-mon[110441]: pgmap v92: 65 pgs: 8 active+undersized+degraded, 4 stale+active+clean, 12 active+undersized, 41 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 15/219 objects degraded (6.849%) 2024-04-25T02:15:58.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:58 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:58.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:58 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:58.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:15:58 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:15:59.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:58 smithi112 ceph-mon[80494]: pgmap v92: 65 pgs: 8 active+undersized+degraded, 4 stale+active+clean, 12 active+undersized, 41 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 15/219 objects degraded (6.849%) 2024-04-25T02:15:59.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:58 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:59.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:58 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:15:59.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:15:58 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:16:00.954 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:00 smithi077 ceph-mon[110441]: pgmap v93: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 28/219 objects degraded (12.785%) 2024-04-25T02:16:01.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:00 smithi112 ceph-mon[80494]: pgmap v93: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 28/219 objects degraded (12.785%) 2024-04-25T02:16:03.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:02 smithi077 ceph-mon[110441]: pgmap v94: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 28/219 objects degraded (12.785%) 2024-04-25T02:16:03.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:02 smithi112 ceph-mon[80494]: pgmap v94: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 28/219 objects degraded (12.785%) 2024-04-25T02:16:03.728 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:16:03 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2[133023]: 2024-04-25T02:16:03.237+0000 7f6b7042b7c0 -1 osd.2 60 log_to_monitors true 2024-04-25T02:16:04.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:03 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:04.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:03 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:04.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:03 smithi077 ceph-mon[110441]: from='osd.2 [v2:172.21.15.77:6818/3911834293,v1:172.21.15.77:6819/3911834293]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T02:16:04.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:03 smithi077 ceph-mon[110441]: Health check update: Degraded data redundancy: 28/219 objects degraded (12.785%), 11 pgs degraded (PG_DEGRADED) 2024-04-25T02:16:04.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:03 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:04.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:03 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:04.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:03 smithi112 ceph-mon[80494]: from='osd.2 [v2:172.21.15.77:6818/3911834293,v1:172.21.15.77:6819/3911834293]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T02:16:04.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:03 smithi112 ceph-mon[80494]: Health check update: Degraded data redundancy: 28/219 objects degraded (12.785%), 11 pgs degraded (PG_DEGRADED) 2024-04-25T02:16:05.163 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:16:04 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2[133023]: 2024-04-25T02:16:04.808+0000 7f6b5d87b700 -1 osd.2 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:16:05.164 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:04 smithi077 ceph-mon[110441]: pgmap v95: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 28/219 objects degraded (12.785%) 2024-04-25T02:16:05.164 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:04 smithi077 ceph-mon[110441]: from='osd.2 [v2:172.21.15.77:6818/3911834293,v1:172.21.15.77:6819/3911834293]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-25T02:16:05.164 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:04 smithi077 ceph-mon[110441]: osdmap e63: 6 total, 5 up, 6 in 2024-04-25T02:16:05.164 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:04 smithi077 ceph-mon[110441]: from='osd.2 [v2:172.21.15.77:6818/3911834293,v1:172.21.15.77:6819/3911834293]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-04-25T02:16:05.164 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:04 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:05.164 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:04 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:05.164 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:04 smithi077 ceph-mon[110441]: from='osd.2 [v2:172.21.15.77:6818/3911834293,v1:172.21.15.77:6819/3911834293]' entity='osd.2' 2024-04-25T02:16:05.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:04 smithi112 ceph-mon[80494]: pgmap v95: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 28/219 objects degraded (12.785%) 2024-04-25T02:16:05.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:04 smithi112 ceph-mon[80494]: from='osd.2 [v2:172.21.15.77:6818/3911834293,v1:172.21.15.77:6819/3911834293]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-25T02:16:05.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:04 smithi112 ceph-mon[80494]: osdmap e63: 6 total, 5 up, 6 in 2024-04-25T02:16:05.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:04 smithi112 ceph-mon[80494]: from='osd.2 [v2:172.21.15.77:6818/3911834293,v1:172.21.15.77:6819/3911834293]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-04-25T02:16:05.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:04 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:05.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:04 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:05.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:04 smithi112 ceph-mon[80494]: from='osd.2 [v2:172.21.15.77:6818/3911834293,v1:172.21.15.77:6819/3911834293]' entity='osd.2' 2024-04-25T02:16:06.135 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:05 smithi077 ceph-mon[110441]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-25T02:16:06.136 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:05 smithi077 ceph-mon[110441]: osd.2 [v2:172.21.15.77:6818/3911834293,v1:172.21.15.77:6819/3911834293] boot 2024-04-25T02:16:06.136 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:05 smithi077 ceph-mon[110441]: osdmap e64: 6 total, 6 up, 6 in 2024-04-25T02:16:06.136 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:05 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:16:06.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:05 smithi112 ceph-mon[80494]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-25T02:16:06.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:05 smithi112 ceph-mon[80494]: osd.2 [v2:172.21.15.77:6818/3911834293,v1:172.21.15.77:6819/3911834293] boot 2024-04-25T02:16:06.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:05 smithi112 ceph-mon[80494]: osdmap e64: 6 total, 6 up, 6 in 2024-04-25T02:16:06.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:05 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:16:07.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:06 smithi077 ceph-mon[110441]: pgmap v97: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 28/219 objects degraded (12.785%) 2024-04-25T02:16:07.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:06 smithi077 ceph-mon[110441]: osdmap e65: 6 total, 6 up, 6 in 2024-04-25T02:16:07.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:06 smithi112 ceph-mon[80494]: pgmap v97: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 28/219 objects degraded (12.785%) 2024-04-25T02:16:07.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:06 smithi112 ceph-mon[80494]: osdmap e65: 6 total, 6 up, 6 in 2024-04-25T02:16:09.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:08 smithi112 ceph-mon[80494]: pgmap v100: 65 pgs: 10 active+undersized+degraded, 12 active+undersized, 43 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 26/219 objects degraded (11.872%) 2024-04-25T02:16:09.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:09.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:09.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:16:09.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:16:09.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:09.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:16:09.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:16:09.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:16:09.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:16:09.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-25T02:16:09.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:08 smithi112 ceph-mon[80494]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-25T02:16:09.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:08 smithi112 ceph-mon[80494]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-04-25T02:16:09.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:08 smithi077 ceph-mon[110441]: pgmap v100: 65 pgs: 10 active+undersized+degraded, 12 active+undersized, 43 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 26/219 objects degraded (11.872%) 2024-04-25T02:16:09.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:09.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:09.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:16:09.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:16:09.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:09.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:16:09.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:16:09.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:16:09.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:16:09.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-25T02:16:09.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:08 smithi077 ceph-mon[110441]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-25T02:16:09.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:08 smithi077 ceph-mon[110441]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-04-25T02:16:10.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:09 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:10.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:09 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:16:10.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:09 smithi077 ceph-mon[110441]: Health check update: Degraded data redundancy: 26/219 objects degraded (11.872%), 10 pgs degraded (PG_DEGRADED) 2024-04-25T02:16:10.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:09 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:10.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:09 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:16:10.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:09 smithi112 ceph-mon[80494]: Health check update: Degraded data redundancy: 26/219 objects degraded (11.872%), 10 pgs degraded (PG_DEGRADED) 2024-04-25T02:16:11.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:10 smithi077 ceph-mon[110441]: pgmap v101: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:11.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:10 smithi077 ceph-mon[110441]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 26/219 objects degraded (11.872%), 10 pgs degraded) 2024-04-25T02:16:11.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:10 smithi077 ceph-mon[110441]: Cluster is now healthy 2024-04-25T02:16:11.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:10 smithi112 ceph-mon[80494]: pgmap v101: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:11.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:10 smithi112 ceph-mon[80494]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 26/219 objects degraded (11.872%), 10 pgs degraded) 2024-04-25T02:16:11.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:10 smithi112 ceph-mon[80494]: Cluster is now healthy 2024-04-25T02:16:13.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:12 smithi077 ceph-mon[110441]: pgmap v102: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:13.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:12 smithi112 ceph-mon[80494]: pgmap v102: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:15.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:14 smithi077 ceph-mon[110441]: pgmap v103: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:15.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:14 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:15.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:14 smithi112 ceph-mon[80494]: pgmap v103: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:15.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:14 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:17.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:16 smithi077 ceph-mon[110441]: pgmap v104: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:17.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:16 smithi112 ceph-mon[80494]: pgmap v104: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:19.079 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:18 smithi112 ceph-mon[80494]: pgmap v105: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:19.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:18 smithi077 ceph-mon[110441]: pgmap v105: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:21.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:20 smithi077 ceph-mon[110441]: pgmap v106: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:21.269 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:20 smithi112 ceph-mon[80494]: pgmap v106: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:22.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.424+0000 7f02306e8700 1 -- 172.21.15.77:0/2014409446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02280fde90 msgr2=0x7f02280fe260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:22.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.424+0000 7f02306e8700 1 --2- 172.21.15.77:0/2014409446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02280fde90 0x7f02280fe260 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0224004940 tx=0x7f0224009e30 comp rx=0 tx=0).stop 2024-04-25T02:16:22.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.424+0000 7f02306e8700 1 -- 172.21.15.77:0/2014409446 shutdown_connections 2024-04-25T02:16:22.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.424+0000 7f02306e8700 1 --2- 172.21.15.77:0/2014409446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02280fe830 0x7f0228106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:22.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.424+0000 7f02306e8700 1 --2- 172.21.15.77:0/2014409446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02280fde90 0x7f02280fe260 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:22.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.424+0000 7f02306e8700 1 -- 172.21.15.77:0/2014409446 >> 172.21.15.77:0/2014409446 conn(0x7f02280f7940 msgr2=0x7f02280f9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:22.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.425+0000 7f02306e8700 1 -- 172.21.15.77:0/2014409446 shutdown_connections 2024-04-25T02:16:22.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.425+0000 7f02306e8700 1 -- 172.21.15.77:0/2014409446 wait complete. 2024-04-25T02:16:22.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.425+0000 7f02306e8700 1 Processor -- start 2024-04-25T02:16:22.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.425+0000 7f02306e8700 1 -- start start 2024-04-25T02:16:22.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.425+0000 7f02306e8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02280fde90 0x7f0228113940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:22.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.425+0000 7f02306e8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02280fe830 0x7f0228113e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:22.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.425+0000 7f02306e8700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02281144d0 con 0x7f02280fe830 2024-04-25T02:16:22.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.425+0000 7f02306e8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022810dad0 con 0x7f02280fde90 2024-04-25T02:16:22.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.425+0000 7f022dc83700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02280fe830 0x7f0228113e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:22.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.425+0000 7f022dc83700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02280fe830 0x7f0228113e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49592/0 (socket says 172.21.15.77:49592) 2024-04-25T02:16:22.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.426+0000 7f022dc83700 1 -- 172.21.15.77:0/3654928397 learned_addr learned my addr 172.21.15.77:0/3654928397 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:16:22.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.426+0000 7f022e484700 1 --2- 172.21.15.77:0/3654928397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02280fde90 0x7f0228113940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:22.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.426+0000 7f022dc83700 1 -- 172.21.15.77:0/3654928397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02280fde90 msgr2=0x7f0228113940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:22.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.426+0000 7f022dc83700 1 --2- 172.21.15.77:0/3654928397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02280fde90 0x7f0228113940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:22.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.426+0000 7f022dc83700 1 -- 172.21.15.77:0/3654928397 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0224005040 con 0x7f02280fe830 2024-04-25T02:16:22.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.426+0000 7f022dc83700 1 --2- 172.21.15.77:0/3654928397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02280fe830 0x7f0228113e80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0218002a50 tx=0x7f02180046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:22.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.426+0000 7f021effd700 1 -- 172.21.15.77:0/3654928397 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0218007cc0 con 0x7f02280fe830 2024-04-25T02:16:22.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.426+0000 7f02306e8700 1 -- 172.21.15.77:0/3654928397 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f022810ddb0 con 0x7f02280fe830 2024-04-25T02:16:22.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.426+0000 7f021effd700 1 -- 172.21.15.77:0/3654928397 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f021800f040 con 0x7f02280fe830 2024-04-25T02:16:22.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.426+0000 7f021effd700 1 -- 172.21.15.77:0/3654928397 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f021800da30 con 0x7f02280fe830 2024-04-25T02:16:22.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.426+0000 7f02306e8700 1 -- 172.21.15.77:0/3654928397 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f022810e2f0 con 0x7f02280fe830 2024-04-25T02:16:22.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.427+0000 7f02306e8700 1 -- 172.21.15.77:0/3654928397 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0228066b70 con 0x7f02280fe830 2024-04-25T02:16:22.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.428+0000 7f021effd700 1 -- 172.21.15.77:0/3654928397 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f021800db90 con 0x7f02280fe830 2024-04-25T02:16:22.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.428+0000 7f021effd700 1 --2- 172.21.15.77:0/3654928397 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f021406e140 0x7f02140705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:22.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.428+0000 7f022e484700 1 --2- 172.21.15.77:0/3654928397 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f021406e140 0x7f02140705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:22.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.428+0000 7f021effd700 1 -- 172.21.15.77:0/3654928397 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f021808d870 con 0x7f02280fe830 2024-04-25T02:16:22.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.429+0000 7f022e484700 1 --2- 172.21.15.77:0/3654928397 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f021406e140 0x7f02140705f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0224004f90 tx=0x7f0224009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:22.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.433+0000 7f021effd700 1 -- 172.21.15.77:0/3654928397 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f021805a770 con 0x7f02280fe830 2024-04-25T02:16:22.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.650+0000 7f02306e8700 1 -- 172.21.15.77:0/3654928397 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0228113610 con 0x7f021406e140 2024-04-25T02:16:22.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.651+0000 7f021effd700 1 -- 172.21.15.77:0/3654928397 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0228113610 con 0x7f021406e140 2024-04-25T02:16:22.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.653+0000 7f02306e8700 1 -- 172.21.15.77:0/3654928397 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f021406e140 msgr2=0x7f02140705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:22.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.653+0000 7f02306e8700 1 --2- 172.21.15.77:0/3654928397 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f021406e140 0x7f02140705f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0224004f90 tx=0x7f0224009e30 comp rx=0 tx=0).stop 2024-04-25T02:16:22.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.653+0000 7f02306e8700 1 -- 172.21.15.77:0/3654928397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02280fe830 msgr2=0x7f0228113e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:22.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.653+0000 7f02306e8700 1 --2- 172.21.15.77:0/3654928397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02280fe830 0x7f0228113e80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0218002a50 tx=0x7f02180046b0 comp rx=0 tx=0).stop 2024-04-25T02:16:22.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.653+0000 7f02306e8700 1 -- 172.21.15.77:0/3654928397 shutdown_connections 2024-04-25T02:16:22.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.653+0000 7f02306e8700 1 --2- 172.21.15.77:0/3654928397 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f021406e140 0x7f02140705f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:22.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.653+0000 7f02306e8700 1 --2- 172.21.15.77:0/3654928397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02280fde90 0x7f0228113940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:22.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.653+0000 7f02306e8700 1 --2- 172.21.15.77:0/3654928397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02280fe830 0x7f0228113e80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:22.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.653+0000 7f02306e8700 1 -- 172.21.15.77:0/3654928397 >> 172.21.15.77:0/3654928397 conn(0x7f02280f7940 msgr2=0x7f02281036e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:22.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.653+0000 7f02306e8700 1 -- 172.21.15.77:0/3654928397 shutdown_connections 2024-04-25T02:16:22.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.653+0000 7f02306e8700 1 -- 172.21.15.77:0/3654928397 wait complete. 2024-04-25T02:16:22.668 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-04-25T02:16:22.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.764+0000 7f1750608700 1 -- 172.21.15.77:0/519416370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1748102de0 msgr2=0x7f17481031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:22.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.764+0000 7f1750608700 1 --2- 172.21.15.77:0/519416370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1748102de0 0x7f17481031b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1744004940 tx=0x7f1744009e30 comp rx=0 tx=0).stop 2024-04-25T02:16:22.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.764+0000 7f1750608700 1 -- 172.21.15.77:0/519416370 shutdown_connections 2024-04-25T02:16:22.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.764+0000 7f1750608700 1 --2- 172.21.15.77:0/519416370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1748103780 0x7f17480fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:22.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.764+0000 7f1750608700 1 --2- 172.21.15.77:0/519416370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1748102de0 0x7f17481031b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:22.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.764+0000 7f1750608700 1 -- 172.21.15.77:0/519416370 >> 172.21.15.77:0/519416370 conn(0x7f17480f8950 msgr2=0x7f17480fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:22.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.764+0000 7f1750608700 1 -- 172.21.15.77:0/519416370 shutdown_connections 2024-04-25T02:16:22.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.764+0000 7f1750608700 1 -- 172.21.15.77:0/519416370 wait complete. 2024-04-25T02:16:22.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.764+0000 7f1750608700 1 Processor -- start 2024-04-25T02:16:22.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.764+0000 7f1750608700 1 -- start start 2024-04-25T02:16:22.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.765+0000 7f1750608700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1748102de0 0x7f1748113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:22.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.765+0000 7f1750608700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1748103780 0x7f17481140f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:22.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.765+0000 7f1750608700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1748114740 con 0x7f1748103780 2024-04-25T02:16:22.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.765+0000 7f1750608700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174810db30 con 0x7f1748102de0 2024-04-25T02:16:22.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.765+0000 7f174dba3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1748103780 0x7f17481140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:22.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.765+0000 7f174dba3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1748103780 0x7f17481140f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49608/0 (socket says 172.21.15.77:49608) 2024-04-25T02:16:22.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.765+0000 7f174dba3700 1 -- 172.21.15.77:0/2305522679 learned_addr learned my addr 172.21.15.77:0/2305522679 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:16:22.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.765+0000 7f174e3a4700 1 --2- 172.21.15.77:0/2305522679 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1748102de0 0x7f1748113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:22.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.765+0000 7f174dba3700 1 -- 172.21.15.77:0/2305522679 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1748102de0 msgr2=0x7f1748113bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:22.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.765+0000 7f174dba3700 1 --2- 172.21.15.77:0/2305522679 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1748102de0 0x7f1748113bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:22.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.765+0000 7f174dba3700 1 -- 172.21.15.77:0/2305522679 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1744005040 con 0x7f1748103780 2024-04-25T02:16:22.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.765+0000 7f174e3a4700 1 --2- 172.21.15.77:0/2305522679 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1748102de0 0x7f1748113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:16:22.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.765+0000 7f174dba3700 1 --2- 172.21.15.77:0/2305522679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1748103780 0x7f17481140f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f173800c890 tx=0x7f17380044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:22.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.765+0000 7f173effd700 1 -- 172.21.15.77:0/2305522679 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f173800a7d0 con 0x7f1748103780 2024-04-25T02:16:22.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.765+0000 7f1750608700 1 -- 172.21.15.77:0/2305522679 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f174810de10 con 0x7f1748103780 2024-04-25T02:16:22.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.765+0000 7f173effd700 1 -- 172.21.15.77:0/2305522679 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f173800ae00 con 0x7f1748103780 2024-04-25T02:16:22.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.765+0000 7f173effd700 1 -- 172.21.15.77:0/2305522679 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17380113a0 con 0x7f1748103780 2024-04-25T02:16:22.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.765+0000 7f1750608700 1 -- 172.21.15.77:0/2305522679 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f174810e3d0 con 0x7f1748103780 2024-04-25T02:16:22.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.766+0000 7f1750608700 1 -- 172.21.15.77:0/2305522679 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17481000f0 con 0x7f1748103780 2024-04-25T02:16:22.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.767+0000 7f173effd700 1 -- 172.21.15.77:0/2305522679 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1738012400 con 0x7f1748103780 2024-04-25T02:16:22.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.767+0000 7f173effd700 1 --2- 172.21.15.77:0/2305522679 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f173406e140 0x7f17340705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:22.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.767+0000 7f173effd700 1 -- 172.21.15.77:0/2305522679 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f173808db80 con 0x7f1748103780 2024-04-25T02:16:22.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.767+0000 7f174e3a4700 1 --2- 172.21.15.77:0/2305522679 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f173406e140 0x7f17340705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:22.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.768+0000 7f174e3a4700 1 --2- 172.21.15.77:0/2305522679 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f173406e140 0x7f17340705f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1744004560 tx=0x7f1744009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:22.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.772+0000 7f173effd700 1 -- 172.21.15.77:0/2305522679 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f173805ab00 con 0x7f1748103780 2024-04-25T02:16:22.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.993+0000 7f1750608700 1 -- 172.21.15.77:0/2305522679 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f174810f200 con 0x7f173406e140 2024-04-25T02:16:22.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.994+0000 7f173effd700 1 -- 172.21.15.77:0/2305522679 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f174810f200 con 0x7f173406e140 2024-04-25T02:16:23.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.997+0000 7f1750608700 1 -- 172.21.15.77:0/2305522679 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f173406e140 msgr2=0x7f17340705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:23.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.997+0000 7f1750608700 1 --2- 172.21.15.77:0/2305522679 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f173406e140 0x7f17340705f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1744004560 tx=0x7f1744009e30 comp rx=0 tx=0).stop 2024-04-25T02:16:23.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.997+0000 7f1750608700 1 -- 172.21.15.77:0/2305522679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1748103780 msgr2=0x7f17481140f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:23.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.997+0000 7f1750608700 1 --2- 172.21.15.77:0/2305522679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1748103780 0x7f17481140f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f173800c890 tx=0x7f17380044c0 comp rx=0 tx=0).stop 2024-04-25T02:16:23.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.997+0000 7f1750608700 1 -- 172.21.15.77:0/2305522679 shutdown_connections 2024-04-25T02:16:23.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.997+0000 7f1750608700 1 --2- 172.21.15.77:0/2305522679 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f173406e140 0x7f17340705f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:23.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.997+0000 7f1750608700 1 --2- 172.21.15.77:0/2305522679 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1748102de0 0x7f1748113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:23.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.997+0000 7f1750608700 1 --2- 172.21.15.77:0/2305522679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1748103780 0x7f17481140f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:23.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.997+0000 7f1750608700 1 -- 172.21.15.77:0/2305522679 >> 172.21.15.77:0/2305522679 conn(0x7f17480f8950 msgr2=0x7f17481073d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:23.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.997+0000 7f1750608700 1 -- 172.21.15.77:0/2305522679 shutdown_connections 2024-04-25T02:16:23.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:22.997+0000 7f1750608700 1 -- 172.21.15.77:0/2305522679 wait complete. 2024-04-25T02:16:23.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.097+0000 7fd3aff53700 1 -- 172.21.15.77:0/3730228371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3a8101c70 msgr2=0x7fd3a8065640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:23.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.097+0000 7fd3aff53700 1 --2- 172.21.15.77:0/3730228371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3a8101c70 0x7fd3a8065640 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4004940 tx=0x7fd3a4009e30 comp rx=0 tx=0).stop 2024-04-25T02:16:23.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.097+0000 7fd3aff53700 1 -- 172.21.15.77:0/3730228371 shutdown_connections 2024-04-25T02:16:23.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.097+0000 7fd3aff53700 1 --2- 172.21.15.77:0/3730228371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3a8065b80 0x7fd3a8065ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:23.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.097+0000 7fd3aff53700 1 --2- 172.21.15.77:0/3730228371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3a8101c70 0x7fd3a8065640 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:23.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.097+0000 7fd3aff53700 1 -- 172.21.15.77:0/3730228371 >> 172.21.15.77:0/3730228371 conn(0x7fd3a8071d00 msgr2=0x7fd3a8072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:23.103 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:22 smithi077 ceph-mon[110441]: pgmap v107: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:23.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.098+0000 7fd3aff53700 1 -- 172.21.15.77:0/3730228371 shutdown_connections 2024-04-25T02:16:23.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.098+0000 7fd3aff53700 1 -- 172.21.15.77:0/3730228371 wait complete. 2024-04-25T02:16:23.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.098+0000 7fd3aff53700 1 Processor -- start 2024-04-25T02:16:23.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.098+0000 7fd3aff53700 1 -- start start 2024-04-25T02:16:23.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.099+0000 7fd3aff53700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3a8065b80 0x7fd3a811a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:23.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.099+0000 7fd3aff53700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3a8101c70 0x7fd3a811a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:23.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.099+0000 7fd3aff53700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a811ae00 con 0x7fd3a8065b80 2024-04-25T02:16:23.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.099+0000 7fd3aff53700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a81141d0 con 0x7fd3a8101c70 2024-04-25T02:16:23.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.099+0000 7fd3adcef700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3a8065b80 0x7fd3a811a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:23.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.099+0000 7fd3adcef700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3a8065b80 0x7fd3a811a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49638/0 (socket says 172.21.15.77:49638) 2024-04-25T02:16:23.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.099+0000 7fd3adcef700 1 -- 172.21.15.77:0/2331450768 learned_addr learned my addr 172.21.15.77:0/2331450768 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:16:23.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.099+0000 7fd3ad4ee700 1 --2- 172.21.15.77:0/2331450768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3a8101c70 0x7fd3a811a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:23.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.099+0000 7fd3adcef700 1 -- 172.21.15.77:0/2331450768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3a8101c70 msgr2=0x7fd3a811a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:23.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.099+0000 7fd3adcef700 1 --2- 172.21.15.77:0/2331450768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3a8101c70 0x7fd3a811a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:23.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.099+0000 7fd3adcef700 1 -- 172.21.15.77:0/2331450768 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a4005040 con 0x7fd3a8065b80 2024-04-25T02:16:23.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.099+0000 7fd3adcef700 1 --2- 172.21.15.77:0/2331450768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3a8065b80 0x7fd3a811a270 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd3a400b8b0 tx=0x7fd3a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:23.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.099+0000 7fd39e7fc700 1 -- 172.21.15.77:0/2331450768 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3a400e040 con 0x7fd3a8065b80 2024-04-25T02:16:23.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.099+0000 7fd3aff53700 1 -- 172.21.15.77:0/2331450768 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a8114450 con 0x7fd3a8065b80 2024-04-25T02:16:23.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.099+0000 7fd39e7fc700 1 -- 172.21.15.77:0/2331450768 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd3a4004290 con 0x7fd3a8065b80 2024-04-25T02:16:23.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.099+0000 7fd3aff53700 1 -- 172.21.15.77:0/2331450768 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a8114990 con 0x7fd3a8065b80 2024-04-25T02:16:23.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.100+0000 7fd39e7fc700 1 -- 172.21.15.77:0/2331450768 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3a4013d10 con 0x7fd3a8065b80 2024-04-25T02:16:23.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.100+0000 7fd3aff53700 1 -- 172.21.15.77:0/2331450768 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a80fc330 con 0x7fd3a8065b80 2024-04-25T02:16:23.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.101+0000 7fd39e7fc700 1 -- 172.21.15.77:0/2331450768 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd3a4013420 con 0x7fd3a8065b80 2024-04-25T02:16:23.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.102+0000 7fd39e7fc700 1 --2- 172.21.15.77:0/2331450768 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd39406e140 0x7fd3940705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:23.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.102+0000 7fd39e7fc700 1 -- 172.21.15.77:0/2331450768 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd3a408f730 con 0x7fd3a8065b80 2024-04-25T02:16:23.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.102+0000 7fd3ad4ee700 1 --2- 172.21.15.77:0/2331450768 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd39406e140 0x7fd3940705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:23.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.102+0000 7fd3ad4ee700 1 --2- 172.21.15.77:0/2331450768 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd39406e140 0x7fd3940705f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8115b10 tx=0x7fd39800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:23.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.107+0000 7fd39e7fc700 1 -- 172.21.15.77:0/2331450768 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fd3a405c6d0 con 0x7fd3a8065b80 2024-04-25T02:16:23.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:22 smithi112 ceph-mon[80494]: pgmap v107: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:23.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.313+0000 7fd3aff53700 1 -- 172.21.15.77:0/2331450768 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3a804bed0 con 0x7fd39406e140 2024-04-25T02:16:23.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.323+0000 7fd39e7fc700 1 -- 172.21.15.77:0/2331450768 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fd3a804bed0 con 0x7fd39406e140 2024-04-25T02:16:23.328 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T02:16:23.328 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (4m) 20s ago 15m 26.8M - 0.25.0 c8568f914cd2 699c7fd25ea5 2024-04-25T02:16:23.328 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (2m) 20s ago 15m 6660k - 19.0.0-2445-gd2c45d97 f68e37b807ef f3c45d31e2e3 2024-04-25T02:16:23.328 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi112 smithi112 running (118s) 114s ago 14m 6656k - 19.0.0-2445-gd2c45d97 f68e37b807ef e16d9899ed11 2024-04-25T02:16:23.328 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (4m) 20s ago 15m 80.8M - 9.4.12 2bacad6d85d8 900138b0bcf0 2024-04-25T02:16:23.328 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.gcfygj smithi077 running (10m) 20s ago 10m 16.0M - 17.2.7-902-gc61472c8 0de407c1b3af 382dd7abf674 2024-04-25T02:16:23.329 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.oadrkb smithi077 running (10m) 20s ago 10m 14.3M - 17.2.7-902-gc61472c8 0de407c1b3af 6992064a4b2a 2024-04-25T02:16:23.329 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.dvwudt smithi112 running (10m) 114s ago 10m 156M - 17.2.7-902-gc61472c8 0de407c1b3af 0792e451abfd 2024-04-25T02:16:23.329 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.fjnadi smithi112 running (10m) 114s ago 9m 15.2M - 17.2.7-902-gc61472c8 0de407c1b3af c8093f622f6b 2024-04-25T02:16:23.329 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.zpflzp smithi077 *:8443,9283,8765 running (6m) 20s ago 16m 504M - 19.0.0-2445-gd2c45d97 f68e37b807ef a1af92e027e5 2024-04-25T02:16:23.329 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi112.cswrxs smithi112 *:8443,9283,8765 running (5m) 114s ago 14m 448M - 19.0.0-2445-gd2c45d97 f68e37b807ef ccc7c57d35f2 2024-04-25T02:16:23.329 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (3m) 20s ago 17m 46.0M 2048M 19.0.0-2445-gd2c45d97 f68e37b807ef 06490c2ecc44 2024-04-25T02:16:23.329 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi112 smithi112 running (2m) 114s ago 14m 33.0M 2048M 19.0.0-2445-gd2c45d97 f68e37b807ef ccd1398acbc5 2024-04-25T02:16:23.329 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (5m) 20s ago 15m 17.0M - 1.5.0 0da6a335fe13 2320132606fc 2024-04-25T02:16:23.329 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi112 smithi112 *:9100 running (5m) 114s ago 14m 14.8M - 1.5.0 0da6a335fe13 49f285354791 2024-04-25T02:16:23.329 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (97s) 20s ago 13m 94.0M 1557M 19.0.0-2445-gd2c45d97 f68e37b807ef 7035e288ddae 2024-04-25T02:16:23.329 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (62s) 20s ago 13m 109M 1557M 19.0.0-2445-gd2c45d97 f68e37b807ef 6e514f700c36 2024-04-25T02:16:23.329 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (25s) 20s ago 12m 11.6M 1557M 19.0.0-2445-gd2c45d97 f68e37b807ef 392fd2036c16 2024-04-25T02:16:23.329 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi112 running (12m) 114s ago 12m 292M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 68429d0dbf88 2024-04-25T02:16:23.330 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi112 running (12m) 114s ago 12m 261M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 66eb71201444 2024-04-25T02:16:23.330 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi112 running (11m) 114s ago 11m 240M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 963e700d6aea 2024-04-25T02:16:23.330 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (4m) 20s ago 15m 59.4M - 2.43.0 a07b618ecd1d c5b8c6104d96 2024-04-25T02:16:23.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.325+0000 7fd3aff53700 1 -- 172.21.15.77:0/2331450768 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd39406e140 msgr2=0x7fd3940705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:23.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.325+0000 7fd3aff53700 1 --2- 172.21.15.77:0/2331450768 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd39406e140 0x7fd3940705f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8115b10 tx=0x7fd39800b040 comp rx=0 tx=0).stop 2024-04-25T02:16:23.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.325+0000 7fd3aff53700 1 -- 172.21.15.77:0/2331450768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3a8065b80 msgr2=0x7fd3a811a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:23.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.325+0000 7fd3aff53700 1 --2- 172.21.15.77:0/2331450768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3a8065b80 0x7fd3a811a270 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd3a400b8b0 tx=0x7fd3a4009e30 comp rx=0 tx=0).stop 2024-04-25T02:16:23.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.325+0000 7fd3aff53700 1 -- 172.21.15.77:0/2331450768 shutdown_connections 2024-04-25T02:16:23.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.325+0000 7fd3aff53700 1 --2- 172.21.15.77:0/2331450768 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd39406e140 0x7fd3940705f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:23.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.325+0000 7fd3aff53700 1 --2- 172.21.15.77:0/2331450768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3a8065b80 0x7fd3a811a270 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:23.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.325+0000 7fd3aff53700 1 --2- 172.21.15.77:0/2331450768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3a8101c70 0x7fd3a811a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:23.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.325+0000 7fd3aff53700 1 -- 172.21.15.77:0/2331450768 >> 172.21.15.77:0/2331450768 conn(0x7fd3a8071d00 msgr2=0x7fd3a80f9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:23.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.325+0000 7fd3aff53700 1 -- 172.21.15.77:0/2331450768 shutdown_connections 2024-04-25T02:16:23.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.325+0000 7fd3aff53700 1 -- 172.21.15.77:0/2331450768 wait complete. 2024-04-25T02:16:23.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.426+0000 7f062d10b700 1 -- 172.21.15.77:0/4240693233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0628101d90 msgr2=0x7f0628102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:23.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.426+0000 7f062d10b700 1 --2- 172.21.15.77:0/4240693233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0628101d90 0x7f0628102160 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0618004940 tx=0x7f0618009e30 comp rx=0 tx=0).stop 2024-04-25T02:16:23.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.426+0000 7f062d10b700 1 -- 172.21.15.77:0/4240693233 shutdown_connections 2024-04-25T02:16:23.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.426+0000 7f062d10b700 1 --2- 172.21.15.77:0/4240693233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06280fbd40 0x7f06280fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:23.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.426+0000 7f062d10b700 1 --2- 172.21.15.77:0/4240693233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0628101d90 0x7f0628102160 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:23.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.426+0000 7f062d10b700 1 -- 172.21.15.77:0/4240693233 >> 172.21.15.77:0/4240693233 conn(0x7f0628071d00 msgr2=0x7f0628072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:23.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.426+0000 7f062d10b700 1 -- 172.21.15.77:0/4240693233 shutdown_connections 2024-04-25T02:16:23.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.426+0000 7f062d10b700 1 -- 172.21.15.77:0/4240693233 wait complete. 2024-04-25T02:16:23.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.427+0000 7f062d10b700 1 Processor -- start 2024-04-25T02:16:23.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.427+0000 7f062d10b700 1 -- start start 2024-04-25T02:16:23.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.427+0000 7f062d10b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06280fbd40 0x7f0628102b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:23.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.427+0000 7f062d10b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0628101d90 0x7f0628103060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:23.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.427+0000 7f062d10b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06281035f0 con 0x7f06280fbd40 2024-04-25T02:16:23.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.427+0000 7f062d10b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0628103730 con 0x7f0628101d90 2024-04-25T02:16:23.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.427+0000 7f0626d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06280fbd40 0x7f0628102b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:23.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.427+0000 7f0626d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06280fbd40 0x7f0628102b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49656/0 (socket says 172.21.15.77:49656) 2024-04-25T02:16:23.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.427+0000 7f0626d9d700 1 -- 172.21.15.77:0/681143765 learned_addr learned my addr 172.21.15.77:0/681143765 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:16:23.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.427+0000 7f062659c700 1 --2- 172.21.15.77:0/681143765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0628101d90 0x7f0628103060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:23.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.427+0000 7f0626d9d700 1 -- 172.21.15.77:0/681143765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0628101d90 msgr2=0x7f0628103060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:23.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.427+0000 7f0626d9d700 1 --2- 172.21.15.77:0/681143765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0628101d90 0x7f0628103060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:23.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.427+0000 7f0626d9d700 1 -- 172.21.15.77:0/681143765 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0618005040 con 0x7f06280fbd40 2024-04-25T02:16:23.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.427+0000 7f0626d9d700 1 --2- 172.21.15.77:0/681143765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06280fbd40 0x7f0628102b20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f061800b3b0 tx=0x7f0618009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:23.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.428+0000 7f060f7fe700 1 -- 172.21.15.77:0/681143765 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f061800e040 con 0x7f06280fbd40 2024-04-25T02:16:23.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.428+0000 7f060f7fe700 1 -- 172.21.15.77:0/681143765 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0618013420 con 0x7f06280fbd40 2024-04-25T02:16:23.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.428+0000 7f062d10b700 1 -- 172.21.15.77:0/681143765 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0628103980 con 0x7f06280fbd40 2024-04-25T02:16:23.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.428+0000 7f060f7fe700 1 -- 172.21.15.77:0/681143765 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f061801c630 con 0x7f06280fbd40 2024-04-25T02:16:23.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.428+0000 7f062d10b700 1 -- 172.21.15.77:0/681143765 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f062811a280 con 0x7f06280fbd40 2024-04-25T02:16:23.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.429+0000 7f062d10b700 1 -- 172.21.15.77:0/681143765 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06280fd430 con 0x7f06280fbd40 2024-04-25T02:16:23.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.429+0000 7f060f7fe700 1 -- 172.21.15.77:0/681143765 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0618013590 con 0x7f06280fbd40 2024-04-25T02:16:23.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.430+0000 7f060f7fe700 1 --2- 172.21.15.77:0/681143765 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f061006e140 0x7f06100705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:23.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.430+0000 7f060f7fe700 1 -- 172.21.15.77:0/681143765 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f061808ed30 con 0x7f06280fbd40 2024-04-25T02:16:23.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.430+0000 7f062659c700 1 --2- 172.21.15.77:0/681143765 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f061006e140 0x7f06100705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:23.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.430+0000 7f062659c700 1 --2- 172.21.15.77:0/681143765 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f061006e140 0x7f06100705f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0628104460 tx=0x7f061c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:23.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.435+0000 7f060f7fe700 1 -- 172.21.15.77:0/681143765 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f0618058180 con 0x7f06280fbd40 2024-04-25T02:16:23.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.720+0000 7f062d10b700 1 -- 172.21.15.77:0/681143765 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f062805f5c0 con 0x7f06280fbd40 2024-04-25T02:16:23.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.720+0000 7f060f7fe700 1 -- 172.21.15.77:0/681143765 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f061805b840 con 0x7f06280fbd40 2024-04-25T02:16:23.725 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:16:23.725 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-04-25T02:16:23.725 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:16:23.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:16:23.725 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-04-25T02:16:23.725 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:16:23.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:16:23.725 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-04-25T02:16:23.725 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 3, 2024-04-25T02:16:23.726 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 3 2024-04-25T02:16:23.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:16:23.726 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-04-25T02:16:23.726 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T02:16:23.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:16:23.726 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-04-25T02:16:23.726 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 7, 2024-04-25T02:16:23.726 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 7 2024-04-25T02:16:23.726 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-25T02:16:23.726 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:16:23.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.722+0000 7f062d10b700 1 -- 172.21.15.77:0/681143765 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f061006e140 msgr2=0x7f06100705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:23.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.722+0000 7f062d10b700 1 --2- 172.21.15.77:0/681143765 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f061006e140 0x7f06100705f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0628104460 tx=0x7f061c00b040 comp rx=0 tx=0).stop 2024-04-25T02:16:23.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.722+0000 7f062d10b700 1 -- 172.21.15.77:0/681143765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06280fbd40 msgr2=0x7f0628102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:23.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.722+0000 7f062d10b700 1 --2- 172.21.15.77:0/681143765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06280fbd40 0x7f0628102b20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f061800b3b0 tx=0x7f0618009e30 comp rx=0 tx=0).stop 2024-04-25T02:16:23.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.722+0000 7f062d10b700 1 -- 172.21.15.77:0/681143765 shutdown_connections 2024-04-25T02:16:23.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.722+0000 7f062d10b700 1 --2- 172.21.15.77:0/681143765 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f061006e140 0x7f06100705f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:23.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.722+0000 7f062d10b700 1 --2- 172.21.15.77:0/681143765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06280fbd40 0x7f0628102b20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:23.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.722+0000 7f062d10b700 1 --2- 172.21.15.77:0/681143765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0628101d90 0x7f0628103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:23.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.722+0000 7f062d10b700 1 -- 172.21.15.77:0/681143765 >> 172.21.15.77:0/681143765 conn(0x7f0628071d00 msgr2=0x7f0628065610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:23.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.723+0000 7f062d10b700 1 -- 172.21.15.77:0/681143765 shutdown_connections 2024-04-25T02:16:23.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.723+0000 7f062d10b700 1 -- 172.21.15.77:0/681143765 wait complete. 2024-04-25T02:16:23.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.825+0000 7fd74d063700 1 -- 172.21.15.77:0/3692219529 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd748102e00 msgr2=0x7fd7481031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:23.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.825+0000 7fd74d063700 1 --2- 172.21.15.77:0/3692219529 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd748102e00 0x7fd7481031d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd738004940 tx=0x7fd738009e30 comp rx=0 tx=0).stop 2024-04-25T02:16:23.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.825+0000 7fd74d063700 1 -- 172.21.15.77:0/3692219529 shutdown_connections 2024-04-25T02:16:23.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.825+0000 7fd74d063700 1 --2- 172.21.15.77:0/3692219529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7481037a0 0x7fd7480fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:23.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.825+0000 7fd74d063700 1 --2- 172.21.15.77:0/3692219529 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd748102e00 0x7fd7481031d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:23.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.825+0000 7fd74d063700 1 -- 172.21.15.77:0/3692219529 >> 172.21.15.77:0/3692219529 conn(0x7fd7480f89b0 msgr2=0x7fd7480fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:23.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.825+0000 7fd74d063700 1 -- 172.21.15.77:0/3692219529 shutdown_connections 2024-04-25T02:16:23.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.825+0000 7fd74d063700 1 -- 172.21.15.77:0/3692219529 wait complete. 2024-04-25T02:16:23.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.826+0000 7fd74d063700 1 Processor -- start 2024-04-25T02:16:23.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.826+0000 7fd74d063700 1 -- start start 2024-04-25T02:16:23.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.826+0000 7fd74d063700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd748102e00 0x7fd748070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:23.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.826+0000 7fd74d063700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7481037a0 0x7fd7480707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:23.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.826+0000 7fd74d063700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd748072160 con 0x7fd7481037a0 2024-04-25T02:16:23.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.826+0000 7fd74d063700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd748070ce0 con 0x7fd748102e00 2024-04-25T02:16:23.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.826+0000 7fd74659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7481037a0 0x7fd7480707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:23.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.826+0000 7fd74659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7481037a0 0x7fd7480707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49684/0 (socket says 172.21.15.77:49684) 2024-04-25T02:16:23.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.826+0000 7fd746d9d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd748102e00 0x7fd748070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:23.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.826+0000 7fd74659c700 1 -- 172.21.15.77:0/1626879845 learned_addr learned my addr 172.21.15.77:0/1626879845 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:16:23.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.827+0000 7fd746d9d700 1 -- 172.21.15.77:0/1626879845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7481037a0 msgr2=0x7fd7480707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:23.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.827+0000 7fd746d9d700 1 --2- 172.21.15.77:0/1626879845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7481037a0 0x7fd7480707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:23.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.827+0000 7fd746d9d700 1 -- 172.21.15.77:0/1626879845 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd738005040 con 0x7fd748102e00 2024-04-25T02:16:23.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.827+0000 7fd74659c700 1 --2- 172.21.15.77:0/1626879845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7481037a0 0x7fd7480707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:16:23.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.827+0000 7fd746d9d700 1 --2- 172.21.15.77:0/1626879845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd748102e00 0x7fd748070260 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd738000c00 tx=0x7fd738009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:23.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.827+0000 7fd72f7fe700 1 -- 172.21.15.77:0/1626879845 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd73800e040 con 0x7fd748102e00 2024-04-25T02:16:23.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.827+0000 7fd74d063700 1 -- 172.21.15.77:0/1626879845 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd748070f60 con 0x7fd748102e00 2024-04-25T02:16:23.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.827+0000 7fd72f7fe700 1 -- 172.21.15.77:0/1626879845 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd7380093d0 con 0x7fd748102e00 2024-04-25T02:16:23.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.827+0000 7fd74d063700 1 -- 172.21.15.77:0/1626879845 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd74811a110 con 0x7fd748102e00 2024-04-25T02:16:23.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.828+0000 7fd72f7fe700 1 -- 172.21.15.77:0/1626879845 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd738013ea0 con 0x7fd748102e00 2024-04-25T02:16:23.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.828+0000 7fd74d063700 1 -- 172.21.15.77:0/1626879845 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd748100110 con 0x7fd748102e00 2024-04-25T02:16:23.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.829+0000 7fd72f7fe700 1 -- 172.21.15.77:0/1626879845 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd738013690 con 0x7fd748102e00 2024-04-25T02:16:23.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.829+0000 7fd72f7fe700 1 --2- 172.21.15.77:0/1626879845 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd73006e0e0 0x7fd730070590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:23.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.829+0000 7fd72f7fe700 1 -- 172.21.15.77:0/1626879845 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd73808ed70 con 0x7fd748102e00 2024-04-25T02:16:23.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.829+0000 7fd74659c700 1 --2- 172.21.15.77:0/1626879845 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd73006e0e0 0x7fd730070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:23.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.830+0000 7fd74659c700 1 --2- 172.21.15.77:0/1626879845 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd73006e0e0 0x7fd730070590 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd73c004fd0 tx=0x7fd73c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:23.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:23.841+0000 7fd72f7fe700 1 -- 172.21.15.77:0/1626879845 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fd7380581d0 con 0x7fd748102e00 2024-04-25T02:16:23.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:23 smithi077 ceph-mon[110441]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:16:23.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:23 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-25T02:16:23.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:23 smithi077 ceph-mon[110441]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-25T02:16:23.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:23 smithi077 ceph-mon[110441]: Upgrade: osd.3 is safe to restart 2024-04-25T02:16:23.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:23 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/681143765' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:16:23.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:23 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:23.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:23 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:16:24.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.085+0000 7fd74d063700 1 -- 172.21.15.77:0/1626879845 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd7480716f0 con 0x7fd748102e00 2024-04-25T02:16:24.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.086+0000 7fd72f7fe700 1 -- 172.21.15.77:0/1626879845 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1876 (secure 0 0 0) 0x7fd738013420 con 0x7fd748102e00 2024-04-25T02:16:24.091 INFO:teuthology.orchestra.run.smithi077.stdout:e15 2024-04-25T02:16:24.091 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T02:16:24.091 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:16:24.091 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-04-25T02:16:24.091 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:16:24.091 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-04-25T02:16:24.091 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-04-25T02:16:24.091 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 15 2024-04-25T02:16:24.091 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-25T02:16:24.091 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-04-25T02:06:10.008979+0000 2024-04-25T02:16:24.091 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-04-25T02:06:27.849984+0000 2024-04-25T02:16:24.091 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-04-25T02:16:24.092 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-04-25T02:16:24.092 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-04-25T02:16:24.092 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-04-25T02:16:24.092 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-04-25T02:16:24.092 INFO:teuthology.orchestra.run.smithi077.stdout:max_xattr_size 65536 2024-04-25T02:16:24.092 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-04-25T02:16:24.092 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-04-25T02:16:24.092 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 47 2024-04-25T02:16:24.092 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:16:24.092 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-04-25T02:16:24.092 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-04-25T02:16:24.092 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=24257} 2024-04-25T02:16:24.092 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-04-25T02:16:24.092 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-04-25T02:16:24.092 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-04-25T02:16:24.093 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-04-25T02:16:24.093 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-04-25T02:16:24.093 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-04-25T02:16:24.093 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-04-25T02:16:24.093 INFO:teuthology.orchestra.run.smithi077.stdout:bal_rank_mask -1 2024-04-25T02:16:24.093 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-04-25T02:16:24.093 INFO:teuthology.orchestra.run.smithi077.stdout:qdb_cluster leader: 0 members: 2024-04-25T02:16:24.093 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi112.dvwudt{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.112:6824/3687767796,v1:172.21.15.112:6825/3687767796] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:16:24.093 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:16:24.093 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:16:24.093 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-04-25T02:16:24.093 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:16:24.093 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.gcfygj{-1:14462} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/691698671,v1:172.21.15.77:6829/691698671] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:16:24.093 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.oadrkb{-1:14474} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.77:6826/26222645,v1:172.21.15.77:6827/26222645] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:16:24.093 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi112.fjnadi{-1:24269} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/2036319817,v1:172.21.15.112:6827/2036319817] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:16:24.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.088+0000 7fd74d063700 1 -- 172.21.15.77:0/1626879845 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd73006e0e0 msgr2=0x7fd730070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:24.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.088+0000 7fd74d063700 1 --2- 172.21.15.77:0/1626879845 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd73006e0e0 0x7fd730070590 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd73c004fd0 tx=0x7fd73c00b040 comp rx=0 tx=0).stop 2024-04-25T02:16:24.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.088+0000 7fd74d063700 1 -- 172.21.15.77:0/1626879845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd748102e00 msgr2=0x7fd748070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:24.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.088+0000 7fd74d063700 1 --2- 172.21.15.77:0/1626879845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd748102e00 0x7fd748070260 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd738000c00 tx=0x7fd738009e30 comp rx=0 tx=0).stop 2024-04-25T02:16:24.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.088+0000 7fd74d063700 1 -- 172.21.15.77:0/1626879845 shutdown_connections 2024-04-25T02:16:24.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.088+0000 7fd74d063700 1 --2- 172.21.15.77:0/1626879845 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd73006e0e0 0x7fd730070590 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:24.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.088+0000 7fd74d063700 1 --2- 172.21.15.77:0/1626879845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd748102e00 0x7fd748070260 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:24.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.088+0000 7fd74d063700 1 --2- 172.21.15.77:0/1626879845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7481037a0 0x7fd7480707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:24.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.088+0000 7fd74d063700 1 -- 172.21.15.77:0/1626879845 >> 172.21.15.77:0/1626879845 conn(0x7fd7480f89b0 msgr2=0x7fd748107370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:24.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.089+0000 7fd74d063700 1 -- 172.21.15.77:0/1626879845 shutdown_connections 2024-04-25T02:16:24.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.089+0000 7fd74d063700 1 -- 172.21.15.77:0/1626879845 wait complete. 2024-04-25T02:16:24.095 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 15 2024-04-25T02:16:24.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.190+0000 7f6e8a45c700 1 -- 172.21.15.77:0/193563820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e84071f30 msgr2=0x7f6e84070300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:24.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.190+0000 7f6e8a45c700 1 --2- 172.21.15.77:0/193563820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e84071f30 0x7f6e84070300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6e74004970 tx=0x7f6e74009e30 comp rx=0 tx=0).stop 2024-04-25T02:16:24.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.190+0000 7f6e8a45c700 1 -- 172.21.15.77:0/193563820 shutdown_connections 2024-04-25T02:16:24.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.190+0000 7f6e8a45c700 1 --2- 172.21.15.77:0/193563820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e84070840 0x7f6e84070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:24.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.190+0000 7f6e8a45c700 1 --2- 172.21.15.77:0/193563820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e84071f30 0x7f6e84070300 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:24.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.190+0000 7f6e8a45c700 1 -- 172.21.15.77:0/193563820 >> 172.21.15.77:0/193563820 conn(0x7f6e840f8990 msgr2=0x7f6e840fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:24.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.190+0000 7f6e8a45c700 1 -- 172.21.15.77:0/193563820 shutdown_connections 2024-04-25T02:16:24.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.190+0000 7f6e8a45c700 1 -- 172.21.15.77:0/193563820 wait complete. 2024-04-25T02:16:24.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.191+0000 7f6e8a45c700 1 Processor -- start 2024-04-25T02:16:24.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.191+0000 7f6e8a45c700 1 -- start start 2024-04-25T02:16:24.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.191+0000 7f6e8a45c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e84070840 0x7f6e84119fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:24.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.191+0000 7f6e8a45c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e84071f30 0x7f6e8411a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:24.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.191+0000 7f6e8a45c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8411ac00 con 0x7f6e84070840 2024-04-25T02:16:24.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.191+0000 7f6e8a45c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e84114150 con 0x7f6e84071f30 2024-04-25T02:16:24.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.191+0000 7f6e83fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e84070840 0x7f6e84119fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:24.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.191+0000 7f6e83fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e84070840 0x7f6e84119fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49698/0 (socket says 172.21.15.77:49698) 2024-04-25T02:16:24.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.191+0000 7f6e83fff700 1 -- 172.21.15.77:0/2143031725 learned_addr learned my addr 172.21.15.77:0/2143031725 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:16:24.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.191+0000 7f6e837fe700 1 --2- 172.21.15.77:0/2143031725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e84071f30 0x7f6e8411a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:24.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.191+0000 7f6e83fff700 1 -- 172.21.15.77:0/2143031725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e84071f30 msgr2=0x7f6e8411a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:24.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.191+0000 7f6e83fff700 1 --2- 172.21.15.77:0/2143031725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e84071f30 0x7f6e8411a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:24.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.191+0000 7f6e83fff700 1 -- 172.21.15.77:0/2143031725 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e74005040 con 0x7f6e84070840 2024-04-25T02:16:24.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.192+0000 7f6e83fff700 1 --2- 172.21.15.77:0/2143031725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e84070840 0x7f6e84119fe0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6e74000c00 tx=0x7f6e74009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:24.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.192+0000 7f6e80ff9700 1 -- 172.21.15.77:0/2143031725 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e7400e040 con 0x7f6e84070840 2024-04-25T02:16:24.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.192+0000 7f6e8a45c700 1 -- 172.21.15.77:0/2143031725 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e84114370 con 0x7f6e84070840 2024-04-25T02:16:24.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.192+0000 7f6e80ff9700 1 -- 172.21.15.77:0/2143031725 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6e7400bce0 con 0x7f6e84070840 2024-04-25T02:16:24.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.192+0000 7f6e80ff9700 1 -- 172.21.15.77:0/2143031725 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e7401c630 con 0x7f6e84070840 2024-04-25T02:16:24.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.192+0000 7f6e8a45c700 1 -- 172.21.15.77:0/2143031725 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e841148b0 con 0x7f6e84070840 2024-04-25T02:16:24.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.193+0000 7f6e8a45c700 1 -- 172.21.15.77:0/2143031725 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e84071a40 con 0x7f6e84070840 2024-04-25T02:16:24.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.193+0000 7f6e80ff9700 1 -- 172.21.15.77:0/2143031725 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6e74013980 con 0x7f6e84070840 2024-04-25T02:16:24.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.194+0000 7f6e80ff9700 1 --2- 172.21.15.77:0/2143031725 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f6e6c06e140 0x7f6e6c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:24.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.194+0000 7f6e837fe700 1 --2- 172.21.15.77:0/2143031725 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f6e6c06e140 0x7f6e6c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:24.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.194+0000 7f6e80ff9700 1 -- 172.21.15.77:0/2143031725 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f6e7408eba0 con 0x7f6e84070840 2024-04-25T02:16:24.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.194+0000 7f6e837fe700 1 --2- 172.21.15.77:0/2143031725 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f6e6c06e140 0x7f6e6c0705f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6e78006fd0 tx=0x7f6e78008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:24.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.199+0000 7f6e80ff9700 1 -- 172.21.15.77:0/2143031725 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f6e7405bb20 con 0x7f6e84070840 2024-04-25T02:16:24.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:23 smithi112 ceph-mon[80494]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:16:24.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:23 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-25T02:16:24.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:23 smithi112 ceph-mon[80494]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-25T02:16:24.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:23 smithi112 ceph-mon[80494]: Upgrade: osd.3 is safe to restart 2024-04-25T02:16:24.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:23 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/681143765' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:16:24.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:23 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:24.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:23 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:16:24.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.413+0000 7f6e8a45c700 1 -- 172.21.15.77:0/2143031725 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e841156f0 con 0x7f6e6c06e140 2024-04-25T02:16:24.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.415+0000 7f6e80ff9700 1 -- 172.21.15.77:0/2143031725 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f6e841156f0 con 0x7f6e6c06e140 2024-04-25T02:16:24.419 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:16:24.419 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901", 2024-04-25T02:16:24.419 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-04-25T02:16:24.419 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T02:16:24.419 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-04-25T02:16:24.419 INFO:teuthology.orchestra.run.smithi077.stdout: "mon", 2024-04-25T02:16:24.420 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr", 2024-04-25T02:16:24.420 INFO:teuthology.orchestra.run.smithi077.stdout: "crash" 2024-04-25T02:16:24.420 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-25T02:16:24.420 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "9/21 daemons upgraded", 2024-04-25T02:16:24.420 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading osd daemons", 2024-04-25T02:16:24.420 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-04-25T02:16:24.420 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:16:24.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.417+0000 7f6e8a45c700 1 -- 172.21.15.77:0/2143031725 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f6e6c06e140 msgr2=0x7f6e6c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:24.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.417+0000 7f6e8a45c700 1 --2- 172.21.15.77:0/2143031725 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f6e6c06e140 0x7f6e6c0705f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6e78006fd0 tx=0x7f6e78008040 comp rx=0 tx=0).stop 2024-04-25T02:16:24.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.417+0000 7f6e8a45c700 1 -- 172.21.15.77:0/2143031725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e84070840 msgr2=0x7f6e84119fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:24.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.417+0000 7f6e8a45c700 1 --2- 172.21.15.77:0/2143031725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e84070840 0x7f6e84119fe0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6e74000c00 tx=0x7f6e74009e30 comp rx=0 tx=0).stop 2024-04-25T02:16:24.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.417+0000 7f6e8a45c700 1 -- 172.21.15.77:0/2143031725 shutdown_connections 2024-04-25T02:16:24.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.417+0000 7f6e8a45c700 1 --2- 172.21.15.77:0/2143031725 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f6e6c06e140 0x7f6e6c0705f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:24.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.417+0000 7f6e8a45c700 1 --2- 172.21.15.77:0/2143031725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e84070840 0x7f6e84119fe0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:24.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.417+0000 7f6e8a45c700 1 --2- 172.21.15.77:0/2143031725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e84071f30 0x7f6e8411a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:24.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.417+0000 7f6e8a45c700 1 -- 172.21.15.77:0/2143031725 >> 172.21.15.77:0/2143031725 conn(0x7f6e840f8990 msgr2=0x7f6e840f9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:24.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.417+0000 7f6e8a45c700 1 -- 172.21.15.77:0/2143031725 shutdown_connections 2024-04-25T02:16:24.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.417+0000 7f6e8a45c700 1 -- 172.21.15.77:0/2143031725 wait complete. 2024-04-25T02:16:24.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.518+0000 7ff7147d4700 1 -- 172.21.15.77:0/1800365616 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff70c0fe720 msgr2=0x7ff70c106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:24.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.518+0000 7ff7147d4700 1 --2- 172.21.15.77:0/1800365616 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff70c0fe720 0x7ff70c106d60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc004940 tx=0x7ff6fc009e30 comp rx=0 tx=0).stop 2024-04-25T02:16:24.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.518+0000 7ff7147d4700 1 -- 172.21.15.77:0/1800365616 shutdown_connections 2024-04-25T02:16:24.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.518+0000 7ff7147d4700 1 --2- 172.21.15.77:0/1800365616 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff70c0fe720 0x7ff70c106d60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:24.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.518+0000 7ff7147d4700 1 --2- 172.21.15.77:0/1800365616 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff70c0fdd80 0x7ff70c0fe150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:24.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.518+0000 7ff7147d4700 1 -- 172.21.15.77:0/1800365616 >> 172.21.15.77:0/1800365616 conn(0x7ff70c0f7850 msgr2=0x7ff70c0f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:24.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.518+0000 7ff7147d4700 1 -- 172.21.15.77:0/1800365616 shutdown_connections 2024-04-25T02:16:24.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.518+0000 7ff7147d4700 1 -- 172.21.15.77:0/1800365616 wait complete. 2024-04-25T02:16:24.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.518+0000 7ff7147d4700 1 Processor -- start 2024-04-25T02:16:24.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.518+0000 7ff7147d4700 1 -- start start 2024-04-25T02:16:24.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.519+0000 7ff7147d4700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff70c0fdd80 0x7ff70c0fbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:24.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.519+0000 7ff7147d4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff70c0fe720 0x7ff70c0fc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:24.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.519+0000 7ff7147d4700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70c0fc6a0 con 0x7ff70c0fdd80 2024-04-25T02:16:24.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.519+0000 7ff7147d4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70c0fc810 con 0x7ff70c0fe720 2024-04-25T02:16:24.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.519+0000 7ff712570700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff70c0fdd80 0x7ff70c0fbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:24.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.519+0000 7ff712570700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff70c0fdd80 0x7ff70c0fbbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49712/0 (socket says 172.21.15.77:49712) 2024-04-25T02:16:24.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.519+0000 7ff712570700 1 -- 172.21.15.77:0/1793855000 learned_addr learned my addr 172.21.15.77:0/1793855000 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:16:24.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.519+0000 7ff711d6f700 1 --2- 172.21.15.77:0/1793855000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff70c0fe720 0x7ff70c0fc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:24.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.519+0000 7ff712570700 1 -- 172.21.15.77:0/1793855000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff70c0fe720 msgr2=0x7ff70c0fc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:24.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.519+0000 7ff712570700 1 --2- 172.21.15.77:0/1793855000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff70c0fe720 0x7ff70c0fc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:24.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.519+0000 7ff712570700 1 -- 172.21.15.77:0/1793855000 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc005040 con 0x7ff70c0fdd80 2024-04-25T02:16:24.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.519+0000 7ff712570700 1 --2- 172.21.15.77:0/1793855000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff70c0fdd80 0x7ff70c0fbbb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff70800eb40 tx=0x7ff70800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:24.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.519+0000 7ff702ffd700 1 -- 172.21.15.77:0/1793855000 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff708007cc0 con 0x7ff70c0fdd80 2024-04-25T02:16:24.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.519+0000 7ff702ffd700 1 -- 172.21.15.77:0/1793855000 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff70800f040 con 0x7ff70c0fdd80 2024-04-25T02:16:24.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.519+0000 7ff702ffd700 1 -- 172.21.15.77:0/1793855000 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff708009620 con 0x7ff70c0fdd80 2024-04-25T02:16:24.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.519+0000 7ff7147d4700 1 -- 172.21.15.77:0/1793855000 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff70c119e00 con 0x7ff70c0fdd80 2024-04-25T02:16:24.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.519+0000 7ff7147d4700 1 -- 172.21.15.77:0/1793855000 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff70c11a210 con 0x7ff70c0fdd80 2024-04-25T02:16:24.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.520+0000 7ff7147d4700 1 -- 172.21.15.77:0/1793855000 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff70c0669f0 con 0x7ff70c0fdd80 2024-04-25T02:16:24.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.521+0000 7ff702ffd700 1 -- 172.21.15.77:0/1793855000 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff708009780 con 0x7ff70c0fdd80 2024-04-25T02:16:24.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.521+0000 7ff702ffd700 1 --2- 172.21.15.77:0/1793855000 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7ff6f806e140 0x7ff6f80705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:24.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.521+0000 7ff702ffd700 1 -- 172.21.15.77:0/1793855000 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ff70808d6b0 con 0x7ff70c0fdd80 2024-04-25T02:16:24.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.521+0000 7ff711d6f700 1 --2- 172.21.15.77:0/1793855000 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7ff6f806e140 0x7ff6f80705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:24.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.522+0000 7ff711d6f700 1 --2- 172.21.15.77:0/1793855000 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7ff6f806e140 0x7ff6f80705f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc00b0d0 tx=0x7ff6fc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:24.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.526+0000 7ff702ffd700 1 -- 172.21.15.77:0/1793855000 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7ff708056bb0 con 0x7ff70c0fdd80 2024-04-25T02:16:24.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.811+0000 7ff7147d4700 1 -- 172.21.15.77:0/1793855000 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff70c0fb450 con 0x7ff70c0fdd80 2024-04-25T02:16:24.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.811+0000 7ff702ffd700 1 -- 172.21.15.77:0/1793855000 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff70805a270 con 0x7ff70c0fdd80 2024-04-25T02:16:24.816 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-04-25T02:16:24.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.814+0000 7ff7147d4700 1 -- 172.21.15.77:0/1793855000 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7ff6f806e140 msgr2=0x7ff6f80705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:24.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.814+0000 7ff7147d4700 1 --2- 172.21.15.77:0/1793855000 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7ff6f806e140 0x7ff6f80705f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc00b0d0 tx=0x7ff6fc009e30 comp rx=0 tx=0).stop 2024-04-25T02:16:24.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.814+0000 7ff7147d4700 1 -- 172.21.15.77:0/1793855000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff70c0fdd80 msgr2=0x7ff70c0fbbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:24.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.814+0000 7ff7147d4700 1 --2- 172.21.15.77:0/1793855000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff70c0fdd80 0x7ff70c0fbbb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff70800eb40 tx=0x7ff70800b040 comp rx=0 tx=0).stop 2024-04-25T02:16:24.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.814+0000 7ff7147d4700 1 -- 172.21.15.77:0/1793855000 shutdown_connections 2024-04-25T02:16:24.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.814+0000 7ff7147d4700 1 --2- 172.21.15.77:0/1793855000 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7ff6f806e140 0x7ff6f80705f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:24.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.814+0000 7ff7147d4700 1 --2- 172.21.15.77:0/1793855000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff70c0fdd80 0x7ff70c0fbbb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:24.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.814+0000 7ff7147d4700 1 --2- 172.21.15.77:0/1793855000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff70c0fe720 0x7ff70c0fc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:24.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.814+0000 7ff7147d4700 1 -- 172.21.15.77:0/1793855000 >> 172.21.15.77:0/1793855000 conn(0x7ff70c0f7850 msgr2=0x7ff70c0f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:24.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.814+0000 7ff7147d4700 1 -- 172.21.15.77:0/1793855000 shutdown_connections 2024-04-25T02:16:24.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:24.814+0000 7ff7147d4700 1 -- 172.21.15.77:0/1793855000 wait complete. 2024-04-25T02:16:25.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:24 smithi112 ceph-mon[80494]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:16:25.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:24 smithi112 ceph-mon[80494]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:16:25.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:24 smithi112 ceph-mon[80494]: pgmap v108: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:25.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:24 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/1626879845' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:16:25.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:24 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:25.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:24 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-25T02:16:25.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:24 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:16:25.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:24 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/1793855000' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T02:16:25.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:24 smithi077 ceph-mon[110441]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:16:25.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:24 smithi077 ceph-mon[110441]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:16:25.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:24 smithi077 ceph-mon[110441]: pgmap v108: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:25.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:24 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/1626879845' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:16:25.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:24 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:25.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:24 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-25T02:16:25.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:24 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:16:25.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:24 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/1793855000' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T02:16:26.145 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:25 smithi112 ceph-mon[80494]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:16:26.146 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:25 smithi112 ceph-mon[80494]: Upgrade: Updating osd.3 2024-04-25T02:16:26.146 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:25 smithi112 ceph-mon[80494]: Deploying daemon osd.3 on smithi112 2024-04-25T02:16:26.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:25 smithi077 ceph-mon[110441]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:16:26.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:25 smithi077 ceph-mon[110441]: Upgrade: Updating osd.3 2024-04-25T02:16:26.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:25 smithi077 ceph-mon[110441]: Deploying daemon osd.3 on smithi112 2024-04-25T02:16:27.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:26 smithi112 ceph-mon[80494]: pgmap v109: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:27.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:26 smithi077 ceph-mon[110441]: pgmap v109: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:28.059 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:27 smithi112 systemd[1]: Stopping Ceph osd.3 for 4bb93d82-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:16:28.527 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:28 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3[38886]: 2024-04-25T02:16:28.053+0000 7f60ec7b6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:16:28.527 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:28 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3[38886]: 2024-04-25T02:16:28.053+0000 7f60ec7b6700 -1 osd.3 65 *** Got signal Terminated *** 2024-04-25T02:16:28.527 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:28 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3[38886]: 2024-04-25T02:16:28.053+0000 7f60ec7b6700 -1 osd.3 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T02:16:29.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:28 smithi077 ceph-mon[110441]: pgmap v110: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:29.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:28 smithi077 ceph-mon[110441]: osd.3 marked itself down and dead 2024-04-25T02:16:29.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:28 smithi112 ceph-mon[80494]: pgmap v110: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:29.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:28 smithi112 ceph-mon[80494]: osd.3 marked itself down and dead 2024-04-25T02:16:29.684 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:29 smithi112 podman[89113]: 2024-04-25 02:16:29.372225695 +0000 UTC m=+1.424400584 container died 68429d0dbf886d3b9c60213a3cd5f32416a67c510889c73c8075fcf3556da803 (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=quincy-c61472c, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-25T02:16:30.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:29 smithi112 ceph-mon[80494]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-25T02:16:30.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:29 smithi112 ceph-mon[80494]: osdmap e66: 6 total, 5 up, 6 in 2024-04-25T02:16:30.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:29 smithi112 ceph-mon[80494]: osdmap e67: 6 total, 5 up, 6 in 2024-04-25T02:16:30.028 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:29 smithi112 podman[89113]: 2024-04-25 02:16:29.787236969 +0000 UTC m=+1.839411852 container cleanup 68429d0dbf886d3b9c60213a3cd5f32416a67c510889c73c8075fcf3556da803 (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, RELEASE=quincy-c61472c, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240424, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-25T02:16:30.028 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:29 smithi112 bash[89113]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3 2024-04-25T02:16:30.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:29 smithi077 ceph-mon[110441]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-25T02:16:30.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:29 smithi077 ceph-mon[110441]: osdmap e66: 6 total, 5 up, 6 in 2024-04-25T02:16:30.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:29 smithi077 ceph-mon[110441]: osdmap e67: 6 total, 5 up, 6 in 2024-04-25T02:16:30.461 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:30 smithi112 podman[89128]: 2024-04-25 02:16:30.055893563 +0000 UTC m=+0.677708945 container remove 68429d0dbf886d3b9c60213a3cd5f32416a67c510889c73c8075fcf3556da803 (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=quincy-c61472c, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD) 2024-04-25T02:16:30.738 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:30 smithi112 podman[89226]: 2024-04-25 02:16:30.360325946 +0000 UTC m=+0.017779816 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:16:30.738 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:30 smithi112 podman[89226]: 2024-04-25 02:16:30.498369415 +0000 UTC m=+0.155823322 container create 1d41e04038f4fbdcce280942fc21abdf9e12831e32268b9047a5bdb56171e57d (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=squid-d2c45d9, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-04-25T02:16:30.739 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:30 smithi112 podman[89226]: 2024-04-25 02:16:30.659049248 +0000 UTC m=+0.316503110 container init 1d41e04038f4fbdcce280942fc21abdf9e12831e32268b9047a5bdb56171e57d (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-d2c45d9, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-25T02:16:30.739 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:30 smithi112 podman[89226]: 2024-04-25 02:16:30.662251924 +0000 UTC m=+0.319705794 container start 1d41e04038f4fbdcce280942fc21abdf9e12831e32268b9047a5bdb56171e57d (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3-deactivate, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-d2c45d9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:16:30.739 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:30 smithi112 podman[89226]: 2024-04-25 02:16:30.734323658 +0000 UTC m=+0.391777530 container attach 1d41e04038f4fbdcce280942fc21abdf9e12831e32268b9047a5bdb56171e57d (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-d2c45d9, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-04-25T02:16:31.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:30 smithi112 ceph-mon[80494]: pgmap v112: 65 pgs: 22 peering, 5 stale+active+clean, 38 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:31.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:30 smithi112 ceph-mon[80494]: Health check failed: Reduced data availability: 11 pgs peering (PG_AVAILABILITY) 2024-04-25T02:16:31.028 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:30 smithi112 podman[89226]: 2024-04-25 02:16:30.952039687 +0000 UTC m=+0.609493556 container died 1d41e04038f4fbdcce280942fc21abdf9e12831e32268b9047a5bdb56171e57d (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-d2c45d9, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:16:31.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:30 smithi077 ceph-mon[110441]: pgmap v112: 65 pgs: 22 peering, 5 stale+active+clean, 38 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:31.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:30 smithi077 ceph-mon[110441]: Health check failed: Reduced data availability: 11 pgs peering (PG_AVAILABILITY) 2024-04-25T02:16:31.777 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:31 smithi112 podman[89252]: 2024-04-25 02:16:31.479573159 +0000 UTC m=+0.521369964 container remove 1d41e04038f4fbdcce280942fc21abdf9e12831e32268b9047a5bdb56171e57d (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=squid-d2c45d9, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T02:16:31.778 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:31 smithi112 systemd[1]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.3.service: Deactivated successfully. 2024-04-25T02:16:31.778 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:31 smithi112 systemd[1]: Stopped Ceph osd.3 for 4bb93d82-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:16:31.778 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:31 smithi112 systemd[1]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.3.service: Consumed 1min 16.614s CPU time. 2024-04-25T02:16:31.778 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:31 smithi112 systemd[1]: Starting Ceph osd.3 for 4bb93d82-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:16:32.221 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:31 smithi112 podman[89357]: 2024-04-25 02:16:31.812307354 +0000 UTC m=+0.018225978 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:16:32.221 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:31 smithi112 podman[89357]: 2024-04-25 02:16:31.914396198 +0000 UTC m=+0.120314858 container create 4690f14540b2a27789f92edfa7f14b5476fedc04ba9c156ea9f4a53ef83117a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS) 2024-04-25T02:16:32.221 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:32 smithi112 podman[89357]: 2024-04-25 02:16:32.125147516 +0000 UTC m=+0.331066133 container init 4690f14540b2a27789f92edfa7f14b5476fedc04ba9c156ea9f4a53ef83117a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3-activate, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-25T02:16:32.221 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:32 smithi112 podman[89357]: 2024-04-25 02:16:32.128331357 +0000 UTC m=+0.334249974 container start 4690f14540b2a27789f92edfa7f14b5476fedc04ba9c156ea9f4a53ef83117a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3-activate, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD) 2024-04-25T02:16:32.221 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:32 smithi112 podman[89357]: 2024-04-25 02:16:32.216813492 +0000 UTC m=+0.422732113 container attach 4690f14540b2a27789f92edfa7f14b5476fedc04ba9c156ea9f4a53ef83117a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3-activate, GIT_CLEAN=True, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:16:32.879 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:32 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3-activate[89373]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T02:16:32.879 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:32 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3-activate[89373]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-25T02:16:32.879 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:32 smithi112 bash[89357]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T02:16:32.879 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:32 smithi112 bash[89357]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-25T02:16:32.879 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:32 smithi112 bash[89357]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-25T02:16:32.879 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:32 smithi112 bash[89357]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-25T02:16:32.879 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:32 smithi112 bash[89357]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-04-25T02:16:32.879 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:32 smithi112 bash[89357]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T02:16:32.879 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:32 smithi112 bash[89357]: --> ceph-volume raw activate successful for osd ID: 3 2024-04-25T02:16:32.879 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:32 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3-activate[89373]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-25T02:16:32.879 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:32 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3-activate[89373]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-25T02:16:32.879 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:32 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3-activate[89373]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-04-25T02:16:32.880 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:32 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3-activate[89373]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T02:16:32.880 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:32 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3-activate[89373]: --> ceph-volume raw activate successful for osd ID: 3 2024-04-25T02:16:32.880 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:32 smithi112 podman[89357]: 2024-04-25 02:16:32.590233107 +0000 UTC m=+0.796151712 container died 4690f14540b2a27789f92edfa7f14b5476fedc04ba9c156ea9f4a53ef83117a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3-activate, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-d2c45d9, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, ceph=True) 2024-04-25T02:16:33.215 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:32 smithi112 ceph-mon[80494]: pgmap v114: 65 pgs: 22 peering, 5 stale+active+clean, 38 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:33.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:32 smithi077 ceph-mon[110441]: pgmap v114: 65 pgs: 22 peering, 5 stale+active+clean, 38 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:33.467 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:33 smithi112 podman[89498]: 2024-04-25 02:16:33.211374455 +0000 UTC m=+0.615458769 container remove 4690f14540b2a27789f92edfa7f14b5476fedc04ba9c156ea9f4a53ef83117a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3-activate, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240424, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-d2c45d9, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-04-25T02:16:33.468 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:33 smithi112 podman[89562]: 2024-04-25 02:16:33.332728529 +0000 UTC m=+0.019031608 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:16:33.468 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:33 smithi112 podman[89562]: 2024-04-25 02:16:33.46370906 +0000 UTC m=+0.150012178 container create c100df1a0f60920c8a0f96cdcde3bff35175cf74e96d04730fe0e05583fb1fad (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3, RELEASE=squid-d2c45d9, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T02:16:33.761 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:33 smithi112 podman[89562]: 2024-04-25 02:16:33.658094962 +0000 UTC m=+0.344398043 container init c100df1a0f60920c8a0f96cdcde3bff35175cf74e96d04730fe0e05583fb1fad (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True) 2024-04-25T02:16:33.762 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:33 smithi112 podman[89562]: 2024-04-25 02:16:33.661254163 +0000 UTC m=+0.347557240 container start c100df1a0f60920c8a0f96cdcde3bff35175cf74e96d04730fe0e05583fb1fad (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-d2c45d9) 2024-04-25T02:16:33.762 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:33 smithi112 ceph-osd[89580]: -- 172.21.15.112:0/1188765371 <== mon.1 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55824666b680 con 0x558246634c00 2024-04-25T02:16:34.027 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:33 smithi112 bash[89562]: c100df1a0f60920c8a0f96cdcde3bff35175cf74e96d04730fe0e05583fb1fad 2024-04-25T02:16:34.027 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:33 smithi112 systemd[1]: Started Ceph osd.3 for 4bb93d82-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:16:34.528 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:34 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3[89576]: 2024-04-25T02:16:34.205+0000 7fe7d88727c0 -1 Falling back to public interface 2024-04-25T02:16:35.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:34 smithi112 ceph-mon[80494]: pgmap v115: 65 pgs: 8 active+undersized+degraded, 22 peering, 8 active+undersized, 27 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 22/219 objects degraded (10.046%) 2024-04-25T02:16:35.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:34 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:35.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:34 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:35.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:34 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:16:35.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:34 smithi112 ceph-mon[80494]: Health check failed: Degraded data redundancy: 22/219 objects degraded (10.046%), 8 pgs degraded (PG_DEGRADED) 2024-04-25T02:16:35.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:34 smithi077 ceph-mon[110441]: pgmap v115: 65 pgs: 8 active+undersized+degraded, 22 peering, 8 active+undersized, 27 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 22/219 objects degraded (10.046%) 2024-04-25T02:16:35.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:34 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:35.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:34 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:35.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:34 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:16:35.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:34 smithi077 ceph-mon[110441]: Health check failed: Degraded data redundancy: 22/219 objects degraded (10.046%), 8 pgs degraded (PG_DEGRADED) 2024-04-25T02:16:36.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:35 smithi112 ceph-mon[80494]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 11 pgs peering) 2024-04-25T02:16:36.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:35 smithi077 ceph-mon[110441]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 11 pgs peering) 2024-04-25T02:16:37.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:36 smithi077 ceph-mon[110441]: pgmap v116: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/219 objects degraded (22.374%) 2024-04-25T02:16:37.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:36 smithi112 ceph-mon[80494]: pgmap v116: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/219 objects degraded (22.374%) 2024-04-25T02:16:38.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:37 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:38.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:37 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:38.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:37 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:38.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:37 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:38.943 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:38 smithi112 ceph-mon[80494]: pgmap v117: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/219 objects degraded (22.374%) 2024-04-25T02:16:38.943 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:38 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:38.944 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:38 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:38.944 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:38 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:38.944 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:38 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:16:38.944 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:38 smithi112 ceph-mon[80494]: Health check update: Degraded data redundancy: 49/219 objects degraded (22.374%), 17 pgs degraded (PG_DEGRADED) 2024-04-25T02:16:39.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:38 smithi077 ceph-mon[110441]: pgmap v117: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/219 objects degraded (22.374%) 2024-04-25T02:16:39.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:38 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:39.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:38 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:39.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:38 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:39.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:38 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:16:39.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:38 smithi077 ceph-mon[110441]: Health check update: Degraded data redundancy: 49/219 objects degraded (22.374%), 17 pgs degraded (PG_DEGRADED) 2024-04-25T02:16:39.705 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:39 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3[89576]: 2024-04-25T02:16:39.418+0000 7fe7d88727c0 -1 osd.3 65 log_to_monitors true 2024-04-25T02:16:40.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:39 smithi112 ceph-mon[80494]: from='osd.3 [v2:172.21.15.112:6800/3463246852,v1:172.21.15.112:6801/3463246852]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T02:16:40.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:39 smithi112 ceph-mon[80494]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T02:16:40.028 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:16:39 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3[89576]: 2024-04-25T02:16:39.939+0000 7fe7c9cca700 -1 osd.3 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:16:40.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:39 smithi077 ceph-mon[110441]: from='osd.3 [v2:172.21.15.112:6800/3463246852,v1:172.21.15.112:6801/3463246852]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T02:16:40.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:39 smithi077 ceph-mon[110441]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T02:16:41.154 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:40 smithi112 ceph-mon[80494]: pgmap v118: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/219 objects degraded (22.374%) 2024-04-25T02:16:41.154 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:40 smithi112 ceph-mon[80494]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-25T02:16:41.155 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:40 smithi112 ceph-mon[80494]: from='osd.3 [v2:172.21.15.112:6800/3463246852,v1:172.21.15.112:6801/3463246852]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T02:16:41.155 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:40 smithi112 ceph-mon[80494]: osdmap e68: 6 total, 5 up, 6 in 2024-04-25T02:16:41.155 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:40 smithi112 ceph-mon[80494]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T02:16:41.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:40 smithi077 ceph-mon[110441]: pgmap v118: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/219 objects degraded (22.374%) 2024-04-25T02:16:41.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:40 smithi077 ceph-mon[110441]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-25T02:16:41.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:40 smithi077 ceph-mon[110441]: from='osd.3 [v2:172.21.15.112:6800/3463246852,v1:172.21.15.112:6801/3463246852]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T02:16:41.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:40 smithi077 ceph-mon[110441]: osdmap e68: 6 total, 5 up, 6 in 2024-04-25T02:16:41.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:40 smithi077 ceph-mon[110441]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T02:16:41.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:41 smithi077 ceph-mon[110441]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-25T02:16:41.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:41 smithi077 ceph-mon[110441]: osd.3 [v2:172.21.15.112:6800/3463246852,v1:172.21.15.112:6801/3463246852] boot 2024-04-25T02:16:41.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:41 smithi077 ceph-mon[110441]: osdmap e69: 6 total, 6 up, 6 in 2024-04-25T02:16:41.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:41 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:16:41.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:41 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:41.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:41 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:41.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:41 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:16:41.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:41 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:16:41.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:41 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:41.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:41 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:16:41.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:41 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:16:41.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:41 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:16:41.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:41 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:16:41.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:41 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-25T02:16:42.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:41 smithi112 ceph-mon[80494]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-25T02:16:42.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:41 smithi112 ceph-mon[80494]: osd.3 [v2:172.21.15.112:6800/3463246852,v1:172.21.15.112:6801/3463246852] boot 2024-04-25T02:16:42.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:41 smithi112 ceph-mon[80494]: osdmap e69: 6 total, 6 up, 6 in 2024-04-25T02:16:42.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:41 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:16:42.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:41 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:42.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:41 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:42.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:41 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:16:42.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:41 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:16:42.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:41 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:42.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:41 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:16:42.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:41 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:16:42.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:41 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:16:42.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:41 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:16:42.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:41 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-25T02:16:43.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:42 smithi077 ceph-mon[110441]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-25T02:16:43.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:42 smithi077 ceph-mon[110441]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-04-25T02:16:43.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:42 smithi077 ceph-mon[110441]: pgmap v121: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/219 objects degraded (22.374%) 2024-04-25T02:16:43.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:42 smithi077 ceph-mon[110441]: osdmap e70: 6 total, 6 up, 6 in 2024-04-25T02:16:43.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:42 smithi112 ceph-mon[80494]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-25T02:16:43.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:42 smithi112 ceph-mon[80494]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-04-25T02:16:43.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:42 smithi112 ceph-mon[80494]: pgmap v121: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/219 objects degraded (22.374%) 2024-04-25T02:16:43.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:42 smithi112 ceph-mon[80494]: osdmap e70: 6 total, 6 up, 6 in 2024-04-25T02:16:45.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:44 smithi077 ceph-mon[110441]: pgmap v123: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/219 objects degraded (15.525%) 2024-04-25T02:16:45.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:44 smithi077 ceph-mon[110441]: Health check update: Degraded data redundancy: 34/219 objects degraded (15.525%), 12 pgs degraded (PG_DEGRADED) 2024-04-25T02:16:45.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:44 smithi112 ceph-mon[80494]: pgmap v123: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/219 objects degraded (15.525%) 2024-04-25T02:16:45.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:44 smithi112 ceph-mon[80494]: Health check update: Degraded data redundancy: 34/219 objects degraded (15.525%), 12 pgs degraded (PG_DEGRADED) 2024-04-25T02:16:46.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:45 smithi077 ceph-mon[110441]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 34/219 objects degraded (15.525%), 12 pgs degraded) 2024-04-25T02:16:46.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:45 smithi077 ceph-mon[110441]: Cluster is now healthy 2024-04-25T02:16:46.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:45 smithi112 ceph-mon[80494]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 34/219 objects degraded (15.525%), 12 pgs degraded) 2024-04-25T02:16:46.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:45 smithi112 ceph-mon[80494]: Cluster is now healthy 2024-04-25T02:16:47.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:46 smithi077 ceph-mon[110441]: pgmap v124: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:47.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:46 smithi112 ceph-mon[80494]: pgmap v124: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:49.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:48 smithi077 ceph-mon[110441]: pgmap v125: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:49.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:48 smithi112 ceph-mon[80494]: pgmap v125: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:51.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:50 smithi077 ceph-mon[110441]: pgmap v126: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:51.263 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:50 smithi112 ceph-mon[80494]: pgmap v126: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:53.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:52 smithi077 ceph-mon[110441]: pgmap v127: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:53.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:52 smithi112 ceph-mon[80494]: pgmap v127: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:54.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.920+0000 7f4313ffd700 1 -- 172.21.15.77:0/1955334834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f430c0fbf40 msgr2=0x7f430c101a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:54.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.920+0000 7f4313ffd700 1 --2- 172.21.15.77:0/1955334834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f430c0fbf40 0x7f430c101a30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4308004940 tx=0x7f4308009e30 comp rx=0 tx=0).stop 2024-04-25T02:16:54.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.920+0000 7f4313ffd700 1 -- 172.21.15.77:0/1955334834 shutdown_connections 2024-04-25T02:16:54.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.920+0000 7f4313ffd700 1 --2- 172.21.15.77:0/1955334834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f430c0fbf40 0x7f430c101a30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:54.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.920+0000 7f4313ffd700 1 --2- 172.21.15.77:0/1955334834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f430c0fb5a0 0x7f430c0fb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:54.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.920+0000 7f4313ffd700 1 -- 172.21.15.77:0/1955334834 >> 172.21.15.77:0/1955334834 conn(0x7f430c073350 msgr2=0x7f430c073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:54.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.920+0000 7f4313ffd700 1 -- 172.21.15.77:0/1955334834 shutdown_connections 2024-04-25T02:16:54.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.920+0000 7f4313ffd700 1 -- 172.21.15.77:0/1955334834 wait complete. 2024-04-25T02:16:54.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.921+0000 7f4313ffd700 1 Processor -- start 2024-04-25T02:16:54.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.921+0000 7f4313ffd700 1 -- start start 2024-04-25T02:16:54.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.921+0000 7f4313ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f430c0fb5a0 0x7f430c113a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:54.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.921+0000 7f4313ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f430c0fbf40 0x7f430c113f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:54.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.921+0000 7f4313ffd700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c114650 con 0x7f430c0fb5a0 2024-04-25T02:16:54.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.921+0000 7f4313ffd700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c10dba0 con 0x7f430c0fbf40 2024-04-25T02:16:54.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.921+0000 7f4311d99700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f430c0fb5a0 0x7f430c113a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:54.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.921+0000 7f4311d99700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f430c0fb5a0 0x7f430c113a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49320/0 (socket says 172.21.15.77:49320) 2024-04-25T02:16:54.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.921+0000 7f4311d99700 1 -- 172.21.15.77:0/3672433008 learned_addr learned my addr 172.21.15.77:0/3672433008 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:16:54.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.921+0000 7f4311598700 1 --2- 172.21.15.77:0/3672433008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f430c0fbf40 0x7f430c113f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:54.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.921+0000 7f4311d99700 1 -- 172.21.15.77:0/3672433008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f430c0fbf40 msgr2=0x7f430c113f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:54.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.921+0000 7f4311d99700 1 --2- 172.21.15.77:0/3672433008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f430c0fbf40 0x7f430c113f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:54.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.921+0000 7f4311d99700 1 -- 172.21.15.77:0/3672433008 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4308005040 con 0x7f430c0fb5a0 2024-04-25T02:16:54.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.922+0000 7f4311d99700 1 --2- 172.21.15.77:0/3672433008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f430c0fb5a0 0x7f430c113a30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f42fc00b790 tx=0x7f42fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:54.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.922+0000 7f43027fc700 1 -- 172.21.15.77:0/3672433008 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42fc00f770 con 0x7f430c0fb5a0 2024-04-25T02:16:54.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.922+0000 7f4313ffd700 1 -- 172.21.15.77:0/3672433008 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f430c10de20 con 0x7f430c0fb5a0 2024-04-25T02:16:54.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.922+0000 7f43027fc700 1 -- 172.21.15.77:0/3672433008 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f42fc00fda0 con 0x7f430c0fb5a0 2024-04-25T02:16:54.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.922+0000 7f43027fc700 1 -- 172.21.15.77:0/3672433008 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42fc00d310 con 0x7f430c0fb5a0 2024-04-25T02:16:54.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.922+0000 7f4313ffd700 1 -- 172.21.15.77:0/3672433008 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f430c10e360 con 0x7f430c0fb5a0 2024-04-25T02:16:54.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.923+0000 7f4313ffd700 1 -- 172.21.15.77:0/3672433008 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f430c0fe670 con 0x7f430c0fb5a0 2024-04-25T02:16:54.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.923+0000 7f43027fc700 1 -- 172.21.15.77:0/3672433008 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f42fc010420 con 0x7f430c0fb5a0 2024-04-25T02:16:54.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.924+0000 7f43027fc700 1 --2- 172.21.15.77:0/3672433008 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f42f806e140 0x7f42f80705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:54.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.924+0000 7f43027fc700 1 -- 172.21.15.77:0/3672433008 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f42fc08daf0 con 0x7f430c0fb5a0 2024-04-25T02:16:54.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.924+0000 7f4311598700 1 --2- 172.21.15.77:0/3672433008 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f42f806e140 0x7f42f80705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:54.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.924+0000 7f4311598700 1 --2- 172.21.15.77:0/3672433008 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f42f806e140 0x7f42f80705f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f430c10f2d0 tx=0x7f4308009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:54.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:54.929+0000 7f43027fc700 1 -- 172.21.15.77:0/3672433008 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f42fc05aa70 con 0x7f430c0fb5a0 2024-04-25T02:16:55.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.146+0000 7f4313ffd700 1 -- 172.21.15.77:0/3672433008 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f430c10e5e0 con 0x7f42f806e140 2024-04-25T02:16:55.150 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:54 smithi077 ceph-mon[110441]: pgmap v128: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:55.151 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:54 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:55.151 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:54 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:16:55.151 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:54 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:55.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.147+0000 7f43027fc700 1 -- 172.21.15.77:0/3672433008 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f430c10e5e0 con 0x7f42f806e140 2024-04-25T02:16:55.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.149+0000 7f4313ffd700 1 -- 172.21.15.77:0/3672433008 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f42f806e140 msgr2=0x7f42f80705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:55.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.149+0000 7f4313ffd700 1 --2- 172.21.15.77:0/3672433008 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f42f806e140 0x7f42f80705f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f430c10f2d0 tx=0x7f4308009e30 comp rx=0 tx=0).stop 2024-04-25T02:16:55.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.149+0000 7f4313ffd700 1 -- 172.21.15.77:0/3672433008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f430c0fb5a0 msgr2=0x7f430c113a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:55.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.149+0000 7f4313ffd700 1 --2- 172.21.15.77:0/3672433008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f430c0fb5a0 0x7f430c113a30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f42fc00b790 tx=0x7f42fc009250 comp rx=0 tx=0).stop 2024-04-25T02:16:55.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.149+0000 7f4313ffd700 1 -- 172.21.15.77:0/3672433008 shutdown_connections 2024-04-25T02:16:55.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.149+0000 7f4313ffd700 1 --2- 172.21.15.77:0/3672433008 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f42f806e140 0x7f42f80705f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:55.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.149+0000 7f4313ffd700 1 --2- 172.21.15.77:0/3672433008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f430c0fb5a0 0x7f430c113a30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:55.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.149+0000 7f4313ffd700 1 --2- 172.21.15.77:0/3672433008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f430c0fbf40 0x7f430c113f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:55.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.149+0000 7f4313ffd700 1 -- 172.21.15.77:0/3672433008 >> 172.21.15.77:0/3672433008 conn(0x7f430c073350 msgr2=0x7f430c0f8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:55.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.149+0000 7f4313ffd700 1 -- 172.21.15.77:0/3672433008 shutdown_connections 2024-04-25T02:16:55.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.149+0000 7f4313ffd700 1 -- 172.21.15.77:0/3672433008 wait complete. 2024-04-25T02:16:55.164 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-04-25T02:16:55.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.250+0000 7f4e0278b700 1 -- 172.21.15.77:0/3312257360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dfc0fb520 msgr2=0x7f4dfc0fb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:55.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.250+0000 7f4e0278b700 1 --2- 172.21.15.77:0/3312257360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dfc0fb520 0x7f4dfc0fb990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4df0004940 tx=0x7f4df0009e30 comp rx=0 tx=0).stop 2024-04-25T02:16:55.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.250+0000 7f4e0278b700 1 -- 172.21.15.77:0/3312257360 shutdown_connections 2024-04-25T02:16:55.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.250+0000 7f4e0278b700 1 --2- 172.21.15.77:0/3312257360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dfc0fb520 0x7f4dfc0fb990 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:55.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.250+0000 7f4e0278b700 1 --2- 172.21.15.77:0/3312257360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dfc102f60 0x7f4dfc103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:55.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.250+0000 7f4e0278b700 1 -- 172.21.15.77:0/3312257360 >> 172.21.15.77:0/3312257360 conn(0x7f4dfc0714d0 msgr2=0x7f4dfc0718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:55.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.250+0000 7f4e0278b700 1 -- 172.21.15.77:0/3312257360 shutdown_connections 2024-04-25T02:16:55.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.250+0000 7f4e0278b700 1 -- 172.21.15.77:0/3312257360 wait complete. 2024-04-25T02:16:55.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.251+0000 7f4e0278b700 1 Processor -- start 2024-04-25T02:16:55.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.251+0000 7f4e0278b700 1 -- start start 2024-04-25T02:16:55.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.251+0000 7f4e0278b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dfc0fb520 0x7f4dfc0fc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:55.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.251+0000 7f4e0278b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dfc102f60 0x7f4dfc0fcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:55.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.251+0000 7f4e0278b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc0fe6e0 con 0x7f4dfc0fb520 2024-04-25T02:16:55.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.251+0000 7f4e0278b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc0fd180 con 0x7f4dfc102f60 2024-04-25T02:16:55.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.251+0000 7f4dfbfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dfc0fb520 0x7f4dfc0fc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:55.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.252+0000 7f4dfbfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dfc0fb520 0x7f4dfc0fc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49328/0 (socket says 172.21.15.77:49328) 2024-04-25T02:16:55.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.252+0000 7f4dfbfff700 1 -- 172.21.15.77:0/1301342894 learned_addr learned my addr 172.21.15.77:0/1301342894 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:16:55.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.252+0000 7f4dfb7fe700 1 --2- 172.21.15.77:0/1301342894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dfc102f60 0x7f4dfc0fcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:55.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.252+0000 7f4dfbfff700 1 -- 172.21.15.77:0/1301342894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dfc102f60 msgr2=0x7f4dfc0fcc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:55.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.252+0000 7f4dfbfff700 1 --2- 172.21.15.77:0/1301342894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dfc102f60 0x7f4dfc0fcc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:55.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.252+0000 7f4dfbfff700 1 -- 172.21.15.77:0/1301342894 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df0005040 con 0x7f4dfc0fb520 2024-04-25T02:16:55.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.252+0000 7f4dfbfff700 1 --2- 172.21.15.77:0/1301342894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dfc0fb520 0x7f4dfc0fc700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4dec00b790 tx=0x7f4dec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:55.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.252+0000 7f4df8ff9700 1 -- 172.21.15.77:0/1301342894 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dec00f770 con 0x7f4dfc0fb520 2024-04-25T02:16:55.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.252+0000 7f4df8ff9700 1 -- 172.21.15.77:0/1301342894 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4dec00fda0 con 0x7f4dfc0fb520 2024-04-25T02:16:55.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.252+0000 7f4e0278b700 1 -- 172.21.15.77:0/1301342894 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dfc0fd460 con 0x7f4dfc0fb520 2024-04-25T02:16:55.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.252+0000 7f4df8ff9700 1 -- 172.21.15.77:0/1301342894 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dec00d310 con 0x7f4dfc0fb520 2024-04-25T02:16:55.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.252+0000 7f4e0278b700 1 -- 172.21.15.77:0/1301342894 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dfc11a200 con 0x7f4dfc0fb520 2024-04-25T02:16:55.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.253+0000 7f4e0278b700 1 -- 172.21.15.77:0/1301342894 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dfc100250 con 0x7f4dfc0fb520 2024-04-25T02:16:55.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.254+0000 7f4df8ff9700 1 -- 172.21.15.77:0/1301342894 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4dec010420 con 0x7f4dfc0fb520 2024-04-25T02:16:55.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.254+0000 7f4df8ff9700 1 --2- 172.21.15.77:0/1301342894 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f4de406e140 0x7f4de40705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:55.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.254+0000 7f4df8ff9700 1 -- 172.21.15.77:0/1301342894 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f4dec08db00 con 0x7f4dfc0fb520 2024-04-25T02:16:55.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.254+0000 7f4dfb7fe700 1 --2- 172.21.15.77:0/1301342894 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f4de406e140 0x7f4de40705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:55.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.255+0000 7f4dfb7fe700 1 --2- 172.21.15.77:0/1301342894 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f4de406e140 0x7f4de40705f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4df0004f90 tx=0x7f4df0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:55.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.259+0000 7f4df8ff9700 1 -- 172.21.15.77:0/1301342894 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f4dec056f50 con 0x7f4dfc0fb520 2024-04-25T02:16:55.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:54 smithi112 ceph-mon[80494]: pgmap v128: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:55.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:54 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:55.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:54 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:16:55.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:54 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:55.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.473+0000 7f4e0278b700 1 -- 172.21.15.77:0/1301342894 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4dfc10a0d0 con 0x7f4de406e140 2024-04-25T02:16:55.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.474+0000 7f4df8ff9700 1 -- 172.21.15.77:0/1301342894 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f4dfc10a0d0 con 0x7f4de406e140 2024-04-25T02:16:55.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.476+0000 7f4e0278b700 1 -- 172.21.15.77:0/1301342894 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f4de406e140 msgr2=0x7f4de40705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:55.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.476+0000 7f4e0278b700 1 --2- 172.21.15.77:0/1301342894 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f4de406e140 0x7f4de40705f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4df0004f90 tx=0x7f4df0009e30 comp rx=0 tx=0).stop 2024-04-25T02:16:55.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.476+0000 7f4e0278b700 1 -- 172.21.15.77:0/1301342894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dfc0fb520 msgr2=0x7f4dfc0fc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:55.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.476+0000 7f4e0278b700 1 --2- 172.21.15.77:0/1301342894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dfc0fb520 0x7f4dfc0fc700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4dec00b790 tx=0x7f4dec009250 comp rx=0 tx=0).stop 2024-04-25T02:16:55.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.476+0000 7f4e0278b700 1 -- 172.21.15.77:0/1301342894 shutdown_connections 2024-04-25T02:16:55.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.476+0000 7f4e0278b700 1 --2- 172.21.15.77:0/1301342894 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f4de406e140 0x7f4de40705f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:55.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.476+0000 7f4e0278b700 1 --2- 172.21.15.77:0/1301342894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dfc0fb520 0x7f4dfc0fc700 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:55.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.476+0000 7f4e0278b700 1 --2- 172.21.15.77:0/1301342894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dfc102f60 0x7f4dfc0fcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:55.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.476+0000 7f4e0278b700 1 -- 172.21.15.77:0/1301342894 >> 172.21.15.77:0/1301342894 conn(0x7f4dfc0714d0 msgr2=0x7f4dfc0fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:55.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.476+0000 7f4e0278b700 1 -- 172.21.15.77:0/1301342894 shutdown_connections 2024-04-25T02:16:55.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.476+0000 7f4e0278b700 1 -- 172.21.15.77:0/1301342894 wait complete. 2024-04-25T02:16:55.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.577+0000 7effdd4b5700 1 -- 172.21.15.77:0/181388208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effd8070c40 msgr2=0x7effd8109190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:55.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.577+0000 7effdd4b5700 1 --2- 172.21.15.77:0/181388208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effd8070c40 0x7effd8109190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7effcc004970 tx=0x7effcc009e30 comp rx=0 tx=0).stop 2024-04-25T02:16:55.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.577+0000 7effdd4b5700 1 -- 172.21.15.77:0/181388208 shutdown_connections 2024-04-25T02:16:55.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.577+0000 7effdd4b5700 1 --2- 172.21.15.77:0/181388208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effd8070c40 0x7effd8109190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:55.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.577+0000 7effdd4b5700 1 --2- 172.21.15.77:0/181388208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effd8070330 0x7effd8070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:55.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.577+0000 7effdd4b5700 1 -- 172.21.15.77:0/181388208 >> 172.21.15.77:0/181388208 conn(0x7effd80f89b0 msgr2=0x7effd80fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:55.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.577+0000 7effdd4b5700 1 -- 172.21.15.77:0/181388208 shutdown_connections 2024-04-25T02:16:55.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.577+0000 7effdd4b5700 1 -- 172.21.15.77:0/181388208 wait complete. 2024-04-25T02:16:55.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.578+0000 7effdd4b5700 1 Processor -- start 2024-04-25T02:16:55.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.578+0000 7effdd4b5700 1 -- start start 2024-04-25T02:16:55.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.578+0000 7effdd4b5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effd8070330 0x7effd8115b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:55.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.578+0000 7effdd4b5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effd8070c40 0x7effd81160a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:55.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.578+0000 7effdd4b5700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd81166f0 con 0x7effd8070c40 2024-04-25T02:16:55.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.578+0000 7effdd4b5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd810fcd0 con 0x7effd8070330 2024-04-25T02:16:55.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.578+0000 7effd67fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effd8070c40 0x7effd81160a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:55.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.578+0000 7effd67fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effd8070c40 0x7effd81160a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49342/0 (socket says 172.21.15.77:49342) 2024-04-25T02:16:55.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.579+0000 7effd67fc700 1 -- 172.21.15.77:0/1653015220 learned_addr learned my addr 172.21.15.77:0/1653015220 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:16:55.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.579+0000 7effd6ffd700 1 --2- 172.21.15.77:0/1653015220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effd8070330 0x7effd8115b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:55.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.579+0000 7effd67fc700 1 -- 172.21.15.77:0/1653015220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effd8070330 msgr2=0x7effd8115b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:55.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.579+0000 7effd67fc700 1 --2- 172.21.15.77:0/1653015220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effd8070330 0x7effd8115b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:55.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.579+0000 7effd67fc700 1 -- 172.21.15.77:0/1653015220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effcc005040 con 0x7effd8070c40 2024-04-25T02:16:55.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.579+0000 7effd6ffd700 1 --2- 172.21.15.77:0/1653015220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effd8070330 0x7effd8115b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:16:55.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.579+0000 7effd67fc700 1 --2- 172.21.15.77:0/1653015220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effd8070c40 0x7effd81160a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7effcc00b370 tx=0x7effcc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:55.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.579+0000 7effbf7fe700 1 -- 172.21.15.77:0/1653015220 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effcc00e040 con 0x7effd8070c40 2024-04-25T02:16:55.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.579+0000 7effbf7fe700 1 -- 172.21.15.77:0/1653015220 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7effcc00bbb0 con 0x7effd8070c40 2024-04-25T02:16:55.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.579+0000 7effdd4b5700 1 -- 172.21.15.77:0/1653015220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd810ff50 con 0x7effd8070c40 2024-04-25T02:16:55.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.579+0000 7effbf7fe700 1 -- 172.21.15.77:0/1653015220 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effcc01c630 con 0x7effd8070c40 2024-04-25T02:16:55.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.579+0000 7effdd4b5700 1 -- 172.21.15.77:0/1653015220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd8110490 con 0x7effd8070c40 2024-04-25T02:16:55.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.580+0000 7effdd4b5700 1 -- 172.21.15.77:0/1653015220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd80719c0 con 0x7effd8070c40 2024-04-25T02:16:55.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.581+0000 7effbf7fe700 1 -- 172.21.15.77:0/1653015220 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7effcc00bd20 con 0x7effd8070c40 2024-04-25T02:16:55.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.581+0000 7effbf7fe700 1 --2- 172.21.15.77:0/1653015220 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7effc006e140 0x7effc00705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:55.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.581+0000 7effbf7fe700 1 -- 172.21.15.77:0/1653015220 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6324+0+0 (secure 0 0 0) 0x7effcc08ee20 con 0x7effd8070c40 2024-04-25T02:16:55.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.581+0000 7effd6ffd700 1 --2- 172.21.15.77:0/1653015220 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7effc006e140 0x7effc00705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:55.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.582+0000 7effd6ffd700 1 --2- 172.21.15.77:0/1653015220 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7effc006e140 0x7effc00705f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7effc80041d0 tx=0x7effc8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:55.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.586+0000 7effbf7fe700 1 -- 172.21.15.77:0/1653015220 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7effcc05bda0 con 0x7effd8070c40 2024-04-25T02:16:55.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.794+0000 7effdd4b5700 1 -- 172.21.15.77:0/1653015220 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7effd81111b0 con 0x7effc006e140 2024-04-25T02:16:55.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.804+0000 7effbf7fe700 1 -- 172.21.15.77:0/1653015220 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7effd81111b0 con 0x7effc006e140 2024-04-25T02:16:55.809 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T02:16:55.809 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (5m) 52s ago 15m 26.8M - 0.25.0 c8568f914cd2 699c7fd25ea5 2024-04-25T02:16:55.809 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (2m) 52s ago 16m 6660k - 19.0.0-2445-gd2c45d97 f68e37b807ef f3c45d31e2e3 2024-04-25T02:16:55.809 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi112 smithi112 running (2m) 18s ago 15m 6656k - 19.0.0-2445-gd2c45d97 f68e37b807ef e16d9899ed11 2024-04-25T02:16:55.809 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (4m) 52s ago 15m 80.8M - 9.4.12 2bacad6d85d8 900138b0bcf0 2024-04-25T02:16:55.809 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.gcfygj smithi077 running (10m) 52s ago 10m 16.0M - 17.2.7-902-gc61472c8 0de407c1b3af 382dd7abf674 2024-04-25T02:16:55.809 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.oadrkb smithi077 running (10m) 52s ago 10m 14.3M - 17.2.7-902-gc61472c8 0de407c1b3af 6992064a4b2a 2024-04-25T02:16:55.809 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.dvwudt smithi112 running (10m) 18s ago 10m 156M - 17.2.7-902-gc61472c8 0de407c1b3af 0792e451abfd 2024-04-25T02:16:55.809 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.fjnadi smithi112 running (10m) 18s ago 10m 15.7M - 17.2.7-902-gc61472c8 0de407c1b3af c8093f622f6b 2024-04-25T02:16:55.809 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.zpflzp smithi077 *:8443,9283,8765 running (6m) 52s ago 17m 504M - 19.0.0-2445-gd2c45d97 f68e37b807ef a1af92e027e5 2024-04-25T02:16:55.809 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi112.cswrxs smithi112 *:8443,9283,8765 running (5m) 18s ago 15m 450M - 19.0.0-2445-gd2c45d97 f68e37b807ef ccc7c57d35f2 2024-04-25T02:16:55.809 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (3m) 52s ago 17m 46.0M 2048M 19.0.0-2445-gd2c45d97 f68e37b807ef 06490c2ecc44 2024-04-25T02:16:55.809 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi112 smithi112 running (3m) 18s ago 15m 36.2M 2048M 19.0.0-2445-gd2c45d97 f68e37b807ef ccd1398acbc5 2024-04-25T02:16:55.809 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (5m) 52s ago 16m 17.0M - 1.5.0 0da6a335fe13 2320132606fc 2024-04-25T02:16:55.810 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi112 smithi112 *:9100 running (5m) 18s ago 15m 14.9M - 1.5.0 0da6a335fe13 49f285354791 2024-04-25T02:16:55.810 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (2m) 52s ago 14m 94.0M 1557M 19.0.0-2445-gd2c45d97 f68e37b807ef 7035e288ddae 2024-04-25T02:16:55.810 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (94s) 52s ago 13m 109M 1557M 19.0.0-2445-gd2c45d97 f68e37b807ef 6e514f700c36 2024-04-25T02:16:55.810 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (58s) 52s ago 13m 11.6M 1557M 19.0.0-2445-gd2c45d97 f68e37b807ef 392fd2036c16 2024-04-25T02:16:55.810 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi112 running (22s) 18s ago 13m 12.4M 2581M 19.0.0-2445-gd2c45d97 f68e37b807ef c100df1a0f60 2024-04-25T02:16:55.810 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi112 running (12m) 18s ago 12m 260M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 66eb71201444 2024-04-25T02:16:55.810 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi112 running (12m) 18s ago 12m 239M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 963e700d6aea 2024-04-25T02:16:55.810 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (5m) 52s ago 15m 59.4M - 2.43.0 a07b618ecd1d c5b8c6104d96 2024-04-25T02:16:55.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.806+0000 7effdd4b5700 1 -- 172.21.15.77:0/1653015220 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7effc006e140 msgr2=0x7effc00705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:55.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.806+0000 7effdd4b5700 1 --2- 172.21.15.77:0/1653015220 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7effc006e140 0x7effc00705f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7effc80041d0 tx=0x7effc8009040 comp rx=0 tx=0).stop 2024-04-25T02:16:55.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.806+0000 7effdd4b5700 1 -- 172.21.15.77:0/1653015220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effd8070c40 msgr2=0x7effd81160a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:55.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.806+0000 7effdd4b5700 1 --2- 172.21.15.77:0/1653015220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effd8070c40 0x7effd81160a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7effcc00b370 tx=0x7effcc009e30 comp rx=0 tx=0).stop 2024-04-25T02:16:55.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.806+0000 7effdd4b5700 1 -- 172.21.15.77:0/1653015220 shutdown_connections 2024-04-25T02:16:55.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.806+0000 7effdd4b5700 1 --2- 172.21.15.77:0/1653015220 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7effc006e140 0x7effc00705f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:55.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.806+0000 7effdd4b5700 1 --2- 172.21.15.77:0/1653015220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effd8070330 0x7effd8115b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:55.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.806+0000 7effdd4b5700 1 --2- 172.21.15.77:0/1653015220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effd8070c40 0x7effd81160a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:55.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.807+0000 7effdd4b5700 1 -- 172.21.15.77:0/1653015220 >> 172.21.15.77:0/1653015220 conn(0x7effd80f89b0 msgr2=0x7effd80f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:55.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.807+0000 7effdd4b5700 1 -- 172.21.15.77:0/1653015220 shutdown_connections 2024-04-25T02:16:55.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.807+0000 7effdd4b5700 1 -- 172.21.15.77:0/1653015220 wait complete. 2024-04-25T02:16:55.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.906+0000 7fd89ab97700 1 -- 172.21.15.77:0/1947358098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8940fb610 msgr2=0x7fd8940fb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:55.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.906+0000 7fd89ab97700 1 --2- 172.21.15.77:0/1947358098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8940fb610 0x7fd8940fb9e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd88c009d10 tx=0x7fd88c004d10 comp rx=0 tx=0).stop 2024-04-25T02:16:55.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.907+0000 7fd89ab97700 1 -- 172.21.15.77:0/1947358098 shutdown_connections 2024-04-25T02:16:55.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.907+0000 7fd89ab97700 1 --2- 172.21.15.77:0/1947358098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8940fbf20 0x7fd89410d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:55.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.907+0000 7fd89ab97700 1 --2- 172.21.15.77:0/1947358098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8940fb610 0x7fd8940fb9e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:55.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.907+0000 7fd89ab97700 1 -- 172.21.15.77:0/1947358098 >> 172.21.15.77:0/1947358098 conn(0x7fd894072380 msgr2=0x7fd894072780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:55.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.907+0000 7fd89ab97700 1 -- 172.21.15.77:0/1947358098 shutdown_connections 2024-04-25T02:16:55.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.907+0000 7fd89ab97700 1 -- 172.21.15.77:0/1947358098 wait complete. 2024-04-25T02:16:55.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.907+0000 7fd89ab97700 1 Processor -- start 2024-04-25T02:16:55.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.907+0000 7fd89ab97700 1 -- start start 2024-04-25T02:16:55.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.907+0000 7fd89ab97700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8940fb610 0x7fd89411a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:55.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.907+0000 7fd89ab97700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8940fbf20 0x7fd89411a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:55.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.908+0000 7fd89ab97700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89411aba0 con 0x7fd8940fb610 2024-04-25T02:16:55.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.908+0000 7fd89ab97700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd894114180 con 0x7fd8940fbf20 2024-04-25T02:16:55.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.908+0000 7fd898933700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8940fb610 0x7fd89411a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:55.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.908+0000 7fd898933700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8940fb610 0x7fd89411a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49366/0 (socket says 172.21.15.77:49366) 2024-04-25T02:16:55.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.908+0000 7fd898933700 1 -- 172.21.15.77:0/3247733728 learned_addr learned my addr 172.21.15.77:0/3247733728 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:16:55.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.908+0000 7fd893fff700 1 --2- 172.21.15.77:0/3247733728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8940fbf20 0x7fd89411a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:55.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.908+0000 7fd898933700 1 -- 172.21.15.77:0/3247733728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8940fbf20 msgr2=0x7fd89411a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:55.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.908+0000 7fd898933700 1 --2- 172.21.15.77:0/3247733728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8940fbf20 0x7fd89411a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:55.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.908+0000 7fd898933700 1 -- 172.21.15.77:0/3247733728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd88c009940 con 0x7fd8940fb610 2024-04-25T02:16:55.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.908+0000 7fd898933700 1 --2- 172.21.15.77:0/3247733728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8940fb610 0x7fd89411a010 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd88c008df0 tx=0x7fd88c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:55.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.908+0000 7fd8917fa700 1 -- 172.21.15.77:0/3247733728 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd88c00e040 con 0x7fd8940fb610 2024-04-25T02:16:55.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.908+0000 7fd89ab97700 1 -- 172.21.15.77:0/3247733728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd894114400 con 0x7fd8940fb610 2024-04-25T02:16:55.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.908+0000 7fd8917fa700 1 -- 172.21.15.77:0/3247733728 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd88c004610 con 0x7fd8940fb610 2024-04-25T02:16:55.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.908+0000 7fd8917fa700 1 -- 172.21.15.77:0/3247733728 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd88c01c7e0 con 0x7fd8940fb610 2024-04-25T02:16:55.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.908+0000 7fd89ab97700 1 -- 172.21.15.77:0/3247733728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8941149c0 con 0x7fd8940fb610 2024-04-25T02:16:55.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.909+0000 7fd89ab97700 1 -- 172.21.15.77:0/3247733728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8940fc3d0 con 0x7fd8940fb610 2024-04-25T02:16:55.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.910+0000 7fd8917fa700 1 -- 172.21.15.77:0/3247733728 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd88c012410 con 0x7fd8940fb610 2024-04-25T02:16:55.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.910+0000 7fd8917fa700 1 --2- 172.21.15.77:0/3247733728 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd88006e140 0x7fd8800705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:55.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.910+0000 7fd8917fa700 1 -- 172.21.15.77:0/3247733728 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd88c08f7e0 con 0x7fd8940fb610 2024-04-25T02:16:55.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.910+0000 7fd893fff700 1 --2- 172.21.15.77:0/3247733728 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd88006e140 0x7fd8800705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:55.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.911+0000 7fd893fff700 1 --2- 172.21.15.77:0/3247733728 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd88006e140 0x7fd8800705f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd87c009b80 tx=0x7fd87c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:55.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:55.915+0000 7fd8917fa700 1 -- 172.21.15.77:0/3247733728 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fd88c05c6e0 con 0x7fd8940fb610 2024-04-25T02:16:56.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.194+0000 7fd89ab97700 1 -- 172.21.15.77:0/3247733728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd894115660 con 0x7fd8940fb610 2024-04-25T02:16:56.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.195+0000 7fd8917fa700 1 -- 172.21.15.77:0/3247733728 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7fd88c05c270 con 0x7fd8940fb610 2024-04-25T02:16:56.200 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:16:56.200 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-04-25T02:16:56.201 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:16:56.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:16:56.201 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-04-25T02:16:56.201 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:16:56.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:16:56.201 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-04-25T02:16:56.201 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2, 2024-04-25T02:16:56.202 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 4 2024-04-25T02:16:56.202 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:16:56.202 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-04-25T02:16:56.202 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T02:16:56.202 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:16:56.202 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-04-25T02:16:56.202 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 6, 2024-04-25T02:16:56.202 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 8 2024-04-25T02:16:56.203 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-25T02:16:56.203 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:16:56.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.197+0000 7fd89ab97700 1 -- 172.21.15.77:0/3247733728 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd88006e140 msgr2=0x7fd8800705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:56.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.197+0000 7fd89ab97700 1 --2- 172.21.15.77:0/3247733728 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd88006e140 0x7fd8800705f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd87c009b80 tx=0x7fd87c00b040 comp rx=0 tx=0).stop 2024-04-25T02:16:56.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.197+0000 7fd89ab97700 1 -- 172.21.15.77:0/3247733728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8940fb610 msgr2=0x7fd89411a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:56.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.197+0000 7fd89ab97700 1 --2- 172.21.15.77:0/3247733728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8940fb610 0x7fd89411a010 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd88c008df0 tx=0x7fd88c004d10 comp rx=0 tx=0).stop 2024-04-25T02:16:56.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.197+0000 7fd89ab97700 1 -- 172.21.15.77:0/3247733728 shutdown_connections 2024-04-25T02:16:56.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.197+0000 7fd89ab97700 1 --2- 172.21.15.77:0/3247733728 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd88006e140 0x7fd8800705f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:56.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.197+0000 7fd89ab97700 1 --2- 172.21.15.77:0/3247733728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8940fb610 0x7fd89411a010 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:56.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.197+0000 7fd89ab97700 1 --2- 172.21.15.77:0/3247733728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8940fbf20 0x7fd89411a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:56.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.197+0000 7fd89ab97700 1 -- 172.21.15.77:0/3247733728 >> 172.21.15.77:0/3247733728 conn(0x7fd894072380 msgr2=0x7fd8940fa3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:56.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.198+0000 7fd89ab97700 1 -- 172.21.15.77:0/3247733728 shutdown_connections 2024-04-25T02:16:56.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.198+0000 7fd89ab97700 1 -- 172.21.15.77:0/3247733728 wait complete. 2024-04-25T02:16:56.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.297+0000 7f71b97e6700 1 -- 172.21.15.77:0/512563349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71b4103780 msgr2=0x7f71b40fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:56.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.297+0000 7f71b97e6700 1 --2- 172.21.15.77:0/512563349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71b4103780 0x7f71b40fcdf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f71a8004940 tx=0x7f71a8009e30 comp rx=0 tx=0).stop 2024-04-25T02:16:56.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.297+0000 7f71b97e6700 1 -- 172.21.15.77:0/512563349 shutdown_connections 2024-04-25T02:16:56.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.297+0000 7f71b97e6700 1 --2- 172.21.15.77:0/512563349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71b4103780 0x7f71b40fcdf0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:56.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.297+0000 7f71b97e6700 1 --2- 172.21.15.77:0/512563349 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71b4102de0 0x7f71b41031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:56.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.297+0000 7f71b97e6700 1 -- 172.21.15.77:0/512563349 >> 172.21.15.77:0/512563349 conn(0x7f71b40f8990 msgr2=0x7f71b40fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:56.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.297+0000 7f71b97e6700 1 -- 172.21.15.77:0/512563349 shutdown_connections 2024-04-25T02:16:56.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.297+0000 7f71b97e6700 1 -- 172.21.15.77:0/512563349 wait complete. 2024-04-25T02:16:56.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.298+0000 7f71b97e6700 1 Processor -- start 2024-04-25T02:16:56.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.298+0000 7f71b97e6700 1 -- start start 2024-04-25T02:16:56.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.298+0000 7f71b97e6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71b4102de0 0x7f71b4113980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:56.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.298+0000 7f71b97e6700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71b4103780 0x7f71b4113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:56.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.298+0000 7f71b97e6700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b41145a0 con 0x7f71b4103780 2024-04-25T02:16:56.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.298+0000 7f71b97e6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b410db60 con 0x7f71b4102de0 2024-04-25T02:16:56.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.298+0000 7f71b27fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71b4103780 0x7f71b4113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:56.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.298+0000 7f71b27fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71b4103780 0x7f71b4113ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49392/0 (socket says 172.21.15.77:49392) 2024-04-25T02:16:56.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.298+0000 7f71b27fc700 1 -- 172.21.15.77:0/2003340959 learned_addr learned my addr 172.21.15.77:0/2003340959 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:16:56.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.299+0000 7f71b27fc700 1 -- 172.21.15.77:0/2003340959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71b4102de0 msgr2=0x7f71b4113980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:56.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.299+0000 7f71b27fc700 1 --2- 172.21.15.77:0/2003340959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71b4102de0 0x7f71b4113980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:56.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.299+0000 7f71b27fc700 1 -- 172.21.15.77:0/2003340959 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a8005040 con 0x7f71b4103780 2024-04-25T02:16:56.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.299+0000 7f71b27fc700 1 --2- 172.21.15.77:0/2003340959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71b4103780 0x7f71b4113ec0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009180 tx=0x7f71a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:56.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.299+0000 7f719b7fe700 1 -- 172.21.15.77:0/2003340959 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71a800e040 con 0x7f71b4103780 2024-04-25T02:16:56.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.299+0000 7f71b97e6700 1 -- 172.21.15.77:0/2003340959 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b410dde0 con 0x7f71b4103780 2024-04-25T02:16:56.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.299+0000 7f719b7fe700 1 -- 172.21.15.77:0/2003340959 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f71a800bbc0 con 0x7f71b4103780 2024-04-25T02:16:56.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.299+0000 7f719b7fe700 1 -- 172.21.15.77:0/2003340959 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71a801c3f0 con 0x7f71b4103780 2024-04-25T02:16:56.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.299+0000 7f71b97e6700 1 -- 172.21.15.77:0/2003340959 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b410e3a0 con 0x7f71b4103780 2024-04-25T02:16:56.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.300+0000 7f71b97e6700 1 -- 172.21.15.77:0/2003340959 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b41000f0 con 0x7f71b4103780 2024-04-25T02:16:56.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.301+0000 7f719b7fe700 1 -- 172.21.15.77:0/2003340959 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f71a800bd30 con 0x7f71b4103780 2024-04-25T02:16:56.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.301+0000 7f719b7fe700 1 --2- 172.21.15.77:0/2003340959 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f719c06e140 0x7f719c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:56.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.301+0000 7f719b7fe700 1 -- 172.21.15.77:0/2003340959 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f71a808ee10 con 0x7f71b4103780 2024-04-25T02:16:56.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.301+0000 7f71b2ffd700 1 --2- 172.21.15.77:0/2003340959 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f719c06e140 0x7f719c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:56.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.301+0000 7f71b2ffd700 1 --2- 172.21.15.77:0/2003340959 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f719c06e140 0x7f719c0705f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f71a4006fd0 tx=0x7f71a4006db0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:56.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.306+0000 7f719b7fe700 1 -- 172.21.15.77:0/2003340959 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f71a805bd90 con 0x7f71b4103780 2024-04-25T02:16:56.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.545+0000 7f71b97e6700 1 -- 172.21.15.77:0/2003340959 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f71b4109f30 con 0x7f71b4103780 2024-04-25T02:16:56.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.546+0000 7f719b7fe700 1 -- 172.21.15.77:0/2003340959 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1876 (secure 0 0 0) 0x7f71a805b920 con 0x7f71b4103780 2024-04-25T02:16:56.555 INFO:teuthology.orchestra.run.smithi077.stdout:e15 2024-04-25T02:16:56.555 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T02:16:56.555 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:16:56.556 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-04-25T02:16:56.556 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:16:56.556 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-04-25T02:16:56.556 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-04-25T02:16:56.556 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 15 2024-04-25T02:16:56.556 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-25T02:16:56.557 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-04-25T02:06:10.008979+0000 2024-04-25T02:16:56.557 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-04-25T02:06:27.849984+0000 2024-04-25T02:16:56.557 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-04-25T02:16:56.557 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-04-25T02:16:56.557 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-04-25T02:16:56.558 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-04-25T02:16:56.558 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-04-25T02:16:56.558 INFO:teuthology.orchestra.run.smithi077.stdout:max_xattr_size 65536 2024-04-25T02:16:56.558 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-04-25T02:16:56.558 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-04-25T02:16:56.559 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 47 2024-04-25T02:16:56.559 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:16:56.559 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-04-25T02:16:56.559 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-04-25T02:16:56.559 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=24257} 2024-04-25T02:16:56.559 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-04-25T02:16:56.560 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-04-25T02:16:56.560 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-04-25T02:16:56.560 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-04-25T02:16:56.560 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-04-25T02:16:56.560 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-04-25T02:16:56.561 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-04-25T02:16:56.561 INFO:teuthology.orchestra.run.smithi077.stdout:bal_rank_mask -1 2024-04-25T02:16:56.561 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-04-25T02:16:56.561 INFO:teuthology.orchestra.run.smithi077.stdout:qdb_cluster leader: 0 members: 2024-04-25T02:16:56.561 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi112.dvwudt{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.112:6824/3687767796,v1:172.21.15.112:6825/3687767796] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:16:56.562 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:16:56.562 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:16:56.562 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-04-25T02:16:56.562 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:16:56.562 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.gcfygj{-1:14462} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/691698671,v1:172.21.15.77:6829/691698671] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:16:56.563 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.oadrkb{-1:14474} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.77:6826/26222645,v1:172.21.15.77:6827/26222645] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:16:56.563 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi112.fjnadi{-1:24269} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/2036319817,v1:172.21.15.112:6827/2036319817] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:16:56.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.548+0000 7f71b97e6700 1 -- 172.21.15.77:0/2003340959 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f719c06e140 msgr2=0x7f719c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:56.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.548+0000 7f71b97e6700 1 --2- 172.21.15.77:0/2003340959 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f719c06e140 0x7f719c0705f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f71a4006fd0 tx=0x7f71a4006db0 comp rx=0 tx=0).stop 2024-04-25T02:16:56.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.548+0000 7f71b97e6700 1 -- 172.21.15.77:0/2003340959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71b4103780 msgr2=0x7f71b4113ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:56.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.548+0000 7f71b97e6700 1 --2- 172.21.15.77:0/2003340959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71b4103780 0x7f71b4113ec0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009180 tx=0x7f71a8009e30 comp rx=0 tx=0).stop 2024-04-25T02:16:56.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.548+0000 7f71b97e6700 1 -- 172.21.15.77:0/2003340959 shutdown_connections 2024-04-25T02:16:56.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.548+0000 7f71b97e6700 1 --2- 172.21.15.77:0/2003340959 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f719c06e140 0x7f719c0705f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:56.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.548+0000 7f71b97e6700 1 --2- 172.21.15.77:0/2003340959 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71b4102de0 0x7f71b4113980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:56.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.548+0000 7f71b97e6700 1 --2- 172.21.15.77:0/2003340959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71b4103780 0x7f71b4113ec0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:56.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.548+0000 7f71b97e6700 1 -- 172.21.15.77:0/2003340959 >> 172.21.15.77:0/2003340959 conn(0x7f71b40f8990 msgr2=0x7f71b4107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:56.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.548+0000 7f71b97e6700 1 -- 172.21.15.77:0/2003340959 shutdown_connections 2024-04-25T02:16:56.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.548+0000 7f71b97e6700 1 -- 172.21.15.77:0/2003340959 wait complete. 2024-04-25T02:16:56.566 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 15 2024-04-25T02:16:56.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.649+0000 7fe1b2b93700 1 -- 172.21.15.77:0/724555973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1ac0fbd40 msgr2=0x7fe1ac0fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:56.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.649+0000 7fe1b2b93700 1 --2- 172.21.15.77:0/724555973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1ac0fbd40 0x7fe1ac0fc1b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe198004940 tx=0x7fe198009e30 comp rx=0 tx=0).stop 2024-04-25T02:16:56.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.649+0000 7fe1b2b93700 1 -- 172.21.15.77:0/724555973 shutdown_connections 2024-04-25T02:16:56.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.649+0000 7fe1b2b93700 1 --2- 172.21.15.77:0/724555973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1ac0fbd40 0x7fe1ac0fc1b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:56.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.649+0000 7fe1b2b93700 1 --2- 172.21.15.77:0/724555973 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1ac101d90 0x7fe1ac102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:56.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.649+0000 7fe1b2b93700 1 -- 172.21.15.77:0/724555973 >> 172.21.15.77:0/724555973 conn(0x7fe1ac071d00 msgr2=0x7fe1ac072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:56.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.649+0000 7fe1b2b93700 1 -- 172.21.15.77:0/724555973 shutdown_connections 2024-04-25T02:16:56.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.649+0000 7fe1b2b93700 1 -- 172.21.15.77:0/724555973 wait complete. 2024-04-25T02:16:56.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.649+0000 7fe1b2b93700 1 Processor -- start 2024-04-25T02:16:56.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.650+0000 7fe1b2b93700 1 -- start start 2024-04-25T02:16:56.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.650+0000 7fe1b2b93700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1ac0fbd40 0x7fe1ac10eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:56.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.650+0000 7fe1b2b93700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1ac101d90 0x7fe1ac10f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:56.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.650+0000 7fe1b2b93700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac10f780 con 0x7fe1ac101d90 2024-04-25T02:16:56.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.650+0000 7fe1b2b93700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac10f8c0 con 0x7fe1ac0fbd40 2024-04-25T02:16:56.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.650+0000 7fe1abfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1ac101d90 0x7fe1ac10f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:56.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.650+0000 7fe1abfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1ac101d90 0x7fe1ac10f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49410/0 (socket says 172.21.15.77:49410) 2024-04-25T02:16:56.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.650+0000 7fe1abfff700 1 -- 172.21.15.77:0/4017829334 learned_addr learned my addr 172.21.15.77:0/4017829334 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:16:56.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.650+0000 7fe1abfff700 1 -- 172.21.15.77:0/4017829334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1ac0fbd40 msgr2=0x7fe1ac10eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:56.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.650+0000 7fe1b092f700 1 --2- 172.21.15.77:0/4017829334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1ac0fbd40 0x7fe1ac10eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:56.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.650+0000 7fe1abfff700 1 --2- 172.21.15.77:0/4017829334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1ac0fbd40 0x7fe1ac10eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:56.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.650+0000 7fe1abfff700 1 -- 172.21.15.77:0/4017829334 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe198005040 con 0x7fe1ac101d90 2024-04-25T02:16:56.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.650+0000 7fe1b092f700 1 --2- 172.21.15.77:0/4017829334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1ac0fbd40 0x7fe1ac10eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:16:56.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.650+0000 7fe1abfff700 1 --2- 172.21.15.77:0/4017829334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1ac101d90 0x7fe1ac10f0a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe19800b3b0 tx=0x7fe198009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:56.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.651+0000 7fe1a97fa700 1 -- 172.21.15.77:0/4017829334 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe19800e040 con 0x7fe1ac101d90 2024-04-25T02:16:56.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.651+0000 7fe1b2b93700 1 -- 172.21.15.77:0/4017829334 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ac117bd0 con 0x7fe1ac101d90 2024-04-25T02:16:56.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.651+0000 7fe1a97fa700 1 -- 172.21.15.77:0/4017829334 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe19800bbc0 con 0x7fe1ac101d90 2024-04-25T02:16:56.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.651+0000 7fe1a97fa700 1 -- 172.21.15.77:0/4017829334 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe19801c3f0 con 0x7fe1ac101d90 2024-04-25T02:16:56.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.651+0000 7fe1b2b93700 1 -- 172.21.15.77:0/4017829334 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ac118160 con 0x7fe1ac101d90 2024-04-25T02:16:56.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.652+0000 7fe1b2b93700 1 -- 172.21.15.77:0/4017829334 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ac0fd430 con 0x7fe1ac101d90 2024-04-25T02:16:56.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.652+0000 7fe1a97fa700 1 -- 172.21.15.77:0/4017829334 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe198013420 con 0x7fe1ac101d90 2024-04-25T02:16:56.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.652+0000 7fe1a97fa700 1 --2- 172.21.15.77:0/4017829334 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fe19c06e140 0x7fe19c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:56.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.653+0000 7fe1b092f700 1 --2- 172.21.15.77:0/4017829334 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fe19c06e140 0x7fe19c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:56.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.653+0000 7fe1a97fa700 1 -- 172.21.15.77:0/4017829334 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe19808ede0 con 0x7fe1ac101d90 2024-04-25T02:16:56.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.653+0000 7fe1b092f700 1 --2- 172.21.15.77:0/4017829334 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fe19c06e140 0x7fe19c0705f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0006fd0 tx=0x7fe1a0008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:56.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.657+0000 7fe1a97fa700 1 -- 172.21.15.77:0/4017829334 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fe1980581b0 con 0x7fe1ac101d90 2024-04-25T02:16:56.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.873+0000 7fe1b2b93700 1 -- 172.21.15.77:0/4017829334 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1ac04bed0 con 0x7fe19c06e140 2024-04-25T02:16:56.878 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:56 smithi077 ceph-mon[110441]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:16:56.878 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:56 smithi077 ceph-mon[110441]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:16:56.878 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:56 smithi077 ceph-mon[110441]: pgmap v129: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:56.879 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:56 smithi077 ceph-mon[110441]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:16:56.879 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:56 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/3247733728' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:16:56.879 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:56 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/2003340959' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:16:56.879 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:56 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-25T02:16:56.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.874+0000 7fe1a97fa700 1 -- 172.21.15.77:0/4017829334 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fe1ac04bed0 con 0x7fe19c06e140 2024-04-25T02:16:56.880 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:16:56.880 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901", 2024-04-25T02:16:56.880 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-04-25T02:16:56.880 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T02:16:56.881 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-04-25T02:16:56.881 INFO:teuthology.orchestra.run.smithi077.stdout: "mon", 2024-04-25T02:16:56.881 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr", 2024-04-25T02:16:56.881 INFO:teuthology.orchestra.run.smithi077.stdout: "crash" 2024-04-25T02:16:56.881 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-25T02:16:56.881 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "10/21 daemons upgraded", 2024-04-25T02:16:56.881 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading osd daemons", 2024-04-25T02:16:56.881 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-04-25T02:16:56.881 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:16:56.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.876+0000 7fe1b2b93700 1 -- 172.21.15.77:0/4017829334 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fe19c06e140 msgr2=0x7fe19c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:56.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.876+0000 7fe1b2b93700 1 --2- 172.21.15.77:0/4017829334 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fe19c06e140 0x7fe19c0705f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0006fd0 tx=0x7fe1a0008040 comp rx=0 tx=0).stop 2024-04-25T02:16:56.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.876+0000 7fe1b2b93700 1 -- 172.21.15.77:0/4017829334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1ac101d90 msgr2=0x7fe1ac10f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:56.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.876+0000 7fe1b2b93700 1 --2- 172.21.15.77:0/4017829334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1ac101d90 0x7fe1ac10f0a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe19800b3b0 tx=0x7fe198009e30 comp rx=0 tx=0).stop 2024-04-25T02:16:56.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.876+0000 7fe1b2b93700 1 -- 172.21.15.77:0/4017829334 shutdown_connections 2024-04-25T02:16:56.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.876+0000 7fe1b2b93700 1 --2- 172.21.15.77:0/4017829334 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fe19c06e140 0x7fe19c0705f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:56.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.876+0000 7fe1b2b93700 1 --2- 172.21.15.77:0/4017829334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1ac0fbd40 0x7fe1ac10eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:56.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.876+0000 7fe1b2b93700 1 --2- 172.21.15.77:0/4017829334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1ac101d90 0x7fe1ac10f0a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:56.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.876+0000 7fe1b2b93700 1 -- 172.21.15.77:0/4017829334 >> 172.21.15.77:0/4017829334 conn(0x7fe1ac071d00 msgr2=0x7fe1ac0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:56.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.876+0000 7fe1b2b93700 1 -- 172.21.15.77:0/4017829334 shutdown_connections 2024-04-25T02:16:56.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.876+0000 7fe1b2b93700 1 -- 172.21.15.77:0/4017829334 wait complete. 2024-04-25T02:16:56.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.976+0000 7f8382cb3700 1 -- 172.21.15.77:0/2520259020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f837c102df0 msgr2=0x7f837c1031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:56.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.976+0000 7f8382cb3700 1 --2- 172.21.15.77:0/2520259020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f837c102df0 0x7f837c1031c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8374009ce0 tx=0x7f8374004d10 comp rx=0 tx=0).stop 2024-04-25T02:16:56.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.976+0000 7f8382cb3700 1 -- 172.21.15.77:0/2520259020 shutdown_connections 2024-04-25T02:16:56.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.976+0000 7f8382cb3700 1 --2- 172.21.15.77:0/2520259020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f837c103790 0x7f837c0fce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:56.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.976+0000 7f8382cb3700 1 --2- 172.21.15.77:0/2520259020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f837c102df0 0x7f837c1031c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:56.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.976+0000 7f8382cb3700 1 -- 172.21.15.77:0/2520259020 >> 172.21.15.77:0/2520259020 conn(0x7f837c0f8980 msgr2=0x7f837c0fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:56.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.976+0000 7f8382cb3700 1 -- 172.21.15.77:0/2520259020 shutdown_connections 2024-04-25T02:16:56.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.976+0000 7f8382cb3700 1 -- 172.21.15.77:0/2520259020 wait complete. 2024-04-25T02:16:56.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.977+0000 7f8382cb3700 1 Processor -- start 2024-04-25T02:16:56.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.977+0000 7f8382cb3700 1 -- start start 2024-04-25T02:16:56.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.977+0000 7f8382cb3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f837c102df0 0x7f837c113ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:56.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.977+0000 7f8382cb3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f837c103790 0x7f837c114000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:56.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.977+0000 7f8382cb3700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c114650 con 0x7f837c103790 2024-04-25T02:16:56.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.977+0000 7f8382cb3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c10dc30 con 0x7f837c102df0 2024-04-25T02:16:56.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.978+0000 7f837bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f837c103790 0x7f837c114000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:56.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.978+0000 7f837bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f837c103790 0x7f837c114000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49428/0 (socket says 172.21.15.77:49428) 2024-04-25T02:16:56.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.978+0000 7f837bfff700 1 -- 172.21.15.77:0/1572717251 learned_addr learned my addr 172.21.15.77:0/1572717251 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:16:56.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.978+0000 7f8380a4f700 1 --2- 172.21.15.77:0/1572717251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f837c102df0 0x7f837c113ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:56.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.978+0000 7f837bfff700 1 -- 172.21.15.77:0/1572717251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f837c102df0 msgr2=0x7f837c113ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:56.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.978+0000 7f837bfff700 1 --2- 172.21.15.77:0/1572717251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f837c102df0 0x7f837c113ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:56.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.978+0000 7f837bfff700 1 -- 172.21.15.77:0/1572717251 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8374009940 con 0x7f837c103790 2024-04-25T02:16:56.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.978+0000 7f837bfff700 1 --2- 172.21.15.77:0/1572717251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f837c103790 0x7f837c114000 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8370002a50 tx=0x7f8370004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:56.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.978+0000 7f83797fa700 1 -- 172.21.15.77:0/1572717251 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8370007cc0 con 0x7f837c103790 2024-04-25T02:16:56.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.978+0000 7f83797fa700 1 -- 172.21.15.77:0/1572717251 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f837000f040 con 0x7f837c103790 2024-04-25T02:16:56.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.978+0000 7f8382cb3700 1 -- 172.21.15.77:0/1572717251 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837c10df10 con 0x7f837c103790 2024-04-25T02:16:56.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.978+0000 7f83797fa700 1 -- 172.21.15.77:0/1572717251 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f837000d9c0 con 0x7f837c103790 2024-04-25T02:16:56.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.978+0000 7f8382cb3700 1 -- 172.21.15.77:0/1572717251 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837c10e4d0 con 0x7f837c103790 2024-04-25T02:16:56.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.979+0000 7f8382cb3700 1 -- 172.21.15.77:0/1572717251 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f837c100100 con 0x7f837c103790 2024-04-25T02:16:56.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.980+0000 7f83797fa700 1 -- 172.21.15.77:0/1572717251 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8370009730 con 0x7f837c103790 2024-04-25T02:16:56.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.980+0000 7f83797fa700 1 --2- 172.21.15.77:0/1572717251 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f836406e140 0x7f83640705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:16:56.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.980+0000 7f83797fa700 1 -- 172.21.15.77:0/1572717251 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f837008d820 con 0x7f837c103790 2024-04-25T02:16:56.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.980+0000 7f8380a4f700 1 --2- 172.21.15.77:0/1572717251 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f836406e140 0x7f83640705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:16:56.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.981+0000 7f8380a4f700 1 --2- 172.21.15.77:0/1572717251 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f836406e140 0x7f83640705f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f837400b740 tx=0x7f8374004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:16:56.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:56.985+0000 7f83797fa700 1 -- 172.21.15.77:0/1572717251 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f837005a720 con 0x7f837c103790 2024-04-25T02:16:57.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:57.262+0000 7f8382cb3700 1 -- 172.21.15.77:0/1572717251 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f837c0fe540 con 0x7f837c103790 2024-04-25T02:16:57.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:57.262+0000 7f83797fa700 1 -- 172.21.15.77:0/1572717251 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f837005a2b0 con 0x7f837c103790 2024-04-25T02:16:57.268 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-04-25T02:16:57.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:57.264+0000 7f8382cb3700 1 -- 172.21.15.77:0/1572717251 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f836406e140 msgr2=0x7f83640705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:57.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:57.264+0000 7f8382cb3700 1 --2- 172.21.15.77:0/1572717251 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f836406e140 0x7f83640705f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f837400b740 tx=0x7f8374004d10 comp rx=0 tx=0).stop 2024-04-25T02:16:57.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:57.264+0000 7f8382cb3700 1 -- 172.21.15.77:0/1572717251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f837c103790 msgr2=0x7f837c114000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:16:57.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:57.264+0000 7f8382cb3700 1 --2- 172.21.15.77:0/1572717251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f837c103790 0x7f837c114000 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8370002a50 tx=0x7f8370004600 comp rx=0 tx=0).stop 2024-04-25T02:16:57.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:57.264+0000 7f8382cb3700 1 -- 172.21.15.77:0/1572717251 shutdown_connections 2024-04-25T02:16:57.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:57.264+0000 7f8382cb3700 1 --2- 172.21.15.77:0/1572717251 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f836406e140 0x7f83640705f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:57.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:57.264+0000 7f8382cb3700 1 --2- 172.21.15.77:0/1572717251 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f837c102df0 0x7f837c113ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:57.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:57.264+0000 7f8382cb3700 1 --2- 172.21.15.77:0/1572717251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f837c103790 0x7f837c114000 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:16:57.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:57.264+0000 7f8382cb3700 1 -- 172.21.15.77:0/1572717251 >> 172.21.15.77:0/1572717251 conn(0x7f837c0f8980 msgr2=0x7f837c107390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:16:57.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:57.264+0000 7f8382cb3700 1 -- 172.21.15.77:0/1572717251 shutdown_connections 2024-04-25T02:16:57.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:16:57.264+0000 7f8382cb3700 1 -- 172.21.15.77:0/1572717251 wait complete. 2024-04-25T02:16:57.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:56 smithi112 ceph-mon[80494]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:16:57.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:56 smithi112 ceph-mon[80494]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:16:57.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:56 smithi112 ceph-mon[80494]: pgmap v129: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:57.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:56 smithi112 ceph-mon[80494]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:16:57.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:56 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/3247733728' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:16:57.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:56 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/2003340959' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:16:57.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:56 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-25T02:16:58.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:57 smithi112 ceph-mon[80494]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-25T02:16:58.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:57 smithi112 ceph-mon[80494]: Upgrade: osd.4 is safe to restart 2024-04-25T02:16:58.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:57 smithi112 ceph-mon[80494]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:16:58.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:57 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/1572717251' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T02:16:58.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:57 smithi077 ceph-mon[110441]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-25T02:16:58.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:57 smithi077 ceph-mon[110441]: Upgrade: osd.4 is safe to restart 2024-04-25T02:16:58.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:57 smithi077 ceph-mon[110441]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:16:58.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:57 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/1572717251' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T02:16:59.099 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:58 smithi112 ceph-mon[80494]: pgmap v130: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:59.099 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:58 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:59.099 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:58 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-25T02:16:59.099 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:58 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:16:59.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:58 smithi077 ceph-mon[110441]: pgmap v130: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:16:59.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:58 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:16:59.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:58 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-25T02:16:59.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:58 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:17:00.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:59 smithi112 ceph-mon[80494]: Upgrade: Updating osd.4 2024-04-25T02:17:00.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:16:59 smithi112 ceph-mon[80494]: Deploying daemon osd.4 on smithi112 2024-04-25T02:17:00.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:59 smithi077 ceph-mon[110441]: Upgrade: Updating osd.4 2024-04-25T02:17:00.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:16:59 smithi077 ceph-mon[110441]: Deploying daemon osd.4 on smithi112 2024-04-25T02:17:01.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:00 smithi112 ceph-mon[80494]: pgmap v131: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:17:01.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:00 smithi077 ceph-mon[110441]: pgmap v131: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:17:01.770 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:01 smithi112 systemd[1]: Stopping Ceph osd.4 for 4bb93d82-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:17:02.027 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:01 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4[45300]: 2024-04-25T02:17:01.794+0000 7ff2e179c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:17:02.027 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:01 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4[45300]: 2024-04-25T02:17:01.794+0000 7ff2e179c700 -1 osd.4 70 *** Got signal Terminated *** 2024-04-25T02:17:02.028 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:01 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4[45300]: 2024-04-25T02:17:01.794+0000 7ff2e179c700 -1 osd.4 70 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T02:17:03.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:02 smithi112 ceph-mon[80494]: pgmap v132: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:17:03.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:02 smithi112 ceph-mon[80494]: osd.4 marked itself down and dead 2024-04-25T02:17:03.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:02 smithi077 ceph-mon[110441]: pgmap v132: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:17:03.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:02 smithi077 ceph-mon[110441]: osd.4 marked itself down and dead 2024-04-25T02:17:03.441 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:03 smithi112 podman[94012]: 2024-04-25 02:17:03.158737098 +0000 UTC m=+1.494260046 container died 66eb71201444502b1e4dc597707dbaae5a5dd369cf68eb0f7e2e175a57fe933d (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4, maintainer=Guillaume Abrioux , RELEASE=quincy-c61472c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240424, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-04-25T02:17:03.777 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:03 smithi112 podman[94012]: 2024-04-25 02:17:03.535735851 +0000 UTC m=+1.871258804 container cleanup 66eb71201444502b1e4dc597707dbaae5a5dd369cf68eb0f7e2e175a57fe933d (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-c61472c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-25T02:17:03.777 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:03 smithi112 bash[94012]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4 2024-04-25T02:17:04.155 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:03 smithi112 ceph-mon[80494]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-25T02:17:04.155 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:03 smithi112 ceph-mon[80494]: osdmap e71: 6 total, 5 up, 6 in 2024-04-25T02:17:04.155 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:03 smithi112 podman[94043]: 2024-04-25 02:17:03.828688579 +0000 UTC m=+0.667477634 container remove 66eb71201444502b1e4dc597707dbaae5a5dd369cf68eb0f7e2e175a57fe933d (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=quincy-c61472c, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-25T02:17:04.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:03 smithi077 ceph-mon[110441]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-25T02:17:04.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:03 smithi077 ceph-mon[110441]: osdmap e71: 6 total, 5 up, 6 in 2024-04-25T02:17:04.469 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:04 smithi112 podman[94135]: 2024-04-25 02:17:04.054592877 +0000 UTC m=+0.017857534 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:17:04.470 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:04 smithi112 podman[94135]: 2024-04-25 02:17:04.185294867 +0000 UTC m=+0.148559512 container create 2bf7bd910780c0df8955c09a41967aa226ad5626e7a6e7dbc9f7a0b5c469d90d (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-d2c45d9, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:17:04.470 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:04 smithi112 podman[94135]: 2024-04-25 02:17:04.390824802 +0000 UTC m=+0.354089446 container init 2bf7bd910780c0df8955c09a41967aa226ad5626e7a6e7dbc9f7a0b5c469d90d (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-d2c45d9, ceph=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:17:04.470 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:04 smithi112 podman[94135]: 2024-04-25 02:17:04.393992503 +0000 UTC m=+0.357257166 container start 2bf7bd910780c0df8955c09a41967aa226ad5626e7a6e7dbc9f7a0b5c469d90d (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD) 2024-04-25T02:17:04.470 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:04 smithi112 podman[94135]: 2024-04-25 02:17:04.46575395 +0000 UTC m=+0.429018611 container attach 2bf7bd910780c0df8955c09a41967aa226ad5626e7a6e7dbc9f7a0b5c469d90d (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, ceph=True) 2024-04-25T02:17:04.778 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:04 smithi112 podman[94135]: 2024-04-25 02:17:04.696047069 +0000 UTC m=+0.659311706 container died 2bf7bd910780c0df8955c09a41967aa226ad5626e7a6e7dbc9f7a0b5c469d90d (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-d2c45d9, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-25T02:17:05.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:04 smithi077 ceph-mon[110441]: pgmap v134: 65 pgs: 8 peering, 5 stale+active+clean, 52 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:17:05.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:04 smithi077 ceph-mon[110441]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-04-25T02:17:05.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:04 smithi077 ceph-mon[110441]: osdmap e72: 6 total, 5 up, 6 in 2024-04-25T02:17:05.256 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:04 smithi112 ceph-mon[80494]: pgmap v134: 65 pgs: 8 peering, 5 stale+active+clean, 52 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:17:05.256 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:04 smithi112 ceph-mon[80494]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-04-25T02:17:05.256 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:04 smithi112 ceph-mon[80494]: osdmap e72: 6 total, 5 up, 6 in 2024-04-25T02:17:05.527 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:05 smithi112 podman[94162]: 2024-04-25 02:17:05.252850026 +0000 UTC m=+0.547107083 container remove 2bf7bd910780c0df8955c09a41967aa226ad5626e7a6e7dbc9f7a0b5c469d90d (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4-deactivate, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424) 2024-04-25T02:17:05.527 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:05 smithi112 systemd[1]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.4.service: Deactivated successfully. 2024-04-25T02:17:05.527 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:05 smithi112 systemd[1]: Stopped Ceph osd.4 for 4bb93d82-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:17:05.527 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:05 smithi112 systemd[1]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.4.service: Consumed 1min 3.708s CPU time. 2024-04-25T02:17:05.528 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:05 smithi112 systemd[1]: Starting Ceph osd.4 for 4bb93d82-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:17:06.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:05 smithi112 ceph-mon[80494]: Health check failed: Degraded data redundancy: 24/219 objects degraded (10.959%), 7 pgs degraded (PG_DEGRADED) 2024-04-25T02:17:06.027 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:05 smithi112 podman[94264]: 2024-04-25 02:17:05.592752711 +0000 UTC m=+0.018012620 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:17:06.028 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:05 smithi112 podman[94264]: 2024-04-25 02:17:05.779128306 +0000 UTC m=+0.204388187 container create 881235fc7035aa6ff296a86d30c3029a2e9e1b8536d0c96ec799a8953b5dd7cc (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4-activate, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:17:06.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:05 smithi077 ceph-mon[110441]: Health check failed: Degraded data redundancy: 24/219 objects degraded (10.959%), 7 pgs degraded (PG_DEGRADED) 2024-04-25T02:17:06.512 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:06 smithi112 podman[94264]: 2024-04-25 02:17:06.061553419 +0000 UTC m=+0.486813303 container init 881235fc7035aa6ff296a86d30c3029a2e9e1b8536d0c96ec799a8953b5dd7cc (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-d2c45d9, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240424) 2024-04-25T02:17:06.512 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:06 smithi112 podman[94264]: 2024-04-25 02:17:06.064764389 +0000 UTC m=+0.490024275 container start 881235fc7035aa6ff296a86d30c3029a2e9e1b8536d0c96ec799a8953b5dd7cc (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4-activate, RELEASE=squid-d2c45d9, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:17:06.512 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:06 smithi112 podman[94264]: 2024-04-25 02:17:06.140470959 +0000 UTC m=+0.565730854 container attach 881235fc7035aa6ff296a86d30c3029a2e9e1b8536d0c96ec799a8953b5dd7cc (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4-activate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-04-25T02:17:06.777 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:06 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4-activate[94279]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T02:17:06.778 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:06 smithi112 bash[94264]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T02:17:06.778 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:06 smithi112 bash[94264]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-25T02:17:06.778 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:06 smithi112 bash[94264]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-25T02:17:06.778 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:06 smithi112 bash[94264]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-25T02:17:06.778 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:06 smithi112 bash[94264]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-04-25T02:17:06.778 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:06 smithi112 bash[94264]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T02:17:06.778 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:06 smithi112 bash[94264]: --> ceph-volume raw activate successful for osd ID: 4 2024-04-25T02:17:06.778 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:06 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4-activate[94279]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-25T02:17:06.778 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:06 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4-activate[94279]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-25T02:17:06.778 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:06 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4-activate[94279]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-25T02:17:06.779 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:06 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4-activate[94279]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-04-25T02:17:06.779 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:06 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4-activate[94279]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T02:17:06.779 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:06 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4-activate[94279]: --> ceph-volume raw activate successful for osd ID: 4 2024-04-25T02:17:06.779 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:06 smithi112 podman[94264]: 2024-04-25 02:17:06.532760564 +0000 UTC m=+0.958020456 container died 881235fc7035aa6ff296a86d30c3029a2e9e1b8536d0c96ec799a8953b5dd7cc (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4-activate, RELEASE=squid-d2c45d9, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240424) 2024-04-25T02:17:07.123 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:06 smithi112 ceph-mon[80494]: pgmap v136: 65 pgs: 7 active+undersized+degraded, 8 peering, 2 stale+active+clean, 11 active+undersized, 37 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 24/219 objects degraded (10.959%) 2024-04-25T02:17:07.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:06 smithi077 ceph-mon[110441]: pgmap v136: 65 pgs: 7 active+undersized+degraded, 8 peering, 2 stale+active+clean, 11 active+undersized, 37 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 24/219 objects degraded (10.959%) 2024-04-25T02:17:07.472 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:07 smithi112 podman[94403]: 2024-04-25 02:17:07.119295725 +0000 UTC m=+0.576822624 container remove 881235fc7035aa6ff296a86d30c3029a2e9e1b8536d0c96ec799a8953b5dd7cc (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4-activate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-25T02:17:07.472 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:07 smithi112 podman[94467]: 2024-04-25 02:17:07.237124473 +0000 UTC m=+0.018363325 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:17:07.472 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:07 smithi112 podman[94467]: 2024-04-25 02:17:07.353544825 +0000 UTC m=+0.134783675 container create 669b1ab41e273de54f54dee222b902c909f589775789f95fe2ea6177b51975dd (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-d2c45d9, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-04-25T02:17:08.028 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:07 smithi112 podman[94467]: 2024-04-25 02:17:07.572446751 +0000 UTC m=+0.353685600 container init 669b1ab41e273de54f54dee222b902c909f589775789f95fe2ea6177b51975dd (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-04-25T02:17:08.028 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:07 smithi112 podman[94467]: 2024-04-25 02:17:07.575672891 +0000 UTC m=+0.356911743 container start 669b1ab41e273de54f54dee222b902c909f589775789f95fe2ea6177b51975dd (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424) 2024-04-25T02:17:08.028 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:07 smithi112 ceph-osd[94485]: -- 172.21.15.112:0/3244677033 <== mon.1 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55619efc3680 con 0x55619ef8cc00 2024-04-25T02:17:08.028 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:07 smithi112 bash[94467]: 669b1ab41e273de54f54dee222b902c909f589775789f95fe2ea6177b51975dd 2024-04-25T02:17:08.028 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:07 smithi112 systemd[1]: Started Ceph osd.4 for 4bb93d82-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:17:08.527 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:08 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4[94481]: 2024-04-25T02:17:08.122+0000 7f699e7a97c0 -1 Falling back to public interface 2024-04-25T02:17:09.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:09.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:09.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:08 smithi112 ceph-mon[80494]: pgmap v137: 65 pgs: 10 active+undersized+degraded, 8 peering, 16 active+undersized, 31 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-04-25T02:17:09.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:17:09.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:09.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:09.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:08 smithi077 ceph-mon[110441]: pgmap v137: 65 pgs: 10 active+undersized+degraded, 8 peering, 16 active+undersized, 31 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-04-25T02:17:09.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:17:10.144 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:09 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:10.144 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:09 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:17:10.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:09 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:10.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:09 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:17:11.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:10 smithi077 ceph-mon[110441]: pgmap v138: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-04-25T02:17:11.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:10 smithi077 ceph-mon[110441]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-04-25T02:17:11.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:10 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:11.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:10 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:11.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:10 smithi112 ceph-mon[80494]: pgmap v138: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-04-25T02:17:11.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:10 smithi112 ceph-mon[80494]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-04-25T02:17:11.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:10 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:11.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:10 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:13.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:12 smithi112 ceph-mon[80494]: pgmap v139: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-04-25T02:17:13.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:13.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:13.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:12 smithi077 ceph-mon[110441]: pgmap v139: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-04-25T02:17:13.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:13.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:13.496 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:13 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4[94481]: 2024-04-25T02:17:13.276+0000 7f699e7a97c0 -1 osd.4 70 log_to_monitors true 2024-04-25T02:17:14.027 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:17:13 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4[94481]: 2024-04-25T02:17:13.820+0000 7f698fc01700 -1 osd.4 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:17:14.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:13 smithi112 ceph-mon[80494]: from='osd.4 [v2:172.21.15.112:6808/1394902745,v1:172.21.15.112:6809/1394902745]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T02:17:14.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:13 smithi112 ceph-mon[80494]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T02:17:14.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:13 smithi077 ceph-mon[110441]: from='osd.4 [v2:172.21.15.112:6808/1394902745,v1:172.21.15.112:6809/1394902745]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T02:17:14.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:13 smithi077 ceph-mon[110441]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T02:17:14.895 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:14 smithi112 ceph-mon[80494]: pgmap v140: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-04-25T02:17:14.895 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:14 smithi112 ceph-mon[80494]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-25T02:17:14.895 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:14 smithi112 ceph-mon[80494]: osdmap e73: 6 total, 5 up, 6 in 2024-04-25T02:17:14.895 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:14 smithi112 ceph-mon[80494]: from='osd.4 [v2:172.21.15.112:6808/1394902745,v1:172.21.15.112:6809/1394902745]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T02:17:14.896 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:14 smithi112 ceph-mon[80494]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T02:17:14.896 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:14 smithi112 ceph-mon[80494]: Health check update: Degraded data redundancy: 37/219 objects degraded (16.895%), 14 pgs degraded (PG_DEGRADED) 2024-04-25T02:17:15.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:14 smithi077 ceph-mon[110441]: pgmap v140: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-04-25T02:17:15.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:14 smithi077 ceph-mon[110441]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-25T02:17:15.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:14 smithi077 ceph-mon[110441]: osdmap e73: 6 total, 5 up, 6 in 2024-04-25T02:17:15.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:14 smithi077 ceph-mon[110441]: from='osd.4 [v2:172.21.15.112:6808/1394902745,v1:172.21.15.112:6809/1394902745]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T02:17:15.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:14 smithi077 ceph-mon[110441]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T02:17:15.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:14 smithi077 ceph-mon[110441]: Health check update: Degraded data redundancy: 37/219 objects degraded (16.895%), 14 pgs degraded (PG_DEGRADED) 2024-04-25T02:17:16.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:15 smithi077 ceph-mon[110441]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-25T02:17:16.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:15 smithi077 ceph-mon[110441]: osd.4 [v2:172.21.15.112:6808/1394902745,v1:172.21.15.112:6809/1394902745] boot 2024-04-25T02:17:16.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:15 smithi077 ceph-mon[110441]: osdmap e74: 6 total, 6 up, 6 in 2024-04-25T02:17:16.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:15 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:17:16.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:15 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:16.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:15 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:16.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:15 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:17:16.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:15 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:17:16.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:15 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:16.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:15 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:17:16.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:15 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:17:16.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:15 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:17:16.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:15 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:17:16.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:15 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-25T02:17:16.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:15 smithi077 ceph-mon[110441]: osdmap e75: 6 total, 6 up, 6 in 2024-04-25T02:17:16.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:15 smithi112 ceph-mon[80494]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-25T02:17:16.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:15 smithi112 ceph-mon[80494]: osd.4 [v2:172.21.15.112:6808/1394902745,v1:172.21.15.112:6809/1394902745] boot 2024-04-25T02:17:16.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:15 smithi112 ceph-mon[80494]: osdmap e74: 6 total, 6 up, 6 in 2024-04-25T02:17:16.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:15 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:17:16.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:15 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:16.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:15 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:16.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:15 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:17:16.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:15 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:17:16.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:15 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:16.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:15 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:17:16.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:15 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:17:16.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:15 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:17:16.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:15 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:17:16.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:15 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-25T02:17:16.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:15 smithi112 ceph-mon[80494]: osdmap e75: 6 total, 6 up, 6 in 2024-04-25T02:17:17.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:16 smithi077 ceph-mon[110441]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-25T02:17:17.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:16 smithi077 ceph-mon[110441]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-04-25T02:17:17.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:16 smithi077 ceph-mon[110441]: pgmap v143: 65 pgs: 10 peering, 9 active+undersized+degraded, 15 active+undersized, 31 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 18/219 objects degraded (8.219%) 2024-04-25T02:17:17.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:16 smithi112 ceph-mon[80494]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-25T02:17:17.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:16 smithi112 ceph-mon[80494]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-04-25T02:17:17.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:16 smithi112 ceph-mon[80494]: pgmap v143: 65 pgs: 10 peering, 9 active+undersized+degraded, 15 active+undersized, 31 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 18/219 objects degraded (8.219%) 2024-04-25T02:17:18.993 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:18 smithi077 ceph-mon[110441]: pgmap v145: 65 pgs: 10 peering, 7 active+undersized+degraded, 11 active+undersized, 37 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 13/219 objects degraded (5.936%) 2024-04-25T02:17:19.080 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:18 smithi112 ceph-mon[80494]: pgmap v145: 65 pgs: 10 peering, 7 active+undersized+degraded, 11 active+undersized, 37 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 13/219 objects degraded (5.936%) 2024-04-25T02:17:20.097 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:19 smithi112 ceph-mon[80494]: Health check update: Degraded data redundancy: 13/219 objects degraded (5.936%), 7 pgs degraded (PG_DEGRADED) 2024-04-25T02:17:20.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:19 smithi077 ceph-mon[110441]: Health check update: Degraded data redundancy: 13/219 objects degraded (5.936%), 7 pgs degraded (PG_DEGRADED) 2024-04-25T02:17:21.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:20 smithi077 ceph-mon[110441]: pgmap v146: 65 pgs: 10 peering, 55 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:17:21.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:20 smithi077 ceph-mon[110441]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/219 objects degraded (5.936%), 7 pgs degraded) 2024-04-25T02:17:21.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:20 smithi077 ceph-mon[110441]: Cluster is now healthy 2024-04-25T02:17:21.259 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:20 smithi112 ceph-mon[80494]: pgmap v146: 65 pgs: 10 peering, 55 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:17:21.259 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:20 smithi112 ceph-mon[80494]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/219 objects degraded (5.936%), 7 pgs degraded) 2024-04-25T02:17:21.259 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:20 smithi112 ceph-mon[80494]: Cluster is now healthy 2024-04-25T02:17:23.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:22 smithi077 ceph-mon[110441]: pgmap v147: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:17:23.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:22 smithi112 ceph-mon[80494]: pgmap v147: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:17:25.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:24 smithi077 ceph-mon[110441]: pgmap v148: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:17:25.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:24 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:25.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:24 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:17:25.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:24 smithi112 ceph-mon[80494]: pgmap v148: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:17:25.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:24 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:25.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:24 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:17:27.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:26 smithi077 ceph-mon[110441]: pgmap v149: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:17:27.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:26 smithi112 ceph-mon[80494]: pgmap v149: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:17:27.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.374+0000 7fade2d9f700 1 -- 172.21.15.77:0/1974676996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faddc101b00 msgr2=0x7faddc101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:27.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.374+0000 7fade2d9f700 1 --2- 172.21.15.77:0/1974676996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faddc101b00 0x7faddc101ed0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fadd8004940 tx=0x7fadd8009e30 comp rx=0 tx=0).stop 2024-04-25T02:17:27.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.375+0000 7fade2d9f700 1 -- 172.21.15.77:0/1974676996 shutdown_connections 2024-04-25T02:17:27.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.375+0000 7fade2d9f700 1 --2- 172.21.15.77:0/1974676996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faddc0fbb40 0x7faddc0fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.375+0000 7fade2d9f700 1 --2- 172.21.15.77:0/1974676996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faddc101b00 0x7faddc101ed0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.375+0000 7fade2d9f700 1 -- 172.21.15.77:0/1974676996 >> 172.21.15.77:0/1974676996 conn(0x7faddc0f7680 msgr2=0x7faddc0f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:27.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.375+0000 7fade2d9f700 1 -- 172.21.15.77:0/1974676996 shutdown_connections 2024-04-25T02:17:27.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.375+0000 7fade2d9f700 1 -- 172.21.15.77:0/1974676996 wait complete. 2024-04-25T02:17:27.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.375+0000 7fade2d9f700 1 Processor -- start 2024-04-25T02:17:27.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.375+0000 7fade2d9f700 1 -- start start 2024-04-25T02:17:27.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.375+0000 7fade2d9f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faddc0fbb40 0x7faddc112850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:27.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.375+0000 7fade2d9f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faddc101b00 0x7faddc112d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:27.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.375+0000 7fade2d9f700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc1133e0 con 0x7faddc101b00 2024-04-25T02:17:27.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.375+0000 7fade2d9f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc10c7d0 con 0x7faddc0fbb40 2024-04-25T02:17:27.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.376+0000 7fade159c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faddc101b00 0x7faddc112d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:27.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.376+0000 7fade159c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faddc101b00 0x7faddc112d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48086/0 (socket says 172.21.15.77:48086) 2024-04-25T02:17:27.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.376+0000 7fade159c700 1 -- 172.21.15.77:0/4184957239 learned_addr learned my addr 172.21.15.77:0/4184957239 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:17:27.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.376+0000 7fade1d9d700 1 --2- 172.21.15.77:0/4184957239 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faddc0fbb40 0x7faddc112850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:27.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.376+0000 7fade159c700 1 -- 172.21.15.77:0/4184957239 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faddc0fbb40 msgr2=0x7faddc112850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:27.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.376+0000 7fade159c700 1 --2- 172.21.15.77:0/4184957239 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faddc0fbb40 0x7faddc112850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.376+0000 7fade159c700 1 -- 172.21.15.77:0/4184957239 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd8005040 con 0x7faddc101b00 2024-04-25T02:17:27.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.376+0000 7fade159c700 1 --2- 172.21.15.77:0/4184957239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faddc101b00 0x7faddc112d90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fadcc00c8c0 tx=0x7fadcc0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:27.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.376+0000 7fadd27fc700 1 -- 172.21.15.77:0/4184957239 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadcc00a760 con 0x7faddc101b00 2024-04-25T02:17:27.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.376+0000 7fadd27fc700 1 -- 172.21.15.77:0/4184957239 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fadcc00ad90 con 0x7faddc101b00 2024-04-25T02:17:27.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.376+0000 7fade2d9f700 1 -- 172.21.15.77:0/4184957239 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faddc10cab0 con 0x7faddc101b00 2024-04-25T02:17:27.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.376+0000 7fadd27fc700 1 -- 172.21.15.77:0/4184957239 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadcc0113a0 con 0x7faddc101b00 2024-04-25T02:17:27.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.376+0000 7fade2d9f700 1 -- 172.21.15.77:0/4184957239 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faddc10d070 con 0x7faddc101b00 2024-04-25T02:17:27.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.377+0000 7fade2d9f700 1 -- 172.21.15.77:0/4184957239 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faddc0fd1f0 con 0x7faddc101b00 2024-04-25T02:17:27.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.378+0000 7fadd27fc700 1 -- 172.21.15.77:0/4184957239 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fadcc012400 con 0x7faddc101b00 2024-04-25T02:17:27.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.378+0000 7fadd27fc700 1 --2- 172.21.15.77:0/4184957239 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fadc806e140 0x7fadc80705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:27.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.378+0000 7fade1d9d700 1 --2- 172.21.15.77:0/4184957239 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fadc806e140 0x7fadc80705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:27.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.378+0000 7fadd27fc700 1 -- 172.21.15.77:0/4184957239 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fadcc08db10 con 0x7faddc101b00 2024-04-25T02:17:27.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.379+0000 7fade1d9d700 1 --2- 172.21.15.77:0/4184957239 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fadc806e140 0x7fadc80705f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fadd8004f90 tx=0x7fadd8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:27.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.383+0000 7fadd27fc700 1 -- 172.21.15.77:0/4184957239 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fadcc05aa90 con 0x7faddc101b00 2024-04-25T02:17:27.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.596+0000 7fade2d9f700 1 -- 172.21.15.77:0/4184957239 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faddc112520 con 0x7fadc806e140 2024-04-25T02:17:27.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.597+0000 7fadd27fc700 1 -- 172.21.15.77:0/4184957239 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7faddc112520 con 0x7fadc806e140 2024-04-25T02:17:27.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.599+0000 7fade2d9f700 1 -- 172.21.15.77:0/4184957239 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fadc806e140 msgr2=0x7fadc80705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:27.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.599+0000 7fade2d9f700 1 --2- 172.21.15.77:0/4184957239 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fadc806e140 0x7fadc80705f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fadd8004f90 tx=0x7fadd8009e30 comp rx=0 tx=0).stop 2024-04-25T02:17:27.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.599+0000 7fade2d9f700 1 -- 172.21.15.77:0/4184957239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faddc101b00 msgr2=0x7faddc112d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:27.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.599+0000 7fade2d9f700 1 --2- 172.21.15.77:0/4184957239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faddc101b00 0x7faddc112d90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fadcc00c8c0 tx=0x7fadcc0044c0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.599+0000 7fade2d9f700 1 -- 172.21.15.77:0/4184957239 shutdown_connections 2024-04-25T02:17:27.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.599+0000 7fade2d9f700 1 --2- 172.21.15.77:0/4184957239 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fadc806e140 0x7fadc80705f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.599+0000 7fade2d9f700 1 --2- 172.21.15.77:0/4184957239 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faddc0fbb40 0x7faddc112850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.599+0000 7fade2d9f700 1 --2- 172.21.15.77:0/4184957239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faddc101b00 0x7faddc112d90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.599+0000 7fade2d9f700 1 -- 172.21.15.77:0/4184957239 >> 172.21.15.77:0/4184957239 conn(0x7faddc0f7680 msgr2=0x7faddc0f8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:27.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.599+0000 7fade2d9f700 1 -- 172.21.15.77:0/4184957239 shutdown_connections 2024-04-25T02:17:27.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.599+0000 7fade2d9f700 1 -- 172.21.15.77:0/4184957239 wait complete. 2024-04-25T02:17:27.614 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-04-25T02:17:27.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.700+0000 7f277478d700 1 -- 172.21.15.77:0/407499859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f276c101d90 msgr2=0x7f276c102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:27.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.700+0000 7f277478d700 1 --2- 172.21.15.77:0/407499859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f276c101d90 0x7f276c102160 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2764004940 tx=0x7f2764009e30 comp rx=0 tx=0).stop 2024-04-25T02:17:27.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.700+0000 7f277478d700 1 -- 172.21.15.77:0/407499859 shutdown_connections 2024-04-25T02:17:27.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.700+0000 7f277478d700 1 --2- 172.21.15.77:0/407499859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f276c0fbd40 0x7f276c0fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.700+0000 7f277478d700 1 --2- 172.21.15.77:0/407499859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f276c101d90 0x7f276c102160 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.700+0000 7f277478d700 1 -- 172.21.15.77:0/407499859 >> 172.21.15.77:0/407499859 conn(0x7f276c071d00 msgr2=0x7f276c072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:27.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.700+0000 7f277478d700 1 -- 172.21.15.77:0/407499859 shutdown_connections 2024-04-25T02:17:27.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.700+0000 7f277478d700 1 -- 172.21.15.77:0/407499859 wait complete. 2024-04-25T02:17:27.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.701+0000 7f277478d700 1 Processor -- start 2024-04-25T02:17:27.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.701+0000 7f277478d700 1 -- start start 2024-04-25T02:17:27.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.701+0000 7f277478d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f276c0fbd40 0x7f276c10ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:27.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.701+0000 7f277478d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f276c101d90 0x7f276c10f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:27.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.701+0000 7f277478d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276c10f760 con 0x7f276c101d90 2024-04-25T02:17:27.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.701+0000 7f277478d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276c10f8a0 con 0x7f276c0fbd40 2024-04-25T02:17:27.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.701+0000 7f2771d28700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f276c101d90 0x7f276c10f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:27.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.701+0000 7f2771d28700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f276c101d90 0x7f276c10f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60044/0 (socket says 172.21.15.77:60044) 2024-04-25T02:17:27.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.701+0000 7f2771d28700 1 -- 172.21.15.77:0/3578861310 learned_addr learned my addr 172.21.15.77:0/3578861310 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:17:27.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.701+0000 7f2772529700 1 --2- 172.21.15.77:0/3578861310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f276c0fbd40 0x7f276c10ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:27.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.702+0000 7f2771d28700 1 -- 172.21.15.77:0/3578861310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f276c0fbd40 msgr2=0x7f276c10ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:27.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.702+0000 7f2771d28700 1 --2- 172.21.15.77:0/3578861310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f276c0fbd40 0x7f276c10ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.702+0000 7f2771d28700 1 -- 172.21.15.77:0/3578861310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2764005040 con 0x7f276c101d90 2024-04-25T02:17:27.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.702+0000 7f2771d28700 1 --2- 172.21.15.77:0/3578861310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f276c101d90 0x7f276c10f220 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f276000b790 tx=0x7f2760009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:27.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.702+0000 7f276affd700 1 -- 172.21.15.77:0/3578861310 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f276000f6f0 con 0x7f276c101d90 2024-04-25T02:17:27.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.702+0000 7f276affd700 1 -- 172.21.15.77:0/3578861310 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f276000fd20 con 0x7f276c101d90 2024-04-25T02:17:27.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.702+0000 7f277478d700 1 -- 172.21.15.77:0/3578861310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f276c117bf0 con 0x7f276c101d90 2024-04-25T02:17:27.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.702+0000 7f276affd700 1 -- 172.21.15.77:0/3578861310 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27600103a0 con 0x7f276c101d90 2024-04-25T02:17:27.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.702+0000 7f277478d700 1 -- 172.21.15.77:0/3578861310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276c1181b0 con 0x7f276c101d90 2024-04-25T02:17:27.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.703+0000 7f277478d700 1 -- 172.21.15.77:0/3578861310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f276c0fd430 con 0x7f276c101d90 2024-04-25T02:17:27.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.704+0000 7f276affd700 1 -- 172.21.15.77:0/3578861310 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2760011400 con 0x7f276c101d90 2024-04-25T02:17:27.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.704+0000 7f276affd700 1 --2- 172.21.15.77:0/3578861310 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f275406e140 0x7f27540705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:27.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.704+0000 7f276affd700 1 -- 172.21.15.77:0/3578861310 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f276008d940 con 0x7f276c101d90 2024-04-25T02:17:27.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.704+0000 7f2772529700 1 --2- 172.21.15.77:0/3578861310 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f275406e140 0x7f27540705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:27.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.705+0000 7f2772529700 1 --2- 172.21.15.77:0/3578861310 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f275406e140 0x7f27540705f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2764004560 tx=0x7f2764009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:27.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.709+0000 7f276affd700 1 -- 172.21.15.77:0/3578861310 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f2760056d90 con 0x7f276c101d90 2024-04-25T02:17:27.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.926+0000 7f277478d700 1 -- 172.21.15.77:0/3578861310 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f276c108ee0 con 0x7f275406e140 2024-04-25T02:17:27.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.927+0000 7f276affd700 1 -- 172.21.15.77:0/3578861310 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f276c108ee0 con 0x7f275406e140 2024-04-25T02:17:27.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.929+0000 7f277478d700 1 -- 172.21.15.77:0/3578861310 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f275406e140 msgr2=0x7f27540705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:27.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.929+0000 7f277478d700 1 --2- 172.21.15.77:0/3578861310 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f275406e140 0x7f27540705f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2764004560 tx=0x7f2764009e30 comp rx=0 tx=0).stop 2024-04-25T02:17:27.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.929+0000 7f277478d700 1 -- 172.21.15.77:0/3578861310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f276c101d90 msgr2=0x7f276c10f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:27.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.929+0000 7f277478d700 1 --2- 172.21.15.77:0/3578861310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f276c101d90 0x7f276c10f220 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f276000b790 tx=0x7f2760009250 comp rx=0 tx=0).stop 2024-04-25T02:17:27.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.929+0000 7f277478d700 1 -- 172.21.15.77:0/3578861310 shutdown_connections 2024-04-25T02:17:27.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.929+0000 7f277478d700 1 --2- 172.21.15.77:0/3578861310 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f275406e140 0x7f27540705f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.929+0000 7f277478d700 1 --2- 172.21.15.77:0/3578861310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f276c0fbd40 0x7f276c10ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.929+0000 7f277478d700 1 --2- 172.21.15.77:0/3578861310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f276c101d90 0x7f276c10f220 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:27.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.929+0000 7f277478d700 1 -- 172.21.15.77:0/3578861310 >> 172.21.15.77:0/3578861310 conn(0x7f276c071d00 msgr2=0x7f276c0fa0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:27.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.929+0000 7f277478d700 1 -- 172.21.15.77:0/3578861310 shutdown_connections 2024-04-25T02:17:27.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:27.929+0000 7f277478d700 1 -- 172.21.15.77:0/3578861310 wait complete. 2024-04-25T02:17:28.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.031+0000 7fce8c433700 1 -- 172.21.15.77:0/1274133586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce84102de0 msgr2=0x7fce841031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:28.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.031+0000 7fce8c433700 1 --2- 172.21.15.77:0/1274133586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce84102de0 0x7fce841031b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fce80004940 tx=0x7fce80009e30 comp rx=0 tx=0).stop 2024-04-25T02:17:28.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.031+0000 7fce8c433700 1 -- 172.21.15.77:0/1274133586 shutdown_connections 2024-04-25T02:17:28.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.031+0000 7fce8c433700 1 --2- 172.21.15.77:0/1274133586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce84103780 0x7fce840fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.031+0000 7fce8c433700 1 --2- 172.21.15.77:0/1274133586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce84102de0 0x7fce841031b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.031+0000 7fce8c433700 1 -- 172.21.15.77:0/1274133586 >> 172.21.15.77:0/1274133586 conn(0x7fce840f8990 msgr2=0x7fce840fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:28.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.031+0000 7fce8c433700 1 -- 172.21.15.77:0/1274133586 shutdown_connections 2024-04-25T02:17:28.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.031+0000 7fce8c433700 1 -- 172.21.15.77:0/1274133586 wait complete. 2024-04-25T02:17:28.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.031+0000 7fce8c433700 1 Processor -- start 2024-04-25T02:17:28.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.031+0000 7fce8c433700 1 -- start start 2024-04-25T02:17:28.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.032+0000 7fce8c433700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce84102de0 0x7fce84113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:28.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.032+0000 7fce8c433700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce84103780 0x7fce84113ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:28.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.032+0000 7fce8c433700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce84114520 con 0x7fce84103780 2024-04-25T02:17:28.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.032+0000 7fce8c433700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8410db70 con 0x7fce84102de0 2024-04-25T02:17:28.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.032+0000 7fce899ce700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce84103780 0x7fce84113ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:28.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.032+0000 7fce899ce700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce84103780 0x7fce84113ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60052/0 (socket says 172.21.15.77:60052) 2024-04-25T02:17:28.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.032+0000 7fce899ce700 1 -- 172.21.15.77:0/553690940 learned_addr learned my addr 172.21.15.77:0/553690940 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:17:28.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.032+0000 7fce8a1cf700 1 --2- 172.21.15.77:0/553690940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce84102de0 0x7fce84113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:28.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.032+0000 7fce899ce700 1 -- 172.21.15.77:0/553690940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce84102de0 msgr2=0x7fce84113990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:28.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.032+0000 7fce899ce700 1 --2- 172.21.15.77:0/553690940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce84102de0 0x7fce84113990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.032+0000 7fce899ce700 1 -- 172.21.15.77:0/553690940 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce80005040 con 0x7fce84103780 2024-04-25T02:17:28.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.032+0000 7fce899ce700 1 --2- 172.21.15.77:0/553690940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce84103780 0x7fce84113ed0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fce74002a80 tx=0x7fce74004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:28.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.032+0000 7fce7affd700 1 -- 172.21.15.77:0/553690940 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce74007cc0 con 0x7fce84103780 2024-04-25T02:17:28.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.032+0000 7fce7affd700 1 -- 172.21.15.77:0/553690940 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fce7400f040 con 0x7fce84103780 2024-04-25T02:17:28.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.032+0000 7fce8c433700 1 -- 172.21.15.77:0/553690940 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce8410de50 con 0x7fce84103780 2024-04-25T02:17:28.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.032+0000 7fce7affd700 1 -- 172.21.15.77:0/553690940 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce7400daf0 con 0x7fce84103780 2024-04-25T02:17:28.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.032+0000 7fce8c433700 1 -- 172.21.15.77:0/553690940 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce8410e410 con 0x7fce84103780 2024-04-25T02:17:28.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.033+0000 7fce8c433700 1 -- 172.21.15.77:0/553690940 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce841000f0 con 0x7fce84103780 2024-04-25T02:17:28.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.034+0000 7fce7affd700 1 -- 172.21.15.77:0/553690940 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fce7400dd30 con 0x7fce84103780 2024-04-25T02:17:28.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.034+0000 7fce7affd700 1 --2- 172.21.15.77:0/553690940 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fce7006e140 0x7fce700705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:28.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.035+0000 7fce8a1cf700 1 --2- 172.21.15.77:0/553690940 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fce7006e140 0x7fce700705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:28.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.035+0000 7fce7affd700 1 -- 172.21.15.77:0/553690940 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fce7408d1c0 con 0x7fce84103780 2024-04-25T02:17:28.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.035+0000 7fce8a1cf700 1 --2- 172.21.15.77:0/553690940 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fce7006e140 0x7fce700705f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fce80004f90 tx=0x7fce80009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:28.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.039+0000 7fce7affd700 1 -- 172.21.15.77:0/553690940 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fce7405a0c0 con 0x7fce84103780 2024-04-25T02:17:28.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.245+0000 7fce8c433700 1 -- 172.21.15.77:0/553690940 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fce8410efe0 con 0x7fce7006e140 2024-04-25T02:17:28.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.255+0000 7fce7affd700 1 -- 172.21.15.77:0/553690940 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fce8410efe0 con 0x7fce7006e140 2024-04-25T02:17:28.260 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T02:17:28.260 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (5m) 85s ago 16m 26.8M - 0.25.0 c8568f914cd2 699c7fd25ea5 2024-04-25T02:17:28.261 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (3m) 85s ago 16m 6660k - 19.0.0-2445-gd2c45d97 f68e37b807ef f3c45d31e2e3 2024-04-25T02:17:28.261 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi112 smithi112 running (3m) 17s ago 15m 6656k - 19.0.0-2445-gd2c45d97 f68e37b807ef e16d9899ed11 2024-04-25T02:17:28.261 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (5m) 85s ago 16m 80.8M - 9.4.12 2bacad6d85d8 900138b0bcf0 2024-04-25T02:17:28.261 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.gcfygj smithi077 running (11m) 85s ago 11m 16.0M - 17.2.7-902-gc61472c8 0de407c1b3af 382dd7abf674 2024-04-25T02:17:28.261 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.oadrkb smithi077 running (11m) 85s ago 11m 14.3M - 17.2.7-902-gc61472c8 0de407c1b3af 6992064a4b2a 2024-04-25T02:17:28.261 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.dvwudt smithi112 running (11m) 17s ago 11m 156M - 17.2.7-902-gc61472c8 0de407c1b3af 0792e451abfd 2024-04-25T02:17:28.261 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.fjnadi smithi112 running (11m) 17s ago 11m 15.9M - 17.2.7-902-gc61472c8 0de407c1b3af c8093f622f6b 2024-04-25T02:17:28.261 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.zpflzp smithi077 *:8443,9283,8765 running (7m) 85s ago 17m 504M - 19.0.0-2445-gd2c45d97 f68e37b807ef a1af92e027e5 2024-04-25T02:17:28.261 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi112.cswrxs smithi112 *:8443,9283,8765 running (6m) 17s ago 15m 450M - 19.0.0-2445-gd2c45d97 f68e37b807ef ccc7c57d35f2 2024-04-25T02:17:28.261 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (4m) 85s ago 18m 46.0M 2048M 19.0.0-2445-gd2c45d97 f68e37b807ef 06490c2ecc44 2024-04-25T02:17:28.261 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi112 smithi112 running (3m) 17s ago 15m 36.4M 2048M 19.0.0-2445-gd2c45d97 f68e37b807ef ccd1398acbc5 2024-04-25T02:17:28.261 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (6m) 85s ago 16m 17.0M - 1.5.0 0da6a335fe13 2320132606fc 2024-04-25T02:17:28.261 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi112 smithi112 *:9100 running (6m) 17s ago 15m 14.9M - 1.5.0 0da6a335fe13 49f285354791 2024-04-25T02:17:28.262 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (2m) 85s ago 14m 94.0M 1557M 19.0.0-2445-gd2c45d97 f68e37b807ef 7035e288ddae 2024-04-25T02:17:28.262 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (2m) 85s ago 14m 109M 1557M 19.0.0-2445-gd2c45d97 f68e37b807ef 6e514f700c36 2024-04-25T02:17:28.262 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (90s) 85s ago 13m 11.6M 1557M 19.0.0-2445-gd2c45d97 f68e37b807ef 392fd2036c16 2024-04-25T02:17:28.262 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi112 running (54s) 17s ago 13m 105M 2581M 19.0.0-2445-gd2c45d97 f68e37b807ef c100df1a0f60 2024-04-25T02:17:28.262 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi112 running (21s) 17s ago 13m 14.8M 2581M 19.0.0-2445-gd2c45d97 f68e37b807ef 669b1ab41e27 2024-04-25T02:17:28.262 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi112 running (12m) 17s ago 12m 239M 2581M 17.2.7-902-gc61472c8 0de407c1b3af 963e700d6aea 2024-04-25T02:17:28.262 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (5m) 85s ago 16m 59.4M - 2.43.0 a07b618ecd1d c5b8c6104d96 2024-04-25T02:17:28.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.257+0000 7fce8c433700 1 -- 172.21.15.77:0/553690940 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fce7006e140 msgr2=0x7fce700705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:28.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.257+0000 7fce8c433700 1 --2- 172.21.15.77:0/553690940 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fce7006e140 0x7fce700705f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fce80004f90 tx=0x7fce80009e30 comp rx=0 tx=0).stop 2024-04-25T02:17:28.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.257+0000 7fce8c433700 1 -- 172.21.15.77:0/553690940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce84103780 msgr2=0x7fce84113ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:28.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.257+0000 7fce8c433700 1 --2- 172.21.15.77:0/553690940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce84103780 0x7fce84113ed0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fce74002a80 tx=0x7fce74004630 comp rx=0 tx=0).stop 2024-04-25T02:17:28.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.257+0000 7fce8c433700 1 -- 172.21.15.77:0/553690940 shutdown_connections 2024-04-25T02:17:28.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.257+0000 7fce8c433700 1 --2- 172.21.15.77:0/553690940 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fce7006e140 0x7fce700705f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.257+0000 7fce8c433700 1 --2- 172.21.15.77:0/553690940 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fce84102de0 0x7fce84113990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.257+0000 7fce8c433700 1 --2- 172.21.15.77:0/553690940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce84103780 0x7fce84113ed0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.257+0000 7fce8c433700 1 -- 172.21.15.77:0/553690940 >> 172.21.15.77:0/553690940 conn(0x7fce840f8990 msgr2=0x7fce84107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:28.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.257+0000 7fce8c433700 1 -- 172.21.15.77:0/553690940 shutdown_connections 2024-04-25T02:17:28.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.257+0000 7fce8c433700 1 -- 172.21.15.77:0/553690940 wait complete. 2024-04-25T02:17:28.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.357+0000 7fa54dbdb700 1 -- 172.21.15.77:0/2279219023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa548101cf0 msgr2=0x7fa5481020c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:28.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.357+0000 7fa54dbdb700 1 --2- 172.21.15.77:0/2279219023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa548101cf0 0x7fa5481020c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa538004940 tx=0x7fa538009e30 comp rx=0 tx=0).stop 2024-04-25T02:17:28.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.357+0000 7fa54dbdb700 1 -- 172.21.15.77:0/2279219023 shutdown_connections 2024-04-25T02:17:28.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.357+0000 7fa54dbdb700 1 --2- 172.21.15.77:0/2279219023 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa548102690 0x7fa5480fbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.357+0000 7fa54dbdb700 1 --2- 172.21.15.77:0/2279219023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa548101cf0 0x7fa5481020c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.357+0000 7fa54dbdb700 1 -- 172.21.15.77:0/2279219023 >> 172.21.15.77:0/2279219023 conn(0x7fa5480f7860 msgr2=0x7fa5480f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:28.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.357+0000 7fa54dbdb700 1 -- 172.21.15.77:0/2279219023 shutdown_connections 2024-04-25T02:17:28.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.357+0000 7fa54dbdb700 1 -- 172.21.15.77:0/2279219023 wait complete. 2024-04-25T02:17:28.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.357+0000 7fa54dbdb700 1 Processor -- start 2024-04-25T02:17:28.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.358+0000 7fa54dbdb700 1 -- start start 2024-04-25T02:17:28.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.358+0000 7fa54dbdb700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa548101cf0 0x7fa548102b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:28.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.358+0000 7fa54dbdb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa548102690 0x7fa548103090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:28.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.358+0000 7fa54dbdb700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa548104aa0 con 0x7fa548101cf0 2024-04-25T02:17:28.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.358+0000 7fa54dbdb700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5481035d0 con 0x7fa548102690 2024-04-25T02:17:28.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.358+0000 7fa5477fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa548101cf0 0x7fa548102b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:28.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.358+0000 7fa5477fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa548101cf0 0x7fa548102b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60060/0 (socket says 172.21.15.77:60060) 2024-04-25T02:17:28.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.358+0000 7fa5477fe700 1 -- 172.21.15.77:0/591500558 learned_addr learned my addr 172.21.15.77:0/591500558 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:17:28.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.358+0000 7fa53effd700 1 --2- 172.21.15.77:0/591500558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa548102690 0x7fa548103090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:28.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.358+0000 7fa5477fe700 1 -- 172.21.15.77:0/591500558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa548102690 msgr2=0x7fa548103090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:28.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.358+0000 7fa5477fe700 1 --2- 172.21.15.77:0/591500558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa548102690 0x7fa548103090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.358+0000 7fa5477fe700 1 -- 172.21.15.77:0/591500558 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa538005040 con 0x7fa548101cf0 2024-04-25T02:17:28.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.358+0000 7fa5477fe700 1 --2- 172.21.15.77:0/591500558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa548101cf0 0x7fa548102b50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa53800b3b0 tx=0x7fa538009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:28.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.358+0000 7fa544ff9700 1 -- 172.21.15.77:0/591500558 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa53800e040 con 0x7fa548101cf0 2024-04-25T02:17:28.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.358+0000 7fa544ff9700 1 -- 172.21.15.77:0/591500558 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa53800bbc0 con 0x7fa548101cf0 2024-04-25T02:17:28.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.359+0000 7fa54dbdb700 1 -- 172.21.15.77:0/591500558 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa548103850 con 0x7fa548101cf0 2024-04-25T02:17:28.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.359+0000 7fa544ff9700 1 -- 172.21.15.77:0/591500558 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa53801c3f0 con 0x7fa548101cf0 2024-04-25T02:17:28.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.359+0000 7fa53effd700 1 --2- 172.21.15.77:0/591500558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa548102690 0x7fa548103090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:28.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.359+0000 7fa54dbdb700 1 -- 172.21.15.77:0/591500558 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa54811a0c0 con 0x7fa548101cf0 2024-04-25T02:17:28.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.360+0000 7fa54dbdb700 1 -- 172.21.15.77:0/591500558 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5480fd440 con 0x7fa548101cf0 2024-04-25T02:17:28.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.360+0000 7fa544ff9700 1 -- 172.21.15.77:0/591500558 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa53800bd30 con 0x7fa548101cf0 2024-04-25T02:17:28.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.361+0000 7fa544ff9700 1 --2- 172.21.15.77:0/591500558 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fa53406e140 0x7fa5340705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:28.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.361+0000 7fa544ff9700 1 -- 172.21.15.77:0/591500558 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fa53808ecd0 con 0x7fa548101cf0 2024-04-25T02:17:28.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.361+0000 7fa53effd700 1 --2- 172.21.15.77:0/591500558 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fa53406e140 0x7fa5340705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:28.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.361+0000 7fa53effd700 1 --2- 172.21.15.77:0/591500558 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fa53406e140 0x7fa5340705f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa530007fd0 tx=0x7fa530009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:28.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.368+0000 7fa544ff9700 1 -- 172.21.15.77:0/591500558 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fa5380580a0 con 0x7fa548101cf0 2024-04-25T02:17:28.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.646+0000 7fa54dbdb700 1 -- 172.21.15.77:0/591500558 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa54811a300 con 0x7fa548101cf0 2024-04-25T02:17:28.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.646+0000 7fa544ff9700 1 -- 172.21.15.77:0/591500558 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7fa53805b760 con 0x7fa548101cf0 2024-04-25T02:17:28.652 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:17:28.652 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-04-25T02:17:28.652 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:17:28.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:17:28.652 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-04-25T02:17:28.652 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:17:28.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:17:28.652 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-04-25T02:17:28.652 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 1, 2024-04-25T02:17:28.653 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 5 2024-04-25T02:17:28.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:17:28.653 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-04-25T02:17:28.653 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T02:17:28.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:17:28.653 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-04-25T02:17:28.653 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 5, 2024-04-25T02:17:28.653 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 9 2024-04-25T02:17:28.653 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-25T02:17:28.653 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:17:28.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.648+0000 7fa54dbdb700 1 -- 172.21.15.77:0/591500558 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fa53406e140 msgr2=0x7fa5340705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:28.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.648+0000 7fa54dbdb700 1 --2- 172.21.15.77:0/591500558 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fa53406e140 0x7fa5340705f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa530007fd0 tx=0x7fa530009040 comp rx=0 tx=0).stop 2024-04-25T02:17:28.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.649+0000 7fa54dbdb700 1 -- 172.21.15.77:0/591500558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa548101cf0 msgr2=0x7fa548102b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:28.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.649+0000 7fa54dbdb700 1 --2- 172.21.15.77:0/591500558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa548101cf0 0x7fa548102b50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa53800b3b0 tx=0x7fa538009e30 comp rx=0 tx=0).stop 2024-04-25T02:17:28.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.649+0000 7fa54dbdb700 1 -- 172.21.15.77:0/591500558 shutdown_connections 2024-04-25T02:17:28.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.649+0000 7fa54dbdb700 1 --2- 172.21.15.77:0/591500558 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fa53406e140 0x7fa5340705f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.649+0000 7fa54dbdb700 1 --2- 172.21.15.77:0/591500558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa548101cf0 0x7fa548102b50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.649+0000 7fa54dbdb700 1 --2- 172.21.15.77:0/591500558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa548102690 0x7fa548103090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.649+0000 7fa54dbdb700 1 -- 172.21.15.77:0/591500558 >> 172.21.15.77:0/591500558 conn(0x7fa5480f7860 msgr2=0x7fa5480f8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:28.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.649+0000 7fa54dbdb700 1 -- 172.21.15.77:0/591500558 shutdown_connections 2024-04-25T02:17:28.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.649+0000 7fa54dbdb700 1 -- 172.21.15.77:0/591500558 wait complete. 2024-04-25T02:17:28.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.751+0000 7f2d2f913700 1 -- 172.21.15.77:0/1030899080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d28101d90 msgr2=0x7f2d28102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:28.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.751+0000 7f2d2f913700 1 --2- 172.21.15.77:0/1030899080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d28101d90 0x7f2d28102160 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2d20004940 tx=0x7f2d20009e30 comp rx=0 tx=0).stop 2024-04-25T02:17:28.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.751+0000 7f2d2f913700 1 -- 172.21.15.77:0/1030899080 shutdown_connections 2024-04-25T02:17:28.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.751+0000 7f2d2f913700 1 --2- 172.21.15.77:0/1030899080 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d280fbd40 0x7f2d280fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.751+0000 7f2d2f913700 1 --2- 172.21.15.77:0/1030899080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d28101d90 0x7f2d28102160 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.751+0000 7f2d2f913700 1 -- 172.21.15.77:0/1030899080 >> 172.21.15.77:0/1030899080 conn(0x7f2d28071d00 msgr2=0x7f2d28072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:28.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.751+0000 7f2d2f913700 1 -- 172.21.15.77:0/1030899080 shutdown_connections 2024-04-25T02:17:28.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.751+0000 7f2d2f913700 1 -- 172.21.15.77:0/1030899080 wait complete. 2024-04-25T02:17:28.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.751+0000 7f2d2f913700 1 Processor -- start 2024-04-25T02:17:28.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.752+0000 7f2d2f913700 1 -- start start 2024-04-25T02:17:28.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.752+0000 7f2d2f913700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d280fbd40 0x7f2d2810ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:28.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.752+0000 7f2d2f913700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d28101d90 0x7f2d2810f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:28.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.752+0000 7f2d2f913700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2810f6f0 con 0x7f2d280fbd40 2024-04-25T02:17:28.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.752+0000 7f2d2f913700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2810f830 con 0x7f2d28101d90 2024-04-25T02:17:28.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.752+0000 7f2d2d6af700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d280fbd40 0x7f2d2810ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:28.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.752+0000 7f2d2d6af700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d280fbd40 0x7f2d2810ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60066/0 (socket says 172.21.15.77:60066) 2024-04-25T02:17:28.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.752+0000 7f2d2d6af700 1 -- 172.21.15.77:0/343347218 learned_addr learned my addr 172.21.15.77:0/343347218 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:17:28.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.752+0000 7f2d2ceae700 1 --2- 172.21.15.77:0/343347218 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d28101d90 0x7f2d2810f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:28.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.752+0000 7f2d2d6af700 1 -- 172.21.15.77:0/343347218 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d28101d90 msgr2=0x7f2d2810f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:28.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.752+0000 7f2d2d6af700 1 --2- 172.21.15.77:0/343347218 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d28101d90 0x7f2d2810f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:28.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.752+0000 7f2d2d6af700 1 -- 172.21.15.77:0/343347218 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d20005040 con 0x7f2d280fbd40 2024-04-25T02:17:28.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.752+0000 7f2d2d6af700 1 --2- 172.21.15.77:0/343347218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d280fbd40 0x7f2d2810ec70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000b8b0 tx=0x7f2d20009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:28.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.753+0000 7f2d25ffb700 1 -- 172.21.15.77:0/343347218 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d2000e040 con 0x7f2d280fbd40 2024-04-25T02:17:28.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.753+0000 7f2d25ffb700 1 -- 172.21.15.77:0/343347218 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2d20013420 con 0x7f2d280fbd40 2024-04-25T02:17:28.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.753+0000 7f2d2f913700 1 -- 172.21.15.77:0/343347218 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d28117b20 con 0x7f2d280fbd40 2024-04-25T02:17:28.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.753+0000 7f2d25ffb700 1 -- 172.21.15.77:0/343347218 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d2001c630 con 0x7f2d280fbd40 2024-04-25T02:17:28.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.753+0000 7f2d2f913700 1 -- 172.21.15.77:0/343347218 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d28118080 con 0x7f2d280fbd40 2024-04-25T02:17:28.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.754+0000 7f2d2f913700 1 -- 172.21.15.77:0/343347218 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d280fd430 con 0x7f2d280fbd40 2024-04-25T02:17:28.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.754+0000 7f2d25ffb700 1 -- 172.21.15.77:0/343347218 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2d20013a00 con 0x7f2d280fbd40 2024-04-25T02:17:28.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.755+0000 7f2d25ffb700 1 --2- 172.21.15.77:0/343347218 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f2d1006e140 0x7f2d100705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:28.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.755+0000 7f2d25ffb700 1 -- 172.21.15.77:0/343347218 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f2d2008ed60 con 0x7f2d280fbd40 2024-04-25T02:17:28.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.755+0000 7f2d2ceae700 1 --2- 172.21.15.77:0/343347218 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f2d1006e140 0x7f2d100705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:28.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.755+0000 7f2d2ceae700 1 --2- 172.21.15.77:0/343347218 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f2d1006e140 0x7f2d100705f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c007fd0 tx=0x7f2d1c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:28.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:28.759+0000 7f2d25ffb700 1 -- 172.21.15.77:0/343347218 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f2d200581b0 con 0x7f2d280fbd40 2024-04-25T02:17:28.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:28 smithi077 ceph-mon[110441]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:17:28.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:28 smithi077 ceph-mon[110441]: pgmap v150: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:17:28.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:28 smithi077 ceph-mon[110441]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:17:28.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:28 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/591500558' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:17:29.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.000+0000 7f2d2f913700 1 -- 172.21.15.77:0/343347218 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2d2804bf60 con 0x7f2d280fbd40 2024-04-25T02:17:29.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.000+0000 7f2d25ffb700 1 -- 172.21.15.77:0/343347218 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1876 (secure 0 0 0) 0x7f2d2005b870 con 0x7f2d280fbd40 2024-04-25T02:17:29.006 INFO:teuthology.orchestra.run.smithi077.stdout:e15 2024-04-25T02:17:29.006 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T02:17:29.006 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:17:29.006 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-04-25T02:17:29.006 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:17:29.006 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-04-25T02:17:29.006 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-04-25T02:17:29.006 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 15 2024-04-25T02:17:29.006 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-25T02:17:29.006 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-04-25T02:06:10.008979+0000 2024-04-25T02:17:29.006 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-04-25T02:06:27.849984+0000 2024-04-25T02:17:29.006 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-04-25T02:17:29.007 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-04-25T02:17:29.007 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-04-25T02:17:29.007 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-04-25T02:17:29.007 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-04-25T02:17:29.007 INFO:teuthology.orchestra.run.smithi077.stdout:max_xattr_size 65536 2024-04-25T02:17:29.007 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-04-25T02:17:29.007 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-04-25T02:17:29.007 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 47 2024-04-25T02:17:29.007 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:17:29.007 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-04-25T02:17:29.007 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-04-25T02:17:29.007 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=24257} 2024-04-25T02:17:29.007 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-04-25T02:17:29.007 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-04-25T02:17:29.008 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-04-25T02:17:29.008 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-04-25T02:17:29.008 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-04-25T02:17:29.008 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-04-25T02:17:29.008 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-04-25T02:17:29.008 INFO:teuthology.orchestra.run.smithi077.stdout:bal_rank_mask -1 2024-04-25T02:17:29.008 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-04-25T02:17:29.008 INFO:teuthology.orchestra.run.smithi077.stdout:qdb_cluster leader: 0 members: 2024-04-25T02:17:29.008 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi112.dvwudt{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.112:6824/3687767796,v1:172.21.15.112:6825/3687767796] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:17:29.008 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:17:29.008 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:17:29.008 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-04-25T02:17:29.008 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:17:29.008 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.gcfygj{-1:14462} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/691698671,v1:172.21.15.77:6829/691698671] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:17:29.008 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.oadrkb{-1:14474} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.77:6826/26222645,v1:172.21.15.77:6827/26222645] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:17:29.008 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi112.fjnadi{-1:24269} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/2036319817,v1:172.21.15.112:6827/2036319817] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:17:29.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.002+0000 7f2d2f913700 1 -- 172.21.15.77:0/343347218 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f2d1006e140 msgr2=0x7f2d100705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:29.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.002+0000 7f2d2f913700 1 --2- 172.21.15.77:0/343347218 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f2d1006e140 0x7f2d100705f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c007fd0 tx=0x7f2d1c009040 comp rx=0 tx=0).stop 2024-04-25T02:17:29.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.002+0000 7f2d2f913700 1 -- 172.21.15.77:0/343347218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d280fbd40 msgr2=0x7f2d2810ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:29.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.002+0000 7f2d2f913700 1 --2- 172.21.15.77:0/343347218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d280fbd40 0x7f2d2810ec70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000b8b0 tx=0x7f2d20009e30 comp rx=0 tx=0).stop 2024-04-25T02:17:29.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.002+0000 7f2d2f913700 1 -- 172.21.15.77:0/343347218 shutdown_connections 2024-04-25T02:17:29.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.002+0000 7f2d2f913700 1 --2- 172.21.15.77:0/343347218 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f2d1006e140 0x7f2d100705f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.002+0000 7f2d2f913700 1 --2- 172.21.15.77:0/343347218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d280fbd40 0x7f2d2810ec70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.002+0000 7f2d2f913700 1 --2- 172.21.15.77:0/343347218 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d28101d90 0x7f2d2810f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.002+0000 7f2d2f913700 1 -- 172.21.15.77:0/343347218 >> 172.21.15.77:0/343347218 conn(0x7f2d28071d00 msgr2=0x7f2d280fa100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:29.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.003+0000 7f2d2f913700 1 -- 172.21.15.77:0/343347218 shutdown_connections 2024-04-25T02:17:29.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.003+0000 7f2d2f913700 1 -- 172.21.15.77:0/343347218 wait complete. 2024-04-25T02:17:29.010 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 15 2024-04-25T02:17:29.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.105+0000 7f12826e7700 1 -- 172.21.15.77:0/862551774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f127c103760 msgr2=0x7f127c0fcdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:29.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.105+0000 7f12826e7700 1 --2- 172.21.15.77:0/862551774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f127c103760 0x7f127c0fcdd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1270004940 tx=0x7f1270009e30 comp rx=0 tx=0).stop 2024-04-25T02:17:29.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.105+0000 7f12826e7700 1 -- 172.21.15.77:0/862551774 shutdown_connections 2024-04-25T02:17:29.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.105+0000 7f12826e7700 1 --2- 172.21.15.77:0/862551774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f127c103760 0x7f127c0fcdd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.105+0000 7f12826e7700 1 --2- 172.21.15.77:0/862551774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f127c102dc0 0x7f127c103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.105+0000 7f12826e7700 1 -- 172.21.15.77:0/862551774 >> 172.21.15.77:0/862551774 conn(0x7f127c0f8930 msgr2=0x7f127c0fad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:29.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.105+0000 7f12826e7700 1 -- 172.21.15.77:0/862551774 shutdown_connections 2024-04-25T02:17:29.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.105+0000 7f12826e7700 1 -- 172.21.15.77:0/862551774 wait complete. 2024-04-25T02:17:29.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.105+0000 7f12826e7700 1 Processor -- start 2024-04-25T02:17:29.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.105+0000 7f12826e7700 1 -- start start 2024-04-25T02:17:29.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.106+0000 7f12826e7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f127c102dc0 0x7f127c113950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:29.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.106+0000 7f12826e7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f127c103760 0x7f127c113e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:29.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.106+0000 7f12826e7700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c1144e0 con 0x7f127c103760 2024-04-25T02:17:29.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.106+0000 7f12826e7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c10dae0 con 0x7f127c102dc0 2024-04-25T02:17:29.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.106+0000 7f127b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f127c103760 0x7f127c113e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:29.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.106+0000 7f127b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f127c103760 0x7f127c113e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60080/0 (socket says 172.21.15.77:60080) 2024-04-25T02:17:29.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.106+0000 7f127b7fe700 1 -- 172.21.15.77:0/2749419665 learned_addr learned my addr 172.21.15.77:0/2749419665 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:17:29.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.106+0000 7f127bfff700 1 --2- 172.21.15.77:0/2749419665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f127c102dc0 0x7f127c113950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:29.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.106+0000 7f127b7fe700 1 -- 172.21.15.77:0/2749419665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f127c102dc0 msgr2=0x7f127c113950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:29.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.106+0000 7f127b7fe700 1 --2- 172.21.15.77:0/2749419665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f127c102dc0 0x7f127c113950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.106+0000 7f127b7fe700 1 -- 172.21.15.77:0/2749419665 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1270005040 con 0x7f127c103760 2024-04-25T02:17:29.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.106+0000 7f127b7fe700 1 --2- 172.21.15.77:0/2749419665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f127c103760 0x7f127c113e90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f127000b3b0 tx=0x7f1270009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:29.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.106+0000 7f1278ff9700 1 -- 172.21.15.77:0/2749419665 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f127000e040 con 0x7f127c103760 2024-04-25T02:17:29.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.106+0000 7f12826e7700 1 -- 172.21.15.77:0/2749419665 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f127c10dd60 con 0x7f127c103760 2024-04-25T02:17:29.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.106+0000 7f1278ff9700 1 -- 172.21.15.77:0/2749419665 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1270013420 con 0x7f127c103760 2024-04-25T02:17:29.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.106+0000 7f12826e7700 1 -- 172.21.15.77:0/2749419665 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127c10e320 con 0x7f127c103760 2024-04-25T02:17:29.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.106+0000 7f1278ff9700 1 -- 172.21.15.77:0/2749419665 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f127001c630 con 0x7f127c103760 2024-04-25T02:17:29.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.107+0000 7f12826e7700 1 -- 172.21.15.77:0/2749419665 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f127c0fe510 con 0x7f127c103760 2024-04-25T02:17:29.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.108+0000 7f1278ff9700 1 -- 172.21.15.77:0/2749419665 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1270013590 con 0x7f127c103760 2024-04-25T02:17:29.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.108+0000 7f1278ff9700 1 --2- 172.21.15.77:0/2749419665 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f126406e140 0x7f12640705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:29.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.108+0000 7f127bfff700 1 --2- 172.21.15.77:0/2749419665 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f126406e140 0x7f12640705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:29.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.108+0000 7f1278ff9700 1 -- 172.21.15.77:0/2749419665 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f127008eb90 con 0x7f127c103760 2024-04-25T02:17:29.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.109+0000 7f127bfff700 1 --2- 172.21.15.77:0/2749419665 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f126406e140 0x7f12640705f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f126c004f40 tx=0x7f126c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:29.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.113+0000 7f1278ff9700 1 -- 172.21.15.77:0/2749419665 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f127005bc60 con 0x7f127c103760 2024-04-25T02:17:29.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:28 smithi112 ceph-mon[80494]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:17:29.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:28 smithi112 ceph-mon[80494]: pgmap v150: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:17:29.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:28 smithi112 ceph-mon[80494]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:17:29.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:28 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/591500558' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:17:29.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.327+0000 7f12826e7700 1 -- 172.21.15.77:0/2749419665 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f127c109ea0 con 0x7f126406e140 2024-04-25T02:17:29.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.328+0000 7f1278ff9700 1 -- 172.21.15.77:0/2749419665 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f127c109ea0 con 0x7f126406e140 2024-04-25T02:17:29.333 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:17:29.333 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901", 2024-04-25T02:17:29.333 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-04-25T02:17:29.334 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T02:17:29.334 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-04-25T02:17:29.334 INFO:teuthology.orchestra.run.smithi077.stdout: "mon", 2024-04-25T02:17:29.334 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr", 2024-04-25T02:17:29.334 INFO:teuthology.orchestra.run.smithi077.stdout: "crash" 2024-04-25T02:17:29.334 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-25T02:17:29.334 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "11/21 daemons upgraded", 2024-04-25T02:17:29.334 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading osd daemons", 2024-04-25T02:17:29.334 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-04-25T02:17:29.334 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:17:29.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.330+0000 7f12826e7700 1 -- 172.21.15.77:0/2749419665 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f126406e140 msgr2=0x7f12640705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:29.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.330+0000 7f12826e7700 1 --2- 172.21.15.77:0/2749419665 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f126406e140 0x7f12640705f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f126c004f40 tx=0x7f126c00b040 comp rx=0 tx=0).stop 2024-04-25T02:17:29.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.330+0000 7f12826e7700 1 -- 172.21.15.77:0/2749419665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f127c103760 msgr2=0x7f127c113e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:29.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.330+0000 7f12826e7700 1 --2- 172.21.15.77:0/2749419665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f127c103760 0x7f127c113e90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f127000b3b0 tx=0x7f1270009e30 comp rx=0 tx=0).stop 2024-04-25T02:17:29.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.330+0000 7f12826e7700 1 -- 172.21.15.77:0/2749419665 shutdown_connections 2024-04-25T02:17:29.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.330+0000 7f12826e7700 1 --2- 172.21.15.77:0/2749419665 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f126406e140 0x7f12640705f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.330+0000 7f12826e7700 1 --2- 172.21.15.77:0/2749419665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f127c102dc0 0x7f127c113950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.330+0000 7f12826e7700 1 --2- 172.21.15.77:0/2749419665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f127c103760 0x7f127c113e90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.330+0000 7f12826e7700 1 -- 172.21.15.77:0/2749419665 >> 172.21.15.77:0/2749419665 conn(0x7f127c0f8930 msgr2=0x7f127c0f98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:29.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.330+0000 7f12826e7700 1 -- 172.21.15.77:0/2749419665 shutdown_connections 2024-04-25T02:17:29.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.330+0000 7f12826e7700 1 -- 172.21.15.77:0/2749419665 wait complete. 2024-04-25T02:17:29.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.434+0000 7f5f0849b700 1 -- 172.21.15.77:0/2791827899 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f000fb390 msgr2=0x7f5f000fb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:29.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.434+0000 7f5f0849b700 1 --2- 172.21.15.77:0/2791827899 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f000fb390 0x7f5f000fb7e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0004940 tx=0x7f5ef0009e30 comp rx=0 tx=0).stop 2024-04-25T02:17:29.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.434+0000 7f5f0849b700 1 -- 172.21.15.77:0/2791827899 shutdown_connections 2024-04-25T02:17:29.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.434+0000 7f5f0849b700 1 --2- 172.21.15.77:0/2791827899 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f000fb390 0x7f5f000fb7e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.434+0000 7f5f0849b700 1 --2- 172.21.15.77:0/2791827899 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f00102f60 0x7f5f00103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.435+0000 7f5f0849b700 1 -- 172.21.15.77:0/2791827899 >> 172.21.15.77:0/2791827899 conn(0x7f5f00073350 msgr2=0x7f5f00073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:29.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.435+0000 7f5f0849b700 1 -- 172.21.15.77:0/2791827899 shutdown_connections 2024-04-25T02:17:29.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.435+0000 7f5f0849b700 1 -- 172.21.15.77:0/2791827899 wait complete. 2024-04-25T02:17:29.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.435+0000 7f5f0849b700 1 Processor -- start 2024-04-25T02:17:29.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.435+0000 7f5f0849b700 1 -- start start 2024-04-25T02:17:29.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.435+0000 7f5f0849b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f000fb390 0x7f5f00113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:29.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.435+0000 7f5f0849b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f00102f60 0x7f5f00113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:29.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.435+0000 7f5f0849b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f00114500 con 0x7f5f000fb390 2024-04-25T02:17:29.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.435+0000 7f5f0849b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0010db20 con 0x7f5f00102f60 2024-04-25T02:17:29.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.435+0000 7f5f06237700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f000fb390 0x7f5f00113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:29.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.435+0000 7f5f06237700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f000fb390 0x7f5f00113970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60098/0 (socket says 172.21.15.77:60098) 2024-04-25T02:17:29.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.435+0000 7f5f06237700 1 -- 172.21.15.77:0/3871693664 learned_addr learned my addr 172.21.15.77:0/3871693664 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:17:29.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.436+0000 7f5f05a36700 1 --2- 172.21.15.77:0/3871693664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f00102f60 0x7f5f00113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:29.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.436+0000 7f5f06237700 1 -- 172.21.15.77:0/3871693664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f00102f60 msgr2=0x7f5f00113eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:29.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.436+0000 7f5f06237700 1 --2- 172.21.15.77:0/3871693664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f00102f60 0x7f5f00113eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.436+0000 7f5f06237700 1 -- 172.21.15.77:0/3871693664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef0005040 con 0x7f5f000fb390 2024-04-25T02:17:29.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.436+0000 7f5f06237700 1 --2- 172.21.15.77:0/3871693664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f000fb390 0x7f5f00113970 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5efc002a50 tx=0x7f5efc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:29.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.436+0000 7f5ef6ffd700 1 -- 172.21.15.77:0/3871693664 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5efc007cc0 con 0x7f5f000fb390 2024-04-25T02:17:29.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.436+0000 7f5ef6ffd700 1 -- 172.21.15.77:0/3871693664 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5efc00f040 con 0x7f5f000fb390 2024-04-25T02:17:29.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.436+0000 7f5f0849b700 1 -- 172.21.15.77:0/3871693664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f0010de00 con 0x7f5f000fb390 2024-04-25T02:17:29.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.436+0000 7f5ef6ffd700 1 -- 172.21.15.77:0/3871693664 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5efc00da30 con 0x7f5f000fb390 2024-04-25T02:17:29.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.436+0000 7f5f0849b700 1 -- 172.21.15.77:0/3871693664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f0010e340 con 0x7f5f000fb390 2024-04-25T02:17:29.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.437+0000 7f5f0849b700 1 -- 172.21.15.77:0/3871693664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f001052f0 con 0x7f5f000fb390 2024-04-25T02:17:29.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.437+0000 7f5ef6ffd700 1 -- 172.21.15.77:0/3871693664 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5efc00db90 con 0x7f5f000fb390 2024-04-25T02:17:29.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.438+0000 7f5ef6ffd700 1 --2- 172.21.15.77:0/3871693664 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5eec06e140 0x7f5eec0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:29.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.438+0000 7f5ef6ffd700 1 -- 172.21.15.77:0/3871693664 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f5efc08d870 con 0x7f5f000fb390 2024-04-25T02:17:29.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.438+0000 7f5f05a36700 1 --2- 172.21.15.77:0/3871693664 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5eec06e140 0x7f5eec0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:29.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.438+0000 7f5f05a36700 1 --2- 172.21.15.77:0/3871693664 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5eec06e140 0x7f5eec0705f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5f0010f210 tx=0x7f5ef0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:29.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.443+0000 7f5ef6ffd700 1 -- 172.21.15.77:0/3871693664 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f5efc056c40 con 0x7f5f000fb390 2024-04-25T02:17:29.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.720+0000 7f5f0849b700 1 -- 172.21.15.77:0/3871693664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5f000fe6b0 con 0x7f5f000fb390 2024-04-25T02:17:29.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.720+0000 7f5ef6ffd700 1 -- 172.21.15.77:0/3871693664 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f5efc05a300 con 0x7f5f000fb390 2024-04-25T02:17:29.725 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-04-25T02:17:29.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.722+0000 7f5f0849b700 1 -- 172.21.15.77:0/3871693664 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5eec06e140 msgr2=0x7f5eec0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:29.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.722+0000 7f5f0849b700 1 --2- 172.21.15.77:0/3871693664 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5eec06e140 0x7f5eec0705f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5f0010f210 tx=0x7f5ef0009e30 comp rx=0 tx=0).stop 2024-04-25T02:17:29.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.722+0000 7f5f0849b700 1 -- 172.21.15.77:0/3871693664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f000fb390 msgr2=0x7f5f00113970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:29.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.722+0000 7f5f0849b700 1 --2- 172.21.15.77:0/3871693664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f000fb390 0x7f5f00113970 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5efc002a50 tx=0x7f5efc0046b0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.722+0000 7f5f0849b700 1 -- 172.21.15.77:0/3871693664 shutdown_connections 2024-04-25T02:17:29.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.722+0000 7f5f0849b700 1 --2- 172.21.15.77:0/3871693664 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5eec06e140 0x7f5eec0705f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.722+0000 7f5f0849b700 1 --2- 172.21.15.77:0/3871693664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f000fb390 0x7f5f00113970 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.722+0000 7f5f0849b700 1 --2- 172.21.15.77:0/3871693664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f00102f60 0x7f5f00113eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:29.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.722+0000 7f5f0849b700 1 -- 172.21.15.77:0/3871693664 >> 172.21.15.77:0/3871693664 conn(0x7f5f00073350 msgr2=0x7f5f000ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:29.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.722+0000 7f5f0849b700 1 -- 172.21.15.77:0/3871693664 shutdown_connections 2024-04-25T02:17:29.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:29.722+0000 7f5f0849b700 1 -- 172.21.15.77:0/3871693664 wait complete. 2024-04-25T02:17:29.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:29 smithi077 ceph-mon[110441]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:17:29.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:29 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/343347218' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:17:29.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:29 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:29.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:29 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/3871693664' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T02:17:30.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:29 smithi112 ceph-mon[80494]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:17:30.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:29 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/343347218' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:17:30.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:29 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:30.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:29 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/3871693664' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T02:17:31.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:30 smithi112 ceph-mon[80494]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:17:31.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:30 smithi112 ceph-mon[80494]: pgmap v151: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:17:31.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:30 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-25T02:17:31.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:30 smithi077 ceph-mon[110441]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:17:31.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:30 smithi077 ceph-mon[110441]: pgmap v151: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:17:31.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:30 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-25T02:17:32.149 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:31 smithi112 ceph-mon[80494]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-25T02:17:32.150 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:31 smithi112 ceph-mon[80494]: Upgrade: osd.5 is safe to restart 2024-04-25T02:17:32.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:31 smithi077 ceph-mon[110441]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-25T02:17:32.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:31 smithi077 ceph-mon[110441]: Upgrade: osd.5 is safe to restart 2024-04-25T02:17:32.875 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:32 smithi112 ceph-mon[80494]: pgmap v152: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:17:32.875 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:32 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:32.875 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:32 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-25T02:17:32.875 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:32 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:17:33.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:32 smithi077 ceph-mon[110441]: pgmap v152: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:17:33.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:32 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:33.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:32 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-25T02:17:33.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:32 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:17:34.149 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:33 smithi112 ceph-mon[80494]: Upgrade: Updating osd.5 2024-04-25T02:17:34.149 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:33 smithi112 ceph-mon[80494]: Deploying daemon osd.5 on smithi112 2024-04-25T02:17:34.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:33 smithi077 ceph-mon[110441]: Upgrade: Updating osd.5 2024-04-25T02:17:34.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:33 smithi077 ceph-mon[110441]: Deploying daemon osd.5 on smithi112 2024-04-25T02:17:35.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:34 smithi112 ceph-mon[80494]: pgmap v153: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:17:35.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:34 smithi077 ceph-mon[110441]: pgmap v153: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:17:35.416 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:35 smithi112 systemd[1]: Stopping Ceph osd.5 for 4bb93d82-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:17:35.777 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:35 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[52049]: 2024-04-25T02:17:35.411+0000 7f3c4749d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:17:35.777 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:35 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[52049]: 2024-04-25T02:17:35.411+0000 7f3c4749d700 -1 osd.5 75 *** Got signal Terminated *** 2024-04-25T02:17:35.777 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:35 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[52049]: 2024-04-25T02:17:35.411+0000 7f3c4749d700 -1 osd.5 75 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T02:17:36.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:35 smithi077 ceph-mon[110441]: osd.5 marked itself down and dead 2024-04-25T02:17:36.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:35 smithi112 ceph-mon[80494]: osd.5 marked itself down and dead 2024-04-25T02:17:36.575 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:36 smithi112 podman[98897]: 2024-04-25 02:17:36.300970776 +0000 UTC m=+0.997779251 container died 963e700d6aeacd96e9ed75431b79a666fa1353f16648650699b635c4bce61d9e (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, RELEASE=quincy-c61472c, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-25T02:17:36.967 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:36 smithi112 podman[98897]: 2024-04-25 02:17:36.670414759 +0000 UTC m=+1.367223229 container cleanup 963e700d6aeacd96e9ed75431b79a666fa1353f16648650699b635c4bce61d9e (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=quincy-c61472c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-25T02:17:36.967 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:36 smithi112 bash[98897]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5 2024-04-25T02:17:36.967 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:36 smithi112 ceph-mon[80494]: pgmap v154: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:17:36.968 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:36 smithi112 ceph-mon[80494]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-25T02:17:36.968 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:36 smithi112 ceph-mon[80494]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-04-25T02:17:36.968 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:36 smithi112 ceph-mon[80494]: osdmap e76: 6 total, 5 up, 6 in 2024-04-25T02:17:37.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:36 smithi077 ceph-mon[110441]: pgmap v154: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:17:37.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:36 smithi077 ceph-mon[110441]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-25T02:17:37.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:36 smithi077 ceph-mon[110441]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-04-25T02:17:37.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:36 smithi077 ceph-mon[110441]: osdmap e76: 6 total, 5 up, 6 in 2024-04-25T02:17:37.262 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:36 smithi112 podman[98915]: 2024-04-25 02:17:36.963530121 +0000 UTC m=+0.657240110 container remove 963e700d6aeacd96e9ed75431b79a666fa1353f16648650699b635c4bce61d9e (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5, RELEASE=quincy-c61472c, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:17:37.528 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:37 smithi112 podman[99004]: 2024-04-25 02:17:37.256152695 +0000 UTC m=+0.111785165 container create f2046094299afff9047483704bdfb65e7fee5c85123ffa45922cf95ce9ecb5a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-d2c45d9, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-04-25T02:17:37.528 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:37 smithi112 podman[99004]: 2024-04-25 02:17:37.162022177 +0000 UTC m=+0.017654682 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:17:37.528 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:37 smithi112 podman[99004]: 2024-04-25 02:17:37.475610685 +0000 UTC m=+0.331243166 container init f2046094299afff9047483704bdfb65e7fee5c85123ffa45922cf95ce9ecb5a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9) 2024-04-25T02:17:37.528 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:37 smithi112 podman[99004]: 2024-04-25 02:17:37.478640489 +0000 UTC m=+0.334272959 container start f2046094299afff9047483704bdfb65e7fee5c85123ffa45922cf95ce9ecb5a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5-deactivate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-d2c45d9, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240424) 2024-04-25T02:17:37.821 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:37 smithi112 podman[99004]: 2024-04-25 02:17:37.550525335 +0000 UTC m=+0.406157816 container attach f2046094299afff9047483704bdfb65e7fee5c85123ffa45922cf95ce9ecb5a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-04-25T02:17:37.821 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:37 smithi112 podman[99004]: 2024-04-25 02:17:37.766517096 +0000 UTC m=+0.622149589 container died f2046094299afff9047483704bdfb65e7fee5c85123ffa45922cf95ce9ecb5a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5-deactivate, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-d2c45d9, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-04-25T02:17:38.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:37 smithi077 ceph-mon[110441]: osdmap e77: 6 total, 5 up, 6 in 2024-04-25T02:17:38.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:37 smithi112 ceph-mon[80494]: osdmap e77: 6 total, 5 up, 6 in 2024-04-25T02:17:38.730 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:38 smithi112 podman[99030]: 2024-04-25 02:17:38.287478567 +0000 UTC m=+0.515259416 container remove f2046094299afff9047483704bdfb65e7fee5c85123ffa45922cf95ce9ecb5a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, RELEASE=squid-d2c45d9, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-04-25T02:17:38.730 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:38 smithi112 systemd[1]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.5.service: Deactivated successfully. 2024-04-25T02:17:38.730 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:38 smithi112 systemd[1]: Stopped Ceph osd.5 for 4bb93d82-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:17:38.731 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:38 smithi112 systemd[1]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.5.service: Consumed 1min 3.186s CPU time. 2024-04-25T02:17:38.731 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:38 smithi112 systemd[1]: Starting Ceph osd.5 for 4bb93d82-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:17:38.983 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:38 smithi112 ceph-mon[80494]: pgmap v157: 65 pgs: 11 stale+active+clean, 3 active+undersized, 51 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:17:38.983 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:38 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:38.983 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:38 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:17:38.983 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:38 smithi112 podman[99131]: 2024-04-25 02:17:38.628854316 +0000 UTC m=+0.018551605 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:17:38.983 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:38 smithi112 podman[99131]: 2024-04-25 02:17:38.733053656 +0000 UTC m=+0.122750968 container create 2e525ef9ebf01120359a35dce130d0b1c0f7d4a3a53e5e9bfbfe536b14d69cca (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5-activate, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=squid-d2c45d9, GIT_CLEAN=True, org.label-schema.build-date=20240424) 2024-04-25T02:17:38.983 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:38 smithi112 podman[99131]: 2024-04-25 02:17:38.975253348 +0000 UTC m=+0.364950630 container init 2e525ef9ebf01120359a35dce130d0b1c0f7d4a3a53e5e9bfbfe536b14d69cca (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5-activate, ceph=True, RELEASE=squid-d2c45d9, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424) 2024-04-25T02:17:38.983 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:38 smithi112 podman[99131]: 2024-04-25 02:17:38.979346751 +0000 UTC m=+0.369044020 container start 2e525ef9ebf01120359a35dce130d0b1c0f7d4a3a53e5e9bfbfe536b14d69cca (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5-activate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:17:39.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:38 smithi077 ceph-mon[110441]: pgmap v157: 65 pgs: 11 stale+active+clean, 3 active+undersized, 51 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-04-25T02:17:39.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:38 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:39.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:38 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:17:39.277 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:39 smithi112 podman[99131]: 2024-04-25 02:17:39.075491756 +0000 UTC m=+0.465189037 container attach 2e525ef9ebf01120359a35dce130d0b1c0f7d4a3a53e5e9bfbfe536b14d69cca (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5-activate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-04-25T02:17:39.741 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:39 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5-activate[99146]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T02:17:39.742 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:39 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5-activate[99146]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-25T02:17:39.742 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:39 smithi112 bash[99131]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T02:17:39.742 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:39 smithi112 bash[99131]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-25T02:17:39.742 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:39 smithi112 bash[99131]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-25T02:17:39.742 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:39 smithi112 bash[99131]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-25T02:17:39.742 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:39 smithi112 bash[99131]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-04-25T02:17:39.742 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:39 smithi112 bash[99131]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T02:17:39.742 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:39 smithi112 bash[99131]: --> ceph-volume raw activate successful for osd ID: 5 2024-04-25T02:17:39.742 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:39 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5-activate[99146]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-25T02:17:39.742 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:39 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5-activate[99146]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-25T02:17:39.742 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:39 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5-activate[99146]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-04-25T02:17:39.742 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:39 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5-activate[99146]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T02:17:39.743 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:39 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5-activate[99146]: --> ceph-volume raw activate successful for osd ID: 5 2024-04-25T02:17:39.743 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:39 smithi112 podman[99131]: 2024-04-25 02:17:39.442625216 +0000 UTC m=+0.832322497 container died 2e525ef9ebf01120359a35dce130d0b1c0f7d4a3a53e5e9bfbfe536b14d69cca (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5-activate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-25T02:17:40.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:39 smithi112 ceph-mon[80494]: Health check failed: Degraded data redundancy: 13/219 objects degraded (5.936%), 7 pgs degraded (PG_DEGRADED) 2024-04-25T02:17:40.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:39 smithi077 ceph-mon[110441]: Health check failed: Degraded data redundancy: 13/219 objects degraded (5.936%), 7 pgs degraded (PG_DEGRADED) 2024-04-25T02:17:40.405 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:40 smithi112 podman[99281]: 2024-04-25 02:17:40.065360687 +0000 UTC m=+0.617069516 container remove 2e525ef9ebf01120359a35dce130d0b1c0f7d4a3a53e5e9bfbfe536b14d69cca (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5-activate, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-04-25T02:17:40.405 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:40 smithi112 podman[99344]: 2024-04-25 02:17:40.182183252 +0000 UTC m=+0.018417093 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:17:40.405 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:40 smithi112 podman[99344]: 2024-04-25 02:17:40.288895544 +0000 UTC m=+0.125129419 container create cc8f3462943ef3854d1c4e6b72e5c664d1f850c8a051a77833f6038ec3c54c41 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5, org.label-schema.build-date=20240424, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-d2c45d9, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:17:40.777 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:40 smithi112 podman[99344]: 2024-04-25 02:17:40.482997922 +0000 UTC m=+0.319231754 container init cc8f3462943ef3854d1c4e6b72e5c664d1f850c8a051a77833f6038ec3c54c41 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:17:40.777 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:40 smithi112 podman[99344]: 2024-04-25 02:17:40.485846435 +0000 UTC m=+0.322080264 container start cc8f3462943ef3854d1c4e6b72e5c664d1f850c8a051a77833f6038ec3c54c41 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-d2c45d9, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T02:17:40.777 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:40 smithi112 ceph-osd[99363]: -- 172.21.15.112:0/1941888538 <== mon.1 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5584e32c3680 con 0x5584e328d000 2024-04-25T02:17:40.777 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:40 smithi112 bash[99344]: cc8f3462943ef3854d1c4e6b72e5c664d1f850c8a051a77833f6038ec3c54c41 2024-04-25T02:17:40.777 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:40 smithi112 systemd[1]: Started Ceph osd.5 for 4bb93d82-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:17:41.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:40 smithi077 ceph-mon[110441]: pgmap v158: 65 pgs: 7 active+undersized+degraded, 3 stale+active+clean, 11 active+undersized, 44 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 13/219 objects degraded (5.936%) 2024-04-25T02:17:41.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:40 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:41.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:40 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:41.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:40 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:17:41.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:40 smithi112 ceph-mon[80494]: pgmap v158: 65 pgs: 7 active+undersized+degraded, 3 stale+active+clean, 11 active+undersized, 44 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 13/219 objects degraded (5.936%) 2024-04-25T02:17:41.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:40 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:41.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:40 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:41.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:40 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:17:41.278 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:41 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:17:41.032+0000 7f634d7d17c0 -1 Falling back to public interface 2024-04-25T02:17:43.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:42 smithi077 ceph-mon[110441]: pgmap v159: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-04-25T02:17:43.254 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:42 smithi112 ceph-mon[80494]: pgmap v159: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-04-25T02:17:45.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:44 smithi077 ceph-mon[110441]: pgmap v160: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-04-25T02:17:45.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:44 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:45.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:44 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:45.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:44 smithi112 ceph-mon[80494]: pgmap v160: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-04-25T02:17:45.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:44 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:45.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:44 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:46.041 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:45 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:46.042 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:45 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:46.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:45 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:46.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:45 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:46.527 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:46 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:17:46.036+0000 7f634d7d17c0 -1 osd.5 75 log_to_monitors true 2024-04-25T02:17:47.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:47 smithi112 ceph-mon[80494]: pgmap v161: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-04-25T02:17:47.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:47 smithi112 ceph-mon[80494]: from='osd.5 [v2:172.21.15.112:6816/1908468918,v1:172.21.15.112:6817/1908468918]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T02:17:47.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:47 smithi112 ceph-mon[80494]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T02:17:47.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:47 smithi077 ceph-mon[110441]: pgmap v161: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-04-25T02:17:47.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:47 smithi077 ceph-mon[110441]: from='osd.5 [v2:172.21.15.112:6816/1908468918,v1:172.21.15.112:6817/1908468918]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T02:17:47.478 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:47 smithi077 ceph-mon[110441]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T02:17:48.245 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:17:47 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:17:47.818+0000 7f633ac21700 -1 osd.5 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:17:48.245 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:48 smithi112 ceph-mon[80494]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-25T02:17:48.246 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:48 smithi112 ceph-mon[80494]: osdmap e78: 6 total, 5 up, 6 in 2024-04-25T02:17:48.246 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:48 smithi112 ceph-mon[80494]: from='osd.5 [v2:172.21.15.112:6816/1908468918,v1:172.21.15.112:6817/1908468918]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T02:17:48.246 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:48 smithi112 ceph-mon[80494]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T02:17:48.246 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:48 smithi112 ceph-mon[80494]: pgmap v163: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 194 MiB data, 794 MiB used, 536 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-04-25T02:17:48.246 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:48 smithi112 ceph-mon[80494]: from='osd.5 ' entity='osd.5' 2024-04-25T02:17:48.366 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:48 smithi077 ceph-mon[110441]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-25T02:17:48.366 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:48 smithi077 ceph-mon[110441]: osdmap e78: 6 total, 5 up, 6 in 2024-04-25T02:17:48.366 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:48 smithi077 ceph-mon[110441]: from='osd.5 [v2:172.21.15.112:6816/1908468918,v1:172.21.15.112:6817/1908468918]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T02:17:48.366 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:48 smithi077 ceph-mon[110441]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T02:17:48.367 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:48 smithi077 ceph-mon[110441]: pgmap v163: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 194 MiB data, 794 MiB used, 536 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-04-25T02:17:48.367 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:48 smithi077 ceph-mon[110441]: from='osd.5 ' entity='osd.5' 2024-04-25T02:17:49.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:49.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:49.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:17:49.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:17:49.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:49.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:17:49.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:17:49.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:17:49.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:17:49.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:17:49.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: Upgrade: Setting container_image for all osd 2024-04-25T02:17:49.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:49.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-04-25T02:17:49.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-04-25T02:17:49.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-04-25T02:17:49.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-04-25T02:17:49.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-04-25T02:17:49.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-04-25T02:17:49.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-04-25T02:17:49.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-04-25T02:17:49.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-04-25T02:17:49.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-04-25T02:17:49.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-04-25T02:17:49.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-04-25T02:17:49.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: Upgrade: Setting require_osd_release to 19 squid 2024-04-25T02:17:49.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-25T02:17:49.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-04-25T02:17:49.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: osd.5 [v2:172.21.15.112:6816/1908468918,v1:172.21.15.112:6817/1908468918] boot 2024-04-25T02:17:49.979 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: osdmap e79: 6 total, 6 up, 6 in 2024-04-25T02:17:49.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:17:49.980 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:49 smithi077 ceph-mon[110441]: Health check update: Degraded data redundancy: 31/219 objects degraded (14.155%), 12 pgs degraded (PG_DEGRADED) 2024-04-25T02:17:50.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:50.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:50.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:17:50.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:17:50.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:50.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:17:50.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:17:50.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:17:50.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:17:50.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:17:50.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: Upgrade: Setting container_image for all osd 2024-04-25T02:17:50.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:50.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-04-25T02:17:50.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-04-25T02:17:50.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-04-25T02:17:50.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-04-25T02:17:50.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-04-25T02:17:50.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-04-25T02:17:50.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-04-25T02:17:50.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-04-25T02:17:50.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-04-25T02:17:50.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-04-25T02:17:50.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-04-25T02:17:50.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-04-25T02:17:50.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: Upgrade: Setting require_osd_release to 19 squid 2024-04-25T02:17:50.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-25T02:17:50.029 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-04-25T02:17:50.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: osd.5 [v2:172.21.15.112:6816/1908468918,v1:172.21.15.112:6817/1908468918] boot 2024-04-25T02:17:50.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: osdmap e79: 6 total, 6 up, 6 in 2024-04-25T02:17:50.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:17:50.030 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:49 smithi112 ceph-mon[80494]: Health check update: Degraded data redundancy: 31/219 objects degraded (14.155%), 12 pgs degraded (PG_DEGRADED) 2024-04-25T02:17:50.699 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:50 smithi077 ceph-mon[110441]: pgmap v165: 65 pgs: 2 peering, 11 active+undersized+degraded, 15 active+undersized, 37 active+clean; 194 MiB data, 794 MiB used, 536 GiB / 536 GiB avail; 28/219 objects degraded (12.785%) 2024-04-25T02:17:50.700 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:50 smithi077 ceph-mon[110441]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-04-25T02:17:50.700 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:50 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-04-25T02:17:50.700 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:50 smithi077 ceph-mon[110441]: osdmap e80: 6 total, 6 up, 6 in 2024-04-25T02:17:51.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:50 smithi112 ceph-mon[80494]: pgmap v165: 65 pgs: 2 peering, 11 active+undersized+degraded, 15 active+undersized, 37 active+clean; 194 MiB data, 794 MiB used, 536 GiB / 536 GiB avail; 28/219 objects degraded (12.785%) 2024-04-25T02:17:51.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:50 smithi112 ceph-mon[80494]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-04-25T02:17:51.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:50 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-04-25T02:17:51.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:50 smithi112 ceph-mon[80494]: osdmap e80: 6 total, 6 up, 6 in 2024-04-25T02:17:52.652 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:52 smithi077 ceph-mon[110441]: Upgrade: Updating mds.cephfs.smithi077.oadrkb 2024-04-25T02:17:52.652 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:52 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:52.652 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:52 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.oadrkb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:17:52.652 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:52 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:17:52.653 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:52 smithi077 ceph-mon[110441]: Deploying daemon mds.cephfs.smithi077.oadrkb on smithi077 2024-04-25T02:17:52.653 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:52 smithi077 ceph-mon[110441]: pgmap v167: 65 pgs: 2 peering, 7 active+undersized+degraded, 12 active+undersized, 44 active+clean; 194 MiB data, 794 MiB used, 536 GiB / 536 GiB avail; 13/219 objects degraded (5.936%) 2024-04-25T02:17:52.777 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:52 smithi112 ceph-mon[80494]: Upgrade: Updating mds.cephfs.smithi077.oadrkb 2024-04-25T02:17:52.777 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:52 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:52.777 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:52 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.oadrkb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:17:52.777 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:52 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:17:52.777 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:52 smithi112 ceph-mon[80494]: Deploying daemon mds.cephfs.smithi077.oadrkb on smithi077 2024-04-25T02:17:52.777 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:52 smithi112 ceph-mon[80494]: pgmap v167: 65 pgs: 2 peering, 7 active+undersized+degraded, 12 active+undersized, 44 active+clean; 194 MiB data, 794 MiB used, 536 GiB / 536 GiB avail; 13/219 objects degraded (5.936%) 2024-04-25T02:17:54.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:54 smithi077 ceph-mon[110441]: osdmap e81: 6 total, 6 up, 6 in 2024-04-25T02:17:54.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:54 smithi077 ceph-mon[110441]: fsmap cephfs:1 {0=cephfs.smithi112.dvwudt=up:active} 2 up:standby 2024-04-25T02:17:54.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:54 smithi077 ceph-mon[110441]: pgmap v169: 65 pgs: 2 peering, 2 active+undersized+degraded, 1 active+undersized, 60 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 3/219 objects degraded (1.370%) 2024-04-25T02:17:54.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:54 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:54.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:54 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:17:54.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:54 smithi077 ceph-mon[110441]: Health check update: Degraded data redundancy: 13/219 objects degraded (5.936%), 7 pgs degraded (PG_DEGRADED) 2024-04-25T02:17:55.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:54 smithi112 ceph-mon[80494]: osdmap e81: 6 total, 6 up, 6 in 2024-04-25T02:17:55.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:54 smithi112 ceph-mon[80494]: fsmap cephfs:1 {0=cephfs.smithi112.dvwudt=up:active} 2 up:standby 2024-04-25T02:17:55.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:54 smithi112 ceph-mon[80494]: pgmap v169: 65 pgs: 2 peering, 2 active+undersized+degraded, 1 active+undersized, 60 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 3/219 objects degraded (1.370%) 2024-04-25T02:17:55.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:54 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:55.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:54 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:17:55.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:54 smithi112 ceph-mon[80494]: Health check update: Degraded data redundancy: 13/219 objects degraded (5.936%), 7 pgs degraded (PG_DEGRADED) 2024-04-25T02:17:55.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:55 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.oadrkb"}]: dispatch 2024-04-25T02:17:56.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:55 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.oadrkb"}]: dispatch 2024-04-25T02:17:56.918 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:56 smithi077 ceph-mon[110441]: pgmap v170: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:17:57.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:56 smithi112 ceph-mon[80494]: pgmap v170: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:17:57.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:57 smithi077 ceph-mon[110441]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/219 objects degraded (1.370%), 2 pgs degraded) 2024-04-25T02:17:57.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:57 smithi077 ceph-mon[110441]: Cluster is now healthy 2024-04-25T02:17:58.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:57 smithi112 ceph-mon[80494]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/219 objects degraded (1.370%), 2 pgs degraded) 2024-04-25T02:17:58.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:57 smithi112 ceph-mon[80494]: Cluster is now healthy 2024-04-25T02:17:58.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:58 smithi077 ceph-mon[110441]: pgmap v171: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:17:59.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:58 smithi112 ceph-mon[80494]: pgmap v171: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:17:59.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.831+0000 7f037fa69700 1 -- 172.21.15.77:0/3899272567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0378101cd0 msgr2=0x7f03781020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:59.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.831+0000 7f037fa69700 1 --2- 172.21.15.77:0/3899272567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0378101cd0 0x7f03781020a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0374004940 tx=0x7f0374009e30 comp rx=0 tx=0).stop 2024-04-25T02:17:59.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.831+0000 7f037fa69700 1 -- 172.21.15.77:0/3899272567 shutdown_connections 2024-04-25T02:17:59.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.831+0000 7f037fa69700 1 --2- 172.21.15.77:0/3899272567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0378102670 0x7f03780fb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:59.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.831+0000 7f037fa69700 1 --2- 172.21.15.77:0/3899272567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0378101cd0 0x7f03781020a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:59.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.831+0000 7f037fa69700 1 -- 172.21.15.77:0/3899272567 >> 172.21.15.77:0/3899272567 conn(0x7f0378071460 msgr2=0x7f0378071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:17:59.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.831+0000 7f037fa69700 1 -- 172.21.15.77:0/3899272567 shutdown_connections 2024-04-25T02:17:59.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.831+0000 7f037fa69700 1 -- 172.21.15.77:0/3899272567 wait complete. 2024-04-25T02:17:59.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.831+0000 7f037fa69700 1 Processor -- start 2024-04-25T02:17:59.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.831+0000 7f037fa69700 1 -- start start 2024-04-25T02:17:59.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.832+0000 7f037fa69700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0378101cd0 0x7f0378113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:59.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.832+0000 7f037fa69700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0378102670 0x7f03781140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:59.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.832+0000 7f037fa69700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0378114710 con 0x7f0378102670 2024-04-25T02:17:59.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.832+0000 7f037fa69700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037810db00 con 0x7f0378101cd0 2024-04-25T02:17:59.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.832+0000 7f037d004700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0378102670 0x7f03781140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:59.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.832+0000 7f037d004700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0378102670 0x7f03781140c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37364/0 (socket says 172.21.15.77:37364) 2024-04-25T02:17:59.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.832+0000 7f037d004700 1 -- 172.21.15.77:0/2104983786 learned_addr learned my addr 172.21.15.77:0/2104983786 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:17:59.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.832+0000 7f037d805700 1 --2- 172.21.15.77:0/2104983786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0378101cd0 0x7f0378113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:59.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.832+0000 7f037d004700 1 -- 172.21.15.77:0/2104983786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0378101cd0 msgr2=0x7f0378113b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:17:59.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.832+0000 7f037d004700 1 --2- 172.21.15.77:0/2104983786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0378101cd0 0x7f0378113b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:17:59.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.832+0000 7f037d004700 1 -- 172.21.15.77:0/2104983786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0374005040 con 0x7f0378102670 2024-04-25T02:17:59.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.832+0000 7f037d805700 1 --2- 172.21.15.77:0/2104983786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0378101cd0 0x7f0378113b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:17:59.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.832+0000 7f037d004700 1 --2- 172.21.15.77:0/2104983786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0378102670 0x7f03781140c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f036800c810 tx=0x7f03680043f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:59.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.833+0000 7f036e7fc700 1 -- 172.21.15.77:0/2104983786 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0368012810 con 0x7f0378102670 2024-04-25T02:17:59.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.833+0000 7f036e7fc700 1 -- 172.21.15.77:0/2104983786 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0368012e40 con 0x7f0378102670 2024-04-25T02:17:59.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.833+0000 7f036e7fc700 1 -- 172.21.15.77:0/2104983786 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f036800a550 con 0x7f0378102670 2024-04-25T02:17:59.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.833+0000 7f037fa69700 1 -- 172.21.15.77:0/2104983786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037810dde0 con 0x7f0378102670 2024-04-25T02:17:59.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.833+0000 7f037fa69700 1 -- 172.21.15.77:0/2104983786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037810e3a0 con 0x7f0378102670 2024-04-25T02:17:59.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.834+0000 7f037fa69700 1 -- 172.21.15.77:0/2104983786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0378065200 con 0x7f0378102670 2024-04-25T02:17:59.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.834+0000 7f036e7fc700 1 -- 172.21.15.77:0/2104983786 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0368012970 con 0x7f0378102670 2024-04-25T02:17:59.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.835+0000 7f036e7fc700 1 --2- 172.21.15.77:0/2104983786 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f036406e140 0x7f03640705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:17:59.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.835+0000 7f036e7fc700 1 -- 172.21.15.77:0/2104983786 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f036808dfb0 con 0x7f0378102670 2024-04-25T02:17:59.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.835+0000 7f037d805700 1 --2- 172.21.15.77:0/2104983786 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f036406e140 0x7f03640705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:17:59.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.835+0000 7f037d805700 1 --2- 172.21.15.77:0/2104983786 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f036406e140 0x7f03640705f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0374004560 tx=0x7f0374009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:17:59.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:17:59.840+0000 7f036e7fc700 1 -- 172.21.15.77:0/2104983786 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f03680c2740 con 0x7f0378102670 2024-04-25T02:17:59.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:59 smithi077 ceph-mon[110441]: mds.? [v2:172.21.15.77:6826/1829655283,v1:172.21.15.77:6827/1829655283] up:boot 2024-04-25T02:17:59.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:59 smithi077 ceph-mon[110441]: fsmap cephfs:1 {0=cephfs.smithi112.dvwudt=up:active} 3 up:standby 2024-04-25T02:17:59.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:59 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.oadrkb"}]: dispatch 2024-04-25T02:17:59.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:59 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:59.977 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:59 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:17:59.978 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:17:59 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:18:00.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:59 smithi112 ceph-mon[80494]: mds.? [v2:172.21.15.77:6826/1829655283,v1:172.21.15.77:6827/1829655283] up:boot 2024-04-25T02:18:00.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:59 smithi112 ceph-mon[80494]: fsmap cephfs:1 {0=cephfs.smithi112.dvwudt=up:active} 3 up:standby 2024-04-25T02:18:00.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:59 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.oadrkb"}]: dispatch 2024-04-25T02:18:00.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:59 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:00.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:59 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:00.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:17:59 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:18:00.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.067+0000 7f037fa69700 1 -- 172.21.15.77:0/2104983786 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0378105330 con 0x7f036406e140 2024-04-25T02:18:00.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.069+0000 7f036e7fc700 1 -- 172.21.15.77:0/2104983786 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0378105330 con 0x7f036406e140 2024-04-25T02:18:00.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.071+0000 7f037fa69700 1 -- 172.21.15.77:0/2104983786 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f036406e140 msgr2=0x7f03640705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:00.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.071+0000 7f037fa69700 1 --2- 172.21.15.77:0/2104983786 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f036406e140 0x7f03640705f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0374004560 tx=0x7f0374009e30 comp rx=0 tx=0).stop 2024-04-25T02:18:00.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.071+0000 7f037fa69700 1 -- 172.21.15.77:0/2104983786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0378102670 msgr2=0x7f03781140c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:00.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.071+0000 7f037fa69700 1 --2- 172.21.15.77:0/2104983786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0378102670 0x7f03781140c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f036800c810 tx=0x7f03680043f0 comp rx=0 tx=0).stop 2024-04-25T02:18:00.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.071+0000 7f037fa69700 1 -- 172.21.15.77:0/2104983786 shutdown_connections 2024-04-25T02:18:00.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.071+0000 7f037fa69700 1 --2- 172.21.15.77:0/2104983786 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f036406e140 0x7f03640705f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:00.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.071+0000 7f037fa69700 1 --2- 172.21.15.77:0/2104983786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0378101cd0 0x7f0378113b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:00.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.071+0000 7f037fa69700 1 --2- 172.21.15.77:0/2104983786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0378102670 0x7f03781140c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:00.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.071+0000 7f037fa69700 1 -- 172.21.15.77:0/2104983786 >> 172.21.15.77:0/2104983786 conn(0x7f0378071460 msgr2=0x7f03780fabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:00.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.072+0000 7f037fa69700 1 -- 172.21.15.77:0/2104983786 shutdown_connections 2024-04-25T02:18:00.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.072+0000 7f037fa69700 1 -- 172.21.15.77:0/2104983786 wait complete. 2024-04-25T02:18:00.088 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-04-25T02:18:00.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.202+0000 7f5a4eb27700 1 -- 172.21.15.77:0/771398509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a481026a0 msgr2=0x7f5a480fbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:00.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.202+0000 7f5a4eb27700 1 --2- 172.21.15.77:0/771398509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a481026a0 0x7f5a480fbd10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5a34004940 tx=0x7f5a34009e30 comp rx=0 tx=0).stop 2024-04-25T02:18:00.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.202+0000 7f5a4eb27700 1 -- 172.21.15.77:0/771398509 shutdown_connections 2024-04-25T02:18:00.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.202+0000 7f5a4eb27700 1 --2- 172.21.15.77:0/771398509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a481026a0 0x7f5a480fbd10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:00.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.202+0000 7f5a4eb27700 1 --2- 172.21.15.77:0/771398509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a48101d00 0x7f5a481020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:00.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.202+0000 7f5a4eb27700 1 -- 172.21.15.77:0/771398509 >> 172.21.15.77:0/771398509 conn(0x7f5a480f78d0 msgr2=0x7f5a480f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:00.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.202+0000 7f5a4eb27700 1 -- 172.21.15.77:0/771398509 shutdown_connections 2024-04-25T02:18:00.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.202+0000 7f5a4eb27700 1 -- 172.21.15.77:0/771398509 wait complete. 2024-04-25T02:18:00.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.203+0000 7f5a4eb27700 1 Processor -- start 2024-04-25T02:18:00.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.203+0000 7f5a4eb27700 1 -- start start 2024-04-25T02:18:00.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.203+0000 7f5a4eb27700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a48101d00 0x7f5a480fd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:00.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.203+0000 7f5a4eb27700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a481026a0 0x7f5a480fdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:00.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.203+0000 7f5a4eb27700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a480fe450 con 0x7f5a48101d00 2024-04-25T02:18:00.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.203+0000 7f5a4eb27700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a480fe590 con 0x7f5a481026a0 2024-04-25T02:18:00.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.203+0000 7f5a4c8c3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a48101d00 0x7f5a480fd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:00.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.203+0000 7f5a4c8c3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a48101d00 0x7f5a480fd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37388/0 (socket says 172.21.15.77:37388) 2024-04-25T02:18:00.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.203+0000 7f5a4c8c3700 1 -- 172.21.15.77:0/1287702943 learned_addr learned my addr 172.21.15.77:0/1287702943 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:18:00.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.204+0000 7f5a47fff700 1 --2- 172.21.15.77:0/1287702943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a481026a0 0x7f5a480fdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:00.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.204+0000 7f5a47fff700 1 -- 172.21.15.77:0/1287702943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a48101d00 msgr2=0x7f5a480fd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:00.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.204+0000 7f5a47fff700 1 --2- 172.21.15.77:0/1287702943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a48101d00 0x7f5a480fd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:00.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.204+0000 7f5a47fff700 1 -- 172.21.15.77:0/1287702943 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a34005040 con 0x7f5a481026a0 2024-04-25T02:18:00.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.204+0000 7f5a4c8c3700 1 --2- 172.21.15.77:0/1287702943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a48101d00 0x7f5a480fd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:00.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.204+0000 7f5a47fff700 1 --2- 172.21.15.77:0/1287702943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a481026a0 0x7f5a480fdec0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5a480672d0 tx=0x7f5a34009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:00.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.204+0000 7f5a457fa700 1 -- 172.21.15.77:0/1287702943 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a3400e040 con 0x7f5a481026a0 2024-04-25T02:18:00.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.204+0000 7f5a4eb27700 1 -- 172.21.15.77:0/1287702943 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a480fe7e0 con 0x7f5a481026a0 2024-04-25T02:18:00.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.204+0000 7f5a457fa700 1 -- 172.21.15.77:0/1287702943 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5a340093d0 con 0x7f5a481026a0 2024-04-25T02:18:00.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.205+0000 7f5a457fa700 1 -- 172.21.15.77:0/1287702943 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a34013e60 con 0x7f5a481026a0 2024-04-25T02:18:00.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.205+0000 7f5a4eb27700 1 -- 172.21.15.77:0/1287702943 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a4811a270 con 0x7f5a481026a0 2024-04-25T02:18:00.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.206+0000 7f5a4eb27700 1 -- 172.21.15.77:0/1287702943 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a480fd450 con 0x7f5a481026a0 2024-04-25T02:18:00.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.206+0000 7f5a457fa700 1 -- 172.21.15.77:0/1287702943 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5a3400baf0 con 0x7f5a481026a0 2024-04-25T02:18:00.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.207+0000 7f5a457fa700 1 --2- 172.21.15.77:0/1287702943 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5a3806e150 0x7f5a38070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:00.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.207+0000 7f5a457fa700 1 -- 172.21.15.77:0/1287702943 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f5a3408eba0 con 0x7f5a481026a0 2024-04-25T02:18:00.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.207+0000 7f5a4c8c3700 1 --2- 172.21.15.77:0/1287702943 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5a3806e150 0x7f5a38070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:00.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.207+0000 7f5a4c8c3700 1 --2- 172.21.15.77:0/1287702943 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5a3806e150 0x7f5a38070600 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c00e5e0 tx=0x7f5a3c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:00.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.212+0000 7f5a457fa700 1 -- 172.21.15.77:0/1287702943 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f5a34058090 con 0x7f5a481026a0 2024-04-25T02:18:00.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.443+0000 7f5a4eb27700 1 -- 172.21.15.77:0/1287702943 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a48108e80 con 0x7f5a3806e150 2024-04-25T02:18:00.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.445+0000 7f5a457fa700 1 -- 172.21.15.77:0/1287702943 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f5a3c00f040 con 0x7f5a3806e150 2024-04-25T02:18:00.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.447+0000 7f5a4eb27700 1 -- 172.21.15.77:0/1287702943 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5a3806e150 msgr2=0x7f5a38070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:00.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.447+0000 7f5a4eb27700 1 --2- 172.21.15.77:0/1287702943 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5a3806e150 0x7f5a38070600 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c00e5e0 tx=0x7f5a3c00b040 comp rx=0 tx=0).stop 2024-04-25T02:18:00.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.447+0000 7f5a4eb27700 1 -- 172.21.15.77:0/1287702943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a481026a0 msgr2=0x7f5a480fdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:00.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.447+0000 7f5a4eb27700 1 --2- 172.21.15.77:0/1287702943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a481026a0 0x7f5a480fdec0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5a480672d0 tx=0x7f5a34009e30 comp rx=0 tx=0).stop 2024-04-25T02:18:00.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.447+0000 7f5a4eb27700 1 -- 172.21.15.77:0/1287702943 shutdown_connections 2024-04-25T02:18:00.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.447+0000 7f5a4eb27700 1 --2- 172.21.15.77:0/1287702943 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5a3806e150 0x7f5a38070600 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:00.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.447+0000 7f5a4eb27700 1 --2- 172.21.15.77:0/1287702943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a48101d00 0x7f5a480fd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:00.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.447+0000 7f5a4eb27700 1 --2- 172.21.15.77:0/1287702943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a481026a0 0x7f5a480fdec0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:00.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.447+0000 7f5a4eb27700 1 -- 172.21.15.77:0/1287702943 >> 172.21.15.77:0/1287702943 conn(0x7f5a480f78d0 msgr2=0x7f5a480f8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:00.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.447+0000 7f5a4eb27700 1 -- 172.21.15.77:0/1287702943 shutdown_connections 2024-04-25T02:18:00.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.447+0000 7f5a4eb27700 1 -- 172.21.15.77:0/1287702943 wait complete. 2024-04-25T02:18:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.551+0000 7f2462a94700 1 -- 172.21.15.77:0/2101141089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f245c1026a0 msgr2=0x7f245c0fbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.551+0000 7f2462a94700 1 --2- 172.21.15.77:0/2101141089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f245c1026a0 0x7f245c0fbd10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f244c004940 tx=0x7f244c009e30 comp rx=0 tx=0).stop 2024-04-25T02:18:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.551+0000 7f2462a94700 1 -- 172.21.15.77:0/2101141089 shutdown_connections 2024-04-25T02:18:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.551+0000 7f2462a94700 1 --2- 172.21.15.77:0/2101141089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f245c1026a0 0x7f245c0fbd10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.551+0000 7f2462a94700 1 --2- 172.21.15.77:0/2101141089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245c101d00 0x7f245c1020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.551+0000 7f2462a94700 1 -- 172.21.15.77:0/2101141089 >> 172.21.15.77:0/2101141089 conn(0x7f245c0f78d0 msgr2=0x7f245c0f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.551+0000 7f2462a94700 1 -- 172.21.15.77:0/2101141089 shutdown_connections 2024-04-25T02:18:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.551+0000 7f2462a94700 1 -- 172.21.15.77:0/2101141089 wait complete. 2024-04-25T02:18:00.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.552+0000 7f2462a94700 1 Processor -- start 2024-04-25T02:18:00.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.552+0000 7f2462a94700 1 -- start start 2024-04-25T02:18:00.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.552+0000 7f2462a94700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245c101d00 0x7f245c10eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:00.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.552+0000 7f2462a94700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f245c1026a0 0x7f245c10f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:00.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.552+0000 7f2462a94700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c10f670 con 0x7f245c1026a0 2024-04-25T02:18:00.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.552+0000 7f2462a94700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c10f7b0 con 0x7f245c101d00 2024-04-25T02:18:00.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.552+0000 7f245bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f245c1026a0 0x7f245c10f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:00.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.552+0000 7f245bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f245c1026a0 0x7f245c10f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37404/0 (socket says 172.21.15.77:37404) 2024-04-25T02:18:00.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.552+0000 7f245bfff700 1 -- 172.21.15.77:0/1721047225 learned_addr learned my addr 172.21.15.77:0/1721047225 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:18:00.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.552+0000 7f2460830700 1 --2- 172.21.15.77:0/1721047225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245c101d00 0x7f245c10eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:00.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.552+0000 7f245bfff700 1 -- 172.21.15.77:0/1721047225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245c101d00 msgr2=0x7f245c10eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:00.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.552+0000 7f245bfff700 1 --2- 172.21.15.77:0/1721047225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245c101d00 0x7f245c10eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:00.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.552+0000 7f245bfff700 1 -- 172.21.15.77:0/1721047225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244c005040 con 0x7f245c1026a0 2024-04-25T02:18:00.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.553+0000 7f245bfff700 1 --2- 172.21.15.77:0/1721047225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f245c1026a0 0x7f245c10f020 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f244c000c00 tx=0x7f244c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:00.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.553+0000 7f24597fa700 1 -- 172.21.15.77:0/1721047225 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f244c021070 con 0x7f245c1026a0 2024-04-25T02:18:00.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.553+0000 7f24597fa700 1 -- 172.21.15.77:0/1721047225 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f244c013c00 con 0x7f245c1026a0 2024-04-25T02:18:00.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.553+0000 7f2462a94700 1 -- 172.21.15.77:0/1721047225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245c117b50 con 0x7f245c1026a0 2024-04-25T02:18:00.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.553+0000 7f24597fa700 1 -- 172.21.15.77:0/1721047225 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f244c00e070 con 0x7f245c1026a0 2024-04-25T02:18:00.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.553+0000 7f2462a94700 1 -- 172.21.15.77:0/1721047225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245c117f60 con 0x7f245c1026a0 2024-04-25T02:18:00.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.554+0000 7f2462a94700 1 -- 172.21.15.77:0/1721047225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f245c0fd450 con 0x7f245c1026a0 2024-04-25T02:18:00.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.555+0000 7f24597fa700 1 -- 172.21.15.77:0/1721047225 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f244c01ca60 con 0x7f245c1026a0 2024-04-25T02:18:00.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.555+0000 7f24597fa700 1 --2- 172.21.15.77:0/1721047225 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f244806e140 0x7f24480705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:00.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.556+0000 7f24597fa700 1 -- 172.21.15.77:0/1721047225 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f244c08ef10 con 0x7f245c1026a0 2024-04-25T02:18:00.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.556+0000 7f2460830700 1 --2- 172.21.15.77:0/1721047225 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f244806e140 0x7f24480705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:00.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.556+0000 7f2460830700 1 --2- 172.21.15.77:0/1721047225 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f244806e140 0x7f24480705f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2454001470 tx=0x7f245400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:00.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.560+0000 7f24597fa700 1 -- 172.21.15.77:0/1721047225 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f244c058360 con 0x7f245c1026a0 2024-04-25T02:18:00.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:00 smithi077 ceph-mon[110441]: pgmap v172: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:00.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.775+0000 7f2462a94700 1 -- 172.21.15.77:0/1721047225 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f245c108e50 con 0x7f244806e140 2024-04-25T02:18:00.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.785+0000 7f24597fa700 1 -- 172.21.15.77:0/1721047225 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f245c108e50 con 0x7f244806e140 2024-04-25T02:18:00.789 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T02:18:00.789 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (6m) 117s ago 17m 26.8M - 0.25.0 c8568f914cd2 699c7fd25ea5 2024-04-25T02:18:00.789 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (3m) 117s ago 17m 6660k - 19.0.0-2445-gd2c45d97 f68e37b807ef f3c45d31e2e3 2024-04-25T02:18:00.789 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi112 smithi112 running (3m) 16s ago 16m 6656k - 19.0.0-2445-gd2c45d97 f68e37b807ef e16d9899ed11 2024-04-25T02:18:00.789 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (5m) 117s ago 16m 80.8M - 9.4.12 2bacad6d85d8 900138b0bcf0 2024-04-25T02:18:00.789 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.gcfygj smithi077 running (11m) 117s ago 11m 16.0M - 17.2.7-902-gc61472c8 0de407c1b3af 382dd7abf674 2024-04-25T02:18:00.789 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.oadrkb smithi077 starting - - - - 2024-04-25T02:18:00.790 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.dvwudt smithi112 running (11m) 16s ago 11m 155M - 17.2.7-902-gc61472c8 0de407c1b3af 0792e451abfd 2024-04-25T02:18:00.790 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.fjnadi smithi112 running (11m) 16s ago 11m 16.0M - 17.2.7-902-gc61472c8 0de407c1b3af c8093f622f6b 2024-04-25T02:18:00.790 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.zpflzp smithi077 *:8443,9283,8765 running (7m) 117s ago 18m 504M - 19.0.0-2445-gd2c45d97 f68e37b807ef a1af92e027e5 2024-04-25T02:18:00.790 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi112.cswrxs smithi112 *:8443,9283,8765 running (7m) 16s ago 16m 451M - 19.0.0-2445-gd2c45d97 f68e37b807ef ccc7c57d35f2 2024-04-25T02:18:00.790 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (4m) 117s ago 18m 46.0M 2048M 19.0.0-2445-gd2c45d97 f68e37b807ef 06490c2ecc44 2024-04-25T02:18:00.790 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi112 smithi112 running (4m) 16s ago 16m 37.6M 2048M 19.0.0-2445-gd2c45d97 f68e37b807ef ccd1398acbc5 2024-04-25T02:18:00.790 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (6m) 117s ago 17m 17.0M - 1.5.0 0da6a335fe13 2320132606fc 2024-04-25T02:18:00.790 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi112 smithi112 *:9100 running (6m) 16s ago 16m 14.9M - 1.5.0 0da6a335fe13 49f285354791 2024-04-25T02:18:00.790 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (3m) 117s ago 15m 94.0M 1557M 19.0.0-2445-gd2c45d97 f68e37b807ef 7035e288ddae 2024-04-25T02:18:00.790 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (2m) 117s ago 14m 109M 1557M 19.0.0-2445-gd2c45d97 f68e37b807ef 6e514f700c36 2024-04-25T02:18:00.790 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (2m) 117s ago 14m 11.6M 1557M 19.0.0-2445-gd2c45d97 f68e37b807ef 392fd2036c16 2024-04-25T02:18:00.791 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi112 running (87s) 16s ago 14m 106M 2581M 19.0.0-2445-gd2c45d97 f68e37b807ef c100df1a0f60 2024-04-25T02:18:00.791 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi112 running (53s) 16s ago 13m 104M 2581M 19.0.0-2445-gd2c45d97 f68e37b807ef 669b1ab41e27 2024-04-25T02:18:00.791 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi112 running (20s) 16s ago 13m 12.0M 2581M 19.0.0-2445-gd2c45d97 f68e37b807ef cc8f3462943e 2024-04-25T02:18:00.791 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (6m) 117s ago 16m 59.4M - 2.43.0 a07b618ecd1d c5b8c6104d96 2024-04-25T02:18:00.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.787+0000 7f2462a94700 1 -- 172.21.15.77:0/1721047225 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f244806e140 msgr2=0x7f24480705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:00.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.787+0000 7f2462a94700 1 --2- 172.21.15.77:0/1721047225 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f244806e140 0x7f24480705f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2454001470 tx=0x7f245400b040 comp rx=0 tx=0).stop 2024-04-25T02:18:00.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.787+0000 7f2462a94700 1 -- 172.21.15.77:0/1721047225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f245c1026a0 msgr2=0x7f245c10f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:00.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.787+0000 7f2462a94700 1 --2- 172.21.15.77:0/1721047225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f245c1026a0 0x7f245c10f020 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f244c000c00 tx=0x7f244c009e30 comp rx=0 tx=0).stop 2024-04-25T02:18:00.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.787+0000 7f2462a94700 1 -- 172.21.15.77:0/1721047225 shutdown_connections 2024-04-25T02:18:00.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.787+0000 7f2462a94700 1 --2- 172.21.15.77:0/1721047225 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f244806e140 0x7f24480705f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:00.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.787+0000 7f2462a94700 1 --2- 172.21.15.77:0/1721047225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245c101d00 0x7f245c10eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:00.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.787+0000 7f2462a94700 1 --2- 172.21.15.77:0/1721047225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f245c1026a0 0x7f245c10f020 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:00.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.787+0000 7f2462a94700 1 -- 172.21.15.77:0/1721047225 >> 172.21.15.77:0/1721047225 conn(0x7f245c0f78d0 msgr2=0x7f245c0f88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:00.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.788+0000 7f2462a94700 1 -- 172.21.15.77:0/1721047225 shutdown_connections 2024-04-25T02:18:00.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.788+0000 7f2462a94700 1 -- 172.21.15.77:0/1721047225 wait complete. 2024-04-25T02:18:00.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.892+0000 7fb3b4c0b700 1 -- 172.21.15.77:0/3200992789 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3b0103780 msgr2=0x7fb3b00fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:00.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.892+0000 7fb3b4c0b700 1 --2- 172.21.15.77:0/3200992789 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3b0103780 0x7fb3b00fcdf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4004940 tx=0x7fb3a4009e30 comp rx=0 tx=0).stop 2024-04-25T02:18:00.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.892+0000 7fb3b4c0b700 1 -- 172.21.15.77:0/3200992789 shutdown_connections 2024-04-25T02:18:00.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.892+0000 7fb3b4c0b700 1 --2- 172.21.15.77:0/3200992789 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3b0103780 0x7fb3b00fcdf0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:00.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.892+0000 7fb3b4c0b700 1 --2- 172.21.15.77:0/3200992789 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3b0102de0 0x7fb3b01031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:00.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.892+0000 7fb3b4c0b700 1 -- 172.21.15.77:0/3200992789 >> 172.21.15.77:0/3200992789 conn(0x7fb3b00f8950 msgr2=0x7fb3b00fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:00.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.892+0000 7fb3b4c0b700 1 -- 172.21.15.77:0/3200992789 shutdown_connections 2024-04-25T02:18:00.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.892+0000 7fb3b4c0b700 1 -- 172.21.15.77:0/3200992789 wait complete. 2024-04-25T02:18:00.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.892+0000 7fb3b4c0b700 1 Processor -- start 2024-04-25T02:18:00.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.893+0000 7fb3b4c0b700 1 -- start start 2024-04-25T02:18:00.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.893+0000 7fb3b4c0b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3b0102de0 0x7fb3b006fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:00.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.893+0000 7fb3b4c0b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3b0103780 0x7fb3b0067a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:00.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.893+0000 7fb3b4c0b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b0067fe0 con 0x7fb3b0103780 2024-04-25T02:18:00.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.893+0000 7fb3b4c0b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b0068150 con 0x7fb3b0102de0 2024-04-25T02:18:00.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.893+0000 7fb3add9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3b0103780 0x7fb3b0067a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:00.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.893+0000 7fb3add9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3b0103780 0x7fb3b0067a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37426/0 (socket says 172.21.15.77:37426) 2024-04-25T02:18:00.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.893+0000 7fb3add9b700 1 -- 172.21.15.77:0/3551726916 learned_addr learned my addr 172.21.15.77:0/3551726916 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:18:00.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.893+0000 7fb3add9b700 1 -- 172.21.15.77:0/3551726916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3b0102de0 msgr2=0x7fb3b006fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:00.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.893+0000 7fb3ae59c700 1 --2- 172.21.15.77:0/3551726916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3b0102de0 0x7fb3b006fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:00.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.893+0000 7fb3add9b700 1 --2- 172.21.15.77:0/3551726916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3b0102de0 0x7fb3b006fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:00.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.893+0000 7fb3add9b700 1 -- 172.21.15.77:0/3551726916 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a4005040 con 0x7fb3b0103780 2024-04-25T02:18:00.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.893+0000 7fb3ae59c700 1 --2- 172.21.15.77:0/3551726916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3b0102de0 0x7fb3b006fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:18:00.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.893+0000 7fb3add9b700 1 --2- 172.21.15.77:0/3551726916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3b0103780 0x7fb3b0067a50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4000c00 tx=0x7fb3a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:00.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.894+0000 7fb39effd700 1 -- 172.21.15.77:0/3551726916 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3a4021070 con 0x7fb3b0103780 2024-04-25T02:18:00.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.894+0000 7fb39effd700 1 -- 172.21.15.77:0/3551726916 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb3a4013cd0 con 0x7fb3b0103780 2024-04-25T02:18:00.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.894+0000 7fb39effd700 1 -- 172.21.15.77:0/3551726916 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3a400e070 con 0x7fb3b0103780 2024-04-25T02:18:00.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.894+0000 7fb3b4c0b700 1 -- 172.21.15.77:0/3551726916 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b00683d0 con 0x7fb3b0103780 2024-04-25T02:18:00.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.894+0000 7fb3b4c0b700 1 -- 172.21.15.77:0/3551726916 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3b00688b0 con 0x7fb3b0103780 2024-04-25T02:18:00.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.895+0000 7fb3b4c0b700 1 -- 172.21.15.77:0/3551726916 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3b00fe530 con 0x7fb3b0103780 2024-04-25T02:18:00.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.896+0000 7fb39effd700 1 -- 172.21.15.77:0/3551726916 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb3a401caf0 con 0x7fb3b0103780 2024-04-25T02:18:00.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.897+0000 7fb39effd700 1 --2- 172.21.15.77:0/3551726916 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb39806e210 0x7fb3980706c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:00.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.897+0000 7fb39effd700 1 -- 172.21.15.77:0/3551726916 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb3a408eeb0 con 0x7fb3b0103780 2024-04-25T02:18:00.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.897+0000 7fb3ae59c700 1 --2- 172.21.15.77:0/3551726916 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb39806e210 0x7fb3980706c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:00.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.898+0000 7fb3ae59c700 1 --2- 172.21.15.77:0/3551726916 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb39806e210 0x7fb3980706c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0004600 tx=0x7fb3a000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:00.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:00.903+0000 7fb39effd700 1 -- 172.21.15.77:0/3551726916 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fb3a405be10 con 0x7fb3b0103780 2024-04-25T02:18:01.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:00 smithi112 ceph-mon[80494]: pgmap v172: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:01.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.203+0000 7fb3b4c0b700 1 -- 172.21.15.77:0/3551726916 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb3b005f5c0 con 0x7fb3b0103780 2024-04-25T02:18:01.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.204+0000 7fb39effd700 1 -- 172.21.15.77:0/3551726916 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7fb3a405b9a0 con 0x7fb3b0103780 2024-04-25T02:18:01.208 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:18:01.208 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-04-25T02:18:01.208 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:18:01.208 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:18:01.208 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-04-25T02:18:01.208 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:18:01.208 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:18:01.208 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-04-25T02:18:01.209 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 6 2024-04-25T02:18:01.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:18:01.209 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-04-25T02:18:01.209 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 3, 2024-04-25T02:18:01.209 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 1 2024-04-25T02:18:01.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:18:01.209 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-04-25T02:18:01.209 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 3, 2024-04-25T02:18:01.209 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 11 2024-04-25T02:18:01.209 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-25T02:18:01.209 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:18:01.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.206+0000 7fb3b4c0b700 1 -- 172.21.15.77:0/3551726916 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb39806e210 msgr2=0x7fb3980706c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:01.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.206+0000 7fb3b4c0b700 1 --2- 172.21.15.77:0/3551726916 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb39806e210 0x7fb3980706c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0004600 tx=0x7fb3a000b040 comp rx=0 tx=0).stop 2024-04-25T02:18:01.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.206+0000 7fb3b4c0b700 1 -- 172.21.15.77:0/3551726916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3b0103780 msgr2=0x7fb3b0067a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:01.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.206+0000 7fb3b4c0b700 1 --2- 172.21.15.77:0/3551726916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3b0103780 0x7fb3b0067a50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4000c00 tx=0x7fb3a4009e30 comp rx=0 tx=0).stop 2024-04-25T02:18:01.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.206+0000 7fb3b4c0b700 1 -- 172.21.15.77:0/3551726916 shutdown_connections 2024-04-25T02:18:01.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.206+0000 7fb3b4c0b700 1 --2- 172.21.15.77:0/3551726916 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb39806e210 0x7fb3980706c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:01.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.206+0000 7fb3b4c0b700 1 --2- 172.21.15.77:0/3551726916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3b0102de0 0x7fb3b006fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:01.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.206+0000 7fb3b4c0b700 1 --2- 172.21.15.77:0/3551726916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3b0103780 0x7fb3b0067a50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:01.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.206+0000 7fb3b4c0b700 1 -- 172.21.15.77:0/3551726916 >> 172.21.15.77:0/3551726916 conn(0x7fb3b00f8950 msgr2=0x7fb3b00f98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:01.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.207+0000 7fb3b4c0b700 1 -- 172.21.15.77:0/3551726916 shutdown_connections 2024-04-25T02:18:01.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.207+0000 7fb3b4c0b700 1 -- 172.21.15.77:0/3551726916 wait complete. 2024-04-25T02:18:01.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.309+0000 7f107ed7c700 1 -- 172.21.15.77:0/2083308476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1078102f30 msgr2=0x7f1078103300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:01.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.309+0000 7f107ed7c700 1 --2- 172.21.15.77:0/2083308476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1078102f30 0x7f1078103300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f106c004940 tx=0x7f106c009e30 comp rx=0 tx=0).stop 2024-04-25T02:18:01.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.309+0000 7f107ed7c700 1 -- 172.21.15.77:0/2083308476 shutdown_connections 2024-04-25T02:18:01.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.309+0000 7f107ed7c700 1 --2- 172.21.15.77:0/2083308476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10780fb3d0 0x7f10780fb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:01.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.309+0000 7f107ed7c700 1 --2- 172.21.15.77:0/2083308476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1078102f30 0x7f1078103300 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:01.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.309+0000 7f107ed7c700 1 -- 172.21.15.77:0/2083308476 >> 172.21.15.77:0/2083308476 conn(0x7f10780713f0 msgr2=0x7f10780717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:01.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.309+0000 7f107ed7c700 1 -- 172.21.15.77:0/2083308476 shutdown_connections 2024-04-25T02:18:01.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.309+0000 7f107ed7c700 1 -- 172.21.15.77:0/2083308476 wait complete. 2024-04-25T02:18:01.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.310+0000 7f107ed7c700 1 Processor -- start 2024-04-25T02:18:01.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.310+0000 7f107ed7c700 1 -- start start 2024-04-25T02:18:01.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.310+0000 7f107ed7c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10780fb3d0 0x7f10780fc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:01.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.310+0000 7f107ed7c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1078102f30 0x7f10780fcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:01.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.310+0000 7f107ed7c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10780fd080 con 0x7f10780fb3d0 2024-04-25T02:18:01.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.310+0000 7f107ed7c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10780fd1c0 con 0x7f1078102f30 2024-04-25T02:18:01.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.310+0000 7f107cb18700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10780fb3d0 0x7f10780fc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:01.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.310+0000 7f107cb18700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10780fb3d0 0x7f10780fc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37448/0 (socket says 172.21.15.77:37448) 2024-04-25T02:18:01.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.310+0000 7f107cb18700 1 -- 172.21.15.77:0/4236572248 learned_addr learned my addr 172.21.15.77:0/4236572248 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:18:01.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.311+0000 7f1077fff700 1 --2- 172.21.15.77:0/4236572248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1078102f30 0x7f10780fcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:01.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.311+0000 7f107cb18700 1 -- 172.21.15.77:0/4236572248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1078102f30 msgr2=0x7f10780fcaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:01.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.311+0000 7f107cb18700 1 --2- 172.21.15.77:0/4236572248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1078102f30 0x7f10780fcaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:01.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.311+0000 7f107cb18700 1 -- 172.21.15.77:0/4236572248 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c005040 con 0x7f10780fb3d0 2024-04-25T02:18:01.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.311+0000 7f1077fff700 1 --2- 172.21.15.77:0/4236572248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1078102f30 0x7f10780fcaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:18:01.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.311+0000 7f107cb18700 1 --2- 172.21.15.77:0/4236572248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10780fb3d0 0x7f10780fc5b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f106c00b3b0 tx=0x7f106c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:01.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.311+0000 7f10757fa700 1 -- 172.21.15.77:0/4236572248 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f106c00e040 con 0x7f10780fb3d0 2024-04-25T02:18:01.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.311+0000 7f107ed7c700 1 -- 172.21.15.77:0/4236572248 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10780fd410 con 0x7f10780fb3d0 2024-04-25T02:18:01.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.311+0000 7f10757fa700 1 -- 172.21.15.77:0/4236572248 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f106c00bbc0 con 0x7f10780fb3d0 2024-04-25T02:18:01.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.311+0000 7f10757fa700 1 -- 172.21.15.77:0/4236572248 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f106c01c630 con 0x7f10780fb3d0 2024-04-25T02:18:01.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.311+0000 7f107ed7c700 1 -- 172.21.15.77:0/4236572248 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f107811a200 con 0x7f10780fb3d0 2024-04-25T02:18:01.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.312+0000 7f107ed7c700 1 -- 172.21.15.77:0/4236572248 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1078100100 con 0x7f10780fb3d0 2024-04-25T02:18:01.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.312+0000 7f10757fa700 1 -- 172.21.15.77:0/4236572248 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f106c00bd30 con 0x7f10780fb3d0 2024-04-25T02:18:01.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.313+0000 7f10757fa700 1 --2- 172.21.15.77:0/4236572248 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f106806e140 0x7f10680705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:01.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.313+0000 7f10757fa700 1 -- 172.21.15.77:0/4236572248 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f106c08ed20 con 0x7f10780fb3d0 2024-04-25T02:18:01.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.313+0000 7f1077fff700 1 --2- 172.21.15.77:0/4236572248 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f106806e140 0x7f10680705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:01.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.313+0000 7f1077fff700 1 --2- 172.21.15.77:0/4236572248 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f106806e140 0x7f10680705f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1064007fd0 tx=0x7f1064009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:01.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.317+0000 7f10757fa700 1 -- 172.21.15.77:0/4236572248 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f106c058170 con 0x7f10780fb3d0 2024-04-25T02:18:01.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.565+0000 7f107ed7c700 1 -- 172.21.15.77:0/4236572248 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f107804bed0 con 0x7f10780fb3d0 2024-04-25T02:18:01.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.566+0000 7f10757fa700 1 -- 172.21.15.77:0/4236572248 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f106c05b830 con 0x7f10780fb3d0 2024-04-25T02:18:01.570 INFO:teuthology.orchestra.run.smithi077.stdout:e17 2024-04-25T02:18:01.570 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T02:18:01.570 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:18:01.570 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-04-25T02:18:01.570 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:18:01.570 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-04-25T02:18:01.570 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-04-25T02:18:01.570 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 15 2024-04-25T02:18:01.570 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-25T02:18:01.570 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-04-25T02:06:10.008979+0000 2024-04-25T02:18:01.570 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-04-25T02:06:27.849984+0000 2024-04-25T02:18:01.570 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-04-25T02:18:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-04-25T02:18:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-04-25T02:18:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-04-25T02:18:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-04-25T02:18:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:max_xattr_size 65536 2024-04-25T02:18:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-04-25T02:18:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-04-25T02:18:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 47 2024-04-25T02:18:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:18:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-04-25T02:18:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-04-25T02:18:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=24257} 2024-04-25T02:18:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-04-25T02:18:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-04-25T02:18:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-04-25T02:18:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-04-25T02:18:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-04-25T02:18:01.572 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-04-25T02:18:01.572 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-04-25T02:18:01.572 INFO:teuthology.orchestra.run.smithi077.stdout:bal_rank_mask -1 2024-04-25T02:18:01.572 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-04-25T02:18:01.572 INFO:teuthology.orchestra.run.smithi077.stdout:qdb_cluster leader: 0 members: 2024-04-25T02:18:01.572 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi112.dvwudt{0:24257} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.112:6824/3687767796,v1:172.21.15.112:6825/3687767796] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:18:01.572 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:18:01.572 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:18:01.572 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-04-25T02:18:01.572 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:18:01.572 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.gcfygj{-1:14462} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/691698671,v1:172.21.15.77:6829/691698671] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:18:01.572 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi112.fjnadi{-1:24269} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/2036319817,v1:172.21.15.112:6827/2036319817] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:18:01.572 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.oadrkb{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.77:6826/1829655283,v1:172.21.15.77:6827/1829655283] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T02:18:01.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.569+0000 7f107ed7c700 1 -- 172.21.15.77:0/4236572248 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f106806e140 msgr2=0x7f10680705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:01.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.569+0000 7f107ed7c700 1 --2- 172.21.15.77:0/4236572248 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f106806e140 0x7f10680705f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1064007fd0 tx=0x7f1064009040 comp rx=0 tx=0).stop 2024-04-25T02:18:01.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.569+0000 7f107ed7c700 1 -- 172.21.15.77:0/4236572248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10780fb3d0 msgr2=0x7f10780fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:01.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.569+0000 7f107ed7c700 1 --2- 172.21.15.77:0/4236572248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10780fb3d0 0x7f10780fc5b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f106c00b3b0 tx=0x7f106c009e30 comp rx=0 tx=0).stop 2024-04-25T02:18:01.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.569+0000 7f107ed7c700 1 -- 172.21.15.77:0/4236572248 shutdown_connections 2024-04-25T02:18:01.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.569+0000 7f107ed7c700 1 --2- 172.21.15.77:0/4236572248 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f106806e140 0x7f10680705f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:01.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.569+0000 7f107ed7c700 1 --2- 172.21.15.77:0/4236572248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10780fb3d0 0x7f10780fc5b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:01.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.569+0000 7f107ed7c700 1 --2- 172.21.15.77:0/4236572248 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1078102f30 0x7f10780fcaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:01.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.569+0000 7f107ed7c700 1 -- 172.21.15.77:0/4236572248 >> 172.21.15.77:0/4236572248 conn(0x7f10780713f0 msgr2=0x7f10780fa6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:01.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.569+0000 7f107ed7c700 1 -- 172.21.15.77:0/4236572248 shutdown_connections 2024-04-25T02:18:01.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.569+0000 7f107ed7c700 1 -- 172.21.15.77:0/4236572248 wait complete. 2024-04-25T02:18:01.574 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 17 2024-04-25T02:18:01.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.673+0000 7fc193091700 1 -- 172.21.15.77:0/1008133864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc18c0fbd40 msgr2=0x7fc18c0fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:01.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.673+0000 7fc193091700 1 --2- 172.21.15.77:0/1008133864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc18c0fbd40 0x7fc18c0fc1b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc178004940 tx=0x7fc178009e30 comp rx=0 tx=0).stop 2024-04-25T02:18:01.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.673+0000 7fc193091700 1 -- 172.21.15.77:0/1008133864 shutdown_connections 2024-04-25T02:18:01.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.673+0000 7fc193091700 1 --2- 172.21.15.77:0/1008133864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc18c0fbd40 0x7fc18c0fc1b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:01.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.673+0000 7fc193091700 1 --2- 172.21.15.77:0/1008133864 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc18c101d90 0x7fc18c102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:01.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.673+0000 7fc193091700 1 -- 172.21.15.77:0/1008133864 >> 172.21.15.77:0/1008133864 conn(0x7fc18c071d00 msgr2=0x7fc18c072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:01.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.673+0000 7fc193091700 1 -- 172.21.15.77:0/1008133864 shutdown_connections 2024-04-25T02:18:01.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.673+0000 7fc193091700 1 -- 172.21.15.77:0/1008133864 wait complete. 2024-04-25T02:18:01.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.674+0000 7fc193091700 1 Processor -- start 2024-04-25T02:18:01.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.674+0000 7fc193091700 1 -- start start 2024-04-25T02:18:01.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.674+0000 7fc193091700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc18c0fbd40 0x7fc18c113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:01.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.674+0000 7fc193091700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc18c101d90 0x7fc18c1140e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:01.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.674+0000 7fc193091700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c1147c0 con 0x7fc18c0fbd40 2024-04-25T02:18:01.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.674+0000 7fc193091700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c10db20 con 0x7fc18c101d90 2024-04-25T02:18:01.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.674+0000 7fc190e2d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc18c0fbd40 0x7fc18c113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:01.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.674+0000 7fc190e2d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc18c0fbd40 0x7fc18c113ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37478/0 (socket says 172.21.15.77:37478) 2024-04-25T02:18:01.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.674+0000 7fc190e2d700 1 -- 172.21.15.77:0/3462244364 learned_addr learned my addr 172.21.15.77:0/3462244364 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:18:01.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.674+0000 7fc18bfff700 1 --2- 172.21.15.77:0/3462244364 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc18c101d90 0x7fc18c1140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:01.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.675+0000 7fc190e2d700 1 -- 172.21.15.77:0/3462244364 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc18c101d90 msgr2=0x7fc18c1140e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:01.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.675+0000 7fc190e2d700 1 --2- 172.21.15.77:0/3462244364 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc18c101d90 0x7fc18c1140e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:01.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.675+0000 7fc190e2d700 1 -- 172.21.15.77:0/3462244364 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc178005040 con 0x7fc18c0fbd40 2024-04-25T02:18:01.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.675+0000 7fc18bfff700 1 --2- 172.21.15.77:0/3462244364 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc18c101d90 0x7fc18c1140e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:18:01.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.675+0000 7fc190e2d700 1 --2- 172.21.15.77:0/3462244364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc18c0fbd40 0x7fc18c113ba0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc18000b790 tx=0x7fc180009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:01.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.675+0000 7fc1897fa700 1 -- 172.21.15.77:0/3462244364 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc18000f770 con 0x7fc18c0fbd40 2024-04-25T02:18:01.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.675+0000 7fc193091700 1 -- 172.21.15.77:0/3462244364 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc18c10de00 con 0x7fc18c0fbd40 2024-04-25T02:18:01.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.675+0000 7fc1897fa700 1 -- 172.21.15.77:0/3462244364 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc18000fda0 con 0x7fc18c0fbd40 2024-04-25T02:18:01.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.675+0000 7fc1897fa700 1 -- 172.21.15.77:0/3462244364 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc18000d310 con 0x7fc18c0fbd40 2024-04-25T02:18:01.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.675+0000 7fc193091700 1 -- 172.21.15.77:0/3462244364 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc18c10e3c0 con 0x7fc18c0fbd40 2024-04-25T02:18:01.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.676+0000 7fc193091700 1 -- 172.21.15.77:0/3462244364 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc18c0fd430 con 0x7fc18c0fbd40 2024-04-25T02:18:01.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.676+0000 7fc1897fa700 1 -- 172.21.15.77:0/3462244364 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc180010420 con 0x7fc18c0fbd40 2024-04-25T02:18:01.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.677+0000 7fc1897fa700 1 --2- 172.21.15.77:0/3462244364 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc17c06e140 0x7fc17c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:01.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.677+0000 7fc1897fa700 1 -- 172.21.15.77:0/3462244364 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc18008db00 con 0x7fc18c0fbd40 2024-04-25T02:18:01.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.677+0000 7fc18bfff700 1 --2- 172.21.15.77:0/3462244364 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc17c06e140 0x7fc17c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:01.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.678+0000 7fc18bfff700 1 --2- 172.21.15.77:0/3462244364 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc17c06e140 0x7fc17c0705f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc178009fd0 tx=0x7fc178009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:01.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.684+0000 7fc1897fa700 1 -- 172.21.15.77:0/3462244364 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fc18005aa80 con 0x7fc18c0fbd40 2024-04-25T02:18:01.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:01 smithi077 ceph-mon[110441]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:18:01.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:01 smithi077 ceph-mon[110441]: from='client.44261 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:18:01.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:01 smithi077 ceph-mon[110441]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:18:01.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:01 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/3551726916' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:18:01.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:01 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/4236572248' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:18:01.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.923+0000 7fc193091700 1 -- 172.21.15.77:0/3462244364 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc18c108e70 con 0x7fc17c06e140 2024-04-25T02:18:01.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.924+0000 7fc1897fa700 1 -- 172.21.15.77:0/3462244364 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc18c108e70 con 0x7fc17c06e140 2024-04-25T02:18:01.928 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:18:01.928 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901", 2024-04-25T02:18:01.928 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-04-25T02:18:01.928 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T02:18:01.928 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-04-25T02:18:01.928 INFO:teuthology.orchestra.run.smithi077.stdout: "mon", 2024-04-25T02:18:01.928 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr", 2024-04-25T02:18:01.928 INFO:teuthology.orchestra.run.smithi077.stdout: "crash", 2024-04-25T02:18:01.928 INFO:teuthology.orchestra.run.smithi077.stdout: "osd" 2024-04-25T02:18:01.928 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-25T02:18:01.929 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "12/21 daemons upgraded", 2024-04-25T02:18:01.929 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading mds daemons", 2024-04-25T02:18:01.929 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-04-25T02:18:01.929 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:18:01.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.926+0000 7fc193091700 1 -- 172.21.15.77:0/3462244364 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc17c06e140 msgr2=0x7fc17c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:01.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.926+0000 7fc193091700 1 --2- 172.21.15.77:0/3462244364 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc17c06e140 0x7fc17c0705f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc178009fd0 tx=0x7fc178009e30 comp rx=0 tx=0).stop 2024-04-25T02:18:01.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.926+0000 7fc193091700 1 -- 172.21.15.77:0/3462244364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc18c0fbd40 msgr2=0x7fc18c113ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:01.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.926+0000 7fc193091700 1 --2- 172.21.15.77:0/3462244364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc18c0fbd40 0x7fc18c113ba0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc18000b790 tx=0x7fc180009250 comp rx=0 tx=0).stop 2024-04-25T02:18:01.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.926+0000 7fc193091700 1 -- 172.21.15.77:0/3462244364 shutdown_connections 2024-04-25T02:18:01.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.926+0000 7fc193091700 1 --2- 172.21.15.77:0/3462244364 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc17c06e140 0x7fc17c0705f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:01.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.926+0000 7fc193091700 1 --2- 172.21.15.77:0/3462244364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc18c0fbd40 0x7fc18c113ba0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:01.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.926+0000 7fc193091700 1 --2- 172.21.15.77:0/3462244364 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc18c101d90 0x7fc18c1140e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:01.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.926+0000 7fc193091700 1 -- 172.21.15.77:0/3462244364 >> 172.21.15.77:0/3462244364 conn(0x7fc18c071d00 msgr2=0x7fc18c065610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:01.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.926+0000 7fc193091700 1 -- 172.21.15.77:0/3462244364 shutdown_connections 2024-04-25T02:18:01.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:01.926+0000 7fc193091700 1 -- 172.21.15.77:0/3462244364 wait complete. 2024-04-25T02:18:02.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:01 smithi112 ceph-mon[80494]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:18:02.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:01 smithi112 ceph-mon[80494]: from='client.44261 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:18:02.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:01 smithi112 ceph-mon[80494]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:18:02.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:01 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/3551726916' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:18:02.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:01 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/4236572248' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:18:02.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.034+0000 7f63a78d0700 1 -- 172.21.15.77:0/2720227845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63a0065640 msgr2=0x7f63a0065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:02.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.034+0000 7f63a78d0700 1 --2- 172.21.15.77:0/2720227845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63a0065640 0x7f63a0065ab0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6390004940 tx=0x7f6390009e30 comp rx=0 tx=0).stop 2024-04-25T02:18:02.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.034+0000 7f63a78d0700 1 -- 172.21.15.77:0/2720227845 shutdown_connections 2024-04-25T02:18:02.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.034+0000 7f63a78d0700 1 --2- 172.21.15.77:0/2720227845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63a0065640 0x7f63a0065ab0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:02.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.034+0000 7f63a78d0700 1 --2- 172.21.15.77:0/2720227845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63a0102e50 0x7f63a0103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:02.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.034+0000 7f63a78d0700 1 -- 172.21.15.77:0/2720227845 >> 172.21.15.77:0/2720227845 conn(0x7f63a0071d00 msgr2=0x7f63a0072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:02.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.035+0000 7f63a78d0700 1 -- 172.21.15.77:0/2720227845 shutdown_connections 2024-04-25T02:18:02.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.035+0000 7f63a78d0700 1 -- 172.21.15.77:0/2720227845 wait complete. 2024-04-25T02:18:02.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.035+0000 7f63a78d0700 1 Processor -- start 2024-04-25T02:18:02.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.035+0000 7f63a78d0700 1 -- start start 2024-04-25T02:18:02.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.035+0000 7f63a78d0700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63a0065640 0x7f63a0113ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.035+0000 7f63a78d0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63a0102e50 0x7f63a0114010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.035+0000 7f63a78d0700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a0114660 con 0x7f63a0065640 2024-04-25T02:18:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.035+0000 7f63a78d0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a010da50 con 0x7f63a0102e50 2024-04-25T02:18:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.035+0000 7f63a566c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63a0065640 0x7f63a0113ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.035+0000 7f63a566c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63a0065640 0x7f63a0113ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37496/0 (socket says 172.21.15.77:37496) 2024-04-25T02:18:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.035+0000 7f63a566c700 1 -- 172.21.15.77:0/4243188580 learned_addr learned my addr 172.21.15.77:0/4243188580 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:18:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.035+0000 7f63a4e6b700 1 --2- 172.21.15.77:0/4243188580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63a0102e50 0x7f63a0114010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.036+0000 7f63a566c700 1 -- 172.21.15.77:0/4243188580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63a0102e50 msgr2=0x7f63a0114010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.036+0000 7f63a566c700 1 --2- 172.21.15.77:0/4243188580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63a0102e50 0x7f63a0114010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.036+0000 7f63a566c700 1 -- 172.21.15.77:0/4243188580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6390005040 con 0x7f63a0065640 2024-04-25T02:18:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.036+0000 7f63a566c700 1 --2- 172.21.15.77:0/4243188580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63a0065640 0x7f63a0113ad0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f639c00eb40 tx=0x7f639c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.036+0000 7f6395ffb700 1 -- 172.21.15.77:0/4243188580 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f639c007cc0 con 0x7f63a0065640 2024-04-25T02:18:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.036+0000 7f63a78d0700 1 -- 172.21.15.77:0/4243188580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a010dcd0 con 0x7f63a0065640 2024-04-25T02:18:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.036+0000 7f6395ffb700 1 -- 172.21.15.77:0/4243188580 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f639c00f040 con 0x7f63a0065640 2024-04-25T02:18:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.036+0000 7f6395ffb700 1 -- 172.21.15.77:0/4243188580 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f639c00ca10 con 0x7f63a0065640 2024-04-25T02:18:02.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.036+0000 7f63a78d0700 1 -- 172.21.15.77:0/4243188580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a010e1e0 con 0x7f63a0065640 2024-04-25T02:18:02.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.037+0000 7f63a78d0700 1 -- 172.21.15.77:0/4243188580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a0100100 con 0x7f63a0065640 2024-04-25T02:18:02.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.038+0000 7f6395ffb700 1 -- 172.21.15.77:0/4243188580 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f639c00cb70 con 0x7f63a0065640 2024-04-25T02:18:02.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.038+0000 7f6395ffb700 1 --2- 172.21.15.77:0/4243188580 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f638c06e140 0x7f638c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:02.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.038+0000 7f6395ffb700 1 -- 172.21.15.77:0/4243188580 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f639c08d610 con 0x7f63a0065640 2024-04-25T02:18:02.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.038+0000 7f63a4e6b700 1 --2- 172.21.15.77:0/4243188580 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f638c06e140 0x7f638c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:02.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.039+0000 7f63a4e6b700 1 --2- 172.21.15.77:0/4243188580 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f638c06e140 0x7f638c0705f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6390009b30 tx=0x7f6390009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:02.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.043+0000 7f6395ffb700 1 -- 172.21.15.77:0/4243188580 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f639c05a640 con 0x7f63a0065640 2024-04-25T02:18:02.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.338+0000 7f63a78d0700 1 -- 172.21.15.77:0/4243188580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f63a010f120 con 0x7f63a0065640 2024-04-25T02:18:02.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.339+0000 7f6395ffb700 1 -- 172.21.15.77:0/4243188580 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f639c05a1d0 con 0x7f63a0065640 2024-04-25T02:18:02.343 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-04-25T02:18:02.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.341+0000 7f63a78d0700 1 -- 172.21.15.77:0/4243188580 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f638c06e140 msgr2=0x7f638c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:02.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.341+0000 7f63a78d0700 1 --2- 172.21.15.77:0/4243188580 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f638c06e140 0x7f638c0705f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6390009b30 tx=0x7f6390009e30 comp rx=0 tx=0).stop 2024-04-25T02:18:02.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.341+0000 7f63a78d0700 1 -- 172.21.15.77:0/4243188580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63a0065640 msgr2=0x7f63a0113ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:02.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.341+0000 7f63a78d0700 1 --2- 172.21.15.77:0/4243188580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63a0065640 0x7f63a0113ad0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f639c00eb40 tx=0x7f639c00b040 comp rx=0 tx=0).stop 2024-04-25T02:18:02.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.341+0000 7f63a78d0700 1 -- 172.21.15.77:0/4243188580 shutdown_connections 2024-04-25T02:18:02.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.341+0000 7f63a78d0700 1 --2- 172.21.15.77:0/4243188580 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f638c06e140 0x7f638c0705f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:02.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.341+0000 7f63a78d0700 1 --2- 172.21.15.77:0/4243188580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63a0065640 0x7f63a0113ad0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:02.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.341+0000 7f63a78d0700 1 --2- 172.21.15.77:0/4243188580 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f63a0102e50 0x7f63a0114010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:02.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.341+0000 7f63a78d0700 1 -- 172.21.15.77:0/4243188580 >> 172.21.15.77:0/4243188580 conn(0x7f63a0071d00 msgr2=0x7f63a00fae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:02.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.341+0000 7f63a78d0700 1 -- 172.21.15.77:0/4243188580 shutdown_connections 2024-04-25T02:18:02.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:02.341+0000 7f63a78d0700 1 -- 172.21.15.77:0/4243188580 wait complete. 2024-04-25T02:18:02.976 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:02 smithi077 ceph-mon[110441]: pgmap v173: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:02.976 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:02 smithi077 ceph-mon[110441]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:18:02.976 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:02 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/4243188580' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T02:18:03.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:02 smithi112 ceph-mon[80494]: pgmap v173: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:03.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:02 smithi112 ceph-mon[80494]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:18:03.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:02 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/4243188580' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T02:18:05.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:04 smithi077 ceph-mon[110441]: pgmap v174: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:05.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:04 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:05.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:04 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:05.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:04 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:05.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:04 smithi112 ceph-mon[80494]: pgmap v174: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:05.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:04 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:05.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:04 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:05.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:04 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:06.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:06 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:06.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:06 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:06.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:06 smithi077 ceph-mon[110441]: pgmap v175: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:06.527 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:06 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:06.527 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:06 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:06.527 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:06 smithi112 ceph-mon[80494]: pgmap v175: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:09.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:08 smithi077 ceph-mon[110441]: pgmap v176: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:09.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:09.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:09.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:18:09.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:09.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:18:09.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:18:09.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:09.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:08 smithi112 ceph-mon[80494]: pgmap v176: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:09.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:09.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:09.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:18:09.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:09.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:18:09.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:18:09.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:10.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:09 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:18:10.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:09 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:18:10.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:09 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:18:10.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:09 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:18:10.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:09 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:18:10.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:09 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:18:10.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:09 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:18:10.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:09 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:18:10.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:09 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:18:10.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:09 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:18:11.192 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:10 smithi077 ceph-mon[110441]: pgmap v177: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:11.192 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:10 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:11.192 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:10 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.gcfygj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:18:11.192 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:10 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:18:11.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:10 smithi112 ceph-mon[80494]: pgmap v177: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:11.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:10 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:11.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:10 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.gcfygj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:18:11.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:10 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:18:12.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:11 smithi077 ceph-mon[110441]: Upgrade: Updating mds.cephfs.smithi077.gcfygj 2024-04-25T02:18:12.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:11 smithi077 ceph-mon[110441]: Deploying daemon mds.cephfs.smithi077.gcfygj on smithi077 2024-04-25T02:18:12.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:11 smithi112 ceph-mon[80494]: Upgrade: Updating mds.cephfs.smithi077.gcfygj 2024-04-25T02:18:12.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:11 smithi112 ceph-mon[80494]: Deploying daemon mds.cephfs.smithi077.gcfygj on smithi077 2024-04-25T02:18:13.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:12 smithi077 ceph-mon[110441]: pgmap v178: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:13.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:12 smithi112 ceph-mon[80494]: pgmap v178: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:14.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:13 smithi077 ceph-mon[110441]: osdmap e82: 6 total, 6 up, 6 in 2024-04-25T02:18:14.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:13 smithi077 ceph-mon[110441]: fsmap cephfs:1 {0=cephfs.smithi112.dvwudt=up:active} 2 up:standby 2024-04-25T02:18:14.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:13 smithi112 ceph-mon[80494]: osdmap e82: 6 total, 6 up, 6 in 2024-04-25T02:18:14.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:13 smithi112 ceph-mon[80494]: fsmap cephfs:1 {0=cephfs.smithi112.dvwudt=up:active} 2 up:standby 2024-04-25T02:18:15.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:14 smithi077 ceph-mon[110441]: pgmap v180: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:15.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:14 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.gcfygj"}]: dispatch 2024-04-25T02:18:15.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:14 smithi112 ceph-mon[80494]: pgmap v180: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:15.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:14 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.gcfygj"}]: dispatch 2024-04-25T02:18:17.067 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:16 smithi077 ceph-mon[110441]: pgmap v181: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:17.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:16 smithi112 ceph-mon[80494]: pgmap v181: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:19.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:18 smithi077 ceph-mon[110441]: pgmap v182: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:19.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:18 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:19.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:18 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:19.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:18 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:18:19.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:18 smithi112 ceph-mon[80494]: pgmap v182: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:19.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:18 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:19.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:18 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:19.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:18 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:18:20.078 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:19 smithi077 ceph-mon[110441]: mds.? [v2:172.21.15.77:6828/702451557,v1:172.21.15.77:6829/702451557] up:boot 2024-04-25T02:18:20.078 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:19 smithi077 ceph-mon[110441]: fsmap cephfs:1 {0=cephfs.smithi112.dvwudt=up:active} 3 up:standby 2024-04-25T02:18:20.079 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:19 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.gcfygj"}]: dispatch 2024-04-25T02:18:20.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:19 smithi112 ceph-mon[80494]: mds.? [v2:172.21.15.77:6828/702451557,v1:172.21.15.77:6829/702451557] up:boot 2024-04-25T02:18:20.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:19 smithi112 ceph-mon[80494]: fsmap cephfs:1 {0=cephfs.smithi112.dvwudt=up:active} 3 up:standby 2024-04-25T02:18:20.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:19 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.gcfygj"}]: dispatch 2024-04-25T02:18:21.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:20 smithi077 ceph-mon[110441]: pgmap v183: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:21.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:20 smithi112 ceph-mon[80494]: pgmap v183: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:23.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:22 smithi077 ceph-mon[110441]: pgmap v184: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:23.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:22 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:23.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:22 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:23.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:22 smithi112 ceph-mon[80494]: pgmap v184: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:23.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:22 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:23.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:22 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:24.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:23 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:18:24.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:23 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:18:25.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:24 smithi077 ceph-mon[110441]: pgmap v185: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:25.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:24 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:25.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:24 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:25.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:24 smithi112 ceph-mon[80494]: pgmap v185: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:25.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:24 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:25.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:24 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:27.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:26 smithi077 ceph-mon[110441]: pgmap v186: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:27.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:26 smithi112 ceph-mon[80494]: pgmap v186: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:28.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:28 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:28.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:28 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:28.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:28 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:18:28.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:28 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:18:28.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:28 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:28.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:28 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:18:28.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:28 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:18:28.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:28 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:18:28.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:28 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:18:28.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:28 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:18:28.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:28 smithi077 ceph-mon[110441]: pgmap v187: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:28.744 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:28 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:28.744 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:28 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:28.744 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:28 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:18:28.745 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:28 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:18:28.745 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:28 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:28.745 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:28 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:18:28.745 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:28 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:18:28.745 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:28 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:18:28.745 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:28 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:18:28.745 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:28 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:18:28.745 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:28 smithi112 ceph-mon[80494]: pgmap v187: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:30.343 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:30 smithi112 ceph-mon[80494]: Upgrade: Updating mds.cephfs.smithi112.dvwudt 2024-04-25T02:18:30.343 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:30 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:30.343 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:30 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.dvwudt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:18:30.343 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:30 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:18:30.343 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:30 smithi112 ceph-mon[80494]: Deploying daemon mds.cephfs.smithi112.dvwudt on smithi112 2024-04-25T02:18:30.343 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:30 smithi112 ceph-mon[80494]: pgmap v188: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:30.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:30 smithi077 ceph-mon[110441]: Upgrade: Updating mds.cephfs.smithi112.dvwudt 2024-04-25T02:18:30.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:30 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:30.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:30 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.dvwudt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:18:30.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:30 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:18:30.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:30 smithi077 ceph-mon[110441]: Deploying daemon mds.cephfs.smithi112.dvwudt on smithi112 2024-04-25T02:18:30.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:30 smithi077 ceph-mon[110441]: pgmap v188: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:31.527 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:18:31 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3[89576]: 2024-04-25T02:18:31.276+0000 7fe7b2c9c700 -1 bdev(0x5582473da000 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-04-25T02:18:31.527 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:18:31 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3[89576]: 2024-04-25T02:18:31.277+0000 7fe7b4ca0700 -1 bdev(0x5582473da000 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 4 2024-04-25T02:18:31.527 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:31 smithi112 ceph-mon[80494]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-25T02:18:31.527 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:31 smithi112 ceph-mon[80494]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:18:31.527 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:31 smithi112 ceph-mon[80494]: osdmap e83: 6 total, 6 up, 6 in 2024-04-25T02:18:31.527 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:31 smithi112 ceph-mon[80494]: Standby daemon mds.cephfs.smithi112.fjnadi assigned to filesystem cephfs as rank 0 2024-04-25T02:18:31.527 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:31 smithi112 ceph-mon[80494]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-25T02:18:31.527 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:31 smithi112 ceph-mon[80494]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-25T02:18:31.528 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:31 smithi112 ceph-mon[80494]: fsmap cephfs:1/1 {0=cephfs.smithi112.fjnadi=up:replay} 2 up:standby 2024-04-25T02:18:31.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:31 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi077[110436]: 2024-04-25T02:18:31.253+0000 7f54c798e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:18:31.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:31 smithi077 ceph-mon[110441]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-25T02:18:31.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:31 smithi077 ceph-mon[110441]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:18:31.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:31 smithi077 ceph-mon[110441]: osdmap e83: 6 total, 6 up, 6 in 2024-04-25T02:18:31.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:31 smithi077 ceph-mon[110441]: Standby daemon mds.cephfs.smithi112.fjnadi assigned to filesystem cephfs as rank 0 2024-04-25T02:18:31.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:31 smithi077 ceph-mon[110441]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-25T02:18:31.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:31 smithi077 ceph-mon[110441]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-25T02:18:31.728 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:31 smithi077 ceph-mon[110441]: fsmap cephfs:1/1 {0=cephfs.smithi112.fjnadi=up:replay} 2 up:standby 2024-04-25T02:18:32.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.456+0000 7f8174814700 1 -- 172.21.15.77:0/2458392561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8170101ce0 msgr2=0x7f81701020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:32.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.456+0000 7f8174814700 1 --2- 172.21.15.77:0/2458392561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8170101ce0 0x7f81701020b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8160004940 tx=0x7f8160009e30 comp rx=0 tx=0).stop 2024-04-25T02:18:32.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.456+0000 7f8174814700 1 -- 172.21.15.77:0/2458392561 shutdown_connections 2024-04-25T02:18:32.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.456+0000 7f8174814700 1 --2- 172.21.15.77:0/2458392561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8170102680 0x7f81700fbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:32.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.456+0000 7f8174814700 1 --2- 172.21.15.77:0/2458392561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8170101ce0 0x7f81701020b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:32.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.456+0000 7f8174814700 1 -- 172.21.15.77:0/2458392561 >> 172.21.15.77:0/2458392561 conn(0x7f81700f7850 msgr2=0x7f81700f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:32.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.456+0000 7f8174814700 1 -- 172.21.15.77:0/2458392561 shutdown_connections 2024-04-25T02:18:32.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.456+0000 7f8174814700 1 -- 172.21.15.77:0/2458392561 wait complete. 2024-04-25T02:18:32.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.457+0000 7f8174814700 1 Processor -- start 2024-04-25T02:18:32.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.457+0000 7f8174814700 1 -- start start 2024-04-25T02:18:32.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.457+0000 7f8174814700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8170101ce0 0x7f817010eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:32.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.457+0000 7f8174814700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8170102680 0x7f817010eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:32.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.457+0000 7f8174814700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817010f640 con 0x7f8170102680 2024-04-25T02:18:32.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.457+0000 7f8174814700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817010f780 con 0x7f8170101ce0 2024-04-25T02:18:32.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.457+0000 7f816dd9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8170102680 0x7f817010eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:32.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.457+0000 7f816e59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8170101ce0 0x7f817010eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:32.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.457+0000 7f816dd9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8170102680 0x7f817010eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54694/0 (socket says 172.21.15.77:54694) 2024-04-25T02:18:32.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.457+0000 7f816dd9b700 1 -- 172.21.15.77:0/2295690113 learned_addr learned my addr 172.21.15.77:0/2295690113 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:18:32.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.457+0000 7f816dd9b700 1 -- 172.21.15.77:0/2295690113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8170101ce0 msgr2=0x7f817010eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:32.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.457+0000 7f816dd9b700 1 --2- 172.21.15.77:0/2295690113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8170101ce0 0x7f817010eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:32.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.457+0000 7f816dd9b700 1 -- 172.21.15.77:0/2295690113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8160005040 con 0x7f8170102680 2024-04-25T02:18:32.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.457+0000 7f816dd9b700 1 --2- 172.21.15.77:0/2295690113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8170102680 0x7f817010eff0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f816400eb40 tx=0x7f816400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:32.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.458+0000 7f815effd700 1 -- 172.21.15.77:0/2295690113 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8164007cc0 con 0x7f8170102680 2024-04-25T02:18:32.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.458+0000 7f8174814700 1 -- 172.21.15.77:0/2295690113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8170117b20 con 0x7f8170102680 2024-04-25T02:18:32.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.458+0000 7f815effd700 1 -- 172.21.15.77:0/2295690113 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f816400f040 con 0x7f8170102680 2024-04-25T02:18:32.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.458+0000 7f815effd700 1 -- 172.21.15.77:0/2295690113 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f816400c9d0 con 0x7f8170102680 2024-04-25T02:18:32.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.458+0000 7f8174814700 1 -- 172.21.15.77:0/2295690113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8170117fb0 con 0x7f8170102680 2024-04-25T02:18:32.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.459+0000 7f8174814700 1 -- 172.21.15.77:0/2295690113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81700fd430 con 0x7f8170102680 2024-04-25T02:18:32.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.459+0000 7f815effd700 1 -- 172.21.15.77:0/2295690113 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f816400cc40 con 0x7f8170102680 2024-04-25T02:18:32.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.460+0000 7f815effd700 1 --2- 172.21.15.77:0/2295690113 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f815806e140 0x7f81580705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:32.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.460+0000 7f815effd700 1 -- 172.21.15.77:0/2295690113 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f816408d570 con 0x7f8170102680 2024-04-25T02:18:32.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.460+0000 7f816e59c700 1 --2- 172.21.15.77:0/2295690113 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f815806e140 0x7f81580705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:32.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.460+0000 7f816e59c700 1 --2- 172.21.15.77:0/2295690113 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f815806e140 0x7f81580705f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8160009b30 tx=0x7f8160009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:32.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.465+0000 7f815effd700 1 -- 172.21.15.77:0/2295690113 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f81640569a0 con 0x7f8170102680 2024-04-25T02:18:32.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.682+0000 7f8174814700 1 -- 172.21.15.77:0/2295690113 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f817004bed0 con 0x7f815806e140 2024-04-25T02:18:32.686 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:32 smithi077 ceph-mon[110441]: pgmap v190: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:32.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.683+0000 7f815effd700 1 -- 172.21.15.77:0/2295690113 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f817004bed0 con 0x7f815806e140 2024-04-25T02:18:32.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.685+0000 7f8174814700 1 -- 172.21.15.77:0/2295690113 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f815806e140 msgr2=0x7f81580705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:32.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.685+0000 7f8174814700 1 --2- 172.21.15.77:0/2295690113 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f815806e140 0x7f81580705f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8160009b30 tx=0x7f8160009e30 comp rx=0 tx=0).stop 2024-04-25T02:18:32.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.685+0000 7f8174814700 1 -- 172.21.15.77:0/2295690113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8170102680 msgr2=0x7f817010eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:32.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.685+0000 7f8174814700 1 --2- 172.21.15.77:0/2295690113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8170102680 0x7f817010eff0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f816400eb40 tx=0x7f816400b040 comp rx=0 tx=0).stop 2024-04-25T02:18:32.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.686+0000 7f8174814700 1 -- 172.21.15.77:0/2295690113 shutdown_connections 2024-04-25T02:18:32.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.686+0000 7f8174814700 1 --2- 172.21.15.77:0/2295690113 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f815806e140 0x7f81580705f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:32.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.686+0000 7f8174814700 1 --2- 172.21.15.77:0/2295690113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8170101ce0 0x7f817010eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:32.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.686+0000 7f8174814700 1 --2- 172.21.15.77:0/2295690113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8170102680 0x7f817010eff0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:32.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.686+0000 7f8174814700 1 -- 172.21.15.77:0/2295690113 >> 172.21.15.77:0/2295690113 conn(0x7f81700f7850 msgr2=0x7f81700f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:32.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.686+0000 7f8174814700 1 -- 172.21.15.77:0/2295690113 shutdown_connections 2024-04-25T02:18:32.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.686+0000 7f8174814700 1 -- 172.21.15.77:0/2295690113 wait complete. 2024-04-25T02:18:32.700 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-04-25T02:18:32.777 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:32 smithi112 ceph-mon[80494]: pgmap v190: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:18:32.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.787+0000 7f40ae1be700 1 -- 172.21.15.77:0/1395967941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a8102de0 msgr2=0x7f40a81031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:32.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.787+0000 7f40ae1be700 1 --2- 172.21.15.77:0/1395967941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a8102de0 0x7f40a81031b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4098004940 tx=0x7f4098009e30 comp rx=0 tx=0).stop 2024-04-25T02:18:32.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.787+0000 7f40ae1be700 1 -- 172.21.15.77:0/1395967941 shutdown_connections 2024-04-25T02:18:32.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.787+0000 7f40ae1be700 1 --2- 172.21.15.77:0/1395967941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40a8103780 0x7f40a80fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:32.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.787+0000 7f40ae1be700 1 --2- 172.21.15.77:0/1395967941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a8102de0 0x7f40a81031b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:32.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.787+0000 7f40ae1be700 1 -- 172.21.15.77:0/1395967941 >> 172.21.15.77:0/1395967941 conn(0x7f40a80f8990 msgr2=0x7f40a80fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:32.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.787+0000 7f40ae1be700 1 -- 172.21.15.77:0/1395967941 shutdown_connections 2024-04-25T02:18:32.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.787+0000 7f40ae1be700 1 -- 172.21.15.77:0/1395967941 wait complete. 2024-04-25T02:18:32.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.788+0000 7f40ae1be700 1 Processor -- start 2024-04-25T02:18:32.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.788+0000 7f40ae1be700 1 -- start start 2024-04-25T02:18:32.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.788+0000 7f40ae1be700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a8102de0 0x7f40a81138b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:32.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.788+0000 7f40ae1be700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40a8103780 0x7f40a8113df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:32.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.788+0000 7f40ae1be700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a8114440 con 0x7f40a8102de0 2024-04-25T02:18:32.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.788+0000 7f40ae1be700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a810da90 con 0x7f40a8103780 2024-04-25T02:18:32.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.788+0000 7f40a77fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a8102de0 0x7f40a81138b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:32.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.788+0000 7f40a77fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a8102de0 0x7f40a81138b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54702/0 (socket says 172.21.15.77:54702) 2024-04-25T02:18:32.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.788+0000 7f40a77fe700 1 -- 172.21.15.77:0/4260140944 learned_addr learned my addr 172.21.15.77:0/4260140944 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:18:32.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.789+0000 7f40a6ffd700 1 --2- 172.21.15.77:0/4260140944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40a8103780 0x7f40a8113df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:32.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.789+0000 7f40a77fe700 1 -- 172.21.15.77:0/4260140944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40a8103780 msgr2=0x7f40a8113df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:32.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.789+0000 7f40a77fe700 1 --2- 172.21.15.77:0/4260140944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40a8103780 0x7f40a8113df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:32.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.789+0000 7f40a77fe700 1 -- 172.21.15.77:0/4260140944 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4098005040 con 0x7f40a8102de0 2024-04-25T02:18:32.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.789+0000 7f40a77fe700 1 --2- 172.21.15.77:0/4260140944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a8102de0 0x7f40a81138b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4098009150 tx=0x7f4098009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:32.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.789+0000 7f408ffff700 1 -- 172.21.15.77:0/4260140944 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4098021070 con 0x7f40a8102de0 2024-04-25T02:18:32.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.789+0000 7f408ffff700 1 -- 172.21.15.77:0/4260140944 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4098013c00 con 0x7f40a8102de0 2024-04-25T02:18:32.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.789+0000 7f40ae1be700 1 -- 172.21.15.77:0/4260140944 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a810dd10 con 0x7f40a8102de0 2024-04-25T02:18:32.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.789+0000 7f408ffff700 1 -- 172.21.15.77:0/4260140944 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f409800e070 con 0x7f40a8102de0 2024-04-25T02:18:32.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.789+0000 7f40ae1be700 1 -- 172.21.15.77:0/4260140944 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a810e1f0 con 0x7f40a8102de0 2024-04-25T02:18:32.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.790+0000 7f40ae1be700 1 -- 172.21.15.77:0/4260140944 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a81000f0 con 0x7f40a8102de0 2024-04-25T02:18:32.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.791+0000 7f408ffff700 1 -- 172.21.15.77:0/4260140944 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f409801c400 con 0x7f40a8102de0 2024-04-25T02:18:32.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.791+0000 7f408ffff700 1 --2- 172.21.15.77:0/4260140944 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f409006e140 0x7f40900705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:32.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.791+0000 7f408ffff700 1 -- 172.21.15.77:0/4260140944 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f409808ef60 con 0x7f40a8102de0 2024-04-25T02:18:32.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.791+0000 7f40a6ffd700 1 --2- 172.21.15.77:0/4260140944 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f409006e140 0x7f40900705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:32.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.791+0000 7f40a6ffd700 1 --2- 172.21.15.77:0/4260140944 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f409006e140 0x7f40900705f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f40a810ec00 tx=0x7f409c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:32.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:32.796+0000 7f408ffff700 1 -- 172.21.15.77:0/4260140944 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f40980c3740 con 0x7f40a8102de0 2024-04-25T02:18:33.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.014+0000 7f40ae1be700 1 -- 172.21.15.77:0/4260140944 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f40a810ef70 con 0x7f409006e140 2024-04-25T02:18:33.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.015+0000 7f408ffff700 1 -- 172.21.15.77:0/4260140944 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f40a810ef70 con 0x7f409006e140 2024-04-25T02:18:33.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.018+0000 7f40ae1be700 1 -- 172.21.15.77:0/4260140944 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f409006e140 msgr2=0x7f40900705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:33.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.018+0000 7f40ae1be700 1 --2- 172.21.15.77:0/4260140944 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f409006e140 0x7f40900705f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f40a810ec00 tx=0x7f409c00b040 comp rx=0 tx=0).stop 2024-04-25T02:18:33.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.018+0000 7f40ae1be700 1 -- 172.21.15.77:0/4260140944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a8102de0 msgr2=0x7f40a81138b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:33.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.018+0000 7f40ae1be700 1 --2- 172.21.15.77:0/4260140944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a8102de0 0x7f40a81138b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4098009150 tx=0x7f4098009e30 comp rx=0 tx=0).stop 2024-04-25T02:18:33.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.018+0000 7f40ae1be700 1 -- 172.21.15.77:0/4260140944 shutdown_connections 2024-04-25T02:18:33.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.018+0000 7f40ae1be700 1 --2- 172.21.15.77:0/4260140944 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f409006e140 0x7f40900705f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:33.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.018+0000 7f40ae1be700 1 --2- 172.21.15.77:0/4260140944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a8102de0 0x7f40a81138b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:33.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.018+0000 7f40ae1be700 1 --2- 172.21.15.77:0/4260140944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40a8103780 0x7f40a8113df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:33.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.018+0000 7f40ae1be700 1 -- 172.21.15.77:0/4260140944 >> 172.21.15.77:0/4260140944 conn(0x7f40a80f8990 msgr2=0x7f40a80fa6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:33.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.018+0000 7f40ae1be700 1 -- 172.21.15.77:0/4260140944 shutdown_connections 2024-04-25T02:18:33.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.018+0000 7f40ae1be700 1 -- 172.21.15.77:0/4260140944 wait complete. 2024-04-25T02:18:33.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.119+0000 7fe8dfe6a700 1 -- 172.21.15.77:0/3934481314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8d8102630 msgr2=0x7fe8d80fbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:33.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.119+0000 7fe8dfe6a700 1 --2- 172.21.15.77:0/3934481314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8d8102630 0x7fe8d80fbca0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8004940 tx=0x7fe8c8009e30 comp rx=0 tx=0).stop 2024-04-25T02:18:33.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.119+0000 7fe8dfe6a700 1 -- 172.21.15.77:0/3934481314 shutdown_connections 2024-04-25T02:18:33.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.119+0000 7fe8dfe6a700 1 --2- 172.21.15.77:0/3934481314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8d8102630 0x7fe8d80fbca0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:33.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.119+0000 7fe8dfe6a700 1 --2- 172.21.15.77:0/3934481314 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8d8101c90 0x7fe8d8102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:33.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.119+0000 7fe8dfe6a700 1 -- 172.21.15.77:0/3934481314 >> 172.21.15.77:0/3934481314 conn(0x7fe8d80f7800 msgr2=0x7fe8d80f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:33.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.119+0000 7fe8dfe6a700 1 -- 172.21.15.77:0/3934481314 shutdown_connections 2024-04-25T02:18:33.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.119+0000 7fe8dfe6a700 1 -- 172.21.15.77:0/3934481314 wait complete. 2024-04-25T02:18:33.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.120+0000 7fe8dfe6a700 1 Processor -- start 2024-04-25T02:18:33.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.120+0000 7fe8dfe6a700 1 -- start start 2024-04-25T02:18:33.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.120+0000 7fe8dfe6a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8d8101c90 0x7fe8d8112a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:33.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.120+0000 7fe8dfe6a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8d8102630 0x7fe8d8112f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:33.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.120+0000 7fe8dfe6a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d81135a0 con 0x7fe8d8101c90 2024-04-25T02:18:33.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.120+0000 7fe8dfe6a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d810c990 con 0x7fe8d8102630 2024-04-25T02:18:33.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.120+0000 7fe8ddc06700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8d8101c90 0x7fe8d8112a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:33.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.120+0000 7fe8ddc06700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8d8101c90 0x7fe8d8112a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54714/0 (socket says 172.21.15.77:54714) 2024-04-25T02:18:33.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.120+0000 7fe8ddc06700 1 -- 172.21.15.77:0/2241629660 learned_addr learned my addr 172.21.15.77:0/2241629660 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:18:33.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.120+0000 7fe8dd405700 1 --2- 172.21.15.77:0/2241629660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8d8102630 0x7fe8d8112f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:33.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.120+0000 7fe8ddc06700 1 -- 172.21.15.77:0/2241629660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8d8102630 msgr2=0x7fe8d8112f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:33.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.120+0000 7fe8ddc06700 1 --2- 172.21.15.77:0/2241629660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8d8102630 0x7fe8d8112f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:33.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.120+0000 7fe8ddc06700 1 -- 172.21.15.77:0/2241629660 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c8005040 con 0x7fe8d8101c90 2024-04-25T02:18:33.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.121+0000 7fe8ddc06700 1 --2- 172.21.15.77:0/2241629660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8d8101c90 0x7fe8d8112a10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4002a50 tx=0x7fe8d40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:33.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.121+0000 7fe8ce7fc700 1 -- 172.21.15.77:0/2241629660 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8d4007cc0 con 0x7fe8d8101c90 2024-04-25T02:18:33.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.121+0000 7fe8ce7fc700 1 -- 172.21.15.77:0/2241629660 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe8d400f040 con 0x7fe8d8101c90 2024-04-25T02:18:33.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.121+0000 7fe8dfe6a700 1 -- 172.21.15.77:0/2241629660 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d810cc70 con 0x7fe8d8101c90 2024-04-25T02:18:33.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.121+0000 7fe8ce7fc700 1 -- 172.21.15.77:0/2241629660 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8d400da30 con 0x7fe8d8101c90 2024-04-25T02:18:33.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.121+0000 7fe8dfe6a700 1 -- 172.21.15.77:0/2241629660 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d810d200 con 0x7fe8d8101c90 2024-04-25T02:18:33.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.122+0000 7fe8dfe6a700 1 -- 172.21.15.77:0/2241629660 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d80fd3e0 con 0x7fe8d8101c90 2024-04-25T02:18:33.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.122+0000 7fe8ce7fc700 1 -- 172.21.15.77:0/2241629660 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe8d400db90 con 0x7fe8d8101c90 2024-04-25T02:18:33.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.123+0000 7fe8ce7fc700 1 --2- 172.21.15.77:0/2241629660 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fe8c406e140 0x7fe8c40705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:33.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.123+0000 7fe8ce7fc700 1 -- 172.21.15.77:0/2241629660 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fe8d408d7f0 con 0x7fe8d8101c90 2024-04-25T02:18:33.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.123+0000 7fe8dd405700 1 --2- 172.21.15.77:0/2241629660 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fe8c406e140 0x7fe8c40705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:33.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.123+0000 7fe8dd405700 1 --2- 172.21.15.77:0/2241629660 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fe8c406e140 0x7fe8c40705f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe8d810dc70 tx=0x7fe8c8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:33.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.127+0000 7fe8ce7fc700 1 -- 172.21.15.77:0/2241629660 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fe8d405a720 con 0x7fe8d8101c90 2024-04-25T02:18:33.316 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:33 smithi077 ceph-mon[110441]: from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:18:33.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.336+0000 7fe8dfe6a700 1 -- 172.21.15.77:0/2241629660 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8d8108d60 con 0x7fe8c406e140 2024-04-25T02:18:33.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.346+0000 7fe8ce7fc700 1 -- 172.21.15.77:0/2241629660 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fe8d8108d60 con 0x7fe8c406e140 2024-04-25T02:18:33.349 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T02:18:33.350 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (6m) 10s ago 17m 26.8M - 0.25.0 c8568f914cd2 699c7fd25ea5 2024-04-25T02:18:33.350 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (4m) 10s ago 17m 6660k - 19.0.0-2445-gd2c45d97 f68e37b807ef f3c45d31e2e3 2024-04-25T02:18:33.350 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi112 smithi112 running (4m) 49s ago 16m 6656k - 19.0.0-2445-gd2c45d97 f68e37b807ef e16d9899ed11 2024-04-25T02:18:33.350 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (6m) 10s ago 17m 79.4M - 9.4.12 2bacad6d85d8 900138b0bcf0 2024-04-25T02:18:33.350 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.gcfygj smithi077 running (15s) 10s ago 12m 11.6M - 19.0.0-2445-gd2c45d97 f68e37b807ef 25bb04d1a9c3 2024-04-25T02:18:33.350 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.oadrkb smithi077 running (35s) 10s ago 12m 11.5M - 19.0.0-2445-gd2c45d97 f68e37b807ef e34ba410a62c 2024-04-25T02:18:33.350 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.dvwudt smithi112 running (12m) 49s ago 12m 155M - 17.2.7-902-gc61472c8 0de407c1b3af 0792e451abfd 2024-04-25T02:18:33.350 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.fjnadi smithi112 running (12m) 49s ago 12m 16.0M - 17.2.7-902-gc61472c8 0de407c1b3af c8093f622f6b 2024-04-25T02:18:33.350 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.zpflzp smithi077 *:8443,9283,8765 running (8m) 10s ago 18m 508M - 19.0.0-2445-gd2c45d97 f68e37b807ef a1af92e027e5 2024-04-25T02:18:33.350 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi112.cswrxs smithi112 *:8443,9283,8765 running (7m) 49s ago 16m 451M - 19.0.0-2445-gd2c45d97 f68e37b807ef ccc7c57d35f2 2024-04-25T02:18:33.350 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (5m) 10s ago 19m 53.0M 2048M 19.0.0-2445-gd2c45d97 f68e37b807ef 06490c2ecc44 2024-04-25T02:18:33.350 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi112 smithi112 running (4m) 49s ago 16m 37.6M 2048M 19.0.0-2445-gd2c45d97 f68e37b807ef ccd1398acbc5 2024-04-25T02:18:33.350 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (7m) 10s ago 17m 16.7M - 1.5.0 0da6a335fe13 2320132606fc 2024-04-25T02:18:33.351 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi112 smithi112 *:9100 running (7m) 49s ago 16m 14.9M - 1.5.0 0da6a335fe13 49f285354791 2024-04-25T02:18:33.351 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (3m) 10s ago 15m 98.6M 1557M 19.0.0-2445-gd2c45d97 f68e37b807ef 7035e288ddae 2024-04-25T02:18:33.351 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (3m) 10s ago 15m 113M 1557M 19.0.0-2445-gd2c45d97 f68e37b807ef 6e514f700c36 2024-04-25T02:18:33.351 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (2m) 10s ago 15m 98.1M 1557M 19.0.0-2445-gd2c45d97 f68e37b807ef 392fd2036c16 2024-04-25T02:18:33.351 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi112 running (2m) 49s ago 14m 106M 2581M 19.0.0-2445-gd2c45d97 f68e37b807ef c100df1a0f60 2024-04-25T02:18:33.351 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi112 running (86s) 49s ago 14m 104M 2581M 19.0.0-2445-gd2c45d97 f68e37b807ef 669b1ab41e27 2024-04-25T02:18:33.351 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi112 running (53s) 49s ago 13m 12.0M 2581M 19.0.0-2445-gd2c45d97 f68e37b807ef cc8f3462943e 2024-04-25T02:18:33.351 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (7m) 10s ago 17m 59.4M - 2.43.0 a07b618ecd1d c5b8c6104d96 2024-04-25T02:18:33.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.348+0000 7fe8dfe6a700 1 -- 172.21.15.77:0/2241629660 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fe8c406e140 msgr2=0x7fe8c40705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:33.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.348+0000 7fe8dfe6a700 1 --2- 172.21.15.77:0/2241629660 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fe8c406e140 0x7fe8c40705f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe8d810dc70 tx=0x7fe8c8009e30 comp rx=0 tx=0).stop 2024-04-25T02:18:33.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.348+0000 7fe8dfe6a700 1 -- 172.21.15.77:0/2241629660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8d8101c90 msgr2=0x7fe8d8112a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:33.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.348+0000 7fe8dfe6a700 1 --2- 172.21.15.77:0/2241629660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8d8101c90 0x7fe8d8112a10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4002a50 tx=0x7fe8d40046b0 comp rx=0 tx=0).stop 2024-04-25T02:18:33.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.348+0000 7fe8dfe6a700 1 -- 172.21.15.77:0/2241629660 shutdown_connections 2024-04-25T02:18:33.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.348+0000 7fe8dfe6a700 1 --2- 172.21.15.77:0/2241629660 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fe8c406e140 0x7fe8c40705f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:33.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.348+0000 7fe8dfe6a700 1 --2- 172.21.15.77:0/2241629660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8d8101c90 0x7fe8d8112a10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:33.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.348+0000 7fe8dfe6a700 1 --2- 172.21.15.77:0/2241629660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8d8102630 0x7fe8d8112f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:33.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.348+0000 7fe8dfe6a700 1 -- 172.21.15.77:0/2241629660 >> 172.21.15.77:0/2241629660 conn(0x7fe8d80f7800 msgr2=0x7fe8d80f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:33.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.348+0000 7fe8dfe6a700 1 -- 172.21.15.77:0/2241629660 shutdown_connections 2024-04-25T02:18:33.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.348+0000 7fe8dfe6a700 1 -- 172.21.15.77:0/2241629660 wait complete. 2024-04-25T02:18:33.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.449+0000 7fc7e9fc8700 1 -- 172.21.15.77:0/3538402710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7e4102680 msgr2=0x7fc7e40fbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:33.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.449+0000 7fc7e9fc8700 1 --2- 172.21.15.77:0/3538402710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7e4102680 0x7fc7e40fbcf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8004940 tx=0x7fc7d8009e30 comp rx=0 tx=0).stop 2024-04-25T02:18:33.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.449+0000 7fc7e9fc8700 1 -- 172.21.15.77:0/3538402710 shutdown_connections 2024-04-25T02:18:33.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.449+0000 7fc7e9fc8700 1 --2- 172.21.15.77:0/3538402710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7e4102680 0x7fc7e40fbcf0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:33.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.449+0000 7fc7e9fc8700 1 --2- 172.21.15.77:0/3538402710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7e4101ce0 0x7fc7e41020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:33.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.449+0000 7fc7e9fc8700 1 -- 172.21.15.77:0/3538402710 >> 172.21.15.77:0/3538402710 conn(0x7fc7e40f7850 msgr2=0x7fc7e40f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:33.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.449+0000 7fc7e9fc8700 1 -- 172.21.15.77:0/3538402710 shutdown_connections 2024-04-25T02:18:33.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.449+0000 7fc7e9fc8700 1 -- 172.21.15.77:0/3538402710 wait complete. 2024-04-25T02:18:33.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.449+0000 7fc7e9fc8700 1 Processor -- start 2024-04-25T02:18:33.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.449+0000 7fc7e9fc8700 1 -- start start 2024-04-25T02:18:33.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.450+0000 7fc7e9fc8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7e4101ce0 0x7fc7e410ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:33.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.450+0000 7fc7e9fc8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7e4102680 0x7fc7e410efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:33.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.450+0000 7fc7e9fc8700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e410f620 con 0x7fc7e4102680 2024-04-25T02:18:33.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.450+0000 7fc7e9fc8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e410f760 con 0x7fc7e4101ce0 2024-04-25T02:18:33.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.450+0000 7fc7e2ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7e4102680 0x7fc7e410efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:33.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.450+0000 7fc7e2ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7e4102680 0x7fc7e410efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54742/0 (socket says 172.21.15.77:54742) 2024-04-25T02:18:33.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.450+0000 7fc7e2ffd700 1 -- 172.21.15.77:0/3861161311 learned_addr learned my addr 172.21.15.77:0/3861161311 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:18:33.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.450+0000 7fc7e37fe700 1 --2- 172.21.15.77:0/3861161311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7e4101ce0 0x7fc7e410ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:33.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.450+0000 7fc7e2ffd700 1 -- 172.21.15.77:0/3861161311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7e4101ce0 msgr2=0x7fc7e410ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:33.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.450+0000 7fc7e2ffd700 1 --2- 172.21.15.77:0/3861161311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7e4101ce0 0x7fc7e410ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:33.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.450+0000 7fc7e2ffd700 1 -- 172.21.15.77:0/3861161311 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d8005040 con 0x7fc7e4102680 2024-04-25T02:18:33.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.450+0000 7fc7e2ffd700 1 --2- 172.21.15.77:0/3861161311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7e4102680 0x7fc7e410efd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8009180 tx=0x7fc7d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:33.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.450+0000 7fc7cbfff700 1 -- 172.21.15.77:0/3861161311 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7d800e040 con 0x7fc7e4102680 2024-04-25T02:18:33.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.450+0000 7fc7e9fc8700 1 -- 172.21.15.77:0/3861161311 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e4117b00 con 0x7fc7e4102680 2024-04-25T02:18:33.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.450+0000 7fc7cbfff700 1 -- 172.21.15.77:0/3861161311 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc7d8013420 con 0x7fc7e4102680 2024-04-25T02:18:33.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.450+0000 7fc7cbfff700 1 -- 172.21.15.77:0/3861161311 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7d801c610 con 0x7fc7e4102680 2024-04-25T02:18:33.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.450+0000 7fc7e9fc8700 1 -- 172.21.15.77:0/3861161311 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e4118010 con 0x7fc7e4102680 2024-04-25T02:18:33.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.451+0000 7fc7e9fc8700 1 -- 172.21.15.77:0/3861161311 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e40fd430 con 0x7fc7e4102680 2024-04-25T02:18:33.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.452+0000 7fc7cbfff700 1 -- 172.21.15.77:0/3861161311 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc7d800baf0 con 0x7fc7e4102680 2024-04-25T02:18:33.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.452+0000 7fc7cbfff700 1 --2- 172.21.15.77:0/3861161311 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc7cc06e140 0x7fc7cc0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:33.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.452+0000 7fc7cbfff700 1 -- 172.21.15.77:0/3861161311 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fc7d808ec70 con 0x7fc7e4102680 2024-04-25T02:18:33.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.452+0000 7fc7e37fe700 1 --2- 172.21.15.77:0/3861161311 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc7cc06e140 0x7fc7cc0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:33.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.453+0000 7fc7e37fe700 1 --2- 172.21.15.77:0/3861161311 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc7cc06e140 0x7fc7cc0705f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4007b20 tx=0x7fc7d4009e20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:33.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.457+0000 7fc7cbfff700 1 -- 172.21.15.77:0/3861161311 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fc7d8058070 con 0x7fc7e4102680 2024-04-25T02:18:33.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.739+0000 7fc7e9fc8700 1 -- 172.21.15.77:0/3861161311 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc7e404bed0 con 0x7fc7e4102680 2024-04-25T02:18:33.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.740+0000 7fc7cbfff700 1 -- 172.21.15.77:0/3861161311 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7fc7d805b730 con 0x7fc7e4102680 2024-04-25T02:18:33.744 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:18:33.744 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-04-25T02:18:33.744 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:18:33.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:18:33.744 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-04-25T02:18:33.744 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:18:33.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:18:33.744 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-04-25T02:18:33.744 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 6 2024-04-25T02:18:33.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:18:33.745 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-04-25T02:18:33.745 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 1, 2024-04-25T02:18:33.745 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:18:33.745 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:18:33.745 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-04-25T02:18:33.745 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 1, 2024-04-25T02:18:33.745 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 12 2024-04-25T02:18:33.745 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-25T02:18:33.745 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:18:33.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.742+0000 7fc7e9fc8700 1 -- 172.21.15.77:0/3861161311 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc7cc06e140 msgr2=0x7fc7cc0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:33.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.742+0000 7fc7e9fc8700 1 --2- 172.21.15.77:0/3861161311 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc7cc06e140 0x7fc7cc0705f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4007b20 tx=0x7fc7d4009e20 comp rx=0 tx=0).stop 2024-04-25T02:18:33.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.742+0000 7fc7e9fc8700 1 -- 172.21.15.77:0/3861161311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7e4102680 msgr2=0x7fc7e410efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:33.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.742+0000 7fc7e9fc8700 1 --2- 172.21.15.77:0/3861161311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7e4102680 0x7fc7e410efd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8009180 tx=0x7fc7d8009e30 comp rx=0 tx=0).stop 2024-04-25T02:18:33.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.742+0000 7fc7e9fc8700 1 -- 172.21.15.77:0/3861161311 shutdown_connections 2024-04-25T02:18:33.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.742+0000 7fc7e9fc8700 1 --2- 172.21.15.77:0/3861161311 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc7cc06e140 0x7fc7cc0705f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:33.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.742+0000 7fc7e9fc8700 1 --2- 172.21.15.77:0/3861161311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7e4101ce0 0x7fc7e410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:33.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.742+0000 7fc7e9fc8700 1 --2- 172.21.15.77:0/3861161311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7e4102680 0x7fc7e410efd0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:33.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.742+0000 7fc7e9fc8700 1 -- 172.21.15.77:0/3861161311 >> 172.21.15.77:0/3861161311 conn(0x7fc7e40f7850 msgr2=0x7fc7e40f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:33.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.742+0000 7fc7e9fc8700 1 -- 172.21.15.77:0/3861161311 shutdown_connections 2024-04-25T02:18:33.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.742+0000 7fc7e9fc8700 1 -- 172.21.15.77:0/3861161311 wait complete. 2024-04-25T02:18:33.776 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:33 smithi112 ceph-mon[80494]: from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:18:33.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.844+0000 7f5b05a0f700 1 -- 172.21.15.77:0/2457499360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b00102de0 msgr2=0x7f5b001031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:33.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.844+0000 7f5b05a0f700 1 --2- 172.21.15.77:0/2457499360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b00102de0 0x7f5b001031b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5af0004940 tx=0x7f5af0009e30 comp rx=0 tx=0).stop 2024-04-25T02:18:33.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.844+0000 7f5b05a0f700 1 -- 172.21.15.77:0/2457499360 shutdown_connections 2024-04-25T02:18:33.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.844+0000 7f5b05a0f700 1 --2- 172.21.15.77:0/2457499360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b00103780 0x7f5b000fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:33.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.844+0000 7f5b05a0f700 1 --2- 172.21.15.77:0/2457499360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b00102de0 0x7f5b001031b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:33.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.844+0000 7f5b05a0f700 1 -- 172.21.15.77:0/2457499360 >> 172.21.15.77:0/2457499360 conn(0x7f5b000f8990 msgr2=0x7f5b000fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:33.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.844+0000 7f5b05a0f700 1 -- 172.21.15.77:0/2457499360 shutdown_connections 2024-04-25T02:18:33.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.844+0000 7f5b05a0f700 1 -- 172.21.15.77:0/2457499360 wait complete. 2024-04-25T02:18:33.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.844+0000 7f5b05a0f700 1 Processor -- start 2024-04-25T02:18:33.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.844+0000 7f5b05a0f700 1 -- start start 2024-04-25T02:18:33.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.845+0000 7f5b05a0f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b00102de0 0x7f5b00070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:33.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.845+0000 7f5b05a0f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b00103780 0x7f5b000707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:33.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.845+0000 7f5b05a0f700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b000721b0 con 0x7f5b00103780 2024-04-25T02:18:33.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.845+0000 7f5b05a0f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b00070ce0 con 0x7f5b00102de0 2024-04-25T02:18:33.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.845+0000 7f5af67fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b00103780 0x7f5b000707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:33.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.845+0000 7f5af67fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b00103780 0x7f5b000707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54760/0 (socket says 172.21.15.77:54760) 2024-04-25T02:18:33.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.845+0000 7f5af67fc700 1 -- 172.21.15.77:0/2948082987 learned_addr learned my addr 172.21.15.77:0/2948082987 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:18:33.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.845+0000 7f5afeffd700 1 --2- 172.21.15.77:0/2948082987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b00102de0 0x7f5b00070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:33.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.845+0000 7f5af67fc700 1 -- 172.21.15.77:0/2948082987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b00102de0 msgr2=0x7f5b00070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:33.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.845+0000 7f5af67fc700 1 --2- 172.21.15.77:0/2948082987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b00102de0 0x7f5b00070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:33.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.845+0000 7f5af67fc700 1 -- 172.21.15.77:0/2948082987 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af0005040 con 0x7f5b00103780 2024-04-25T02:18:33.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.845+0000 7f5af67fc700 1 --2- 172.21.15.77:0/2948082987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b00103780 0x7f5b000707a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8002a50 tx=0x7f5ae80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:33.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.845+0000 7f5af7fff700 1 -- 172.21.15.77:0/2948082987 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ae8007cc0 con 0x7f5b00103780 2024-04-25T02:18:33.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.845+0000 7f5af7fff700 1 -- 172.21.15.77:0/2948082987 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5ae800f040 con 0x7f5b00103780 2024-04-25T02:18:33.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.845+0000 7f5af7fff700 1 -- 172.21.15.77:0/2948082987 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ae800db30 con 0x7f5b00103780 2024-04-25T02:18:33.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.845+0000 7f5b05a0f700 1 -- 172.21.15.77:0/2948082987 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b00070fc0 con 0x7f5b00103780 2024-04-25T02:18:33.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.846+0000 7f5b05a0f700 1 -- 172.21.15.77:0/2948082987 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0011a090 con 0x7f5b00103780 2024-04-25T02:18:33.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.847+0000 7f5b05a0f700 1 -- 172.21.15.77:0/2948082987 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b001000f0 con 0x7f5b00103780 2024-04-25T02:18:33.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.847+0000 7f5af7fff700 1 -- 172.21.15.77:0/2948082987 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5ae800dc90 con 0x7f5b00103780 2024-04-25T02:18:33.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.847+0000 7f5af7fff700 1 --2- 172.21.15.77:0/2948082987 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5aec06e140 0x7f5aec0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:33.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.848+0000 7f5af7fff700 1 -- 172.21.15.77:0/2948082987 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f5ae808d8a0 con 0x7f5b00103780 2024-04-25T02:18:33.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.848+0000 7f5afeffd700 1 --2- 172.21.15.77:0/2948082987 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5aec06e140 0x7f5aec0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:33.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.848+0000 7f5afeffd700 1 --2- 172.21.15.77:0/2948082987 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5aec06e140 0x7f5aec0705f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5af0004f90 tx=0x7f5af0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:33.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:33.852+0000 7f5af7fff700 1 -- 172.21.15.77:0/2948082987 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f5ae8056c20 con 0x7f5b00103780 2024-04-25T02:18:34.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.100+0000 7f5b05a0f700 1 -- 172.21.15.77:0/2948082987 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5b00071740 con 0x7f5b00103780 2024-04-25T02:18:34.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.100+0000 7f5af7fff700 1 -- 172.21.15.77:0/2948082987 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1704 (secure 0 0 0) 0x7f5ae805a2e0 con 0x7f5b00103780 2024-04-25T02:18:34.104 INFO:teuthology.orchestra.run.smithi077.stdout:e21 2024-04-25T02:18:34.104 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T02:18:34.104 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:18:34.104 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-04-25T02:18:34.104 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:18:34.104 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-04-25T02:18:34.105 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-04-25T02:18:34.105 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 21 2024-04-25T02:18:34.105 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-25T02:18:34.105 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-04-25T02:06:10.008979+0000 2024-04-25T02:18:34.105 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-04-25T02:18:31.259306+0000 2024-04-25T02:18:34.105 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-04-25T02:18:34.105 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-04-25T02:18:34.105 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-04-25T02:18:34.105 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-04-25T02:18:34.105 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-04-25T02:18:34.105 INFO:teuthology.orchestra.run.smithi077.stdout:max_xattr_size 65536 2024-04-25T02:18:34.105 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-04-25T02:18:34.105 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-04-25T02:18:34.105 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 83 2024-04-25T02:18:34.105 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:18:34.106 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-04-25T02:18:34.106 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-04-25T02:18:34.106 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=24269} 2024-04-25T02:18:34.106 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-04-25T02:18:34.106 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-04-25T02:18:34.106 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-04-25T02:18:34.106 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-04-25T02:18:34.106 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-04-25T02:18:34.106 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-04-25T02:18:34.106 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-04-25T02:18:34.106 INFO:teuthology.orchestra.run.smithi077.stdout:bal_rank_mask -1 2024-04-25T02:18:34.107 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-04-25T02:18:34.107 INFO:teuthology.orchestra.run.smithi077.stdout:qdb_cluster leader: 0 members: 2024-04-25T02:18:34.107 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi112.fjnadi{0:24269} state up:replay seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/2036319817,v1:172.21.15.112:6827/2036319817] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T02:18:34.107 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:18:34.107 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:18:34.107 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-04-25T02:18:34.107 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:18:34.107 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.oadrkb{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.77:6826/1829655283,v1:172.21.15.77:6827/1829655283] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T02:18:34.107 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.gcfygj{-1:34406} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.77:6828/702451557,v1:172.21.15.77:6829/702451557] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T02:18:34.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.102+0000 7f5b05a0f700 1 -- 172.21.15.77:0/2948082987 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5aec06e140 msgr2=0x7f5aec0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:34.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.102+0000 7f5b05a0f700 1 --2- 172.21.15.77:0/2948082987 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5aec06e140 0x7f5aec0705f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5af0004f90 tx=0x7f5af0009e30 comp rx=0 tx=0).stop 2024-04-25T02:18:34.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.102+0000 7f5b05a0f700 1 -- 172.21.15.77:0/2948082987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b00103780 msgr2=0x7f5b000707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:34.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.102+0000 7f5b05a0f700 1 --2- 172.21.15.77:0/2948082987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b00103780 0x7f5b000707a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8002a50 tx=0x7f5ae80046b0 comp rx=0 tx=0).stop 2024-04-25T02:18:34.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.102+0000 7f5b05a0f700 1 -- 172.21.15.77:0/2948082987 shutdown_connections 2024-04-25T02:18:34.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.102+0000 7f5b05a0f700 1 --2- 172.21.15.77:0/2948082987 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5aec06e140 0x7f5aec0705f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:34.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.102+0000 7f5b05a0f700 1 --2- 172.21.15.77:0/2948082987 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b00102de0 0x7f5b00070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:34.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.102+0000 7f5b05a0f700 1 --2- 172.21.15.77:0/2948082987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b00103780 0x7f5b000707a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:34.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.102+0000 7f5b05a0f700 1 -- 172.21.15.77:0/2948082987 >> 172.21.15.77:0/2948082987 conn(0x7f5b000f8990 msgr2=0x7f5b000fa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:34.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.103+0000 7f5b05a0f700 1 -- 172.21.15.77:0/2948082987 shutdown_connections 2024-04-25T02:18:34.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.103+0000 7f5b05a0f700 1 -- 172.21.15.77:0/2948082987 wait complete. 2024-04-25T02:18:34.109 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-04-25T02:18:34.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.205+0000 7fe18525a700 1 -- 172.21.15.77:0/3644286496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1801037c0 msgr2=0x7fe1800fb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:34.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.205+0000 7fe18525a700 1 --2- 172.21.15.77:0/3644286496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1801037c0 0x7fe1800fb3c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe174004940 tx=0x7fe174009e30 comp rx=0 tx=0).stop 2024-04-25T02:18:34.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.205+0000 7fe18525a700 1 -- 172.21.15.77:0/3644286496 shutdown_connections 2024-04-25T02:18:34.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.205+0000 7fe18525a700 1 --2- 172.21.15.77:0/3644286496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1801037c0 0x7fe1800fb3c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:34.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.205+0000 7fe18525a700 1 --2- 172.21.15.77:0/3644286496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe180102e20 0x7fe1801031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:34.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.205+0000 7fe18525a700 1 -- 172.21.15.77:0/3644286496 >> 172.21.15.77:0/3644286496 conn(0x7fe180072380 msgr2=0x7fe180072780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:34.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.205+0000 7fe18525a700 1 -- 172.21.15.77:0/3644286496 shutdown_connections 2024-04-25T02:18:34.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.205+0000 7fe18525a700 1 -- 172.21.15.77:0/3644286496 wait complete. 2024-04-25T02:18:34.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.206+0000 7fe18525a700 1 Processor -- start 2024-04-25T02:18:34.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.206+0000 7fe18525a700 1 -- start start 2024-04-25T02:18:34.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.206+0000 7fe18525a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe180102e20 0x7fe180113940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:34.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.206+0000 7fe18525a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1801037c0 0x7fe180113e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.206+0000 7fe18525a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1801144d0 con 0x7fe1801037c0 2024-04-25T02:18:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.206+0000 7fe18525a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18010dad0 con 0x7fe180102e20 2024-04-25T02:18:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.206+0000 7fe17e59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1801037c0 0x7fe180113e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.206+0000 7fe17e59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1801037c0 0x7fe180113e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54774/0 (socket says 172.21.15.77:54774) 2024-04-25T02:18:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.206+0000 7fe17e59c700 1 -- 172.21.15.77:0/1437590259 learned_addr learned my addr 172.21.15.77:0/1437590259 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:18:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.206+0000 7fe17ed9d700 1 --2- 172.21.15.77:0/1437590259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe180102e20 0x7fe180113940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.207+0000 7fe17e59c700 1 -- 172.21.15.77:0/1437590259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe180102e20 msgr2=0x7fe180113940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.207+0000 7fe17e59c700 1 --2- 172.21.15.77:0/1437590259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe180102e20 0x7fe180113940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.207+0000 7fe17e59c700 1 -- 172.21.15.77:0/1437590259 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe174005040 con 0x7fe1801037c0 2024-04-25T02:18:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.207+0000 7fe17e59c700 1 --2- 172.21.15.77:0/1437590259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1801037c0 0x7fe180113e80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe174009180 tx=0x7fe174009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.207+0000 7fe1677fe700 1 -- 172.21.15.77:0/1437590259 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe17400e040 con 0x7fe1801037c0 2024-04-25T02:18:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.207+0000 7fe1677fe700 1 -- 172.21.15.77:0/1437590259 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe174013420 con 0x7fe1801037c0 2024-04-25T02:18:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.207+0000 7fe18525a700 1 -- 172.21.15.77:0/1437590259 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe18010dd50 con 0x7fe1801037c0 2024-04-25T02:18:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.207+0000 7fe1677fe700 1 -- 172.21.15.77:0/1437590259 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe17401c610 con 0x7fe1801037c0 2024-04-25T02:18:34.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.207+0000 7fe18525a700 1 -- 172.21.15.77:0/1437590259 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe18010e290 con 0x7fe1801037c0 2024-04-25T02:18:34.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.208+0000 7fe18525a700 1 -- 172.21.15.77:0/1437590259 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe180100160 con 0x7fe1801037c0 2024-04-25T02:18:34.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.208+0000 7fe1677fe700 1 -- 172.21.15.77:0/1437590259 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe174013a00 con 0x7fe1801037c0 2024-04-25T02:18:34.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.209+0000 7fe1677fe700 1 --2- 172.21.15.77:0/1437590259 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fe16806e140 0x7fe1680705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:34.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.209+0000 7fe1677fe700 1 -- 172.21.15.77:0/1437590259 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fe17408ec10 con 0x7fe1801037c0 2024-04-25T02:18:34.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.209+0000 7fe17ed9d700 1 --2- 172.21.15.77:0/1437590259 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fe16806e140 0x7fe1680705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:34.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.209+0000 7fe17ed9d700 1 --2- 172.21.15.77:0/1437590259 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fe16806e140 0x7fe1680705f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe170009fd0 tx=0x7fe17000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:34.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.214+0000 7fe1677fe700 1 -- 172.21.15.77:0/1437590259 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fe17405bbf0 con 0x7fe1801037c0 2024-04-25T02:18:34.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.430+0000 7fe18525a700 1 -- 172.21.15.77:0/1437590259 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe180113610 con 0x7fe16806e140 2024-04-25T02:18:34.435 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:34 smithi077 ceph-mon[110441]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:18:34.435 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:34 smithi077 ceph-mon[110441]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:18:34.435 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:34 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/3861161311' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:18:34.435 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:34 smithi077 ceph-mon[110441]: pgmap v191: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s rd, 1 op/s 2024-04-25T02:18:34.435 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:34 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/2948082987' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:18:34.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.432+0000 7fe1677fe700 1 -- 172.21.15.77:0/1437590259 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe180113610 con 0x7fe16806e140 2024-04-25T02:18:34.436 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:18:34.436 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901", 2024-04-25T02:18:34.436 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-04-25T02:18:34.436 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T02:18:34.436 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-04-25T02:18:34.436 INFO:teuthology.orchestra.run.smithi077.stdout: "mon", 2024-04-25T02:18:34.436 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr", 2024-04-25T02:18:34.436 INFO:teuthology.orchestra.run.smithi077.stdout: "crash", 2024-04-25T02:18:34.436 INFO:teuthology.orchestra.run.smithi077.stdout: "osd" 2024-04-25T02:18:34.436 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-25T02:18:34.436 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "14/21 daemons upgraded", 2024-04-25T02:18:34.436 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading mds daemons", 2024-04-25T02:18:34.436 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-04-25T02:18:34.437 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:18:34.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.434+0000 7fe18525a700 1 -- 172.21.15.77:0/1437590259 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fe16806e140 msgr2=0x7fe1680705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:34.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.434+0000 7fe18525a700 1 --2- 172.21.15.77:0/1437590259 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fe16806e140 0x7fe1680705f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe170009fd0 tx=0x7fe17000b040 comp rx=0 tx=0).stop 2024-04-25T02:18:34.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.434+0000 7fe18525a700 1 -- 172.21.15.77:0/1437590259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1801037c0 msgr2=0x7fe180113e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:34.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.434+0000 7fe18525a700 1 --2- 172.21.15.77:0/1437590259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1801037c0 0x7fe180113e80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe174009180 tx=0x7fe174009e30 comp rx=0 tx=0).stop 2024-04-25T02:18:34.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.434+0000 7fe18525a700 1 -- 172.21.15.77:0/1437590259 shutdown_connections 2024-04-25T02:18:34.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.434+0000 7fe18525a700 1 --2- 172.21.15.77:0/1437590259 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fe16806e140 0x7fe1680705f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:34.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.434+0000 7fe18525a700 1 --2- 172.21.15.77:0/1437590259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe180102e20 0x7fe180113940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:34.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.434+0000 7fe18525a700 1 --2- 172.21.15.77:0/1437590259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1801037c0 0x7fe180113e80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:34.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.434+0000 7fe18525a700 1 -- 172.21.15.77:0/1437590259 >> 172.21.15.77:0/1437590259 conn(0x7fe180072380 msgr2=0x7fe1800faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:34.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.435+0000 7fe18525a700 1 -- 172.21.15.77:0/1437590259 shutdown_connections 2024-04-25T02:18:34.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.435+0000 7fe18525a700 1 -- 172.21.15.77:0/1437590259 wait complete. 2024-04-25T02:18:34.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.535+0000 7fc95e64c700 1 -- 172.21.15.77:0/1119454777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9580fbd40 msgr2=0x7fc9580fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:34.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.535+0000 7fc95e64c700 1 --2- 172.21.15.77:0/1119454777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9580fbd40 0x7fc9580fc1b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc948004940 tx=0x7fc948009e30 comp rx=0 tx=0).stop 2024-04-25T02:18:34.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.535+0000 7fc95e64c700 1 -- 172.21.15.77:0/1119454777 shutdown_connections 2024-04-25T02:18:34.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.535+0000 7fc95e64c700 1 --2- 172.21.15.77:0/1119454777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9580fbd40 0x7fc9580fc1b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:34.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.535+0000 7fc95e64c700 1 --2- 172.21.15.77:0/1119454777 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc958101d90 0x7fc958102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:34.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.535+0000 7fc95e64c700 1 -- 172.21.15.77:0/1119454777 >> 172.21.15.77:0/1119454777 conn(0x7fc958071d00 msgr2=0x7fc958072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:34.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.535+0000 7fc95e64c700 1 -- 172.21.15.77:0/1119454777 shutdown_connections 2024-04-25T02:18:34.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.535+0000 7fc95e64c700 1 -- 172.21.15.77:0/1119454777 wait complete. 2024-04-25T02:18:34.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.536+0000 7fc95e64c700 1 Processor -- start 2024-04-25T02:18:34.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.536+0000 7fc95e64c700 1 -- start start 2024-04-25T02:18:34.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.536+0000 7fc95e64c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9580fbd40 0x7fc95810eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:34.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.536+0000 7fc95e64c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc958101d90 0x7fc95810efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:34.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.536+0000 7fc95e64c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95810f630 con 0x7fc958101d90 2024-04-25T02:18:34.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.536+0000 7fc95e64c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95810f770 con 0x7fc9580fbd40 2024-04-25T02:18:34.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.536+0000 7fc9577fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc958101d90 0x7fc95810efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:34.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.536+0000 7fc9577fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc958101d90 0x7fc95810efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54802/0 (socket says 172.21.15.77:54802) 2024-04-25T02:18:34.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.536+0000 7fc9577fe700 1 -- 172.21.15.77:0/1888453242 learned_addr learned my addr 172.21.15.77:0/1888453242 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:18:34.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.536+0000 7fc957fff700 1 --2- 172.21.15.77:0/1888453242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9580fbd40 0x7fc95810eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:34.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.536+0000 7fc9577fe700 1 -- 172.21.15.77:0/1888453242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9580fbd40 msgr2=0x7fc95810eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:34.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.536+0000 7fc9577fe700 1 --2- 172.21.15.77:0/1888453242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9580fbd40 0x7fc95810eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:34.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.536+0000 7fc9577fe700 1 -- 172.21.15.77:0/1888453242 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc948005040 con 0x7fc958101d90 2024-04-25T02:18:34.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.536+0000 7fc957fff700 1 --2- 172.21.15.77:0/1888453242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9580fbd40 0x7fc95810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:18:34.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.537+0000 7fc9577fe700 1 --2- 172.21.15.77:0/1888453242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc958101d90 0x7fc95810efe0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc948009b30 tx=0x7fc948009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:34.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.537+0000 7fc954ff9700 1 -- 172.21.15.77:0/1888453242 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc948021070 con 0x7fc958101d90 2024-04-25T02:18:34.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.537+0000 7fc954ff9700 1 -- 172.21.15.77:0/1888453242 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc948013c00 con 0x7fc958101d90 2024-04-25T02:18:34.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.537+0000 7fc95e64c700 1 -- 172.21.15.77:0/1888453242 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc958117b10 con 0x7fc958101d90 2024-04-25T02:18:34.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.537+0000 7fc954ff9700 1 -- 172.21.15.77:0/1888453242 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc94800e070 con 0x7fc958101d90 2024-04-25T02:18:34.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.537+0000 7fc95e64c700 1 -- 172.21.15.77:0/1888453242 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc958117f70 con 0x7fc958101d90 2024-04-25T02:18:34.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.538+0000 7fc95e64c700 1 -- 172.21.15.77:0/1888453242 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9580fd430 con 0x7fc958101d90 2024-04-25T02:18:34.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.538+0000 7fc954ff9700 1 -- 172.21.15.77:0/1888453242 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc94801cb60 con 0x7fc958101d90 2024-04-25T02:18:34.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.539+0000 7fc954ff9700 1 --2- 172.21.15.77:0/1888453242 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc94006e140 0x7fc9400705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:18:34.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.539+0000 7fc954ff9700 1 -- 172.21.15.77:0/1888453242 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fc94808efb0 con 0x7fc958101d90 2024-04-25T02:18:34.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.539+0000 7fc957fff700 1 --2- 172.21.15.77:0/1888453242 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc94006e140 0x7fc9400705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:18:34.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.539+0000 7fc957fff700 1 --2- 172.21.15.77:0/1888453242 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc94006e140 0x7fc9400705f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc94c009b80 tx=0x7fc94c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:18:34.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.543+0000 7fc954ff9700 1 -- 172.21.15.77:0/1888453242 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fc9480583b0 con 0x7fc958101d90 2024-04-25T02:18:34.776 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:34 smithi112 ceph-mon[80494]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:18:34.777 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:34 smithi112 ceph-mon[80494]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:18:34.777 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:34 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/3861161311' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:18:34.777 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:34 smithi112 ceph-mon[80494]: pgmap v191: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s rd, 1 op/s 2024-04-25T02:18:34.777 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:34 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/2948082987' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:18:34.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.823+0000 7fc95e64c700 1 -- 172.21.15.77:0/1888453242 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc95805f5c0 con 0x7fc958101d90 2024-04-25T02:18:34.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.823+0000 7fc954ff9700 1 -- 172.21.15.77:0/1888453242 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+107 (secure 0 0 0) 0x7fc948004490 con 0x7fc958101d90 2024-04-25T02:18:34.827 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_WARN 1 filesystem is degraded 2024-04-25T02:18:34.827 INFO:teuthology.orchestra.run.smithi077.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-04-25T02:18:34.827 INFO:teuthology.orchestra.run.smithi077.stdout: fs cephfs is degraded 2024-04-25T02:18:34.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.825+0000 7fc95e64c700 1 -- 172.21.15.77:0/1888453242 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc94006e140 msgr2=0x7fc9400705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:34.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.825+0000 7fc95e64c700 1 --2- 172.21.15.77:0/1888453242 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc94006e140 0x7fc9400705f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc94c009b80 tx=0x7fc94c00b040 comp rx=0 tx=0).stop 2024-04-25T02:18:34.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.825+0000 7fc95e64c700 1 -- 172.21.15.77:0/1888453242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc958101d90 msgr2=0x7fc95810efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:18:34.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.825+0000 7fc95e64c700 1 --2- 172.21.15.77:0/1888453242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc958101d90 0x7fc95810efe0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc948009b30 tx=0x7fc948009e30 comp rx=0 tx=0).stop 2024-04-25T02:18:34.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.825+0000 7fc95e64c700 1 -- 172.21.15.77:0/1888453242 shutdown_connections 2024-04-25T02:18:34.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.825+0000 7fc95e64c700 1 --2- 172.21.15.77:0/1888453242 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc94006e140 0x7fc9400705f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:34.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.825+0000 7fc95e64c700 1 --2- 172.21.15.77:0/1888453242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9580fbd40 0x7fc95810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:34.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.825+0000 7fc95e64c700 1 --2- 172.21.15.77:0/1888453242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc958101d90 0x7fc95810efe0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:18:34.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.825+0000 7fc95e64c700 1 -- 172.21.15.77:0/1888453242 >> 172.21.15.77:0/1888453242 conn(0x7fc958071d00 msgr2=0x7fc9580fa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:18:34.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.826+0000 7fc95e64c700 1 -- 172.21.15.77:0/1888453242 shutdown_connections 2024-04-25T02:18:34.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:18:34.826+0000 7fc95e64c700 1 -- 172.21.15.77:0/1888453242 wait complete. 2024-04-25T02:18:35.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:35 smithi077 ceph-mon[110441]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:18:35.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:35 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.dvwudt"}]: dispatch 2024-04-25T02:18:35.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:35 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/1888453242' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T02:18:35.777 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:35 smithi112 ceph-mon[80494]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:18:35.777 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:35 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.dvwudt"}]: dispatch 2024-04-25T02:18:35.777 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:35 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/1888453242' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T02:18:36.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:36 smithi077 ceph-mon[110441]: pgmap v192: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 9.4 MiB/s rd, 3 op/s 2024-04-25T02:18:36.776 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:36 smithi112 ceph-mon[80494]: pgmap v192: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 9.4 MiB/s rd, 3 op/s 2024-04-25T02:18:39.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:38 smithi077 ceph-mon[110441]: pgmap v193: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-04-25T02:18:39.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:38 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:39.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:38 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:18:39.231 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:38 smithi112 ceph-mon[80494]: pgmap v193: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-04-25T02:18:39.231 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:38 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:39.231 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:38 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:18:40.925 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:40 smithi112 ceph-mon[80494]: pgmap v194: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-04-25T02:18:40.925 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:40 smithi112 ceph-mon[80494]: reconnect by client.14518 v1:172.21.15.112:0/2995074108 after 0.000999973 2024-04-25T02:18:40.925 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:40 smithi112 ceph-mon[80494]: reconnect by client.14512 v1:192.168.0.1:0/1415948385 after 0.000999973 2024-04-25T02:18:40.925 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:40 smithi112 ceph-mon[80494]: mds.? [v2:172.21.15.112:6826/2036319817,v1:172.21.15.112:6827/2036319817] up:reconnect 2024-04-25T02:18:40.925 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:40 smithi112 ceph-mon[80494]: mds.? [v2:172.21.15.112:6824/1388779321,v1:172.21.15.112:6825/1388779321] up:boot 2024-04-25T02:18:40.925 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:40 smithi112 ceph-mon[80494]: fsmap cephfs:1/1 {0=cephfs.smithi112.fjnadi=up:reconnect} 3 up:standby 2024-04-25T02:18:40.925 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:40 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.dvwudt"}]: dispatch 2024-04-25T02:18:40.925 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:40 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:40.925 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:40 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:40.925 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:40 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:18:41.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:40 smithi077 ceph-mon[110441]: pgmap v194: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-04-25T02:18:41.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:40 smithi077 ceph-mon[110441]: reconnect by client.14518 v1:172.21.15.112:0/2995074108 after 0.000999973 2024-04-25T02:18:41.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:40 smithi077 ceph-mon[110441]: reconnect by client.14512 v1:192.168.0.1:0/1415948385 after 0.000999973 2024-04-25T02:18:41.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:40 smithi077 ceph-mon[110441]: mds.? [v2:172.21.15.112:6826/2036319817,v1:172.21.15.112:6827/2036319817] up:reconnect 2024-04-25T02:18:41.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:40 smithi077 ceph-mon[110441]: mds.? [v2:172.21.15.112:6824/1388779321,v1:172.21.15.112:6825/1388779321] up:boot 2024-04-25T02:18:41.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:40 smithi077 ceph-mon[110441]: fsmap cephfs:1/1 {0=cephfs.smithi112.fjnadi=up:reconnect} 3 up:standby 2024-04-25T02:18:41.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:40 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.dvwudt"}]: dispatch 2024-04-25T02:18:41.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:40 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:41.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:40 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:41.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:40 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:18:42.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:41 smithi077 ceph-mon[110441]: mds.? [v2:172.21.15.112:6826/2036319817,v1:172.21.15.112:6827/2036319817] up:rejoin 2024-04-25T02:18:42.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:41 smithi077 ceph-mon[110441]: fsmap cephfs:1/1 {0=cephfs.smithi112.fjnadi=up:rejoin} 3 up:standby 2024-04-25T02:18:42.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:41 smithi077 ceph-mon[110441]: daemon mds.cephfs.smithi112.fjnadi is now active in filesystem cephfs as rank 0 2024-04-25T02:18:42.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:41 smithi112 ceph-mon[80494]: mds.? [v2:172.21.15.112:6826/2036319817,v1:172.21.15.112:6827/2036319817] up:rejoin 2024-04-25T02:18:42.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:41 smithi112 ceph-mon[80494]: fsmap cephfs:1/1 {0=cephfs.smithi112.fjnadi=up:rejoin} 3 up:standby 2024-04-25T02:18:42.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:41 smithi112 ceph-mon[80494]: daemon mds.cephfs.smithi112.fjnadi is now active in filesystem cephfs as rank 0 2024-04-25T02:18:43.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:42 smithi077 ceph-mon[110441]: pgmap v195: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-25T02:18:43.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:42 smithi077 ceph-mon[110441]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-25T02:18:43.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:42 smithi077 ceph-mon[110441]: Cluster is now healthy 2024-04-25T02:18:43.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:42 smithi077 ceph-mon[110441]: mds.? [v2:172.21.15.112:6826/2036319817,v1:172.21.15.112:6827/2036319817] up:active 2024-04-25T02:18:43.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:42 smithi077 ceph-mon[110441]: fsmap cephfs:1 {0=cephfs.smithi112.fjnadi=up:active} 3 up:standby 2024-04-25T02:18:43.240 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:42 smithi112 ceph-mon[80494]: pgmap v195: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-25T02:18:43.240 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:42 smithi112 ceph-mon[80494]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-25T02:18:43.240 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:42 smithi112 ceph-mon[80494]: Cluster is now healthy 2024-04-25T02:18:43.240 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:42 smithi112 ceph-mon[80494]: mds.? [v2:172.21.15.112:6826/2036319817,v1:172.21.15.112:6827/2036319817] up:active 2024-04-25T02:18:43.241 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:42 smithi112 ceph-mon[80494]: fsmap cephfs:1 {0=cephfs.smithi112.fjnadi=up:active} 3 up:standby 2024-04-25T02:18:45.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:44 smithi112 ceph-mon[80494]: pgmap v196: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 255 B/s wr, 6 op/s 2024-04-25T02:18:45.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:44 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:45.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:44 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:45.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:44 smithi077 ceph-mon[110441]: pgmap v196: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 255 B/s wr, 6 op/s 2024-04-25T02:18:45.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:44 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:45.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:44 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:46.527 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:46 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:46.527 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:46 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:46.527 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:46 smithi112 ceph-mon[80494]: pgmap v197: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 5.0 KiB/s wr, 9 op/s 2024-04-25T02:18:46.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:46 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:46.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:46 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:46.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:46 smithi077 ceph-mon[110441]: pgmap v197: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 5.0 KiB/s wr, 9 op/s 2024-04-25T02:18:49.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:48 smithi112 ceph-mon[80494]: pgmap v198: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 7.9 MiB/s rd, 5.0 KiB/s wr, 7 op/s 2024-04-25T02:18:49.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:48 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:49.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:48 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:49.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:48 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:18:49.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:48 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:18:49.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:48 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:49.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:48 smithi077 ceph-mon[110441]: pgmap v198: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 7.9 MiB/s rd, 5.0 KiB/s wr, 7 op/s 2024-04-25T02:18:49.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:48 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:49.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:48 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:49.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:48 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:18:49.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:48 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:18:49.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:48 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:50.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:18:50.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:18:50.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:18:50.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:18:50.028 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:49 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:18:50.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:18:50.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:18:50.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:18:50.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:18:50.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:49 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:18:51.167 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:50 smithi112 ceph-mon[80494]: pgmap v199: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 5.9 MiB/s rd, 5.0 KiB/s wr, 7 op/s 2024-04-25T02:18:51.168 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:50 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:51.168 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:50 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.fjnadi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:18:51.168 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:50 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:18:51.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:50 smithi077 ceph-mon[110441]: pgmap v199: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 5.9 MiB/s rd, 5.0 KiB/s wr, 7 op/s 2024-04-25T02:18:51.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:50 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:18:51.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:50 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.fjnadi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:18:51.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:50 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:18:51.897 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:51 smithi112 ceph-mon[80494]: Upgrade: Updating mds.cephfs.smithi112.fjnadi 2024-04-25T02:18:51.897 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:51 smithi112 ceph-mon[80494]: Deploying daemon mds.cephfs.smithi112.fjnadi on smithi112 2024-04-25T02:18:52.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:51 smithi077 ceph-mon[110441]: Upgrade: Updating mds.cephfs.smithi112.fjnadi 2024-04-25T02:18:52.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:51 smithi077 ceph-mon[110441]: Deploying daemon mds.cephfs.smithi112.fjnadi on smithi112 2024-04-25T02:18:52.863 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:52 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi077[110436]: 2024-04-25T02:18:52.548+0000 7f54c798e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:18:52.864 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:18:52 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3[89576]: 2024-04-25T02:18:52.572+0000 7fe7b6ca4700 -1 bdev(0x5582473da000 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 5 2024-04-25T02:18:52.864 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:18:52 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3[89576]: 2024-04-25T02:18:52.573+0000 7fe7b4ca0700 -1 bdev(0x5582473da000 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 7 2024-04-25T02:18:53.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:52 smithi077 ceph-mon[110441]: pgmap v200: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-04-25T02:18:53.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:52 smithi077 ceph-mon[110441]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-25T02:18:53.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:52 smithi077 ceph-mon[110441]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:18:53.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:52 smithi077 ceph-mon[110441]: osdmap e84: 6 total, 6 up, 6 in 2024-04-25T02:18:53.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:52 smithi077 ceph-mon[110441]: Standby daemon mds.cephfs.smithi077.oadrkb assigned to filesystem cephfs as rank 0 2024-04-25T02:18:53.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:52 smithi077 ceph-mon[110441]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-25T02:18:53.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:52 smithi077 ceph-mon[110441]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-25T02:18:53.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:52 smithi077 ceph-mon[110441]: fsmap cephfs:1/1 {0=cephfs.smithi077.oadrkb=up:replay} 2 up:standby 2024-04-25T02:18:53.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:52 smithi112 ceph-mon[80494]: pgmap v200: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-04-25T02:18:53.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:52 smithi112 ceph-mon[80494]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-25T02:18:53.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:52 smithi112 ceph-mon[80494]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:18:53.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:52 smithi112 ceph-mon[80494]: osdmap e84: 6 total, 6 up, 6 in 2024-04-25T02:18:53.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:52 smithi112 ceph-mon[80494]: Standby daemon mds.cephfs.smithi077.oadrkb assigned to filesystem cephfs as rank 0 2024-04-25T02:18:53.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:52 smithi112 ceph-mon[80494]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-25T02:18:53.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:52 smithi112 ceph-mon[80494]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-25T02:18:53.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:52 smithi112 ceph-mon[80494]: fsmap cephfs:1/1 {0=cephfs.smithi077.oadrkb=up:replay} 2 up:standby 2024-04-25T02:18:54.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:53 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:18:54.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:53 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:18:55.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:54 smithi077 ceph-mon[110441]: pgmap v202: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 5.7 KiB/s wr, 6 op/s 2024-04-25T02:18:55.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:54 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.fjnadi"}]: dispatch 2024-04-25T02:18:55.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:54 smithi112 ceph-mon[80494]: pgmap v202: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 5.7 KiB/s wr, 6 op/s 2024-04-25T02:18:55.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:54 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.fjnadi"}]: dispatch 2024-04-25T02:18:57.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:56 smithi077 ceph-mon[110441]: pgmap v203: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 6.6 MiB/s rd, 0 B/s wr, 3 op/s 2024-04-25T02:18:57.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:56 smithi112 ceph-mon[80494]: pgmap v203: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 6.6 MiB/s rd, 0 B/s wr, 3 op/s 2024-04-25T02:18:59.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:18:58 smithi077 ceph-mon[110441]: pgmap v204: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 9.4 MiB/s rd, 0 B/s wr, 3 op/s 2024-04-25T02:18:59.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:18:58 smithi112 ceph-mon[80494]: pgmap v204: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 9.4 MiB/s rd, 0 B/s wr, 3 op/s 2024-04-25T02:19:01.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:00 smithi077 ceph-mon[110441]: pgmap v205: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-04-25T02:19:01.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:00 smithi112 ceph-mon[80494]: pgmap v205: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-04-25T02:19:02.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:01 smithi077 ceph-mon[110441]: reconnect by client.14512 v1:192.168.0.1:0/1415948385 after 0.000999979 2024-04-25T02:19:02.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:01 smithi077 ceph-mon[110441]: reconnect by client.14518 v1:172.21.15.112:0/2995074108 after 0.000999979 2024-04-25T02:19:02.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:01 smithi077 ceph-mon[110441]: mds.? [v2:172.21.15.77:6826/1829655283,v1:172.21.15.77:6827/1829655283] up:reconnect 2024-04-25T02:19:02.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:01 smithi077 ceph-mon[110441]: fsmap cephfs:1/1 {0=cephfs.smithi077.oadrkb=up:reconnect} 2 up:standby 2024-04-25T02:19:02.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:01 smithi112 ceph-mon[80494]: reconnect by client.14512 v1:192.168.0.1:0/1415948385 after 0.000999979 2024-04-25T02:19:02.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:01 smithi112 ceph-mon[80494]: reconnect by client.14518 v1:172.21.15.112:0/2995074108 after 0.000999979 2024-04-25T02:19:02.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:01 smithi112 ceph-mon[80494]: mds.? [v2:172.21.15.77:6826/1829655283,v1:172.21.15.77:6827/1829655283] up:reconnect 2024-04-25T02:19:02.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:01 smithi112 ceph-mon[80494]: fsmap cephfs:1/1 {0=cephfs.smithi077.oadrkb=up:reconnect} 2 up:standby 2024-04-25T02:19:03.073 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:02 smithi112 ceph-mon[80494]: pgmap v206: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-25T02:19:03.073 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:02 smithi112 ceph-mon[80494]: mds.? [v2:172.21.15.77:6826/1829655283,v1:172.21.15.77:6827/1829655283] up:rejoin 2024-04-25T02:19:03.073 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:02 smithi112 ceph-mon[80494]: fsmap cephfs:1/1 {0=cephfs.smithi077.oadrkb=up:rejoin} 2 up:standby 2024-04-25T02:19:03.073 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:02 smithi112 ceph-mon[80494]: daemon mds.cephfs.smithi077.oadrkb is now active in filesystem cephfs as rank 0 2024-04-25T02:19:03.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:02 smithi077 ceph-mon[110441]: pgmap v206: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-25T02:19:03.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:02 smithi077 ceph-mon[110441]: mds.? [v2:172.21.15.77:6826/1829655283,v1:172.21.15.77:6827/1829655283] up:rejoin 2024-04-25T02:19:03.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:02 smithi077 ceph-mon[110441]: fsmap cephfs:1/1 {0=cephfs.smithi077.oadrkb=up:rejoin} 2 up:standby 2024-04-25T02:19:03.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:02 smithi077 ceph-mon[110441]: daemon mds.cephfs.smithi077.oadrkb is now active in filesystem cephfs as rank 0 2024-04-25T02:19:04.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:03 smithi077 ceph-mon[110441]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-25T02:19:04.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:03 smithi077 ceph-mon[110441]: Cluster is now healthy 2024-04-25T02:19:04.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:03 smithi077 ceph-mon[110441]: mds.? [v2:172.21.15.77:6826/1829655283,v1:172.21.15.77:6827/1829655283] up:active 2024-04-25T02:19:04.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:03 smithi077 ceph-mon[110441]: fsmap cephfs:1 {0=cephfs.smithi077.oadrkb=up:active} 2 up:standby 2024-04-25T02:19:04.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:03 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:04.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:03 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:04.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:03 smithi112 ceph-mon[80494]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-25T02:19:04.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:03 smithi112 ceph-mon[80494]: Cluster is now healthy 2024-04-25T02:19:04.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:03 smithi112 ceph-mon[80494]: mds.? [v2:172.21.15.77:6826/1829655283,v1:172.21.15.77:6827/1829655283] up:active 2024-04-25T02:19:04.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:03 smithi112 ceph-mon[80494]: fsmap cephfs:1 {0=cephfs.smithi077.oadrkb=up:active} 2 up:standby 2024-04-25T02:19:04.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:03 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:04.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:03 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:04.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.941+0000 7f9ea3eb3700 1 -- 172.21.15.77:0/2254582537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e9c0fde00 msgr2=0x7f9e9c0fe1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:04.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.941+0000 7f9ea3eb3700 1 --2- 172.21.15.77:0/2254582537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e9c0fde00 0x7f9e9c0fe1d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9e98004880 tx=0x7f9e98009e30 comp rx=0 tx=0).stop 2024-04-25T02:19:04.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.941+0000 7f9ea3eb3700 1 -- 172.21.15.77:0/2254582537 shutdown_connections 2024-04-25T02:19:04.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.941+0000 7f9ea3eb3700 1 --2- 172.21.15.77:0/2254582537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e9c0fe7a0 0x7f9e9c106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:04.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.941+0000 7f9ea3eb3700 1 --2- 172.21.15.77:0/2254582537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e9c0fde00 0x7f9e9c0fe1d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:04.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.941+0000 7f9ea3eb3700 1 -- 172.21.15.77:0/2254582537 >> 172.21.15.77:0/2254582537 conn(0x7f9e9c0f7860 msgr2=0x7f9e9c0f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:04.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.941+0000 7f9ea3eb3700 1 -- 172.21.15.77:0/2254582537 shutdown_connections 2024-04-25T02:19:04.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.941+0000 7f9ea3eb3700 1 -- 172.21.15.77:0/2254582537 wait complete. 2024-04-25T02:19:04.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.941+0000 7f9ea3eb3700 1 Processor -- start 2024-04-25T02:19:04.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.941+0000 7f9ea3eb3700 1 -- start start 2024-04-25T02:19:04.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.942+0000 7f9ea3eb3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e9c0fde00 0x7f9e9c0fbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:04.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.942+0000 7f9ea3eb3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e9c0fe7a0 0x7f9e9c0fc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:04.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.942+0000 7f9ea3eb3700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c0fdc10 con 0x7f9e9c0fe7a0 2024-04-25T02:19:04.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.942+0000 7f9ea3eb3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c0fc740 con 0x7f9e9c0fde00 2024-04-25T02:19:04.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.942+0000 7f9ea144e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e9c0fe7a0 0x7f9e9c0fc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:04.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.942+0000 7f9ea144e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e9c0fe7a0 0x7f9e9c0fc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45026/0 (socket says 172.21.15.77:45026) 2024-04-25T02:19:04.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.942+0000 7f9ea144e700 1 -- 172.21.15.77:0/336957549 learned_addr learned my addr 172.21.15.77:0/336957549 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:19:04.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.942+0000 7f9ea1c4f700 1 --2- 172.21.15.77:0/336957549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e9c0fde00 0x7f9e9c0fbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:04.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.942+0000 7f9ea144e700 1 -- 172.21.15.77:0/336957549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e9c0fde00 msgr2=0x7f9e9c0fbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:04.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.942+0000 7f9ea144e700 1 --2- 172.21.15.77:0/336957549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e9c0fde00 0x7f9e9c0fbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:04.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.942+0000 7f9ea144e700 1 -- 172.21.15.77:0/336957549 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e98005040 con 0x7f9e9c0fe7a0 2024-04-25T02:19:04.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.942+0000 7f9ea1c4f700 1 --2- 172.21.15.77:0/336957549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e9c0fde00 0x7f9e9c0fbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:19:04.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.942+0000 7f9ea144e700 1 --2- 172.21.15.77:0/336957549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e9c0fe7a0 0x7f9e9c0fc200 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c00eaf0 tx=0x7f9e8c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:04.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.943+0000 7f9e927fc700 1 -- 172.21.15.77:0/336957549 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e8c007cc0 con 0x7f9e9c0fe7a0 2024-04-25T02:19:04.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.943+0000 7f9e927fc700 1 -- 172.21.15.77:0/336957549 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e8c00f040 con 0x7f9e9c0fe7a0 2024-04-25T02:19:04.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.943+0000 7f9e927fc700 1 -- 172.21.15.77:0/336957549 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e8c00cb90 con 0x7f9e9c0fe7a0 2024-04-25T02:19:04.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.943+0000 7f9ea3eb3700 1 -- 172.21.15.77:0/336957549 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e9c0fc9c0 con 0x7f9e9c0fe7a0 2024-04-25T02:19:04.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.943+0000 7f9ea3eb3700 1 -- 172.21.15.77:0/336957549 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e9c11a070 con 0x7f9e9c0fe7a0 2024-04-25T02:19:04.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.944+0000 7f9ea3eb3700 1 -- 172.21.15.77:0/336957549 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e9c066b10 con 0x7f9e9c0fe7a0 2024-04-25T02:19:04.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.944+0000 7f9e927fc700 1 -- 172.21.15.77:0/336957549 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9e8c00ccf0 con 0x7f9e9c0fe7a0 2024-04-25T02:19:04.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.945+0000 7f9e927fc700 1 --2- 172.21.15.77:0/336957549 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f9e8806e140 0x7f9e880705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:04.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.945+0000 7f9e927fc700 1 -- 172.21.15.77:0/336957549 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f9e8c08d820 con 0x7f9e9c0fe7a0 2024-04-25T02:19:04.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.945+0000 7f9ea1c4f700 1 --2- 172.21.15.77:0/336957549 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f9e8806e140 0x7f9e880705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:04.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.945+0000 7f9ea1c4f700 1 --2- 172.21.15.77:0/336957549 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f9e8806e140 0x7f9e880705f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9e980040d0 tx=0x7f9e98009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:04.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:04.950+0000 7f9e927fc700 1 -- 172.21.15.77:0/336957549 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f9e8c056b50 con 0x7f9e9c0fe7a0 2024-04-25T02:19:05.026 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:04 smithi112 ceph-mon[80494]: pgmap v207: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-04-25T02:19:05.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:04 smithi112 ceph-mon[80494]: mds.? [v2:172.21.15.112:6826/1789386749,v1:172.21.15.112:6827/1789386749] up:boot 2024-04-25T02:19:05.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:04 smithi112 ceph-mon[80494]: fsmap cephfs:1 {0=cephfs.smithi077.oadrkb=up:active} 3 up:standby 2024-04-25T02:19:05.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:04 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.fjnadi"}]: dispatch 2024-04-25T02:19:05.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:04 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:19:05.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.167+0000 7f9ea3eb3700 1 -- 172.21.15.77:0/336957549 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e9c05e3a0 con 0x7f9e8806e140 2024-04-25T02:19:05.172 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:04 smithi077 ceph-mon[110441]: pgmap v207: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-04-25T02:19:05.172 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:04 smithi077 ceph-mon[110441]: mds.? [v2:172.21.15.112:6826/1789386749,v1:172.21.15.112:6827/1789386749] up:boot 2024-04-25T02:19:05.172 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:04 smithi077 ceph-mon[110441]: fsmap cephfs:1 {0=cephfs.smithi077.oadrkb=up:active} 3 up:standby 2024-04-25T02:19:05.172 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:04 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.fjnadi"}]: dispatch 2024-04-25T02:19:05.172 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:04 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:19:05.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.168+0000 7f9e927fc700 1 -- 172.21.15.77:0/336957549 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9e9c05e3a0 con 0x7f9e8806e140 2024-04-25T02:19:05.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.170+0000 7f9ea3eb3700 1 -- 172.21.15.77:0/336957549 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f9e8806e140 msgr2=0x7f9e880705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:05.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.170+0000 7f9ea3eb3700 1 --2- 172.21.15.77:0/336957549 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f9e8806e140 0x7f9e880705f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9e980040d0 tx=0x7f9e98009e30 comp rx=0 tx=0).stop 2024-04-25T02:19:05.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.170+0000 7f9ea3eb3700 1 -- 172.21.15.77:0/336957549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e9c0fe7a0 msgr2=0x7f9e9c0fc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:05.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.170+0000 7f9ea3eb3700 1 --2- 172.21.15.77:0/336957549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e9c0fe7a0 0x7f9e9c0fc200 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c00eaf0 tx=0x7f9e8c00b040 comp rx=0 tx=0).stop 2024-04-25T02:19:05.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.170+0000 7f9ea3eb3700 1 -- 172.21.15.77:0/336957549 shutdown_connections 2024-04-25T02:19:05.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.170+0000 7f9ea3eb3700 1 --2- 172.21.15.77:0/336957549 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f9e8806e140 0x7f9e880705f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:05.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.170+0000 7f9ea3eb3700 1 --2- 172.21.15.77:0/336957549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e9c0fde00 0x7f9e9c0fbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:05.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.170+0000 7f9ea3eb3700 1 --2- 172.21.15.77:0/336957549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e9c0fe7a0 0x7f9e9c0fc200 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:05.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.170+0000 7f9ea3eb3700 1 -- 172.21.15.77:0/336957549 >> 172.21.15.77:0/336957549 conn(0x7f9e9c0f7860 msgr2=0x7f9e9c0ff330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:05.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.171+0000 7f9ea3eb3700 1 -- 172.21.15.77:0/336957549 shutdown_connections 2024-04-25T02:19:05.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.171+0000 7f9ea3eb3700 1 -- 172.21.15.77:0/336957549 wait complete. 2024-04-25T02:19:05.185 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-04-25T02:19:05.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.272+0000 7fb475bc2700 1 -- 172.21.15.77:0/3938906090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4700fbd40 msgr2=0x7fb4700fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:05.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.272+0000 7fb475bc2700 1 --2- 172.21.15.77:0/3938906090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4700fbd40 0x7fb4700fc1b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb458004940 tx=0x7fb458009e30 comp rx=0 tx=0).stop 2024-04-25T02:19:05.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.272+0000 7fb475bc2700 1 -- 172.21.15.77:0/3938906090 shutdown_connections 2024-04-25T02:19:05.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.272+0000 7fb475bc2700 1 --2- 172.21.15.77:0/3938906090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4700fbd40 0x7fb4700fc1b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:05.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.272+0000 7fb475bc2700 1 --2- 172.21.15.77:0/3938906090 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb470101d90 0x7fb470102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:05.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.272+0000 7fb475bc2700 1 -- 172.21.15.77:0/3938906090 >> 172.21.15.77:0/3938906090 conn(0x7fb470071d00 msgr2=0x7fb470072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:05.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.272+0000 7fb475bc2700 1 -- 172.21.15.77:0/3938906090 shutdown_connections 2024-04-25T02:19:05.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.272+0000 7fb475bc2700 1 -- 172.21.15.77:0/3938906090 wait complete. 2024-04-25T02:19:05.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.273+0000 7fb475bc2700 1 Processor -- start 2024-04-25T02:19:05.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.273+0000 7fb475bc2700 1 -- start start 2024-04-25T02:19:05.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.273+0000 7fb475bc2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4700fbd40 0x7fb47010ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:05.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.273+0000 7fb475bc2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb470101d90 0x7fb47010f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:05.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.273+0000 7fb475bc2700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47010f770 con 0x7fb4700fbd40 2024-04-25T02:19:05.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.273+0000 7fb475bc2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47010f8b0 con 0x7fb470101d90 2024-04-25T02:19:05.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.273+0000 7fb46f7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4700fbd40 0x7fb47010ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:05.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.273+0000 7fb46f7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4700fbd40 0x7fb47010ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45044/0 (socket says 172.21.15.77:45044) 2024-04-25T02:19:05.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.273+0000 7fb46f7fe700 1 -- 172.21.15.77:0/4168676557 learned_addr learned my addr 172.21.15.77:0/4168676557 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:19:05.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.274+0000 7fb467fff700 1 --2- 172.21.15.77:0/4168676557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb470101d90 0x7fb47010f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:05.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.274+0000 7fb46f7fe700 1 -- 172.21.15.77:0/4168676557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb470101d90 msgr2=0x7fb47010f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:05.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.274+0000 7fb46f7fe700 1 --2- 172.21.15.77:0/4168676557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb470101d90 0x7fb47010f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:05.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.274+0000 7fb46f7fe700 1 -- 172.21.15.77:0/4168676557 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb458005040 con 0x7fb4700fbd40 2024-04-25T02:19:05.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.274+0000 7fb46f7fe700 1 --2- 172.21.15.77:0/4168676557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4700fbd40 0x7fb47010ecf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb460002a50 tx=0x7fb4600046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:05.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.274+0000 7fb46cff9700 1 -- 172.21.15.77:0/4168676557 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb460007cc0 con 0x7fb4700fbd40 2024-04-25T02:19:05.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.274+0000 7fb475bc2700 1 -- 172.21.15.77:0/4168676557 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb470117ba0 con 0x7fb4700fbd40 2024-04-25T02:19:05.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.274+0000 7fb46cff9700 1 -- 172.21.15.77:0/4168676557 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb46000f040 con 0x7fb4700fbd40 2024-04-25T02:19:05.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.274+0000 7fb46cff9700 1 -- 172.21.15.77:0/4168676557 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb46000da30 con 0x7fb4700fbd40 2024-04-25T02:19:05.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.274+0000 7fb475bc2700 1 -- 172.21.15.77:0/4168676557 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb470118130 con 0x7fb4700fbd40 2024-04-25T02:19:05.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.275+0000 7fb475bc2700 1 -- 172.21.15.77:0/4168676557 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4700fd430 con 0x7fb4700fbd40 2024-04-25T02:19:05.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.276+0000 7fb46cff9700 1 -- 172.21.15.77:0/4168676557 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb46000dc10 con 0x7fb4700fbd40 2024-04-25T02:19:05.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.276+0000 7fb46cff9700 1 --2- 172.21.15.77:0/4168676557 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb45c06e150 0x7fb45c070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:05.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.276+0000 7fb46cff9700 1 -- 172.21.15.77:0/4168676557 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb46008d940 con 0x7fb4700fbd40 2024-04-25T02:19:05.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.276+0000 7fb467fff700 1 --2- 172.21.15.77:0/4168676557 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb45c06e150 0x7fb45c070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:05.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.277+0000 7fb467fff700 1 --2- 172.21.15.77:0/4168676557 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb45c06e150 0x7fb45c070600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb470066000 tx=0x7fb458009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:05.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.281+0000 7fb46cff9700 1 -- 172.21.15.77:0/4168676557 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fb460056c70 con 0x7fb4700fbd40 2024-04-25T02:19:05.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.498+0000 7fb475bc2700 1 -- 172.21.15.77:0/4168676557 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb470065db0 con 0x7fb45c06e150 2024-04-25T02:19:05.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.499+0000 7fb46cff9700 1 -- 172.21.15.77:0/4168676557 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb470065db0 con 0x7fb45c06e150 2024-04-25T02:19:05.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.501+0000 7fb475bc2700 1 -- 172.21.15.77:0/4168676557 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb45c06e150 msgr2=0x7fb45c070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:05.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.501+0000 7fb475bc2700 1 --2- 172.21.15.77:0/4168676557 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb45c06e150 0x7fb45c070600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb470066000 tx=0x7fb458009e30 comp rx=0 tx=0).stop 2024-04-25T02:19:05.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.501+0000 7fb475bc2700 1 -- 172.21.15.77:0/4168676557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4700fbd40 msgr2=0x7fb47010ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:05.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.501+0000 7fb475bc2700 1 --2- 172.21.15.77:0/4168676557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4700fbd40 0x7fb47010ecf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb460002a50 tx=0x7fb4600046b0 comp rx=0 tx=0).stop 2024-04-25T02:19:05.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.501+0000 7fb475bc2700 1 -- 172.21.15.77:0/4168676557 shutdown_connections 2024-04-25T02:19:05.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.501+0000 7fb475bc2700 1 --2- 172.21.15.77:0/4168676557 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb45c06e150 0x7fb45c070600 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:05.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.501+0000 7fb475bc2700 1 --2- 172.21.15.77:0/4168676557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4700fbd40 0x7fb47010ecf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:05.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.501+0000 7fb475bc2700 1 --2- 172.21.15.77:0/4168676557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb470101d90 0x7fb47010f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:05.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.501+0000 7fb475bc2700 1 -- 172.21.15.77:0/4168676557 >> 172.21.15.77:0/4168676557 conn(0x7fb470071d00 msgr2=0x7fb4700fa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:05.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.502+0000 7fb475bc2700 1 -- 172.21.15.77:0/4168676557 shutdown_connections 2024-04-25T02:19:05.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.502+0000 7fb475bc2700 1 -- 172.21.15.77:0/4168676557 wait complete. 2024-04-25T02:19:05.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.603+0000 7fa36f05c700 1 -- 172.21.15.77:0/3664802044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa368103780 msgr2=0x7fa3680fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:05.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.603+0000 7fa36f05c700 1 --2- 172.21.15.77:0/3664802044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa368103780 0x7fa3680fcdf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa358004940 tx=0x7fa358009e30 comp rx=0 tx=0).stop 2024-04-25T02:19:05.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.603+0000 7fa36f05c700 1 -- 172.21.15.77:0/3664802044 shutdown_connections 2024-04-25T02:19:05.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.603+0000 7fa36f05c700 1 --2- 172.21.15.77:0/3664802044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa368103780 0x7fa3680fcdf0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:05.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.603+0000 7fa36f05c700 1 --2- 172.21.15.77:0/3664802044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa368102de0 0x7fa3681031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:05.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.603+0000 7fa36f05c700 1 -- 172.21.15.77:0/3664802044 >> 172.21.15.77:0/3664802044 conn(0x7fa3680f8990 msgr2=0x7fa3680fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:05.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.603+0000 7fa36f05c700 1 -- 172.21.15.77:0/3664802044 shutdown_connections 2024-04-25T02:19:05.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.603+0000 7fa36f05c700 1 -- 172.21.15.77:0/3664802044 wait complete. 2024-04-25T02:19:05.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.603+0000 7fa36f05c700 1 Processor -- start 2024-04-25T02:19:05.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.603+0000 7fa36f05c700 1 -- start start 2024-04-25T02:19:05.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.604+0000 7fa36f05c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa368102de0 0x7fa368115bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:05.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.604+0000 7fa36f05c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa368103780 0x7fa368116130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:05.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.604+0000 7fa36f05c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa368116780 con 0x7fa368102de0 2024-04-25T02:19:05.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.604+0000 7fa36f05c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36810fd60 con 0x7fa368103780 2024-04-25T02:19:05.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.604+0000 7fa36cdf8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa368102de0 0x7fa368115bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:05.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.604+0000 7fa36cdf8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa368102de0 0x7fa368115bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45068/0 (socket says 172.21.15.77:45068) 2024-04-25T02:19:05.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.604+0000 7fa36cdf8700 1 -- 172.21.15.77:0/2513355749 learned_addr learned my addr 172.21.15.77:0/2513355749 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:19:05.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.604+0000 7fa35ffff700 1 --2- 172.21.15.77:0/2513355749 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa368103780 0x7fa368116130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:05.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.604+0000 7fa36cdf8700 1 -- 172.21.15.77:0/2513355749 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa368103780 msgr2=0x7fa368116130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:05.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.604+0000 7fa36cdf8700 1 --2- 172.21.15.77:0/2513355749 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa368103780 0x7fa368116130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:05.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.604+0000 7fa36cdf8700 1 -- 172.21.15.77:0/2513355749 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa358005040 con 0x7fa368102de0 2024-04-25T02:19:05.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.604+0000 7fa36cdf8700 1 --2- 172.21.15.77:0/2513355749 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa368102de0 0x7fa368115bf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa364001d80 tx=0x7fa364009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:05.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.604+0000 7fa35d7fa700 1 -- 172.21.15.77:0/2513355749 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa364007d10 con 0x7fa368102de0 2024-04-25T02:19:05.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.604+0000 7fa35d7fa700 1 -- 172.21.15.77:0/2513355749 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa364001e80 con 0x7fa368102de0 2024-04-25T02:19:05.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.604+0000 7fa36f05c700 1 -- 172.21.15.77:0/2513355749 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa368110040 con 0x7fa368102de0 2024-04-25T02:19:05.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.604+0000 7fa35d7fa700 1 -- 172.21.15.77:0/2513355749 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa364014640 con 0x7fa368102de0 2024-04-25T02:19:05.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.605+0000 7fa36f05c700 1 -- 172.21.15.77:0/2513355749 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa368110580 con 0x7fa368102de0 2024-04-25T02:19:05.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.605+0000 7fa36f05c700 1 -- 172.21.15.77:0/2513355749 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3680fe530 con 0x7fa368102de0 2024-04-25T02:19:05.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.606+0000 7fa35d7fa700 1 -- 172.21.15.77:0/2513355749 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa36400e960 con 0x7fa368102de0 2024-04-25T02:19:05.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.606+0000 7fa35d7fa700 1 --2- 172.21.15.77:0/2513355749 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fa35006e140 0x7fa3500705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:05.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.607+0000 7fa35d7fa700 1 -- 172.21.15.77:0/2513355749 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa36408d830 con 0x7fa368102de0 2024-04-25T02:19:05.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.607+0000 7fa35ffff700 1 --2- 172.21.15.77:0/2513355749 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fa35006e140 0x7fa3500705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:05.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.607+0000 7fa35ffff700 1 --2- 172.21.15.77:0/2513355749 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fa35006e140 0x7fa3500705f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa368111490 tx=0x7fa358009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:05.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.611+0000 7fa35d7fa700 1 -- 172.21.15.77:0/2513355749 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fa36405a7c0 con 0x7fa368102de0 2024-04-25T02:19:05.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.821+0000 7fa36f05c700 1 -- 172.21.15.77:0/2513355749 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3681112b0 con 0x7fa35006e140 2024-04-25T02:19:05.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.830+0000 7fa35d7fa700 1 -- 172.21.15.77:0/2513355749 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fa3681112b0 con 0x7fa35006e140 2024-04-25T02:19:05.835 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T02:19:05.835 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (7m) 42s ago 18m 26.8M - 0.25.0 c8568f914cd2 699c7fd25ea5 2024-04-25T02:19:05.835 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (4m) 42s ago 18m 6660k - 19.0.0-2445-gd2c45d97 f68e37b807ef f3c45d31e2e3 2024-04-25T02:19:05.835 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi112 smithi112 running (4m) 21s ago 17m 6656k - 19.0.0-2445-gd2c45d97 f68e37b807ef e16d9899ed11 2024-04-25T02:19:05.835 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (6m) 42s ago 17m 79.4M - 9.4.12 2bacad6d85d8 900138b0bcf0 2024-04-25T02:19:05.835 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.gcfygj smithi077 running (47s) 42s ago 12m 11.6M - 19.0.0-2445-gd2c45d97 f68e37b807ef 25bb04d1a9c3 2024-04-25T02:19:05.836 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.oadrkb smithi077 running (67s) 42s ago 12m 11.5M - 19.0.0-2445-gd2c45d97 f68e37b807ef e34ba410a62c 2024-04-25T02:19:05.836 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.dvwudt smithi112 running (26s) 21s ago 12m 11.5M - 19.0.0-2445-gd2c45d97 f68e37b807ef 6334abfd52be 2024-04-25T02:19:05.836 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.fjnadi smithi112 starting - - - - 2024-04-25T02:19:05.836 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.zpflzp smithi077 *:8443,9283,8765 running (8m) 42s ago 19m 508M - 19.0.0-2445-gd2c45d97 f68e37b807ef a1af92e027e5 2024-04-25T02:19:05.836 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi112.cswrxs smithi112 *:8443,9283,8765 running (8m) 21s ago 17m 451M - 19.0.0-2445-gd2c45d97 f68e37b807ef ccc7c57d35f2 2024-04-25T02:19:05.836 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (5m) 42s ago 19m 53.0M 2048M 19.0.0-2445-gd2c45d97 f68e37b807ef 06490c2ecc44 2024-04-25T02:19:05.836 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi112 smithi112 running (5m) 21s ago 17m 41.9M 2048M 19.0.0-2445-gd2c45d97 f68e37b807ef ccd1398acbc5 2024-04-25T02:19:05.836 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (7m) 42s ago 18m 16.7M - 1.5.0 0da6a335fe13 2320132606fc 2024-04-25T02:19:05.836 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi112 smithi112 *:9100 running (7m) 21s ago 17m 14.7M - 1.5.0 0da6a335fe13 49f285354791 2024-04-25T02:19:05.836 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (4m) 42s ago 16m 98.6M 1557M 19.0.0-2445-gd2c45d97 f68e37b807ef 7035e288ddae 2024-04-25T02:19:05.836 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (3m) 42s ago 16m 113M 1557M 19.0.0-2445-gd2c45d97 f68e37b807ef 6e514f700c36 2024-04-25T02:19:05.836 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (3m) 42s ago 15m 98.1M 1557M 19.0.0-2445-gd2c45d97 f68e37b807ef 392fd2036c16 2024-04-25T02:19:05.836 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi112 running (2m) 21s ago 15m 119M 2581M 19.0.0-2445-gd2c45d97 f68e37b807ef c100df1a0f60 2024-04-25T02:19:05.836 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi112 running (118s) 21s ago 14m 107M 2581M 19.0.0-2445-gd2c45d97 f68e37b807ef 669b1ab41e27 2024-04-25T02:19:05.836 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi112 running (85s) 21s ago 14m 105M 2581M 19.0.0-2445-gd2c45d97 f68e37b807ef cc8f3462943e 2024-04-25T02:19:05.836 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (7m) 42s ago 17m 59.4M - 2.43.0 a07b618ecd1d c5b8c6104d96 2024-04-25T02:19:05.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.832+0000 7fa36f05c700 1 -- 172.21.15.77:0/2513355749 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fa35006e140 msgr2=0x7fa3500705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:05.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.832+0000 7fa36f05c700 1 --2- 172.21.15.77:0/2513355749 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fa35006e140 0x7fa3500705f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa368111490 tx=0x7fa358009e30 comp rx=0 tx=0).stop 2024-04-25T02:19:05.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.832+0000 7fa36f05c700 1 -- 172.21.15.77:0/2513355749 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa368102de0 msgr2=0x7fa368115bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:05.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.832+0000 7fa36f05c700 1 --2- 172.21.15.77:0/2513355749 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa368102de0 0x7fa368115bf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa364001d80 tx=0x7fa364009ec0 comp rx=0 tx=0).stop 2024-04-25T02:19:05.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.833+0000 7fa36f05c700 1 -- 172.21.15.77:0/2513355749 shutdown_connections 2024-04-25T02:19:05.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.833+0000 7fa36f05c700 1 --2- 172.21.15.77:0/2513355749 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fa35006e140 0x7fa3500705f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:05.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.833+0000 7fa36f05c700 1 --2- 172.21.15.77:0/2513355749 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa368102de0 0x7fa368115bf0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:05.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.833+0000 7fa36f05c700 1 --2- 172.21.15.77:0/2513355749 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa368103780 0x7fa368116130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:05.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.833+0000 7fa36f05c700 1 -- 172.21.15.77:0/2513355749 >> 172.21.15.77:0/2513355749 conn(0x7fa3680f8990 msgr2=0x7fa3680f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:05.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.833+0000 7fa36f05c700 1 -- 172.21.15.77:0/2513355749 shutdown_connections 2024-04-25T02:19:05.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.833+0000 7fa36f05c700 1 -- 172.21.15.77:0/2513355749 wait complete. 2024-04-25T02:19:05.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.932+0000 7fbf87fab700 1 -- 172.21.15.77:0/1829433974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf801004d0 msgr2=0x7fbf801008a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:05.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.932+0000 7fbf87fab700 1 --2- 172.21.15.77:0/1829433974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf801004d0 0x7fbf801008a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c004940 tx=0x7fbf7c009e30 comp rx=0 tx=0).stop 2024-04-25T02:19:05.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.933+0000 7fbf87fab700 1 -- 172.21.15.77:0/1829433974 shutdown_connections 2024-04-25T02:19:05.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.933+0000 7fbf87fab700 1 --2- 172.21.15.77:0/1829433974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf800fb5a0 0x7fbf800fba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:05.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.933+0000 7fbf87fab700 1 --2- 172.21.15.77:0/1829433974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf801004d0 0x7fbf801008a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:05.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.933+0000 7fbf87fab700 1 -- 172.21.15.77:0/1829433974 >> 172.21.15.77:0/1829433974 conn(0x7fbf800714d0 msgr2=0x7fbf800718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:05.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.933+0000 7fbf87fab700 1 -- 172.21.15.77:0/1829433974 shutdown_connections 2024-04-25T02:19:05.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.933+0000 7fbf87fab700 1 -- 172.21.15.77:0/1829433974 wait complete. 2024-04-25T02:19:05.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.933+0000 7fbf87fab700 1 Processor -- start 2024-04-25T02:19:05.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.933+0000 7fbf87fab700 1 -- start start 2024-04-25T02:19:05.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.933+0000 7fbf87fab700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf800fb5a0 0x7fbf800fd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:05.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.933+0000 7fbf87fab700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf801004d0 0x7fbf800fd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:05.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.933+0000 7fbf87fab700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf800ff0c0 con 0x7fbf801004d0 2024-04-25T02:19:05.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.933+0000 7fbf87fab700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf800fdbf0 con 0x7fbf800fb5a0 2024-04-25T02:19:05.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.934+0000 7fbf85546700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf801004d0 0x7fbf800fd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:05.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.934+0000 7fbf85546700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf801004d0 0x7fbf800fd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45088/0 (socket says 172.21.15.77:45088) 2024-04-25T02:19:05.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.934+0000 7fbf85546700 1 -- 172.21.15.77:0/149406422 learned_addr learned my addr 172.21.15.77:0/149406422 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:19:05.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.934+0000 7fbf85d47700 1 --2- 172.21.15.77:0/149406422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf800fb5a0 0x7fbf800fd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:05.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.934+0000 7fbf85546700 1 -- 172.21.15.77:0/149406422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf800fb5a0 msgr2=0x7fbf800fd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:05.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.934+0000 7fbf85546700 1 --2- 172.21.15.77:0/149406422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf800fb5a0 0x7fbf800fd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:05.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.934+0000 7fbf85546700 1 -- 172.21.15.77:0/149406422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7c005040 con 0x7fbf801004d0 2024-04-25T02:19:05.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.934+0000 7fbf85546700 1 --2- 172.21.15.77:0/149406422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf801004d0 0x7fbf800fd6b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbf7000a6c0 tx=0x7fbf7000c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:05.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.934+0000 7fbf767fc700 1 -- 172.21.15.77:0/149406422 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf7000ab50 con 0x7fbf801004d0 2024-04-25T02:19:05.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.934+0000 7fbf87fab700 1 -- 172.21.15.77:0/149406422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf800fde70 con 0x7fbf801004d0 2024-04-25T02:19:05.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.934+0000 7fbf767fc700 1 -- 172.21.15.77:0/149406422 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbf70010040 con 0x7fbf801004d0 2024-04-25T02:19:05.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.934+0000 7fbf767fc700 1 -- 172.21.15.77:0/149406422 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf7000e9c0 con 0x7fbf801004d0 2024-04-25T02:19:05.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.934+0000 7fbf87fab700 1 -- 172.21.15.77:0/149406422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8011a020 con 0x7fbf801004d0 2024-04-25T02:19:05.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.935+0000 7fbf87fab700 1 -- 172.21.15.77:0/149406422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf80105a90 con 0x7fbf801004d0 2024-04-25T02:19:05.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.936+0000 7fbf767fc700 1 -- 172.21.15.77:0/149406422 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fbf70007cc0 con 0x7fbf801004d0 2024-04-25T02:19:05.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.936+0000 7fbf767fc700 1 --2- 172.21.15.77:0/149406422 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fbf6c06e140 0x7fbf6c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:05.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.936+0000 7fbf767fc700 1 -- 172.21.15.77:0/149406422 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fbf7008d2c0 con 0x7fbf801004d0 2024-04-25T02:19:05.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.936+0000 7fbf85d47700 1 --2- 172.21.15.77:0/149406422 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fbf6c06e140 0x7fbf6c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:05.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.937+0000 7fbf85d47700 1 --2- 172.21.15.77:0/149406422 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fbf6c06e140 0x7fbf6c0705f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c009b30 tx=0x7fbf7c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:05.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:05.941+0000 7fbf767fc700 1 -- 172.21.15.77:0/149406422 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fbf700566a0 con 0x7fbf801004d0 2024-04-25T02:19:06.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.224+0000 7fbf87fab700 1 -- 172.21.15.77:0/149406422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbf80107dd0 con 0x7fbf801004d0 2024-04-25T02:19:06.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.224+0000 7fbf767fc700 1 -- 172.21.15.77:0/149406422 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fbf70059d60 con 0x7fbf801004d0 2024-04-25T02:19:06.230 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:19:06.230 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-04-25T02:19:06.230 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:19:06.230 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:19:06.230 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-04-25T02:19:06.230 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:19:06.230 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:19:06.230 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-04-25T02:19:06.230 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 6 2024-04-25T02:19:06.230 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:19:06.230 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-04-25T02:19:06.230 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 4 2024-04-25T02:19:06.231 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:19:06.231 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-04-25T02:19:06.231 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 14 2024-04-25T02:19:06.231 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-25T02:19:06.231 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:19:06.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.226+0000 7fbf87fab700 1 -- 172.21.15.77:0/149406422 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fbf6c06e140 msgr2=0x7fbf6c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:06.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.226+0000 7fbf87fab700 1 --2- 172.21.15.77:0/149406422 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fbf6c06e140 0x7fbf6c0705f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c009b30 tx=0x7fbf7c009e30 comp rx=0 tx=0).stop 2024-04-25T02:19:06.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.226+0000 7fbf87fab700 1 -- 172.21.15.77:0/149406422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf801004d0 msgr2=0x7fbf800fd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:06.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.226+0000 7fbf87fab700 1 --2- 172.21.15.77:0/149406422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf801004d0 0x7fbf800fd6b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbf7000a6c0 tx=0x7fbf7000c040 comp rx=0 tx=0).stop 2024-04-25T02:19:06.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.226+0000 7fbf87fab700 1 -- 172.21.15.77:0/149406422 shutdown_connections 2024-04-25T02:19:06.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.226+0000 7fbf87fab700 1 --2- 172.21.15.77:0/149406422 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fbf6c06e140 0x7fbf6c0705f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:06.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.226+0000 7fbf87fab700 1 --2- 172.21.15.77:0/149406422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf800fb5a0 0x7fbf800fd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:06.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.226+0000 7fbf87fab700 1 --2- 172.21.15.77:0/149406422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf801004d0 0x7fbf800fd6b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:06.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.226+0000 7fbf87fab700 1 -- 172.21.15.77:0/149406422 >> 172.21.15.77:0/149406422 conn(0x7fbf800714d0 msgr2=0x7fbf800f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:06.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.227+0000 7fbf87fab700 1 -- 172.21.15.77:0/149406422 shutdown_connections 2024-04-25T02:19:06.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.227+0000 7fbf87fab700 1 -- 172.21.15.77:0/149406422 wait complete. 2024-04-25T02:19:06.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.326+0000 7ff25ec94700 1 -- 172.21.15.77:0/3258597452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff258101e20 msgr2=0x7ff2581021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:06.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.326+0000 7ff25ec94700 1 --2- 172.21.15.77:0/3258597452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff258101e20 0x7ff2581021f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff24c004940 tx=0x7ff24c009e30 comp rx=0 tx=0).stop 2024-04-25T02:19:06.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.326+0000 7ff25ec94700 1 -- 172.21.15.77:0/3258597452 shutdown_connections 2024-04-25T02:19:06.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.326+0000 7ff25ec94700 1 --2- 172.21.15.77:0/3258597452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2580fc710 0x7ff2580fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:06.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.326+0000 7ff25ec94700 1 --2- 172.21.15.77:0/3258597452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff258101e20 0x7ff2581021f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:06.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.326+0000 7ff25ec94700 1 -- 172.21.15.77:0/3258597452 >> 172.21.15.77:0/3258597452 conn(0x7ff258071460 msgr2=0x7ff258071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:06.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.327+0000 7ff25ec94700 1 -- 172.21.15.77:0/3258597452 shutdown_connections 2024-04-25T02:19:06.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.327+0000 7ff25ec94700 1 -- 172.21.15.77:0/3258597452 wait complete. 2024-04-25T02:19:06.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.327+0000 7ff25ec94700 1 Processor -- start 2024-04-25T02:19:06.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.327+0000 7ff25ec94700 1 -- start start 2024-04-25T02:19:06.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.327+0000 7ff25ec94700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2580fc710 0x7ff25810eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:06.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.327+0000 7ff25ec94700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff258101e20 0x7ff25810f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:06.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.327+0000 7ff25ec94700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25810f620 con 0x7ff2580fc710 2024-04-25T02:19:06.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.327+0000 7ff25ec94700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25810f790 con 0x7ff258101e20 2024-04-25T02:19:06.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.327+0000 7ff25ca30700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2580fc710 0x7ff25810eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:06.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.328+0000 7ff25ca30700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2580fc710 0x7ff25810eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45102/0 (socket says 172.21.15.77:45102) 2024-04-25T02:19:06.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.328+0000 7ff25ca30700 1 -- 172.21.15.77:0/763555755 learned_addr learned my addr 172.21.15.77:0/763555755 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:19:06.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.328+0000 7ff257fff700 1 --2- 172.21.15.77:0/763555755 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff258101e20 0x7ff25810f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:06.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.328+0000 7ff25ca30700 1 -- 172.21.15.77:0/763555755 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff258101e20 msgr2=0x7ff25810f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:06.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.328+0000 7ff25ca30700 1 --2- 172.21.15.77:0/763555755 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff258101e20 0x7ff25810f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:06.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.328+0000 7ff25ca30700 1 -- 172.21.15.77:0/763555755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff24c005040 con 0x7ff2580fc710 2024-04-25T02:19:06.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.328+0000 7ff25ca30700 1 --2- 172.21.15.77:0/763555755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2580fc710 0x7ff25810eae0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff24c009380 tx=0x7ff24c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:06.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.328+0000 7ff2557fa700 1 -- 172.21.15.77:0/763555755 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff24c00e070 con 0x7ff2580fc710 2024-04-25T02:19:06.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.328+0000 7ff2557fa700 1 -- 172.21.15.77:0/763555755 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff24c013c00 con 0x7ff2580fc710 2024-04-25T02:19:06.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.328+0000 7ff25ec94700 1 -- 172.21.15.77:0/763555755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff258117b50 con 0x7ff2580fc710 2024-04-25T02:19:06.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.328+0000 7ff2557fa700 1 -- 172.21.15.77:0/763555755 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff24c00b650 con 0x7ff2580fc710 2024-04-25T02:19:06.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.328+0000 7ff25ec94700 1 -- 172.21.15.77:0/763555755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff258117ef0 con 0x7ff2580fc710 2024-04-25T02:19:06.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.329+0000 7ff25ec94700 1 -- 172.21.15.77:0/763555755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff258104260 con 0x7ff2580fc710 2024-04-25T02:19:06.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.330+0000 7ff2557fa700 1 -- 172.21.15.77:0/763555755 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff24c01c960 con 0x7ff2580fc710 2024-04-25T02:19:06.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.330+0000 7ff2557fa700 1 --2- 172.21.15.77:0/763555755 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7ff24806e150 0x7ff248070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:06.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.330+0000 7ff2557fa700 1 -- 172.21.15.77:0/763555755 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff24c08f530 con 0x7ff2580fc710 2024-04-25T02:19:06.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.330+0000 7ff257fff700 1 --2- 172.21.15.77:0/763555755 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7ff24806e150 0x7ff248070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:06.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.331+0000 7ff257fff700 1 --2- 172.21.15.77:0/763555755 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7ff24806e150 0x7ff248070600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff2580fbfd0 tx=0x7ff24400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:06.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.335+0000 7ff2557fa700 1 -- 172.21.15.77:0/763555755 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7ff24c058860 con 0x7ff2580fc710 2024-04-25T02:19:06.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.574+0000 7ff25ec94700 1 -- 172.21.15.77:0/763555755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff25804bed0 con 0x7ff2580fc710 2024-04-25T02:19:06.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.575+0000 7ff2557fa700 1 -- 172.21.15.77:0/763555755 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1938 (secure 0 0 0) 0x7ff24c07c020 con 0x7ff2580fc710 2024-04-25T02:19:06.580 INFO:teuthology.orchestra.run.smithi077.stdout:e30 2024-04-25T02:19:06.580 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T02:19:06.580 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:19:06.580 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-04-25T02:19:06.580 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:19:06.580 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-04-25T02:19:06.580 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-04-25T02:19:06.580 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 29 2024-04-25T02:19:06.580 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-25T02:19:06.580 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-04-25T02:06:10.008979+0000 2024-04-25T02:19:06.580 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-04-25T02:19:02.886301+0000 2024-04-25T02:19:06.580 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-04-25T02:19:06.580 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-04-25T02:19:06.581 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-04-25T02:19:06.581 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-04-25T02:19:06.581 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-04-25T02:19:06.581 INFO:teuthology.orchestra.run.smithi077.stdout:max_xattr_size 65536 2024-04-25T02:19:06.581 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-04-25T02:19:06.581 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-04-25T02:19:06.581 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 84 2024-04-25T02:19:06.581 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-25T02:19:06.581 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-04-25T02:19:06.581 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-04-25T02:19:06.581 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=34374} 2024-04-25T02:19:06.581 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-04-25T02:19:06.581 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-04-25T02:19:06.581 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-04-25T02:19:06.581 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-04-25T02:19:06.582 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-04-25T02:19:06.582 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-04-25T02:19:06.582 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-04-25T02:19:06.582 INFO:teuthology.orchestra.run.smithi077.stdout:bal_rank_mask -1 2024-04-25T02:19:06.582 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-04-25T02:19:06.582 INFO:teuthology.orchestra.run.smithi077.stdout:qdb_cluster leader: 34374 members: 34374 2024-04-25T02:19:06.582 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.oadrkb{0:34374} state up:active seq 19 join_fscid=1 addr [v2:172.21.15.77:6826/1829655283,v1:172.21.15.77:6827/1829655283] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T02:19:06.582 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:19:06.582 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:19:06.582 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-04-25T02:19:06.582 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:19:06.582 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.gcfygj{-1:34406} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.77:6828/702451557,v1:172.21.15.77:6829/702451557] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T02:19:06.582 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi112.dvwudt{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6824/1388779321,v1:172.21.15.112:6825/1388779321] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T02:19:06.582 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi112.fjnadi{-1:44307} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/1789386749,v1:172.21.15.112:6827/1789386749] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T02:19:06.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.577+0000 7ff25ec94700 1 -- 172.21.15.77:0/763555755 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7ff24806e150 msgr2=0x7ff248070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:06.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.577+0000 7ff25ec94700 1 --2- 172.21.15.77:0/763555755 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7ff24806e150 0x7ff248070600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff2580fbfd0 tx=0x7ff24400b040 comp rx=0 tx=0).stop 2024-04-25T02:19:06.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.577+0000 7ff25ec94700 1 -- 172.21.15.77:0/763555755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2580fc710 msgr2=0x7ff25810eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:06.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.577+0000 7ff25ec94700 1 --2- 172.21.15.77:0/763555755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2580fc710 0x7ff25810eae0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff24c009380 tx=0x7ff24c009e30 comp rx=0 tx=0).stop 2024-04-25T02:19:06.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.577+0000 7ff25ec94700 1 -- 172.21.15.77:0/763555755 shutdown_connections 2024-04-25T02:19:06.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.577+0000 7ff25ec94700 1 --2- 172.21.15.77:0/763555755 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7ff24806e150 0x7ff248070600 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:06.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.577+0000 7ff25ec94700 1 --2- 172.21.15.77:0/763555755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2580fc710 0x7ff25810eae0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:06.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.577+0000 7ff25ec94700 1 --2- 172.21.15.77:0/763555755 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff258101e20 0x7ff25810f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:06.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.577+0000 7ff25ec94700 1 -- 172.21.15.77:0/763555755 >> 172.21.15.77:0/763555755 conn(0x7ff258071460 msgr2=0x7ff2580f9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:06.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.577+0000 7ff25ec94700 1 -- 172.21.15.77:0/763555755 shutdown_connections 2024-04-25T02:19:06.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.577+0000 7ff25ec94700 1 -- 172.21.15.77:0/763555755 wait complete. 2024-04-25T02:19:06.584 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 30 2024-04-25T02:19:06.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.680+0000 7f47c607d700 1 -- 172.21.15.77:0/4123940545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47c00fbd40 msgr2=0x7f47c00fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:06.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.680+0000 7f47c607d700 1 --2- 172.21.15.77:0/4123940545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47c00fbd40 0x7f47c00fc1b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f47b4004940 tx=0x7f47b4009e30 comp rx=0 tx=0).stop 2024-04-25T02:19:06.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.680+0000 7f47c607d700 1 -- 172.21.15.77:0/4123940545 shutdown_connections 2024-04-25T02:19:06.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.680+0000 7f47c607d700 1 --2- 172.21.15.77:0/4123940545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47c00fbd40 0x7f47c00fc1b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:06.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.680+0000 7f47c607d700 1 --2- 172.21.15.77:0/4123940545 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47c0101d90 0x7f47c0102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:06.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.680+0000 7f47c607d700 1 -- 172.21.15.77:0/4123940545 >> 172.21.15.77:0/4123940545 conn(0x7f47c0071d00 msgr2=0x7f47c0072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:06.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.680+0000 7f47c607d700 1 -- 172.21.15.77:0/4123940545 shutdown_connections 2024-04-25T02:19:06.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.680+0000 7f47c607d700 1 -- 172.21.15.77:0/4123940545 wait complete. 2024-04-25T02:19:06.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.681+0000 7f47c607d700 1 Processor -- start 2024-04-25T02:19:06.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.681+0000 7f47c607d700 1 -- start start 2024-04-25T02:19:06.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.681+0000 7f47c607d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47c00fbd40 0x7f47c0113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:06.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.681+0000 7f47c607d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47c0101d90 0x7f47c01140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:06.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.681+0000 7f47c607d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c0114710 con 0x7f47c0101d90 2024-04-25T02:19:06.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.681+0000 7f47c607d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c010db00 con 0x7f47c00fbd40 2024-04-25T02:19:06.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.681+0000 7f47beffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47c0101d90 0x7f47c01140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:06.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.681+0000 7f47beffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47c0101d90 0x7f47c01140c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45108/0 (socket says 172.21.15.77:45108) 2024-04-25T02:19:06.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.681+0000 7f47beffd700 1 -- 172.21.15.77:0/419757112 learned_addr learned my addr 172.21.15.77:0/419757112 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:19:06.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.682+0000 7f47bf7fe700 1 --2- 172.21.15.77:0/419757112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47c00fbd40 0x7f47c0113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:06.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.682+0000 7f47beffd700 1 -- 172.21.15.77:0/419757112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47c00fbd40 msgr2=0x7f47c0113b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:06.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.682+0000 7f47beffd700 1 --2- 172.21.15.77:0/419757112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47c00fbd40 0x7f47c0113b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:06.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.682+0000 7f47beffd700 1 -- 172.21.15.77:0/419757112 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b4005040 con 0x7f47c0101d90 2024-04-25T02:19:06.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.682+0000 7f47beffd700 1 --2- 172.21.15.77:0/419757112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47c0101d90 0x7f47c01140c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f47b400b3b0 tx=0x7f47b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:06.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.682+0000 7f47a7fff700 1 -- 172.21.15.77:0/419757112 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47b400e040 con 0x7f47c0101d90 2024-04-25T02:19:06.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.682+0000 7f47a7fff700 1 -- 172.21.15.77:0/419757112 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f47b4013420 con 0x7f47c0101d90 2024-04-25T02:19:06.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.682+0000 7f47a7fff700 1 -- 172.21.15.77:0/419757112 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47b401c630 con 0x7f47c0101d90 2024-04-25T02:19:06.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.682+0000 7f47c607d700 1 -- 172.21.15.77:0/419757112 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c010dd80 con 0x7f47c0101d90 2024-04-25T02:19:06.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.682+0000 7f47c607d700 1 -- 172.21.15.77:0/419757112 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c010e340 con 0x7f47c0101d90 2024-04-25T02:19:06.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.683+0000 7f47c607d700 1 -- 172.21.15.77:0/419757112 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47c00fd430 con 0x7f47c0101d90 2024-04-25T02:19:06.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.684+0000 7f47a7fff700 1 -- 172.21.15.77:0/419757112 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f47b4013590 con 0x7f47c0101d90 2024-04-25T02:19:06.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.684+0000 7f47a7fff700 1 --2- 172.21.15.77:0/419757112 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f47a806e140 0x7f47a80705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:06.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.684+0000 7f47a7fff700 1 -- 172.21.15.77:0/419757112 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f47b408eca0 con 0x7f47c0101d90 2024-04-25T02:19:06.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.684+0000 7f47bf7fe700 1 --2- 172.21.15.77:0/419757112 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f47a806e140 0x7f47a80705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:06.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.685+0000 7f47bf7fe700 1 --2- 172.21.15.77:0/419757112 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f47a806e140 0x7f47a80705f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f47b0004f40 tx=0x7f47b000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:06.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.689+0000 7f47a7fff700 1 -- 172.21.15.77:0/419757112 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f47b4093070 con 0x7f47c0101d90 2024-04-25T02:19:06.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.910+0000 7f47c607d700 1 -- 172.21.15.77:0/419757112 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f47c0108df0 con 0x7f47a806e140 2024-04-25T02:19:06.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.911+0000 7f47a7fff700 1 -- 172.21.15.77:0/419757112 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f47c0108df0 con 0x7f47a806e140 2024-04-25T02:19:06.916 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:19:06.916 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901", 2024-04-25T02:19:06.916 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-04-25T02:19:06.916 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T02:19:06.916 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-04-25T02:19:06.916 INFO:teuthology.orchestra.run.smithi077.stdout: "mon", 2024-04-25T02:19:06.916 INFO:teuthology.orchestra.run.smithi077.stdout: "mds", 2024-04-25T02:19:06.916 INFO:teuthology.orchestra.run.smithi077.stdout: "crash", 2024-04-25T02:19:06.916 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr", 2024-04-25T02:19:06.916 INFO:teuthology.orchestra.run.smithi077.stdout: "osd" 2024-04-25T02:19:06.916 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-25T02:19:06.916 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "16/21 daemons upgraded", 2024-04-25T02:19:06.916 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading mds daemons", 2024-04-25T02:19:06.916 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-04-25T02:19:06.916 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:19:06.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.913+0000 7f47c607d700 1 -- 172.21.15.77:0/419757112 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f47a806e140 msgr2=0x7f47a80705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:06.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.913+0000 7f47c607d700 1 --2- 172.21.15.77:0/419757112 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f47a806e140 0x7f47a80705f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f47b0004f40 tx=0x7f47b000b040 comp rx=0 tx=0).stop 2024-04-25T02:19:06.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.913+0000 7f47c607d700 1 -- 172.21.15.77:0/419757112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47c0101d90 msgr2=0x7f47c01140c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:06.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.913+0000 7f47c607d700 1 --2- 172.21.15.77:0/419757112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47c0101d90 0x7f47c01140c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f47b400b3b0 tx=0x7f47b4009e30 comp rx=0 tx=0).stop 2024-04-25T02:19:06.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.913+0000 7f47c607d700 1 -- 172.21.15.77:0/419757112 shutdown_connections 2024-04-25T02:19:06.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.913+0000 7f47c607d700 1 --2- 172.21.15.77:0/419757112 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f47a806e140 0x7f47a80705f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:06.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.913+0000 7f47c607d700 1 --2- 172.21.15.77:0/419757112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47c00fbd40 0x7f47c0113b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:06.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.913+0000 7f47c607d700 1 --2- 172.21.15.77:0/419757112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47c0101d90 0x7f47c01140c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:06.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.913+0000 7f47c607d700 1 -- 172.21.15.77:0/419757112 >> 172.21.15.77:0/419757112 conn(0x7f47c0071d00 msgr2=0x7f47c00655a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:06.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.913+0000 7f47c607d700 1 -- 172.21.15.77:0/419757112 shutdown_connections 2024-04-25T02:19:06.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:06.913+0000 7f47c607d700 1 -- 172.21.15.77:0/419757112 wait complete. 2024-04-25T02:19:07.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.013+0000 7ff4401ac700 1 -- 172.21.15.77:0/3663094982 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4380fde10 msgr2=0x7ff4380fe1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:07.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.013+0000 7ff4401ac700 1 --2- 172.21.15.77:0/3663094982 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4380fde10 0x7ff4380fe1e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff434004940 tx=0x7ff434009e30 comp rx=0 tx=0).stop 2024-04-25T02:19:07.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.013+0000 7ff4401ac700 1 -- 172.21.15.77:0/3663094982 shutdown_connections 2024-04-25T02:19:07.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.013+0000 7ff4401ac700 1 --2- 172.21.15.77:0/3663094982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4380fe7b0 0x7ff438106df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:07.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.013+0000 7ff4401ac700 1 --2- 172.21.15.77:0/3663094982 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4380fde10 0x7ff4380fe1e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:07.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.013+0000 7ff4401ac700 1 -- 172.21.15.77:0/3663094982 >> 172.21.15.77:0/3663094982 conn(0x7ff4380f78e0 msgr2=0x7ff4380f9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:07.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.013+0000 7ff4401ac700 1 -- 172.21.15.77:0/3663094982 shutdown_connections 2024-04-25T02:19:07.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.013+0000 7ff4401ac700 1 -- 172.21.15.77:0/3663094982 wait complete. 2024-04-25T02:19:07.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.014+0000 7ff4401ac700 1 Processor -- start 2024-04-25T02:19:07.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.014+0000 7ff4401ac700 1 -- start start 2024-04-25T02:19:07.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.014+0000 7ff4401ac700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4380fde10 0x7ff4381138a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:07.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.014+0000 7ff4401ac700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4380fe7b0 0x7ff438113de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:07.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.014+0000 7ff4401ac700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff438114430 con 0x7ff4380fe7b0 2024-04-25T02:19:07.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.014+0000 7ff4401ac700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43810da30 con 0x7ff4380fde10 2024-04-25T02:19:07.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.014+0000 7ff43d747700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4380fe7b0 0x7ff438113de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:07.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.014+0000 7ff43d747700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4380fe7b0 0x7ff438113de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45128/0 (socket says 172.21.15.77:45128) 2024-04-25T02:19:07.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.014+0000 7ff43d747700 1 -- 172.21.15.77:0/2878096296 learned_addr learned my addr 172.21.15.77:0/2878096296 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:19:07.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.014+0000 7ff43df48700 1 --2- 172.21.15.77:0/2878096296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4380fde10 0x7ff4381138a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:07.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.014+0000 7ff43d747700 1 -- 172.21.15.77:0/2878096296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4380fde10 msgr2=0x7ff4381138a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:07.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.014+0000 7ff43d747700 1 --2- 172.21.15.77:0/2878096296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4380fde10 0x7ff4381138a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:07.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.014+0000 7ff43d747700 1 -- 172.21.15.77:0/2878096296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff434005040 con 0x7ff4380fe7b0 2024-04-25T02:19:07.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.015+0000 7ff43d747700 1 --2- 172.21.15.77:0/2878096296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4380fe7b0 0x7ff438113de0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff42800eb40 tx=0x7ff42800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:07.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.015+0000 7ff42e7fc700 1 -- 172.21.15.77:0/2878096296 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff428007cc0 con 0x7ff4380fe7b0 2024-04-25T02:19:07.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.015+0000 7ff42e7fc700 1 -- 172.21.15.77:0/2878096296 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff42800f040 con 0x7ff4380fe7b0 2024-04-25T02:19:07.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.015+0000 7ff4401ac700 1 -- 172.21.15.77:0/2878096296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff43810dcb0 con 0x7ff4380fe7b0 2024-04-25T02:19:07.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.015+0000 7ff42e7fc700 1 -- 172.21.15.77:0/2878096296 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff42800ca10 con 0x7ff4380fe7b0 2024-04-25T02:19:07.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.015+0000 7ff4401ac700 1 -- 172.21.15.77:0/2878096296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43810e1f0 con 0x7ff4380fe7b0 2024-04-25T02:19:07.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.016+0000 7ff4401ac700 1 -- 172.21.15.77:0/2878096296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff438066b30 con 0x7ff4380fe7b0 2024-04-25T02:19:07.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.016+0000 7ff42e7fc700 1 -- 172.21.15.77:0/2878096296 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff42800cb70 con 0x7ff4380fe7b0 2024-04-25T02:19:07.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.017+0000 7ff42e7fc700 1 --2- 172.21.15.77:0/2878096296 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7ff42406e140 0x7ff4240705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:07.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.017+0000 7ff42e7fc700 1 -- 172.21.15.77:0/2878096296 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff42808d670 con 0x7ff4380fe7b0 2024-04-25T02:19:07.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.017+0000 7ff43df48700 1 --2- 172.21.15.77:0/2878096296 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7ff42406e140 0x7ff4240705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:07.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.017+0000 7ff43df48700 1 --2- 172.21.15.77:0/2878096296 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7ff42406e140 0x7ff4240705f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff43400b0d0 tx=0x7ff434009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:07.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.021+0000 7ff42e7fc700 1 -- 172.21.15.77:0/2878096296 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7ff42805a600 con 0x7ff4380fe7b0 2024-04-25T02:19:07.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:06 smithi077 ceph-mon[110441]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:19:07.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:06 smithi077 ceph-mon[110441]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:19:07.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:06 smithi077 ceph-mon[110441]: pgmap v208: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-04-25T02:19:07.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:06 smithi077 ceph-mon[110441]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:19:07.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:06 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:07.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:06 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:07.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:06 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/149406422' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:07.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:06 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/763555755' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:19:07.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:06 smithi112 ceph-mon[80494]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:19:07.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:06 smithi112 ceph-mon[80494]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:19:07.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:06 smithi112 ceph-mon[80494]: pgmap v208: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-04-25T02:19:07.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:06 smithi112 ceph-mon[80494]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:19:07.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:06 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:07.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:06 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:07.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:06 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/149406422' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:07.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:06 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/763555755' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:19:07.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.322+0000 7ff4401ac700 1 -- 172.21.15.77:0/2878096296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff438109ea0 con 0x7ff4380fe7b0 2024-04-25T02:19:07.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.322+0000 7ff42e7fc700 1 -- 172.21.15.77:0/2878096296 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff42805a190 con 0x7ff4380fe7b0 2024-04-25T02:19:07.327 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-04-25T02:19:07.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.324+0000 7ff4401ac700 1 -- 172.21.15.77:0/2878096296 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7ff42406e140 msgr2=0x7ff4240705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:07.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.324+0000 7ff4401ac700 1 --2- 172.21.15.77:0/2878096296 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7ff42406e140 0x7ff4240705f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff43400b0d0 tx=0x7ff434009e30 comp rx=0 tx=0).stop 2024-04-25T02:19:07.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.324+0000 7ff4401ac700 1 -- 172.21.15.77:0/2878096296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4380fe7b0 msgr2=0x7ff438113de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:07.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.324+0000 7ff4401ac700 1 --2- 172.21.15.77:0/2878096296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4380fe7b0 0x7ff438113de0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff42800eb40 tx=0x7ff42800b040 comp rx=0 tx=0).stop 2024-04-25T02:19:07.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.324+0000 7ff4401ac700 1 -- 172.21.15.77:0/2878096296 shutdown_connections 2024-04-25T02:19:07.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.324+0000 7ff4401ac700 1 --2- 172.21.15.77:0/2878096296 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7ff42406e140 0x7ff4240705f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:07.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.324+0000 7ff4401ac700 1 --2- 172.21.15.77:0/2878096296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff4380fde10 0x7ff4381138a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:07.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.324+0000 7ff4401ac700 1 --2- 172.21.15.77:0/2878096296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4380fe7b0 0x7ff438113de0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:07.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.324+0000 7ff4401ac700 1 -- 172.21.15.77:0/2878096296 >> 172.21.15.77:0/2878096296 conn(0x7ff4380f78e0 msgr2=0x7ff4380f8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:07.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.324+0000 7ff4401ac700 1 -- 172.21.15.77:0/2878096296 shutdown_connections 2024-04-25T02:19:07.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:07.324+0000 7ff4401ac700 1 -- 172.21.15.77:0/2878096296 wait complete. 2024-04-25T02:19:08.038 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:07 smithi112 ceph-mon[80494]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:19:08.039 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:07 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:08.039 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:07 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:08.039 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:07 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/2878096296' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T02:19:08.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:07 smithi077 ceph-mon[110441]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:19:08.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:07 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:08.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:07 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:08.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:07 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/2878096296' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T02:19:09.182 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:08 smithi112 ceph-mon[80494]: pgmap v209: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-04-25T02:19:09.183 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:09.183 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:19:09.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:08 smithi077 ceph-mon[110441]: pgmap v209: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-04-25T02:19:09.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:09.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:19:11.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:10 smithi112 ceph-mon[80494]: pgmap v210: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 7.9 MiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-04-25T02:19:11.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:10 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:11.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:10 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:11.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:10 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:19:11.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:10 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:19:11.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:10 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:11.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:10 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:19:11.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:10 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:11.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:10 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:11.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:10 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:11.027 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:10 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:11.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:10 smithi077 ceph-mon[110441]: pgmap v210: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 7.9 MiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-04-25T02:19:11.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:10 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:11.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:10 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:11.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:10 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:19:11.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:10 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:19:11.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:10 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:11.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:10 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:19:11.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:10 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:11.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:10 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:11.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:10 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:11.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:10 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:12.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:11 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:12.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:11 smithi077 ceph-mon[110441]: Upgrade: Setting container_image for all mds 2024-04-25T02:19:12.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:11 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:12.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:11 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi077.gcfygj"}]: dispatch 2024-04-25T02:19:12.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:11 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi077.gcfygj"}]': finished 2024-04-25T02:19:12.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:11 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi077.oadrkb"}]: dispatch 2024-04-25T02:19:12.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:11 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi077.oadrkb"}]': finished 2024-04-25T02:19:12.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:11 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.dvwudt"}]: dispatch 2024-04-25T02:19:12.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:11 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.dvwudt"}]': finished 2024-04-25T02:19:12.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:11 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.fjnadi"}]: dispatch 2024-04-25T02:19:12.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:11 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.fjnadi"}]': finished 2024-04-25T02:19:12.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:11 smithi077 ceph-mon[110441]: Upgrade: Setting filesystem cephfs Joinable 2024-04-25T02:19:12.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:11 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-04-25T02:19:12.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:11 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:12.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:11 smithi112 ceph-mon[80494]: Upgrade: Setting container_image for all mds 2024-04-25T02:19:12.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:11 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:12.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:11 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi077.gcfygj"}]: dispatch 2024-04-25T02:19:12.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:11 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi077.gcfygj"}]': finished 2024-04-25T02:19:12.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:11 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi077.oadrkb"}]: dispatch 2024-04-25T02:19:12.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:11 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi077.oadrkb"}]': finished 2024-04-25T02:19:12.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:11 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.dvwudt"}]: dispatch 2024-04-25T02:19:12.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:11 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.dvwudt"}]': finished 2024-04-25T02:19:12.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:11 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.fjnadi"}]: dispatch 2024-04-25T02:19:12.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:11 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.fjnadi"}]': finished 2024-04-25T02:19:12.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:11 smithi112 ceph-mon[80494]: Upgrade: Setting filesystem cephfs Joinable 2024-04-25T02:19:12.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:11 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-04-25T02:19:13.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: pgmap v211: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 2.9 MiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-04-25T02:19:13.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-04-25T02:19:13.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: fsmap cephfs:1 {0=cephfs.smithi077.oadrkb=up:active} 3 up:standby 2024-04-25T02:19:13.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:13.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: Upgrade: Setting container_image for all rgw 2024-04-25T02:19:13.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:13.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:13.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: Upgrade: Setting container_image for all rbd-mirror 2024-04-25T02:19:13.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:13.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:13.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:13.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: Upgrade: Setting container_image for all ceph-exporter 2024-04-25T02:19:13.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:13.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:13.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: Upgrade: Setting container_image for all iscsi 2024-04-25T02:19:13.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:13.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:13.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: Upgrade: Setting container_image for all nfs 2024-04-25T02:19:13.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:13.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:13.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: Upgrade: Setting container_image for all nvmeof 2024-04-25T02:19:13.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:13.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:13.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:13.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:13.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:13.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:13.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:13.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: Upgrade: Finalizing container_image settings 2024-04-25T02:19:13.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-25T02:19:13.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-25T02:19:13.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:19:13.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-25T02:19:13.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-25T02:19:13.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-04-25T02:19:13.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-25T02:19:13.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-04-25T02:19:13.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-25T02:19:13.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-04-25T02:19:13.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-25T02:19:13.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-25T02:19:13.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-25T02:19:13.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-25T02:19:13.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:19:13.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-25T02:19:13.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-25T02:19:13.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-25T02:19:13.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-25T02:19:13.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-25T02:19:13.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-25T02:19:13.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-25T02:19:13.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-25T02:19:13.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:19:13.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:19:13.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:19:13.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:19:13.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:19:13.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:19:13.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-25T02:19:13.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-25T02:19:13.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:19:13.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:19:13.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:19:13.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:13.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:19:13.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:19:13.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:19:13.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:13.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: pgmap v211: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 2.9 MiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-04-25T02:19:13.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-04-25T02:19:13.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: fsmap cephfs:1 {0=cephfs.smithi077.oadrkb=up:active} 3 up:standby 2024-04-25T02:19:13.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:13.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: Upgrade: Setting container_image for all rgw 2024-04-25T02:19:13.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:13.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:13.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: Upgrade: Setting container_image for all rbd-mirror 2024-04-25T02:19:13.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:13.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:13.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:13.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: Upgrade: Setting container_image for all ceph-exporter 2024-04-25T02:19:13.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:13.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:13.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: Upgrade: Setting container_image for all iscsi 2024-04-25T02:19:13.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:13.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:13.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: Upgrade: Setting container_image for all nfs 2024-04-25T02:19:13.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:13.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:13.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: Upgrade: Setting container_image for all nvmeof 2024-04-25T02:19:13.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:13.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:13.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:13.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:13.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:13.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:13.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:13.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: Upgrade: Finalizing container_image settings 2024-04-25T02:19:13.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-25T02:19:13.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-25T02:19:13.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:19:13.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-25T02:19:13.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-25T02:19:13.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-04-25T02:19:13.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-25T02:19:13.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-04-25T02:19:13.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-25T02:19:13.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-04-25T02:19:13.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-25T02:19:13.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-25T02:19:13.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-25T02:19:13.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-25T02:19:13.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:19:13.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-25T02:19:13.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-25T02:19:13.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-25T02:19:13.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-25T02:19:13.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-25T02:19:13.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-25T02:19:13.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-25T02:19:13.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-25T02:19:13.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:19:13.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:19:13.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:19:13.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:19:13.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:19:13.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T02:19:13.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-25T02:19:13.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-25T02:19:13.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:19:13.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:19:13.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:19:13.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:13.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:19:13.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:19:13.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:19:13.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:14.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:13 smithi077 ceph-mon[110441]: Upgrade: Complete! 2024-04-25T02:19:14.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:13 smithi112 ceph-mon[80494]: Upgrade: Complete! 2024-04-25T02:19:15.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:14 smithi077 ceph-mon[110441]: pgmap v212: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 706 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-04-25T02:19:15.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:14 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:15.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:14 smithi112 ceph-mon[80494]: pgmap v212: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 706 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-04-25T02:19:15.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:14 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:19:17.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:16 smithi077 ceph-mon[110441]: pgmap v213: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 24 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-04-25T02:19:17.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:16 smithi112 ceph-mon[80494]: pgmap v213: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 24 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-04-25T02:19:19.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:18 smithi077 ceph-mon[110441]: pgmap v214: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 0 op/s 2024-04-25T02:19:19.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:18 smithi112 ceph-mon[80494]: pgmap v214: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 0 op/s 2024-04-25T02:19:21.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:20 smithi077 ceph-mon[110441]: pgmap v215: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 255 B/s rd, 0 B/s wr, 0 op/s 2024-04-25T02:19:21.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:20 smithi112 ceph-mon[80494]: pgmap v215: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail; 255 B/s rd, 0 B/s wr, 0 op/s 2024-04-25T02:19:23.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:22 smithi077 ceph-mon[110441]: pgmap v216: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:23.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:22 smithi112 ceph-mon[80494]: pgmap v216: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:24.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:23 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:19:24.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:23 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:19:25.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:24 smithi077 ceph-mon[110441]: pgmap v217: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:25.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:24 smithi112 ceph-mon[80494]: pgmap v217: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:27.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:26 smithi077 ceph-mon[110441]: pgmap v218: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:27.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:26 smithi112 ceph-mon[80494]: pgmap v218: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:29.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:28 smithi112 ceph-mon[80494]: pgmap v219: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:29.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:28 smithi077 ceph-mon[110441]: pgmap v219: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:31.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:30 smithi112 ceph-mon[80494]: pgmap v220: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:31.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:30 smithi077 ceph-mon[110441]: pgmap v220: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:33.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:32 smithi112 ceph-mon[80494]: pgmap v221: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:33.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:32 smithi077 ceph-mon[110441]: pgmap v221: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:35.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:34 smithi112 ceph-mon[80494]: pgmap v222: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:35.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:34 smithi077 ceph-mon[110441]: pgmap v222: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:37.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:36 smithi112 ceph-mon[80494]: pgmap v223: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:37.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.439+0000 7fd97394e700 1 -- 172.21.15.77:0/1142333788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd96c102de0 msgr2=0x7fd96c1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:37.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.439+0000 7fd97394e700 1 --2- 172.21.15.77:0/1142333788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd96c102de0 0x7fd96c1031b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd95c004940 tx=0x7fd95c009e30 comp rx=0 tx=0).stop 2024-04-25T02:19:37.444 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:36 smithi077 ceph-mon[110441]: pgmap v223: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:37.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.439+0000 7fd97394e700 1 -- 172.21.15.77:0/1142333788 shutdown_connections 2024-04-25T02:19:37.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.439+0000 7fd97394e700 1 --2- 172.21.15.77:0/1142333788 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd96c103780 0x7fd96c0fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:37.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.439+0000 7fd97394e700 1 --2- 172.21.15.77:0/1142333788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd96c102de0 0x7fd96c1031b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:37.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.439+0000 7fd97394e700 1 -- 172.21.15.77:0/1142333788 >> 172.21.15.77:0/1142333788 conn(0x7fd96c0f89b0 msgr2=0x7fd96c0fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:37.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.440+0000 7fd97394e700 1 -- 172.21.15.77:0/1142333788 shutdown_connections 2024-04-25T02:19:37.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.440+0000 7fd97394e700 1 -- 172.21.15.77:0/1142333788 wait complete. 2024-04-25T02:19:37.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.440+0000 7fd97394e700 1 Processor -- start 2024-04-25T02:19:37.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.440+0000 7fd97394e700 1 -- start start 2024-04-25T02:19:37.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.440+0000 7fd97394e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd96c102de0 0x7fd96c113b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:37.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.440+0000 7fd97394e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd96c103780 0x7fd96c114080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:37.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.440+0000 7fd97394e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c1146d0 con 0x7fd96c102de0 2024-04-25T02:19:37.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.440+0000 7fd97394e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c10db10 con 0x7fd96c103780 2024-04-25T02:19:37.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.440+0000 7fd9716ea700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd96c102de0 0x7fd96c113b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:37.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.441+0000 7fd9716ea700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd96c102de0 0x7fd96c113b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42548/0 (socket says 172.21.15.77:42548) 2024-04-25T02:19:37.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.441+0000 7fd9716ea700 1 -- 172.21.15.77:0/3059739305 learned_addr learned my addr 172.21.15.77:0/3059739305 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:19:37.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.441+0000 7fd970ee9700 1 --2- 172.21.15.77:0/3059739305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd96c103780 0x7fd96c114080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:37.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.441+0000 7fd9716ea700 1 -- 172.21.15.77:0/3059739305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd96c103780 msgr2=0x7fd96c114080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:37.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.441+0000 7fd9716ea700 1 --2- 172.21.15.77:0/3059739305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd96c103780 0x7fd96c114080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:37.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.441+0000 7fd9716ea700 1 -- 172.21.15.77:0/3059739305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c005040 con 0x7fd96c102de0 2024-04-25T02:19:37.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.441+0000 7fd9716ea700 1 --2- 172.21.15.77:0/3059739305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd96c102de0 0x7fd96c113b40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd95c00b3b0 tx=0x7fd95c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:37.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.441+0000 7fd961ffb700 1 -- 172.21.15.77:0/3059739305 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd95c00e040 con 0x7fd96c102de0 2024-04-25T02:19:37.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.441+0000 7fd97394e700 1 -- 172.21.15.77:0/3059739305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96c10dd90 con 0x7fd96c102de0 2024-04-25T02:19:37.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.441+0000 7fd961ffb700 1 -- 172.21.15.77:0/3059739305 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd95c00bbc0 con 0x7fd96c102de0 2024-04-25T02:19:37.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.441+0000 7fd961ffb700 1 -- 172.21.15.77:0/3059739305 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd95c01c3f0 con 0x7fd96c102de0 2024-04-25T02:19:37.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.441+0000 7fd97394e700 1 -- 172.21.15.77:0/3059739305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96c10e350 con 0x7fd96c102de0 2024-04-25T02:19:37.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.442+0000 7fd97394e700 1 -- 172.21.15.77:0/3059739305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96c1000f0 con 0x7fd96c102de0 2024-04-25T02:19:37.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.443+0000 7fd961ffb700 1 -- 172.21.15.77:0/3059739305 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd95c00bd30 con 0x7fd96c102de0 2024-04-25T02:19:37.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.443+0000 7fd961ffb700 1 --2- 172.21.15.77:0/3059739305 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd95806e140 0x7fd9580705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:37.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.444+0000 7fd970ee9700 1 --2- 172.21.15.77:0/3059739305 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd95806e140 0x7fd9580705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:37.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.444+0000 7fd961ffb700 1 -- 172.21.15.77:0/3059739305 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd95c08ee00 con 0x7fd96c102de0 2024-04-25T02:19:37.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.444+0000 7fd970ee9700 1 --2- 172.21.15.77:0/3059739305 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd95806e140 0x7fd9580705f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd968007fd0 tx=0x7fd968009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:37.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.448+0000 7fd961ffb700 1 -- 172.21.15.77:0/3059739305 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fd95c05bc60 con 0x7fd96c102de0 2024-04-25T02:19:37.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.664+0000 7fd97394e700 1 -- 172.21.15.77:0/3059739305 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd96c10f200 con 0x7fd95806e140 2024-04-25T02:19:37.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.665+0000 7fd961ffb700 1 -- 172.21.15.77:0/3059739305 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fd96c10f200 con 0x7fd95806e140 2024-04-25T02:19:37.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.667+0000 7fd97394e700 1 -- 172.21.15.77:0/3059739305 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd95806e140 msgr2=0x7fd9580705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:37.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.667+0000 7fd97394e700 1 --2- 172.21.15.77:0/3059739305 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd95806e140 0x7fd9580705f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd968007fd0 tx=0x7fd968009040 comp rx=0 tx=0).stop 2024-04-25T02:19:37.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.667+0000 7fd97394e700 1 -- 172.21.15.77:0/3059739305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd96c102de0 msgr2=0x7fd96c113b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:37.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.667+0000 7fd97394e700 1 --2- 172.21.15.77:0/3059739305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd96c102de0 0x7fd96c113b40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd95c00b3b0 tx=0x7fd95c009e30 comp rx=0 tx=0).stop 2024-04-25T02:19:37.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.667+0000 7fd97394e700 1 -- 172.21.15.77:0/3059739305 shutdown_connections 2024-04-25T02:19:37.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.667+0000 7fd97394e700 1 --2- 172.21.15.77:0/3059739305 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd95806e140 0x7fd9580705f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:37.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.667+0000 7fd97394e700 1 --2- 172.21.15.77:0/3059739305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd96c102de0 0x7fd96c113b40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:37.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.667+0000 7fd97394e700 1 --2- 172.21.15.77:0/3059739305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd96c103780 0x7fd96c114080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:37.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.667+0000 7fd97394e700 1 -- 172.21.15.77:0/3059739305 >> 172.21.15.77:0/3059739305 conn(0x7fd96c0f89b0 msgr2=0x7fd96c1073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:37.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.667+0000 7fd97394e700 1 -- 172.21.15.77:0/3059739305 shutdown_connections 2024-04-25T02:19:37.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:37.668+0000 7fd97394e700 1 -- 172.21.15.77:0/3059739305 wait complete. 2024-04-25T02:19:38.383 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -e sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 -- bash -c 'ceph orch ps' 2024-04-25T02:19:38.680 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:19:39.103 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:38 smithi077 ceph-mon[110441]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:19:39.103 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:38 smithi077 ceph-mon[110441]: pgmap v224: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:39.103 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:38 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:19:39.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:38 smithi112 ceph-mon[80494]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:19:39.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:38 smithi112 ceph-mon[80494]: pgmap v224: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:39.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:38 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:19:40.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.316+0000 7f19f475e700 1 -- 172.21.15.77:0/1458819329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19ec103790 msgr2=0x7f19ec0fce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:40.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.316+0000 7f19f475e700 1 --2- 172.21.15.77:0/1458819329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19ec103790 0x7f19ec0fce00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f19e0004940 tx=0x7f19e0009e30 comp rx=0 tx=0).stop 2024-04-25T02:19:40.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.316+0000 7f19f475e700 1 -- 172.21.15.77:0/1458819329 shutdown_connections 2024-04-25T02:19:40.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.316+0000 7f19f475e700 1 --2- 172.21.15.77:0/1458819329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19ec103790 0x7f19ec0fce00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:40.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.316+0000 7f19f475e700 1 --2- 172.21.15.77:0/1458819329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19ec102df0 0x7f19ec1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:40.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.316+0000 7f19f475e700 1 -- 172.21.15.77:0/1458819329 >> 172.21.15.77:0/1458819329 conn(0x7f19ec0f8980 msgr2=0x7f19ec0fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:40.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.316+0000 7f19f475e700 1 -- 172.21.15.77:0/1458819329 shutdown_connections 2024-04-25T02:19:40.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.316+0000 7f19f475e700 1 -- 172.21.15.77:0/1458819329 wait complete. 2024-04-25T02:19:40.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.316+0000 7f19f475e700 1 Processor -- start 2024-04-25T02:19:40.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.317+0000 7f19f475e700 1 -- start start 2024-04-25T02:19:40.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.317+0000 7f19f475e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19ec102df0 0x7f19ec113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:40.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.317+0000 7f19f475e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19ec103790 0x7f19ec1140d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:40.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.317+0000 7f19f475e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec1147b0 con 0x7f19ec102df0 2024-04-25T02:19:40.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.317+0000 7f19f475e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec10db30 con 0x7f19ec103790 2024-04-25T02:19:40.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.317+0000 7f19f24fa700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19ec102df0 0x7f19ec113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:40.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.317+0000 7f19f24fa700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19ec102df0 0x7f19ec113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42570/0 (socket says 172.21.15.77:42570) 2024-04-25T02:19:40.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.317+0000 7f19f24fa700 1 -- 172.21.15.77:0/2771366297 learned_addr learned my addr 172.21.15.77:0/2771366297 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:19:40.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.317+0000 7f19f1cf9700 1 --2- 172.21.15.77:0/2771366297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19ec103790 0x7f19ec1140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:40.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.317+0000 7f19f24fa700 1 -- 172.21.15.77:0/2771366297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19ec103790 msgr2=0x7f19ec1140d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:40.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.317+0000 7f19f24fa700 1 --2- 172.21.15.77:0/2771366297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19ec103790 0x7f19ec1140d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:40.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.317+0000 7f19f24fa700 1 -- 172.21.15.77:0/2771366297 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e0005040 con 0x7f19ec102df0 2024-04-25T02:19:40.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.317+0000 7f19f1cf9700 1 --2- 172.21.15.77:0/2771366297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19ec103790 0x7f19ec1140d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:19:40.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.317+0000 7f19f24fa700 1 --2- 172.21.15.77:0/2771366297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19ec102df0 0x7f19ec113b90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f19e400bbb0 tx=0x7f19e4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:40.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.317+0000 7f19eaffd700 1 -- 172.21.15.77:0/2771366297 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19e40092e0 con 0x7f19ec102df0 2024-04-25T02:19:40.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.318+0000 7f19f475e700 1 -- 172.21.15.77:0/2771366297 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ec10de10 con 0x7f19ec102df0 2024-04-25T02:19:40.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.318+0000 7f19eaffd700 1 -- 172.21.15.77:0/2771366297 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f19e400cbd0 con 0x7f19ec102df0 2024-04-25T02:19:40.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.318+0000 7f19eaffd700 1 -- 172.21.15.77:0/2771366297 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19e4007400 con 0x7f19ec102df0 2024-04-25T02:19:40.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.318+0000 7f19f475e700 1 -- 172.21.15.77:0/2771366297 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19ec10e350 con 0x7f19ec102df0 2024-04-25T02:19:40.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.318+0000 7f19f475e700 1 -- 172.21.15.77:0/2771366297 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19ec100100 con 0x7f19ec102df0 2024-04-25T02:19:40.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.319+0000 7f19eaffd700 1 -- 172.21.15.77:0/2771366297 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f19e4012070 con 0x7f19ec102df0 2024-04-25T02:19:40.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.319+0000 7f19eaffd700 1 --2- 172.21.15.77:0/2771366297 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f19d406e140 0x7f19d40705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:40.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.319+0000 7f19eaffd700 1 -- 172.21.15.77:0/2771366297 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f19e408d840 con 0x7f19ec102df0 2024-04-25T02:19:40.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.319+0000 7f19f1cf9700 1 --2- 172.21.15.77:0/2771366297 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f19d406e140 0x7f19d40705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:40.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.320+0000 7f19f1cf9700 1 --2- 172.21.15.77:0/2771366297 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f19d406e140 0x7f19d40705f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009fd0 tx=0x7f19e0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:40.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.324+0000 7f19eaffd700 1 -- 172.21.15.77:0/2771366297 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f19e4056b70 con 0x7f19ec102df0 2024-04-25T02:19:40.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.531+0000 7f19f475e700 1 -- 172.21.15.77:0/2771366297 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f19ec109fb0 con 0x7f19d406e140 2024-04-25T02:19:40.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.541+0000 7f19eaffd700 1 -- 172.21.15.77:0/2771366297 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f19ec109fb0 con 0x7f19d406e140 2024-04-25T02:19:40.545 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T02:19:40.545 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (7m) 77s ago 18m 26.8M - 0.25.0 c8568f914cd2 699c7fd25ea5 2024-04-25T02:19:40.545 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (5m) 77s ago 18m 6660k - 19.0.0-2445-gd2c45d97 f68e37b807ef f3c45d31e2e3 2024-04-25T02:19:40.545 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi112 smithi112 running (5m) 34s ago 17m 6656k - 19.0.0-2445-gd2c45d97 f68e37b807ef e16d9899ed11 2024-04-25T02:19:40.545 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (7m) 77s ago 18m 79.4M - 9.4.12 2bacad6d85d8 900138b0bcf0 2024-04-25T02:19:40.545 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.gcfygj smithi077 running (82s) 77s ago 13m 11.6M - 19.0.0-2445-gd2c45d97 f68e37b807ef 25bb04d1a9c3 2024-04-25T02:19:40.545 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.oadrkb smithi077 running (102s) 77s ago 13m 11.5M - 19.0.0-2445-gd2c45d97 f68e37b807ef e34ba410a62c 2024-04-25T02:19:40.545 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.dvwudt smithi112 running (61s) 34s ago 13m 11.7M - 19.0.0-2445-gd2c45d97 f68e37b807ef 6334abfd52be 2024-04-25T02:19:40.545 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.fjnadi smithi112 running (37s) 34s ago 13m 11.4M - 19.0.0-2445-gd2c45d97 f68e37b807ef 03f0494c61c9 2024-04-25T02:19:40.545 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.zpflzp smithi077 *:8443,9283,8765 running (9m) 77s ago 20m 508M - 19.0.0-2445-gd2c45d97 f68e37b807ef a1af92e027e5 2024-04-25T02:19:40.545 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi112.cswrxs smithi112 *:8443,9283,8765 running (8m) 34s ago 17m 451M - 19.0.0-2445-gd2c45d97 f68e37b807ef ccc7c57d35f2 2024-04-25T02:19:40.546 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (6m) 77s ago 20m 53.0M 2048M 19.0.0-2445-gd2c45d97 f68e37b807ef 06490c2ecc44 2024-04-25T02:19:40.546 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi112 smithi112 running (6m) 34s ago 17m 42.7M 2048M 19.0.0-2445-gd2c45d97 f68e37b807ef ccd1398acbc5 2024-04-25T02:19:40.546 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (8m) 77s ago 18m 16.7M - 1.5.0 0da6a335fe13 2320132606fc 2024-04-25T02:19:40.546 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi112 smithi112 *:9100 running (8m) 34s ago 17m 15.0M - 1.5.0 0da6a335fe13 49f285354791 2024-04-25T02:19:40.546 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (4m) 77s ago 17m 98.6M 1557M 19.0.0-2445-gd2c45d97 f68e37b807ef 7035e288ddae 2024-04-25T02:19:40.546 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (4m) 77s ago 16m 113M 1557M 19.0.0-2445-gd2c45d97 f68e37b807ef 6e514f700c36 2024-04-25T02:19:40.546 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (3m) 77s ago 16m 98.1M 1557M 19.0.0-2445-gd2c45d97 f68e37b807ef 392fd2036c16 2024-04-25T02:19:40.546 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi112 running (3m) 34s ago 15m 120M 2581M 19.0.0-2445-gd2c45d97 f68e37b807ef c100df1a0f60 2024-04-25T02:19:40.546 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi112 running (2m) 34s ago 15m 109M 2581M 19.0.0-2445-gd2c45d97 f68e37b807ef 669b1ab41e27 2024-04-25T02:19:40.546 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi112 running (2m) 34s ago 14m 108M 2581M 19.0.0-2445-gd2c45d97 f68e37b807ef cc8f3462943e 2024-04-25T02:19:40.546 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (8m) 77s ago 18m 59.4M - 2.43.0 a07b618ecd1d c5b8c6104d96 2024-04-25T02:19:40.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.543+0000 7f19f475e700 1 -- 172.21.15.77:0/2771366297 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f19d406e140 msgr2=0x7f19d40705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:40.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.543+0000 7f19f475e700 1 --2- 172.21.15.77:0/2771366297 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f19d406e140 0x7f19d40705f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009fd0 tx=0x7f19e0009e30 comp rx=0 tx=0).stop 2024-04-25T02:19:40.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.543+0000 7f19f475e700 1 -- 172.21.15.77:0/2771366297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19ec102df0 msgr2=0x7f19ec113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:40.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.543+0000 7f19f475e700 1 --2- 172.21.15.77:0/2771366297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19ec102df0 0x7f19ec113b90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f19e400bbb0 tx=0x7f19e4009840 comp rx=0 tx=0).stop 2024-04-25T02:19:40.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.543+0000 7f19f475e700 1 -- 172.21.15.77:0/2771366297 shutdown_connections 2024-04-25T02:19:40.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.543+0000 7f19f475e700 1 --2- 172.21.15.77:0/2771366297 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f19d406e140 0x7f19d40705f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:40.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.543+0000 7f19f475e700 1 --2- 172.21.15.77:0/2771366297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19ec102df0 0x7f19ec113b90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:40.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.543+0000 7f19f475e700 1 --2- 172.21.15.77:0/2771366297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19ec103790 0x7f19ec1140d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:40.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.543+0000 7f19f475e700 1 -- 172.21.15.77:0/2771366297 >> 172.21.15.77:0/2771366297 conn(0x7f19ec0f8980 msgr2=0x7f19ec1073b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:40.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.543+0000 7f19f475e700 1 -- 172.21.15.77:0/2771366297 shutdown_connections 2024-04-25T02:19:40.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:40.543+0000 7f19f475e700 1 -- 172.21.15.77:0/2771366297 wait complete. 2024-04-25T02:19:41.139 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:40 smithi077 ceph-mon[110441]: pgmap v225: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:41.164 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -e sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 -- bash -c 'ceph orch upgrade status' 2024-04-25T02:19:41.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:40 smithi112 ceph-mon[80494]: pgmap v225: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:41.431 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:19:42.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:41 smithi112 ceph-mon[80494]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:19:42.397 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:41 smithi077 ceph-mon[110441]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:19:43.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:42 smithi077 ceph-mon[110441]: pgmap v226: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:43.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.253+0000 7f8c8ce40700 1 -- 172.21.15.77:0/2786080716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c88102690 msgr2=0x7f8c880fbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:43.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.253+0000 7f8c8ce40700 1 --2- 172.21.15.77:0/2786080716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c88102690 0x7f8c880fbd00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8c78004940 tx=0x7f8c78009e30 comp rx=0 tx=0).stop 2024-04-25T02:19:43.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.254+0000 7f8c8ce40700 1 -- 172.21.15.77:0/2786080716 shutdown_connections 2024-04-25T02:19:43.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.254+0000 7f8c8ce40700 1 --2- 172.21.15.77:0/2786080716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c88102690 0x7f8c880fbd00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:43.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.254+0000 7f8c8ce40700 1 --2- 172.21.15.77:0/2786080716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c88101cf0 0x7f8c881020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:43.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.254+0000 7f8c8ce40700 1 -- 172.21.15.77:0/2786080716 >> 172.21.15.77:0/2786080716 conn(0x7f8c880f7860 msgr2=0x7f8c880f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:43.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.254+0000 7f8c8ce40700 1 -- 172.21.15.77:0/2786080716 shutdown_connections 2024-04-25T02:19:43.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.254+0000 7f8c8ce40700 1 -- 172.21.15.77:0/2786080716 wait complete. 2024-04-25T02:19:43.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.254+0000 7f8c8ce40700 1 Processor -- start 2024-04-25T02:19:43.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.254+0000 7f8c8ce40700 1 -- start start 2024-04-25T02:19:43.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.254+0000 7f8c8ce40700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c88101cf0 0x7f8c88112850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:43.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.254+0000 7f8c8ce40700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c88102690 0x7f8c88112d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:43.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.254+0000 7f8c8ce40700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c881133e0 con 0x7f8c88102690 2024-04-25T02:19:43.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.254+0000 7f8c8ce40700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8810c9e0 con 0x7f8c88101cf0 2024-04-25T02:19:43.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.255+0000 7f8c85d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c88102690 0x7f8c88112d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:43.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.255+0000 7f8c85d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c88102690 0x7f8c88112d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42594/0 (socket says 172.21.15.77:42594) 2024-04-25T02:19:43.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.255+0000 7f8c85d9b700 1 -- 172.21.15.77:0/3882076850 learned_addr learned my addr 172.21.15.77:0/3882076850 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:19:43.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.255+0000 7f8c8659c700 1 --2- 172.21.15.77:0/3882076850 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c88101cf0 0x7f8c88112850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:43.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.255+0000 7f8c85d9b700 1 -- 172.21.15.77:0/3882076850 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c88101cf0 msgr2=0x7f8c88112850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:43.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.255+0000 7f8c85d9b700 1 --2- 172.21.15.77:0/3882076850 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c88101cf0 0x7f8c88112850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:43.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.255+0000 7f8c85d9b700 1 -- 172.21.15.77:0/3882076850 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c78005040 con 0x7f8c88102690 2024-04-25T02:19:43.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.255+0000 7f8c8659c700 1 --2- 172.21.15.77:0/3882076850 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c88101cf0 0x7f8c88112850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:19:43.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.255+0000 7f8c85d9b700 1 --2- 172.21.15.77:0/3882076850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c88102690 0x7f8c88112d90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800b3b0 tx=0x7f8c78009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:43.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.255+0000 7f8c76ffd700 1 -- 172.21.15.77:0/3882076850 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c7800e040 con 0x7f8c88102690 2024-04-25T02:19:43.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.255+0000 7f8c76ffd700 1 -- 172.21.15.77:0/3882076850 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8c78009b10 con 0x7f8c88102690 2024-04-25T02:19:43.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.255+0000 7f8c8ce40700 1 -- 172.21.15.77:0/3882076850 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c8810cc60 con 0x7f8c88102690 2024-04-25T02:19:43.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.255+0000 7f8c76ffd700 1 -- 172.21.15.77:0/3882076850 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c78013420 con 0x7f8c88102690 2024-04-25T02:19:43.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.255+0000 7f8c8ce40700 1 -- 172.21.15.77:0/3882076850 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c8810d220 con 0x7f8c88102690 2024-04-25T02:19:43.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.256+0000 7f8c8ce40700 1 -- 172.21.15.77:0/3882076850 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c880fd440 con 0x7f8c88102690 2024-04-25T02:19:43.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.257+0000 7f8c76ffd700 1 -- 172.21.15.77:0/3882076850 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8c7800bbc0 con 0x7f8c88102690 2024-04-25T02:19:43.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.257+0000 7f8c76ffd700 1 --2- 172.21.15.77:0/3882076850 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f8c7006e140 0x7f8c700705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:43.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.257+0000 7f8c76ffd700 1 -- 172.21.15.77:0/3882076850 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f8c7808e690 con 0x7f8c88102690 2024-04-25T02:19:43.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.257+0000 7f8c8659c700 1 --2- 172.21.15.77:0/3882076850 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f8c7006e140 0x7f8c700705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:43.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.258+0000 7f8c8659c700 1 --2- 172.21.15.77:0/3882076850 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f8c7006e140 0x7f8c700705f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c007fd0 tx=0x7f8c7c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:43.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.262+0000 7f8c76ffd700 1 -- 172.21.15.77:0/3882076850 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f8c7805b620 con 0x7f8c88102690 2024-04-25T02:19:43.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:42 smithi112 ceph-mon[80494]: pgmap v226: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:43.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.475+0000 7f8c8ce40700 1 -- 172.21.15.77:0/3882076850 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c8810df10 con 0x7f8c7006e140 2024-04-25T02:19:43.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.477+0000 7f8c76ffd700 1 -- 172.21.15.77:0/3882076850 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f8c8810df10 con 0x7f8c7006e140 2024-04-25T02:19:43.481 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:19:43.481 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": null, 2024-04-25T02:19:43.481 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": false, 2024-04-25T02:19:43.481 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "", 2024-04-25T02:19:43.481 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [], 2024-04-25T02:19:43.482 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": null, 2024-04-25T02:19:43.482 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "", 2024-04-25T02:19:43.482 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-04-25T02:19:43.482 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:19:43.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.478+0000 7f8c8ce40700 1 -- 172.21.15.77:0/3882076850 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f8c7006e140 msgr2=0x7f8c700705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:43.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.478+0000 7f8c8ce40700 1 --2- 172.21.15.77:0/3882076850 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f8c7006e140 0x7f8c700705f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c007fd0 tx=0x7f8c7c009040 comp rx=0 tx=0).stop 2024-04-25T02:19:43.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.478+0000 7f8c8ce40700 1 -- 172.21.15.77:0/3882076850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c88102690 msgr2=0x7f8c88112d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:43.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.478+0000 7f8c8ce40700 1 --2- 172.21.15.77:0/3882076850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c88102690 0x7f8c88112d90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800b3b0 tx=0x7f8c78009e30 comp rx=0 tx=0).stop 2024-04-25T02:19:43.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.478+0000 7f8c8ce40700 1 -- 172.21.15.77:0/3882076850 shutdown_connections 2024-04-25T02:19:43.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.479+0000 7f8c8ce40700 1 --2- 172.21.15.77:0/3882076850 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f8c7006e140 0x7f8c700705f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:43.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.479+0000 7f8c8ce40700 1 --2- 172.21.15.77:0/3882076850 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c88101cf0 0x7f8c88112850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:43.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.479+0000 7f8c8ce40700 1 --2- 172.21.15.77:0/3882076850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c88102690 0x7f8c88112d90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:43.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.479+0000 7f8c8ce40700 1 -- 172.21.15.77:0/3882076850 >> 172.21.15.77:0/3882076850 conn(0x7f8c880f7860 msgr2=0x7f8c880f8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:43.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.479+0000 7f8c8ce40700 1 -- 172.21.15.77:0/3882076850 shutdown_connections 2024-04-25T02:19:43.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:43.479+0000 7f8c8ce40700 1 -- 172.21.15.77:0/3882076850 wait complete. 2024-04-25T02:19:44.216 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -e sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 -- bash -c 'ceph health detail' 2024-04-25T02:19:44.469 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:19:45.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:45 smithi077 ceph-mon[110441]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:19:45.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:45 smithi077 ceph-mon[110441]: pgmap v227: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:45.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:45 smithi112 ceph-mon[80494]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:19:45.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:45 smithi112 ceph-mon[80494]: pgmap v227: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:46.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.094+0000 7fb0ff2de700 1 -- 172.21.15.77:0/526295711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f8101d10 msgr2=0x7fb0f81020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:46.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.095+0000 7fb0ff2de700 1 --2- 172.21.15.77:0/526295711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f8101d10 0x7fb0f81020e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4004940 tx=0x7fb0f4009e30 comp rx=0 tx=0).stop 2024-04-25T02:19:46.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.095+0000 7fb0ff2de700 1 -- 172.21.15.77:0/526295711 shutdown_connections 2024-04-25T02:19:46.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.095+0000 7fb0ff2de700 1 --2- 172.21.15.77:0/526295711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0f81026b0 0x7fb0f80fbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:46.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.095+0000 7fb0ff2de700 1 --2- 172.21.15.77:0/526295711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f8101d10 0x7fb0f81020e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:46.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.095+0000 7fb0ff2de700 1 -- 172.21.15.77:0/526295711 >> 172.21.15.77:0/526295711 conn(0x7fb0f80f7860 msgr2=0x7fb0f80f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:46.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.095+0000 7fb0ff2de700 1 -- 172.21.15.77:0/526295711 shutdown_connections 2024-04-25T02:19:46.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.095+0000 7fb0ff2de700 1 -- 172.21.15.77:0/526295711 wait complete. 2024-04-25T02:19:46.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.095+0000 7fb0ff2de700 1 Processor -- start 2024-04-25T02:19:46.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.095+0000 7fb0ff2de700 1 -- start start 2024-04-25T02:19:46.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.095+0000 7fb0ff2de700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f8101d10 0x7fb0f810c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:46.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.095+0000 7fb0ff2de700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0f81026b0 0x7fb0f810cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:46.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.095+0000 7fb0ff2de700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f8067100 con 0x7fb0f8101d10 2024-04-25T02:19:46.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.095+0000 7fb0ff2de700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f8067240 con 0x7fb0f81026b0 2024-04-25T02:19:46.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.095+0000 7fb0fd07a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f8101d10 0x7fb0f810c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:46.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.096+0000 7fb0fd07a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f8101d10 0x7fb0f810c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42618/0 (socket says 172.21.15.77:42618) 2024-04-25T02:19:46.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.096+0000 7fb0fd07a700 1 -- 172.21.15.77:0/1506555529 learned_addr learned my addr 172.21.15.77:0/1506555529 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:19:46.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.096+0000 7fb0fc879700 1 --2- 172.21.15.77:0/1506555529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0f81026b0 0x7fb0f810cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:46.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.096+0000 7fb0fd07a700 1 -- 172.21.15.77:0/1506555529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0f81026b0 msgr2=0x7fb0f810cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:46.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.096+0000 7fb0fd07a700 1 --2- 172.21.15.77:0/1506555529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0f81026b0 0x7fb0f810cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:46.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.096+0000 7fb0fd07a700 1 -- 172.21.15.77:0/1506555529 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f4005040 con 0x7fb0f8101d10 2024-04-25T02:19:46.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.096+0000 7fb0fc879700 1 --2- 172.21.15.77:0/1506555529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0f81026b0 0x7fb0f810cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:19:46.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.096+0000 7fb0fd07a700 1 --2- 172.21.15.77:0/1506555529 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f8101d10 0x7fb0f810c980 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb0f400b8b0 tx=0x7fb0f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:46.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.096+0000 7fb0edffb700 1 -- 172.21.15.77:0/1506555529 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0f400e040 con 0x7fb0f8101d10 2024-04-25T02:19:46.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.096+0000 7fb0edffb700 1 -- 172.21.15.77:0/1506555529 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb0f4004290 con 0x7fb0f8101d10 2024-04-25T02:19:46.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.096+0000 7fb0ff2de700 1 -- 172.21.15.77:0/1506555529 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f810d4f0 con 0x7fb0f8101d10 2024-04-25T02:19:46.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.096+0000 7fb0edffb700 1 -- 172.21.15.77:0/1506555529 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0f401c3f0 con 0x7fb0f8101d10 2024-04-25T02:19:46.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.096+0000 7fb0ff2de700 1 -- 172.21.15.77:0/1506555529 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f811a1b0 con 0x7fb0f8101d10 2024-04-25T02:19:46.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.097+0000 7fb0ff2de700 1 -- 172.21.15.77:0/1506555529 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f80fd460 con 0x7fb0f8101d10 2024-04-25T02:19:46.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.098+0000 7fb0edffb700 1 -- 172.21.15.77:0/1506555529 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb0f40137b0 con 0x7fb0f8101d10 2024-04-25T02:19:46.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.098+0000 7fb0edffb700 1 --2- 172.21.15.77:0/1506555529 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb0e406e140 0x7fb0e40705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:46.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.098+0000 7fb0edffb700 1 -- 172.21.15.77:0/1506555529 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb0f408eea0 con 0x7fb0f8101d10 2024-04-25T02:19:46.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.098+0000 7fb0fc879700 1 --2- 172.21.15.77:0/1506555529 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb0e406e140 0x7fb0e40705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:46.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.098+0000 7fb0fc879700 1 --2- 172.21.15.77:0/1506555529 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb0e406e140 0x7fb0e40705f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8007fd0 tx=0x7fb0e8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:46.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.103+0000 7fb0edffb700 1 -- 172.21.15.77:0/1506555529 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fb0f4058250 con 0x7fb0f8101d10 2024-04-25T02:19:46.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.385+0000 7fb0ff2de700 1 -- 172.21.15.77:0/1506555529 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb0f804c710 con 0x7fb0f8101d10 2024-04-25T02:19:46.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.386+0000 7fb0edffb700 1 -- 172.21.15.77:0/1506555529 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fb0f405b910 con 0x7fb0f8101d10 2024-04-25T02:19:46.390 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-04-25T02:19:46.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.388+0000 7fb0ff2de700 1 -- 172.21.15.77:0/1506555529 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb0e406e140 msgr2=0x7fb0e40705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:46.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.388+0000 7fb0ff2de700 1 --2- 172.21.15.77:0/1506555529 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb0e406e140 0x7fb0e40705f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8007fd0 tx=0x7fb0e8009040 comp rx=0 tx=0).stop 2024-04-25T02:19:46.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.388+0000 7fb0ff2de700 1 -- 172.21.15.77:0/1506555529 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f8101d10 msgr2=0x7fb0f810c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:46.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.388+0000 7fb0ff2de700 1 --2- 172.21.15.77:0/1506555529 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f8101d10 0x7fb0f810c980 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb0f400b8b0 tx=0x7fb0f4009e30 comp rx=0 tx=0).stop 2024-04-25T02:19:46.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.388+0000 7fb0ff2de700 1 -- 172.21.15.77:0/1506555529 shutdown_connections 2024-04-25T02:19:46.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.388+0000 7fb0ff2de700 1 --2- 172.21.15.77:0/1506555529 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb0e406e140 0x7fb0e40705f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:46.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.388+0000 7fb0ff2de700 1 --2- 172.21.15.77:0/1506555529 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f8101d10 0x7fb0f810c980 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:46.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.388+0000 7fb0ff2de700 1 --2- 172.21.15.77:0/1506555529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0f81026b0 0x7fb0f810cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:46.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.388+0000 7fb0ff2de700 1 -- 172.21.15.77:0/1506555529 >> 172.21.15.77:0/1506555529 conn(0x7fb0f80f7860 msgr2=0x7fb0f80f8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:46.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.388+0000 7fb0ff2de700 1 -- 172.21.15.77:0/1506555529 shutdown_connections 2024-04-25T02:19:46.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:46.388+0000 7fb0ff2de700 1 -- 172.21.15.77:0/1506555529 wait complete. 2024-04-25T02:19:47.038 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -e sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 -- bash -c 'ceph versions' 2024-04-25T02:19:47.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:47 smithi077 ceph-mon[110441]: pgmap v228: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:47.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:47 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/1506555529' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T02:19:47.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:47 smithi112 ceph-mon[80494]: pgmap v228: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:47.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:47 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/1506555529' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T02:19:47.292 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:19:48.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.923+0000 7f1b1c04c700 1 -- 172.21.15.77:0/3394358100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b140fe790 msgr2=0x7f1b14106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:48.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.923+0000 7f1b1c04c700 1 --2- 172.21.15.77:0/3394358100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b140fe790 0x7f1b14106e60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1b04004940 tx=0x7f1b04009e30 comp rx=0 tx=0).stop 2024-04-25T02:19:48.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.924+0000 7f1b1c04c700 1 -- 172.21.15.77:0/3394358100 shutdown_connections 2024-04-25T02:19:48.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.924+0000 7f1b1c04c700 1 --2- 172.21.15.77:0/3394358100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b140fe790 0x7f1b14106e60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:48.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.924+0000 7f1b1c04c700 1 --2- 172.21.15.77:0/3394358100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b140fddf0 0x7f1b140fe1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:48.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.924+0000 7f1b1c04c700 1 -- 172.21.15.77:0/3394358100 >> 172.21.15.77:0/3394358100 conn(0x7f1b140f7870 msgr2=0x7f1b140f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:48.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.924+0000 7f1b1c04c700 1 -- 172.21.15.77:0/3394358100 shutdown_connections 2024-04-25T02:19:48.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.924+0000 7f1b1c04c700 1 -- 172.21.15.77:0/3394358100 wait complete. 2024-04-25T02:19:48.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.924+0000 7f1b1c04c700 1 Processor -- start 2024-04-25T02:19:48.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.924+0000 7f1b1c04c700 1 -- start start 2024-04-25T02:19:48.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.924+0000 7f1b1c04c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b140fddf0 0x7f1b14113950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:48.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.924+0000 7f1b1c04c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b140fe790 0x7f1b14113e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:48.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.924+0000 7f1b1c04c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b14114570 con 0x7f1b140fe790 2024-04-25T02:19:48.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.924+0000 7f1b1c04c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1410db30 con 0x7f1b140fddf0 2024-04-25T02:19:48.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.925+0000 7f1b195e7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b140fe790 0x7f1b14113e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:48.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.925+0000 7f1b195e7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b140fe790 0x7f1b14113e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56616/0 (socket says 172.21.15.77:56616) 2024-04-25T02:19:48.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.925+0000 7f1b195e7700 1 -- 172.21.15.77:0/1136029274 learned_addr learned my addr 172.21.15.77:0/1136029274 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:19:48.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.925+0000 7f1b19de8700 1 --2- 172.21.15.77:0/1136029274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b140fddf0 0x7f1b14113950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:48.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.925+0000 7f1b195e7700 1 -- 172.21.15.77:0/1136029274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b140fddf0 msgr2=0x7f1b14113950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:48.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.925+0000 7f1b195e7700 1 --2- 172.21.15.77:0/1136029274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b140fddf0 0x7f1b14113950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:48.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.925+0000 7f1b195e7700 1 -- 172.21.15.77:0/1136029274 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b04005040 con 0x7f1b140fe790 2024-04-25T02:19:48.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.925+0000 7f1b195e7700 1 --2- 172.21.15.77:0/1136029274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b140fe790 0x7f1b14113e90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1b04004890 tx=0x7f1b04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:48.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.925+0000 7f1b0a7fc700 1 -- 172.21.15.77:0/1136029274 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b0400e040 con 0x7f1b140fe790 2024-04-25T02:19:48.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.925+0000 7f1b1c04c700 1 -- 172.21.15.77:0/1136029274 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b1410ddb0 con 0x7f1b140fe790 2024-04-25T02:19:48.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.925+0000 7f1b0a7fc700 1 -- 172.21.15.77:0/1136029274 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1b04009af0 con 0x7f1b140fe790 2024-04-25T02:19:48.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.925+0000 7f1b0a7fc700 1 -- 172.21.15.77:0/1136029274 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b0401c3f0 con 0x7f1b140fe790 2024-04-25T02:19:48.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.925+0000 7f1b1c04c700 1 -- 172.21.15.77:0/1136029274 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b1410e2f0 con 0x7f1b140fe790 2024-04-25T02:19:48.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.926+0000 7f1b1c04c700 1 -- 172.21.15.77:0/1136029274 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b14066ab0 con 0x7f1b140fe790 2024-04-25T02:19:48.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.927+0000 7f1b0a7fc700 1 -- 172.21.15.77:0/1136029274 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1b0400baf0 con 0x7f1b140fe790 2024-04-25T02:19:48.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.927+0000 7f1b0a7fc700 1 --2- 172.21.15.77:0/1136029274 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f1b0006e140 0x7f1b000705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:48.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.927+0000 7f1b0a7fc700 1 -- 172.21.15.77:0/1136029274 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f1b0408ee10 con 0x7f1b140fe790 2024-04-25T02:19:48.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.927+0000 7f1b19de8700 1 --2- 172.21.15.77:0/1136029274 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f1b0006e140 0x7f1b000705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:48.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.928+0000 7f1b19de8700 1 --2- 172.21.15.77:0/1136029274 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f1b0006e140 0x7f1b000705f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009bf0 tx=0x7f1b100091a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:48.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:48.932+0000 7f1b0a7fc700 1 -- 172.21.15.77:0/1136029274 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f1b0405bc70 con 0x7f1b140fe790 2024-04-25T02:19:49.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:49.218+0000 7f1b1c04c700 1 -- 172.21.15.77:0/1136029274 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1b14109f00 con 0x7f1b140fe790 2024-04-25T02:19:49.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:49.219+0000 7f1b0a7fc700 1 -- 172.21.15.77:0/1136029274 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f1b0405b800 con 0x7f1b140fe790 2024-04-25T02:19:49.224 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:19:49.224 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-04-25T02:19:49.224 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:19:49.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:19:49.224 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-04-25T02:19:49.224 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:19:49.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:19:49.224 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-04-25T02:19:49.224 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 6 2024-04-25T02:19:49.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:19:49.224 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-04-25T02:19:49.224 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 4 2024-04-25T02:19:49.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:19:49.224 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-04-25T02:19:49.225 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 14 2024-04-25T02:19:49.225 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-25T02:19:49.225 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:19:49.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:49.221+0000 7f1b1c04c700 1 -- 172.21.15.77:0/1136029274 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f1b0006e140 msgr2=0x7f1b000705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:49.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:49.221+0000 7f1b1c04c700 1 --2- 172.21.15.77:0/1136029274 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f1b0006e140 0x7f1b000705f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009bf0 tx=0x7f1b100091a0 comp rx=0 tx=0).stop 2024-04-25T02:19:49.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:49.221+0000 7f1b1c04c700 1 -- 172.21.15.77:0/1136029274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b140fe790 msgr2=0x7f1b14113e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:49.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:49.221+0000 7f1b1c04c700 1 --2- 172.21.15.77:0/1136029274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b140fe790 0x7f1b14113e90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1b04004890 tx=0x7f1b04009e30 comp rx=0 tx=0).stop 2024-04-25T02:19:49.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:49.221+0000 7f1b1c04c700 1 -- 172.21.15.77:0/1136029274 shutdown_connections 2024-04-25T02:19:49.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:49.221+0000 7f1b1c04c700 1 --2- 172.21.15.77:0/1136029274 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f1b0006e140 0x7f1b000705f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:49.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:49.221+0000 7f1b1c04c700 1 --2- 172.21.15.77:0/1136029274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b140fddf0 0x7f1b14113950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:49.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:49.221+0000 7f1b1c04c700 1 --2- 172.21.15.77:0/1136029274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b140fe790 0x7f1b14113e90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:49.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:49.221+0000 7f1b1c04c700 1 -- 172.21.15.77:0/1136029274 >> 172.21.15.77:0/1136029274 conn(0x7f1b140f7870 msgr2=0x7f1b14103760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:49.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:49.221+0000 7f1b1c04c700 1 -- 172.21.15.77:0/1136029274 shutdown_connections 2024-04-25T02:19:49.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:19:49.221+0000 7f1b1c04c700 1 -- 172.21.15.77:0/1136029274 wait complete. 2024-04-25T02:19:49.262 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:49 smithi077 ceph-mon[110441]: pgmap v229: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:49.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:49 smithi112 ceph-mon[80494]: pgmap v229: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:49.855 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -e sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-04-25T02:19:50.111 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:19:50.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:50 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/1136029274' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:50.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:50 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/1136029274' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:19:51.134 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:51 smithi077 ceph-mon[110441]: pgmap v230: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:51.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:51 smithi112 ceph-mon[80494]: pgmap v230: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:51.630 INFO:teuthology.orchestra.run.smithi077.stdout:wait for servicemap items w/ changing names to refresh 2024-04-25T02:19:52.270 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -e sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 -- bash -c 'sleep 60' 2024-04-25T02:19:52.526 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:19:53.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:53 smithi077 ceph-mon[110441]: pgmap v231: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:53.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:53 smithi112 ceph-mon[80494]: pgmap v231: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:54.120 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:54 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:19:54.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:54 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:19:55.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:55 smithi112 ceph-mon[80494]: pgmap v232: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:55.476 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:55 smithi077 ceph-mon[110441]: pgmap v232: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:56.476 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:56 smithi077 ceph-mon[110441]: pgmap v233: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:56.526 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:56 smithi112 ceph-mon[80494]: pgmap v233: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:59.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:19:58 smithi077 ceph-mon[110441]: pgmap v234: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:19:59.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:19:58 smithi112 ceph-mon[80494]: pgmap v234: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:01.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:00 smithi077 ceph-mon[110441]: pgmap v235: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:01.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:00 smithi077 ceph-mon[110441]: overall HEALTH_OK 2024-04-25T02:20:01.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:00 smithi112 ceph-mon[80494]: pgmap v235: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:01.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:00 smithi112 ceph-mon[80494]: overall HEALTH_OK 2024-04-25T02:20:03.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:02 smithi077 ceph-mon[110441]: pgmap v236: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:03.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:02 smithi112 ceph-mon[80494]: pgmap v236: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:05.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:04 smithi077 ceph-mon[110441]: pgmap v237: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:05.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:04 smithi112 ceph-mon[80494]: pgmap v237: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:07.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:06 smithi077 ceph-mon[110441]: pgmap v238: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:07.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:06 smithi112 ceph-mon[80494]: pgmap v238: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:09.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:08 smithi077 ceph-mon[110441]: pgmap v239: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:09.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:20:09.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:08 smithi112 ceph-mon[80494]: pgmap v239: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:09.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:20:11.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:10 smithi077 ceph-mon[110441]: pgmap v240: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:11.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:10 smithi112 ceph-mon[80494]: pgmap v240: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:13.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:12 smithi077 ceph-mon[110441]: pgmap v241: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:13.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:12 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:20:13.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:12 smithi112 ceph-mon[80494]: pgmap v241: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:13.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:12 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:20:14.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:13 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:20:14.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:13 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:20:14.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:13 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:20:14.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:13 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:20:14.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:13 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:20:14.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:13 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:20:15.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:14 smithi112 ceph-mon[80494]: pgmap v242: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:15.476 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:14 smithi077 ceph-mon[110441]: pgmap v242: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:17.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:17 smithi112 ceph-mon[80494]: pgmap v243: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:17.476 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:16 smithi077 ceph-mon[110441]: pgmap v243: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:19.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:19 smithi112 ceph-mon[80494]: pgmap v244: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:19.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:19 smithi077 ceph-mon[110441]: pgmap v244: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:21.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:21 smithi112 ceph-mon[80494]: pgmap v245: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:21.476 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:21 smithi077 ceph-mon[110441]: pgmap v245: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:23.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:23 smithi112 ceph-mon[80494]: pgmap v246: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:23.476 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:23 smithi077 ceph-mon[110441]: pgmap v246: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:24.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:24 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:20:24.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:24 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:20:25.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:25 smithi112 ceph-mon[80494]: pgmap v247: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:25.477 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:25 smithi077 ceph-mon[110441]: pgmap v247: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:27.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:27 smithi112 ceph-mon[80494]: pgmap v248: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:27.476 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:27 smithi077 ceph-mon[110441]: pgmap v248: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:29.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:29 smithi112 ceph-mon[80494]: pgmap v249: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:29.476 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:29 smithi077 ceph-mon[110441]: pgmap v249: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:31.476 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:31 smithi077 ceph-mon[110441]: pgmap v250: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:31.526 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:31 smithi112 ceph-mon[80494]: pgmap v250: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:32.476 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:32 smithi077 ceph-mon[110441]: pgmap v251: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:32.526 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:32 smithi112 ceph-mon[80494]: pgmap v251: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:35.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:34 smithi077 ceph-mon[110441]: pgmap v252: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:35.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:34 smithi112 ceph-mon[80494]: pgmap v252: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:37.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:36 smithi077 ceph-mon[110441]: pgmap v253: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:37.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:36 smithi112 ceph-mon[80494]: pgmap v253: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:39.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:38 smithi077 ceph-mon[110441]: pgmap v254: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:39.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:38 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:20:39.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:38 smithi112 ceph-mon[80494]: pgmap v254: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:39.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:38 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:20:41.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:40 smithi077 ceph-mon[110441]: pgmap v255: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:41.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:40 smithi112 ceph-mon[80494]: pgmap v255: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:43.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:42 smithi077 ceph-mon[110441]: pgmap v256: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:43.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:42 smithi112 ceph-mon[80494]: pgmap v256: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:45.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:44 smithi077 ceph-mon[110441]: pgmap v257: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:45.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:44 smithi112 ceph-mon[80494]: pgmap v257: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:47.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:46 smithi077 ceph-mon[110441]: pgmap v258: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:47.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:46 smithi112 ceph-mon[80494]: pgmap v258: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:49.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:48 smithi077 ceph-mon[110441]: pgmap v259: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:49.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:48 smithi112 ceph-mon[80494]: pgmap v259: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:51.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:50 smithi077 ceph-mon[110441]: pgmap v260: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:51.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:50 smithi112 ceph-mon[80494]: pgmap v260: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:53.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:52 smithi077 ceph-mon[110441]: pgmap v261: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:53.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:52 smithi112 ceph-mon[80494]: pgmap v261: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:54.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:53 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:20:54.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:53 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:20:54.945 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -e sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 -- bash -c 'ceph orch ps' 2024-04-25T02:20:55.208 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:20:55.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:54 smithi077 ceph-mon[110441]: pgmap v262: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:55.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:54 smithi112 ceph-mon[80494]: pgmap v262: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:56.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.887+0000 7f3b7a485700 1 -- 172.21.15.77:0/510951381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b74070300 msgr2=0x7f3b740706d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:56.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.887+0000 7f3b7a485700 1 --2- 172.21.15.77:0/510951381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b74070300 0x7f3b740706d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3b64004970 tx=0x7f3b64009e30 comp rx=0 tx=0).stop 2024-04-25T02:20:56.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.887+0000 7f3b7a485700 1 -- 172.21.15.77:0/510951381 shutdown_connections 2024-04-25T02:20:56.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.887+0000 7f3b7a485700 1 --2- 172.21.15.77:0/510951381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b74070c10 0x7f3b741090f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:56.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.887+0000 7f3b7a485700 1 --2- 172.21.15.77:0/510951381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b74070300 0x7f3b740706d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:56.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.887+0000 7f3b7a485700 1 -- 172.21.15.77:0/510951381 >> 172.21.15.77:0/510951381 conn(0x7f3b740f8990 msgr2=0x7f3b740fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:56.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.887+0000 7f3b7a485700 1 -- 172.21.15.77:0/510951381 shutdown_connections 2024-04-25T02:20:56.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.887+0000 7f3b7a485700 1 -- 172.21.15.77:0/510951381 wait complete. 2024-04-25T02:20:56.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.887+0000 7f3b7a485700 1 Processor -- start 2024-04-25T02:20:56.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.887+0000 7f3b7a485700 1 -- start start 2024-04-25T02:20:56.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.888+0000 7f3b7a485700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b74070300 0x7f3b74115b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:56.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.888+0000 7f3b7a485700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b74070c10 0x7f3b74116080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:56.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.888+0000 7f3b7a485700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b741166d0 con 0x7f3b74070c10 2024-04-25T02:20:56.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.888+0000 7f3b7a485700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7410fcb0 con 0x7f3b74070300 2024-04-25T02:20:56.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.888+0000 7f3b737fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b74070c10 0x7f3b74116080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:56.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.888+0000 7f3b737fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b74070c10 0x7f3b74116080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37490/0 (socket says 172.21.15.77:37490) 2024-04-25T02:20:56.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.888+0000 7f3b737fe700 1 -- 172.21.15.77:0/189999848 learned_addr learned my addr 172.21.15.77:0/189999848 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:20:56.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.888+0000 7f3b73fff700 1 --2- 172.21.15.77:0/189999848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b74070300 0x7f3b74115b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:56.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.888+0000 7f3b737fe700 1 -- 172.21.15.77:0/189999848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b74070300 msgr2=0x7f3b74115b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:56.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.888+0000 7f3b737fe700 1 --2- 172.21.15.77:0/189999848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b74070300 0x7f3b74115b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:56.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.888+0000 7f3b737fe700 1 -- 172.21.15.77:0/189999848 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b64005040 con 0x7f3b74070c10 2024-04-25T02:20:56.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.888+0000 7f3b737fe700 1 --2- 172.21.15.77:0/189999848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b74070c10 0x7f3b74116080 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3b6800c830 tx=0x7f3b68004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:56.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.889+0000 7f3b70ff9700 1 -- 172.21.15.77:0/189999848 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b680106f0 con 0x7f3b74070c10 2024-04-25T02:20:56.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.889+0000 7f3b70ff9700 1 -- 172.21.15.77:0/189999848 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b68010d20 con 0x7f3b74070c10 2024-04-25T02:20:56.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.889+0000 7f3b70ff9700 1 -- 172.21.15.77:0/189999848 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b680113a0 con 0x7f3b74070c10 2024-04-25T02:20:56.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.889+0000 7f3b7a485700 1 -- 172.21.15.77:0/189999848 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b7410ff90 con 0x7f3b74070c10 2024-04-25T02:20:56.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.889+0000 7f3b7a485700 1 -- 172.21.15.77:0/189999848 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b74110480 con 0x7f3b74070c10 2024-04-25T02:20:56.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.890+0000 7f3b7a485700 1 -- 172.21.15.77:0/189999848 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b74071a40 con 0x7f3b74070c10 2024-04-25T02:20:56.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.890+0000 7f3b70ff9700 1 -- 172.21.15.77:0/189999848 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3b68012400 con 0x7f3b74070c10 2024-04-25T02:20:56.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.891+0000 7f3b70ff9700 1 --2- 172.21.15.77:0/189999848 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f3b5c06e140 0x7f3b5c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:56.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.891+0000 7f3b73fff700 1 --2- 172.21.15.77:0/189999848 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f3b5c06e140 0x7f3b5c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:56.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.891+0000 7f3b70ff9700 1 -- 172.21.15.77:0/189999848 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f3b6808db40 con 0x7f3b74070c10 2024-04-25T02:20:56.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.891+0000 7f3b73fff700 1 --2- 172.21.15.77:0/189999848 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f3b5c06e140 0x7f3b5c0705f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3b64004f50 tx=0x7f3b64009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:56.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:56.895+0000 7f3b70ff9700 1 -- 172.21.15.77:0/189999848 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f3b6805a9a0 con 0x7f3b74070c10 2024-04-25T02:20:56.976 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:56 smithi077 ceph-mon[110441]: pgmap v263: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:57.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:57.101+0000 7f3b7a485700 1 -- 172.21.15.77:0/189999848 --> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b7410c140 con 0x7f3b5c06e140 2024-04-25T02:20:57.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:57.111+0000 7f3b70ff9700 1 -- 172.21.15.77:0/189999848 <== mgr.34104 v2:172.21.15.77:6800/3291613354 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f3b7410c140 con 0x7f3b5c06e140 2024-04-25T02:20:57.114 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T02:20:57.114 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (9m) 2m ago 20m 26.8M - 0.25.0 c8568f914cd2 699c7fd25ea5 2024-04-25T02:20:57.114 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (6m) 2m ago 20m 6660k - 19.0.0-2445-gd2c45d97 f68e37b807ef f3c45d31e2e3 2024-04-25T02:20:57.114 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi112 smithi112 running (6m) 110s ago 19m 6656k - 19.0.0-2445-gd2c45d97 f68e37b807ef e16d9899ed11 2024-04-25T02:20:57.115 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (8m) 2m ago 19m 79.4M - 9.4.12 2bacad6d85d8 900138b0bcf0 2024-04-25T02:20:57.115 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.gcfygj smithi077 running (2m) 2m ago 14m 11.6M - 19.0.0-2445-gd2c45d97 f68e37b807ef 25bb04d1a9c3 2024-04-25T02:20:57.115 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.oadrkb smithi077 running (2m) 2m ago 14m 11.5M - 19.0.0-2445-gd2c45d97 f68e37b807ef e34ba410a62c 2024-04-25T02:20:57.115 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.dvwudt smithi112 running (2m) 110s ago 14m 11.7M - 19.0.0-2445-gd2c45d97 f68e37b807ef 6334abfd52be 2024-04-25T02:20:57.115 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi112.fjnadi smithi112 running (113s) 110s ago 14m 11.4M - 19.0.0-2445-gd2c45d97 f68e37b807ef 03f0494c61c9 2024-04-25T02:20:57.115 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.zpflzp smithi077 *:8443,9283,8765 running (10m) 2m ago 21m 508M - 19.0.0-2445-gd2c45d97 f68e37b807ef a1af92e027e5 2024-04-25T02:20:57.115 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi112.cswrxs smithi112 *:8443,9283,8765 running (9m) 110s ago 19m 451M - 19.0.0-2445-gd2c45d97 f68e37b807ef ccc7c57d35f2 2024-04-25T02:20:57.115 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (7m) 2m ago 21m 53.0M 2048M 19.0.0-2445-gd2c45d97 f68e37b807ef 06490c2ecc44 2024-04-25T02:20:57.115 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi112 smithi112 running (7m) 110s ago 19m 42.7M 2048M 19.0.0-2445-gd2c45d97 f68e37b807ef ccd1398acbc5 2024-04-25T02:20:57.115 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (9m) 2m ago 20m 16.7M - 1.5.0 0da6a335fe13 2320132606fc 2024-04-25T02:20:57.115 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi112 smithi112 *:9100 running (9m) 110s ago 19m 15.0M - 1.5.0 0da6a335fe13 49f285354791 2024-04-25T02:20:57.115 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (6m) 2m ago 18m 98.6M 1557M 19.0.0-2445-gd2c45d97 f68e37b807ef 7035e288ddae 2024-04-25T02:20:57.115 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (5m) 2m ago 17m 113M 1557M 19.0.0-2445-gd2c45d97 f68e37b807ef 6e514f700c36 2024-04-25T02:20:57.115 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (4m) 2m ago 17m 98.1M 1557M 19.0.0-2445-gd2c45d97 f68e37b807ef 392fd2036c16 2024-04-25T02:20:57.115 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi112 running (4m) 110s ago 17m 120M 2581M 19.0.0-2445-gd2c45d97 f68e37b807ef c100df1a0f60 2024-04-25T02:20:57.116 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi112 running (3m) 110s ago 16m 109M 2581M 19.0.0-2445-gd2c45d97 f68e37b807ef 669b1ab41e27 2024-04-25T02:20:57.116 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi112 running (3m) 110s ago 16m 108M 2581M 19.0.0-2445-gd2c45d97 f68e37b807ef cc8f3462943e 2024-04-25T02:20:57.116 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (9m) 2m ago 19m 59.4M - 2.43.0 a07b618ecd1d c5b8c6104d96 2024-04-25T02:20:57.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:57.113+0000 7f3b7a485700 1 -- 172.21.15.77:0/189999848 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f3b5c06e140 msgr2=0x7f3b5c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:57.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:57.113+0000 7f3b7a485700 1 --2- 172.21.15.77:0/189999848 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f3b5c06e140 0x7f3b5c0705f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3b64004f50 tx=0x7f3b64009e30 comp rx=0 tx=0).stop 2024-04-25T02:20:57.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:57.113+0000 7f3b7a485700 1 -- 172.21.15.77:0/189999848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b74070c10 msgr2=0x7f3b74116080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:57.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:57.113+0000 7f3b7a485700 1 --2- 172.21.15.77:0/189999848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b74070c10 0x7f3b74116080 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3b6800c830 tx=0x7f3b68004470 comp rx=0 tx=0).stop 2024-04-25T02:20:57.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:57.114+0000 7f3b7a485700 1 -- 172.21.15.77:0/189999848 shutdown_connections 2024-04-25T02:20:57.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:57.114+0000 7f3b7a485700 1 --2- 172.21.15.77:0/189999848 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f3b5c06e140 0x7f3b5c0705f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:57.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:57.114+0000 7f3b7a485700 1 --2- 172.21.15.77:0/189999848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b74070300 0x7f3b74115b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:57.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:57.114+0000 7f3b7a485700 1 --2- 172.21.15.77:0/189999848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b74070c10 0x7f3b74116080 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:57.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:57.114+0000 7f3b7a485700 1 -- 172.21.15.77:0/189999848 >> 172.21.15.77:0/189999848 conn(0x7f3b740f8990 msgr2=0x7f3b740f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:57.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:57.114+0000 7f3b7a485700 1 -- 172.21.15.77:0/189999848 shutdown_connections 2024-04-25T02:20:57.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:57.114+0000 7f3b7a485700 1 -- 172.21.15.77:0/189999848 wait complete. 2024-04-25T02:20:57.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:56 smithi112 ceph-mon[80494]: pgmap v263: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:57.712 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -e sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 -- bash -c 'ceph versions' 2024-04-25T02:20:57.976 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:20:59.045 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:58 smithi077 ceph-mon[110441]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:20:59.045 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:58 smithi077 ceph-mon[110441]: pgmap v264: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:59.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:58 smithi112 ceph-mon[80494]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:20:59.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:58 smithi112 ceph-mon[80494]: pgmap v264: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:20:59.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.579+0000 7f955ecb0700 1 -- 172.21.15.77:0/3869357830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9558103790 msgr2=0x7f95580fce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:59.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.579+0000 7f955ecb0700 1 --2- 172.21.15.77:0/3869357830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9558103790 0x7f95580fce00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9544004940 tx=0x7f9544009e30 comp rx=0 tx=0).stop 2024-04-25T02:20:59.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.579+0000 7f955ecb0700 1 -- 172.21.15.77:0/3869357830 shutdown_connections 2024-04-25T02:20:59.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.579+0000 7f955ecb0700 1 --2- 172.21.15.77:0/3869357830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9558103790 0x7f95580fce00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:59.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.579+0000 7f955ecb0700 1 --2- 172.21.15.77:0/3869357830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9558102df0 0x7f95581031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:59.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.579+0000 7f955ecb0700 1 -- 172.21.15.77:0/3869357830 >> 172.21.15.77:0/3869357830 conn(0x7f95580f8980 msgr2=0x7f95580fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.579+0000 7f955ecb0700 1 -- 172.21.15.77:0/3869357830 shutdown_connections 2024-04-25T02:20:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.579+0000 7f955ecb0700 1 -- 172.21.15.77:0/3869357830 wait complete. 2024-04-25T02:20:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.579+0000 7f955ecb0700 1 Processor -- start 2024-04-25T02:20:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.579+0000 7f955ecb0700 1 -- start start 2024-04-25T02:20:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.580+0000 7f955ecb0700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9558102df0 0x7f9558070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.580+0000 7f955ecb0700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9558103790 0x7f95580707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.580+0000 7f955ecb0700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9558070dc0 con 0x7f9558103790 2024-04-25T02:20:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.580+0000 7f955ecb0700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9558070f00 con 0x7f9558102df0 2024-04-25T02:20:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.580+0000 7f9557fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9558103790 0x7f95580707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.580+0000 7f9557fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9558103790 0x7f95580707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44450/0 (socket says 172.21.15.77:44450) 2024-04-25T02:20:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.580+0000 7f9557fff700 1 -- 172.21.15.77:0/2821394010 learned_addr learned my addr 172.21.15.77:0/2821394010 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:20:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.580+0000 7f955ca4c700 1 --2- 172.21.15.77:0/2821394010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9558102df0 0x7f9558070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.580+0000 7f9557fff700 1 -- 172.21.15.77:0/2821394010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9558102df0 msgr2=0x7f9558070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.580+0000 7f9557fff700 1 --2- 172.21.15.77:0/2821394010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9558102df0 0x7f9558070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.580+0000 7f9557fff700 1 -- 172.21.15.77:0/2821394010 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9544005040 con 0x7f9558103790 2024-04-25T02:20:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.580+0000 7f955ca4c700 1 --2- 172.21.15.77:0/2821394010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9558102df0 0x7f9558070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:20:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.580+0000 7f9557fff700 1 --2- 172.21.15.77:0/2821394010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9558103790 0x7f95580707a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9544009100 tx=0x7f9544009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.580+0000 7f95557fa700 1 -- 172.21.15.77:0/2821394010 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f954400e040 con 0x7f9558103790 2024-04-25T02:20:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.580+0000 7f95557fa700 1 -- 172.21.15.77:0/2821394010 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9544013420 con 0x7f9558103790 2024-04-25T02:20:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.580+0000 7f955ecb0700 1 -- 172.21.15.77:0/2821394010 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9558119ed0 con 0x7f9558103790 2024-04-25T02:20:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.580+0000 7f95557fa700 1 -- 172.21.15.77:0/2821394010 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f954401c610 con 0x7f9558103790 2024-04-25T02:20:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.580+0000 7f955ecb0700 1 -- 172.21.15.77:0/2821394010 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f955811a330 con 0x7f9558103790 2024-04-25T02:20:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.581+0000 7f955ecb0700 1 -- 172.21.15.77:0/2821394010 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9558100100 con 0x7f9558103790 2024-04-25T02:20:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.582+0000 7f95557fa700 1 -- 172.21.15.77:0/2821394010 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9544013590 con 0x7f9558103790 2024-04-25T02:20:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.582+0000 7f95557fa700 1 --2- 172.21.15.77:0/2821394010 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f954806e140 0x7f95480705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.582+0000 7f95557fa700 1 -- 172.21.15.77:0/2821394010 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f954408ec90 con 0x7f9558103790 2024-04-25T02:20:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.582+0000 7f955ca4c700 1 --2- 172.21.15.77:0/2821394010 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f954806e140 0x7f95480705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.583+0000 7f955ca4c700 1 --2- 172.21.15.77:0/2821394010 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f954806e140 0x7f95480705f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f954c006fd0 tx=0x7f954c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:59.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.587+0000 7f95557fa700 1 -- 172.21.15.77:0/2821394010 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f9544058100 con 0x7f9558103790 2024-04-25T02:20:59.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.875+0000 7f955ecb0700 1 -- 172.21.15.77:0/2821394010 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9558100100 con 0x7f9558103790 2024-04-25T02:20:59.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.876+0000 7f95557fa700 1 -- 172.21.15.77:0/2821394010 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f954405b7c0 con 0x7f9558103790 2024-04-25T02:20:59.879 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T02:20:59.879 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-04-25T02:20:59.880 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:20:59.880 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:20:59.880 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-04-25T02:20:59.880 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 2 2024-04-25T02:20:59.880 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:20:59.880 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-04-25T02:20:59.880 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 6 2024-04-25T02:20:59.880 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:20:59.880 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-04-25T02:20:59.880 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 4 2024-04-25T02:20:59.880 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T02:20:59.880 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-04-25T02:20:59.880 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)": 14 2024-04-25T02:20:59.880 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-25T02:20:59.881 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T02:20:59.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.878+0000 7f955ecb0700 1 -- 172.21.15.77:0/2821394010 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f954806e140 msgr2=0x7f95480705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:59.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.878+0000 7f955ecb0700 1 --2- 172.21.15.77:0/2821394010 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f954806e140 0x7f95480705f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f954c006fd0 tx=0x7f954c008040 comp rx=0 tx=0).stop 2024-04-25T02:20:59.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.878+0000 7f955ecb0700 1 -- 172.21.15.77:0/2821394010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9558103790 msgr2=0x7f95580707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:59.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.878+0000 7f955ecb0700 1 --2- 172.21.15.77:0/2821394010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9558103790 0x7f95580707a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9544009100 tx=0x7f9544009e30 comp rx=0 tx=0).stop 2024-04-25T02:20:59.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.878+0000 7f955ecb0700 1 -- 172.21.15.77:0/2821394010 shutdown_connections 2024-04-25T02:20:59.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.878+0000 7f955ecb0700 1 --2- 172.21.15.77:0/2821394010 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f954806e140 0x7f95480705f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:59.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.878+0000 7f955ecb0700 1 --2- 172.21.15.77:0/2821394010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9558102df0 0x7f9558070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:59.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.878+0000 7f955ecb0700 1 --2- 172.21.15.77:0/2821394010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9558103790 0x7f95580707a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:59.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.878+0000 7f955ecb0700 1 -- 172.21.15.77:0/2821394010 >> 172.21.15.77:0/2821394010 conn(0x7f95580f8980 msgr2=0x7f95581073b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:59.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.878+0000 7f955ecb0700 1 -- 172.21.15.77:0/2821394010 shutdown_connections 2024-04-25T02:20:59.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:20:59.878+0000 7f955ecb0700 1 -- 172.21.15.77:0/2821394010 wait complete. 2024-04-25T02:21:00.177 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:20:59 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/2821394010' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:21:00.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:20:59 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/2821394010' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:21:00.470 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -e sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-04-25T02:21:00.726 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:21:01.172 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:00 smithi077 ceph-mon[110441]: pgmap v265: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:21:01.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:00 smithi112 ceph-mon[80494]: pgmap v265: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:21:02.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.264+0000 7f19d4d59700 1 -- 172.21.15.77:0/2852182780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19d0102f60 msgr2=0x7f19d0103330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:02.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.264+0000 7f19d4d59700 1 --2- 172.21.15.77:0/2852182780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19d0102f60 0x7f19d0103330 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f19b8009ce0 tx=0x7f19b8004d10 comp rx=0 tx=0).stop 2024-04-25T02:21:02.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.264+0000 7f19d4d59700 1 -- 172.21.15.77:0/2852182780 shutdown_connections 2024-04-25T02:21:02.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.264+0000 7f19d4d59700 1 --2- 172.21.15.77:0/2852182780 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19d00fb520 0x7f19d00fb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:02.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.264+0000 7f19d4d59700 1 --2- 172.21.15.77:0/2852182780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19d0102f60 0x7f19d0103330 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:02.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.264+0000 7f19d4d59700 1 -- 172.21.15.77:0/2852182780 >> 172.21.15.77:0/2852182780 conn(0x7f19d00714d0 msgr2=0x7f19d00718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:02.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.264+0000 7f19d4d59700 1 -- 172.21.15.77:0/2852182780 shutdown_connections 2024-04-25T02:21:02.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.264+0000 7f19d4d59700 1 -- 172.21.15.77:0/2852182780 wait complete. 2024-04-25T02:21:02.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.265+0000 7f19d4d59700 1 Processor -- start 2024-04-25T02:21:02.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.265+0000 7f19d4d59700 1 -- start start 2024-04-25T02:21:02.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.265+0000 7f19d4d59700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19d00fb520 0x7f19d0113b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:02.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.265+0000 7f19d4d59700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19d0102f60 0x7f19d0114040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:02.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.265+0000 7f19d4d59700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d0114690 con 0x7f19d0102f60 2024-04-25T02:21:02.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.265+0000 7f19d4d59700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d010dc70 con 0x7f19d00fb520 2024-04-25T02:21:02.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.265+0000 7f19cdd9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19d0102f60 0x7f19d0114040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:02.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.265+0000 7f19cdd9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19d0102f60 0x7f19d0114040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44476/0 (socket says 172.21.15.77:44476) 2024-04-25T02:21:02.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.265+0000 7f19cdd9b700 1 -- 172.21.15.77:0/2473446590 learned_addr learned my addr 172.21.15.77:0/2473446590 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:02.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.265+0000 7f19ce59c700 1 --2- 172.21.15.77:0/2473446590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19d00fb520 0x7f19d0113b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:02.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.265+0000 7f19cdd9b700 1 -- 172.21.15.77:0/2473446590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19d00fb520 msgr2=0x7f19d0113b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:02.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.265+0000 7f19cdd9b700 1 --2- 172.21.15.77:0/2473446590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19d00fb520 0x7f19d0113b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:02.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.265+0000 7f19cdd9b700 1 -- 172.21.15.77:0/2473446590 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b8009940 con 0x7f19d0102f60 2024-04-25T02:21:02.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.265+0000 7f19ce59c700 1 --2- 172.21.15.77:0/2473446590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19d00fb520 0x7f19d0113b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:21:02.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.265+0000 7f19cdd9b700 1 --2- 172.21.15.77:0/2473446590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19d0102f60 0x7f19d0114040 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f19c0002a80 tx=0x7f19c00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:02.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.265+0000 7f19c6ffd700 1 -- 172.21.15.77:0/2473446590 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19c0007cc0 con 0x7f19d0102f60 2024-04-25T02:21:02.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.265+0000 7f19d4d59700 1 -- 172.21.15.77:0/2473446590 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d010df50 con 0x7f19d0102f60 2024-04-25T02:21:02.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.265+0000 7f19c6ffd700 1 -- 172.21.15.77:0/2473446590 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f19c000f040 con 0x7f19d0102f60 2024-04-25T02:21:02.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.266+0000 7f19c6ffd700 1 -- 172.21.15.77:0/2473446590 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19c00096f0 con 0x7f19d0102f60 2024-04-25T02:21:02.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.266+0000 7f19d4d59700 1 -- 172.21.15.77:0/2473446590 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d010e490 con 0x7f19d0102f60 2024-04-25T02:21:02.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.266+0000 7f19d4d59700 1 -- 172.21.15.77:0/2473446590 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d0100250 con 0x7f19d0102f60 2024-04-25T02:21:02.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.267+0000 7f19c6ffd700 1 -- 172.21.15.77:0/2473446590 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f19c000d690 con 0x7f19d0102f60 2024-04-25T02:21:02.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.267+0000 7f19c6ffd700 1 --2- 172.21.15.77:0/2473446590 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f19bc06e140 0x7f19bc0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:02.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.267+0000 7f19ce59c700 1 --2- 172.21.15.77:0/2473446590 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f19bc06e140 0x7f19bc0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:02.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.268+0000 7f19c6ffd700 1 -- 172.21.15.77:0/2473446590 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f19c008d330 con 0x7f19d0102f60 2024-04-25T02:21:02.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.268+0000 7f19ce59c700 1 --2- 172.21.15.77:0/2473446590 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f19bc06e140 0x7f19bc0705f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f19b800b740 tx=0x7f19b8004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:02.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.272+0000 7f19c6ffd700 1 -- 172.21.15.77:0/2473446590 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f19c005a190 con 0x7f19d0102f60 2024-04-25T02:21:02.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.556+0000 7f19d4d59700 1 -- 172.21.15.77:0/2473446590 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f19d010f150 con 0x7f19d0102f60 2024-04-25T02:21:02.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.556+0000 7f19c6ffd700 1 -- 172.21.15.77:0/2473446590 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f19c0059d20 con 0x7f19d0102f60 2024-04-25T02:21:02.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.559+0000 7f19d4d59700 1 -- 172.21.15.77:0/2473446590 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f19bc06e140 msgr2=0x7f19bc0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:02.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.559+0000 7f19d4d59700 1 --2- 172.21.15.77:0/2473446590 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f19bc06e140 0x7f19bc0705f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f19b800b740 tx=0x7f19b8004d10 comp rx=0 tx=0).stop 2024-04-25T02:21:02.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.559+0000 7f19d4d59700 1 -- 172.21.15.77:0/2473446590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19d0102f60 msgr2=0x7f19d0114040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:02.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.559+0000 7f19d4d59700 1 --2- 172.21.15.77:0/2473446590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19d0102f60 0x7f19d0114040 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f19c0002a80 tx=0x7f19c00046b0 comp rx=0 tx=0).stop 2024-04-25T02:21:02.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.559+0000 7f19d4d59700 1 -- 172.21.15.77:0/2473446590 shutdown_connections 2024-04-25T02:21:02.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.559+0000 7f19d4d59700 1 --2- 172.21.15.77:0/2473446590 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f19bc06e140 0x7f19bc0705f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:02.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.559+0000 7f19d4d59700 1 --2- 172.21.15.77:0/2473446590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19d00fb520 0x7f19d0113b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:02.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.559+0000 7f19d4d59700 1 --2- 172.21.15.77:0/2473446590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19d0102f60 0x7f19d0114040 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:02.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.559+0000 7f19d4d59700 1 -- 172.21.15.77:0/2473446590 >> 172.21.15.77:0/2473446590 conn(0x7f19d00714d0 msgr2=0x7f19d00fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:02.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.559+0000 7f19d4d59700 1 -- 172.21.15.77:0/2473446590 shutdown_connections 2024-04-25T02:21:02.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:02.559+0000 7f19d4d59700 1 -- 172.21.15.77:0/2473446590 wait complete. 2024-04-25T02:21:02.572 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-04-25T02:21:03.191 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:02 smithi077 ceph-mon[110441]: pgmap v266: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:21:03.192 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:02 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/2473446590' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:21:03.217 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -e sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-04-25T02:21:03.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:02 smithi112 ceph-mon[80494]: pgmap v266: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:21:03.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:02 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/2473446590' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:21:03.468 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:21:05.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.155+0000 7f84b335a700 1 -- 172.21.15.77:0/328734541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84ac0fb610 msgr2=0x7f84ac0fb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:05.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.155+0000 7f84b335a700 1 --2- 172.21.15.77:0/328734541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84ac0fb610 0x7f84ac0fb9e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f84a8004970 tx=0x7f84a8009e30 comp rx=0 tx=0).stop 2024-04-25T02:21:05.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.155+0000 7f84b335a700 1 -- 172.21.15.77:0/328734541 shutdown_connections 2024-04-25T02:21:05.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.155+0000 7f84b335a700 1 --2- 172.21.15.77:0/328734541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84ac0fbf20 0x7f84ac10d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:05.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.155+0000 7f84b335a700 1 --2- 172.21.15.77:0/328734541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84ac0fb610 0x7f84ac0fb9e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:05.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.155+0000 7f84b335a700 1 -- 172.21.15.77:0/328734541 >> 172.21.15.77:0/328734541 conn(0x7f84ac072380 msgr2=0x7f84ac072780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:05.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.155+0000 7f84b335a700 1 -- 172.21.15.77:0/328734541 shutdown_connections 2024-04-25T02:21:05.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.155+0000 7f84b335a700 1 -- 172.21.15.77:0/328734541 wait complete. 2024-04-25T02:21:05.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.155+0000 7f84b335a700 1 Processor -- start 2024-04-25T02:21:05.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.155+0000 7f84b335a700 1 -- start start 2024-04-25T02:21:05.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.156+0000 7f84b335a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84ac0fb610 0x7f84ac119ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:05.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.156+0000 7f84b335a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84ac0fbf20 0x7f84ac11a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:05.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.156+0000 7f84b335a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac11ab10 con 0x7f84ac0fbf20 2024-04-25T02:21:05.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.156+0000 7f84b335a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac114060 con 0x7f84ac0fb610 2024-04-25T02:21:05.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.156+0000 7f84b08f5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84ac0fbf20 0x7f84ac11a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:05.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.156+0000 7f84b08f5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84ac0fbf20 0x7f84ac11a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44498/0 (socket says 172.21.15.77:44498) 2024-04-25T02:21:05.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.156+0000 7f84b08f5700 1 -- 172.21.15.77:0/2556508098 learned_addr learned my addr 172.21.15.77:0/2556508098 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:05.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.156+0000 7f84b10f6700 1 --2- 172.21.15.77:0/2556508098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84ac0fb610 0x7f84ac119ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:05.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.156+0000 7f84b08f5700 1 -- 172.21.15.77:0/2556508098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84ac0fb610 msgr2=0x7f84ac119ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:05.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.156+0000 7f84b08f5700 1 --2- 172.21.15.77:0/2556508098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84ac0fb610 0x7f84ac119ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:05.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.156+0000 7f84b08f5700 1 -- 172.21.15.77:0/2556508098 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a8005040 con 0x7f84ac0fbf20 2024-04-25T02:21:05.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.156+0000 7f84b10f6700 1 --2- 172.21.15.77:0/2556508098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84ac0fb610 0x7f84ac119ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:21:05.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.156+0000 7f84b08f5700 1 --2- 172.21.15.77:0/2556508098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84ac0fbf20 0x7f84ac11a430 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f849c00b790 tx=0x7f849c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:05.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.157+0000 7f84a1ffb700 1 -- 172.21.15.77:0/2556508098 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f849c00f770 con 0x7f84ac0fbf20 2024-04-25T02:21:05.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.157+0000 7f84a1ffb700 1 -- 172.21.15.77:0/2556508098 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f849c00fda0 con 0x7f84ac0fbf20 2024-04-25T02:21:05.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.157+0000 7f84a1ffb700 1 -- 172.21.15.77:0/2556508098 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f849c00d310 con 0x7f84ac0fbf20 2024-04-25T02:21:05.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.157+0000 7f84b335a700 1 -- 172.21.15.77:0/2556508098 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84ac1142e0 con 0x7f84ac0fbf20 2024-04-25T02:21:05.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.157+0000 7f84b335a700 1 -- 172.21.15.77:0/2556508098 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84ac114820 con 0x7f84ac0fbf20 2024-04-25T02:21:05.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.158+0000 7f84b335a700 1 -- 172.21.15.77:0/2556508098 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84ac0fc3d0 con 0x7f84ac0fbf20 2024-04-25T02:21:05.163 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:04 smithi077 ceph-mon[110441]: pgmap v267: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:21:05.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.158+0000 7f84a1ffb700 1 -- 172.21.15.77:0/2556508098 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f849c010420 con 0x7f84ac0fbf20 2024-04-25T02:21:05.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.159+0000 7f84a1ffb700 1 --2- 172.21.15.77:0/2556508098 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f849806e140 0x7f84980705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:05.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.159+0000 7f84a1ffb700 1 -- 172.21.15.77:0/2556508098 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f849c08da80 con 0x7f84ac0fbf20 2024-04-25T02:21:05.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.159+0000 7f84b10f6700 1 --2- 172.21.15.77:0/2556508098 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f849806e140 0x7f84980705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:05.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.159+0000 7f84b10f6700 1 --2- 172.21.15.77:0/2556508098 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f849806e140 0x7f84980705f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f84a8009fd0 tx=0x7f84a8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:05.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.164+0000 7f84a1ffb700 1 -- 172.21.15.77:0/2556508098 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f849c05aa20 con 0x7f84ac0fbf20 2024-04-25T02:21:05.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:04 smithi112 ceph-mon[80494]: pgmap v267: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:21:05.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.444+0000 7f84b335a700 1 -- 172.21.15.77:0/2556508098 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f84ac04c710 con 0x7f84ac0fbf20 2024-04-25T02:21:05.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.444+0000 7f84a1ffb700 1 -- 172.21.15.77:0/2556508098 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f849c08be60 con 0x7f84ac0fbf20 2024-04-25T02:21:05.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.447+0000 7f84b335a700 1 -- 172.21.15.77:0/2556508098 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f849806e140 msgr2=0x7f84980705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:05.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.447+0000 7f84b335a700 1 --2- 172.21.15.77:0/2556508098 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f849806e140 0x7f84980705f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f84a8009fd0 tx=0x7f84a8009e30 comp rx=0 tx=0).stop 2024-04-25T02:21:05.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.447+0000 7f84b335a700 1 -- 172.21.15.77:0/2556508098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84ac0fbf20 msgr2=0x7f84ac11a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:05.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.447+0000 7f84b335a700 1 --2- 172.21.15.77:0/2556508098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84ac0fbf20 0x7f84ac11a430 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f849c00b790 tx=0x7f849c009250 comp rx=0 tx=0).stop 2024-04-25T02:21:05.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.447+0000 7f84b335a700 1 -- 172.21.15.77:0/2556508098 shutdown_connections 2024-04-25T02:21:05.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.447+0000 7f84b335a700 1 --2- 172.21.15.77:0/2556508098 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f849806e140 0x7f84980705f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:05.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.447+0000 7f84b335a700 1 --2- 172.21.15.77:0/2556508098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84ac0fb610 0x7f84ac119ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:05.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.447+0000 7f84b335a700 1 --2- 172.21.15.77:0/2556508098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84ac0fbf20 0x7f84ac11a430 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:05.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.447+0000 7f84b335a700 1 -- 172.21.15.77:0/2556508098 >> 172.21.15.77:0/2556508098 conn(0x7f84ac072380 msgr2=0x7f84ac0fa3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:05.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.447+0000 7f84b335a700 1 -- 172.21.15.77:0/2556508098 shutdown_connections 2024-04-25T02:21:05.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:05.447+0000 7f84b335a700 1 -- 172.21.15.77:0/2556508098 wait complete. 2024-04-25T02:21:05.460 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)" 2024-04-25T02:21:06.215 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:05 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/2556508098' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:21:06.241 DEBUG:teuthology.parallel:result is None 2024-04-25T02:21:06.241 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-25T02:21:06.257 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T02:21:06.257 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-25T02:21:06.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:05 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/2556508098' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T02:21:06.510 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/mon.smithi077/config 2024-04-25T02:21:07.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:06 smithi077 ceph-mon[110441]: pgmap v268: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:21:07.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:06 smithi112 ceph-mon[80494]: pgmap v268: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:21:08.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.147+0000 7f0c21d5d700 1 -- 172.21.15.77:0/664760054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c1c0fbd40 msgr2=0x7f0c1c0fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:08.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.147+0000 7f0c21d5d700 1 --2- 172.21.15.77:0/664760054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c1c0fbd40 0x7f0c1c0fc1b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0c10004940 tx=0x7f0c10009e30 comp rx=0 tx=0).stop 2024-04-25T02:21:08.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.147+0000 7f0c21d5d700 1 -- 172.21.15.77:0/664760054 shutdown_connections 2024-04-25T02:21:08.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.147+0000 7f0c21d5d700 1 --2- 172.21.15.77:0/664760054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c1c0fbd40 0x7f0c1c0fc1b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:08.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.147+0000 7f0c21d5d700 1 --2- 172.21.15.77:0/664760054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c1c101d90 0x7f0c1c102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:08.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.147+0000 7f0c21d5d700 1 -- 172.21.15.77:0/664760054 >> 172.21.15.77:0/664760054 conn(0x7f0c1c071d00 msgr2=0x7f0c1c072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:08.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.147+0000 7f0c21d5d700 1 -- 172.21.15.77:0/664760054 shutdown_connections 2024-04-25T02:21:08.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.147+0000 7f0c21d5d700 1 -- 172.21.15.77:0/664760054 wait complete. 2024-04-25T02:21:08.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.148+0000 7f0c21d5d700 1 Processor -- start 2024-04-25T02:21:08.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.148+0000 7f0c21d5d700 1 -- start start 2024-04-25T02:21:08.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.148+0000 7f0c21d5d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c1c0fbd40 0x7f0c1c10eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:08.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.148+0000 7f0c21d5d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c1c101d90 0x7f0c1c10f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:08.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.148+0000 7f0c21d5d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1c10f740 con 0x7f0c1c101d90 2024-04-25T02:21:08.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.148+0000 7f0c21d5d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1c10f880 con 0x7f0c1c0fbd40 2024-04-25T02:21:08.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.148+0000 7f0c1affd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c1c101d90 0x7f0c1c10f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:08.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.148+0000 7f0c1affd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c1c101d90 0x7f0c1c10f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39130/0 (socket says 172.21.15.77:39130) 2024-04-25T02:21:08.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.148+0000 7f0c1affd700 1 -- 172.21.15.77:0/539932699 learned_addr learned my addr 172.21.15.77:0/539932699 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:08.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.148+0000 7f0c1b7fe700 1 --2- 172.21.15.77:0/539932699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c1c0fbd40 0x7f0c1c10eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:08.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.149+0000 7f0c1affd700 1 -- 172.21.15.77:0/539932699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c1c0fbd40 msgr2=0x7f0c1c10eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:08.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.149+0000 7f0c1affd700 1 --2- 172.21.15.77:0/539932699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c1c0fbd40 0x7f0c1c10eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:08.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.149+0000 7f0c1affd700 1 -- 172.21.15.77:0/539932699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c10005040 con 0x7f0c1c101d90 2024-04-25T02:21:08.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.149+0000 7f0c1affd700 1 --2- 172.21.15.77:0/539932699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c1c101d90 0x7f0c1c10f060 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0c1000b3b0 tx=0x7f0c10009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:08.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.149+0000 7f0c03fff700 1 -- 172.21.15.77:0/539932699 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c1000e040 con 0x7f0c1c101d90 2024-04-25T02:21:08.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.149+0000 7f0c21d5d700 1 -- 172.21.15.77:0/539932699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c1c117b90 con 0x7f0c1c101d90 2024-04-25T02:21:08.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.149+0000 7f0c03fff700 1 -- 172.21.15.77:0/539932699 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0c10013420 con 0x7f0c1c101d90 2024-04-25T02:21:08.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.149+0000 7f0c03fff700 1 -- 172.21.15.77:0/539932699 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c1001c630 con 0x7f0c1c101d90 2024-04-25T02:21:08.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.149+0000 7f0c21d5d700 1 -- 172.21.15.77:0/539932699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c1c118120 con 0x7f0c1c101d90 2024-04-25T02:21:08.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.150+0000 7f0c21d5d700 1 -- 172.21.15.77:0/539932699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c1c0fd430 con 0x7f0c1c101d90 2024-04-25T02:21:08.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.150+0000 7f0c03fff700 1 -- 172.21.15.77:0/539932699 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0c10013590 con 0x7f0c1c101d90 2024-04-25T02:21:08.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.151+0000 7f0c03fff700 1 --2- 172.21.15.77:0/539932699 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f0c0406e140 0x7f0c040705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:08.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.151+0000 7f0c03fff700 1 -- 172.21.15.77:0/539932699 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f0c1008edd0 con 0x7f0c1c101d90 2024-04-25T02:21:08.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.151+0000 7f0c1b7fe700 1 --2- 172.21.15.77:0/539932699 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f0c0406e140 0x7f0c040705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:08.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.151+0000 7f0c1b7fe700 1 --2- 172.21.15.77:0/539932699 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f0c0406e140 0x7f0c040705f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c009bf0 tx=0x7f0c0c0091a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:08.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.156+0000 7f0c03fff700 1 -- 172.21.15.77:0/539932699 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f0c10058180 con 0x7f0c1c101d90 2024-04-25T02:21:08.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.398+0000 7f0c21d5d700 1 -- 172.21.15.77:0/539932699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0c1c04bed0 con 0x7f0c1c101d90 2024-04-25T02:21:08.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.399+0000 7f0c03fff700 1 -- 172.21.15.77:0/539932699 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) v1 ==== 76+0+1938 (secure 0 0 0) 0x7f0c1005b840 con 0x7f0c1c101d90 2024-04-25T02:21:08.402 INFO:teuthology.orchestra.run.smithi077.stdout:e31 2024-04-25T02:21:08.402 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T02:21:08.403 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T02:21:08.403 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-04-25T02:21:08.403 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:21:08.403 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-04-25T02:21:08.403 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-04-25T02:21:08.403 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 31 2024-04-25T02:21:08.403 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-25T02:21:08.403 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-04-25T02:06:10.008979+0000 2024-04-25T02:21:08.403 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-04-25T02:19:10.937490+0000 2024-04-25T02:21:08.403 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-04-25T02:21:08.403 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-04-25T02:21:08.403 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-04-25T02:21:08.403 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-04-25T02:21:08.404 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-04-25T02:21:08.404 INFO:teuthology.orchestra.run.smithi077.stdout:max_xattr_size 65536 2024-04-25T02:21:08.404 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-04-25T02:21:08.404 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-04-25T02:21:08.404 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 84 2024-04-25T02:21:08.404 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-25T02:21:08.404 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-04-25T02:21:08.404 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-04-25T02:21:08.404 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=34374} 2024-04-25T02:21:08.404 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-04-25T02:21:08.404 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-04-25T02:21:08.404 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-04-25T02:21:08.404 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-04-25T02:21:08.404 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-04-25T02:21:08.405 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-04-25T02:21:08.405 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-04-25T02:21:08.405 INFO:teuthology.orchestra.run.smithi077.stdout:bal_rank_mask -1 2024-04-25T02:21:08.405 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-04-25T02:21:08.405 INFO:teuthology.orchestra.run.smithi077.stdout:qdb_cluster leader: 34374 members: 34374 2024-04-25T02:21:08.405 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.oadrkb{0:34374} state up:active seq 19 join_fscid=1 addr [v2:172.21.15.77:6826/1829655283,v1:172.21.15.77:6827/1829655283] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T02:21:08.405 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:21:08.405 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:21:08.405 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-04-25T02:21:08.405 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:21:08.405 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.gcfygj{-1:34406} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.77:6828/702451557,v1:172.21.15.77:6829/702451557] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T02:21:08.405 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi112.dvwudt{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6824/1388779321,v1:172.21.15.112:6825/1388779321] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T02:21:08.405 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi112.fjnadi{-1:44307} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/1789386749,v1:172.21.15.112:6827/1789386749] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T02:21:08.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.401+0000 7f0c21d5d700 1 -- 172.21.15.77:0/539932699 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f0c0406e140 msgr2=0x7f0c040705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:08.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.401+0000 7f0c21d5d700 1 --2- 172.21.15.77:0/539932699 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f0c0406e140 0x7f0c040705f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c009bf0 tx=0x7f0c0c0091a0 comp rx=0 tx=0).stop 2024-04-25T02:21:08.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.401+0000 7f0c21d5d700 1 -- 172.21.15.77:0/539932699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c1c101d90 msgr2=0x7f0c1c10f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:08.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.401+0000 7f0c21d5d700 1 --2- 172.21.15.77:0/539932699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c1c101d90 0x7f0c1c10f060 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0c1000b3b0 tx=0x7f0c10009e30 comp rx=0 tx=0).stop 2024-04-25T02:21:08.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.401+0000 7f0c21d5d700 1 -- 172.21.15.77:0/539932699 shutdown_connections 2024-04-25T02:21:08.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.401+0000 7f0c21d5d700 1 --2- 172.21.15.77:0/539932699 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f0c0406e140 0x7f0c040705f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:08.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.401+0000 7f0c21d5d700 1 --2- 172.21.15.77:0/539932699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c1c0fbd40 0x7f0c1c10eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:08.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.401+0000 7f0c21d5d700 1 --2- 172.21.15.77:0/539932699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c1c101d90 0x7f0c1c10f060 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:08.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.401+0000 7f0c21d5d700 1 -- 172.21.15.77:0/539932699 >> 172.21.15.77:0/539932699 conn(0x7f0c1c071d00 msgr2=0x7f0c1c0fa030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:08.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.401+0000 7f0c21d5d700 1 -- 172.21.15.77:0/539932699 shutdown_connections 2024-04-25T02:21:08.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:08.401+0000 7f0c21d5d700 1 -- 172.21.15.77:0/539932699 wait complete. 2024-04-25T02:21:08.407 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 31 2024-04-25T02:21:09.141 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-04-25T02:21:09.153 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:21:09.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:08 smithi077 ceph-mon[110441]: pgmap v269: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:21:09.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:08 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/539932699' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:21:09.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:08 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:21:09.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.248+0000 7fabcbb1d640 1 -- 172.21.15.77:0/3860382435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabc41021f0 msgr2=0x7fabc41025c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:09.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.248+0000 7fabcbb1d640 1 --2- 172.21.15.77:0/3860382435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabc41021f0 0x7fabc41025c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fabc00048d0 tx=0x7fabc0009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:09.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.248+0000 7fabcbb1d640 1 -- 172.21.15.77:0/3860382435 shutdown_connections 2024-04-25T02:21:09.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.248+0000 7fabcbb1d640 1 --2- 172.21.15.77:0/3860382435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabc4102b90 0x7fabc4064350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:09.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.248+0000 7fabcbb1d640 1 --2- 172.21.15.77:0/3860382435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabc41021f0 0x7fabc41025c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:09.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.248+0000 7fabcbb1d640 1 -- 172.21.15.77:0/3860382435 >> 172.21.15.77:0/3860382435 conn(0x7fabc40711c0 msgr2=0x7fabc40715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:09.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.248+0000 7fabcbb1d640 1 -- 172.21.15.77:0/3860382435 shutdown_connections 2024-04-25T02:21:09.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.248+0000 7fabcbb1d640 1 -- 172.21.15.77:0/3860382435 wait complete. 2024-04-25T02:21:09.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.248+0000 7fabcbb1d640 1 Processor -- start 2024-04-25T02:21:09.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.248+0000 7fabcbb1d640 1 -- start start 2024-04-25T02:21:09.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.248+0000 7fabcbb1d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabc41021f0 0x7fabc4112d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:09.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.248+0000 7fabcbb1d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabc4102b90 0x7fabc4113260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:09.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.248+0000 7fabcbb1d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc4113860 con 0x7fabc41021f0 2024-04-25T02:21:09.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.248+0000 7fabcbb1d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc410ceb0 con 0x7fabc4102b90 2024-04-25T02:21:09.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.249+0000 7fabc98b9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabc41021f0 0x7fabc4112d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:09.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.249+0000 7fabc98b9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabc41021f0 0x7fabc4112d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39142/0 (socket says 172.21.15.77:39142) 2024-04-25T02:21:09.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.249+0000 7fabc98b9640 1 -- 172.21.15.77:0/2229450305 learned_addr learned my addr 172.21.15.77:0/2229450305 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:09.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.249+0000 7fabc98b9640 1 -- 172.21.15.77:0/2229450305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabc4102b90 msgr2=0x7fabc4113260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:09.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.249+0000 7fabc98b9640 1 --2- 172.21.15.77:0/2229450305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabc4102b90 0x7fabc4113260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:09.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.249+0000 7fabc98b9640 1 -- 172.21.15.77:0/2229450305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc0005040 con 0x7fabc41021f0 2024-04-25T02:21:09.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.249+0000 7fabc98b9640 1 --2- 172.21.15.77:0/2229450305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabc41021f0 0x7fabc4112d20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fabc0004930 tx=0x7fabc0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:09.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.249+0000 7fabba7fc640 1 -- 172.21.15.77:0/2229450305 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabc00094c0 con 0x7fabc41021f0 2024-04-25T02:21:09.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.249+0000 7fabba7fc640 1 -- 172.21.15.77:0/2229450305 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fabc0032e50 con 0x7fabc41021f0 2024-04-25T02:21:09.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.249+0000 7fabcbb1d640 1 -- 172.21.15.77:0/2229450305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc410d130 con 0x7fabc41021f0 2024-04-25T02:21:09.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.249+0000 7fabba7fc640 1 -- 172.21.15.77:0/2229450305 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabc00433b0 con 0x7fabc41021f0 2024-04-25T02:21:09.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.249+0000 7fabcbb1d640 1 -- 172.21.15.77:0/2229450305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc410d5f0 con 0x7fabc41021f0 2024-04-25T02:21:09.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.250+0000 7fabcbb1d640 1 -- 172.21.15.77:0/2229450305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc40fd990 con 0x7fabc41021f0 2024-04-25T02:21:09.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.251+0000 7fabba7fc640 1 -- 172.21.15.77:0/2229450305 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fabc002f070 con 0x7fabc41021f0 2024-04-25T02:21:09.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.251+0000 7fabba7fc640 1 --2- 172.21.15.77:0/2229450305 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fabb006e0b0 0x7fabb0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:09.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.251+0000 7fabba7fc640 1 -- 172.21.15.77:0/2229450305 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fabc00afb50 con 0x7fabc41021f0 2024-04-25T02:21:09.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.251+0000 7fabc90b8640 1 --2- 172.21.15.77:0/2229450305 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fabb006e0b0 0x7fabb0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:09.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.252+0000 7fabc90b8640 1 --2- 172.21.15.77:0/2229450305 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fabb006e0b0 0x7fabb0070560 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fabc410e5e0 tx=0x7fabb4007cb0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:09.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.256+0000 7fabba7fc640 1 -- 172.21.15.77:0/2229450305 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fabc0078e80 con 0x7fabc41021f0 2024-04-25T02:21:09.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:08 smithi112 ceph-mon[80494]: pgmap v269: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:21:09.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:08 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/539932699' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:21:09.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:08 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T02:21:09.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.431+0000 7fabcbb1d640 1 -- 172.21.15.77:0/2229450305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabc41093c0 con 0x7fabc41021f0 2024-04-25T02:21:09.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.432+0000 7fabba7fc640 1 -- 172.21.15.77:0/2229450305 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16641 (secure 0 0 0) 0x7fabc007c540 con 0x7fabc41021f0 2024-04-25T02:21:09.436 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:21:09.436 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":84,"fsid":"4bb93d82-02a7-11ef-bc93-c7b262605968","created":"2024-04-25T01:59:22.235413+0000","modified":"2024-04-25T02:18:52.548455+0000","last_up_change":"2024-04-25T02:17:48.815266+0000","last_in_change":"2024-04-25T02:04:33.912973+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:03:38.692032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-25T02:06:08.304706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-25T02:06:09.237302+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1533372f-b1a5-4ec0-9524-9940f870d874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":79,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1934093025},{"type":"v1","addr":"172.21.15.77:6803","nonce":1934093025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1934093025},{"type":"v1","addr":"172.21.15.77:6805","nonce":1934093025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1934093025},{"type":"v1","addr":"172.21.15.77:6809","nonce":1934093025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1934093025},{"type":"v1","addr":"172.21.15.77:6807","nonce":1934093025}]},"public_addr":"172.21.15.77:6803/1934093025","cluster_addr":"172.21.15.77:6805/1934093025","heartbeat_back_addr":"172.21.15.77:6809/1934093025","heartbeat_front_addr":"172.21.15.77:6807/1934093025","state":["exists","up"]},{"osd":1,"uuid":"cb083b21-fd25-4ac4-bbde-6387c3253d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":59,"up_thru":79,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":79281053},{"type":"v1","addr":"172.21.15.77:6811","nonce":79281053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":79281053},{"type":"v1","addr":"172.21.15.77:6813","nonce":79281053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":79281053},{"type":"v1","addr":"172.21.15.77:6817","nonce":79281053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":79281053},{"type":"v1","addr":"172.21.15.77:6815","nonce":79281053}]},"public_addr":"172.21.15.77:6811/79281053","cluster_addr":"172.21.15.77:6813/79281053","heartbeat_back_addr":"172.21.15.77:6817/79281053","heartbeat_front_addr":"172.21.15.77:6815/79281053","state":["exists","up"]},{"osd":2,"uuid":"39b4553c-c1ed-489b-aead-210f38ac86b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":60,"up_from":64,"up_thru":79,"down_at":61,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3911834293},{"type":"v1","addr":"172.21.15.77:6819","nonce":3911834293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3911834293},{"type":"v1","addr":"172.21.15.77:6821","nonce":3911834293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3911834293},{"type":"v1","addr":"172.21.15.77:6825","nonce":3911834293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3911834293},{"type":"v1","addr":"172.21.15.77:6823","nonce":3911834293}]},"public_addr":"172.21.15.77:6819/3911834293","cluster_addr":"172.21.15.77:6821/3911834293","heartbeat_back_addr":"172.21.15.77:6825/3911834293","heartbeat_front_addr":"172.21.15.77:6823/3911834293","state":["exists","up"]},{"osd":3,"uuid":"addec0fa-80ee-465d-9d3e-c801d7bd9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":65,"up_from":69,"up_thru":79,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3463246852},{"type":"v1","addr":"172.21.15.112:6801","nonce":3463246852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3463246852},{"type":"v1","addr":"172.21.15.112:6803","nonce":3463246852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3463246852},{"type":"v1","addr":"172.21.15.112:6807","nonce":3463246852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3463246852},{"type":"v1","addr":"172.21.15.112:6805","nonce":3463246852}]},"public_addr":"172.21.15.112:6801/3463246852","cluster_addr":"172.21.15.112:6803/3463246852","heartbeat_back_addr":"172.21.15.112:6807/3463246852","heartbeat_front_addr":"172.21.15.112:6805/3463246852","state":["exists","up"]},{"osd":4,"uuid":"93465def-0617-4ba8-915a-b3ea85c8f6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":70,"up_from":74,"up_thru":79,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":1394902745},{"type":"v1","addr":"172.21.15.112:6809","nonce":1394902745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1394902745},{"type":"v1","addr":"172.21.15.112:6811","nonce":1394902745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1394902745},{"type":"v1","addr":"172.21.15.112:6815","nonce":1394902745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":1394902745},{"type":"v1","addr":"172.21.15.112:6813","nonce":1394902745}]},"public_addr":"172.21.15.112:6809/1394902745","cluster_addr":"172.21.15.112:6811/1394902745","heartbeat_back_addr":"172.21.15.112:6815/1394902745","heartbeat_front_addr":"172.21.15.112:6813/1394902745","state":["exists","up"]},{"osd":5,"uuid":"d3f693f5-324b-4a48-8f24-77e65c5f7f7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":75,"up_from":79,"up_thru":79,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1908468918},{"type":"v1","addr":"172.21.15.112:6817","nonce":1908468918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1908468918},{"type":"v1","addr":"172.21.15.112:6819","nonce":1908468918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1908468918},{"type":"v1","addr":"172.21.15.112:6823","nonce":1908468918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1908468918},{"type":"v1","addr":"172.21.15.112:6821","nonce":1908468918}]},"public_addr":"172.21.15.112:6817/1908468918","cluster_addr":"172.21.15.112:6819/1908468918","heartbeat_back_addr":"172.21.15.112:6823/1908468918","heartbeat_front_addr":"172.21.15.112:6821/1908468918","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:42.635624+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:10.189211+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:35.781710+0000","dead_epoch":60},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:59.250841+0000","dead_epoch":65},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:25.155356+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:51.315370+0000","dead_epoch":75}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6825/3687767796":"2024-04-26T02:18:31.253792+0000","172.21.15.77:0/1779967375":"2024-04-26T02:00:25.057598+0000","172.21.15.112:6826/2036319817":"2024-04-26T02:18:52.548426+0000","172.21.15.77:6800/859750200":"2024-04-26T02:00:25.057598+0000","172.21.15.112:0/1986353395":"2024-04-26T02:10:29.627481+0000","172.21.15.77:0/2265849210":"2024-04-26T02:00:25.057598+0000","172.21.15.77:0/2490024809":"2024-04-26T02:01:30.377936+0000","172.21.15.77:0/265498985":"2024-04-26T01:59:54.491478+0000","172.21.15.77:0/543110241":"2024-04-26T02:01:30.377936+0000","172.21.15.77:6826/4228767448":"2024-04-26T02:06:24.839959+0000","172.21.15.77:6801/310739264":"2024-04-26T02:09:17.638820+0000","172.21.15.77:6801/799251145":"2024-04-26T02:13:23.698232+0000","172.21.15.77:0/3184722826":"2024-04-26T02:01:30.377936+0000","172.21.15.77:6800/310739264":"2024-04-26T02:09:17.638820+0000","172.21.15.77:6801/839529497":"2024-04-26T01:59:54.491478+0000","172.21.15.77:0/2089066429":"2024-04-26T02:09:17.638820+0000","172.21.15.112:0/1265440623":"2024-04-26T02:10:29.627481+0000","172.21.15.77:0/1177720370":"2024-04-26T01:59:54.491478+0000","172.21.15.77:6800/2375514340":"2024-04-26T02:01:30.377936+0000","172.21.15.112:0/582855468":"2024-04-26T02:10:29.627481+0000","172.21.15.77:6801/859750200":"2024-04-26T02:00:25.057598+0000","172.21.15.77:0/2254838943":"2024-04-26T02:00:25.057598+0000","172.21.15.77:0/1743910051":"2024-04-26T01:59:54.491478+0000","172.21.15.112:6828/218023931":"2024-04-26T02:10:29.627481+0000","172.21.15.77:6800/839529497":"2024-04-26T01:59:54.491478+0000","172.21.15.77:0/863377592":"2024-04-26T02:09:17.638820+0000","172.21.15.77:6827/4228767448":"2024-04-26T02:06:24.839959+0000","172.21.15.77:6800/799251145":"2024-04-26T02:13:23.698232+0000","172.21.15.112:6827/2036319817":"2024-04-26T02:18:52.548426+0000","172.21.15.77:0/1802503387":"2024-04-26T02:09:17.638820+0000","172.21.15.77:6801/2375514340":"2024-04-26T02:01:30.377936+0000","172.21.15.77:0/910905261":"2024-04-26T02:13:23.698232+0000","172.21.15.112:0/1205122809":"2024-04-26T02:10:29.627481+0000","172.21.15.112:6829/218023931":"2024-04-26T02:10:29.627481+0000","172.21.15.77:0/2354945099":"2024-04-26T02:13:23.698232+0000","172.21.15.77:0/678203530":"2024-04-26T02:13:23.698232+0000","172.21.15.77:0/114993391":"2024-04-26T02:09:17.638820+0000","172.21.15.77:0/1864957324":"2024-04-26T02:13:23.698232+0000","172.21.15.112:6824/3687767796":"2024-04-26T02:18:31.253792+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:21:09.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.434+0000 7fabcbb1d640 1 -- 172.21.15.77:0/2229450305 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fabb006e0b0 msgr2=0x7fabb0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:09.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.434+0000 7fabcbb1d640 1 --2- 172.21.15.77:0/2229450305 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fabb006e0b0 0x7fabb0070560 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fabc410e5e0 tx=0x7fabb4007cb0 comp rx=0 tx=0).stop 2024-04-25T02:21:09.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.434+0000 7fabcbb1d640 1 -- 172.21.15.77:0/2229450305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabc41021f0 msgr2=0x7fabc4112d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:09.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.434+0000 7fabcbb1d640 1 --2- 172.21.15.77:0/2229450305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabc41021f0 0x7fabc4112d20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fabc0004930 tx=0x7fabc0009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:09.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.434+0000 7fabcbb1d640 1 -- 172.21.15.77:0/2229450305 shutdown_connections 2024-04-25T02:21:09.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.434+0000 7fabcbb1d640 1 --2- 172.21.15.77:0/2229450305 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fabb006e0b0 0x7fabb0070560 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:09.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.434+0000 7fabcbb1d640 1 --2- 172.21.15.77:0/2229450305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabc4102b90 0x7fabc4113260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:09.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.434+0000 7fabcbb1d640 1 --2- 172.21.15.77:0/2229450305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabc41021f0 0x7fabc4112d20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:09.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.434+0000 7fabcbb1d640 1 -- 172.21.15.77:0/2229450305 >> 172.21.15.77:0/2229450305 conn(0x7fabc40711c0 msgr2=0x7fabc40fa410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:09.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.434+0000 7fabcbb1d640 1 -- 172.21.15.77:0/2229450305 shutdown_connections 2024-04-25T02:21:09.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.434+0000 7fabcbb1d640 1 -- 172.21.15.77:0/2229450305 wait complete. 2024-04-25T02:21:09.448 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:03:38.692032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-25T02:06:08.304706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-25T02:06:09.237302+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:21:09.449 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:21:09.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.542+0000 7f839515d640 1 -- 172.21.15.77:0/1788132230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83901010b0 msgr2=0x7f8390101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:09.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.542+0000 7f839515d640 1 --2- 172.21.15.77:0/1788132230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83901010b0 0x7f8390101480 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f83800048d0 tx=0x7f8380009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:09.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.542+0000 7f839515d640 1 -- 172.21.15.77:0/1788132230 shutdown_connections 2024-04-25T02:21:09.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.542+0000 7f839515d640 1 --2- 172.21.15.77:0/1788132230 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8390101a50 0x7f83900fb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:09.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.542+0000 7f839515d640 1 --2- 172.21.15.77:0/1788132230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83901010b0 0x7f8390101480 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:09.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.542+0000 7f839515d640 1 -- 172.21.15.77:0/1788132230 >> 172.21.15.77:0/1788132230 conn(0x7f83900f6c60 msgr2=0x7f83900f9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:09.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.542+0000 7f839515d640 1 -- 172.21.15.77:0/1788132230 shutdown_connections 2024-04-25T02:21:09.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.542+0000 7f839515d640 1 -- 172.21.15.77:0/1788132230 wait complete. 2024-04-25T02:21:09.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.543+0000 7f839515d640 1 Processor -- start 2024-04-25T02:21:09.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.543+0000 7f839515d640 1 -- start start 2024-04-25T02:21:09.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.543+0000 7f839515d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83901010b0 0x7f8390111eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:09.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.543+0000 7f839515d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8390101a50 0x7f83901123f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:09.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.543+0000 7f839515d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83901129f0 con 0x7f83901010b0 2024-04-25T02:21:09.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.543+0000 7f839515d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8390112b60 con 0x7f8390101a50 2024-04-25T02:21:09.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.543+0000 7f838ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83901010b0 0x7f8390111eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:09.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.543+0000 7f838ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83901010b0 0x7f8390111eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39152/0 (socket says 172.21.15.77:39152) 2024-04-25T02:21:09.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.543+0000 7f838ed9d640 1 -- 172.21.15.77:0/2620832080 learned_addr learned my addr 172.21.15.77:0/2620832080 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:09.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.543+0000 7f8387fff640 1 --2- 172.21.15.77:0/2620832080 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8390101a50 0x7f83901123f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:09.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.543+0000 7f838ed9d640 1 -- 172.21.15.77:0/2620832080 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8390101a50 msgr2=0x7f83901123f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:09.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.543+0000 7f838ed9d640 1 --2- 172.21.15.77:0/2620832080 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8390101a50 0x7f83901123f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:09.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.543+0000 7f838ed9d640 1 -- 172.21.15.77:0/2620832080 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8380005040 con 0x7f83901010b0 2024-04-25T02:21:09.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.543+0000 7f838ed9d640 1 --2- 172.21.15.77:0/2620832080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83901010b0 0x7f8390111eb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8380004930 tx=0x7f8380009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:09.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.543+0000 7f83877fe640 1 -- 172.21.15.77:0/2620832080 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83800094c0 con 0x7f83901010b0 2024-04-25T02:21:09.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.543+0000 7f83877fe640 1 -- 172.21.15.77:0/2620832080 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8380032e50 con 0x7f83901010b0 2024-04-25T02:21:09.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.543+0000 7f839515d640 1 -- 172.21.15.77:0/2620832080 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f839010c190 con 0x7f83901010b0 2024-04-25T02:21:09.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.544+0000 7f83877fe640 1 -- 172.21.15.77:0/2620832080 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83800433b0 con 0x7f83901010b0 2024-04-25T02:21:09.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.544+0000 7f839515d640 1 -- 172.21.15.77:0/2620832080 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f839010c650 con 0x7f83901010b0 2024-04-25T02:21:09.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.544+0000 7f839515d640 1 -- 172.21.15.77:0/2620832080 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83900fc820 con 0x7f83901010b0 2024-04-25T02:21:09.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.545+0000 7f83877fe640 1 -- 172.21.15.77:0/2620832080 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f838002f070 con 0x7f83901010b0 2024-04-25T02:21:09.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.545+0000 7f83877fe640 1 --2- 172.21.15.77:0/2620832080 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f837c06e0b0 0x7f837c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:09.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.545+0000 7f83877fe640 1 -- 172.21.15.77:0/2620832080 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f83800afb90 con 0x7f83901010b0 2024-04-25T02:21:09.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.545+0000 7f8387fff640 1 --2- 172.21.15.77:0/2620832080 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f837c06e0b0 0x7f837c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:09.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.546+0000 7f8387fff640 1 --2- 172.21.15.77:0/2620832080 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f837c06e0b0 0x7f837c070560 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f839010d7b0 tx=0x7f8378009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:09.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.550+0000 7f83877fe640 1 -- 172.21.15.77:0/2620832080 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f8380078ec0 con 0x7f83901010b0 2024-04-25T02:21:09.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.726+0000 7f839515d640 1 -- 172.21.15.77:0/2620832080 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8390066b70 con 0x7f83901010b0 2024-04-25T02:21:09.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.726+0000 7f83877fe640 1 -- 172.21.15.77:0/2620832080 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f838007c580 con 0x7f83901010b0 2024-04-25T02:21:09.730 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-25T02:21:09.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.728+0000 7f839515d640 1 -- 172.21.15.77:0/2620832080 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f837c06e0b0 msgr2=0x7f837c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:09.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.728+0000 7f839515d640 1 --2- 172.21.15.77:0/2620832080 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f837c06e0b0 0x7f837c070560 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f839010d7b0 tx=0x7f8378009040 comp rx=0 tx=0).stop 2024-04-25T02:21:09.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.728+0000 7f839515d640 1 -- 172.21.15.77:0/2620832080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83901010b0 msgr2=0x7f8390111eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:09.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.728+0000 7f839515d640 1 --2- 172.21.15.77:0/2620832080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83901010b0 0x7f8390111eb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8380004930 tx=0x7f8380009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:09.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.728+0000 7f839515d640 1 -- 172.21.15.77:0/2620832080 shutdown_connections 2024-04-25T02:21:09.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.728+0000 7f839515d640 1 --2- 172.21.15.77:0/2620832080 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f837c06e0b0 0x7f837c070560 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:09.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.728+0000 7f839515d640 1 --2- 172.21.15.77:0/2620832080 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8390101a50 0x7f83901123f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:09.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.728+0000 7f839515d640 1 --2- 172.21.15.77:0/2620832080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83901010b0 0x7f8390111eb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:09.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.728+0000 7f839515d640 1 -- 172.21.15.77:0/2620832080 >> 172.21.15.77:0/2620832080 conn(0x7f83900f6c60 msgr2=0x7f83900f7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:09.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.728+0000 7f839515d640 1 -- 172.21.15.77:0/2620832080 shutdown_connections 2024-04-25T02:21:09.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.728+0000 7f839515d640 1 -- 172.21.15.77:0/2620832080 wait complete. 2024-04-25T02:21:09.742 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-25T02:21:09.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.836+0000 7f93abb1d640 1 -- 172.21.15.77:0/202956173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93a4101110 msgr2=0x7f93a41014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:09.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.836+0000 7f93abb1d640 1 --2- 172.21.15.77:0/202956173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93a4101110 0x7f93a41014e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f939c009c50 tx=0x7f939c004d10 comp rx=0 tx=0).stop 2024-04-25T02:21:09.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.836+0000 7f93abb1d640 1 -- 172.21.15.77:0/202956173 shutdown_connections 2024-04-25T02:21:09.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.836+0000 7f93abb1d640 1 --2- 172.21.15.77:0/202956173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93a40fb0e0 0x7f93a40fb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:09.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.836+0000 7f93abb1d640 1 --2- 172.21.15.77:0/202956173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93a4101110 0x7f93a41014e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:09.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.836+0000 7f93abb1d640 1 -- 172.21.15.77:0/202956173 >> 172.21.15.77:0/202956173 conn(0x7f93a40710c0 msgr2=0x7f93a40714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:09.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.836+0000 7f93abb1d640 1 -- 172.21.15.77:0/202956173 shutdown_connections 2024-04-25T02:21:09.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.836+0000 7f93abb1d640 1 -- 172.21.15.77:0/202956173 wait complete. 2024-04-25T02:21:09.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.836+0000 7f93abb1d640 1 Processor -- start 2024-04-25T02:21:09.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.836+0000 7f93abb1d640 1 -- start start 2024-04-25T02:21:09.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.836+0000 7f93abb1d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93a40fb0e0 0x7f93a4111c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:09.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.836+0000 7f93abb1d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93a4101110 0x7f93a41121b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:09.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.836+0000 7f93abb1d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a4112840 con 0x7f93a4101110 2024-04-25T02:21:09.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.836+0000 7f93abb1d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a410be00 con 0x7f93a40fb0e0 2024-04-25T02:21:09.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.837+0000 7f93a90b8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93a4101110 0x7f93a41121b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:09.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.837+0000 7f93a90b8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93a4101110 0x7f93a41121b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39174/0 (socket says 172.21.15.77:39174) 2024-04-25T02:21:09.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.837+0000 7f93a90b8640 1 -- 172.21.15.77:0/337275352 learned_addr learned my addr 172.21.15.77:0/337275352 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:09.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.837+0000 7f93a98b9640 1 --2- 172.21.15.77:0/337275352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93a40fb0e0 0x7f93a4111c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:09.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.837+0000 7f93a90b8640 1 -- 172.21.15.77:0/337275352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93a40fb0e0 msgr2=0x7f93a4111c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:09.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.837+0000 7f93a90b8640 1 --2- 172.21.15.77:0/337275352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93a40fb0e0 0x7f93a4111c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:09.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.837+0000 7f93a90b8640 1 -- 172.21.15.77:0/337275352 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f939c0098b0 con 0x7f93a4101110 2024-04-25T02:21:09.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.837+0000 7f93a90b8640 1 --2- 172.21.15.77:0/337275352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93a4101110 0x7f93a41121b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f939400b790 tx=0x7f93940091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:09.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.837+0000 7f939a7fc640 1 -- 172.21.15.77:0/337275352 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f939400c700 con 0x7f93a4101110 2024-04-25T02:21:09.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.837+0000 7f939a7fc640 1 -- 172.21.15.77:0/337275352 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f939400cd30 con 0x7f93a4101110 2024-04-25T02:21:09.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.837+0000 7f93abb1d640 1 -- 172.21.15.77:0/337275352 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a410c0e0 con 0x7f93a4101110 2024-04-25T02:21:09.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.837+0000 7f939a7fc640 1 -- 172.21.15.77:0/337275352 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9394013370 con 0x7f93a4101110 2024-04-25T02:21:09.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.837+0000 7f93abb1d640 1 -- 172.21.15.77:0/337275352 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a410c600 con 0x7f93a4101110 2024-04-25T02:21:09.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.838+0000 7f93abb1d640 1 -- 172.21.15.77:0/337275352 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a40fc7d0 con 0x7f93a4101110 2024-04-25T02:21:09.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.839+0000 7f939a7fc640 1 -- 172.21.15.77:0/337275352 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9394012070 con 0x7f93a4101110 2024-04-25T02:21:09.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.839+0000 7f939a7fc640 1 --2- 172.21.15.77:0/337275352 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f939006e0b0 0x7f9390070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:09.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.839+0000 7f93a98b9640 1 --2- 172.21.15.77:0/337275352 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f939006e0b0 0x7f9390070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:09.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.839+0000 7f939a7fc640 1 -- 172.21.15.77:0/337275352 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f939408d620 con 0x7f93a4101110 2024-04-25T02:21:09.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.840+0000 7f93a98b9640 1 --2- 172.21.15.77:0/337275352 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f939006e0b0 0x7f9390070560 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f939c004a30 tx=0x7f939c037040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:09.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:09.845+0000 7f939a7fc640 1 -- 172.21.15.77:0/337275352 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f93940569d0 con 0x7f93a4101110 2024-04-25T02:21:10.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.023+0000 7f93abb1d640 1 -- 172.21.15.77:0/337275352 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f93a4108280 con 0x7f93a4101110 2024-04-25T02:21:10.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.024+0000 7f939a7fc640 1 -- 172.21.15.77:0/337275352 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7f939405a090 con 0x7f93a4101110 2024-04-25T02:21:10.027 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T02:21:10.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.026+0000 7f93abb1d640 1 -- 172.21.15.77:0/337275352 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f939006e0b0 msgr2=0x7f9390070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:10.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.026+0000 7f93abb1d640 1 --2- 172.21.15.77:0/337275352 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f939006e0b0 0x7f9390070560 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f939c004a30 tx=0x7f939c037040 comp rx=0 tx=0).stop 2024-04-25T02:21:10.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.026+0000 7f93abb1d640 1 -- 172.21.15.77:0/337275352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93a4101110 msgr2=0x7f93a41121b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:10.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.026+0000 7f93abb1d640 1 --2- 172.21.15.77:0/337275352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93a4101110 0x7f93a41121b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f939400b790 tx=0x7f93940091d0 comp rx=0 tx=0).stop 2024-04-25T02:21:10.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.026+0000 7f93abb1d640 1 -- 172.21.15.77:0/337275352 shutdown_connections 2024-04-25T02:21:10.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.026+0000 7f93abb1d640 1 --2- 172.21.15.77:0/337275352 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f939006e0b0 0x7f9390070560 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:10.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.026+0000 7f93abb1d640 1 --2- 172.21.15.77:0/337275352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93a4101110 0x7f93a41121b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:10.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.026+0000 7f93abb1d640 1 --2- 172.21.15.77:0/337275352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93a40fb0e0 0x7f93a4111c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:10.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.026+0000 7f93abb1d640 1 -- 172.21.15.77:0/337275352 >> 172.21.15.77:0/337275352 conn(0x7f93a40710c0 msgr2=0x7f93a40f94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:10.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.026+0000 7f93abb1d640 1 -- 172.21.15.77:0/337275352 shutdown_connections 2024-04-25T02:21:10.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.026+0000 7f93abb1d640 1 -- 172.21.15.77:0/337275352 wait complete. 2024-04-25T02:21:10.039 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:09 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/2229450305' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:21:10.039 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:09 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/2620832080' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:21:10.040 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-25T02:21:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.133+0000 7f3edfb9d640 1 -- 172.21.15.77:0/616919070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ed81021f0 msgr2=0x7f3ed81025c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.133+0000 7f3edfb9d640 1 --2- 172.21.15.77:0/616919070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ed81021f0 0x7f3ed81025c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3ec80048d0 tx=0x7f3ec8009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.133+0000 7f3edfb9d640 1 -- 172.21.15.77:0/616919070 shutdown_connections 2024-04-25T02:21:10.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.133+0000 7f3edfb9d640 1 --2- 172.21.15.77:0/616919070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ed80fa840 0x7f3ed80fac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:10.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.133+0000 7f3edfb9d640 1 --2- 172.21.15.77:0/616919070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ed81021f0 0x7f3ed81025c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:10.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.133+0000 7f3edfb9d640 1 -- 172.21.15.77:0/616919070 >> 172.21.15.77:0/616919070 conn(0x7f3ed8071700 msgr2=0x7f3ed8071b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:10.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.133+0000 7f3edfb9d640 1 -- 172.21.15.77:0/616919070 shutdown_connections 2024-04-25T02:21:10.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.133+0000 7f3edfb9d640 1 -- 172.21.15.77:0/616919070 wait complete. 2024-04-25T02:21:10.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.133+0000 7f3edfb9d640 1 Processor -- start 2024-04-25T02:21:10.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.133+0000 7f3edfb9d640 1 -- start start 2024-04-25T02:21:10.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.133+0000 7f3edfb9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ed80fa840 0x7f3ed8112d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:10.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.133+0000 7f3edfb9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ed81021f0 0x7f3ed8113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:10.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.134+0000 7f3edfb9d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed8113840 con 0x7f3ed80fa840 2024-04-25T02:21:10.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.134+0000 7f3edfb9d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed810ce90 con 0x7f3ed81021f0 2024-04-25T02:21:10.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.134+0000 7f3edd939640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ed80fa840 0x7f3ed8112d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:10.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.134+0000 7f3edd939640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ed80fa840 0x7f3ed8112d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39178/0 (socket says 172.21.15.77:39178) 2024-04-25T02:21:10.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.134+0000 7f3edd939640 1 -- 172.21.15.77:0/2361280756 learned_addr learned my addr 172.21.15.77:0/2361280756 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:10.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.134+0000 7f3edd138640 1 --2- 172.21.15.77:0/2361280756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ed81021f0 0x7f3ed8113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:10.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.134+0000 7f3edd939640 1 -- 172.21.15.77:0/2361280756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ed81021f0 msgr2=0x7f3ed8113240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:10.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.134+0000 7f3edd939640 1 --2- 172.21.15.77:0/2361280756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ed81021f0 0x7f3ed8113240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:10.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.134+0000 7f3edd939640 1 -- 172.21.15.77:0/2361280756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec8005040 con 0x7f3ed80fa840 2024-04-25T02:21:10.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.134+0000 7f3edd138640 1 --2- 172.21.15.77:0/2361280756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ed81021f0 0x7f3ed8113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:21:10.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.134+0000 7f3edd939640 1 --2- 172.21.15.77:0/2361280756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ed80fa840 0x7f3ed8112d00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8004930 tx=0x7f3ec8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:10.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.134+0000 7f3ece7fc640 1 -- 172.21.15.77:0/2361280756 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ec80094c0 con 0x7f3ed80fa840 2024-04-25T02:21:10.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.134+0000 7f3edfb9d640 1 -- 172.21.15.77:0/2361280756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed810d110 con 0x7f3ed80fa840 2024-04-25T02:21:10.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.134+0000 7f3ece7fc640 1 -- 172.21.15.77:0/2361280756 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ec8032e50 con 0x7f3ed80fa840 2024-04-25T02:21:10.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.134+0000 7f3ece7fc640 1 -- 172.21.15.77:0/2361280756 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ec80433b0 con 0x7f3ed80fa840 2024-04-25T02:21:10.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.134+0000 7f3edfb9d640 1 -- 172.21.15.77:0/2361280756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed810d5d0 con 0x7f3ed80fa840 2024-04-25T02:21:10.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.135+0000 7f3edfb9d640 1 -- 172.21.15.77:0/2361280756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed804bcc0 con 0x7f3ed80fa840 2024-04-25T02:21:10.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.136+0000 7f3ece7fc640 1 -- 172.21.15.77:0/2361280756 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3ec802f070 con 0x7f3ed80fa840 2024-04-25T02:21:10.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.136+0000 7f3ece7fc640 1 --2- 172.21.15.77:0/2361280756 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f3ec406e0b0 0x7f3ec4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:10.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.136+0000 7f3ece7fc640 1 -- 172.21.15.77:0/2361280756 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f3ec80afb20 con 0x7f3ed80fa840 2024-04-25T02:21:10.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.136+0000 7f3edd138640 1 --2- 172.21.15.77:0/2361280756 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f3ec406e0b0 0x7f3ec4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:10.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.136+0000 7f3edd138640 1 --2- 172.21.15.77:0/2361280756 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f3ec406e0b0 0x7f3ec4070560 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3ed810e5c0 tx=0x7f3ed4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:10.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.141+0000 7f3ece7fc640 1 -- 172.21.15.77:0/2361280756 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f3ec8078e50 con 0x7f3ed80fa840 2024-04-25T02:21:10.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:09 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/2229450305' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:21:10.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:09 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/2620832080' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:21:10.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.314+0000 7f3edfb9d640 1 -- 172.21.15.77:0/2361280756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f3ed80652b0 con 0x7f3ed80fa840 2024-04-25T02:21:10.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.314+0000 7f3ece7fc640 1 -- 172.21.15.77:0/2361280756 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7f3ec807c510 con 0x7f3ed80fa840 2024-04-25T02:21:10.318 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T02:21:10.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.316+0000 7f3edfb9d640 1 -- 172.21.15.77:0/2361280756 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f3ec406e0b0 msgr2=0x7f3ec4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:10.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.316+0000 7f3edfb9d640 1 --2- 172.21.15.77:0/2361280756 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f3ec406e0b0 0x7f3ec4070560 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3ed810e5c0 tx=0x7f3ed4009040 comp rx=0 tx=0).stop 2024-04-25T02:21:10.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.316+0000 7f3edfb9d640 1 -- 172.21.15.77:0/2361280756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ed80fa840 msgr2=0x7f3ed8112d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:10.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.316+0000 7f3edfb9d640 1 --2- 172.21.15.77:0/2361280756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ed80fa840 0x7f3ed8112d00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8004930 tx=0x7f3ec8009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:10.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.316+0000 7f3edfb9d640 1 -- 172.21.15.77:0/2361280756 shutdown_connections 2024-04-25T02:21:10.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.316+0000 7f3edfb9d640 1 --2- 172.21.15.77:0/2361280756 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f3ec406e0b0 0x7f3ec4070560 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:10.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.316+0000 7f3edfb9d640 1 --2- 172.21.15.77:0/2361280756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ed81021f0 0x7f3ed8113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:10.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.316+0000 7f3edfb9d640 1 --2- 172.21.15.77:0/2361280756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ed80fa840 0x7f3ed8112d00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:10.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.316+0000 7f3edfb9d640 1 -- 172.21.15.77:0/2361280756 >> 172.21.15.77:0/2361280756 conn(0x7f3ed8071700 msgr2=0x7f3ed80f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:10.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.316+0000 7f3edfb9d640 1 -- 172.21.15.77:0/2361280756 shutdown_connections 2024-04-25T02:21:10.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.316+0000 7f3edfb9d640 1 -- 172.21.15.77:0/2361280756 wait complete. 2024-04-25T02:21:10.331 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:21:10.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.421+0000 7fd93f414640 1 -- 172.21.15.77:0/3489707817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9380fd190 msgr2=0x7fd9380fd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:10.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.421+0000 7fd93f414640 1 --2- 172.21.15.77:0/3489707817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9380fd190 0x7fd9380fd560 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd9340048d0 tx=0x7fd934009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:10.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.421+0000 7fd93f414640 1 -- 172.21.15.77:0/3489707817 shutdown_connections 2024-04-25T02:21:10.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.421+0000 7fd93f414640 1 --2- 172.21.15.77:0/3489707817 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9380fdb30 0x7fd938106200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:10.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.421+0000 7fd93f414640 1 --2- 172.21.15.77:0/3489707817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9380fd190 0x7fd9380fd560 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:10.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.421+0000 7fd93f414640 1 -- 172.21.15.77:0/3489707817 >> 172.21.15.77:0/3489707817 conn(0x7fd9380f6c10 msgr2=0x7fd9380f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:10.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.421+0000 7fd93f414640 1 -- 172.21.15.77:0/3489707817 shutdown_connections 2024-04-25T02:21:10.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.421+0000 7fd93f414640 1 -- 172.21.15.77:0/3489707817 wait complete. 2024-04-25T02:21:10.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.422+0000 7fd93f414640 1 Processor -- start 2024-04-25T02:21:10.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.422+0000 7fd93f414640 1 -- start start 2024-04-25T02:21:10.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.422+0000 7fd93f414640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9380fd190 0x7fd938112ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:10.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.422+0000 7fd93f414640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9380fdb30 0x7fd938113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:10.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.422+0000 7fd93f414640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd938113820 con 0x7fd9380fd190 2024-04-25T02:21:10.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.422+0000 7fd93f414640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93810ce70 con 0x7fd9380fdb30 2024-04-25T02:21:10.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.422+0000 7fd93d1b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9380fd190 0x7fd938112ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:10.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.422+0000 7fd93d1b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9380fd190 0x7fd938112ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39204/0 (socket says 172.21.15.77:39204) 2024-04-25T02:21:10.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.422+0000 7fd93d1b0640 1 -- 172.21.15.77:0/1878528141 learned_addr learned my addr 172.21.15.77:0/1878528141 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:10.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.422+0000 7fd93c9af640 1 --2- 172.21.15.77:0/1878528141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9380fdb30 0x7fd938113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:10.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.422+0000 7fd93d1b0640 1 -- 172.21.15.77:0/1878528141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9380fdb30 msgr2=0x7fd938113220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:10.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.422+0000 7fd93d1b0640 1 --2- 172.21.15.77:0/1878528141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9380fdb30 0x7fd938113220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:10.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.422+0000 7fd93d1b0640 1 -- 172.21.15.77:0/1878528141 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd934005040 con 0x7fd9380fd190 2024-04-25T02:21:10.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.422+0000 7fd93c9af640 1 --2- 172.21.15.77:0/1878528141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9380fdb30 0x7fd938113220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:21:10.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.423+0000 7fd93d1b0640 1 --2- 172.21.15.77:0/1878528141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9380fd190 0x7fd938112ce0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd9340318b0 tx=0x7fd934009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:10.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.423+0000 7fd92dffb640 1 -- 172.21.15.77:0/1878528141 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9340092e0 con 0x7fd9380fd190 2024-04-25T02:21:10.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.423+0000 7fd93f414640 1 -- 172.21.15.77:0/1878528141 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd93810d0f0 con 0x7fd9380fd190 2024-04-25T02:21:10.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.423+0000 7fd92dffb640 1 -- 172.21.15.77:0/1878528141 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd93403d450 con 0x7fd9380fd190 2024-04-25T02:21:10.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.423+0000 7fd92dffb640 1 -- 172.21.15.77:0/1878528141 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd93403b640 con 0x7fd9380fd190 2024-04-25T02:21:10.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.423+0000 7fd93f414640 1 -- 172.21.15.77:0/1878528141 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd93810d610 con 0x7fd9380fd190 2024-04-25T02:21:10.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.424+0000 7fd93f414640 1 -- 172.21.15.77:0/1878528141 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd938065d30 con 0x7fd9380fd190 2024-04-25T02:21:10.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.424+0000 7fd92dffb640 1 -- 172.21.15.77:0/1878528141 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd93402f070 con 0x7fd9380fd190 2024-04-25T02:21:10.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.425+0000 7fd92dffb640 1 --2- 172.21.15.77:0/1878528141 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd92406e0b0 0x7fd924070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:10.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.425+0000 7fd92dffb640 1 -- 172.21.15.77:0/1878528141 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd9340affe0 con 0x7fd9380fd190 2024-04-25T02:21:10.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.425+0000 7fd93c9af640 1 --2- 172.21.15.77:0/1878528141 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd92406e0b0 0x7fd924070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:10.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.425+0000 7fd93c9af640 1 --2- 172.21.15.77:0/1878528141 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd92406e0b0 0x7fd924070560 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd93810e5a0 tx=0x7fd928009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:10.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.429+0000 7fd92dffb640 1 -- 172.21.15.77:0/1878528141 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fd934079310 con 0x7fd9380fd190 2024-04-25T02:21:10.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.638+0000 7fd93f414640 1 -- 172.21.15.77:0/1878528141 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd93810e350 con 0x7fd9380fd190 2024-04-25T02:21:10.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.639+0000 7fd92dffb640 1 -- 172.21.15.77:0/1878528141 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+5210 (secure 0 0 0) 0x7fd93402d040 con 0x7fd9380fd190 2024-04-25T02:21:10.642 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:21:10.643 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34406,"name":"cephfs.smithi077.gcfygj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6829/702451557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":702451557},{"type":"v1","addr":"172.21.15.77:6829","nonce":702451557}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44303,"name":"cephfs.smithi112.dvwudt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6825/1388779321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1388779321},{"type":"v1","addr":"172.21.15.112:6825","nonce":1388779321}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44307,"name":"cephfs.smithi112.fjnadi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6827/1789386749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":1789386749},{"type":"v1","addr":"172.21.15.112:6827","nonce":1789386749}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:06:10.008979+0000","modified":"2024-04-25T02:19:10.937490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34374":{"gid":34374,"name":"cephfs.smithi077.oadrkb","rank":0,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.77:6827/1829655283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1829655283},{"type":"v1","addr":"172.21.15.77:6827","nonce":1829655283}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34374,"qdb_cluster":[34374]},"id":1}]} 2024-04-25T02:21:10.643 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 31 2024-04-25T02:21:10.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.641+0000 7fd93f414640 1 -- 172.21.15.77:0/1878528141 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd92406e0b0 msgr2=0x7fd924070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:10.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.641+0000 7fd93f414640 1 --2- 172.21.15.77:0/1878528141 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd92406e0b0 0x7fd924070560 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd93810e5a0 tx=0x7fd928009040 comp rx=0 tx=0).stop 2024-04-25T02:21:10.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.641+0000 7fd93f414640 1 -- 172.21.15.77:0/1878528141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9380fd190 msgr2=0x7fd938112ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:10.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.641+0000 7fd93f414640 1 --2- 172.21.15.77:0/1878528141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9380fd190 0x7fd938112ce0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd9340318b0 tx=0x7fd934009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:10.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.641+0000 7fd93f414640 1 -- 172.21.15.77:0/1878528141 shutdown_connections 2024-04-25T02:21:10.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.641+0000 7fd93f414640 1 --2- 172.21.15.77:0/1878528141 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd92406e0b0 0x7fd924070560 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:10.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.641+0000 7fd93f414640 1 --2- 172.21.15.77:0/1878528141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9380fdb30 0x7fd938113220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:10.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.641+0000 7fd93f414640 1 --2- 172.21.15.77:0/1878528141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9380fd190 0x7fd938112ce0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:10.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.641+0000 7fd93f414640 1 -- 172.21.15.77:0/1878528141 >> 172.21.15.77:0/1878528141 conn(0x7fd9380f6c10 msgr2=0x7fd9380f8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:10.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.641+0000 7fd93f414640 1 -- 172.21.15.77:0/1878528141 shutdown_connections 2024-04-25T02:21:10.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.641+0000 7fd93f414640 1 -- 172.21.15.77:0/1878528141 wait complete. 2024-04-25T02:21:10.656 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 1, 'flags': 18} 2024-04-25T02:21:10.656 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 16 2024-04-25T02:21:10.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.754+0000 7fdcb0c07640 1 -- 172.21.15.77:0/1451948430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcac102270 msgr2=0x7fdcac102640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:10.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.754+0000 7fdcb0c07640 1 --2- 172.21.15.77:0/1451948430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcac102270 0x7fdcac102640 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdca00048d0 tx=0x7fdca0009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:10.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.754+0000 7fdcb0c07640 1 -- 172.21.15.77:0/1451948430 shutdown_connections 2024-04-25T02:21:10.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.754+0000 7fdcb0c07640 1 --2- 172.21.15.77:0/1451948430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcac064390 0x7fdcac064800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:10.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.754+0000 7fdcb0c07640 1 --2- 172.21.15.77:0/1451948430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcac102270 0x7fdcac102640 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:10.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.754+0000 7fdcb0c07640 1 -- 172.21.15.77:0/1451948430 >> 172.21.15.77:0/1451948430 conn(0x7fdcac071fd0 msgr2=0x7fdcac0723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:10.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.754+0000 7fdcb0c07640 1 -- 172.21.15.77:0/1451948430 shutdown_connections 2024-04-25T02:21:10.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.754+0000 7fdcb0c07640 1 -- 172.21.15.77:0/1451948430 wait complete. 2024-04-25T02:21:10.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.754+0000 7fdcb0c07640 1 Processor -- start 2024-04-25T02:21:10.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.754+0000 7fdcb0c07640 1 -- start start 2024-04-25T02:21:10.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.754+0000 7fdcb0c07640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcac064390 0x7fdcac112c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:10.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.754+0000 7fdcb0c07640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcac102270 0x7fdcac113170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:10.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.754+0000 7fdcb0c07640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac113770 con 0x7fdcac064390 2024-04-25T02:21:10.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.754+0000 7fdcb0c07640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac10cdc0 con 0x7fdcac102270 2024-04-25T02:21:10.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.755+0000 7fdcaa59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcac064390 0x7fdcac112c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:10.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.755+0000 7fdcaa59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcac064390 0x7fdcac112c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39216/0 (socket says 172.21.15.77:39216) 2024-04-25T02:21:10.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.755+0000 7fdcaa59c640 1 -- 172.21.15.77:0/4281882004 learned_addr learned my addr 172.21.15.77:0/4281882004 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:10.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.755+0000 7fdcaa59c640 1 -- 172.21.15.77:0/4281882004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcac102270 msgr2=0x7fdcac113170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:10.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.755+0000 7fdcaa59c640 1 --2- 172.21.15.77:0/4281882004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcac102270 0x7fdcac113170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:10.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.755+0000 7fdcaa59c640 1 -- 172.21.15.77:0/4281882004 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca0005040 con 0x7fdcac064390 2024-04-25T02:21:10.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.755+0000 7fdcaa59c640 1 --2- 172.21.15.77:0/4281882004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcac064390 0x7fdcac112c30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdca0004930 tx=0x7fdca0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:10.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.755+0000 7fdc9affd640 1 -- 172.21.15.77:0/4281882004 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdca00094c0 con 0x7fdcac064390 2024-04-25T02:21:10.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.755+0000 7fdc9affd640 1 -- 172.21.15.77:0/4281882004 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdca0032e50 con 0x7fdcac064390 2024-04-25T02:21:10.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.755+0000 7fdcb0c07640 1 -- 172.21.15.77:0/4281882004 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcac10d040 con 0x7fdcac064390 2024-04-25T02:21:10.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.755+0000 7fdc9affd640 1 -- 172.21.15.77:0/4281882004 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdca00433b0 con 0x7fdcac064390 2024-04-25T02:21:10.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.755+0000 7fdcb0c07640 1 -- 172.21.15.77:0/4281882004 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcac10d500 con 0x7fdcac064390 2024-04-25T02:21:10.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.756+0000 7fdcb0c07640 1 -- 172.21.15.77:0/4281882004 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcac0fd970 con 0x7fdcac064390 2024-04-25T02:21:10.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.757+0000 7fdc9affd640 1 -- 172.21.15.77:0/4281882004 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fdca002f070 con 0x7fdcac064390 2024-04-25T02:21:10.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.757+0000 7fdc9affd640 1 --2- 172.21.15.77:0/4281882004 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fdc9406e0b0 0x7fdc94070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:10.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.757+0000 7fdc9affd640 1 -- 172.21.15.77:0/4281882004 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fdca00afa40 con 0x7fdcac064390 2024-04-25T02:21:10.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.757+0000 7fdca9d9b640 1 --2- 172.21.15.77:0/4281882004 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fdc9406e0b0 0x7fdc94070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:10.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.758+0000 7fdca9d9b640 1 --2- 172.21.15.77:0/4281882004 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fdc9406e0b0 0x7fdc94070560 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdcac10e4f0 tx=0x7fdc9c009c50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:10.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.762+0000 7fdc9affd640 1 -- 172.21.15.77:0/4281882004 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fdca0078d70 con 0x7fdcac064390 2024-04-25T02:21:10.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.976+0000 7fdcb0c07640 1 -- 172.21.15.77:0/4281882004 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7fdcac109370 con 0x7fdcac064390 2024-04-25T02:21:10.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.977+0000 7fdc9affd640 1 -- 172.21.15.77:0/4281882004 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v31) v1 ==== 107+0+4081 (secure 0 0 0) 0x7fdca007c430 con 0x7fdcac064390 2024-04-25T02:21:10.980 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:21:10.980 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14462,"name":"cephfs.smithi077.gcfygj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.77:6829/691698671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":691698671},{"type":"v1","addr":"172.21.15.77:6829","nonce":691698671}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24269,"name":"cephfs.smithi112.fjnadi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.112:6827/2036319817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2036319817},{"type":"v1","addr":"172.21.15.112:6827","nonce":2036319817}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:06:10.008979+0000","modified":"2024-04-25T02:06:27.849984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24257":{"gid":24257,"name":"cephfs.smithi112.dvwudt","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6825/3687767796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":3687767796},{"type":"v1","addr":"172.21.15.112:6825","nonce":3687767796}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T02:21:10.980 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 16 2024-04-25T02:21:10.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.979+0000 7fdcb0c07640 1 -- 172.21.15.77:0/4281882004 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fdc9406e0b0 msgr2=0x7fdc94070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:10.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.979+0000 7fdcb0c07640 1 --2- 172.21.15.77:0/4281882004 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fdc9406e0b0 0x7fdc94070560 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdcac10e4f0 tx=0x7fdc9c009c50 comp rx=0 tx=0).stop 2024-04-25T02:21:10.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.979+0000 7fdcb0c07640 1 -- 172.21.15.77:0/4281882004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcac064390 msgr2=0x7fdcac112c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:10.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.979+0000 7fdcb0c07640 1 --2- 172.21.15.77:0/4281882004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcac064390 0x7fdcac112c30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdca0004930 tx=0x7fdca0009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:10.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.979+0000 7fdcb0c07640 1 -- 172.21.15.77:0/4281882004 shutdown_connections 2024-04-25T02:21:10.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.979+0000 7fdcb0c07640 1 --2- 172.21.15.77:0/4281882004 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fdc9406e0b0 0x7fdc94070560 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:10.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.979+0000 7fdcb0c07640 1 --2- 172.21.15.77:0/4281882004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcac102270 0x7fdcac113170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:10.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.979+0000 7fdcb0c07640 1 --2- 172.21.15.77:0/4281882004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcac064390 0x7fdcac112c30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:10.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.979+0000 7fdcb0c07640 1 -- 172.21.15.77:0/4281882004 >> 172.21.15.77:0/4281882004 conn(0x7fdcac071fd0 msgr2=0x7fdcac0fa260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:10.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.979+0000 7fdcb0c07640 1 -- 172.21.15.77:0/4281882004 shutdown_connections 2024-04-25T02:21:10.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:10.979+0000 7fdcb0c07640 1 -- 172.21.15.77:0/4281882004 wait complete. 2024-04-25T02:21:10.993 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 17 2024-04-25T02:21:11.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.084+0000 7fa49d51d640 1 -- 172.21.15.77:0/2137486217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4981021e0 msgr2=0x7fa4981025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:11.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.084+0000 7fa49d51d640 1 --2- 172.21.15.77:0/2137486217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4981021e0 0x7fa4981025b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa4880048d0 tx=0x7fa488009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:11.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.084+0000 7fa49d51d640 1 -- 172.21.15.77:0/2137486217 shutdown_connections 2024-04-25T02:21:11.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.084+0000 7fa49d51d640 1 --2- 172.21.15.77:0/2137486217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa498102b80 0x7fa4980fc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:11.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.084+0000 7fa49d51d640 1 --2- 172.21.15.77:0/2137486217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4981021e0 0x7fa4981025b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:11.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.084+0000 7fa49d51d640 1 -- 172.21.15.77:0/2137486217 >> 172.21.15.77:0/2137486217 conn(0x7fa4980f7db0 msgr2=0x7fa4980fa1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:11.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.084+0000 7fa49d51d640 1 -- 172.21.15.77:0/2137486217 shutdown_connections 2024-04-25T02:21:11.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.084+0000 7fa49d51d640 1 -- 172.21.15.77:0/2137486217 wait complete. 2024-04-25T02:21:11.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.085+0000 7fa49d51d640 1 Processor -- start 2024-04-25T02:21:11.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.085+0000 7fa49d51d640 1 -- start start 2024-04-25T02:21:11.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.085+0000 7fa49d51d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4981021e0 0x7fa49806f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:11.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.085+0000 7fa49d51d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa498102b80 0x7fa49806fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:11.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.085+0000 7fa49d51d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa498071650 con 0x7fa4981021e0 2024-04-25T02:21:11.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.085+0000 7fa49d51d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4980701f0 con 0x7fa498102b80 2024-04-25T02:21:11.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.085+0000 7fa496ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4981021e0 0x7fa49806f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:11.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.085+0000 7fa496ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4981021e0 0x7fa49806f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39228/0 (socket says 172.21.15.77:39228) 2024-04-25T02:21:11.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.085+0000 7fa496ffd640 1 -- 172.21.15.77:0/2469811874 learned_addr learned my addr 172.21.15.77:0/2469811874 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:11.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.085+0000 7fa4967fc640 1 --2- 172.21.15.77:0/2469811874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa498102b80 0x7fa49806fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:11.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.085+0000 7fa496ffd640 1 -- 172.21.15.77:0/2469811874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa498102b80 msgr2=0x7fa49806fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:11.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.085+0000 7fa496ffd640 1 --2- 172.21.15.77:0/2469811874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa498102b80 0x7fa49806fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:11.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.085+0000 7fa496ffd640 1 -- 172.21.15.77:0/2469811874 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa488005040 con 0x7fa4981021e0 2024-04-25T02:21:11.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.086+0000 7fa496ffd640 1 --2- 172.21.15.77:0/2469811874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4981021e0 0x7fa49806f770 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa488004930 tx=0x7fa488009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:11.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.086+0000 7fa47f7fe640 1 -- 172.21.15.77:0/2469811874 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4880094c0 con 0x7fa4981021e0 2024-04-25T02:21:11.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.086+0000 7fa47f7fe640 1 -- 172.21.15.77:0/2469811874 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa488032e50 con 0x7fa4981021e0 2024-04-25T02:21:11.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.086+0000 7fa49d51d640 1 -- 172.21.15.77:0/2469811874 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa498070470 con 0x7fa4981021e0 2024-04-25T02:21:11.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.086+0000 7fa47f7fe640 1 -- 172.21.15.77:0/2469811874 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4880433b0 con 0x7fa4981021e0 2024-04-25T02:21:11.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.086+0000 7fa49d51d640 1 -- 172.21.15.77:0/2469811874 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa498119370 con 0x7fa4981021e0 2024-04-25T02:21:11.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.087+0000 7fa49d51d640 1 -- 172.21.15.77:0/2469811874 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4980fd950 con 0x7fa4981021e0 2024-04-25T02:21:11.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.087+0000 7fa47f7fe640 1 -- 172.21.15.77:0/2469811874 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa48802f070 con 0x7fa4981021e0 2024-04-25T02:21:11.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.088+0000 7fa47f7fe640 1 --2- 172.21.15.77:0/2469811874 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fa48006e0b0 0x7fa480070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:11.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.088+0000 7fa4967fc640 1 --2- 172.21.15.77:0/2469811874 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fa48006e0b0 0x7fa480070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:11.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.088+0000 7fa47f7fe640 1 -- 172.21.15.77:0/2469811874 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa4880afb90 con 0x7fa4981021e0 2024-04-25T02:21:11.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.088+0000 7fa4967fc640 1 --2- 172.21.15.77:0/2469811874 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fa48006e0b0 0x7fa480070560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa498070ea0 tx=0x7fa48c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:11.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.093+0000 7fa47f7fe640 1 -- 172.21.15.77:0/2469811874 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fa488078ec0 con 0x7fa4981021e0 2024-04-25T02:21:11.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:10 smithi077 ceph-mon[110441]: pgmap v270: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:21:11.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:10 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/337275352' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-25T02:21:11.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:10 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/2361280756' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-25T02:21:11.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:10 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/1878528141' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:21:11.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:10 smithi112 ceph-mon[80494]: pgmap v270: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:21:11.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:10 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/337275352' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-25T02:21:11.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:10 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/2361280756' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-25T02:21:11.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:10 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/1878528141' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:21:11.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.303+0000 7fa49d51d640 1 -- 172.21.15.77:0/2469811874 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7fa4980ff480 con 0x7fa4981021e0 2024-04-25T02:21:11.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.304+0000 7fa47f7fe640 1 -- 172.21.15.77:0/2469811874 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v31) v1 ==== 107+0+4928 (secure 0 0 0) 0x7fa48807c580 con 0x7fa4981021e0 2024-04-25T02:21:11.307 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:21:11.307 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14462,"name":"cephfs.smithi077.gcfygj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.77:6829/691698671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":691698671},{"type":"v1","addr":"172.21.15.77:6829","nonce":691698671}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24269,"name":"cephfs.smithi112.fjnadi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.112:6827/2036319817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2036319817},{"type":"v1","addr":"172.21.15.112:6827","nonce":2036319817}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34374,"name":"cephfs.smithi077.oadrkb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6827/1829655283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1829655283},{"type":"v1","addr":"172.21.15.77:6827","nonce":1829655283}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:06:10.008979+0000","modified":"2024-04-25T02:06:27.849984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24257":{"gid":24257,"name":"cephfs.smithi112.dvwudt","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6825/3687767796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":3687767796},{"type":"v1","addr":"172.21.15.112:6825","nonce":3687767796}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T02:21:11.307 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 17 2024-04-25T02:21:11.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.306+0000 7fa49d51d640 1 -- 172.21.15.77:0/2469811874 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fa48006e0b0 msgr2=0x7fa480070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:11.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.306+0000 7fa49d51d640 1 --2- 172.21.15.77:0/2469811874 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fa48006e0b0 0x7fa480070560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa498070ea0 tx=0x7fa48c009040 comp rx=0 tx=0).stop 2024-04-25T02:21:11.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.306+0000 7fa49d51d640 1 -- 172.21.15.77:0/2469811874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4981021e0 msgr2=0x7fa49806f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:11.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.306+0000 7fa49d51d640 1 --2- 172.21.15.77:0/2469811874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4981021e0 0x7fa49806f770 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa488004930 tx=0x7fa488009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:11.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.306+0000 7fa49d51d640 1 -- 172.21.15.77:0/2469811874 shutdown_connections 2024-04-25T02:21:11.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.306+0000 7fa49d51d640 1 --2- 172.21.15.77:0/2469811874 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fa48006e0b0 0x7fa480070560 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:11.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.306+0000 7fa49d51d640 1 --2- 172.21.15.77:0/2469811874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa498102b80 0x7fa49806fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:11.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.306+0000 7fa49d51d640 1 --2- 172.21.15.77:0/2469811874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4981021e0 0x7fa49806f770 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:11.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.306+0000 7fa49d51d640 1 -- 172.21.15.77:0/2469811874 >> 172.21.15.77:0/2469811874 conn(0x7fa4980f7db0 msgr2=0x7fa4980f9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:11.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.306+0000 7fa49d51d640 1 -- 172.21.15.77:0/2469811874 shutdown_connections 2024-04-25T02:21:11.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.306+0000 7fa49d51d640 1 -- 172.21.15.77:0/2469811874 wait complete. 2024-04-25T02:21:11.320 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 18 2024-04-25T02:21:11.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.411+0000 7fefb602e640 1 -- 172.21.15.77:0/2158368374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefb00fbb60 msgr2=0x7fefb00fbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:11.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.411+0000 7fefb602e640 1 --2- 172.21.15.77:0/2158368374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefb00fbb60 0x7fefb00fbfd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fef980048d0 tx=0x7fef98009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:11.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.411+0000 7fefb602e640 1 -- 172.21.15.77:0/2158368374 shutdown_connections 2024-04-25T02:21:11.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.411+0000 7fefb602e640 1 --2- 172.21.15.77:0/2158368374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefb00fbb60 0x7fefb00fbfd0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:11.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.411+0000 7fefb602e640 1 --2- 172.21.15.77:0/2158368374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb01002f0 0x7fefb01006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:11.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.411+0000 7fefb602e640 1 -- 172.21.15.77:0/2158368374 >> 172.21.15.77:0/2158368374 conn(0x7fefb0071990 msgr2=0x7fefb0071d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:11.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.411+0000 7fefb602e640 1 -- 172.21.15.77:0/2158368374 shutdown_connections 2024-04-25T02:21:11.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.411+0000 7fefb602e640 1 -- 172.21.15.77:0/2158368374 wait complete. 2024-04-25T02:21:11.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.412+0000 7fefb602e640 1 Processor -- start 2024-04-25T02:21:11.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.412+0000 7fefb602e640 1 -- start start 2024-04-25T02:21:11.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.412+0000 7fefb602e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb00fbb60 0x7fefb0111e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:11.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.412+0000 7fefb602e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefb01002f0 0x7fefb01123a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:11.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.412+0000 7fefb602e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb01129a0 con 0x7fefb01002f0 2024-04-25T02:21:11.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.412+0000 7fefb602e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb010bff0 con 0x7fefb00fbb60 2024-04-25T02:21:11.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.413+0000 7fefa6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefb01002f0 0x7fefb01123a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:11.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.413+0000 7fefa6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefb01002f0 0x7fefb01123a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39248/0 (socket says 172.21.15.77:39248) 2024-04-25T02:21:11.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.413+0000 7fefa6ffd640 1 -- 172.21.15.77:0/682384725 learned_addr learned my addr 172.21.15.77:0/682384725 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:11.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.413+0000 7fefaf7fe640 1 --2- 172.21.15.77:0/682384725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb00fbb60 0x7fefb0111e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:11.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.413+0000 7fefa6ffd640 1 -- 172.21.15.77:0/682384725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb00fbb60 msgr2=0x7fefb0111e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:11.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.413+0000 7fefa6ffd640 1 --2- 172.21.15.77:0/682384725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb00fbb60 0x7fefb0111e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:11.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.413+0000 7fefa6ffd640 1 -- 172.21.15.77:0/682384725 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef98005040 con 0x7fefb01002f0 2024-04-25T02:21:11.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.413+0000 7fefa6ffd640 1 --2- 172.21.15.77:0/682384725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefb01002f0 0x7fefb01123a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fef98004930 tx=0x7fef98009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:11.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.413+0000 7fefacff9640 1 -- 172.21.15.77:0/682384725 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef980094c0 con 0x7fefb01002f0 2024-04-25T02:21:11.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.413+0000 7fefb602e640 1 -- 172.21.15.77:0/682384725 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb010c270 con 0x7fefb01002f0 2024-04-25T02:21:11.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.413+0000 7fefacff9640 1 -- 172.21.15.77:0/682384725 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fef98032e50 con 0x7fefb01002f0 2024-04-25T02:21:11.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.413+0000 7fefacff9640 1 -- 172.21.15.77:0/682384725 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef980433b0 con 0x7fefb01002f0 2024-04-25T02:21:11.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.413+0000 7fefb602e640 1 -- 172.21.15.77:0/682384725 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb010c730 con 0x7fefb01002f0 2024-04-25T02:21:11.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.414+0000 7fefb602e640 1 -- 172.21.15.77:0/682384725 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb00fcb70 con 0x7fefb01002f0 2024-04-25T02:21:11.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.415+0000 7fefacff9640 1 -- 172.21.15.77:0/682384725 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fef9802f070 con 0x7fefb01002f0 2024-04-25T02:21:11.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.415+0000 7fefacff9640 1 --2- 172.21.15.77:0/682384725 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fef9c06e0b0 0x7fef9c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:11.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.415+0000 7fefacff9640 1 -- 172.21.15.77:0/682384725 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fef980afa70 con 0x7fefb01002f0 2024-04-25T02:21:11.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.415+0000 7fefaf7fe640 1 --2- 172.21.15.77:0/682384725 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fef9c06e0b0 0x7fef9c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:11.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.415+0000 7fefaf7fe640 1 --2- 172.21.15.77:0/682384725 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fef9c06e0b0 0x7fef9c070560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fefa00041d0 tx=0x7fefa0004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:11.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.419+0000 7fefacff9640 1 -- 172.21.15.77:0/682384725 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fef98078e50 con 0x7fefb01002f0 2024-04-25T02:21:11.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.635+0000 7fefb602e640 1 -- 172.21.15.77:0/682384725 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7fefb0108560 con 0x7fefb01002f0 2024-04-25T02:21:11.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.636+0000 7fefacff9640 1 -- 172.21.15.77:0/682384725 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v31) v1 ==== 107+0+4152 (secure 0 0 0) 0x7fef9807c510 con 0x7fefb01002f0 2024-04-25T02:21:11.639 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:21:11.639 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24269,"name":"cephfs.smithi112.fjnadi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.112:6827/2036319817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2036319817},{"type":"v1","addr":"172.21.15.112:6827","nonce":2036319817}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34374,"name":"cephfs.smithi077.oadrkb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6827/1829655283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1829655283},{"type":"v1","addr":"172.21.15.77:6827","nonce":1829655283}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:06:10.008979+0000","modified":"2024-04-25T02:06:27.849984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24257":{"gid":24257,"name":"cephfs.smithi112.dvwudt","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6825/3687767796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":3687767796},{"type":"v1","addr":"172.21.15.112:6825","nonce":3687767796}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T02:21:11.639 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 18 2024-04-25T02:21:11.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.638+0000 7fefb602e640 1 -- 172.21.15.77:0/682384725 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fef9c06e0b0 msgr2=0x7fef9c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:11.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.638+0000 7fefb602e640 1 --2- 172.21.15.77:0/682384725 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fef9c06e0b0 0x7fef9c070560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fefa00041d0 tx=0x7fefa0004330 comp rx=0 tx=0).stop 2024-04-25T02:21:11.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.638+0000 7fefb602e640 1 -- 172.21.15.77:0/682384725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefb01002f0 msgr2=0x7fefb01123a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:11.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.638+0000 7fefb602e640 1 --2- 172.21.15.77:0/682384725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefb01002f0 0x7fefb01123a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fef98004930 tx=0x7fef98009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:11.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.638+0000 7fefb602e640 1 -- 172.21.15.77:0/682384725 shutdown_connections 2024-04-25T02:21:11.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.638+0000 7fefb602e640 1 --2- 172.21.15.77:0/682384725 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fef9c06e0b0 0x7fef9c070560 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:11.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.638+0000 7fefb602e640 1 --2- 172.21.15.77:0/682384725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefb01002f0 0x7fefb01123a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:11.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.638+0000 7fefb602e640 1 --2- 172.21.15.77:0/682384725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb00fbb60 0x7fefb0111e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:11.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.638+0000 7fefb602e640 1 -- 172.21.15.77:0/682384725 >> 172.21.15.77:0/682384725 conn(0x7fefb0071990 msgr2=0x7fefb00f9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:11.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.638+0000 7fefb602e640 1 -- 172.21.15.77:0/682384725 shutdown_connections 2024-04-25T02:21:11.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.638+0000 7fefb602e640 1 -- 172.21.15.77:0/682384725 wait complete. 2024-04-25T02:21:11.652 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-04-25T02:21:11.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.743+0000 7f917f82e640 1 -- 172.21.15.77:0/2094693093 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9178101070 msgr2=0x7f9178101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:11.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.743+0000 7f917f82e640 1 --2- 172.21.15.77:0/2094693093 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9178101070 0x7f9178101440 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f91700048d0 tx=0x7f9170009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:11.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.743+0000 7f917f82e640 1 -- 172.21.15.77:0/2094693093 shutdown_connections 2024-04-25T02:21:11.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.743+0000 7f917f82e640 1 --2- 172.21.15.77:0/2094693093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9178101a10 0x7f91780fb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:11.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.743+0000 7f917f82e640 1 --2- 172.21.15.77:0/2094693093 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9178101070 0x7f9178101440 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:11.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.743+0000 7f917f82e640 1 -- 172.21.15.77:0/2094693093 >> 172.21.15.77:0/2094693093 conn(0x7f91780f6be0 msgr2=0x7f91780f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:11.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.744+0000 7f917f82e640 1 -- 172.21.15.77:0/2094693093 shutdown_connections 2024-04-25T02:21:11.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.744+0000 7f917f82e640 1 -- 172.21.15.77:0/2094693093 wait complete. 2024-04-25T02:21:11.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.744+0000 7f917f82e640 1 Processor -- start 2024-04-25T02:21:11.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.744+0000 7f917f82e640 1 -- start start 2024-04-25T02:21:11.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.744+0000 7f917f82e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9178101070 0x7f917810de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:11.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.744+0000 7f917f82e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9178101a10 0x7f917810e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:11.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.744+0000 7f917f82e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9178066780 con 0x7f9178101070 2024-04-25T02:21:11.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.744+0000 7f917f82e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917810e8e0 con 0x7f9178101a10 2024-04-25T02:21:11.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.744+0000 7f917d5ca640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9178101070 0x7f917810de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:11.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.745+0000 7f917d5ca640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9178101070 0x7f917810de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39266/0 (socket says 172.21.15.77:39266) 2024-04-25T02:21:11.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.745+0000 7f917d5ca640 1 -- 172.21.15.77:0/315118411 learned_addr learned my addr 172.21.15.77:0/315118411 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:11.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.745+0000 7f917cdc9640 1 --2- 172.21.15.77:0/315118411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9178101a10 0x7f917810e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:11.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.745+0000 7f917d5ca640 1 -- 172.21.15.77:0/315118411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9178101a10 msgr2=0x7f917810e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:11.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.745+0000 7f917d5ca640 1 --2- 172.21.15.77:0/315118411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9178101a10 0x7f917810e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:11.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.745+0000 7f917d5ca640 1 -- 172.21.15.77:0/315118411 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9170005040 con 0x7f9178101070 2024-04-25T02:21:11.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.745+0000 7f917cdc9640 1 --2- 172.21.15.77:0/315118411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9178101a10 0x7f917810e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:21:11.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.745+0000 7f917d5ca640 1 --2- 172.21.15.77:0/315118411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9178101070 0x7f917810de60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9170004930 tx=0x7f9170009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:11.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.745+0000 7f916dffb640 1 -- 172.21.15.77:0/315118411 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91700094c0 con 0x7f9178101070 2024-04-25T02:21:11.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.745+0000 7f916dffb640 1 -- 172.21.15.77:0/315118411 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9170032e50 con 0x7f9178101070 2024-04-25T02:21:11.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.745+0000 7f917f82e640 1 -- 172.21.15.77:0/315118411 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f917810eb60 con 0x7f9178101070 2024-04-25T02:21:11.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.745+0000 7f916dffb640 1 -- 172.21.15.77:0/315118411 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91700433b0 con 0x7f9178101070 2024-04-25T02:21:11.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.745+0000 7f917f82e640 1 -- 172.21.15.77:0/315118411 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91781170c0 con 0x7f9178101070 2024-04-25T02:21:11.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.746+0000 7f917f82e640 1 -- 172.21.15.77:0/315118411 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91780fc7e0 con 0x7f9178101070 2024-04-25T02:21:11.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.747+0000 7f916dffb640 1 -- 172.21.15.77:0/315118411 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f917002f070 con 0x7f9178101070 2024-04-25T02:21:11.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.747+0000 7f916dffb640 1 --2- 172.21.15.77:0/315118411 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f916406e0b0 0x7f9164070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:11.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.747+0000 7f916dffb640 1 -- 172.21.15.77:0/315118411 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f91700afa20 con 0x7f9178101070 2024-04-25T02:21:11.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.747+0000 7f917cdc9640 1 --2- 172.21.15.77:0/315118411 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f916406e0b0 0x7f9164070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:11.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.747+0000 7f917cdc9640 1 --2- 172.21.15.77:0/315118411 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f916406e0b0 0x7f9164070560 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9168007fd0 tx=0x7f9168009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:11.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.752+0000 7f916dffb640 1 -- 172.21.15.77:0/315118411 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f9170078d50 con 0x7f9178101070 2024-04-25T02:21:11.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.966+0000 7f917f82e640 1 -- 172.21.15.77:0/315118411 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f9178064350 con 0x7f9178101070 2024-04-25T02:21:11.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.967+0000 7f916dffb640 1 -- 172.21.15.77:0/315118411 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v31) v1 ==== 107+0+4996 (secure 0 0 0) 0x7f917007c410 con 0x7f9178101070 2024-04-25T02:21:11.970 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:21:11.970 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24269,"name":"cephfs.smithi112.fjnadi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.112:6827/2036319817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2036319817},{"type":"v1","addr":"172.21.15.112:6827","nonce":2036319817}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34374,"name":"cephfs.smithi077.oadrkb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6827/1829655283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1829655283},{"type":"v1","addr":"172.21.15.77:6827","nonce":1829655283}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34406,"name":"cephfs.smithi077.gcfygj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6829/702451557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":702451557},{"type":"v1","addr":"172.21.15.77:6829","nonce":702451557}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:06:10.008979+0000","modified":"2024-04-25T02:06:27.849984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24257":{"gid":24257,"name":"cephfs.smithi112.dvwudt","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6825/3687767796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":3687767796},{"type":"v1","addr":"172.21.15.112:6825","nonce":3687767796}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T02:21:11.971 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 19 2024-04-25T02:21:11.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.969+0000 7f917f82e640 1 -- 172.21.15.77:0/315118411 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f916406e0b0 msgr2=0x7f9164070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:11.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.969+0000 7f917f82e640 1 --2- 172.21.15.77:0/315118411 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f916406e0b0 0x7f9164070560 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9168007fd0 tx=0x7f9168009e90 comp rx=0 tx=0).stop 2024-04-25T02:21:11.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.969+0000 7f917f82e640 1 -- 172.21.15.77:0/315118411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9178101070 msgr2=0x7f917810de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:11.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.969+0000 7f917f82e640 1 --2- 172.21.15.77:0/315118411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9178101070 0x7f917810de60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9170004930 tx=0x7f9170009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:11.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.969+0000 7f917f82e640 1 -- 172.21.15.77:0/315118411 shutdown_connections 2024-04-25T02:21:11.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.969+0000 7f917f82e640 1 --2- 172.21.15.77:0/315118411 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f916406e0b0 0x7f9164070560 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:11.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.969+0000 7f917f82e640 1 --2- 172.21.15.77:0/315118411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9178101a10 0x7f917810e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:11.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.969+0000 7f917f82e640 1 --2- 172.21.15.77:0/315118411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9178101070 0x7f917810de60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:11.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.969+0000 7f917f82e640 1 -- 172.21.15.77:0/315118411 >> 172.21.15.77:0/315118411 conn(0x7f91780f6be0 msgr2=0x7f91780f7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:11.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.969+0000 7f917f82e640 1 -- 172.21.15.77:0/315118411 shutdown_connections 2024-04-25T02:21:11.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:11.969+0000 7f917f82e640 1 -- 172.21.15.77:0/315118411 wait complete. 2024-04-25T02:21:11.983 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-04-25T02:21:12.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.074+0000 7fbb00314640 1 -- 172.21.15.77:0/1667359263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaf81021e0 msgr2=0x7fbaf81025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:12.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.074+0000 7fbb00314640 1 --2- 172.21.15.77:0/1667359263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaf81021e0 0x7fbaf81025b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4009c50 tx=0x7fbaf4004d10 comp rx=0 tx=0).stop 2024-04-25T02:21:12.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.074+0000 7fbb00314640 1 -- 172.21.15.77:0/1667359263 shutdown_connections 2024-04-25T02:21:12.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.074+0000 7fbb00314640 1 --2- 172.21.15.77:0/1667359263 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbaf8102b80 0x7fbaf80fc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:12.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.074+0000 7fbb00314640 1 --2- 172.21.15.77:0/1667359263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaf81021e0 0x7fbaf81025b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:12.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.074+0000 7fbb00314640 1 -- 172.21.15.77:0/1667359263 >> 172.21.15.77:0/1667359263 conn(0x7fbaf80f7db0 msgr2=0x7fbaf80fa1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:12.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.075+0000 7fbb00314640 1 -- 172.21.15.77:0/1667359263 shutdown_connections 2024-04-25T02:21:12.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.075+0000 7fbb00314640 1 -- 172.21.15.77:0/1667359263 wait complete. 2024-04-25T02:21:12.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.075+0000 7fbb00314640 1 Processor -- start 2024-04-25T02:21:12.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.075+0000 7fbb00314640 1 -- start start 2024-04-25T02:21:12.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.075+0000 7fbb00314640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaf81021e0 0x7fbaf8112ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:12.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.075+0000 7fbb00314640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbaf8102b80 0x7fbaf81131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:12.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.075+0000 7fbb00314640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf81137e0 con 0x7fbaf81021e0 2024-04-25T02:21:12.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.075+0000 7fbb00314640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf810ce30 con 0x7fbaf8102b80 2024-04-25T02:21:12.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.075+0000 7fbafe0b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaf81021e0 0x7fbaf8112ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:12.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.075+0000 7fbafe0b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaf81021e0 0x7fbaf8112ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39288/0 (socket says 172.21.15.77:39288) 2024-04-25T02:21:12.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.075+0000 7fbafe0b0640 1 -- 172.21.15.77:0/3260962820 learned_addr learned my addr 172.21.15.77:0/3260962820 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:12.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.075+0000 7fbafe0b0640 1 -- 172.21.15.77:0/3260962820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbaf8102b80 msgr2=0x7fbaf81131e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:12.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.075+0000 7fbafe0b0640 1 --2- 172.21.15.77:0/3260962820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbaf8102b80 0x7fbaf81131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:12.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.075+0000 7fbafe0b0640 1 -- 172.21.15.77:0/3260962820 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf40098b0 con 0x7fbaf81021e0 2024-04-25T02:21:12.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.076+0000 7fbafe0b0640 1 --2- 172.21.15.77:0/3260962820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaf81021e0 0x7fbaf8112ca0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4004a30 tx=0x7fbaf4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:12.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.076+0000 7fbaeeffd640 1 -- 172.21.15.77:0/3260962820 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbaf403a070 con 0x7fbaf81021e0 2024-04-25T02:21:12.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.076+0000 7fbaeeffd640 1 -- 172.21.15.77:0/3260962820 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbaf4035b20 con 0x7fbaf81021e0 2024-04-25T02:21:12.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.076+0000 7fbb00314640 1 -- 172.21.15.77:0/3260962820 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf810d0b0 con 0x7fbaf81021e0 2024-04-25T02:21:12.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.076+0000 7fbaeeffd640 1 -- 172.21.15.77:0/3260962820 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbaf403ea70 con 0x7fbaf81021e0 2024-04-25T02:21:12.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.076+0000 7fbb00314640 1 -- 172.21.15.77:0/3260962820 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf810d650 con 0x7fbaf81021e0 2024-04-25T02:21:12.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.077+0000 7fbb00314640 1 -- 172.21.15.77:0/3260962820 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaf80fd950 con 0x7fbaf81021e0 2024-04-25T02:21:12.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.077+0000 7fbaeeffd640 1 -- 172.21.15.77:0/3260962820 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fbaf4032070 con 0x7fbaf81021e0 2024-04-25T02:21:12.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.078+0000 7fbaeeffd640 1 --2- 172.21.15.77:0/3260962820 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fbae406e0b0 0x7fbae4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:12.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.078+0000 7fbafd8af640 1 --2- 172.21.15.77:0/3260962820 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fbae406e0b0 0x7fbae4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:12.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.078+0000 7fbaeeffd640 1 -- 172.21.15.77:0/3260962820 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fbaf40afd10 con 0x7fbaf81021e0 2024-04-25T02:21:12.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.078+0000 7fbafd8af640 1 --2- 172.21.15.77:0/3260962820 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fbae406e0b0 0x7fbae4070560 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbaf810e560 tx=0x7fbae8009c50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:12.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.082+0000 7fbaeeffd640 1 -- 172.21.15.77:0/3260962820 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fbaf40790f0 con 0x7fbaf81021e0 2024-04-25T02:21:12.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:11 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/4281882004' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-04-25T02:21:12.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:11 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/2469811874' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-04-25T02:21:12.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:11 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/682384725' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-04-25T02:21:12.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:11 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/4281882004' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-04-25T02:21:12.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:11 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/2469811874' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-04-25T02:21:12.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:11 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/682384725' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-04-25T02:21:12.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.292+0000 7fbb00314640 1 -- 172.21.15.77:0/3260962820 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7fbaf8109370 con 0x7fbaf81021e0 2024-04-25T02:21:12.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.293+0000 7fbaeeffd640 1 -- 172.21.15.77:0/3260962820 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v31) v1 ==== 107+0+4203 (secure 0 0 0) 0x7fbaf407c7b0 con 0x7fbaf81021e0 2024-04-25T02:21:12.296 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:21:12.296 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24269,"name":"cephfs.smithi112.fjnadi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.112:6827/2036319817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2036319817},{"type":"v1","addr":"172.21.15.112:6827","nonce":2036319817}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34374,"name":"cephfs.smithi077.oadrkb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6827/1829655283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1829655283},{"type":"v1","addr":"172.21.15.77:6827","nonce":1829655283}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34406,"name":"cephfs.smithi077.gcfygj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6829/702451557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":702451557},{"type":"v1","addr":"172.21.15.77:6829","nonce":702451557}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:06:10.008979+0000","modified":"2024-04-25T02:18:31.253807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T02:21:12.297 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 20 2024-04-25T02:21:12.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.295+0000 7fbb00314640 1 -- 172.21.15.77:0/3260962820 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fbae406e0b0 msgr2=0x7fbae4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:12.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.295+0000 7fbb00314640 1 --2- 172.21.15.77:0/3260962820 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fbae406e0b0 0x7fbae4070560 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbaf810e560 tx=0x7fbae8009c50 comp rx=0 tx=0).stop 2024-04-25T02:21:12.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.295+0000 7fbb00314640 1 -- 172.21.15.77:0/3260962820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaf81021e0 msgr2=0x7fbaf8112ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:12.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.295+0000 7fbb00314640 1 --2- 172.21.15.77:0/3260962820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaf81021e0 0x7fbaf8112ca0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4004a30 tx=0x7fbaf4004d10 comp rx=0 tx=0).stop 2024-04-25T02:21:12.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.295+0000 7fbb00314640 1 -- 172.21.15.77:0/3260962820 shutdown_connections 2024-04-25T02:21:12.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.295+0000 7fbb00314640 1 --2- 172.21.15.77:0/3260962820 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fbae406e0b0 0x7fbae4070560 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:12.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.295+0000 7fbb00314640 1 --2- 172.21.15.77:0/3260962820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbaf8102b80 0x7fbaf81131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:12.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.295+0000 7fbb00314640 1 --2- 172.21.15.77:0/3260962820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaf81021e0 0x7fbaf8112ca0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:12.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.295+0000 7fbb00314640 1 -- 172.21.15.77:0/3260962820 >> 172.21.15.77:0/3260962820 conn(0x7fbaf80f7db0 msgr2=0x7fbaf80f9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:12.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.295+0000 7fbb00314640 1 -- 172.21.15.77:0/3260962820 shutdown_connections 2024-04-25T02:21:12.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.295+0000 7fbb00314640 1 -- 172.21.15.77:0/3260962820 wait complete. 2024-04-25T02:21:12.310 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-04-25T02:21:12.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.401+0000 7f3458b5d640 1 -- 172.21.15.77:0/3550163607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3454102bd0 msgr2=0x7f34540fa8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:12.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.401+0000 7f3458b5d640 1 --2- 172.21.15.77:0/3550163607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3454102bd0 0x7f34540fa8c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f343c0048d0 tx=0x7f343c009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:12.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.401+0000 7f3458b5d640 1 -- 172.21.15.77:0/3550163607 shutdown_connections 2024-04-25T02:21:12.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.401+0000 7f3458b5d640 1 --2- 172.21.15.77:0/3550163607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3454102bd0 0x7f34540fa8c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:12.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.401+0000 7f3458b5d640 1 --2- 172.21.15.77:0/3550163607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3454102230 0x7f3454102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:12.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.401+0000 7f3458b5d640 1 -- 172.21.15.77:0/3550163607 >> 172.21.15.77:0/3550163607 conn(0x7f34540717e0 msgr2=0x7f3454071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:12.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.401+0000 7f3458b5d640 1 -- 172.21.15.77:0/3550163607 shutdown_connections 2024-04-25T02:21:12.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.401+0000 7f3458b5d640 1 -- 172.21.15.77:0/3550163607 wait complete. 2024-04-25T02:21:12.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.401+0000 7f3458b5d640 1 Processor -- start 2024-04-25T02:21:12.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.401+0000 7f3458b5d640 1 -- start start 2024-04-25T02:21:12.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.402+0000 7f3458b5d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3454102230 0x7f3454112d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:12.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.402+0000 7f3458b5d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3454102bd0 0x7f3454113290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:12.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.402+0000 7f3458b5d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3454113890 con 0x7f3454102bd0 2024-04-25T02:21:12.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.402+0000 7f3458b5d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345410cee0 con 0x7f3454102230 2024-04-25T02:21:12.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.402+0000 7f344bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3454102bd0 0x7f3454113290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:12.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.402+0000 7f344bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3454102bd0 0x7f3454113290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39308/0 (socket says 172.21.15.77:39308) 2024-04-25T02:21:12.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.402+0000 7f344bfff640 1 -- 172.21.15.77:0/2148501833 learned_addr learned my addr 172.21.15.77:0/2148501833 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:12.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.402+0000 7f345259c640 1 --2- 172.21.15.77:0/2148501833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3454102230 0x7f3454112d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:12.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.402+0000 7f344bfff640 1 -- 172.21.15.77:0/2148501833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3454102230 msgr2=0x7f3454112d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:12.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.402+0000 7f344bfff640 1 --2- 172.21.15.77:0/2148501833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3454102230 0x7f3454112d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:12.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.402+0000 7f344bfff640 1 -- 172.21.15.77:0/2148501833 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c005040 con 0x7f3454102bd0 2024-04-25T02:21:12.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.402+0000 7f345259c640 1 --2- 172.21.15.77:0/2148501833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3454102230 0x7f3454112d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:21:12.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.402+0000 7f344bfff640 1 --2- 172.21.15.77:0/2148501833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3454102bd0 0x7f3454113290 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f343c02bda0 tx=0x7f343c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:12.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.402+0000 7f344affd640 1 -- 172.21.15.77:0/2148501833 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f343c0094c0 con 0x7f3454102bd0 2024-04-25T02:21:12.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.402+0000 7f344affd640 1 -- 172.21.15.77:0/2148501833 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f343c032e50 con 0x7f3454102bd0 2024-04-25T02:21:12.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.402+0000 7f3458b5d640 1 -- 172.21.15.77:0/2148501833 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f345410d160 con 0x7f3454102bd0 2024-04-25T02:21:12.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.402+0000 7f344affd640 1 -- 172.21.15.77:0/2148501833 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f343c03b400 con 0x7f3454102bd0 2024-04-25T02:21:12.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.402+0000 7f3458b5d640 1 -- 172.21.15.77:0/2148501833 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f345410d680 con 0x7f3454102bd0 2024-04-25T02:21:12.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.403+0000 7f3458b5d640 1 -- 172.21.15.77:0/2148501833 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3454064350 con 0x7f3454102bd0 2024-04-25T02:21:12.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.404+0000 7f344affd640 1 -- 172.21.15.77:0/2148501833 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f343c02f070 con 0x7f3454102bd0 2024-04-25T02:21:12.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.404+0000 7f344affd640 1 --2- 172.21.15.77:0/2148501833 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f344006e0b0 0x7f3440070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:12.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.404+0000 7f344affd640 1 -- 172.21.15.77:0/2148501833 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f343c0affb0 con 0x7f3454102bd0 2024-04-25T02:21:12.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.404+0000 7f345259c640 1 --2- 172.21.15.77:0/2148501833 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f344006e0b0 0x7f3440070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:12.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.405+0000 7f345259c640 1 --2- 172.21.15.77:0/2148501833 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f344006e0b0 0x7f3440070560 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3444007fd0 tx=0x7f3444009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:12.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.409+0000 7f344affd640 1 -- 172.21.15.77:0/2148501833 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f343c0e4740 con 0x7f3454102bd0 2024-04-25T02:21:12.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.621+0000 7f3458b5d640 1 -- 172.21.15.77:0/2148501833 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f345410e3c0 con 0x7f3454102bd0 2024-04-25T02:21:12.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.621+0000 7f344affd640 1 -- 172.21.15.77:0/2148501833 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v31) v1 ==== 107+0+4214 (secure 0 0 0) 0x7f343c0792e0 con 0x7f3454102bd0 2024-04-25T02:21:12.625 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:21:12.625 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34374,"name":"cephfs.smithi077.oadrkb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6827/1829655283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1829655283},{"type":"v1","addr":"172.21.15.77:6827","nonce":1829655283}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34406,"name":"cephfs.smithi077.gcfygj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6829/702451557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":702451557},{"type":"v1","addr":"172.21.15.77:6829","nonce":702451557}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:06:10.008979+0000","modified":"2024-04-25T02:18:31.259306+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24269":{"gid":24269,"name":"cephfs.smithi112.fjnadi","rank":0,"incarnation":21,"state":"up:replay","state_seq":2,"addr":"172.21.15.112:6827/2036319817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2036319817},{"type":"v1","addr":"172.21.15.112:6827","nonce":2036319817}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T02:21:12.625 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-04-25T02:21:12.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.624+0000 7f3458b5d640 1 -- 172.21.15.77:0/2148501833 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f344006e0b0 msgr2=0x7f3440070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:12.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.624+0000 7f3458b5d640 1 --2- 172.21.15.77:0/2148501833 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f344006e0b0 0x7f3440070560 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3444007fd0 tx=0x7f3444009e90 comp rx=0 tx=0).stop 2024-04-25T02:21:12.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.624+0000 7f3458b5d640 1 -- 172.21.15.77:0/2148501833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3454102bd0 msgr2=0x7f3454113290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:12.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.624+0000 7f3458b5d640 1 --2- 172.21.15.77:0/2148501833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3454102bd0 0x7f3454113290 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f343c02bda0 tx=0x7f343c009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:12.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.624+0000 7f3458b5d640 1 -- 172.21.15.77:0/2148501833 shutdown_connections 2024-04-25T02:21:12.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.624+0000 7f3458b5d640 1 --2- 172.21.15.77:0/2148501833 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f344006e0b0 0x7f3440070560 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:12.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.624+0000 7f3458b5d640 1 --2- 172.21.15.77:0/2148501833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3454102bd0 0x7f3454113290 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:12.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.624+0000 7f3458b5d640 1 --2- 172.21.15.77:0/2148501833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3454102230 0x7f3454112d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:12.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.624+0000 7f3458b5d640 1 -- 172.21.15.77:0/2148501833 >> 172.21.15.77:0/2148501833 conn(0x7f34540717e0 msgr2=0x7f34540fa220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:12.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.624+0000 7f3458b5d640 1 -- 172.21.15.77:0/2148501833 shutdown_connections 2024-04-25T02:21:12.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.624+0000 7f3458b5d640 1 -- 172.21.15.77:0/2148501833 wait complete. 2024-04-25T02:21:12.638 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-04-25T02:21:12.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.729+0000 7f1a9ed1d640 1 -- 172.21.15.77:0/4138437523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a98101170 msgr2=0x7f1a98101540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:12.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.729+0000 7f1a9ed1d640 1 --2- 172.21.15.77:0/4138437523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a98101170 0x7f1a98101540 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1a880048d0 tx=0x7f1a88009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:12.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.730+0000 7f1a9ed1d640 1 -- 172.21.15.77:0/4138437523 shutdown_connections 2024-04-25T02:21:12.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.730+0000 7f1a9ed1d640 1 --2- 172.21.15.77:0/4138437523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a980fb150 0x7f1a980fb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:12.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.730+0000 7f1a9ed1d640 1 --2- 172.21.15.77:0/4138437523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a98101170 0x7f1a98101540 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:12.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.730+0000 7f1a9ed1d640 1 -- 172.21.15.77:0/4138437523 >> 172.21.15.77:0/4138437523 conn(0x7f1a98071fd0 msgr2=0x7f1a980723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:12.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.730+0000 7f1a9ed1d640 1 -- 172.21.15.77:0/4138437523 shutdown_connections 2024-04-25T02:21:12.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.730+0000 7f1a9ed1d640 1 -- 172.21.15.77:0/4138437523 wait complete. 2024-04-25T02:21:12.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.730+0000 7f1a9ed1d640 1 Processor -- start 2024-04-25T02:21:12.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.730+0000 7f1a9ed1d640 1 -- start start 2024-04-25T02:21:12.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.730+0000 7f1a9ed1d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a980fb150 0x7f1a9810de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:12.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.730+0000 7f1a9ed1d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a98101170 0x7f1a9810e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:12.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.730+0000 7f1a9ed1d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a98065310 con 0x7f1a98101170 2024-04-25T02:21:12.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.730+0000 7f1a9ed1d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9810e8c0 con 0x7f1a980fb150 2024-04-25T02:21:12.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.730+0000 7f1a97fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a98101170 0x7f1a9810e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:12.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.731+0000 7f1a97fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a98101170 0x7f1a9810e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39316/0 (socket says 172.21.15.77:39316) 2024-04-25T02:21:12.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.731+0000 7f1a97fff640 1 -- 172.21.15.77:0/4044068989 learned_addr learned my addr 172.21.15.77:0/4044068989 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:12.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.731+0000 7f1a9cab9640 1 --2- 172.21.15.77:0/4044068989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a980fb150 0x7f1a9810de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:12.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.731+0000 7f1a97fff640 1 -- 172.21.15.77:0/4044068989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a980fb150 msgr2=0x7f1a9810de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:12.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.731+0000 7f1a97fff640 1 --2- 172.21.15.77:0/4044068989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a980fb150 0x7f1a9810de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:12.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.731+0000 7f1a97fff640 1 -- 172.21.15.77:0/4044068989 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a88005040 con 0x7f1a98101170 2024-04-25T02:21:12.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.731+0000 7f1a97fff640 1 --2- 172.21.15.77:0/4044068989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a98101170 0x7f1a9810e350 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c00c830 tx=0x7f1a8c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:12.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.731+0000 7f1a957fa640 1 -- 172.21.15.77:0/4044068989 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a8c00a850 con 0x7f1a98101170 2024-04-25T02:21:12.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.731+0000 7f1a9ed1d640 1 -- 172.21.15.77:0/4044068989 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a9810eba0 con 0x7f1a98101170 2024-04-25T02:21:12.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.731+0000 7f1a957fa640 1 -- 172.21.15.77:0/4044068989 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1a8c00ae80 con 0x7f1a98101170 2024-04-25T02:21:12.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.731+0000 7f1a957fa640 1 -- 172.21.15.77:0/4044068989 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a8c012ea0 con 0x7f1a98101170 2024-04-25T02:21:12.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.731+0000 7f1a9ed1d640 1 -- 172.21.15.77:0/4044068989 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a98117130 con 0x7f1a98101170 2024-04-25T02:21:12.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.732+0000 7f1a9ed1d640 1 -- 172.21.15.77:0/4044068989 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a980fc870 con 0x7f1a98101170 2024-04-25T02:21:12.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.733+0000 7f1a957fa640 1 -- 172.21.15.77:0/4044068989 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1a8c012400 con 0x7f1a98101170 2024-04-25T02:21:12.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.733+0000 7f1a957fa640 1 --2- 172.21.15.77:0/4044068989 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f1a8006e0b0 0x7f1a80070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:12.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.733+0000 7f1a957fa640 1 -- 172.21.15.77:0/4044068989 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f1a8c08ddb0 con 0x7f1a98101170 2024-04-25T02:21:12.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.733+0000 7f1a9cab9640 1 --2- 172.21.15.77:0/4044068989 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f1a8006e0b0 0x7f1a80070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:12.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.734+0000 7f1a9cab9640 1 --2- 172.21.15.77:0/4044068989 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f1a8006e0b0 0x7f1a80070560 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1a88000c00 tx=0x7f1a88009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:12.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.738+0000 7f1a957fa640 1 -- 172.21.15.77:0/4044068989 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f1a8c057160 con 0x7f1a98101170 2024-04-25T02:21:12.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.948+0000 7f1a9ed1d640 1 -- 172.21.15.77:0/4044068989 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f1a98063f00 con 0x7f1a98101170 2024-04-25T02:21:12.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.949+0000 7f1a957fa640 1 -- 172.21.15.77:0/4044068989 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v31) v1 ==== 107+0+5069 (secure 0 0 0) 0x7f1a8c0126b0 con 0x7f1a98101170 2024-04-25T02:21:12.952 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:21:12.952 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34374,"name":"cephfs.smithi077.oadrkb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6827/1829655283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1829655283},{"type":"v1","addr":"172.21.15.77:6827","nonce":1829655283}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34406,"name":"cephfs.smithi077.gcfygj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6829/702451557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":702451557},{"type":"v1","addr":"172.21.15.77:6829","nonce":702451557}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44303,"name":"cephfs.smithi112.dvwudt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6825/1388779321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1388779321},{"type":"v1","addr":"172.21.15.112:6825","nonce":1388779321}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:06:10.008979+0000","modified":"2024-04-25T02:18:39.253938+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24269":{"gid":24269,"name":"cephfs.smithi112.fjnadi","rank":0,"incarnation":21,"state":"up:reconnect","state_seq":185,"addr":"172.21.15.112:6827/2036319817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2036319817},{"type":"v1","addr":"172.21.15.112:6827","nonce":2036319817}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T02:21:12.953 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 22 2024-04-25T02:21:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.951+0000 7f1a9ed1d640 1 -- 172.21.15.77:0/4044068989 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f1a8006e0b0 msgr2=0x7f1a80070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.951+0000 7f1a9ed1d640 1 --2- 172.21.15.77:0/4044068989 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f1a8006e0b0 0x7f1a80070560 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1a88000c00 tx=0x7f1a88009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.951+0000 7f1a9ed1d640 1 -- 172.21.15.77:0/4044068989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a98101170 msgr2=0x7f1a9810e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.951+0000 7f1a9ed1d640 1 --2- 172.21.15.77:0/4044068989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a98101170 0x7f1a9810e350 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c00c830 tx=0x7f1a8c004430 comp rx=0 tx=0).stop 2024-04-25T02:21:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.951+0000 7f1a9ed1d640 1 -- 172.21.15.77:0/4044068989 shutdown_connections 2024-04-25T02:21:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.951+0000 7f1a9ed1d640 1 --2- 172.21.15.77:0/4044068989 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f1a8006e0b0 0x7f1a80070560 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.951+0000 7f1a9ed1d640 1 --2- 172.21.15.77:0/4044068989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a98101170 0x7f1a9810e350 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.951+0000 7f1a9ed1d640 1 --2- 172.21.15.77:0/4044068989 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a980fb150 0x7f1a9810de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.951+0000 7f1a9ed1d640 1 -- 172.21.15.77:0/4044068989 >> 172.21.15.77:0/4044068989 conn(0x7f1a98071fd0 msgr2=0x7f1a980fa2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.951+0000 7f1a9ed1d640 1 -- 172.21.15.77:0/4044068989 shutdown_connections 2024-04-25T02:21:12.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:12.951+0000 7f1a9ed1d640 1 -- 172.21.15.77:0/4044068989 wait complete. 2024-04-25T02:21:12.966 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-04-25T02:21:13.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.057+0000 7fd54739d640 1 -- 172.21.15.77:0/529486853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5401021e0 msgr2=0x7fd5401025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:13.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.057+0000 7fd54739d640 1 --2- 172.21.15.77:0/529486853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5401021e0 0x7fd5401025b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd5380048d0 tx=0x7fd538009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:13.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.057+0000 7fd54739d640 1 -- 172.21.15.77:0/529486853 shutdown_connections 2024-04-25T02:21:13.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.057+0000 7fd54739d640 1 --2- 172.21.15.77:0/529486853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd540102b80 0x7fd5400fc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:13.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.057+0000 7fd54739d640 1 --2- 172.21.15.77:0/529486853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5401021e0 0x7fd5401025b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:13.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.057+0000 7fd54739d640 1 -- 172.21.15.77:0/529486853 >> 172.21.15.77:0/529486853 conn(0x7fd5400f7db0 msgr2=0x7fd5400fa1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:13.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.057+0000 7fd54739d640 1 -- 172.21.15.77:0/529486853 shutdown_connections 2024-04-25T02:21:13.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.057+0000 7fd54739d640 1 -- 172.21.15.77:0/529486853 wait complete. 2024-04-25T02:21:13.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.058+0000 7fd54739d640 1 Processor -- start 2024-04-25T02:21:13.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.058+0000 7fd54739d640 1 -- start start 2024-04-25T02:21:13.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.058+0000 7fd54739d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5401021e0 0x7fd54006f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:13.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.058+0000 7fd54739d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd540102b80 0x7fd54006fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:13.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.058+0000 7fd54739d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd540071600 con 0x7fd540102b80 2024-04-25T02:21:13.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.058+0000 7fd54739d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd540071770 con 0x7fd5401021e0 2024-04-25T02:21:13.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.058+0000 7fd544938640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd540102b80 0x7fd54006fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:13.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.058+0000 7fd544938640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd540102b80 0x7fd54006fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39334/0 (socket says 172.21.15.77:39334) 2024-04-25T02:21:13.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.058+0000 7fd544938640 1 -- 172.21.15.77:0/1246882027 learned_addr learned my addr 172.21.15.77:0/1246882027 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:13.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.058+0000 7fd545139640 1 --2- 172.21.15.77:0/1246882027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5401021e0 0x7fd54006f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:13.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.058+0000 7fd544938640 1 -- 172.21.15.77:0/1246882027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5401021e0 msgr2=0x7fd54006f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:13.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.058+0000 7fd544938640 1 --2- 172.21.15.77:0/1246882027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5401021e0 0x7fd54006f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:13.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.058+0000 7fd544938640 1 -- 172.21.15.77:0/1246882027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd538005040 con 0x7fd540102b80 2024-04-25T02:21:13.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.059+0000 7fd544938640 1 --2- 172.21.15.77:0/1246882027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd540102b80 0x7fd54006fcb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd53400c830 tx=0x7fd534004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:13.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.059+0000 7fd53dffb640 1 -- 172.21.15.77:0/1246882027 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd53400a850 con 0x7fd540102b80 2024-04-25T02:21:13.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.059+0000 7fd54739d640 1 -- 172.21.15.77:0/1246882027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd540070390 con 0x7fd540102b80 2024-04-25T02:21:13.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.059+0000 7fd53dffb640 1 -- 172.21.15.77:0/1246882027 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd53400ae80 con 0x7fd540102b80 2024-04-25T02:21:13.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.059+0000 7fd53dffb640 1 -- 172.21.15.77:0/1246882027 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd534012ea0 con 0x7fd540102b80 2024-04-25T02:21:13.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.059+0000 7fd54739d640 1 -- 172.21.15.77:0/1246882027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd540119330 con 0x7fd540102b80 2024-04-25T02:21:13.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.060+0000 7fd54739d640 1 -- 172.21.15.77:0/1246882027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5400fd950 con 0x7fd540102b80 2024-04-25T02:21:13.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.060+0000 7fd53dffb640 1 -- 172.21.15.77:0/1246882027 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd534012400 con 0x7fd540102b80 2024-04-25T02:21:13.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.061+0000 7fd53dffb640 1 --2- 172.21.15.77:0/1246882027 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd52806e0b0 0x7fd528070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:13.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.061+0000 7fd53dffb640 1 -- 172.21.15.77:0/1246882027 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd53408dd00 con 0x7fd540102b80 2024-04-25T02:21:13.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.061+0000 7fd545139640 1 --2- 172.21.15.77:0/1246882027 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd52806e0b0 0x7fd528070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:13.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.061+0000 7fd545139640 1 --2- 172.21.15.77:0/1246882027 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd52806e0b0 0x7fd528070560 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd538003080 tx=0x7fd538009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:13.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.065+0000 7fd53dffb640 1 -- 172.21.15.77:0/1246882027 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fd5340570b0 con 0x7fd540102b80 2024-04-25T02:21:13.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:12 smithi077 ceph-mon[110441]: pgmap v271: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:21:13.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:12 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/315118411' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-04-25T02:21:13.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:12 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/3260962820' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-04-25T02:21:13.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:12 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/2148501833' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-04-25T02:21:13.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:12 smithi112 ceph-mon[80494]: pgmap v271: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:21:13.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:12 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/315118411' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-04-25T02:21:13.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:12 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/3260962820' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-04-25T02:21:13.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:12 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/2148501833' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-04-25T02:21:13.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.288+0000 7fd54739d640 1 -- 172.21.15.77:0/1246882027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7fd540064350 con 0x7fd540102b80 2024-04-25T02:21:13.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.288+0000 7fd53dffb640 1 -- 172.21.15.77:0/1246882027 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v31) v1 ==== 107+0+5066 (secure 0 0 0) 0x7fd5340126b0 con 0x7fd540102b80 2024-04-25T02:21:13.292 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:21:13.292 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34374,"name":"cephfs.smithi077.oadrkb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6827/1829655283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1829655283},{"type":"v1","addr":"172.21.15.77:6827","nonce":1829655283}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34406,"name":"cephfs.smithi077.gcfygj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6829/702451557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":702451557},{"type":"v1","addr":"172.21.15.77:6829","nonce":702451557}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44303,"name":"cephfs.smithi112.dvwudt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6825/1388779321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1388779321},{"type":"v1","addr":"172.21.15.112:6825","nonce":1388779321}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:06:10.008979+0000","modified":"2024-04-25T02:18:39.846442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24269":{"gid":24269,"name":"cephfs.smithi112.fjnadi","rank":0,"incarnation":21,"state":"up:rejoin","state_seq":186,"addr":"172.21.15.112:6827/2036319817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2036319817},{"type":"v1","addr":"172.21.15.112:6827","nonce":2036319817}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T02:21:13.292 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 23 2024-04-25T02:21:13.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.290+0000 7fd54739d640 1 -- 172.21.15.77:0/1246882027 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd52806e0b0 msgr2=0x7fd528070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:13.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.290+0000 7fd54739d640 1 --2- 172.21.15.77:0/1246882027 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd52806e0b0 0x7fd528070560 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd538003080 tx=0x7fd538009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:13.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.290+0000 7fd54739d640 1 -- 172.21.15.77:0/1246882027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd540102b80 msgr2=0x7fd54006fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:13.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.290+0000 7fd54739d640 1 --2- 172.21.15.77:0/1246882027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd540102b80 0x7fd54006fcb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd53400c830 tx=0x7fd534004430 comp rx=0 tx=0).stop 2024-04-25T02:21:13.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.290+0000 7fd54739d640 1 -- 172.21.15.77:0/1246882027 shutdown_connections 2024-04-25T02:21:13.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.290+0000 7fd54739d640 1 --2- 172.21.15.77:0/1246882027 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fd52806e0b0 0x7fd528070560 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:13.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.290+0000 7fd54739d640 1 --2- 172.21.15.77:0/1246882027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd540102b80 0x7fd54006fcb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:13.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.290+0000 7fd54739d640 1 --2- 172.21.15.77:0/1246882027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5401021e0 0x7fd54006f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:13.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.290+0000 7fd54739d640 1 -- 172.21.15.77:0/1246882027 >> 172.21.15.77:0/1246882027 conn(0x7fd5400f7db0 msgr2=0x7fd5400f9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:13.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.291+0000 7fd54739d640 1 -- 172.21.15.77:0/1246882027 shutdown_connections 2024-04-25T02:21:13.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.291+0000 7fd54739d640 1 -- 172.21.15.77:0/1246882027 wait complete. 2024-04-25T02:21:13.305 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-04-25T02:21:13.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.399+0000 7f788e22e640 1 -- 172.21.15.77:0/397794844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78880fb150 msgr2=0x7f78880fb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.399+0000 7f788e22e640 1 --2- 172.21.15.77:0/397794844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78880fb150 0x7f78880fb5c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f78780048d0 tx=0x7f7878009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.399+0000 7f788e22e640 1 -- 172.21.15.77:0/397794844 shutdown_connections 2024-04-25T02:21:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.399+0000 7f788e22e640 1 --2- 172.21.15.77:0/397794844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78880fb150 0x7f78880fb5c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.399+0000 7f788e22e640 1 --2- 172.21.15.77:0/397794844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7888101170 0x7f7888101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.399+0000 7f788e22e640 1 -- 172.21.15.77:0/397794844 >> 172.21.15.77:0/397794844 conn(0x7f7888071fd0 msgr2=0x7f78880723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.399+0000 7f788e22e640 1 -- 172.21.15.77:0/397794844 shutdown_connections 2024-04-25T02:21:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.399+0000 7f788e22e640 1 -- 172.21.15.77:0/397794844 wait complete. 2024-04-25T02:21:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.400+0000 7f788e22e640 1 Processor -- start 2024-04-25T02:21:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.400+0000 7f788e22e640 1 -- start start 2024-04-25T02:21:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.400+0000 7f788e22e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78880fb150 0x7f7888112c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.400+0000 7f788e22e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7888101170 0x7f78881131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.400+0000 7f788e22e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78881137b0 con 0x7f78880fb150 2024-04-25T02:21:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.400+0000 7f788e22e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788810ce00 con 0x7f7888101170 2024-04-25T02:21:13.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.401+0000 7f78877fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78880fb150 0x7f7888112c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:13.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.401+0000 7f78877fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78880fb150 0x7f7888112c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39358/0 (socket says 172.21.15.77:39358) 2024-04-25T02:21:13.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.401+0000 7f78877fe640 1 -- 172.21.15.77:0/3794630332 learned_addr learned my addr 172.21.15.77:0/3794630332 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:13.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.401+0000 7f7886ffd640 1 --2- 172.21.15.77:0/3794630332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7888101170 0x7f78881131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:13.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.401+0000 7f78877fe640 1 -- 172.21.15.77:0/3794630332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7888101170 msgr2=0x7f78881131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:13.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.401+0000 7f78877fe640 1 --2- 172.21.15.77:0/3794630332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7888101170 0x7f78881131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:13.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.401+0000 7f78877fe640 1 -- 172.21.15.77:0/3794630332 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7878005040 con 0x7f78880fb150 2024-04-25T02:21:13.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.401+0000 7f78877fe640 1 --2- 172.21.15.77:0/3794630332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78880fb150 0x7f7888112c70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f787c00eb70 tx=0x7f787c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:13.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.401+0000 7f786ffff640 1 -- 172.21.15.77:0/3794630332 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f787c007c30 con 0x7f78880fb150 2024-04-25T02:21:13.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.401+0000 7f788e22e640 1 -- 172.21.15.77:0/3794630332 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f788810d080 con 0x7f78880fb150 2024-04-25T02:21:13.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.401+0000 7f786ffff640 1 -- 172.21.15.77:0/3794630332 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f787c00f040 con 0x7f78880fb150 2024-04-25T02:21:13.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.401+0000 7f786ffff640 1 -- 172.21.15.77:0/3794630332 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f787c0095b0 con 0x7f78880fb150 2024-04-25T02:21:13.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.401+0000 7f788e22e640 1 -- 172.21.15.77:0/3794630332 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f788810d570 con 0x7f78880fb150 2024-04-25T02:21:13.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.402+0000 7f788e22e640 1 -- 172.21.15.77:0/3794630332 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78880fc870 con 0x7f78880fb150 2024-04-25T02:21:13.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.403+0000 7f786ffff640 1 -- 172.21.15.77:0/3794630332 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f787c009730 con 0x7f78880fb150 2024-04-25T02:21:13.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.404+0000 7f786ffff640 1 --2- 172.21.15.77:0/3794630332 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f787006e0b0 0x7f7870070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:13.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.404+0000 7f786ffff640 1 -- 172.21.15.77:0/3794630332 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f787c08d870 con 0x7f78880fb150 2024-04-25T02:21:13.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.404+0000 7f7886ffd640 1 --2- 172.21.15.77:0/3794630332 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f787006e0b0 0x7f7870070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:13.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.404+0000 7f7886ffd640 1 --2- 172.21.15.77:0/3794630332 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f787006e0b0 0x7f7870070560 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f78880f9430 tx=0x7f7878009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:13.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.409+0000 7f786ffff640 1 -- 172.21.15.77:0/3794630332 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f787c056c50 con 0x7f78880fb150 2024-04-25T02:21:13.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.633+0000 7f788e22e640 1 -- 172.21.15.77:0/3794630332 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f788810e2e0 con 0x7f78880fb150 2024-04-25T02:21:13.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.634+0000 7f786ffff640 1 -- 172.21.15.77:0/3794630332 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v31) v1 ==== 107+0+5075 (secure 0 0 0) 0x7f787c05a310 con 0x7f78880fb150 2024-04-25T02:21:13.637 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:21:13.637 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34374,"name":"cephfs.smithi077.oadrkb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6827/1829655283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1829655283},{"type":"v1","addr":"172.21.15.77:6827","nonce":1829655283}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34406,"name":"cephfs.smithi077.gcfygj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6829/702451557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":702451557},{"type":"v1","addr":"172.21.15.77:6829","nonce":702451557}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44303,"name":"cephfs.smithi112.dvwudt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6825/1388779321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1388779321},{"type":"v1","addr":"172.21.15.112:6825","nonce":1388779321}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:06:10.008979+0000","modified":"2024-04-25T02:18:41.846217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24269":{"gid":24269,"name":"cephfs.smithi112.fjnadi","rank":0,"incarnation":21,"state":"up:active","state_seq":187,"addr":"172.21.15.112:6827/2036319817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":2036319817},{"type":"v1","addr":"172.21.15.112:6827","nonce":2036319817}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24269,"qdb_cluster":[24269]},"id":1}]} 2024-04-25T02:21:13.637 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 24 2024-04-25T02:21:13.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.636+0000 7f788e22e640 1 -- 172.21.15.77:0/3794630332 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f787006e0b0 msgr2=0x7f7870070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:13.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.636+0000 7f788e22e640 1 --2- 172.21.15.77:0/3794630332 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f787006e0b0 0x7f7870070560 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f78880f9430 tx=0x7f7878009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:13.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.636+0000 7f788e22e640 1 -- 172.21.15.77:0/3794630332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78880fb150 msgr2=0x7f7888112c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:13.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.636+0000 7f788e22e640 1 --2- 172.21.15.77:0/3794630332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78880fb150 0x7f7888112c70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f787c00eb70 tx=0x7f787c00b040 comp rx=0 tx=0).stop 2024-04-25T02:21:13.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.636+0000 7f788e22e640 1 -- 172.21.15.77:0/3794630332 shutdown_connections 2024-04-25T02:21:13.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.636+0000 7f788e22e640 1 --2- 172.21.15.77:0/3794630332 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f787006e0b0 0x7f7870070560 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:13.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.636+0000 7f788e22e640 1 --2- 172.21.15.77:0/3794630332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7888101170 0x7f78881131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:13.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.636+0000 7f788e22e640 1 --2- 172.21.15.77:0/3794630332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78880fb150 0x7f7888112c70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:13.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.636+0000 7f788e22e640 1 -- 172.21.15.77:0/3794630332 >> 172.21.15.77:0/3794630332 conn(0x7f7888071fd0 msgr2=0x7f78880646c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:13.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.636+0000 7f788e22e640 1 -- 172.21.15.77:0/3794630332 shutdown_connections 2024-04-25T02:21:13.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.636+0000 7f788e22e640 1 -- 172.21.15.77:0/3794630332 wait complete. 2024-04-25T02:21:13.650 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-04-25T02:21:13.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.753+0000 7f06f8d1d640 1 -- 172.21.15.77:0/530791254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06f4064390 msgr2=0x7f06f4064800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:13.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.753+0000 7f06f8d1d640 1 --2- 172.21.15.77:0/530791254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06f4064390 0x7f06f4064800 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f06e80048d0 tx=0x7f06e8009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:13.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.753+0000 7f06f8d1d640 1 -- 172.21.15.77:0/530791254 shutdown_connections 2024-04-25T02:21:13.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.753+0000 7f06f8d1d640 1 --2- 172.21.15.77:0/530791254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06f4064390 0x7f06f4064800 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:13.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.753+0000 7f06f8d1d640 1 --2- 172.21.15.77:0/530791254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06f4102270 0x7f06f4102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:13.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.753+0000 7f06f8d1d640 1 -- 172.21.15.77:0/530791254 >> 172.21.15.77:0/530791254 conn(0x7f06f4071fd0 msgr2=0x7f06f40723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:13.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.753+0000 7f06f8d1d640 1 -- 172.21.15.77:0/530791254 shutdown_connections 2024-04-25T02:21:13.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.753+0000 7f06f8d1d640 1 -- 172.21.15.77:0/530791254 wait complete. 2024-04-25T02:21:13.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.753+0000 7f06f8d1d640 1 Processor -- start 2024-04-25T02:21:13.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.753+0000 7f06f8d1d640 1 -- start start 2024-04-25T02:21:13.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.754+0000 7f06f8d1d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06f4064390 0x7f06f4112c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:13.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.754+0000 7f06f8d1d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06f4102270 0x7f06f41131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:13.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.754+0000 7f06f8d1d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f41137c0 con 0x7f06f4102270 2024-04-25T02:21:13.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.754+0000 7f06f8d1d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f410ce10 con 0x7f06f4064390 2024-04-25T02:21:13.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.754+0000 7f06f1d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06f4102270 0x7f06f41131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:13.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.754+0000 7f06f1d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06f4102270 0x7f06f41131c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39380/0 (socket says 172.21.15.77:39380) 2024-04-25T02:21:13.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.754+0000 7f06f1d9b640 1 -- 172.21.15.77:0/2020615691 learned_addr learned my addr 172.21.15.77:0/2020615691 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:13.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.754+0000 7f06f259c640 1 --2- 172.21.15.77:0/2020615691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06f4064390 0x7f06f4112c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:13.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.754+0000 7f06f1d9b640 1 -- 172.21.15.77:0/2020615691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06f4064390 msgr2=0x7f06f4112c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:13.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.754+0000 7f06f1d9b640 1 --2- 172.21.15.77:0/2020615691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06f4064390 0x7f06f4112c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:13.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.754+0000 7f06f1d9b640 1 -- 172.21.15.77:0/2020615691 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e8005040 con 0x7f06f4102270 2024-04-25T02:21:13.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.754+0000 7f06f1d9b640 1 --2- 172.21.15.77:0/2020615691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06f4102270 0x7f06f41131c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f06e8034040 tx=0x7f06e8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:13.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.754+0000 7f06e2ffd640 1 -- 172.21.15.77:0/2020615691 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06e80092b0 con 0x7f06f4102270 2024-04-25T02:21:13.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.754+0000 7f06f8d1d640 1 -- 172.21.15.77:0/2020615691 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f410d090 con 0x7f06f4102270 2024-04-25T02:21:13.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.754+0000 7f06e2ffd640 1 -- 172.21.15.77:0/2020615691 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f06e803b400 con 0x7f06f4102270 2024-04-25T02:21:13.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.754+0000 7f06e2ffd640 1 -- 172.21.15.77:0/2020615691 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06e80435d0 con 0x7f06f4102270 2024-04-25T02:21:13.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.754+0000 7f06f8d1d640 1 -- 172.21.15.77:0/2020615691 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f410d550 con 0x7f06f4102270 2024-04-25T02:21:13.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.755+0000 7f06f8d1d640 1 -- 172.21.15.77:0/2020615691 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f40fd970 con 0x7f06f4102270 2024-04-25T02:21:13.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.756+0000 7f06e2ffd640 1 -- 172.21.15.77:0/2020615691 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f06e802f070 con 0x7f06f4102270 2024-04-25T02:21:13.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.756+0000 7f06e2ffd640 1 --2- 172.21.15.77:0/2020615691 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f06dc06e0b0 0x7f06dc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:13.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.756+0000 7f06e2ffd640 1 -- 172.21.15.77:0/2020615691 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f06e80af830 con 0x7f06f4102270 2024-04-25T02:21:13.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.756+0000 7f06f259c640 1 --2- 172.21.15.77:0/2020615691 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f06dc06e0b0 0x7f06dc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:13.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.757+0000 7f06f259c640 1 --2- 172.21.15.77:0/2020615691 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f06dc06e0b0 0x7f06dc070560 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009af0 tx=0x7f06e400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:13.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.761+0000 7f06e2ffd640 1 -- 172.21.15.77:0/2020615691 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f06e8078c10 con 0x7f06f4102270 2024-04-25T02:21:13.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.983+0000 7f06f8d1d640 1 -- 172.21.15.77:0/2020615691 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f06f41093a0 con 0x7f06f4102270 2024-04-25T02:21:13.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.983+0000 7f06e2ffd640 1 -- 172.21.15.77:0/2020615691 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v31) v1 ==== 107+0+4271 (secure 0 0 0) 0x7f06e807c2d0 con 0x7f06f4102270 2024-04-25T02:21:13.986 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:21:13.987 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34374,"name":"cephfs.smithi077.oadrkb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6827/1829655283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1829655283},{"type":"v1","addr":"172.21.15.77:6827","nonce":1829655283}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34406,"name":"cephfs.smithi077.gcfygj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6829/702451557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":702451557},{"type":"v1","addr":"172.21.15.77:6829","nonce":702451557}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44303,"name":"cephfs.smithi112.dvwudt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6825/1388779321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1388779321},{"type":"v1","addr":"172.21.15.112:6825","nonce":1388779321}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:06:10.008979+0000","modified":"2024-04-25T02:18:52.548692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T02:21:13.987 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 25 2024-04-25T02:21:13.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.985+0000 7f06f8d1d640 1 -- 172.21.15.77:0/2020615691 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f06dc06e0b0 msgr2=0x7f06dc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:13.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.985+0000 7f06f8d1d640 1 --2- 172.21.15.77:0/2020615691 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f06dc06e0b0 0x7f06dc070560 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009af0 tx=0x7f06e400b040 comp rx=0 tx=0).stop 2024-04-25T02:21:13.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.985+0000 7f06f8d1d640 1 -- 172.21.15.77:0/2020615691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06f4102270 msgr2=0x7f06f41131c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:13.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.985+0000 7f06f8d1d640 1 --2- 172.21.15.77:0/2020615691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06f4102270 0x7f06f41131c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f06e8034040 tx=0x7f06e8009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:13.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.985+0000 7f06f8d1d640 1 -- 172.21.15.77:0/2020615691 shutdown_connections 2024-04-25T02:21:13.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.985+0000 7f06f8d1d640 1 --2- 172.21.15.77:0/2020615691 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f06dc06e0b0 0x7f06dc070560 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:13.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.985+0000 7f06f8d1d640 1 --2- 172.21.15.77:0/2020615691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06f4102270 0x7f06f41131c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:13.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.985+0000 7f06f8d1d640 1 --2- 172.21.15.77:0/2020615691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06f4064390 0x7f06f4112c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:13.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.985+0000 7f06f8d1d640 1 -- 172.21.15.77:0/2020615691 >> 172.21.15.77:0/2020615691 conn(0x7f06f4071fd0 msgr2=0x7f06f40fa320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:13.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.985+0000 7f06f8d1d640 1 -- 172.21.15.77:0/2020615691 shutdown_connections 2024-04-25T02:21:13.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:13.985+0000 7f06f8d1d640 1 -- 172.21.15.77:0/2020615691 wait complete. 2024-04-25T02:21:14.000 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-04-25T02:21:14.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.094+0000 7f5d81a61640 1 -- 172.21.15.77:0/3616175124 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d7c102ba0 msgr2=0x7f5d7c0fc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:14.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.094+0000 7f5d81a61640 1 --2- 172.21.15.77:0/3616175124 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d7c102ba0 0x7f5d7c0fc230 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5d640048d0 tx=0x7f5d64009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:14.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.094+0000 7f5d81a61640 1 -- 172.21.15.77:0/3616175124 shutdown_connections 2024-04-25T02:21:14.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.094+0000 7f5d81a61640 1 --2- 172.21.15.77:0/3616175124 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d7c102ba0 0x7f5d7c0fc230 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:14.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.094+0000 7f5d81a61640 1 --2- 172.21.15.77:0/3616175124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d7c102200 0x7f5d7c1025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:14.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.094+0000 7f5d81a61640 1 -- 172.21.15.77:0/3616175124 >> 172.21.15.77:0/3616175124 conn(0x7f5d7c0f7e10 msgr2=0x7f5d7c0fa220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:14.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.095+0000 7f5d81a61640 1 -- 172.21.15.77:0/3616175124 shutdown_connections 2024-04-25T02:21:14.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.095+0000 7f5d81a61640 1 -- 172.21.15.77:0/3616175124 wait complete. 2024-04-25T02:21:14.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.095+0000 7f5d81a61640 1 Processor -- start 2024-04-25T02:21:14.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.095+0000 7f5d81a61640 1 -- start start 2024-04-25T02:21:14.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.095+0000 7f5d81a61640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d7c102200 0x7f5d7c06f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:14.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.095+0000 7f5d81a61640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d7c102ba0 0x7f5d7c06fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:14.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.095+0000 7f5d81a61640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c071600 con 0x7f5d7c102200 2024-04-25T02:21:14.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.095+0000 7f5d81a61640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c071770 con 0x7f5d7c102ba0 2024-04-25T02:21:14.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.095+0000 7f5d7affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d7c102200 0x7f5d7c06f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:14.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.095+0000 7f5d7affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d7c102200 0x7f5d7c06f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39404/0 (socket says 172.21.15.77:39404) 2024-04-25T02:21:14.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.095+0000 7f5d7affd640 1 -- 172.21.15.77:0/618073011 learned_addr learned my addr 172.21.15.77:0/618073011 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:14.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.096+0000 7f5d7a7fc640 1 --2- 172.21.15.77:0/618073011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d7c102ba0 0x7f5d7c06fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:14.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.096+0000 7f5d7affd640 1 -- 172.21.15.77:0/618073011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d7c102ba0 msgr2=0x7f5d7c06fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:14.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.096+0000 7f5d7affd640 1 --2- 172.21.15.77:0/618073011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d7c102ba0 0x7f5d7c06fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:14.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.096+0000 7f5d7affd640 1 -- 172.21.15.77:0/618073011 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d64005040 con 0x7f5d7c102200 2024-04-25T02:21:14.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.096+0000 7f5d7affd640 1 --2- 172.21.15.77:0/618073011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d7c102200 0x7f5d7c06f770 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5d7400ece0 tx=0x7f5d7400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:14.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.096+0000 7f5d737fe640 1 -- 172.21.15.77:0/618073011 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d7400ee40 con 0x7f5d7c102200 2024-04-25T02:21:14.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.096+0000 7f5d81a61640 1 -- 172.21.15.77:0/618073011 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d7c070390 con 0x7f5d7c102200 2024-04-25T02:21:14.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.096+0000 7f5d737fe640 1 -- 172.21.15.77:0/618073011 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5d7400f040 con 0x7f5d7c102200 2024-04-25T02:21:14.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.096+0000 7f5d737fe640 1 -- 172.21.15.77:0/618073011 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d74009750 con 0x7f5d7c102200 2024-04-25T02:21:14.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.096+0000 7f5d81a61640 1 -- 172.21.15.77:0/618073011 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d7c119370 con 0x7f5d7c102200 2024-04-25T02:21:14.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.097+0000 7f5d81a61640 1 -- 172.21.15.77:0/618073011 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d7c0fd970 con 0x7f5d7c102200 2024-04-25T02:21:14.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.098+0000 7f5d737fe640 1 -- 172.21.15.77:0/618073011 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5d74007890 con 0x7f5d7c102200 2024-04-25T02:21:14.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.098+0000 7f5d737fe640 1 --2- 172.21.15.77:0/618073011 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5d6806e0b0 0x7f5d68070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:14.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.098+0000 7f5d737fe640 1 -- 172.21.15.77:0/618073011 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f5d7408e300 con 0x7f5d7c102200 2024-04-25T02:21:14.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.098+0000 7f5d7a7fc640 1 --2- 172.21.15.77:0/618073011 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5d6806e0b0 0x7f5d68070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:14.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.098+0000 7f5d7a7fc640 1 --2- 172.21.15.77:0/618073011 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5d6806e0b0 0x7f5d68070560 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c070e50 tx=0x7f5d64009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:14.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.103+0000 7f5d737fe640 1 -- 172.21.15.77:0/618073011 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f5d74057630 con 0x7f5d7c102200 2024-04-25T02:21:14.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:13 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/4044068989' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-04-25T02:21:14.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:13 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:21:14.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:13 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/1246882027' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-04-25T02:21:14.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:13 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:21:14.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:13 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:21:14.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:13 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/3794630332' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-04-25T02:21:14.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:13 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/4044068989' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-04-25T02:21:14.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:13 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:21:14.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:13 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/1246882027' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-04-25T02:21:14.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:13 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:21:14.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:13 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:21:14.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:13 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/3794630332' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-04-25T02:21:14.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.326+0000 7f5d81a61640 1 -- 172.21.15.77:0/618073011 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f5d7c104640 con 0x7f5d7c102200 2024-04-25T02:21:14.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.327+0000 7f5d737fe640 1 -- 172.21.15.77:0/618073011 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v31) v1 ==== 107+0+4350 (secure 0 0 0) 0x7f5d7405acf0 con 0x7f5d7c102200 2024-04-25T02:21:14.330 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:21:14.331 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34406,"name":"cephfs.smithi077.gcfygj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6829/702451557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":702451557},{"type":"v1","addr":"172.21.15.77:6829","nonce":702451557}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44303,"name":"cephfs.smithi112.dvwudt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6825/1388779321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1388779321},{"type":"v1","addr":"172.21.15.112:6825","nonce":1388779321}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:06:10.008979+0000","modified":"2024-04-25T02:18:52.555896+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34374":{"gid":34374,"name":"cephfs.smithi077.oadrkb","rank":0,"incarnation":26,"state":"up:replay","state_seq":1,"addr":"172.21.15.77:6827/1829655283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1829655283},{"type":"v1","addr":"172.21.15.77:6827","nonce":1829655283}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T02:21:14.331 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 26 2024-04-25T02:21:14.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.329+0000 7f5d81a61640 1 -- 172.21.15.77:0/618073011 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5d6806e0b0 msgr2=0x7f5d68070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:14.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.329+0000 7f5d81a61640 1 --2- 172.21.15.77:0/618073011 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5d6806e0b0 0x7f5d68070560 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c070e50 tx=0x7f5d64009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:14.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.329+0000 7f5d81a61640 1 -- 172.21.15.77:0/618073011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d7c102200 msgr2=0x7f5d7c06f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:14.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.329+0000 7f5d81a61640 1 --2- 172.21.15.77:0/618073011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d7c102200 0x7f5d7c06f770 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5d7400ece0 tx=0x7f5d7400b040 comp rx=0 tx=0).stop 2024-04-25T02:21:14.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.329+0000 7f5d81a61640 1 -- 172.21.15.77:0/618073011 shutdown_connections 2024-04-25T02:21:14.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.329+0000 7f5d81a61640 1 --2- 172.21.15.77:0/618073011 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f5d6806e0b0 0x7f5d68070560 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:14.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.329+0000 7f5d81a61640 1 --2- 172.21.15.77:0/618073011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d7c102ba0 0x7f5d7c06fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:14.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.329+0000 7f5d81a61640 1 --2- 172.21.15.77:0/618073011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d7c102200 0x7f5d7c06f770 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:14.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.329+0000 7f5d81a61640 1 -- 172.21.15.77:0/618073011 >> 172.21.15.77:0/618073011 conn(0x7f5d7c0f7e10 msgr2=0x7f5d7c0f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:14.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.329+0000 7f5d81a61640 1 -- 172.21.15.77:0/618073011 shutdown_connections 2024-04-25T02:21:14.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.329+0000 7f5d81a61640 1 -- 172.21.15.77:0/618073011 wait complete. 2024-04-25T02:21:14.343 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-04-25T02:21:14.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.435+0000 7f743e310640 1 -- 172.21.15.77:0/1569295509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74380fd190 msgr2=0x7f74380fd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:14.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.435+0000 7f743e310640 1 --2- 172.21.15.77:0/1569295509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74380fd190 0x7f74380fd560 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f74280048d0 tx=0x7f7428009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:14.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.435+0000 7f743e310640 1 -- 172.21.15.77:0/1569295509 shutdown_connections 2024-04-25T02:21:14.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.435+0000 7f743e310640 1 --2- 172.21.15.77:0/1569295509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74380fdb30 0x7f7438106170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:14.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.435+0000 7f743e310640 1 --2- 172.21.15.77:0/1569295509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74380fd190 0x7f74380fd560 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:14.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.435+0000 7f743e310640 1 -- 172.21.15.77:0/1569295509 >> 172.21.15.77:0/1569295509 conn(0x7f74380f6be0 msgr2=0x7f74380f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:14.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.435+0000 7f743e310640 1 -- 172.21.15.77:0/1569295509 shutdown_connections 2024-04-25T02:21:14.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.435+0000 7f743e310640 1 -- 172.21.15.77:0/1569295509 wait complete. 2024-04-25T02:21:14.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.436+0000 7f743e310640 1 Processor -- start 2024-04-25T02:21:14.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.436+0000 7f743e310640 1 -- start start 2024-04-25T02:21:14.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.436+0000 7f743e310640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74380fd190 0x7f7438112ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:14.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.436+0000 7f743e310640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74380fdb30 0x7f7438113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:14.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.436+0000 7f743e310640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7438113820 con 0x7f74380fdb30 2024-04-25T02:21:14.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.436+0000 7f743e310640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743810ce70 con 0x7f74380fd190 2024-04-25T02:21:14.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.436+0000 7f74377fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74380fdb30 0x7f7438113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:14.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.436+0000 7f74377fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74380fdb30 0x7f7438113220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39428/0 (socket says 172.21.15.77:39428) 2024-04-25T02:21:14.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.436+0000 7f74377fe640 1 -- 172.21.15.77:0/2402366669 learned_addr learned my addr 172.21.15.77:0/2402366669 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:14.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.436+0000 7f7437fff640 1 --2- 172.21.15.77:0/2402366669 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74380fd190 0x7f7438112ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:14.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.436+0000 7f74377fe640 1 -- 172.21.15.77:0/2402366669 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74380fd190 msgr2=0x7f7438112ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:14.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.436+0000 7f74377fe640 1 --2- 172.21.15.77:0/2402366669 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74380fd190 0x7f7438112ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:14.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.436+0000 7f74377fe640 1 -- 172.21.15.77:0/2402366669 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7428005040 con 0x7f74380fdb30 2024-04-25T02:21:14.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.437+0000 7f74377fe640 1 --2- 172.21.15.77:0/2402366669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74380fdb30 0x7f7438113220 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f742c00c810 tx=0x7f742c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:14.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.437+0000 7f7434ff9640 1 -- 172.21.15.77:0/2402366669 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f742c00a820 con 0x7f74380fdb30 2024-04-25T02:21:14.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.437+0000 7f7434ff9640 1 -- 172.21.15.77:0/2402366669 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f742c00ae50 con 0x7f74380fdb30 2024-04-25T02:21:14.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.437+0000 7f743e310640 1 -- 172.21.15.77:0/2402366669 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743810d150 con 0x7f74380fdb30 2024-04-25T02:21:14.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.437+0000 7f7434ff9640 1 -- 172.21.15.77:0/2402366669 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f742c0115c0 con 0x7f74380fdb30 2024-04-25T02:21:14.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.437+0000 7f743e310640 1 -- 172.21.15.77:0/2402366669 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743810d670 con 0x7f74380fdb30 2024-04-25T02:21:14.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.438+0000 7f743e310640 1 -- 172.21.15.77:0/2402366669 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7438066060 con 0x7f74380fdb30 2024-04-25T02:21:14.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.438+0000 7f7434ff9640 1 -- 172.21.15.77:0/2402366669 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f742c00a980 con 0x7f74380fdb30 2024-04-25T02:21:14.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.438+0000 7f7434ff9640 1 --2- 172.21.15.77:0/2402366669 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f742006e0b0 0x7f7420070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:14.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.439+0000 7f7434ff9640 1 -- 172.21.15.77:0/2402366669 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f742c08e0b0 con 0x7f74380fdb30 2024-04-25T02:21:14.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.439+0000 7f7437fff640 1 --2- 172.21.15.77:0/2402366669 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f742006e0b0 0x7f7420070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:14.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.439+0000 7f7437fff640 1 --2- 172.21.15.77:0/2402366669 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f742006e0b0 0x7f7420070560 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7428031870 tx=0x7f7428009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:14.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.443+0000 7f7434ff9640 1 -- 172.21.15.77:0/2402366669 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f742c0573e0 con 0x7f74380fdb30 2024-04-25T02:21:14.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.655+0000 7f743e310640 1 -- 172.21.15.77:0/2402366669 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f74381092d0 con 0x7f74380fdb30 2024-04-25T02:21:14.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.656+0000 7f7434ff9640 1 -- 172.21.15.77:0/2402366669 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v31) v1 ==== 107+0+4354 (secure 0 0 0) 0x7f742c05aaa0 con 0x7f74380fdb30 2024-04-25T02:21:14.662 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:21:14.663 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34406,"name":"cephfs.smithi077.gcfygj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6829/702451557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":702451557},{"type":"v1","addr":"172.21.15.77:6829","nonce":702451557}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44303,"name":"cephfs.smithi112.dvwudt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6825/1388779321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1388779321},{"type":"v1","addr":"172.21.15.112:6825","nonce":1388779321}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:06:10.008979+0000","modified":"2024-04-25T02:19:00.467216+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34374":{"gid":34374,"name":"cephfs.smithi077.oadrkb","rank":0,"incarnation":26,"state":"up:reconnect","state_seq":17,"addr":"172.21.15.77:6827/1829655283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1829655283},{"type":"v1","addr":"172.21.15.77:6827","nonce":1829655283}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T02:21:14.664 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 27 2024-04-25T02:21:14.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.658+0000 7f743e310640 1 -- 172.21.15.77:0/2402366669 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f742006e0b0 msgr2=0x7f7420070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:14.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.658+0000 7f743e310640 1 --2- 172.21.15.77:0/2402366669 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f742006e0b0 0x7f7420070560 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7428031870 tx=0x7f7428009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:14.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.658+0000 7f743e310640 1 -- 172.21.15.77:0/2402366669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74380fdb30 msgr2=0x7f7438113220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:14.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.658+0000 7f743e310640 1 --2- 172.21.15.77:0/2402366669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74380fdb30 0x7f7438113220 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f742c00c810 tx=0x7f742c0043c0 comp rx=0 tx=0).stop 2024-04-25T02:21:14.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.658+0000 7f743e310640 1 -- 172.21.15.77:0/2402366669 shutdown_connections 2024-04-25T02:21:14.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.658+0000 7f743e310640 1 --2- 172.21.15.77:0/2402366669 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f742006e0b0 0x7f7420070560 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:14.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.658+0000 7f743e310640 1 --2- 172.21.15.77:0/2402366669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74380fdb30 0x7f7438113220 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:14.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.658+0000 7f743e310640 1 --2- 172.21.15.77:0/2402366669 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74380fd190 0x7f7438112ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:14.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.658+0000 7f743e310640 1 -- 172.21.15.77:0/2402366669 >> 172.21.15.77:0/2402366669 conn(0x7f74380f6be0 msgr2=0x7f74380f8020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:14.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.658+0000 7f743e310640 1 -- 172.21.15.77:0/2402366669 shutdown_connections 2024-04-25T02:21:14.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.658+0000 7f743e310640 1 -- 172.21.15.77:0/2402366669 wait complete. 2024-04-25T02:21:14.672 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-04-25T02:21:14.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.763+0000 7f88e362e640 1 -- 172.21.15.77:0/3060271392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88dc102b40 msgr2=0x7f88dc0fc1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:14.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.763+0000 7f88e362e640 1 --2- 172.21.15.77:0/3060271392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88dc102b40 0x7f88dc0fc1d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0048d0 tx=0x7f88cc009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:14.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.763+0000 7f88e362e640 1 -- 172.21.15.77:0/3060271392 shutdown_connections 2024-04-25T02:21:14.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.763+0000 7f88e362e640 1 --2- 172.21.15.77:0/3060271392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88dc102b40 0x7f88dc0fc1d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:14.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.763+0000 7f88e362e640 1 --2- 172.21.15.77:0/3060271392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88dc1021a0 0x7f88dc102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:14.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.763+0000 7f88e362e640 1 -- 172.21.15.77:0/3060271392 >> 172.21.15.77:0/3060271392 conn(0x7f88dc0f7d30 msgr2=0x7f88dc0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:14.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.763+0000 7f88e362e640 1 -- 172.21.15.77:0/3060271392 shutdown_connections 2024-04-25T02:21:14.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.764+0000 7f88e362e640 1 -- 172.21.15.77:0/3060271392 wait complete. 2024-04-25T02:21:14.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.764+0000 7f88e362e640 1 Processor -- start 2024-04-25T02:21:14.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.764+0000 7f88e362e640 1 -- start start 2024-04-25T02:21:14.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.764+0000 7f88e362e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88dc1021a0 0x7f88dc112cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:14.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.764+0000 7f88e362e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88dc102b40 0x7f88dc113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:14.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.764+0000 7f88e362e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc113830 con 0x7f88dc102b40 2024-04-25T02:21:14.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.764+0000 7f88e362e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc10ce80 con 0x7f88dc1021a0 2024-04-25T02:21:14.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.764+0000 7f88e0bc9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88dc102b40 0x7f88dc113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:14.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.764+0000 7f88e0bc9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88dc102b40 0x7f88dc113230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39452/0 (socket says 172.21.15.77:39452) 2024-04-25T02:21:14.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.764+0000 7f88e0bc9640 1 -- 172.21.15.77:0/3503233993 learned_addr learned my addr 172.21.15.77:0/3503233993 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:14.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.765+0000 7f88e13ca640 1 --2- 172.21.15.77:0/3503233993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88dc1021a0 0x7f88dc112cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:14.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.765+0000 7f88e0bc9640 1 -- 172.21.15.77:0/3503233993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88dc1021a0 msgr2=0x7f88dc112cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:14.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.765+0000 7f88e0bc9640 1 --2- 172.21.15.77:0/3503233993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88dc1021a0 0x7f88dc112cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:14.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.765+0000 7f88e0bc9640 1 -- 172.21.15.77:0/3503233993 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88cc005040 con 0x7f88dc102b40 2024-04-25T02:21:14.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.765+0000 7f88e13ca640 1 --2- 172.21.15.77:0/3503233993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88dc1021a0 0x7f88dc112cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:21:14.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.765+0000 7f88e0bc9640 1 --2- 172.21.15.77:0/3503233993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88dc102b40 0x7f88dc113230 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f88cc004930 tx=0x7f88cc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:14.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.765+0000 7f88d1ffb640 1 -- 172.21.15.77:0/3503233993 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88cc0094c0 con 0x7f88dc102b40 2024-04-25T02:21:14.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.765+0000 7f88d1ffb640 1 -- 172.21.15.77:0/3503233993 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f88cc032e50 con 0x7f88dc102b40 2024-04-25T02:21:14.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.765+0000 7f88d1ffb640 1 -- 172.21.15.77:0/3503233993 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88cc0433b0 con 0x7f88dc102b40 2024-04-25T02:21:14.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.765+0000 7f88e362e640 1 -- 172.21.15.77:0/3503233993 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88dc10d100 con 0x7f88dc102b40 2024-04-25T02:21:14.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.765+0000 7f88e362e640 1 -- 172.21.15.77:0/3503233993 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88dc10d5c0 con 0x7f88dc102b40 2024-04-25T02:21:14.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.766+0000 7f88e362e640 1 -- 172.21.15.77:0/3503233993 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88dc0fd910 con 0x7f88dc102b40 2024-04-25T02:21:14.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.767+0000 7f88d1ffb640 1 -- 172.21.15.77:0/3503233993 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f88cc02f070 con 0x7f88dc102b40 2024-04-25T02:21:14.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.767+0000 7f88d1ffb640 1 --2- 172.21.15.77:0/3503233993 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f88c806e0b0 0x7f88c8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:14.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.767+0000 7f88e13ca640 1 --2- 172.21.15.77:0/3503233993 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f88c806e0b0 0x7f88c8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:14.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.767+0000 7f88d1ffb640 1 -- 172.21.15.77:0/3503233993 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f88cc0af960 con 0x7f88dc102b40 2024-04-25T02:21:14.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.768+0000 7f88e13ca640 1 --2- 172.21.15.77:0/3503233993 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f88c806e0b0 0x7f88c8070560 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f88d8007ee0 tx=0x7f88d800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:14.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.772+0000 7f88d1ffb640 1 -- 172.21.15.77:0/3503233993 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f88cc078c90 con 0x7f88dc102b40 2024-04-25T02:21:14.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.983+0000 7f88e362e640 1 -- 172.21.15.77:0/3503233993 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f88dc109300 con 0x7f88dc102b40 2024-04-25T02:21:14.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.984+0000 7f88d1ffb640 1 -- 172.21.15.77:0/3503233993 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v31) v1 ==== 107+0+4351 (secure 0 0 0) 0x7f88cc07c350 con 0x7f88dc102b40 2024-04-25T02:21:14.987 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:21:14.987 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34406,"name":"cephfs.smithi077.gcfygj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6829/702451557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":702451557},{"type":"v1","addr":"172.21.15.77:6829","nonce":702451557}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44303,"name":"cephfs.smithi112.dvwudt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6825/1388779321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1388779321},{"type":"v1","addr":"172.21.15.112:6825","nonce":1388779321}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:06:10.008979+0000","modified":"2024-04-25T02:19:00.881533+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34374":{"gid":34374,"name":"cephfs.smithi077.oadrkb","rank":0,"incarnation":26,"state":"up:rejoin","state_seq":18,"addr":"172.21.15.77:6827/1829655283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1829655283},{"type":"v1","addr":"172.21.15.77:6827","nonce":1829655283}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T02:21:14.988 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 28 2024-04-25T02:21:14.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.986+0000 7f88e362e640 1 -- 172.21.15.77:0/3503233993 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f88c806e0b0 msgr2=0x7f88c8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:14.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.986+0000 7f88e362e640 1 --2- 172.21.15.77:0/3503233993 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f88c806e0b0 0x7f88c8070560 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f88d8007ee0 tx=0x7f88d800b040 comp rx=0 tx=0).stop 2024-04-25T02:21:14.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.986+0000 7f88e362e640 1 -- 172.21.15.77:0/3503233993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88dc102b40 msgr2=0x7f88dc113230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:14.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.986+0000 7f88e362e640 1 --2- 172.21.15.77:0/3503233993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88dc102b40 0x7f88dc113230 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f88cc004930 tx=0x7f88cc009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:14.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.986+0000 7f88e362e640 1 -- 172.21.15.77:0/3503233993 shutdown_connections 2024-04-25T02:21:14.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.986+0000 7f88e362e640 1 --2- 172.21.15.77:0/3503233993 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f88c806e0b0 0x7f88c8070560 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:14.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.986+0000 7f88e362e640 1 --2- 172.21.15.77:0/3503233993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88dc102b40 0x7f88dc113230 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:14.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.986+0000 7f88e362e640 1 --2- 172.21.15.77:0/3503233993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88dc1021a0 0x7f88dc112cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:14.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.986+0000 7f88e362e640 1 -- 172.21.15.77:0/3503233993 >> 172.21.15.77:0/3503233993 conn(0x7f88dc0f7d30 msgr2=0x7f88dc0f8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:14.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.986+0000 7f88e362e640 1 -- 172.21.15.77:0/3503233993 shutdown_connections 2024-04-25T02:21:14.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:14.986+0000 7f88e362e640 1 -- 172.21.15.77:0/3503233993 wait complete. 2024-04-25T02:21:15.000 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-04-25T02:21:15.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.091+0000 7f6e30e2e640 1 -- 172.21.15.77:0/1489733341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e2c102b80 msgr2=0x7f6e2c0fc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:15.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.091+0000 7f6e30e2e640 1 --2- 172.21.15.77:0/1489733341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e2c102b80 0x7f6e2c0fc210 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6e140048d0 tx=0x7f6e14009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:15.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.091+0000 7f6e30e2e640 1 -- 172.21.15.77:0/1489733341 shutdown_connections 2024-04-25T02:21:15.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.091+0000 7f6e30e2e640 1 --2- 172.21.15.77:0/1489733341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e2c102b80 0x7f6e2c0fc210 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:15.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.091+0000 7f6e30e2e640 1 --2- 172.21.15.77:0/1489733341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e2c1021e0 0x7f6e2c1025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:15.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.091+0000 7f6e30e2e640 1 -- 172.21.15.77:0/1489733341 >> 172.21.15.77:0/1489733341 conn(0x7f6e2c0f7db0 msgr2=0x7f6e2c0fa1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:15.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.091+0000 7f6e30e2e640 1 -- 172.21.15.77:0/1489733341 shutdown_connections 2024-04-25T02:21:15.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.091+0000 7f6e30e2e640 1 -- 172.21.15.77:0/1489733341 wait complete. 2024-04-25T02:21:15.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.091+0000 7f6e30e2e640 1 Processor -- start 2024-04-25T02:21:15.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.091+0000 7f6e30e2e640 1 -- start start 2024-04-25T02:21:15.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.092+0000 7f6e30e2e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e2c1021e0 0x7f6e2c112c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:15.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.092+0000 7f6e30e2e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e2c102b80 0x7f6e2c1131a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:15.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.092+0000 7f6e30e2e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c1137a0 con 0x7f6e2c102b80 2024-04-25T02:21:15.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.092+0000 7f6e30e2e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c10cdf0 con 0x7f6e2c1021e0 2024-04-25T02:21:15.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.092+0000 7f6e23fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e2c102b80 0x7f6e2c1131a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:15.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.092+0000 7f6e23fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e2c102b80 0x7f6e2c1131a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39482/0 (socket says 172.21.15.77:39482) 2024-04-25T02:21:15.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.092+0000 7f6e23fff640 1 -- 172.21.15.77:0/1716547597 learned_addr learned my addr 172.21.15.77:0/1716547597 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:15.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.092+0000 7f6e23fff640 1 -- 172.21.15.77:0/1716547597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e2c1021e0 msgr2=0x7f6e2c112c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:15.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.092+0000 7f6e23fff640 1 --2- 172.21.15.77:0/1716547597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e2c1021e0 0x7f6e2c112c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:15.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.092+0000 7f6e23fff640 1 -- 172.21.15.77:0/1716547597 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e14005040 con 0x7f6e2c102b80 2024-04-25T02:21:15.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.092+0000 7f6e23fff640 1 --2- 172.21.15.77:0/1716547597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e2c102b80 0x7f6e2c1131a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6e14004930 tx=0x7f6e14009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:15.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.092+0000 7f6e22ffd640 1 -- 172.21.15.77:0/1716547597 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e140094c0 con 0x7f6e2c102b80 2024-04-25T02:21:15.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.092+0000 7f6e22ffd640 1 -- 172.21.15.77:0/1716547597 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6e14032e50 con 0x7f6e2c102b80 2024-04-25T02:21:15.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.092+0000 7f6e30e2e640 1 -- 172.21.15.77:0/1716547597 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e2c10d070 con 0x7f6e2c102b80 2024-04-25T02:21:15.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.092+0000 7f6e22ffd640 1 -- 172.21.15.77:0/1716547597 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e140433b0 con 0x7f6e2c102b80 2024-04-25T02:21:15.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.092+0000 7f6e30e2e640 1 -- 172.21.15.77:0/1716547597 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e2c10d530 con 0x7f6e2c102b80 2024-04-25T02:21:15.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.093+0000 7f6e30e2e640 1 -- 172.21.15.77:0/1716547597 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e2c0fd950 con 0x7f6e2c102b80 2024-04-25T02:21:15.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.094+0000 7f6e22ffd640 1 -- 172.21.15.77:0/1716547597 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6e1402f070 con 0x7f6e2c102b80 2024-04-25T02:21:15.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.094+0000 7f6e22ffd640 1 --2- 172.21.15.77:0/1716547597 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f6e1806e0b0 0x7f6e18070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:15.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.094+0000 7f6e22ffd640 1 -- 172.21.15.77:0/1716547597 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f6e140afb90 con 0x7f6e2c102b80 2024-04-25T02:21:15.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.094+0000 7f6e2a59c640 1 --2- 172.21.15.77:0/1716547597 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f6e1806e0b0 0x7f6e18070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:15.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.095+0000 7f6e2a59c640 1 --2- 172.21.15.77:0/1716547597 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f6e1806e0b0 0x7f6e18070560 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c004a50 tx=0x7f6e1c007cb0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:15.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.099+0000 7f6e22ffd640 1 -- 172.21.15.77:0/1716547597 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f6e14078ec0 con 0x7f6e2c102b80 2024-04-25T02:21:15.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:14 smithi077 ceph-mon[110441]: pgmap v272: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:21:15.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:14 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/2020615691' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-04-25T02:21:15.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:14 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:21:15.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:14 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:21:15.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:14 smithi077 ceph-mon[110441]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:21:15.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:14 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/618073011' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-04-25T02:21:15.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:14 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/2402366669' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-04-25T02:21:15.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:14 smithi112 ceph-mon[80494]: pgmap v272: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:21:15.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:14 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/2020615691' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-04-25T02:21:15.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:14 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:21:15.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:14 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:21:15.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:14 smithi112 ceph-mon[80494]: from='mgr.34104 172.21.15.77:0/2432373476' entity='mgr.smithi077.zpflzp' 2024-04-25T02:21:15.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:14 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/618073011' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-04-25T02:21:15.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:14 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/2402366669' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-04-25T02:21:15.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.308+0000 7f6e30e2e640 1 -- 172.21.15.77:0/1716547597 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f6e2c064300 con 0x7f6e2c102b80 2024-04-25T02:21:15.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.309+0000 7f6e22ffd640 1 -- 172.21.15.77:0/1716547597 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v31) v1 ==== 107+0+4360 (secure 0 0 0) 0x7f6e1407c580 con 0x7f6e2c102b80 2024-04-25T02:21:15.312 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:21:15.312 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34406,"name":"cephfs.smithi077.gcfygj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6829/702451557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":702451557},{"type":"v1","addr":"172.21.15.77:6829","nonce":702451557}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44303,"name":"cephfs.smithi112.dvwudt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6825/1388779321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1388779321},{"type":"v1","addr":"172.21.15.112:6825","nonce":1388779321}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:06:10.008979+0000","modified":"2024-04-25T02:19:02.886301+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34374":{"gid":34374,"name":"cephfs.smithi077.oadrkb","rank":0,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.77:6827/1829655283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1829655283},{"type":"v1","addr":"172.21.15.77:6827","nonce":1829655283}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34374,"qdb_cluster":[34374]},"id":1}]} 2024-04-25T02:21:15.312 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 29 2024-04-25T02:21:15.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.311+0000 7f6e30e2e640 1 -- 172.21.15.77:0/1716547597 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f6e1806e0b0 msgr2=0x7f6e18070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:15.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.311+0000 7f6e30e2e640 1 --2- 172.21.15.77:0/1716547597 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f6e1806e0b0 0x7f6e18070560 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c004a50 tx=0x7f6e1c007cb0 comp rx=0 tx=0).stop 2024-04-25T02:21:15.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.311+0000 7f6e30e2e640 1 -- 172.21.15.77:0/1716547597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e2c102b80 msgr2=0x7f6e2c1131a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:15.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.311+0000 7f6e30e2e640 1 --2- 172.21.15.77:0/1716547597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e2c102b80 0x7f6e2c1131a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6e14004930 tx=0x7f6e14009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:15.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.311+0000 7f6e30e2e640 1 -- 172.21.15.77:0/1716547597 shutdown_connections 2024-04-25T02:21:15.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.311+0000 7f6e30e2e640 1 --2- 172.21.15.77:0/1716547597 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f6e1806e0b0 0x7f6e18070560 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:15.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.311+0000 7f6e30e2e640 1 --2- 172.21.15.77:0/1716547597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e2c102b80 0x7f6e2c1131a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:15.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.311+0000 7f6e30e2e640 1 --2- 172.21.15.77:0/1716547597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e2c1021e0 0x7f6e2c112c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:15.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.311+0000 7f6e30e2e640 1 -- 172.21.15.77:0/1716547597 >> 172.21.15.77:0/1716547597 conn(0x7f6e2c0f7db0 msgr2=0x7f6e2c0f9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:15.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.311+0000 7f6e30e2e640 1 -- 172.21.15.77:0/1716547597 shutdown_connections 2024-04-25T02:21:15.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.311+0000 7f6e30e2e640 1 -- 172.21.15.77:0/1716547597 wait complete. 2024-04-25T02:21:15.325 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-04-25T02:21:15.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.416+0000 7f513199d640 1 -- 172.21.15.77:0/3073621597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f512c0fb150 msgr2=0x7f512c0fb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:15.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.416+0000 7f513199d640 1 --2- 172.21.15.77:0/3073621597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f512c0fb150 0x7f512c0fb5c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f51200048d0 tx=0x7f5120009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:15.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.416+0000 7f513199d640 1 -- 172.21.15.77:0/3073621597 shutdown_connections 2024-04-25T02:21:15.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.416+0000 7f513199d640 1 --2- 172.21.15.77:0/3073621597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f512c0fb150 0x7f512c0fb5c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:15.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.416+0000 7f513199d640 1 --2- 172.21.15.77:0/3073621597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f512c101170 0x7f512c101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:15.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.416+0000 7f513199d640 1 -- 172.21.15.77:0/3073621597 >> 172.21.15.77:0/3073621597 conn(0x7f512c071fd0 msgr2=0x7f512c0723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:15.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.416+0000 7f513199d640 1 -- 172.21.15.77:0/3073621597 shutdown_connections 2024-04-25T02:21:15.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.416+0000 7f513199d640 1 -- 172.21.15.77:0/3073621597 wait complete. 2024-04-25T02:21:15.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.417+0000 7f513199d640 1 Processor -- start 2024-04-25T02:21:15.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.417+0000 7f513199d640 1 -- start start 2024-04-25T02:21:15.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.417+0000 7f513199d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f512c0fb150 0x7f512c10de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:15.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.417+0000 7f513199d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f512c101170 0x7f512c10e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:15.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.417+0000 7f513199d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c0652f0 con 0x7f512c0fb150 2024-04-25T02:21:15.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.417+0000 7f513199d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c10e8d0 con 0x7f512c101170 2024-04-25T02:21:15.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.417+0000 7f512affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f512c0fb150 0x7f512c10de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:15.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.417+0000 7f512affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f512c0fb150 0x7f512c10de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39492/0 (socket says 172.21.15.77:39492) 2024-04-25T02:21:15.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.417+0000 7f512affd640 1 -- 172.21.15.77:0/1182714494 learned_addr learned my addr 172.21.15.77:0/1182714494 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:15.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.418+0000 7f512a7fc640 1 --2- 172.21.15.77:0/1182714494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f512c101170 0x7f512c10e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:15.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.418+0000 7f512affd640 1 -- 172.21.15.77:0/1182714494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f512c101170 msgr2=0x7f512c10e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:15.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.418+0000 7f512affd640 1 --2- 172.21.15.77:0/1182714494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f512c101170 0x7f512c10e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:15.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.418+0000 7f512affd640 1 -- 172.21.15.77:0/1182714494 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5120005040 con 0x7f512c0fb150 2024-04-25T02:21:15.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.418+0000 7f512a7fc640 1 --2- 172.21.15.77:0/1182714494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f512c101170 0x7f512c10e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:21:15.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.418+0000 7f512affd640 1 --2- 172.21.15.77:0/1182714494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f512c0fb150 0x7f512c10de50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f511c00db00 tx=0x7f511c004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:15.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.418+0000 7f51137fe640 1 -- 172.21.15.77:0/1182714494 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f511c017070 con 0x7f512c0fb150 2024-04-25T02:21:15.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.418+0000 7f51137fe640 1 -- 172.21.15.77:0/1182714494 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f511c00f040 con 0x7f512c0fb150 2024-04-25T02:21:15.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.418+0000 7f51137fe640 1 -- 172.21.15.77:0/1182714494 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f511c003ae0 con 0x7f512c0fb150 2024-04-25T02:21:15.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.418+0000 7f513199d640 1 -- 172.21.15.77:0/1182714494 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512c10ebb0 con 0x7f512c0fb150 2024-04-25T02:21:15.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.418+0000 7f513199d640 1 -- 172.21.15.77:0/1182714494 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512c117170 con 0x7f512c0fb150 2024-04-25T02:21:15.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.419+0000 7f513199d640 1 -- 172.21.15.77:0/1182714494 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f512c0fc870 con 0x7f512c0fb150 2024-04-25T02:21:15.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.419+0000 7f51137fe640 1 -- 172.21.15.77:0/1182714494 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f511c003c40 con 0x7f512c0fb150 2024-04-25T02:21:15.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.420+0000 7f51137fe640 1 --2- 172.21.15.77:0/1182714494 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f511406e0b0 0x7f5114070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:15.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.420+0000 7f51137fe640 1 -- 172.21.15.77:0/1182714494 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f511c08dcd0 con 0x7f512c0fb150 2024-04-25T02:21:15.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.420+0000 7f512a7fc640 1 --2- 172.21.15.77:0/1182714494 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f511406e0b0 0x7f5114070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:15.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.420+0000 7f512a7fc640 1 --2- 172.21.15.77:0/1182714494 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f511406e0b0 0x7f5114070560 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5120000c00 tx=0x7f5120009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:15.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.424+0000 7f51137fe640 1 -- 172.21.15.77:0/1182714494 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f511c057000 con 0x7f512c0fb150 2024-04-25T02:21:15.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.636+0000 7f513199d640 1 -- 172.21.15.77:0/1182714494 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f512c0fe3a0 con 0x7f512c0fb150 2024-04-25T02:21:15.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.637+0000 7f51137fe640 1 -- 172.21.15.77:0/1182714494 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v31) v1 ==== 107+0+5210 (secure 0 0 0) 0x7f511c05a6c0 con 0x7f512c0fb150 2024-04-25T02:21:15.640 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:21:15.641 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34406,"name":"cephfs.smithi077.gcfygj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6829/702451557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":702451557},{"type":"v1","addr":"172.21.15.77:6829","nonce":702451557}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44303,"name":"cephfs.smithi112.dvwudt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6825/1388779321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1388779321},{"type":"v1","addr":"172.21.15.112:6825","nonce":1388779321}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44307,"name":"cephfs.smithi112.fjnadi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6827/1789386749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":1789386749},{"type":"v1","addr":"172.21.15.112:6827","nonce":1789386749}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:06:10.008979+0000","modified":"2024-04-25T02:19:02.886301+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34374":{"gid":34374,"name":"cephfs.smithi077.oadrkb","rank":0,"incarnation":26,"state":"up:active","state_seq":19,"addr":"172.21.15.77:6827/1829655283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1829655283},{"type":"v1","addr":"172.21.15.77:6827","nonce":1829655283}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34374,"qdb_cluster":[34374]},"id":1}]} 2024-04-25T02:21:15.641 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 30 2024-04-25T02:21:15.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.639+0000 7f513199d640 1 -- 172.21.15.77:0/1182714494 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f511406e0b0 msgr2=0x7f5114070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:15.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.639+0000 7f513199d640 1 --2- 172.21.15.77:0/1182714494 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f511406e0b0 0x7f5114070560 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5120000c00 tx=0x7f5120009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:15.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.639+0000 7f513199d640 1 -- 172.21.15.77:0/1182714494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f512c0fb150 msgr2=0x7f512c10de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:15.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.639+0000 7f513199d640 1 --2- 172.21.15.77:0/1182714494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f512c0fb150 0x7f512c10de50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f511c00db00 tx=0x7f511c004e60 comp rx=0 tx=0).stop 2024-04-25T02:21:15.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.639+0000 7f513199d640 1 -- 172.21.15.77:0/1182714494 shutdown_connections 2024-04-25T02:21:15.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.639+0000 7f513199d640 1 --2- 172.21.15.77:0/1182714494 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f511406e0b0 0x7f5114070560 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:15.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.639+0000 7f513199d640 1 --2- 172.21.15.77:0/1182714494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f512c101170 0x7f512c10e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:15.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.639+0000 7f513199d640 1 --2- 172.21.15.77:0/1182714494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f512c0fb150 0x7f512c10de50 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:15.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.639+0000 7f513199d640 1 -- 172.21.15.77:0/1182714494 >> 172.21.15.77:0/1182714494 conn(0x7f512c071fd0 msgr2=0x7f512c0fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:15.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.639+0000 7f513199d640 1 -- 172.21.15.77:0/1182714494 shutdown_connections 2024-04-25T02:21:15.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.639+0000 7f513199d640 1 -- 172.21.15.77:0/1182714494 wait complete. 2024-04-25T02:21:15.654 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-25T02:21:15.664 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-25T02:21:15.665 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T02:21:15.665 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:21:15.681 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T02:21:15.681 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:21:15.737 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:21:15.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.869+0000 7fa319225640 1 -- 172.21.15.77:0/3437169101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa314101aa0 msgr2=0x7fa3140fb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:15.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.869+0000 7fa319225640 1 --2- 172.21.15.77:0/3437169101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa314101aa0 0x7fa3140fb160 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa308009c50 tx=0x7fa308004d10 comp rx=0 tx=0).stop 2024-04-25T02:21:15.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.869+0000 7fa319225640 1 -- 172.21.15.77:0/3437169101 shutdown_connections 2024-04-25T02:21:15.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.869+0000 7fa319225640 1 --2- 172.21.15.77:0/3437169101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa314101aa0 0x7fa3140fb160 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:15.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.869+0000 7fa319225640 1 --2- 172.21.15.77:0/3437169101 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa314101100 0x7fa3141014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:15.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.869+0000 7fa319225640 1 -- 172.21.15.77:0/3437169101 >> 172.21.15.77:0/3437169101 conn(0x7fa3140711c0 msgr2=0x7fa3140715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:15.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.869+0000 7fa319225640 1 -- 172.21.15.77:0/3437169101 shutdown_connections 2024-04-25T02:21:15.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.869+0000 7fa319225640 1 -- 172.21.15.77:0/3437169101 wait complete. 2024-04-25T02:21:15.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.870+0000 7fa319225640 1 Processor -- start 2024-04-25T02:21:15.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.870+0000 7fa319225640 1 -- start start 2024-04-25T02:21:15.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.870+0000 7fa319225640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa314101100 0x7fa31410df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:15.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.870+0000 7fa319225640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa314101aa0 0x7fa31410e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:15.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.870+0000 7fa319225640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3140652f0 con 0x7fa314101100 2024-04-25T02:21:15.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.870+0000 7fa319225640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31410e9f0 con 0x7fa314101aa0 2024-04-25T02:21:15.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.870+0000 7fa312d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa314101100 0x7fa31410df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:15.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.870+0000 7fa312d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa314101100 0x7fa31410df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39512/0 (socket says 172.21.15.77:39512) 2024-04-25T02:21:15.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.870+0000 7fa312d9d640 1 -- 172.21.15.77:0/3625508941 learned_addr learned my addr 172.21.15.77:0/3625508941 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:15.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.870+0000 7fa312d9d640 1 -- 172.21.15.77:0/3625508941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa314101aa0 msgr2=0x7fa31410e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:15.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.870+0000 7fa31259c640 1 --2- 172.21.15.77:0/3625508941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa314101aa0 0x7fa31410e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:15.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.870+0000 7fa312d9d640 1 --2- 172.21.15.77:0/3625508941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa314101aa0 0x7fa31410e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:15.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.870+0000 7fa312d9d640 1 -- 172.21.15.77:0/3625508941 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3080098b0 con 0x7fa314101100 2024-04-25T02:21:15.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.870+0000 7fa31259c640 1 --2- 172.21.15.77:0/3625508941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa314101aa0 0x7fa31410e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:21:15.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.871+0000 7fa312d9d640 1 --2- 172.21.15.77:0/3625508941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa314101100 0x7fa31410df70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa30c00c830 tx=0x7fa30c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:15.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.871+0000 7fa2fb7fe640 1 -- 172.21.15.77:0/3625508941 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa30c00a850 con 0x7fa314101100 2024-04-25T02:21:15.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.871+0000 7fa319225640 1 -- 172.21.15.77:0/3625508941 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa31410ecd0 con 0x7fa314101100 2024-04-25T02:21:15.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.871+0000 7fa2fb7fe640 1 -- 172.21.15.77:0/3625508941 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa30c00ae80 con 0x7fa314101100 2024-04-25T02:21:15.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.871+0000 7fa2fb7fe640 1 -- 172.21.15.77:0/3625508941 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa30c012ea0 con 0x7fa314101100 2024-04-25T02:21:15.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.871+0000 7fa319225640 1 -- 172.21.15.77:0/3625508941 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa314117290 con 0x7fa314101100 2024-04-25T02:21:15.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.872+0000 7fa319225640 1 -- 172.21.15.77:0/3625508941 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3140fc880 con 0x7fa314101100 2024-04-25T02:21:15.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.872+0000 7fa2fb7fe640 1 -- 172.21.15.77:0/3625508941 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa30c012400 con 0x7fa314101100 2024-04-25T02:21:15.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.873+0000 7fa2fb7fe640 1 --2- 172.21.15.77:0/3625508941 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fa2fc06e0b0 0x7fa2fc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:15.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.873+0000 7fa2fb7fe640 1 -- 172.21.15.77:0/3625508941 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa30c08dda0 con 0x7fa314101100 2024-04-25T02:21:15.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.873+0000 7fa31259c640 1 --2- 172.21.15.77:0/3625508941 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fa2fc06e0b0 0x7fa2fc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:15.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.873+0000 7fa31259c640 1 --2- 172.21.15.77:0/3625508941 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fa2fc06e0b0 0x7fa2fc070560 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa308000f80 tx=0x7fa30802e040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:15.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:15.877+0000 7fa2fb7fe640 1 -- 172.21.15.77:0/3625508941 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fa30c057150 con 0x7fa314101100 2024-04-25T02:21:16.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.058+0000 7fa319225640 1 -- 172.21.15.77:0/3625508941 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa31404bcc0 con 0x7fa314101100 2024-04-25T02:21:16.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.059+0000 7fa2fb7fe640 1 -- 172.21.15.77:0/3625508941 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16641 (secure 0 0 0) 0x7fa30c0126b0 con 0x7fa314101100 2024-04-25T02:21:16.063 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:21:16.063 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":84,"fsid":"4bb93d82-02a7-11ef-bc93-c7b262605968","created":"2024-04-25T01:59:22.235413+0000","modified":"2024-04-25T02:18:52.548455+0000","last_up_change":"2024-04-25T02:17:48.815266+0000","last_in_change":"2024-04-25T02:04:33.912973+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:03:38.692032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-25T02:06:08.304706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-25T02:06:09.237302+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1533372f-b1a5-4ec0-9524-9940f870d874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":79,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1934093025},{"type":"v1","addr":"172.21.15.77:6803","nonce":1934093025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1934093025},{"type":"v1","addr":"172.21.15.77:6805","nonce":1934093025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1934093025},{"type":"v1","addr":"172.21.15.77:6809","nonce":1934093025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1934093025},{"type":"v1","addr":"172.21.15.77:6807","nonce":1934093025}]},"public_addr":"172.21.15.77:6803/1934093025","cluster_addr":"172.21.15.77:6805/1934093025","heartbeat_back_addr":"172.21.15.77:6809/1934093025","heartbeat_front_addr":"172.21.15.77:6807/1934093025","state":["exists","up"]},{"osd":1,"uuid":"cb083b21-fd25-4ac4-bbde-6387c3253d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":59,"up_thru":79,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":79281053},{"type":"v1","addr":"172.21.15.77:6811","nonce":79281053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":79281053},{"type":"v1","addr":"172.21.15.77:6813","nonce":79281053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":79281053},{"type":"v1","addr":"172.21.15.77:6817","nonce":79281053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":79281053},{"type":"v1","addr":"172.21.15.77:6815","nonce":79281053}]},"public_addr":"172.21.15.77:6811/79281053","cluster_addr":"172.21.15.77:6813/79281053","heartbeat_back_addr":"172.21.15.77:6817/79281053","heartbeat_front_addr":"172.21.15.77:6815/79281053","state":["exists","up"]},{"osd":2,"uuid":"39b4553c-c1ed-489b-aead-210f38ac86b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":60,"up_from":64,"up_thru":79,"down_at":61,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3911834293},{"type":"v1","addr":"172.21.15.77:6819","nonce":3911834293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3911834293},{"type":"v1","addr":"172.21.15.77:6821","nonce":3911834293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3911834293},{"type":"v1","addr":"172.21.15.77:6825","nonce":3911834293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3911834293},{"type":"v1","addr":"172.21.15.77:6823","nonce":3911834293}]},"public_addr":"172.21.15.77:6819/3911834293","cluster_addr":"172.21.15.77:6821/3911834293","heartbeat_back_addr":"172.21.15.77:6825/3911834293","heartbeat_front_addr":"172.21.15.77:6823/3911834293","state":["exists","up"]},{"osd":3,"uuid":"addec0fa-80ee-465d-9d3e-c801d7bd9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":65,"up_from":69,"up_thru":79,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3463246852},{"type":"v1","addr":"172.21.15.112:6801","nonce":3463246852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3463246852},{"type":"v1","addr":"172.21.15.112:6803","nonce":3463246852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3463246852},{"type":"v1","addr":"172.21.15.112:6807","nonce":3463246852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3463246852},{"type":"v1","addr":"172.21.15.112:6805","nonce":3463246852}]},"public_addr":"172.21.15.112:6801/3463246852","cluster_addr":"172.21.15.112:6803/3463246852","heartbeat_back_addr":"172.21.15.112:6807/3463246852","heartbeat_front_addr":"172.21.15.112:6805/3463246852","state":["exists","up"]},{"osd":4,"uuid":"93465def-0617-4ba8-915a-b3ea85c8f6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":70,"up_from":74,"up_thru":79,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":1394902745},{"type":"v1","addr":"172.21.15.112:6809","nonce":1394902745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1394902745},{"type":"v1","addr":"172.21.15.112:6811","nonce":1394902745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1394902745},{"type":"v1","addr":"172.21.15.112:6815","nonce":1394902745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":1394902745},{"type":"v1","addr":"172.21.15.112:6813","nonce":1394902745}]},"public_addr":"172.21.15.112:6809/1394902745","cluster_addr":"172.21.15.112:6811/1394902745","heartbeat_back_addr":"172.21.15.112:6815/1394902745","heartbeat_front_addr":"172.21.15.112:6813/1394902745","state":["exists","up"]},{"osd":5,"uuid":"d3f693f5-324b-4a48-8f24-77e65c5f7f7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":75,"up_from":79,"up_thru":79,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1908468918},{"type":"v1","addr":"172.21.15.112:6817","nonce":1908468918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1908468918},{"type":"v1","addr":"172.21.15.112:6819","nonce":1908468918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1908468918},{"type":"v1","addr":"172.21.15.112:6823","nonce":1908468918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1908468918},{"type":"v1","addr":"172.21.15.112:6821","nonce":1908468918}]},"public_addr":"172.21.15.112:6817/1908468918","cluster_addr":"172.21.15.112:6819/1908468918","heartbeat_back_addr":"172.21.15.112:6823/1908468918","heartbeat_front_addr":"172.21.15.112:6821/1908468918","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:42.635624+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:10.189211+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:35.781710+0000","dead_epoch":60},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:59.250841+0000","dead_epoch":65},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:25.155356+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:51.315370+0000","dead_epoch":75}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6825/3687767796":"2024-04-26T02:18:31.253792+0000","172.21.15.77:0/1779967375":"2024-04-26T02:00:25.057598+0000","172.21.15.112:6826/2036319817":"2024-04-26T02:18:52.548426+0000","172.21.15.77:6800/859750200":"2024-04-26T02:00:25.057598+0000","172.21.15.112:0/1986353395":"2024-04-26T02:10:29.627481+0000","172.21.15.77:0/2265849210":"2024-04-26T02:00:25.057598+0000","172.21.15.77:0/2490024809":"2024-04-26T02:01:30.377936+0000","172.21.15.77:0/265498985":"2024-04-26T01:59:54.491478+0000","172.21.15.77:0/543110241":"2024-04-26T02:01:30.377936+0000","172.21.15.77:6826/4228767448":"2024-04-26T02:06:24.839959+0000","172.21.15.77:6801/310739264":"2024-04-26T02:09:17.638820+0000","172.21.15.77:6801/799251145":"2024-04-26T02:13:23.698232+0000","172.21.15.77:0/3184722826":"2024-04-26T02:01:30.377936+0000","172.21.15.77:6800/310739264":"2024-04-26T02:09:17.638820+0000","172.21.15.77:6801/839529497":"2024-04-26T01:59:54.491478+0000","172.21.15.77:0/2089066429":"2024-04-26T02:09:17.638820+0000","172.21.15.112:0/1265440623":"2024-04-26T02:10:29.627481+0000","172.21.15.77:0/1177720370":"2024-04-26T01:59:54.491478+0000","172.21.15.77:6800/2375514340":"2024-04-26T02:01:30.377936+0000","172.21.15.112:0/582855468":"2024-04-26T02:10:29.627481+0000","172.21.15.77:6801/859750200":"2024-04-26T02:00:25.057598+0000","172.21.15.77:0/2254838943":"2024-04-26T02:00:25.057598+0000","172.21.15.77:0/1743910051":"2024-04-26T01:59:54.491478+0000","172.21.15.112:6828/218023931":"2024-04-26T02:10:29.627481+0000","172.21.15.77:6800/839529497":"2024-04-26T01:59:54.491478+0000","172.21.15.77:0/863377592":"2024-04-26T02:09:17.638820+0000","172.21.15.77:6827/4228767448":"2024-04-26T02:06:24.839959+0000","172.21.15.77:6800/799251145":"2024-04-26T02:13:23.698232+0000","172.21.15.112:6827/2036319817":"2024-04-26T02:18:52.548426+0000","172.21.15.77:0/1802503387":"2024-04-26T02:09:17.638820+0000","172.21.15.77:6801/2375514340":"2024-04-26T02:01:30.377936+0000","172.21.15.77:0/910905261":"2024-04-26T02:13:23.698232+0000","172.21.15.112:0/1205122809":"2024-04-26T02:10:29.627481+0000","172.21.15.112:6829/218023931":"2024-04-26T02:10:29.627481+0000","172.21.15.77:0/2354945099":"2024-04-26T02:13:23.698232+0000","172.21.15.77:0/678203530":"2024-04-26T02:13:23.698232+0000","172.21.15.77:0/114993391":"2024-04-26T02:09:17.638820+0000","172.21.15.77:0/1864957324":"2024-04-26T02:13:23.698232+0000","172.21.15.112:6824/3687767796":"2024-04-26T02:18:31.253792+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:21:16.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.062+0000 7fa319225640 1 -- 172.21.15.77:0/3625508941 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fa2fc06e0b0 msgr2=0x7fa2fc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:16.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.062+0000 7fa319225640 1 --2- 172.21.15.77:0/3625508941 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fa2fc06e0b0 0x7fa2fc070560 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa308000f80 tx=0x7fa30802e040 comp rx=0 tx=0).stop 2024-04-25T02:21:16.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.062+0000 7fa319225640 1 -- 172.21.15.77:0/3625508941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa314101100 msgr2=0x7fa31410df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:16.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.062+0000 7fa319225640 1 --2- 172.21.15.77:0/3625508941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa314101100 0x7fa31410df70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa30c00c830 tx=0x7fa30c004430 comp rx=0 tx=0).stop 2024-04-25T02:21:16.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.062+0000 7fa319225640 1 -- 172.21.15.77:0/3625508941 shutdown_connections 2024-04-25T02:21:16.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.062+0000 7fa319225640 1 --2- 172.21.15.77:0/3625508941 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fa2fc06e0b0 0x7fa2fc070560 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:16.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.062+0000 7fa319225640 1 --2- 172.21.15.77:0/3625508941 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa314101aa0 0x7fa31410e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:16.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.062+0000 7fa319225640 1 --2- 172.21.15.77:0/3625508941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa314101100 0x7fa31410df70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:16.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.062+0000 7fa319225640 1 -- 172.21.15.77:0/3625508941 >> 172.21.15.77:0/3625508941 conn(0x7fa3140711c0 msgr2=0x7fa3140faaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:16.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.062+0000 7fa319225640 1 -- 172.21.15.77:0/3625508941 shutdown_connections 2024-04-25T02:21:16.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.062+0000 7fa319225640 1 -- 172.21.15.77:0/3625508941 wait complete. 2024-04-25T02:21:16.076 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:03:38.692032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-25T02:06:08.304706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-25T02:06:09.237302+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:21:16.077 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:21:16.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.170+0000 7f4c06d1d640 1 -- 172.21.15.77:0/1541739730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c00101a50 msgr2=0x7f4c000fb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:16.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.170+0000 7f4c06d1d640 1 --2- 172.21.15.77:0/1541739730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c00101a50 0x7f4c000fb0e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4bec0048d0 tx=0x7f4bec009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:16.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.170+0000 7f4c06d1d640 1 -- 172.21.15.77:0/1541739730 shutdown_connections 2024-04-25T02:21:16.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.170+0000 7f4c06d1d640 1 --2- 172.21.15.77:0/1541739730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c00101a50 0x7f4c000fb0e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:16.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.170+0000 7f4c06d1d640 1 --2- 172.21.15.77:0/1541739730 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c001010b0 0x7f4c00101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:16.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.170+0000 7f4c06d1d640 1 -- 172.21.15.77:0/1541739730 >> 172.21.15.77:0/1541739730 conn(0x7f4c000f6cc0 msgr2=0x7f4c000f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:16.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.170+0000 7f4c06d1d640 1 -- 172.21.15.77:0/1541739730 shutdown_connections 2024-04-25T02:21:16.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.170+0000 7f4c06d1d640 1 -- 172.21.15.77:0/1541739730 wait complete. 2024-04-25T02:21:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.170+0000 7f4c06d1d640 1 Processor -- start 2024-04-25T02:21:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.171+0000 7f4c06d1d640 1 -- start start 2024-04-25T02:21:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.171+0000 7f4c06d1d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c001010b0 0x7f4c00112cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.171+0000 7f4c06d1d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c00101a50 0x7f4c00113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.171+0000 7f4c06d1d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c00113810 con 0x7f4c00101a50 2024-04-25T02:21:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.171+0000 7f4c06d1d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0010ce60 con 0x7f4c001010b0 2024-04-25T02:21:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.171+0000 7f4bfffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c00101a50 0x7f4c00113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.171+0000 7f4bfffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c00101a50 0x7f4c00113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39534/0 (socket says 172.21.15.77:39534) 2024-04-25T02:21:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.171+0000 7f4bfffff640 1 -- 172.21.15.77:0/2348173951 learned_addr learned my addr 172.21.15.77:0/2348173951 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.171+0000 7f4c04ab9640 1 --2- 172.21.15.77:0/2348173951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c001010b0 0x7f4c00112cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.171+0000 7f4bfffff640 1 -- 172.21.15.77:0/2348173951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c001010b0 msgr2=0x7f4c00112cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.171+0000 7f4bfffff640 1 --2- 172.21.15.77:0/2348173951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c001010b0 0x7f4c00112cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.171+0000 7f4bfffff640 1 -- 172.21.15.77:0/2348173951 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec005040 con 0x7f4c00101a50 2024-04-25T02:21:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.171+0000 7f4bfffff640 1 --2- 172.21.15.77:0/2348173951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c00101a50 0x7f4c00113210 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4bec004930 tx=0x7f4bec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.172+0000 7f4bfd7fa640 1 -- 172.21.15.77:0/2348173951 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bec0094c0 con 0x7f4c00101a50 2024-04-25T02:21:16.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.172+0000 7f4c06d1d640 1 -- 172.21.15.77:0/2348173951 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c0010d0e0 con 0x7f4c00101a50 2024-04-25T02:21:16.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.172+0000 7f4bfd7fa640 1 -- 172.21.15.77:0/2348173951 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4bec032e50 con 0x7f4c00101a50 2024-04-25T02:21:16.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.172+0000 7f4c06d1d640 1 -- 172.21.15.77:0/2348173951 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0010d5a0 con 0x7f4c00101a50 2024-04-25T02:21:16.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.172+0000 7f4bfd7fa640 1 -- 172.21.15.77:0/2348173951 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bec0433b0 con 0x7f4c00101a50 2024-04-25T02:21:16.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.173+0000 7f4c06d1d640 1 -- 172.21.15.77:0/2348173951 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c000fc820 con 0x7f4c00101a50 2024-04-25T02:21:16.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.173+0000 7f4bfd7fa640 1 -- 172.21.15.77:0/2348173951 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4bec02f070 con 0x7f4c00101a50 2024-04-25T02:21:16.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.173+0000 7f4bfd7fa640 1 --2- 172.21.15.77:0/2348173951 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f4bf006e0b0 0x7f4bf0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:16.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.173+0000 7f4bfd7fa640 1 -- 172.21.15.77:0/2348173951 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f4bec0afbc0 con 0x7f4c00101a50 2024-04-25T02:21:16.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.173+0000 7f4c04ab9640 1 --2- 172.21.15.77:0/2348173951 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f4bf006e0b0 0x7f4bf0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:16.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.174+0000 7f4c04ab9640 1 --2- 172.21.15.77:0/2348173951 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f4bf006e0b0 0x7f4bf0070560 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4004c40 tx=0x7f4bf4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:16.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.178+0000 7f4bfd7fa640 1 -- 172.21.15.77:0/2348173951 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f4bec078ef0 con 0x7f4c00101a50 2024-04-25T02:21:16.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:15 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/3503233993' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-04-25T02:21:16.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:15 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/1716547597' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-04-25T02:21:16.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:15 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/1182714494' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-04-25T02:21:16.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:15 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/3503233993' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-04-25T02:21:16.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:15 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/1716547597' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-04-25T02:21:16.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:15 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/1182714494' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-04-25T02:21:16.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.352+0000 7f4c06d1d640 1 -- 172.21.15.77:0/2348173951 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4c0004bcc0 con 0x7f4c00101a50 2024-04-25T02:21:16.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.352+0000 7f4bfd7fa640 1 -- 172.21.15.77:0/2348173951 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4bec07c5b0 con 0x7f4c00101a50 2024-04-25T02:21:16.356 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-25T02:21:16.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.354+0000 7f4c06d1d640 1 -- 172.21.15.77:0/2348173951 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f4bf006e0b0 msgr2=0x7f4bf0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:16.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.354+0000 7f4c06d1d640 1 --2- 172.21.15.77:0/2348173951 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f4bf006e0b0 0x7f4bf0070560 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4004c40 tx=0x7f4bf4009040 comp rx=0 tx=0).stop 2024-04-25T02:21:16.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.354+0000 7f4c06d1d640 1 -- 172.21.15.77:0/2348173951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c00101a50 msgr2=0x7f4c00113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:16.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.354+0000 7f4c06d1d640 1 --2- 172.21.15.77:0/2348173951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c00101a50 0x7f4c00113210 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4bec004930 tx=0x7f4bec009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:16.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.355+0000 7f4c06d1d640 1 -- 172.21.15.77:0/2348173951 shutdown_connections 2024-04-25T02:21:16.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.355+0000 7f4c06d1d640 1 --2- 172.21.15.77:0/2348173951 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f4bf006e0b0 0x7f4bf0070560 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:16.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.355+0000 7f4c06d1d640 1 --2- 172.21.15.77:0/2348173951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c00101a50 0x7f4c00113210 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:16.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.355+0000 7f4c06d1d640 1 --2- 172.21.15.77:0/2348173951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c001010b0 0x7f4c00112cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:16.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.355+0000 7f4c06d1d640 1 -- 172.21.15.77:0/2348173951 >> 172.21.15.77:0/2348173951 conn(0x7f4c000f6cc0 msgr2=0x7f4c000f7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:16.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.355+0000 7f4c06d1d640 1 -- 172.21.15.77:0/2348173951 shutdown_connections 2024-04-25T02:21:16.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.355+0000 7f4c06d1d640 1 -- 172.21.15.77:0/2348173951 wait complete. 2024-04-25T02:21:16.369 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-25T02:21:16.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.462+0000 7fe7a886e640 1 -- 172.21.15.77:0/783231713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7a41021f0 msgr2=0x7fe7a41025c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:16.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.462+0000 7fe7a886e640 1 --2- 172.21.15.77:0/783231713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7a41021f0 0x7fe7a41025c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe79c0048d0 tx=0x7fe79c009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:16.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.462+0000 7fe7a886e640 1 -- 172.21.15.77:0/783231713 shutdown_connections 2024-04-25T02:21:16.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.462+0000 7fe7a886e640 1 --2- 172.21.15.77:0/783231713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a40fa840 0x7fe7a40fac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:16.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.462+0000 7fe7a886e640 1 --2- 172.21.15.77:0/783231713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7a41021f0 0x7fe7a41025c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:16.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.462+0000 7fe7a886e640 1 -- 172.21.15.77:0/783231713 >> 172.21.15.77:0/783231713 conn(0x7fe7a4071700 msgr2=0x7fe7a4071b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:16.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.462+0000 7fe7a886e640 1 -- 172.21.15.77:0/783231713 shutdown_connections 2024-04-25T02:21:16.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.462+0000 7fe7a886e640 1 -- 172.21.15.77:0/783231713 wait complete. 2024-04-25T02:21:16.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.462+0000 7fe7a886e640 1 Processor -- start 2024-04-25T02:21:16.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.462+0000 7fe7a886e640 1 -- start start 2024-04-25T02:21:16.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.462+0000 7fe7a886e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7a40fa840 0x7fe7a40fba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:16.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.462+0000 7fe7a886e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a41021f0 0x7fe7a40fbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:16.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.462+0000 7fe7a886e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a40fd980 con 0x7fe7a40fa840 2024-04-25T02:21:16.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.462+0000 7fe7a886e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a40fc4a0 con 0x7fe7a41021f0 2024-04-25T02:21:16.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.462+0000 7fe7a259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7a40fa840 0x7fe7a40fba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:16.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.462+0000 7fe7a259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7a40fa840 0x7fe7a40fba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39542/0 (socket says 172.21.15.77:39542) 2024-04-25T02:21:16.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.462+0000 7fe7a259c640 1 -- 172.21.15.77:0/212874631 learned_addr learned my addr 172.21.15.77:0/212874631 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:16.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.463+0000 7fe7a1d9b640 1 --2- 172.21.15.77:0/212874631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a41021f0 0x7fe7a40fbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:16.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.463+0000 7fe7a259c640 1 -- 172.21.15.77:0/212874631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a41021f0 msgr2=0x7fe7a40fbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:16.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.463+0000 7fe7a259c640 1 --2- 172.21.15.77:0/212874631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a41021f0 0x7fe7a40fbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:16.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.463+0000 7fe7a259c640 1 -- 172.21.15.77:0/212874631 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79c005040 con 0x7fe7a40fa840 2024-04-25T02:21:16.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.463+0000 7fe7a1d9b640 1 --2- 172.21.15.77:0/212874631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a41021f0 0x7fe7a40fbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:21:16.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.463+0000 7fe7a259c640 1 --2- 172.21.15.77:0/212874631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7a40fa840 0x7fe7a40fba20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe79c004930 tx=0x7fe79c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:16.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.463+0000 7fe792ffd640 1 -- 172.21.15.77:0/212874631 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe79c0094c0 con 0x7fe7a40fa840 2024-04-25T02:21:16.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.463+0000 7fe792ffd640 1 -- 172.21.15.77:0/212874631 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe79c032e50 con 0x7fe7a40fa840 2024-04-25T02:21:16.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.463+0000 7fe7a886e640 1 -- 172.21.15.77:0/212874631 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a40fc720 con 0x7fe7a40fa840 2024-04-25T02:21:16.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.463+0000 7fe792ffd640 1 -- 172.21.15.77:0/212874631 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe79c0433b0 con 0x7fe7a40fa840 2024-04-25T02:21:16.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.463+0000 7fe7a886e640 1 -- 172.21.15.77:0/212874631 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a4119410 con 0x7fe7a40fa840 2024-04-25T02:21:16.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.464+0000 7fe7a886e640 1 -- 172.21.15.77:0/212874631 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a404bcc0 con 0x7fe7a40fa840 2024-04-25T02:21:16.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.464+0000 7fe792ffd640 1 -- 172.21.15.77:0/212874631 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe79c02f070 con 0x7fe7a40fa840 2024-04-25T02:21:16.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.465+0000 7fe792ffd640 1 --2- 172.21.15.77:0/212874631 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fe78c06e0b0 0x7fe78c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:16.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.465+0000 7fe792ffd640 1 -- 172.21.15.77:0/212874631 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fe79c0af8d0 con 0x7fe7a40fa840 2024-04-25T02:21:16.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.465+0000 7fe7a1d9b640 1 --2- 172.21.15.77:0/212874631 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fe78c06e0b0 0x7fe78c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:16.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.465+0000 7fe7a1d9b640 1 --2- 172.21.15.77:0/212874631 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fe78c06e0b0 0x7fe78c070560 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40fd150 tx=0x7fe798004d00 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:16.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.469+0000 7fe792ffd640 1 -- 172.21.15.77:0/212874631 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fe79c078c00 con 0x7fe7a40fa840 2024-04-25T02:21:16.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.645+0000 7fe7a886e640 1 -- 172.21.15.77:0/212874631 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fe7a4109360 con 0x7fe7a40fa840 2024-04-25T02:21:16.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.645+0000 7fe792ffd640 1 -- 172.21.15.77:0/212874631 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7fe79c07c2c0 con 0x7fe7a40fa840 2024-04-25T02:21:16.648 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T02:21:16.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.647+0000 7fe7a886e640 1 -- 172.21.15.77:0/212874631 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fe78c06e0b0 msgr2=0x7fe78c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:16.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.647+0000 7fe7a886e640 1 --2- 172.21.15.77:0/212874631 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fe78c06e0b0 0x7fe78c070560 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40fd150 tx=0x7fe798004d00 comp rx=0 tx=0).stop 2024-04-25T02:21:16.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.647+0000 7fe7a886e640 1 -- 172.21.15.77:0/212874631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7a40fa840 msgr2=0x7fe7a40fba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:16.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.647+0000 7fe7a886e640 1 --2- 172.21.15.77:0/212874631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7a40fa840 0x7fe7a40fba20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe79c004930 tx=0x7fe79c009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:16.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.647+0000 7fe7a886e640 1 -- 172.21.15.77:0/212874631 shutdown_connections 2024-04-25T02:21:16.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.647+0000 7fe7a886e640 1 --2- 172.21.15.77:0/212874631 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fe78c06e0b0 0x7fe78c070560 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:16.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.647+0000 7fe7a886e640 1 --2- 172.21.15.77:0/212874631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7a41021f0 0x7fe7a40fbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:16.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.647+0000 7fe7a886e640 1 --2- 172.21.15.77:0/212874631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7a40fa840 0x7fe7a40fba20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:16.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.647+0000 7fe7a886e640 1 -- 172.21.15.77:0/212874631 >> 172.21.15.77:0/212874631 conn(0x7fe7a4071700 msgr2=0x7fe7a40f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:16.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.647+0000 7fe7a886e640 1 -- 172.21.15.77:0/212874631 shutdown_connections 2024-04-25T02:21:16.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.647+0000 7fe7a886e640 1 -- 172.21.15.77:0/212874631 wait complete. 2024-04-25T02:21:16.661 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-25T02:21:16.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.755+0000 7f089499d640 1 -- 172.21.15.77:0/2375641932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08901010a0 msgr2=0x7f0890101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:16.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.755+0000 7f089499d640 1 --2- 172.21.15.77:0/2375641932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08901010a0 0x7f0890101470 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f08800048d0 tx=0x7f0880009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:16.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.755+0000 7f089499d640 1 -- 172.21.15.77:0/2375641932 shutdown_connections 2024-04-25T02:21:16.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.755+0000 7f089499d640 1 --2- 172.21.15.77:0/2375641932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0890101a40 0x7f08900fb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:16.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.755+0000 7f089499d640 1 --2- 172.21.15.77:0/2375641932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08901010a0 0x7f0890101470 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:16.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.755+0000 7f089499d640 1 -- 172.21.15.77:0/2375641932 >> 172.21.15.77:0/2375641932 conn(0x7f08900f6c90 msgr2=0x7f08900f90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:16.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.755+0000 7f089499d640 1 -- 172.21.15.77:0/2375641932 shutdown_connections 2024-04-25T02:21:16.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.755+0000 7f089499d640 1 -- 172.21.15.77:0/2375641932 wait complete. 2024-04-25T02:21:16.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.756+0000 7f089499d640 1 Processor -- start 2024-04-25T02:21:16.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.756+0000 7f089499d640 1 -- start start 2024-04-25T02:21:16.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.756+0000 7f089499d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08901010a0 0x7f0890111be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:16.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.756+0000 7f089499d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0890101a40 0x7f0890112120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:16.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.756+0000 7f089499d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0890112720 con 0x7f08901010a0 2024-04-25T02:21:16.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.756+0000 7f089499d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089010bd70 con 0x7f0890101a40 2024-04-25T02:21:16.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.756+0000 7f088e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08901010a0 0x7f0890111be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:16.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.756+0000 7f088e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08901010a0 0x7f0890111be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39552/0 (socket says 172.21.15.77:39552) 2024-04-25T02:21:16.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.756+0000 7f088e59c640 1 -- 172.21.15.77:0/1052449443 learned_addr learned my addr 172.21.15.77:0/1052449443 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:16.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.756+0000 7f088e59c640 1 -- 172.21.15.77:0/1052449443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0890101a40 msgr2=0x7f0890112120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:16.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.756+0000 7f088e59c640 1 --2- 172.21.15.77:0/1052449443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0890101a40 0x7f0890112120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:16.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.756+0000 7f088e59c640 1 -- 172.21.15.77:0/1052449443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0880005040 con 0x7f08901010a0 2024-04-25T02:21:16.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.756+0000 7f088e59c640 1 --2- 172.21.15.77:0/1052449443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08901010a0 0x7f0890111be0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0880004930 tx=0x7f0880009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:16.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.756+0000 7f0886ffd640 1 -- 172.21.15.77:0/1052449443 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08800094c0 con 0x7f08901010a0 2024-04-25T02:21:16.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.756+0000 7f089499d640 1 -- 172.21.15.77:0/1052449443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f089010bff0 con 0x7f08901010a0 2024-04-25T02:21:16.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.756+0000 7f0886ffd640 1 -- 172.21.15.77:0/1052449443 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0880032e50 con 0x7f08901010a0 2024-04-25T02:21:16.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.756+0000 7f0886ffd640 1 -- 172.21.15.77:0/1052449443 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0880038420 con 0x7f08901010a0 2024-04-25T02:21:16.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.756+0000 7f089499d640 1 -- 172.21.15.77:0/1052449443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f089010c510 con 0x7f08901010a0 2024-04-25T02:21:16.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.757+0000 7f089499d640 1 -- 172.21.15.77:0/1052449443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08900fc810 con 0x7f08901010a0 2024-04-25T02:21:16.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.758+0000 7f0886ffd640 1 -- 172.21.15.77:0/1052449443 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f088002f070 con 0x7f08901010a0 2024-04-25T02:21:16.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.758+0000 7f0886ffd640 1 --2- 172.21.15.77:0/1052449443 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f087c06e0b0 0x7f087c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:16.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.758+0000 7f0886ffd640 1 -- 172.21.15.77:0/1052449443 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f08800b1920 con 0x7f08901010a0 2024-04-25T02:21:16.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.758+0000 7f0887fff640 1 --2- 172.21.15.77:0/1052449443 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f087c06e0b0 0x7f087c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:16.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.759+0000 7f0887fff640 1 --2- 172.21.15.77:0/1052449443 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f087c06e0b0 0x7f087c070560 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f089010d4a0 tx=0x7f0878009c50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:16.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.763+0000 7f0886ffd640 1 -- 172.21.15.77:0/1052449443 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f088007ac50 con 0x7f08901010a0 2024-04-25T02:21:16.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.937+0000 7f089499d640 1 -- 172.21.15.77:0/1052449443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f089010d250 con 0x7f08901010a0 2024-04-25T02:21:16.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.938+0000 7f0886ffd640 1 -- 172.21.15.77:0/1052449443 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7f0880036070 con 0x7f08901010a0 2024-04-25T02:21:16.941 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T02:21:16.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.940+0000 7f089499d640 1 -- 172.21.15.77:0/1052449443 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f087c06e0b0 msgr2=0x7f087c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:16.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.940+0000 7f089499d640 1 --2- 172.21.15.77:0/1052449443 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f087c06e0b0 0x7f087c070560 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f089010d4a0 tx=0x7f0878009c50 comp rx=0 tx=0).stop 2024-04-25T02:21:16.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.940+0000 7f089499d640 1 -- 172.21.15.77:0/1052449443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08901010a0 msgr2=0x7f0890111be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:16.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.940+0000 7f089499d640 1 --2- 172.21.15.77:0/1052449443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08901010a0 0x7f0890111be0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0880004930 tx=0x7f0880009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:16.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.940+0000 7f089499d640 1 -- 172.21.15.77:0/1052449443 shutdown_connections 2024-04-25T02:21:16.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.940+0000 7f089499d640 1 --2- 172.21.15.77:0/1052449443 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f087c06e0b0 0x7f087c070560 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:16.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.940+0000 7f089499d640 1 --2- 172.21.15.77:0/1052449443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0890101a40 0x7f0890112120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:16.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.940+0000 7f089499d640 1 --2- 172.21.15.77:0/1052449443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08901010a0 0x7f0890111be0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:16.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.940+0000 7f089499d640 1 -- 172.21.15.77:0/1052449443 >> 172.21.15.77:0/1052449443 conn(0x7f08900f6c90 msgr2=0x7f08900f7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:16.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.940+0000 7f089499d640 1 -- 172.21.15.77:0/1052449443 shutdown_connections 2024-04-25T02:21:16.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:16.940+0000 7f089499d640 1 -- 172.21.15.77:0/1052449443 wait complete. 2024-04-25T02:21:16.955 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:21:17.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.045+0000 7f3be539d640 1 -- 172.21.15.77:0/4062304242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3be0101a60 msgr2=0x7f3be00fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:17.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.045+0000 7f3be539d640 1 --2- 172.21.15.77:0/4062304242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3be0101a60 0x7f3be00fb0f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80048d0 tx=0x7f3bc8009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:17.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.045+0000 7f3be539d640 1 -- 172.21.15.77:0/4062304242 shutdown_connections 2024-04-25T02:21:17.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.045+0000 7f3be539d640 1 --2- 172.21.15.77:0/4062304242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3be0101a60 0x7f3be00fb0f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:17.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.045+0000 7f3be539d640 1 --2- 172.21.15.77:0/4062304242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3be01010c0 0x7f3be0101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:17.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.045+0000 7f3be539d640 1 -- 172.21.15.77:0/4062304242 >> 172.21.15.77:0/4062304242 conn(0x7f3be00f6cf0 msgr2=0x7f3be00f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:17.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.045+0000 7f3be539d640 1 -- 172.21.15.77:0/4062304242 shutdown_connections 2024-04-25T02:21:17.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.045+0000 7f3be539d640 1 -- 172.21.15.77:0/4062304242 wait complete. 2024-04-25T02:21:17.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.046+0000 7f3be539d640 1 Processor -- start 2024-04-25T02:21:17.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.046+0000 7f3be539d640 1 -- start start 2024-04-25T02:21:17.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.046+0000 7f3be539d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3be01010c0 0x7f3be010ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:17.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.046+0000 7f3be539d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3be0101a60 0x7f3be010e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:17.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.046+0000 7f3be539d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be0066510 con 0x7f3be01010c0 2024-04-25T02:21:17.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.046+0000 7f3be539d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be010e950 con 0x7f3be0101a60 2024-04-25T02:21:17.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.046+0000 7f3bdeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3be01010c0 0x7f3be010ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:17.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.046+0000 7f3bdeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3be01010c0 0x7f3be010ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39584/0 (socket says 172.21.15.77:39584) 2024-04-25T02:21:17.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.046+0000 7f3bdeffd640 1 -- 172.21.15.77:0/2177119634 learned_addr learned my addr 172.21.15.77:0/2177119634 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:17.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.046+0000 7f3bd7fff640 1 --2- 172.21.15.77:0/2177119634 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3be0101a60 0x7f3be010e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:17.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.046+0000 7f3bdeffd640 1 -- 172.21.15.77:0/2177119634 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3be0101a60 msgr2=0x7f3be010e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:17.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.046+0000 7f3bdeffd640 1 --2- 172.21.15.77:0/2177119634 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3be0101a60 0x7f3be010e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:17.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.046+0000 7f3bdeffd640 1 -- 172.21.15.77:0/2177119634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc8005040 con 0x7f3be01010c0 2024-04-25T02:21:17.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.046+0000 7f3bdeffd640 1 --2- 172.21.15.77:0/2177119634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3be01010c0 0x7f3be010ded0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3bd000eb70 tx=0x7f3bd000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:17.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.047+0000 7f3bd77fe640 1 -- 172.21.15.77:0/2177119634 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bd0007c30 con 0x7f3be01010c0 2024-04-25T02:21:17.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.047+0000 7f3bd77fe640 1 -- 172.21.15.77:0/2177119634 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3bd000f040 con 0x7f3be01010c0 2024-04-25T02:21:17.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.047+0000 7f3be539d640 1 -- 172.21.15.77:0/2177119634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be010ebd0 con 0x7f3be01010c0 2024-04-25T02:21:17.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.047+0000 7f3bd77fe640 1 -- 172.21.15.77:0/2177119634 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bd00095b0 con 0x7f3be01010c0 2024-04-25T02:21:17.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.047+0000 7f3be539d640 1 -- 172.21.15.77:0/2177119634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be0117190 con 0x7f3be01010c0 2024-04-25T02:21:17.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.048+0000 7f3be539d640 1 -- 172.21.15.77:0/2177119634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be00fc830 con 0x7f3be01010c0 2024-04-25T02:21:17.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.048+0000 7f3bd77fe640 1 -- 172.21.15.77:0/2177119634 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3bd0009730 con 0x7f3be01010c0 2024-04-25T02:21:17.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.048+0000 7f3bd77fe640 1 --2- 172.21.15.77:0/2177119634 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f3bcc06e0b0 0x7f3bcc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:17.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.048+0000 7f3bd77fe640 1 -- 172.21.15.77:0/2177119634 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f3bd008d8f0 con 0x7f3be01010c0 2024-04-25T02:21:17.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.048+0000 7f3bd7fff640 1 --2- 172.21.15.77:0/2177119634 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f3bcc06e0b0 0x7f3bcc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:17.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.049+0000 7f3bd7fff640 1 --2- 172.21.15.77:0/2177119634 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f3bcc06e0b0 0x7f3bcc070560 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3be0065d60 tx=0x7f3bc8009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:17.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.053+0000 7f3bd77fe640 1 -- 172.21.15.77:0/2177119634 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f3bd0056c20 con 0x7f3be01010c0 2024-04-25T02:21:17.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:16 smithi077 ceph-mon[110441]: pgmap v273: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:21:17.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:16 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/3625508941' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:21:17.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:16 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/2348173951' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:21:17.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:16 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/212874631' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-25T02:21:17.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:16 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/1052449443' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-25T02:21:17.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.241+0000 7f3be539d640 1 -- 172.21.15.77:0/2177119634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3be004bcc0 con 0x7f3be01010c0 2024-04-25T02:21:17.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.242+0000 7f3bd77fe640 1 -- 172.21.15.77:0/2177119634 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 39 entries v84) v1 ==== 81+0+2309 (secure 0 0 0) 0x7f3bd005a2e0 con 0x7f3be01010c0 2024-04-25T02:21:17.245 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.112:6825/3687767796 2024-04-26T02:18:31.253792+0000 2024-04-25T02:21:17.245 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/1779967375 2024-04-26T02:00:25.057598+0000 2024-04-25T02:21:17.245 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.112:6826/2036319817 2024-04-26T02:18:52.548426+0000 2024-04-25T02:21:17.245 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6800/859750200 2024-04-26T02:00:25.057598+0000 2024-04-25T02:21:17.245 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.112:0/1986353395 2024-04-26T02:10:29.627481+0000 2024-04-25T02:21:17.245 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/2265849210 2024-04-26T02:00:25.057598+0000 2024-04-25T02:21:17.245 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/2490024809 2024-04-26T02:01:30.377936+0000 2024-04-25T02:21:17.245 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/265498985 2024-04-26T01:59:54.491478+0000 2024-04-25T02:21:17.245 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/543110241 2024-04-26T02:01:30.377936+0000 2024-04-25T02:21:17.245 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6826/4228767448 2024-04-26T02:06:24.839959+0000 2024-04-25T02:21:17.246 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6801/310739264 2024-04-26T02:09:17.638820+0000 2024-04-25T02:21:17.246 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6801/799251145 2024-04-26T02:13:23.698232+0000 2024-04-25T02:21:17.246 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/3184722826 2024-04-26T02:01:30.377936+0000 2024-04-25T02:21:17.246 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6800/310739264 2024-04-26T02:09:17.638820+0000 2024-04-25T02:21:17.246 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6801/839529497 2024-04-26T01:59:54.491478+0000 2024-04-25T02:21:17.246 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/2089066429 2024-04-26T02:09:17.638820+0000 2024-04-25T02:21:17.246 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.112:0/1265440623 2024-04-26T02:10:29.627481+0000 2024-04-25T02:21:17.246 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/1177720370 2024-04-26T01:59:54.491478+0000 2024-04-25T02:21:17.246 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6800/2375514340 2024-04-26T02:01:30.377936+0000 2024-04-25T02:21:17.246 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.112:0/582855468 2024-04-26T02:10:29.627481+0000 2024-04-25T02:21:17.246 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6801/859750200 2024-04-26T02:00:25.057598+0000 2024-04-25T02:21:17.246 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/2254838943 2024-04-26T02:00:25.057598+0000 2024-04-25T02:21:17.246 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/1743910051 2024-04-26T01:59:54.491478+0000 2024-04-25T02:21:17.246 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.112:6828/218023931 2024-04-26T02:10:29.627481+0000 2024-04-25T02:21:17.246 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6800/839529497 2024-04-26T01:59:54.491478+0000 2024-04-25T02:21:17.246 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/863377592 2024-04-26T02:09:17.638820+0000 2024-04-25T02:21:17.247 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6827/4228767448 2024-04-26T02:06:24.839959+0000 2024-04-25T02:21:17.247 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6800/799251145 2024-04-26T02:13:23.698232+0000 2024-04-25T02:21:17.247 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.112:6827/2036319817 2024-04-26T02:18:52.548426+0000 2024-04-25T02:21:17.247 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/1802503387 2024-04-26T02:09:17.638820+0000 2024-04-25T02:21:17.247 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6801/2375514340 2024-04-26T02:01:30.377936+0000 2024-04-25T02:21:17.247 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/910905261 2024-04-26T02:13:23.698232+0000 2024-04-25T02:21:17.247 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.112:0/1205122809 2024-04-26T02:10:29.627481+0000 2024-04-25T02:21:17.247 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.112:6829/218023931 2024-04-26T02:10:29.627481+0000 2024-04-25T02:21:17.247 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/2354945099 2024-04-26T02:13:23.698232+0000 2024-04-25T02:21:17.247 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/678203530 2024-04-26T02:13:23.698232+0000 2024-04-25T02:21:17.247 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/114993391 2024-04-26T02:09:17.638820+0000 2024-04-25T02:21:17.247 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/1864957324 2024-04-26T02:13:23.698232+0000 2024-04-25T02:21:17.247 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.112:6824/3687767796 2024-04-26T02:18:31.253792+0000 2024-04-25T02:21:17.248 INFO:teuthology.orchestra.run.smithi077.stderr:listed 39 entries 2024-04-25T02:21:17.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.244+0000 7f3be539d640 1 -- 172.21.15.77:0/2177119634 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f3bcc06e0b0 msgr2=0x7f3bcc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:17.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.244+0000 7f3be539d640 1 --2- 172.21.15.77:0/2177119634 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f3bcc06e0b0 0x7f3bcc070560 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3be0065d60 tx=0x7f3bc8009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:17.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.244+0000 7f3be539d640 1 -- 172.21.15.77:0/2177119634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3be01010c0 msgr2=0x7f3be010ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:17.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.244+0000 7f3be539d640 1 --2- 172.21.15.77:0/2177119634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3be01010c0 0x7f3be010ded0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3bd000eb70 tx=0x7f3bd000b040 comp rx=0 tx=0).stop 2024-04-25T02:21:17.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.244+0000 7f3be539d640 1 -- 172.21.15.77:0/2177119634 shutdown_connections 2024-04-25T02:21:17.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.244+0000 7f3be539d640 1 --2- 172.21.15.77:0/2177119634 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f3bcc06e0b0 0x7f3bcc070560 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:17.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.244+0000 7f3be539d640 1 --2- 172.21.15.77:0/2177119634 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3be0101a60 0x7f3be010e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:17.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.244+0000 7f3be539d640 1 --2- 172.21.15.77:0/2177119634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3be01010c0 0x7f3be010ded0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:17.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.244+0000 7f3be539d640 1 -- 172.21.15.77:0/2177119634 >> 172.21.15.77:0/2177119634 conn(0x7f3be00f6cf0 msgr2=0x7f3be00f7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:17.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.244+0000 7f3be539d640 1 -- 172.21.15.77:0/2177119634 shutdown_connections 2024-04-25T02:21:17.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.244+0000 7f3be539d640 1 -- 172.21.15.77:0/2177119634 wait complete. 2024-04-25T02:21:17.258 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T02:21:17.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:21:17.258 DEBUG:teuthology.orchestra.run.smithi077:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T02:21:17.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:16 smithi112 ceph-mon[80494]: pgmap v273: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:21:17.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:16 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/3625508941' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:21:17.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:16 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/2348173951' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:21:17.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:16 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/212874631' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-25T02:21:17.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:16 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/1052449443' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-25T02:21:17.282 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T02:21:17.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:21:17.282 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T02:21:17.352 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T02:21:17.353 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:21:17.371 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T02:21:17.371 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:21:17.429 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:21:17.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.520+0000 7f35a8e07640 1 -- 172.21.15.77:0/2062270421 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a4101a50 msgr2=0x7f35a40fb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:17.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.520+0000 7f35a8e07640 1 --2- 172.21.15.77:0/2062270421 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a4101a50 0x7f35a40fb0e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f35980048d0 tx=0x7f3598009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:17.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.520+0000 7f35a8e07640 1 -- 172.21.15.77:0/2062270421 shutdown_connections 2024-04-25T02:21:17.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.520+0000 7f35a8e07640 1 --2- 172.21.15.77:0/2062270421 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a4101a50 0x7f35a40fb0e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:17.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.520+0000 7f35a8e07640 1 --2- 172.21.15.77:0/2062270421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35a41010b0 0x7f35a4101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:17.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.520+0000 7f35a8e07640 1 -- 172.21.15.77:0/2062270421 >> 172.21.15.77:0/2062270421 conn(0x7f35a40f6c60 msgr2=0x7f35a40f9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:17.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.520+0000 7f35a8e07640 1 -- 172.21.15.77:0/2062270421 shutdown_connections 2024-04-25T02:21:17.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.520+0000 7f35a8e07640 1 -- 172.21.15.77:0/2062270421 wait complete. 2024-04-25T02:21:17.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.521+0000 7f35a8e07640 1 Processor -- start 2024-04-25T02:21:17.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.521+0000 7f35a8e07640 1 -- start start 2024-04-25T02:21:17.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.521+0000 7f35a8e07640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a41010b0 0x7f35a4114ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:17.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.521+0000 7f35a8e07640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35a4101a50 0x7f35a41153e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:17.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.521+0000 7f35a8e07640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a41159e0 con 0x7f35a41010b0 2024-04-25T02:21:17.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.521+0000 7f35a8e07640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a4115b50 con 0x7f35a4101a50 2024-04-25T02:21:17.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.521+0000 7f35a259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a41010b0 0x7f35a4114ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:17.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.521+0000 7f35a259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a41010b0 0x7f35a4114ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35962/0 (socket says 172.21.15.77:35962) 2024-04-25T02:21:17.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.521+0000 7f35a259c640 1 -- 172.21.15.77:0/766519807 learned_addr learned my addr 172.21.15.77:0/766519807 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:17.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.521+0000 7f35a1d9b640 1 --2- 172.21.15.77:0/766519807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35a4101a50 0x7f35a41153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:17.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.521+0000 7f35a259c640 1 -- 172.21.15.77:0/766519807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35a4101a50 msgr2=0x7f35a41153e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:17.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.521+0000 7f35a259c640 1 --2- 172.21.15.77:0/766519807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35a4101a50 0x7f35a41153e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:17.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.521+0000 7f35a259c640 1 -- 172.21.15.77:0/766519807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3598005040 con 0x7f35a41010b0 2024-04-25T02:21:17.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.522+0000 7f35a259c640 1 --2- 172.21.15.77:0/766519807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a41010b0 0x7f35a4114ea0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3594002a50 tx=0x7f3594004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:17.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.522+0000 7f3592ffd640 1 -- 172.21.15.77:0/766519807 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3594007c30 con 0x7f35a41010b0 2024-04-25T02:21:17.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.522+0000 7f3592ffd640 1 -- 172.21.15.77:0/766519807 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f359400f040 con 0x7f35a41010b0 2024-04-25T02:21:17.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.522+0000 7f35a8e07640 1 -- 172.21.15.77:0/766519807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a410f250 con 0x7f35a41010b0 2024-04-25T02:21:17.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.522+0000 7f3592ffd640 1 -- 172.21.15.77:0/766519807 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f359400db50 con 0x7f35a41010b0 2024-04-25T02:21:17.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.522+0000 7f35a8e07640 1 -- 172.21.15.77:0/766519807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a410f770 con 0x7f35a41010b0 2024-04-25T02:21:17.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.523+0000 7f35a8e07640 1 -- 172.21.15.77:0/766519807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a40fc820 con 0x7f35a41010b0 2024-04-25T02:21:17.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.523+0000 7f3592ffd640 1 -- 172.21.15.77:0/766519807 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f359401c400 con 0x7f35a41010b0 2024-04-25T02:21:17.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.523+0000 7f3592ffd640 1 --2- 172.21.15.77:0/766519807 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f358c06e0b0 0x7f358c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:17.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.523+0000 7f3592ffd640 1 -- 172.21.15.77:0/766519807 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f359408d470 con 0x7f35a41010b0 2024-04-25T02:21:17.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.524+0000 7f35a1d9b640 1 --2- 172.21.15.77:0/766519807 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f358c06e0b0 0x7f358c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:17.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.524+0000 7f35a1d9b640 1 --2- 172.21.15.77:0/766519807 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f358c06e0b0 0x7f358c070560 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f35a40658a0 tx=0x7f3598009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:17.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.528+0000 7f3592ffd640 1 -- 172.21.15.77:0/766519807 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f35940567a0 con 0x7f35a41010b0 2024-04-25T02:21:17.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.702+0000 7f35a8e07640 1 -- 172.21.15.77:0/766519807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35a41082a0 con 0x7f35a41010b0 2024-04-25T02:21:17.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.703+0000 7f3592ffd640 1 -- 172.21.15.77:0/766519807 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f3594059e60 con 0x7f35a41010b0 2024-04-25T02:21:17.707 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T02:21:17.707 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":84,"fsid":"4bb93d82-02a7-11ef-bc93-c7b262605968","created":"2024-04-25T01:59:22.235413+0000","modified":"2024-04-25T02:18:52.548455+0000","last_up_change":"2024-04-25T02:17:48.815266+0000","last_in_change":"2024-04-25T02:04:33.912973+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:03:38.692032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-25T02:06:08.304706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-25T02:06:09.237302+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1533372f-b1a5-4ec0-9524-9940f870d874","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":79,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1934093025},{"type":"v1","addr":"172.21.15.77:6803","nonce":1934093025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1934093025},{"type":"v1","addr":"172.21.15.77:6805","nonce":1934093025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1934093025},{"type":"v1","addr":"172.21.15.77:6809","nonce":1934093025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1934093025},{"type":"v1","addr":"172.21.15.77:6807","nonce":1934093025}]},"public_addr":"172.21.15.77:6803/1934093025","cluster_addr":"172.21.15.77:6805/1934093025","heartbeat_back_addr":"172.21.15.77:6809/1934093025","heartbeat_front_addr":"172.21.15.77:6807/1934093025","state":["exists","up"]},{"osd":1,"uuid":"cb083b21-fd25-4ac4-bbde-6387c3253d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":59,"up_thru":79,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":79281053},{"type":"v1","addr":"172.21.15.77:6811","nonce":79281053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":79281053},{"type":"v1","addr":"172.21.15.77:6813","nonce":79281053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":79281053},{"type":"v1","addr":"172.21.15.77:6817","nonce":79281053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":79281053},{"type":"v1","addr":"172.21.15.77:6815","nonce":79281053}]},"public_addr":"172.21.15.77:6811/79281053","cluster_addr":"172.21.15.77:6813/79281053","heartbeat_back_addr":"172.21.15.77:6817/79281053","heartbeat_front_addr":"172.21.15.77:6815/79281053","state":["exists","up"]},{"osd":2,"uuid":"39b4553c-c1ed-489b-aead-210f38ac86b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":60,"up_from":64,"up_thru":79,"down_at":61,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3911834293},{"type":"v1","addr":"172.21.15.77:6819","nonce":3911834293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3911834293},{"type":"v1","addr":"172.21.15.77:6821","nonce":3911834293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3911834293},{"type":"v1","addr":"172.21.15.77:6825","nonce":3911834293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3911834293},{"type":"v1","addr":"172.21.15.77:6823","nonce":3911834293}]},"public_addr":"172.21.15.77:6819/3911834293","cluster_addr":"172.21.15.77:6821/3911834293","heartbeat_back_addr":"172.21.15.77:6825/3911834293","heartbeat_front_addr":"172.21.15.77:6823/3911834293","state":["exists","up"]},{"osd":3,"uuid":"addec0fa-80ee-465d-9d3e-c801d7bd9f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":65,"up_from":69,"up_thru":79,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3463246852},{"type":"v1","addr":"172.21.15.112:6801","nonce":3463246852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3463246852},{"type":"v1","addr":"172.21.15.112:6803","nonce":3463246852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3463246852},{"type":"v1","addr":"172.21.15.112:6807","nonce":3463246852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3463246852},{"type":"v1","addr":"172.21.15.112:6805","nonce":3463246852}]},"public_addr":"172.21.15.112:6801/3463246852","cluster_addr":"172.21.15.112:6803/3463246852","heartbeat_back_addr":"172.21.15.112:6807/3463246852","heartbeat_front_addr":"172.21.15.112:6805/3463246852","state":["exists","up"]},{"osd":4,"uuid":"93465def-0617-4ba8-915a-b3ea85c8f6d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":70,"up_from":74,"up_thru":79,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":1394902745},{"type":"v1","addr":"172.21.15.112:6809","nonce":1394902745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":1394902745},{"type":"v1","addr":"172.21.15.112:6811","nonce":1394902745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":1394902745},{"type":"v1","addr":"172.21.15.112:6815","nonce":1394902745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":1394902745},{"type":"v1","addr":"172.21.15.112:6813","nonce":1394902745}]},"public_addr":"172.21.15.112:6809/1394902745","cluster_addr":"172.21.15.112:6811/1394902745","heartbeat_back_addr":"172.21.15.112:6815/1394902745","heartbeat_front_addr":"172.21.15.112:6813/1394902745","state":["exists","up"]},{"osd":5,"uuid":"d3f693f5-324b-4a48-8f24-77e65c5f7f7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":75,"up_from":79,"up_thru":79,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1908468918},{"type":"v1","addr":"172.21.15.112:6817","nonce":1908468918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1908468918},{"type":"v1","addr":"172.21.15.112:6819","nonce":1908468918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1908468918},{"type":"v1","addr":"172.21.15.112:6823","nonce":1908468918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1908468918},{"type":"v1","addr":"172.21.15.112:6821","nonce":1908468918}]},"public_addr":"172.21.15.112:6817/1908468918","cluster_addr":"172.21.15.112:6819/1908468918","heartbeat_back_addr":"172.21.15.112:6823/1908468918","heartbeat_front_addr":"172.21.15.112:6821/1908468918","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:42.635624+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:10.189211+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:35.781710+0000","dead_epoch":60},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:59.250841+0000","dead_epoch":65},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:25.155356+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:51.315370+0000","dead_epoch":75}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.112:6825/3687767796":"2024-04-26T02:18:31.253792+0000","172.21.15.77:0/1779967375":"2024-04-26T02:00:25.057598+0000","172.21.15.112:6826/2036319817":"2024-04-26T02:18:52.548426+0000","172.21.15.77:6800/859750200":"2024-04-26T02:00:25.057598+0000","172.21.15.112:0/1986353395":"2024-04-26T02:10:29.627481+0000","172.21.15.77:0/2265849210":"2024-04-26T02:00:25.057598+0000","172.21.15.77:0/2490024809":"2024-04-26T02:01:30.377936+0000","172.21.15.77:0/265498985":"2024-04-26T01:59:54.491478+0000","172.21.15.77:0/543110241":"2024-04-26T02:01:30.377936+0000","172.21.15.77:6826/4228767448":"2024-04-26T02:06:24.839959+0000","172.21.15.77:6801/310739264":"2024-04-26T02:09:17.638820+0000","172.21.15.77:6801/799251145":"2024-04-26T02:13:23.698232+0000","172.21.15.77:0/3184722826":"2024-04-26T02:01:30.377936+0000","172.21.15.77:6800/310739264":"2024-04-26T02:09:17.638820+0000","172.21.15.77:6801/839529497":"2024-04-26T01:59:54.491478+0000","172.21.15.77:0/2089066429":"2024-04-26T02:09:17.638820+0000","172.21.15.112:0/1265440623":"2024-04-26T02:10:29.627481+0000","172.21.15.77:0/1177720370":"2024-04-26T01:59:54.491478+0000","172.21.15.77:6800/2375514340":"2024-04-26T02:01:30.377936+0000","172.21.15.112:0/582855468":"2024-04-26T02:10:29.627481+0000","172.21.15.77:6801/859750200":"2024-04-26T02:00:25.057598+0000","172.21.15.77:0/2254838943":"2024-04-26T02:00:25.057598+0000","172.21.15.77:0/1743910051":"2024-04-26T01:59:54.491478+0000","172.21.15.112:6828/218023931":"2024-04-26T02:10:29.627481+0000","172.21.15.77:6800/839529497":"2024-04-26T01:59:54.491478+0000","172.21.15.77:0/863377592":"2024-04-26T02:09:17.638820+0000","172.21.15.77:6827/4228767448":"2024-04-26T02:06:24.839959+0000","172.21.15.77:6800/799251145":"2024-04-26T02:13:23.698232+0000","172.21.15.112:6827/2036319817":"2024-04-26T02:18:52.548426+0000","172.21.15.77:0/1802503387":"2024-04-26T02:09:17.638820+0000","172.21.15.77:6801/2375514340":"2024-04-26T02:01:30.377936+0000","172.21.15.77:0/910905261":"2024-04-26T02:13:23.698232+0000","172.21.15.112:0/1205122809":"2024-04-26T02:10:29.627481+0000","172.21.15.112:6829/218023931":"2024-04-26T02:10:29.627481+0000","172.21.15.77:0/2354945099":"2024-04-26T02:13:23.698232+0000","172.21.15.77:0/678203530":"2024-04-26T02:13:23.698232+0000","172.21.15.77:0/114993391":"2024-04-26T02:09:17.638820+0000","172.21.15.77:0/1864957324":"2024-04-26T02:13:23.698232+0000","172.21.15.112:6824/3687767796":"2024-04-26T02:18:31.253792+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:21:17.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.705+0000 7f35a8e07640 1 -- 172.21.15.77:0/766519807 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f358c06e0b0 msgr2=0x7f358c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:17.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.705+0000 7f35a8e07640 1 --2- 172.21.15.77:0/766519807 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f358c06e0b0 0x7f358c070560 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f35a40658a0 tx=0x7f3598009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:17.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.705+0000 7f35a8e07640 1 -- 172.21.15.77:0/766519807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a41010b0 msgr2=0x7f35a4114ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:17.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.705+0000 7f35a8e07640 1 --2- 172.21.15.77:0/766519807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a41010b0 0x7f35a4114ea0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3594002a50 tx=0x7f3594004600 comp rx=0 tx=0).stop 2024-04-25T02:21:17.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.705+0000 7f35a8e07640 1 -- 172.21.15.77:0/766519807 shutdown_connections 2024-04-25T02:21:17.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.705+0000 7f35a8e07640 1 --2- 172.21.15.77:0/766519807 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f358c06e0b0 0x7f358c070560 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:17.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.705+0000 7f35a8e07640 1 --2- 172.21.15.77:0/766519807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35a4101a50 0x7f35a41153e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:17.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.705+0000 7f35a8e07640 1 --2- 172.21.15.77:0/766519807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a41010b0 0x7f35a4114ea0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:17.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.705+0000 7f35a8e07640 1 -- 172.21.15.77:0/766519807 >> 172.21.15.77:0/766519807 conn(0x7f35a40f6c60 msgr2=0x7f35a40f8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:17.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.705+0000 7f35a8e07640 1 -- 172.21.15.77:0/766519807 shutdown_connections 2024-04-25T02:21:17.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.705+0000 7f35a8e07640 1 -- 172.21.15.77:0/766519807 wait complete. 2024-04-25T02:21:17.720 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:03:38.692032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-25T02:06:08.304706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-25T02:06:09.237302+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:21:17.720 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:21:17.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.814+0000 7fc0a486e640 1 -- 172.21.15.77:0/4063596139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0a0101a50 msgr2=0x7fc0a00fb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.814+0000 7fc0a486e640 1 --2- 172.21.15.77:0/4063596139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0a0101a50 0x7fc0a00fb0e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc0880048d0 tx=0x7fc088009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.814+0000 7fc0a486e640 1 -- 172.21.15.77:0/4063596139 shutdown_connections 2024-04-25T02:21:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.814+0000 7fc0a486e640 1 --2- 172.21.15.77:0/4063596139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0a0101a50 0x7fc0a00fb0e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.814+0000 7fc0a486e640 1 --2- 172.21.15.77:0/4063596139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0a01010b0 0x7fc0a0101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.814+0000 7fc0a486e640 1 -- 172.21.15.77:0/4063596139 >> 172.21.15.77:0/4063596139 conn(0x7fc0a00f6c60 msgr2=0x7fc0a00f9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.814+0000 7fc0a486e640 1 -- 172.21.15.77:0/4063596139 shutdown_connections 2024-04-25T02:21:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.814+0000 7fc0a486e640 1 -- 172.21.15.77:0/4063596139 wait complete. 2024-04-25T02:21:17.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.815+0000 7fc0a486e640 1 Processor -- start 2024-04-25T02:21:17.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.815+0000 7fc0a486e640 1 -- start start 2024-04-25T02:21:17.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.815+0000 7fc0a486e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0a01010b0 0x7fc0a010e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:17.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.815+0000 7fc0a486e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0a0101a50 0x7fc0a010e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:17.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.815+0000 7fc0a486e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a00664d0 con 0x7fc0a0101a50 2024-04-25T02:21:17.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.815+0000 7fc0a486e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a010ec70 con 0x7fc0a01010b0 2024-04-25T02:21:17.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.815+0000 7fc097fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0a0101a50 0x7fc0a010e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:17.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.815+0000 7fc097fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0a0101a50 0x7fc0a010e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35984/0 (socket says 172.21.15.77:35984) 2024-04-25T02:21:17.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.815+0000 7fc097fff640 1 -- 172.21.15.77:0/1219619279 learned_addr learned my addr 172.21.15.77:0/1219619279 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:17.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.815+0000 7fc09e59c640 1 --2- 172.21.15.77:0/1219619279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0a01010b0 0x7fc0a010e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:17.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.815+0000 7fc097fff640 1 -- 172.21.15.77:0/1219619279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0a01010b0 msgr2=0x7fc0a010e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:17.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.815+0000 7fc097fff640 1 --2- 172.21.15.77:0/1219619279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0a01010b0 0x7fc0a010e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:17.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.815+0000 7fc097fff640 1 -- 172.21.15.77:0/1219619279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc088005040 con 0x7fc0a0101a50 2024-04-25T02:21:17.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.815+0000 7fc09e59c640 1 --2- 172.21.15.77:0/1219619279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0a01010b0 0x7fc0a010e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:21:17.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.815+0000 7fc097fff640 1 --2- 172.21.15.77:0/1219619279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0a0101a50 0x7fc0a010e700 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc088004930 tx=0x7fc088009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:17.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.816+0000 7fc096ffd640 1 -- 172.21.15.77:0/1219619279 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0880094c0 con 0x7fc0a0101a50 2024-04-25T02:21:17.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.816+0000 7fc096ffd640 1 -- 172.21.15.77:0/1219619279 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc088032e50 con 0x7fc0a0101a50 2024-04-25T02:21:17.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.816+0000 7fc0a486e640 1 -- 172.21.15.77:0/1219619279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a010eef0 con 0x7fc0a0101a50 2024-04-25T02:21:17.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.816+0000 7fc096ffd640 1 -- 172.21.15.77:0/1219619279 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0880433b0 con 0x7fc0a0101a50 2024-04-25T02:21:17.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.816+0000 7fc0a486e640 1 -- 172.21.15.77:0/1219619279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a0117420 con 0x7fc0a0101a50 2024-04-25T02:21:17.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.817+0000 7fc0a486e640 1 -- 172.21.15.77:0/1219619279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a00fc820 con 0x7fc0a0101a50 2024-04-25T02:21:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.817+0000 7fc096ffd640 1 -- 172.21.15.77:0/1219619279 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc08802f070 con 0x7fc0a0101a50 2024-04-25T02:21:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.817+0000 7fc096ffd640 1 --2- 172.21.15.77:0/1219619279 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc08c06e0b0 0x7fc08c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.817+0000 7fc096ffd640 1 -- 172.21.15.77:0/1219619279 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc0880afa40 con 0x7fc0a0101a50 2024-04-25T02:21:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.817+0000 7fc09e59c640 1 --2- 172.21.15.77:0/1219619279 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc08c06e0b0 0x7fc08c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.818+0000 7fc09e59c640 1 --2- 172.21.15.77:0/1219619279 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc08c06e0b0 0x7fc08c070560 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc090007fd0 tx=0x7fc090009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:17.822+0000 7fc096ffd640 1 -- 172.21.15.77:0/1219619279 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fc088078d70 con 0x7fc0a0101a50 2024-04-25T02:21:17.976 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:17 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/2177119634' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T02:21:17.976 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:17 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/766519807' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:21:18.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.003+0000 7fc0a486e640 1 -- 172.21.15.77:0/1219619279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc0a0108270 con 0x7fc0a0101a50 2024-04-25T02:21:18.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.003+0000 7fc096ffd640 1 -- 172.21.15.77:0/1219619279 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc08807c430 con 0x7fc0a0101a50 2024-04-25T02:21:18.007 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-25T02:21:18.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.005+0000 7fc0a486e640 1 -- 172.21.15.77:0/1219619279 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc08c06e0b0 msgr2=0x7fc08c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:18.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.005+0000 7fc0a486e640 1 --2- 172.21.15.77:0/1219619279 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc08c06e0b0 0x7fc08c070560 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc090007fd0 tx=0x7fc090009e90 comp rx=0 tx=0).stop 2024-04-25T02:21:18.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.005+0000 7fc0a486e640 1 -- 172.21.15.77:0/1219619279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0a0101a50 msgr2=0x7fc0a010e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:18.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.005+0000 7fc0a486e640 1 --2- 172.21.15.77:0/1219619279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0a0101a50 0x7fc0a010e700 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc088004930 tx=0x7fc088009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:18.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.005+0000 7fc0a486e640 1 -- 172.21.15.77:0/1219619279 shutdown_connections 2024-04-25T02:21:18.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.005+0000 7fc0a486e640 1 --2- 172.21.15.77:0/1219619279 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fc08c06e0b0 0x7fc08c070560 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:18.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.005+0000 7fc0a486e640 1 --2- 172.21.15.77:0/1219619279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0a0101a50 0x7fc0a010e700 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:18.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.005+0000 7fc0a486e640 1 --2- 172.21.15.77:0/1219619279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0a01010b0 0x7fc0a010e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:18.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.005+0000 7fc0a486e640 1 -- 172.21.15.77:0/1219619279 >> 172.21.15.77:0/1219619279 conn(0x7fc0a00f6c60 msgr2=0x7fc0a00f7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:18.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.005+0000 7fc0a486e640 1 -- 172.21.15.77:0/1219619279 shutdown_connections 2024-04-25T02:21:18.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.005+0000 7fc0a486e640 1 -- 172.21.15.77:0/1219619279 wait complete. 2024-04-25T02:21:18.019 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-25T02:21:18.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.112+0000 7fb3492ae640 1 -- 172.21.15.77:0/2980600396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3440fdb70 msgr2=0x7fb3441061b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:18.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.112+0000 7fb3492ae640 1 --2- 172.21.15.77:0/2980600396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3440fdb70 0x7fb3441061b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0048d0 tx=0x7fb32c009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:18.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.112+0000 7fb3492ae640 1 -- 172.21.15.77:0/2980600396 shutdown_connections 2024-04-25T02:21:18.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.112+0000 7fb3492ae640 1 --2- 172.21.15.77:0/2980600396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3440fdb70 0x7fb3441061b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:18.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.112+0000 7fb3492ae640 1 --2- 172.21.15.77:0/2980600396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3440fd1d0 0x7fb3440fd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:18.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.112+0000 7fb3492ae640 1 -- 172.21.15.77:0/2980600396 >> 172.21.15.77:0/2980600396 conn(0x7fb3440f6c60 msgr2=0x7fb3440f9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:18.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.112+0000 7fb3492ae640 1 -- 172.21.15.77:0/2980600396 shutdown_connections 2024-04-25T02:21:18.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.112+0000 7fb3492ae640 1 -- 172.21.15.77:0/2980600396 wait complete. 2024-04-25T02:21:18.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.113+0000 7fb3492ae640 1 Processor -- start 2024-04-25T02:21:18.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.113+0000 7fb3492ae640 1 -- start start 2024-04-25T02:21:18.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.113+0000 7fb3492ae640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3440fd1d0 0x7fb3441130a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:18.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.113+0000 7fb3492ae640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3440fdb70 0x7fb3441135e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:18.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.113+0000 7fb3492ae640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb344113be0 con 0x7fb3440fdb70 2024-04-25T02:21:18.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.113+0000 7fb3492ae640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34410d230 con 0x7fb3440fd1d0 2024-04-25T02:21:18.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.113+0000 7fb33bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3440fdb70 0x7fb3441135e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:18.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.113+0000 7fb33bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3440fdb70 0x7fb3441135e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36004/0 (socket says 172.21.15.77:36004) 2024-04-25T02:21:18.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.113+0000 7fb33bfff640 1 -- 172.21.15.77:0/617203255 learned_addr learned my addr 172.21.15.77:0/617203255 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:18.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.113+0000 7fb342ffd640 1 --2- 172.21.15.77:0/617203255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3440fd1d0 0x7fb3441130a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:18.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.113+0000 7fb33bfff640 1 -- 172.21.15.77:0/617203255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3440fd1d0 msgr2=0x7fb3441130a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:18.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.113+0000 7fb33bfff640 1 --2- 172.21.15.77:0/617203255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3440fd1d0 0x7fb3441130a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:18.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.113+0000 7fb33bfff640 1 -- 172.21.15.77:0/617203255 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32c005040 con 0x7fb3440fdb70 2024-04-25T02:21:18.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.113+0000 7fb33bfff640 1 --2- 172.21.15.77:0/617203255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3440fdb70 0x7fb3441135e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb32c004930 tx=0x7fb32c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:18.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.113+0000 7fb33b7fe640 1 -- 172.21.15.77:0/617203255 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb32c0094c0 con 0x7fb3440fdb70 2024-04-25T02:21:18.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.114+0000 7fb33b7fe640 1 -- 172.21.15.77:0/617203255 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb32c032e50 con 0x7fb3440fdb70 2024-04-25T02:21:18.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.114+0000 7fb33b7fe640 1 -- 172.21.15.77:0/617203255 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb32c0433b0 con 0x7fb3440fdb70 2024-04-25T02:21:18.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.114+0000 7fb3492ae640 1 -- 172.21.15.77:0/617203255 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb34410d4b0 con 0x7fb3440fdb70 2024-04-25T02:21:18.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.114+0000 7fb3492ae640 1 -- 172.21.15.77:0/617203255 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb34410d970 con 0x7fb3440fdb70 2024-04-25T02:21:18.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.115+0000 7fb3492ae640 1 -- 172.21.15.77:0/617203255 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb344065df0 con 0x7fb3440fdb70 2024-04-25T02:21:18.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.115+0000 7fb33b7fe640 1 -- 172.21.15.77:0/617203255 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb32c02f070 con 0x7fb3440fdb70 2024-04-25T02:21:18.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.115+0000 7fb33b7fe640 1 --2- 172.21.15.77:0/617203255 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb33006e0b0 0x7fb330070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:18.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.115+0000 7fb33b7fe640 1 -- 172.21.15.77:0/617203255 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb32c0af9f0 con 0x7fb3440fdb70 2024-04-25T02:21:18.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.115+0000 7fb342ffd640 1 --2- 172.21.15.77:0/617203255 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb33006e0b0 0x7fb330070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:18.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.116+0000 7fb342ffd640 1 --2- 172.21.15.77:0/617203255 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb33006e0b0 0x7fb330070560 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb334007fd0 tx=0x7fb334009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:18.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.120+0000 7fb33b7fe640 1 -- 172.21.15.77:0/617203255 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fb32c078d20 con 0x7fb3440fdb70 2024-04-25T02:21:18.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:17 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/2177119634' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T02:21:18.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:17 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/766519807' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:21:18.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.292+0000 7fb3492ae640 1 -- 172.21.15.77:0/617203255 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fb344109320 con 0x7fb3440fdb70 2024-04-25T02:21:18.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.293+0000 7fb33b7fe640 1 -- 172.21.15.77:0/617203255 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7fb32c07c3e0 con 0x7fb3440fdb70 2024-04-25T02:21:18.296 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T02:21:18.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.295+0000 7fb3492ae640 1 -- 172.21.15.77:0/617203255 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb33006e0b0 msgr2=0x7fb330070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:18.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.295+0000 7fb3492ae640 1 --2- 172.21.15.77:0/617203255 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb33006e0b0 0x7fb330070560 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb334007fd0 tx=0x7fb334009e90 comp rx=0 tx=0).stop 2024-04-25T02:21:18.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.295+0000 7fb3492ae640 1 -- 172.21.15.77:0/617203255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3440fdb70 msgr2=0x7fb3441135e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:18.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.295+0000 7fb3492ae640 1 --2- 172.21.15.77:0/617203255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3440fdb70 0x7fb3441135e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb32c004930 tx=0x7fb32c009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:18.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.295+0000 7fb3492ae640 1 -- 172.21.15.77:0/617203255 shutdown_connections 2024-04-25T02:21:18.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.295+0000 7fb3492ae640 1 --2- 172.21.15.77:0/617203255 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7fb33006e0b0 0x7fb330070560 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:18.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.295+0000 7fb3492ae640 1 --2- 172.21.15.77:0/617203255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3440fdb70 0x7fb3441135e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:18.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.295+0000 7fb3492ae640 1 --2- 172.21.15.77:0/617203255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3440fd1d0 0x7fb3441130a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:18.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.295+0000 7fb3492ae640 1 -- 172.21.15.77:0/617203255 >> 172.21.15.77:0/617203255 conn(0x7fb3440f6c60 msgr2=0x7fb3440f8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:18.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.295+0000 7fb3492ae640 1 -- 172.21.15.77:0/617203255 shutdown_connections 2024-04-25T02:21:18.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.295+0000 7fb3492ae640 1 -- 172.21.15.77:0/617203255 wait complete. 2024-04-25T02:21:18.309 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-25T02:21:18.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.405+0000 7f79daf9d640 1 -- 172.21.15.77:0/1740988328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d40fb0e0 msgr2=0x7f79d40fb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:18.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.405+0000 7f79daf9d640 1 --2- 172.21.15.77:0/1740988328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d40fb0e0 0x7f79d40fb530 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f79c00048d0 tx=0x7f79c0009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:18.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.405+0000 7f79daf9d640 1 -- 172.21.15.77:0/1740988328 shutdown_connections 2024-04-25T02:21:18.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.405+0000 7f79daf9d640 1 --2- 172.21.15.77:0/1740988328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d40fb0e0 0x7f79d40fb530 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:18.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.405+0000 7f79daf9d640 1 --2- 172.21.15.77:0/1740988328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79d4101110 0x7f79d41014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:18.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.405+0000 7f79daf9d640 1 -- 172.21.15.77:0/1740988328 >> 172.21.15.77:0/1740988328 conn(0x7f79d40710c0 msgr2=0x7f79d40714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:18.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.405+0000 7f79daf9d640 1 -- 172.21.15.77:0/1740988328 shutdown_connections 2024-04-25T02:21:18.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.405+0000 7f79daf9d640 1 -- 172.21.15.77:0/1740988328 wait complete. 2024-04-25T02:21:18.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.405+0000 7f79daf9d640 1 Processor -- start 2024-04-25T02:21:18.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.405+0000 7f79daf9d640 1 -- start start 2024-04-25T02:21:18.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.406+0000 7f79daf9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d40fb0e0 0x7f79d410dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:18.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.406+0000 7f79daf9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79d4101110 0x7f79d410e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:18.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.406+0000 7f79daf9d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d40652f0 con 0x7f79d40fb0e0 2024-04-25T02:21:18.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.406+0000 7f79daf9d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d410e940 con 0x7f79d4101110 2024-04-25T02:21:18.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.406+0000 7f79d8d39640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d40fb0e0 0x7f79d410dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:18.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.406+0000 7f79d8d39640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d40fb0e0 0x7f79d410dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36022/0 (socket says 172.21.15.77:36022) 2024-04-25T02:21:18.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.406+0000 7f79d8d39640 1 -- 172.21.15.77:0/391169206 learned_addr learned my addr 172.21.15.77:0/391169206 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:18.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.406+0000 7f79d8d39640 1 -- 172.21.15.77:0/391169206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79d4101110 msgr2=0x7f79d410e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:18.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.406+0000 7f79d3fff640 1 --2- 172.21.15.77:0/391169206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79d4101110 0x7f79d410e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:18.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.406+0000 7f79d8d39640 1 --2- 172.21.15.77:0/391169206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79d4101110 0x7f79d410e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:18.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.406+0000 7f79d8d39640 1 -- 172.21.15.77:0/391169206 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c0005040 con 0x7f79d40fb0e0 2024-04-25T02:21:18.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.406+0000 7f79d3fff640 1 --2- 172.21.15.77:0/391169206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79d4101110 0x7f79d410e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:21:18.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.406+0000 7f79d8d39640 1 --2- 172.21.15.77:0/391169206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d40fb0e0 0x7f79d410dec0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f79c8002a50 tx=0x7f79c8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:18.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.406+0000 7f79d17fa640 1 -- 172.21.15.77:0/391169206 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79c8007c30 con 0x7f79d40fb0e0 2024-04-25T02:21:18.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.406+0000 7f79daf9d640 1 -- 172.21.15.77:0/391169206 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d410ec20 con 0x7f79d40fb0e0 2024-04-25T02:21:18.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.406+0000 7f79d17fa640 1 -- 172.21.15.77:0/391169206 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f79c800f040 con 0x7f79d40fb0e0 2024-04-25T02:21:18.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.406+0000 7f79d17fa640 1 -- 172.21.15.77:0/391169206 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79c800db50 con 0x7f79d40fb0e0 2024-04-25T02:21:18.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.406+0000 7f79daf9d640 1 -- 172.21.15.77:0/391169206 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d41171e0 con 0x7f79d40fb0e0 2024-04-25T02:21:18.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.407+0000 7f79daf9d640 1 -- 172.21.15.77:0/391169206 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d40fc7d0 con 0x7f79d40fb0e0 2024-04-25T02:21:18.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.408+0000 7f79d17fa640 1 -- 172.21.15.77:0/391169206 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f79c801c400 con 0x7f79d40fb0e0 2024-04-25T02:21:18.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.408+0000 7f79d17fa640 1 --2- 172.21.15.77:0/391169206 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f79c406e0b0 0x7f79c4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:18.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.408+0000 7f79d17fa640 1 -- 172.21.15.77:0/391169206 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f79c808d470 con 0x7f79d40fb0e0 2024-04-25T02:21:18.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.408+0000 7f79d3fff640 1 --2- 172.21.15.77:0/391169206 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f79c406e0b0 0x7f79c4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:18.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.409+0000 7f79d3fff640 1 --2- 172.21.15.77:0/391169206 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f79c406e0b0 0x7f79c4070560 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f79c00043d0 tx=0x7f79c0009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:18.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.417+0000 7f79d17fa640 1 -- 172.21.15.77:0/391169206 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f79c80567a0 con 0x7f79d40fb0e0 2024-04-25T02:21:18.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.595+0000 7f79daf9d640 1 -- 172.21.15.77:0/391169206 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f79d41173d0 con 0x7f79d40fb0e0 2024-04-25T02:21:18.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.595+0000 7f79d17fa640 1 -- 172.21.15.77:0/391169206 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7f79c8059e60 con 0x7f79d40fb0e0 2024-04-25T02:21:18.599 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T02:21:18.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.597+0000 7f79daf9d640 1 -- 172.21.15.77:0/391169206 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f79c406e0b0 msgr2=0x7f79c4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:18.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.597+0000 7f79daf9d640 1 --2- 172.21.15.77:0/391169206 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f79c406e0b0 0x7f79c4070560 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f79c00043d0 tx=0x7f79c0009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:18.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.597+0000 7f79daf9d640 1 -- 172.21.15.77:0/391169206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d40fb0e0 msgr2=0x7f79d410dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:18.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.597+0000 7f79daf9d640 1 --2- 172.21.15.77:0/391169206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d40fb0e0 0x7f79d410dec0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f79c8002a50 tx=0x7f79c8004600 comp rx=0 tx=0).stop 2024-04-25T02:21:18.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.597+0000 7f79daf9d640 1 -- 172.21.15.77:0/391169206 shutdown_connections 2024-04-25T02:21:18.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.597+0000 7f79daf9d640 1 --2- 172.21.15.77:0/391169206 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f79c406e0b0 0x7f79c4070560 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:18.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.597+0000 7f79daf9d640 1 --2- 172.21.15.77:0/391169206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79d4101110 0x7f79d410e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:18.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.597+0000 7f79daf9d640 1 --2- 172.21.15.77:0/391169206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79d40fb0e0 0x7f79d410dec0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:18.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.597+0000 7f79daf9d640 1 -- 172.21.15.77:0/391169206 >> 172.21.15.77:0/391169206 conn(0x7f79d40710c0 msgr2=0x7f79d40fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:18.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.597+0000 7f79daf9d640 1 -- 172.21.15.77:0/391169206 shutdown_connections 2024-04-25T02:21:18.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.597+0000 7f79daf9d640 1 -- 172.21.15.77:0/391169206 wait complete. 2024-04-25T02:21:18.612 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:21:18.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.707+0000 7f94b611d640 1 -- 172.21.15.77:0/3693735784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94b00fdb50 msgr2=0x7f94b0106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:18.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.707+0000 7f94b611d640 1 --2- 172.21.15.77:0/3693735784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94b00fdb50 0x7f94b0106220 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f94a4004900 tx=0x7f94a4009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:18.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.707+0000 7f94b611d640 1 -- 172.21.15.77:0/3693735784 shutdown_connections 2024-04-25T02:21:18.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.707+0000 7f94b611d640 1 --2- 172.21.15.77:0/3693735784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94b00fdb50 0x7f94b0106220 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:18.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.707+0000 7f94b611d640 1 --2- 172.21.15.77:0/3693735784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94b00fd1b0 0x7f94b00fd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:18.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.707+0000 7f94b611d640 1 -- 172.21.15.77:0/3693735784 >> 172.21.15.77:0/3693735784 conn(0x7f94b00f6c70 msgr2=0x7f94b00f9080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:18.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.707+0000 7f94b611d640 1 -- 172.21.15.77:0/3693735784 shutdown_connections 2024-04-25T02:21:18.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.707+0000 7f94b611d640 1 -- 172.21.15.77:0/3693735784 wait complete. 2024-04-25T02:21:18.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.708+0000 7f94b611d640 1 Processor -- start 2024-04-25T02:21:18.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.708+0000 7f94b611d640 1 -- start start 2024-04-25T02:21:18.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.708+0000 7f94b611d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94b00fd1b0 0x7f94b0112d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:18.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.708+0000 7f94b611d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94b00fdb50 0x7f94b01132b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:18.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.708+0000 7f94b611d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b01138b0 con 0x7f94b00fd1b0 2024-04-25T02:21:18.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.708+0000 7f94b611d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b010cf00 con 0x7f94b00fdb50 2024-04-25T02:21:18.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.709+0000 7f94af7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94b00fd1b0 0x7f94b0112d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:18.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.709+0000 7f94af7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94b00fd1b0 0x7f94b0112d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36034/0 (socket says 172.21.15.77:36034) 2024-04-25T02:21:18.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.709+0000 7f94af7fe640 1 -- 172.21.15.77:0/1275968535 learned_addr learned my addr 172.21.15.77:0/1275968535 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T02:21:18.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.709+0000 7f94aeffd640 1 --2- 172.21.15.77:0/1275968535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94b00fdb50 0x7f94b01132b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:18.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.709+0000 7f94af7fe640 1 -- 172.21.15.77:0/1275968535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94b00fdb50 msgr2=0x7f94b01132b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:18.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.709+0000 7f94af7fe640 1 --2- 172.21.15.77:0/1275968535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94b00fdb50 0x7f94b01132b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:18.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.709+0000 7f94af7fe640 1 -- 172.21.15.77:0/1275968535 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a4005040 con 0x7f94b00fd1b0 2024-04-25T02:21:18.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.709+0000 7f94aeffd640 1 --2- 172.21.15.77:0/1275968535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94b00fdb50 0x7f94b01132b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:21:18.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.709+0000 7f94af7fe640 1 --2- 172.21.15.77:0/1275968535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94b00fd1b0 0x7f94b0112d70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f94a0002a50 tx=0x7f94a0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:18.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.709+0000 7f9497fff640 1 -- 172.21.15.77:0/1275968535 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94a0007c30 con 0x7f94b00fd1b0 2024-04-25T02:21:18.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.709+0000 7f9497fff640 1 -- 172.21.15.77:0/1275968535 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f94a000f040 con 0x7f94b00fd1b0 2024-04-25T02:21:18.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.709+0000 7f94b611d640 1 -- 172.21.15.77:0/1275968535 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b010d1e0 con 0x7f94b00fd1b0 2024-04-25T02:21:18.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.709+0000 7f9497fff640 1 -- 172.21.15.77:0/1275968535 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94a000db50 con 0x7f94b00fd1b0 2024-04-25T02:21:18.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.709+0000 7f94b611d640 1 -- 172.21.15.77:0/1275968535 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b010d700 con 0x7f94b00fd1b0 2024-04-25T02:21:18.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.711+0000 7f94b611d640 1 -- 172.21.15.77:0/1275968535 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b0065860 con 0x7f94b00fd1b0 2024-04-25T02:21:18.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.711+0000 7f9497fff640 1 -- 172.21.15.77:0/1275968535 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f94a001c400 con 0x7f94b00fd1b0 2024-04-25T02:21:18.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.712+0000 7f9497fff640 1 --2- 172.21.15.77:0/1275968535 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f949806e0b0 0x7f9498070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:21:18.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.712+0000 7f9497fff640 1 -- 172.21.15.77:0/1275968535 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f94a008d470 con 0x7f94b00fd1b0 2024-04-25T02:21:18.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.712+0000 7f94aeffd640 1 --2- 172.21.15.77:0/1275968535 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f949806e0b0 0x7f9498070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:21:18.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.712+0000 7f94aeffd640 1 --2- 172.21.15.77:0/1275968535 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f949806e0b0 0x7f9498070560 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f94a4000c00 tx=0x7f94a4009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:18.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.716+0000 7f9497fff640 1 -- 172.21.15.77:0/1275968535 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f94a00567a0 con 0x7f94b00fd1b0 2024-04-25T02:21:18.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.924+0000 7f94b611d640 1 -- 172.21.15.77:0/1275968535 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f94b010e3e0 con 0x7f94b00fd1b0 2024-04-25T02:21:18.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.924+0000 7f9497fff640 1 -- 172.21.15.77:0/1275968535 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 39 entries v84) v1 ==== 81+0+2309 (secure 0 0 0) 0x7f94a0059e60 con 0x7f94b00fd1b0 2024-04-25T02:21:18.928 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.112:6825/3687767796 2024-04-26T02:18:31.253792+0000 2024-04-25T02:21:18.928 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/1779967375 2024-04-26T02:00:25.057598+0000 2024-04-25T02:21:18.928 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.112:6826/2036319817 2024-04-26T02:18:52.548426+0000 2024-04-25T02:21:18.928 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6800/859750200 2024-04-26T02:00:25.057598+0000 2024-04-25T02:21:18.928 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.112:0/1986353395 2024-04-26T02:10:29.627481+0000 2024-04-25T02:21:18.928 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/2265849210 2024-04-26T02:00:25.057598+0000 2024-04-25T02:21:18.928 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/2490024809 2024-04-26T02:01:30.377936+0000 2024-04-25T02:21:18.928 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/265498985 2024-04-26T01:59:54.491478+0000 2024-04-25T02:21:18.928 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/543110241 2024-04-26T02:01:30.377936+0000 2024-04-25T02:21:18.929 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6826/4228767448 2024-04-26T02:06:24.839959+0000 2024-04-25T02:21:18.929 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6801/310739264 2024-04-26T02:09:17.638820+0000 2024-04-25T02:21:18.929 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6801/799251145 2024-04-26T02:13:23.698232+0000 2024-04-25T02:21:18.929 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/3184722826 2024-04-26T02:01:30.377936+0000 2024-04-25T02:21:18.929 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6800/310739264 2024-04-26T02:09:17.638820+0000 2024-04-25T02:21:18.929 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6801/839529497 2024-04-26T01:59:54.491478+0000 2024-04-25T02:21:18.929 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/2089066429 2024-04-26T02:09:17.638820+0000 2024-04-25T02:21:18.929 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.112:0/1265440623 2024-04-26T02:10:29.627481+0000 2024-04-25T02:21:18.929 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/1177720370 2024-04-26T01:59:54.491478+0000 2024-04-25T02:21:18.929 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6800/2375514340 2024-04-26T02:01:30.377936+0000 2024-04-25T02:21:18.929 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.112:0/582855468 2024-04-26T02:10:29.627481+0000 2024-04-25T02:21:18.929 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6801/859750200 2024-04-26T02:00:25.057598+0000 2024-04-25T02:21:18.929 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/2254838943 2024-04-26T02:00:25.057598+0000 2024-04-25T02:21:18.929 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/1743910051 2024-04-26T01:59:54.491478+0000 2024-04-25T02:21:18.929 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.112:6828/218023931 2024-04-26T02:10:29.627481+0000 2024-04-25T02:21:18.930 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6800/839529497 2024-04-26T01:59:54.491478+0000 2024-04-25T02:21:18.930 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/863377592 2024-04-26T02:09:17.638820+0000 2024-04-25T02:21:18.930 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6827/4228767448 2024-04-26T02:06:24.839959+0000 2024-04-25T02:21:18.930 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6800/799251145 2024-04-26T02:13:23.698232+0000 2024-04-25T02:21:18.930 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.112:6827/2036319817 2024-04-26T02:18:52.548426+0000 2024-04-25T02:21:18.930 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/1802503387 2024-04-26T02:09:17.638820+0000 2024-04-25T02:21:18.930 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6801/2375514340 2024-04-26T02:01:30.377936+0000 2024-04-25T02:21:18.930 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/910905261 2024-04-26T02:13:23.698232+0000 2024-04-25T02:21:18.930 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.112:0/1205122809 2024-04-26T02:10:29.627481+0000 2024-04-25T02:21:18.930 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.112:6829/218023931 2024-04-26T02:10:29.627481+0000 2024-04-25T02:21:18.930 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/2354945099 2024-04-26T02:13:23.698232+0000 2024-04-25T02:21:18.930 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/678203530 2024-04-26T02:13:23.698232+0000 2024-04-25T02:21:18.930 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/114993391 2024-04-26T02:09:17.638820+0000 2024-04-25T02:21:18.930 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/1864957324 2024-04-26T02:13:23.698232+0000 2024-04-25T02:21:18.931 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.112:6824/3687767796 2024-04-26T02:18:31.253792+0000 2024-04-25T02:21:18.931 INFO:teuthology.orchestra.run.smithi077.stderr:listed 39 entries 2024-04-25T02:21:18.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.927+0000 7f94b611d640 1 -- 172.21.15.77:0/1275968535 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f949806e0b0 msgr2=0x7f9498070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:18.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.927+0000 7f94b611d640 1 --2- 172.21.15.77:0/1275968535 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f949806e0b0 0x7f9498070560 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f94a4000c00 tx=0x7f94a4009da0 comp rx=0 tx=0).stop 2024-04-25T02:21:18.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.927+0000 7f94b611d640 1 -- 172.21.15.77:0/1275968535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94b00fd1b0 msgr2=0x7f94b0112d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:18.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.927+0000 7f94b611d640 1 --2- 172.21.15.77:0/1275968535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94b00fd1b0 0x7f94b0112d70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f94a0002a50 tx=0x7f94a0004600 comp rx=0 tx=0).stop 2024-04-25T02:21:18.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.927+0000 7f94b611d640 1 -- 172.21.15.77:0/1275968535 shutdown_connections 2024-04-25T02:21:18.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.927+0000 7f94b611d640 1 --2- 172.21.15.77:0/1275968535 >> [v2:172.21.15.77:6800/3291613354,v1:172.21.15.77:6801/3291613354] conn(0x7f949806e0b0 0x7f9498070560 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:18.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.927+0000 7f94b611d640 1 --2- 172.21.15.77:0/1275968535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94b00fdb50 0x7f94b01132b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:18.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.927+0000 7f94b611d640 1 --2- 172.21.15.77:0/1275968535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94b00fd1b0 0x7f94b0112d70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:21:18.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.927+0000 7f94b611d640 1 -- 172.21.15.77:0/1275968535 >> 172.21.15.77:0/1275968535 conn(0x7f94b00f6c70 msgr2=0x7f94b00f8090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:18.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.927+0000 7f94b611d640 1 -- 172.21.15.77:0/1275968535 shutdown_connections 2024-04-25T02:21:18.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T02:21:18.927+0000 7f94b611d640 1 -- 172.21.15.77:0/1275968535 wait complete. 2024-04-25T02:21:18.941 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-25T02:21:18.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:21:18.942 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-04-25T02:21:18.974 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-04-25T02:21:18.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:21:18.974 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-25T02:21:19.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:21:19.050 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-04-25T02:21:19.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T02:21:19.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:21:19.066 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:21:19.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:21:19.131 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link delete ceph-brx 2024-04-25T02:21:19.193 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:18 smithi077 ceph-mon[110441]: pgmap v274: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:21:19.193 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:18 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/1219619279' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:21:19.193 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:18 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/617203255' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-25T02:21:19.193 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:18 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/391169206' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-25T02:21:19.193 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:18 smithi077 ceph-mon[110441]: from='client.? 172.21.15.77:0/1275968535' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T02:21:19.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:21:19.237 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-04-25T02:21:19.256 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T02:21:19.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:21:19.257 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T02:21:19.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:18 smithi112 ceph-mon[80494]: pgmap v274: 65 pgs: 65 active+clean; 194 MiB data, 783 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:21:19.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:18 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/1219619279' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:21:19.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:18 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/617203255' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-25T02:21:19.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:18 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/391169206' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-25T02:21:19.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:18 smithi112 ceph-mon[80494]: from='client.? 172.21.15.77:0/1275968535' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T02:21:19.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:21:19.305 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2024-04-25T02:21:19.402 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-25T02:21:19.413 INFO:tasks.cephadm:Teardown begin 2024-04-25T02:21:19.414 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T02:21:19.438 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T02:21:19.465 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-25T02:21:19.466 DEBUG:teuthology.orchestra.run.smithi077:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-25T02:21:19.493 DEBUG:teuthology.orchestra.run.smithi112:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-25T02:21:19.521 INFO:tasks.cephadm:Stopping all daemons... 2024-04-25T02:21:19.521 INFO:tasks.cephadm.mon.smithi077:Stopping mon.smithi077... 2024-04-25T02:21:19.521 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@mon.smithi077 2024-04-25T02:21:19.815 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:19 smithi077 systemd[1]: Stopping Ceph mon.smithi077 for 4bb93d82-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:21:20.174 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:19 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi077[110436]: 2024-04-25T02:21:19.811+0000 7f54cd199700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi077 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:21:20.175 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:19 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi077[110436]: 2024-04-25T02:21:19.811+0000 7f54cd199700 -1 mon.smithi077@0(leader) e3 *** Got Signal Terminated *** 2024-04-25T02:21:20.175 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:19 smithi077 podman[151412]: 2024-04-25 02:21:19.873278096 +0000 UTC m=+0.159988257 container died 06490c2ecc449edf566ac9ec9f04ab5b8888478e05a1ed4ba67e37fa05f178d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi077, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-d2c45d9, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-25T02:21:20.475 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:20 smithi077 podman[151412]: 2024-04-25 02:21:20.270585491 +0000 UTC m=+0.557295660 container cleanup 06490c2ecc449edf566ac9ec9f04ab5b8888478e05a1ed4ba67e37fa05f178d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi077, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-04-25T02:21:20.475 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Apr 25 02:21:20 smithi077 bash[151412]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi077 2024-04-25T02:21:20.614 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@mon.smithi077.service' 2024-04-25T02:21:20.662 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:21:20.662 INFO:tasks.cephadm.mon.smithi077:Stopped mon.smithi077 2024-04-25T02:21:20.662 INFO:tasks.cephadm.mon.smithi112:Stopping mon.smithi112... 2024-04-25T02:21:20.662 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@mon.smithi112 2024-04-25T02:21:21.012 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:20 smithi112 systemd[1]: Stopping Ceph mon.smithi112 for 4bb93d82-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:21:21.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:21 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi112[80490]: 2024-04-25T02:21:21.007+0000 7f31e3e59700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi112 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:21:21.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:21 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi112[80490]: 2024-04-25T02:21:21.007+0000 7f31e3e59700 -1 mon.smithi112@1(peon) e3 *** Got Signal Terminated *** 2024-04-25T02:21:21.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:21 smithi112 podman[111776]: 2024-04-25 02:21:21.038620031 +0000 UTC m=+0.185400128 container died ccd1398acbc5a479337cac5f14f1d1711d786c61de43cdeabbbc2f3bbab006d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi112, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-d2c45d9, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-04-25T02:21:21.615 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:21 smithi112 podman[111776]: 2024-04-25 02:21:21.439513514 +0000 UTC m=+0.586293610 container cleanup ccd1398acbc5a479337cac5f14f1d1711d786c61de43cdeabbbc2f3bbab006d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi112, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-d2c45d9, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-25T02:21:21.616 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:21 smithi112 bash[111776]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi112 2024-04-25T02:21:21.854 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@mon.smithi112.service' 2024-04-25T02:21:21.875 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:21 smithi112 podman[111790]: 2024-04-25 02:21:21.726818882 +0000 UTC m=+0.684412370 container remove ccd1398acbc5a479337cac5f14f1d1711d786c61de43cdeabbbc2f3bbab006d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-mon-smithi112, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-d2c45d9, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424) 2024-04-25T02:21:21.875 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:21 smithi112 systemd[1]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@mon.smithi112.service: Deactivated successfully. 2024-04-25T02:21:21.875 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:21 smithi112 systemd[1]: Stopped Ceph mon.smithi112 for 4bb93d82-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:21:21.875 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Apr 25 02:21:21 smithi112 systemd[1]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@mon.smithi112.service: Consumed 4.381s CPU time. 2024-04-25T02:21:21.898 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:21:21.898 INFO:tasks.cephadm.mon.smithi112:Stopped mon.smithi112 2024-04-25T02:21:21.898 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-25T02:21:21.898 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.0 2024-04-25T02:21:22.186 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:21:21 smithi077 systemd[1]: Stopping Ceph osd.0 for 4bb93d82-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:21:22.476 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:21:22 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0[121722]: 2024-04-25T02:21:22.182+0000 7f35b94bc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:21:22.477 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:21:22 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0[121722]: 2024-04-25T02:21:22.182+0000 7f35b94bc700 -1 osd.0 84 *** Got signal Terminated *** 2024-04-25T02:21:22.477 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:21:22 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0[121722]: 2024-04-25T02:21:22.182+0000 7f35b94bc700 -1 osd.0 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T02:21:27.913 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:21:27 smithi077 podman[151545]: 2024-04-25 02:21:27.628573809 +0000 UTC m=+5.544999022 container died 7035e288ddaed293a9975987137a82ec2ac550646e4b02eb47041f5965db3bac (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-d2c45d9, org.label-schema.schema-version=1.0) 2024-04-25T02:21:28.227 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:21:28 smithi077 podman[151545]: 2024-04-25 02:21:28.008509069 +0000 UTC m=+5.924934278 container cleanup 7035e288ddaed293a9975987137a82ec2ac550646e4b02eb47041f5965db3bac (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T02:21:28.227 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:21:28 smithi077 bash[151545]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0 2024-04-25T02:21:28.584 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:21:28 smithi077 podman[151564]: 2024-04-25 02:21:28.259973801 +0000 UTC m=+0.631385379 container remove 7035e288ddaed293a9975987137a82ec2ac550646e4b02eb47041f5965db3bac (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0, RELEASE=squid-d2c45d9, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-25T02:21:28.842 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:21:28 smithi077 podman[151656]: 2024-04-25 02:21:28.485071483 +0000 UTC m=+0.018176293 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:21:28.842 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:21:28 smithi077 podman[151656]: 2024-04-25 02:21:28.602721716 +0000 UTC m=+0.135826567 container create b783a460f1bec96bf3ac49cd29badb9e7fb2acbf8e91b0099eb52b5114300977 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:21:28.842 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:21:28 smithi077 podman[151656]: 2024-04-25 02:21:28.839126264 +0000 UTC m=+0.372231082 container init b783a460f1bec96bf3ac49cd29badb9e7fb2acbf8e91b0099eb52b5114300977 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-d2c45d9, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5) 2024-04-25T02:21:29.155 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:21:28 smithi077 podman[151656]: 2024-04-25 02:21:28.842500633 +0000 UTC m=+0.375605453 container start b783a460f1bec96bf3ac49cd29badb9e7fb2acbf8e91b0099eb52b5114300977 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-d2c45d9, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T02:21:29.156 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:21:28 smithi077 podman[151656]: 2024-04-25 02:21:28.914094001 +0000 UTC m=+0.447198825 container attach b783a460f1bec96bf3ac49cd29badb9e7fb2acbf8e91b0099eb52b5114300977 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0-deactivate, RELEASE=squid-d2c45d9, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:21:29.476 INFO:journalctl@ceph.osd.0.smithi077.stdout:Apr 25 02:21:29 smithi077 podman[151656]: 2024-04-25 02:21:29.15355199 +0000 UTC m=+0.686656805 container died b783a460f1bec96bf3ac49cd29badb9e7fb2acbf8e91b0099eb52b5114300977 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=squid-d2c45d9, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:21:29.788 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.0.service' 2024-04-25T02:21:29.827 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:21:29.827 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-25T02:21:29.828 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-25T02:21:29.828 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.1 2024-04-25T02:21:30.142 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:21:29 smithi077 systemd[1]: Stopping Ceph osd.1 for 4bb93d82-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:21:30.476 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:21:30 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1[127174]: 2024-04-25T02:21:30.136+0000 7f744b982700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:21:30.476 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:21:30 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1[127174]: 2024-04-25T02:21:30.137+0000 7f744b982700 -1 osd.1 84 *** Got signal Terminated *** 2024-04-25T02:21:30.476 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:21:30 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1[127174]: 2024-04-25T02:21:30.137+0000 7f744b982700 -1 osd.1 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T02:21:35.850 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:21:35 smithi077 podman[151766]: 2024-04-25 02:21:35.571574753 +0000 UTC m=+5.526198835 container died 6e514f700c365ce5acc1b742ee9376ebb9c9aa53a7e0da8282e0f5fa42f9fb01 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-d2c45d9, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True) 2024-04-25T02:21:36.192 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:21:35 smithi077 podman[151766]: 2024-04-25 02:21:35.938049296 +0000 UTC m=+5.892673374 container cleanup 6e514f700c365ce5acc1b742ee9376ebb9c9aa53a7e0da8282e0f5fa42f9fb01 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1, RELEASE=squid-d2c45d9, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:21:36.192 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:21:35 smithi077 bash[151766]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1 2024-04-25T02:21:36.476 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:21:36 smithi077 podman[151785]: 2024-04-25 02:21:36.189340215 +0000 UTC m=+0.613789994 container remove 6e514f700c365ce5acc1b742ee9376ebb9c9aa53a7e0da8282e0f5fa42f9fb01 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-d2c45d9, ceph=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:21:36.820 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:21:36 smithi077 podman[151875]: 2024-04-25 02:21:36.40052261 +0000 UTC m=+0.017973352 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:21:36.820 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:21:36 smithi077 podman[151875]: 2024-04-25 02:21:36.51532408 +0000 UTC m=+0.132774834 container create 7fe57bacda870c1b5a0fd80544018934b08cc0f6eba5801eecdd6f956fed8fdd (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=squid-d2c45d9, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-25T02:21:36.821 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:21:36 smithi077 podman[151875]: 2024-04-25 02:21:36.743219816 +0000 UTC m=+0.360670536 container init 7fe57bacda870c1b5a0fd80544018934b08cc0f6eba5801eecdd6f956fed8fdd (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=squid-d2c45d9, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:21:36.821 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:21:36 smithi077 podman[151875]: 2024-04-25 02:21:36.746592188 +0000 UTC m=+0.364042913 container start 7fe57bacda870c1b5a0fd80544018934b08cc0f6eba5801eecdd6f956fed8fdd (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1-deactivate, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-d2c45d9, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:21:36.821 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:21:36 smithi077 podman[151875]: 2024-04-25 02:21:36.817695216 +0000 UTC m=+0.435145949 container attach 7fe57bacda870c1b5a0fd80544018934b08cc0f6eba5801eecdd6f956fed8fdd (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-d2c45d9, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5) 2024-04-25T02:21:37.226 INFO:journalctl@ceph.osd.1.smithi077.stdout:Apr 25 02:21:37 smithi077 podman[151875]: 2024-04-25 02:21:37.041153879 +0000 UTC m=+0.658604599 container died 7fe57bacda870c1b5a0fd80544018934b08cc0f6eba5801eecdd6f956fed8fdd (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:21:37.578 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.1.service' 2024-04-25T02:21:37.619 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:21:37.619 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-25T02:21:37.620 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-25T02:21:37.620 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.2 2024-04-25T02:21:37.944 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:21:37 smithi077 systemd[1]: Stopping Ceph osd.2 for 4bb93d82-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:21:38.226 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:21:37 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2[133023]: 2024-04-25T02:21:37.939+0000 7f6b66291700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:21:38.289 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:21:37 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2[133023]: 2024-04-25T02:21:37.939+0000 7f6b66291700 -1 osd.2 84 *** Got signal Terminated *** 2024-04-25T02:21:38.290 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:21:37 smithi077 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2[133023]: 2024-04-25T02:21:37.939+0000 7f6b66291700 -1 osd.2 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T02:21:43.762 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:21:43 smithi077 podman[151981]: 2024-04-25 02:21:43.487328574 +0000 UTC m=+5.644150758 container died 392fd2036c1677a3f4fdaeeb8182acd4a4589eba372713842f185810e726f603 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-04-25T02:21:44.111 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:21:43 smithi077 podman[151981]: 2024-04-25 02:21:43.849218532 +0000 UTC m=+6.006040713 container cleanup 392fd2036c1677a3f4fdaeeb8182acd4a4589eba372713842f185810e726f603 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2, RELEASE=squid-d2c45d9, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-04-25T02:21:44.112 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:21:43 smithi077 bash[151981]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2 2024-04-25T02:21:44.424 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:21:44 smithi077 podman[151998]: 2024-04-25 02:21:44.108821774 +0000 UTC m=+0.619667787 container remove 392fd2036c1677a3f4fdaeeb8182acd4a4589eba372713842f185810e726f603 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-d2c45d9) 2024-04-25T02:21:44.727 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:21:44 smithi077 podman[152093]: 2024-04-25 02:21:44.324763582 +0000 UTC m=+0.018050401 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:21:44.727 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:21:44 smithi077 podman[152093]: 2024-04-25 02:21:44.434896369 +0000 UTC m=+0.128183175 container create f8d6a31665d7a97fcb482d2dc60adc3f898c6e2e0f97de16abbdd2b9b7019705 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-d2c45d9, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS) 2024-04-25T02:21:44.727 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:21:44 smithi077 podman[152093]: 2024-04-25 02:21:44.653887182 +0000 UTC m=+0.347173989 container init f8d6a31665d7a97fcb482d2dc60adc3f898c6e2e0f97de16abbdd2b9b7019705 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-d2c45d9, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-25T02:21:44.727 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:21:44 smithi077 podman[152093]: 2024-04-25 02:21:44.657097689 +0000 UTC m=+0.350384499 container start f8d6a31665d7a97fcb482d2dc60adc3f898c6e2e0f97de16abbdd2b9b7019705 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-d2c45d9, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-25T02:21:45.226 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:21:44 smithi077 podman[152093]: 2024-04-25 02:21:44.762892146 +0000 UTC m=+0.456178962 container attach f8d6a31665d7a97fcb482d2dc60adc3f898c6e2e0f97de16abbdd2b9b7019705 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-d2c45d9, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-04-25T02:21:45.227 INFO:journalctl@ceph.osd.2.smithi077.stdout:Apr 25 02:21:44 smithi077 podman[152093]: 2024-04-25 02:21:44.949140102 +0000 UTC m=+0.642426909 container died f8d6a31665d7a97fcb482d2dc60adc3f898c6e2e0f97de16abbdd2b9b7019705 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-d2c45d9, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-04-25T02:21:45.528 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.2.service' 2024-04-25T02:21:45.567 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:21:45.567 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-25T02:21:45.567 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-25T02:21:45.567 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.3 2024-04-25T02:21:45.882 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:21:45 smithi112 systemd[1]: Stopping Ceph osd.3 for 4bb93d82-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:21:46.276 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:21:45 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3[89576]: 2024-04-25T02:21:45.877+0000 7fe7ce6d8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:21:46.276 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:21:45 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3[89576]: 2024-04-25T02:21:45.877+0000 7fe7ce6d8700 -1 osd.3 84 *** Got signal Terminated *** 2024-04-25T02:21:46.276 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:21:45 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3[89576]: 2024-04-25T02:21:45.877+0000 7fe7ce6d8700 -1 osd.3 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T02:21:51.665 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:21:51 smithi112 podman[111909]: 2024-04-25 02:21:51.37617881 +0000 UTC m=+5.609677569 container died c100df1a0f60920c8a0f96cdcde3bff35175cf74e96d04730fe0e05583fb1fad (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-d2c45d9, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-04-25T02:21:52.026 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:21:51 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4[94481]: 2024-04-25T02:21:51.712+0000 7f6991404700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-04-25T02:21:21.627709+0000 front 2024-04-25T02:21:21.627670+0000 (oldest deadline 2024-04-25T02:21:51.628095+0000) 2024-04-25T02:21:52.026 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:21:51 smithi112 podman[111909]: 2024-04-25 02:21:51.862616938 +0000 UTC m=+6.096115695 container cleanup c100df1a0f60920c8a0f96cdcde3bff35175cf74e96d04730fe0e05583fb1fad (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-25T02:21:52.026 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:21:51 smithi112 bash[111909]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3 2024-04-25T02:21:52.480 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:21:52 smithi112 podman[111929]: 2024-04-25 02:21:52.139249195 +0000 UTC m=+0.754976713 container remove c100df1a0f60920c8a0f96cdcde3bff35175cf74e96d04730fe0e05583fb1fad (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T02:21:52.754 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:21:52 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4[94481]: 2024-04-25T02:21:52.717+0000 7f6991404700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-04-25T02:21:21.627709+0000 front 2024-04-25T02:21:21.627670+0000 (oldest deadline 2024-04-25T02:21:51.628095+0000) 2024-04-25T02:21:52.754 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:21:52 smithi112 podman[112023]: 2024-04-25 02:21:52.379848457 +0000 UTC m=+0.018288602 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:21:52.754 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:21:52 smithi112 podman[112023]: 2024-04-25 02:21:52.481704066 +0000 UTC m=+0.120144198 container create ae7145f0c2a5ad7b4e0072d282f9aa86086df4abd425984357043f40ca51b69b (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424) 2024-04-25T02:21:52.755 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:21:52 smithi112 podman[112023]: 2024-04-25 02:21:52.693063494 +0000 UTC m=+0.331503634 container init ae7145f0c2a5ad7b4e0072d282f9aa86086df4abd425984357043f40ca51b69b (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-04-25T02:21:52.755 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:21:52 smithi112 podman[112023]: 2024-04-25 02:21:52.696488286 +0000 UTC m=+0.334928429 container start ae7145f0c2a5ad7b4e0072d282f9aa86086df4abd425984357043f40ca51b69b (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-04-25T02:21:53.026 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:21:52 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:21:52.750+0000 7f633c424700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-04-25T02:21:25.966849+0000 front 2024-04-25T02:21:25.967011+0000 (oldest deadline 2024-04-25T02:21:51.866702+0000) 2024-04-25T02:21:53.027 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:21:52 smithi112 podman[112023]: 2024-04-25 02:21:52.770932482 +0000 UTC m=+0.409372615 container attach ae7145f0c2a5ad7b4e0072d282f9aa86086df4abd425984357043f40ca51b69b (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-25T02:21:53.027 INFO:journalctl@ceph.osd.3.smithi112.stdout:Apr 25 02:21:52 smithi112 podman[112023]: 2024-04-25 02:21:52.979587568 +0000 UTC m=+0.618027701 container died ae7145f0c2a5ad7b4e0072d282f9aa86086df4abd425984357043f40ca51b69b (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, RELEASE=squid-d2c45d9, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424) 2024-04-25T02:21:53.585 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.3.service' 2024-04-25T02:21:53.623 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:21:53.623 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-25T02:21:53.623 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-25T02:21:53.623 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.4 2024-04-25T02:21:53.935 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:21:53 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:21:53.731+0000 7f633c424700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-04-25T02:21:25.966849+0000 front 2024-04-25T02:21:25.967011+0000 (oldest deadline 2024-04-25T02:21:51.866702+0000) 2024-04-25T02:21:53.936 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:21:53 smithi112 systemd[1]: Stopping Ceph osd.4 for 4bb93d82-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:21:53.936 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:21:53 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4[94481]: 2024-04-25T02:21:53.751+0000 7f6991404700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-04-25T02:21:21.627709+0000 front 2024-04-25T02:21:21.627670+0000 (oldest deadline 2024-04-25T02:21:51.628095+0000) 2024-04-25T02:21:53.936 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:21:53 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4[94481]: 2024-04-25T02:21:53.931+0000 7f699460f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:21:53.936 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:21:53 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4[94481]: 2024-04-25T02:21:53.931+0000 7f699460f700 -1 osd.4 84 *** Got signal Terminated *** 2024-04-25T02:21:53.936 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:21:53 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4[94481]: 2024-04-25T02:21:53.931+0000 7f699460f700 -1 osd.4 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T02:21:55.026 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:21:54 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4[94481]: 2024-04-25T02:21:54.764+0000 7f6991404700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-04-25T02:21:21.627709+0000 front 2024-04-25T02:21:21.627670+0000 (oldest deadline 2024-04-25T02:21:51.628095+0000) 2024-04-25T02:21:55.027 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:21:54 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:21:54.727+0000 7f633c424700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-04-25T02:21:25.966849+0000 front 2024-04-25T02:21:25.967011+0000 (oldest deadline 2024-04-25T02:21:51.866702+0000) 2024-04-25T02:21:56.026 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:21:55 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4[94481]: 2024-04-25T02:21:55.795+0000 7f6991404700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-04-25T02:21:21.627709+0000 front 2024-04-25T02:21:21.627670+0000 (oldest deadline 2024-04-25T02:21:51.628095+0000) 2024-04-25T02:21:56.027 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:21:55 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:21:55.712+0000 7f633c424700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-04-25T02:21:25.966849+0000 front 2024-04-25T02:21:25.967011+0000 (oldest deadline 2024-04-25T02:21:51.866702+0000) 2024-04-25T02:21:57.026 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:21:56 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4[94481]: 2024-04-25T02:21:56.759+0000 7f6991404700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-04-25T02:21:21.627709+0000 front 2024-04-25T02:21:21.627670+0000 (oldest deadline 2024-04-25T02:21:51.628095+0000) 2024-04-25T02:21:57.026 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:21:56 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:21:56.736+0000 7f633c424700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-04-25T02:21:25.966849+0000 front 2024-04-25T02:21:25.967011+0000 (oldest deadline 2024-04-25T02:21:51.866702+0000) 2024-04-25T02:21:58.026 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:21:57 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4[94481]: 2024-04-25T02:21:57.752+0000 7f6991404700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-04-25T02:21:21.627709+0000 front 2024-04-25T02:21:21.627670+0000 (oldest deadline 2024-04-25T02:21:51.628095+0000) 2024-04-25T02:21:58.027 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:21:57 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:21:57.738+0000 7f633c424700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-04-25T02:21:25.966849+0000 front 2024-04-25T02:21:25.967011+0000 (oldest deadline 2024-04-25T02:21:51.866702+0000) 2024-04-25T02:21:58.027 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:21:57 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:21:57.738+0000 7f633c424700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6814 osd.1 since back 2024-04-25T02:21:31.867161+0000 front 2024-04-25T02:21:31.867133+0000 (oldest deadline 2024-04-25T02:21:57.167094+0000) 2024-04-25T02:21:59.026 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:21:58 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:21:58.704+0000 7f633c424700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-04-25T02:21:25.966849+0000 front 2024-04-25T02:21:25.967011+0000 (oldest deadline 2024-04-25T02:21:51.866702+0000) 2024-04-25T02:21:59.026 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:21:58 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:21:58.704+0000 7f633c424700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6814 osd.1 since back 2024-04-25T02:21:31.867161+0000 front 2024-04-25T02:21:31.867133+0000 (oldest deadline 2024-04-25T02:21:57.167094+0000) 2024-04-25T02:21:59.027 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:21:58 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4[94481]: 2024-04-25T02:21:58.759+0000 7f6991404700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-04-25T02:21:21.627709+0000 front 2024-04-25T02:21:21.627670+0000 (oldest deadline 2024-04-25T02:21:51.628095+0000) 2024-04-25T02:21:59.027 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:21:58 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4[94481]: 2024-04-25T02:21:58.759+0000 7f6991404700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.77:6814 osd.1 since back 2024-04-25T02:21:32.729264+0000 front 2024-04-25T02:21:32.729319+0000 (oldest deadline 2024-04-25T02:21:58.029055+0000) 2024-04-25T02:21:59.662 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:21:59 smithi112 podman[112128]: 2024-04-25 02:21:59.406171895 +0000 UTC m=+5.570414080 container died 669b1ab41e273de54f54dee222b902c909f589775789f95fe2ea6177b51975dd (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-d2c45d9, GIT_BRANCH=HEAD) 2024-04-25T02:22:00.026 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:21:59 smithi112 podman[112128]: 2024-04-25 02:21:59.840935151 +0000 UTC m=+6.005177334 container cleanup 669b1ab41e273de54f54dee222b902c909f589775789f95fe2ea6177b51975dd (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:22:00.026 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:21:59 smithi112 bash[112128]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4 2024-04-25T02:22:00.027 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:21:59 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:21:59.707+0000 7f633c424700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-04-25T02:21:25.966849+0000 front 2024-04-25T02:21:25.967011+0000 (oldest deadline 2024-04-25T02:21:51.866702+0000) 2024-04-25T02:22:00.027 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:21:59 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:21:59.707+0000 7f633c424700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6814 osd.1 since back 2024-04-25T02:21:31.867161+0000 front 2024-04-25T02:21:31.867133+0000 (oldest deadline 2024-04-25T02:21:57.167094+0000) 2024-04-25T02:22:00.458 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:22:00 smithi112 podman[112146]: 2024-04-25 02:22:00.04577561 +0000 UTC m=+0.632346531 container remove 669b1ab41e273de54f54dee222b902c909f589775789f95fe2ea6177b51975dd (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=squid-d2c45d9, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True) 2024-04-25T02:22:00.754 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:22:00 smithi112 podman[112238]: 2024-04-25 02:22:00.358770652 +0000 UTC m=+0.018315818 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:22:00.754 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:22:00 smithi112 podman[112238]: 2024-04-25 02:22:00.46820163 +0000 UTC m=+0.127746825 container create 11bf61f3146da001b01ce075f8bf2853a798664cd11833faadf0d5296f3f77bc (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, ceph=True) 2024-04-25T02:22:00.754 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:22:00 smithi112 podman[112238]: 2024-04-25 02:22:00.686582452 +0000 UTC m=+0.346127604 container init 11bf61f3146da001b01ce075f8bf2853a798664cd11833faadf0d5296f3f77bc (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, RELEASE=squid-d2c45d9, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:22:00.755 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:22:00 smithi112 podman[112238]: 2024-04-25 02:22:00.68959197 +0000 UTC m=+0.349137132 container start 11bf61f3146da001b01ce075f8bf2853a798664cd11833faadf0d5296f3f77bc (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240424, ceph=True) 2024-04-25T02:22:01.026 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:22:00 smithi112 podman[112238]: 2024-04-25 02:22:00.770658528 +0000 UTC m=+0.430203681 container attach 11bf61f3146da001b01ce075f8bf2853a798664cd11833faadf0d5296f3f77bc (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-25T02:22:01.027 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 02:22:00 smithi112 podman[112238]: 2024-04-25 02:22:00.976624065 +0000 UTC m=+0.636169220 container died 11bf61f3146da001b01ce075f8bf2853a798664cd11833faadf0d5296f3f77bc (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240424, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-d2c45d9, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:22:01.027 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:00 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:22:00.750+0000 7f633c424700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-04-25T02:21:25.966849+0000 front 2024-04-25T02:21:25.967011+0000 (oldest deadline 2024-04-25T02:21:51.866702+0000) 2024-04-25T02:22:01.027 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:00 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:22:00.750+0000 7f633c424700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6814 osd.1 since back 2024-04-25T02:21:31.867161+0000 front 2024-04-25T02:21:31.867133+0000 (oldest deadline 2024-04-25T02:21:57.167094+0000) 2024-04-25T02:22:01.648 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.4.service' 2024-04-25T02:22:01.688 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:22:01.688 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-25T02:22:01.688 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-25T02:22:01.689 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.5 2024-04-25T02:22:02.026 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:01 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:22:01.761+0000 7f633c424700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-04-25T02:21:25.966849+0000 front 2024-04-25T02:21:25.967011+0000 (oldest deadline 2024-04-25T02:21:51.866702+0000) 2024-04-25T02:22:02.026 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:01 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:22:01.761+0000 7f633c424700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6814 osd.1 since back 2024-04-25T02:21:31.867161+0000 front 2024-04-25T02:21:31.867133+0000 (oldest deadline 2024-04-25T02:21:57.167094+0000) 2024-04-25T02:22:02.026 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:01 smithi112 systemd[1]: Stopping Ceph osd.5 for 4bb93d82-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:22:02.526 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:02 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:22:02.068+0000 7f6343637700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:22:02.526 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:02 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:22:02.068+0000 7f6343637700 -1 osd.5 84 *** Got signal Terminated *** 2024-04-25T02:22:02.526 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:02 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:22:02.068+0000 7f6343637700 -1 osd.5 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T02:22:03.026 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:02 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:22:02.764+0000 7f633c424700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-04-25T02:21:25.966849+0000 front 2024-04-25T02:21:25.967011+0000 (oldest deadline 2024-04-25T02:21:51.866702+0000) 2024-04-25T02:22:03.026 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:02 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:22:02.764+0000 7f633c424700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6814 osd.1 since back 2024-04-25T02:21:31.867161+0000 front 2024-04-25T02:21:31.867133+0000 (oldest deadline 2024-04-25T02:21:57.167094+0000) 2024-04-25T02:22:04.026 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:03 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:22:03.759+0000 7f633c424700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-04-25T02:21:25.966849+0000 front 2024-04-25T02:21:25.967011+0000 (oldest deadline 2024-04-25T02:21:51.866702+0000) 2024-04-25T02:22:04.026 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:03 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:22:03.759+0000 7f633c424700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6814 osd.1 since back 2024-04-25T02:21:31.867161+0000 front 2024-04-25T02:21:31.867133+0000 (oldest deadline 2024-04-25T02:21:57.167094+0000) 2024-04-25T02:22:05.026 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:04 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:22:04.736+0000 7f633c424700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-04-25T02:21:25.966849+0000 front 2024-04-25T02:21:25.967011+0000 (oldest deadline 2024-04-25T02:21:51.866702+0000) 2024-04-25T02:22:05.026 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:04 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:22:04.736+0000 7f633c424700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6814 osd.1 since back 2024-04-25T02:21:31.867161+0000 front 2024-04-25T02:21:31.867133+0000 (oldest deadline 2024-04-25T02:21:57.167094+0000) 2024-04-25T02:22:06.026 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:05 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:22:05.746+0000 7f633c424700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-04-25T02:21:25.966849+0000 front 2024-04-25T02:21:25.967011+0000 (oldest deadline 2024-04-25T02:21:51.866702+0000) 2024-04-25T02:22:06.026 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:05 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:22:05.746+0000 7f633c424700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6814 osd.1 since back 2024-04-25T02:21:31.867161+0000 front 2024-04-25T02:21:31.867133+0000 (oldest deadline 2024-04-25T02:21:57.167094+0000) 2024-04-25T02:22:07.026 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:06 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:22:06.699+0000 7f633c424700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-04-25T02:21:25.966849+0000 front 2024-04-25T02:21:25.967011+0000 (oldest deadline 2024-04-25T02:21:51.866702+0000) 2024-04-25T02:22:07.026 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:06 smithi112 ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5[99359]: 2024-04-25T02:22:06.699+0000 7f633c424700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.77:6814 osd.1 since back 2024-04-25T02:21:31.867161+0000 front 2024-04-25T02:21:31.867133+0000 (oldest deadline 2024-04-25T02:21:57.167094+0000) 2024-04-25T02:22:07.739 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:07 smithi112 podman[112343]: 2024-04-25 02:22:07.463795538 +0000 UTC m=+5.557688024 container died cc8f3462943ef3854d1c4e6b72e5c664d1f850c8a051a77833f6038ec3c54c41 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-04-25T02:22:08.026 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:07 smithi112 podman[112343]: 2024-04-25 02:22:07.902219453 +0000 UTC m=+5.996111976 container cleanup cc8f3462943ef3854d1c4e6b72e5c664d1f850c8a051a77833f6038ec3c54c41 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9) 2024-04-25T02:22:08.026 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:07 smithi112 bash[112343]: ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5 2024-04-25T02:22:08.486 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:08 smithi112 podman[112361]: 2024-04-25 02:22:08.099888919 +0000 UTC m=+0.632284669 container remove cc8f3462943ef3854d1c4e6b72e5c664d1f850c8a051a77833f6038ec3c54c41 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5, RELEASE=squid-d2c45d9, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240424) 2024-04-25T02:22:08.776 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:08 smithi112 podman[112450]: 2024-04-25 02:22:08.483922048 +0000 UTC m=+0.103589149 container create f9f7548cd2cbc00fde1a1543cf344d24602d528e45e1fd82b089920de6e7b991 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True) 2024-04-25T02:22:08.777 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:08 smithi112 podman[112450]: 2024-04-25 02:22:08.398130415 +0000 UTC m=+0.017797533 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:22:08.777 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:08 smithi112 podman[112450]: 2024-04-25 02:22:08.694592424 +0000 UTC m=+0.314259526 container init f9f7548cd2cbc00fde1a1543cf344d24602d528e45e1fd82b089920de6e7b991 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-d2c45d9, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-04-25T02:22:08.777 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:08 smithi112 podman[112450]: 2024-04-25 02:22:08.697583439 +0000 UTC m=+0.317250550 container start f9f7548cd2cbc00fde1a1543cf344d24602d528e45e1fd82b089920de6e7b991 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD) 2024-04-25T02:22:09.276 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:08 smithi112 podman[112450]: 2024-04-25 02:22:08.777915234 +0000 UTC m=+0.397582354 container attach f9f7548cd2cbc00fde1a1543cf344d24602d528e45e1fd82b089920de6e7b991 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, RELEASE=squid-d2c45d9, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-04-25T02:22:09.276 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:08 smithi112 podman[112450]: 2024-04-25 02:22:08.989060574 +0000 UTC m=+0.608727675 container died f9f7548cd2cbc00fde1a1543cf344d24602d528e45e1fd82b089920de6e7b991 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-25T02:22:09.545 INFO:journalctl@ceph.osd.5.smithi112.stdout:Apr 25 02:22:09 smithi112 podman[112475]: 2024-04-25 02:22:09.539528831 +0000 UTC m=+0.545192427 container remove f9f7548cd2cbc00fde1a1543cf344d24602d528e45e1fd82b089920de6e7b991 (image=quay.ceph.io/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-4bb93d82-02a7-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, ceph=True) 2024-04-25T02:22:09.563 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4bb93d82-02a7-11ef-bc93-c7b262605968@osd.5.service' 2024-04-25T02:22:09.601 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:22:09.602 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-25T02:22:09.602 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-25T02:22:34.947 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-25T02:22:49.227 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T02:22:49.260 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T02:22:49.286 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-25T02:22:49.287 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672363/remote/smithi077/crash 2024-04-25T02:22:49.288 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/crash -- . 2024-04-25T02:22:49.326 INFO:teuthology.orchestra.run.smithi077.stderr:tar: /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-25T02:22:49.326 INFO:teuthology.orchestra.run.smithi077.stderr:tar: Error is not recoverable: exiting now 2024-04-25T02:22:49.328 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672363/remote/smithi112/crash 2024-04-25T02:22:49.329 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/crash -- . 2024-04-25T02:22:49.352 INFO:teuthology.orchestra.run.smithi112.stderr:tar: /var/lib/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-25T02:22:49.352 INFO:teuthology.orchestra.run.smithi112.stderr:tar: Error is not recoverable: exiting now 2024-04-25T02:22:49.353 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-25T02:22:49.353 DEBUG:teuthology.orchestra.run.smithi077:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | head -n 1 2024-04-25T02:22:49.407 INFO:teuthology.orchestra.run.smithi077.stdout:1714011030.4741654 mon.smithi077 (mon.0) 945 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-25T02:22:49.408 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-04-25T02:22:49.408 DEBUG:teuthology.orchestra.run.smithi077:> sudo egrep '\[SEC\]' /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | head -n 1 2024-04-25T02:22:49.479 DEBUG:teuthology.orchestra.run.smithi077:> sudo egrep '\[ERR\]' /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | head -n 1 2024-04-25T02:22:49.549 DEBUG:teuthology.orchestra.run.smithi077:> sudo egrep '\[WRN\]' /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | head -n 1 2024-04-25T02:22:49.622 INFO:teuthology.orchestra.run.smithi077.stdout:1714011030.4741654 mon.smithi077 (mon.0) 945 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-25T02:22:49.622 INFO:tasks.cephadm:Compressing logs... 2024-04-25T02:22:49.622 DEBUG:teuthology.orchestra.run.smithi077:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T02:22:49.665 DEBUG:teuthology.orchestra.run.smithi112:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T02:22:49.686 INFO:teuthology.orchestra.run.smithi077.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph.log 2024-04-25T02:22:49.687 INFO:teuthology.orchestra.run.smithi077.stderr:: No such file or directory 2024-04-25T02:22:49.687 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-osd.2.log 2024-04-25T02:22:49.687 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-25T02:22:49.687 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-osd.1.log 2024-04-25T02:22:49.687 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-osd.0.log 2024-04-25T02:22:49.691 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi077.gcfygj.log 2024-04-25T02:22:49.691 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-mgr.smithi077.zpflzp.log 2024-04-25T02:22:49.691 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi077.gcfygj.log: gzip -5 --verbose -- /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-25T02:22:49.691 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-mgr.smithi077.zpflzp.log: 87.4% -- replaced with /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-25T02:22:49.691 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi077.oadrkb.log 2024-04-25T02:22:49.691 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph.cephadm.log: 85.5% -- replaced with /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-25T02:22:49.692 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-mon.smithi077.log 2024-04-25T02:22:49.693 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi077.oadrkb.log: 91.0% -- replaced with /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-25T02:22:49.693 INFO:teuthology.orchestra.run.smithi077.stderr: 93.9% -- replaced with /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi077.gcfygj.log.gz 2024-04-25T02:22:49.697 INFO:teuthology.orchestra.run.smithi112.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose: No such file or directory -- 2024-04-25T02:22:49.697 INFO:teuthology.orchestra.run.smithi112.stderr: /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-mon.smithi112.log 2024-04-25T02:22:49.697 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph.log 2024-04-25T02:22:49.697 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-25T02:22:49.697 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-mon.smithi112.log: gzip -5 --verbose -- /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-osd.5.log 2024-04-25T02:22:49.697 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph.log: /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-osd.3.log 2024-04-25T02:22:49.698 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-osd.4.log 2024-04-25T02:22:49.698 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-osd.5.log: /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-mgr.smithi112.cswrxs.log 2024-04-25T02:22:49.698 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi112.dvwudt.log 2024-04-25T02:22:49.698 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-25T02:22:49.698 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi112.dvwudt.log: /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-mgr.smithi112.cswrxs.log: 87.4% -- replaced with /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-25T02:22:49.698 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi112.fjnadi.log 2024-04-25T02:22:49.698 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-25T02:22:49.698 INFO:teuthology.orchestra.run.smithi112.stderr: 85.4% -- replaced with /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-25T02:22:49.698 INFO:teuthology.orchestra.run.smithi112.stderr: 91.2%/var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi112.fjnadi.log: -- replaced with /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-25T02:22:49.707 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-25T02:22:49.708 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-25T02:22:49.708 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-mon.smithi077.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-25T02:22:49.719 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-volume.log: /var/log/ceph/cephadm.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-25T02:22:49.726 INFO:teuthology.orchestra.run.smithi112.stderr: 91.0% -- replaced with /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-25T02:22:49.728 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-volume.log: /var/log/ceph/cephadm.log: 91.1% -- replaced with /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-25T02:22:49.748 INFO:teuthology.orchestra.run.smithi077.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-25T02:22:49.759 INFO:teuthology.orchestra.run.smithi112.stderr: 89.7% -- replaced with /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-mgr.smithi112.cswrxs.log.gz 2024-04-25T02:22:50.020 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-mgr.smithi077.zpflzp.log.gz 2024-04-25T02:22:50.055 INFO:teuthology.orchestra.run.smithi112.stderr: 92.6% -- replaced with /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-mon.smithi112.log.gz 2024-04-25T02:22:50.775 INFO:teuthology.orchestra.run.smithi077.stderr: 90.6% -- replaced with /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-mon.smithi077.log.gz 2024-04-25T02:22:54.547 INFO:teuthology.orchestra.run.smithi077.stderr: 93.5% -- replaced with /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-osd.2.log.gz 2024-04-25T02:22:55.122 INFO:teuthology.orchestra.run.smithi077.stderr: 94.9% -- replaced with /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi077.oadrkb.log.gz 2024-04-25T02:22:55.272 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-osd.0.log.gz 2024-04-25T02:22:55.339 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-osd.1.log.gz 2024-04-25T02:22:55.341 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-04-25T02:22:55.341 INFO:teuthology.orchestra.run.smithi077.stderr:real 0m5.665s 2024-04-25T02:22:55.341 INFO:teuthology.orchestra.run.smithi077.stderr:user 0m22.184s 2024-04-25T02:22:55.341 INFO:teuthology.orchestra.run.smithi077.stderr:sys 0m0.784s 2024-04-25T02:22:55.516 INFO:teuthology.orchestra.run.smithi112.stderr: 93.4% -- replaced with /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-osd.5.log.gz 2024-04-25T02:22:56.131 INFO:teuthology.orchestra.run.smithi112.stderr: 93.4% -- replaced with /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-osd.4.log.gz 2024-04-25T02:22:56.471 INFO:teuthology.orchestra.run.smithi112.stderr: 93.5% -- replaced with /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-osd.3.log.gz 2024-04-25T02:22:56.742 INFO:teuthology.orchestra.run.smithi112.stderr: 95.0% -- replaced with /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi112.fjnadi.log.gz 2024-04-25T02:24:16.410 INFO:teuthology.orchestra.run.smithi112.stderr: 92.5% -- replaced with /var/log/ceph/4bb93d82-02a7-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi112.dvwudt.log.gz 2024-04-25T02:24:16.412 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-04-25T02:24:16.412 INFO:teuthology.orchestra.run.smithi112.stderr:real 1m26.732s 2024-04-25T02:24:16.412 INFO:teuthology.orchestra.run.smithi112.stderr:user 1m49.661s 2024-04-25T02:24:16.412 INFO:teuthology.orchestra.run.smithi112.stderr:sys 0m3.395s 2024-04-25T02:24:16.412 INFO:tasks.cephadm:Archiving logs... 2024-04-25T02:24:16.413 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672363/remote/smithi077/log 2024-04-25T02:24:16.414 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T02:24:19.615 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672363/remote/smithi112/log 2024-04-25T02:24:19.616 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T02:24:38.481 INFO:tasks.cephadm:Removing cluster... 2024-04-25T02:24:38.481 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 --force 2024-04-25T02:24:39.068 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4bb93d82-02a7-11ef-bc93-c7b262605968 --force 2024-04-25T02:24:39.703 INFO:tasks.cephadm:Removing cephadm ... 2024-04-25T02:24:39.703 DEBUG:teuthology.orchestra.run.smithi077:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-25T02:24:39.720 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-25T02:24:39.736 INFO:tasks.cephadm:Teardown complete 2024-04-25T02:24:39.736 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T02:24:40.043 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T02:24:40.043 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T02:24:40.048 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T02:24:40.126 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T02:24:40.614 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T02:24:40.614 DEBUG:teuthology.orchestra.run.smithi077:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T02:24:40.620 DEBUG:teuthology.orchestra.run.smithi112:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T02:24:40.633 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2024-04-25T02:24:40.637 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T02:24:40.637 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2024-04-25T02:24:40.637 INFO:teuthology.orchestra.run.smithi077.stdout:^- hv01.front.sepia.ceph.com 2 7 377 105 +1779us[+1808us] +/- 572ms 2024-04-25T02:24:40.637 INFO:teuthology.orchestra.run.smithi077.stdout:^* hv02.front.sepia.ceph.com 3 7 377 42 -287us[ -256us] +/- 55ms 2024-04-25T02:24:40.638 INFO:teuthology.orchestra.run.smithi077.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 101 +329us[ +358us] +/- 61ms 2024-04-25T02:24:40.638 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:24:40.639 INFO:teuthology.orchestra.run.smithi112.stderr:bash: line 1: ntpq: command not found 2024-04-25T02:24:40.643 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T02:24:40.643 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2024-04-25T02:24:40.643 INFO:teuthology.orchestra.run.smithi112.stdout:^- hv01.front.sepia.ceph.com 2 6 377 39 +1788us[+1788us] +/- 573ms 2024-04-25T02:24:40.643 INFO:teuthology.orchestra.run.smithi112.stdout:^* hv02.front.sepia.ceph.com 3 6 377 45 -276us[ -248us] +/- 54ms 2024-04-25T02:24:40.643 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 44 +342us[ +342us] +/- 62ms 2024-04-25T02:24:40.643 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:24:40.644 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T02:24:40.949 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T02:24:40.949 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T02:24:41.077 DEBUG:teuthology.orchestra.run.smithi077:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T02:24:41.163 DEBUG:teuthology.orchestra.run.smithi112:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T02:24:41.244 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T02:24:41.274 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:24:41.275 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T02:24:41.305 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:24:41.306 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T02:24:41.330 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T02:24:41.347 INFO:teuthology.task.internal:Duration was 1937.525506 seconds 2024-04-25T02:24:41.347 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T02:24:41.394 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T02:24:41.395 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T02:24:41.400 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T02:24:41.436 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T02:24:41.440 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T02:24:41.770 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T02:24:41.770 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T02:24:41.771 DEBUG:teuthology.orchestra.run.smithi077:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T02:24:41.830 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi112.front.sepia.ceph.com 2024-04-25T02:24:41.830 DEBUG:teuthology.orchestra.run.smithi112:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T02:24:41.856 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T02:24:41.856 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T02:24:41.874 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T02:24:41.921 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T02:24:41.921 DEBUG:teuthology.orchestra.run.smithi077:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T02:24:41.939 DEBUG:teuthology.orchestra.run.smithi112:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T02:24:42.570 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T02:24:42.582 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T02:24:42.583 DEBUG:teuthology.orchestra.run.smithi077:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T02:24:42.606 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T02:24:42.631 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T02:24:42.643 DEBUG:teuthology.orchestra.run.smithi077:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:24:42.649 DEBUG:teuthology.orchestra.run.smithi112:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:24:42.668 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = core 2024-04-25T02:24:42.693 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = core 2024-04-25T02:24:42.705 DEBUG:teuthology.orchestra.run.smithi077:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:24:42.734 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:24:42.735 DEBUG:teuthology.orchestra.run.smithi112:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:24:42.765 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:24:42.765 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T02:24:42.777 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T02:24:42.778 DEBUG:teuthology.misc:Transferring archived files from smithi077:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672363/remote/smithi077 2024-04-25T02:24:42.778 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T02:24:42.825 DEBUG:teuthology.misc:Transferring archived files from smithi112:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672363/remote/smithi112 2024-04-25T02:24:42.825 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T02:24:42.864 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T02:24:42.865 DEBUG:teuthology.orchestra.run.smithi077:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T02:24:42.867 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T02:24:42.913 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T02:24:42.928 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T02:24:42.928 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T02:24:42.940 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T02:24:42.940 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T02:24:42.943 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T02:24:42.955 INFO:teuthology.orchestra.run.smithi077.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 02:24 /home/ubuntu/cephtest 2024-04-25T02:24:42.967 INFO:teuthology.orchestra.run.smithi112.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 02:24 /home/ubuntu/cephtest 2024-04-25T02:24:42.968 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T02:24:42.981 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T02:24:43.008 INFO:teuthology.nuke:Checking targets against current locks 2024-04-25T02:24:43.033 DEBUG:teuthology.nuke:shortname: smithi077 2024-04-25T02:24:43.034 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T02:24:43.056 DEBUG:teuthology.nuke:shortname: smithi112 2024-04-25T02:24:43.057 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T02:24:43.060 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672363', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 01:46:49.343101', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNiPBYem2L315tQD+IhE1fOSxEotITBoXUgKc1rgysRDbvkCxsMhj1zSuxQcFbVMI1ULi6K1eaQiYG2mxOFiyd8='} 2024-04-25T02:24:43.084 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672363', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 01:46:49.344569', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOyb6/xA4fcJng6PBDhcYIPEWBfUWzN7SEeld1a6SkG9xPYbOJoVO/QWpe6kPHVkytVZqRRK4qgJ7qmgSXQTcEY='} 2024-04-25T02:24:43.113 INFO:teuthology.orchestra.console.smithi077:Power off 2024-04-25T02:24:43.113 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T02:24:43.140 DEBUG:teuthology.orchestra.console.smithi077:power off output: Chassis Power Control: Down/Off 2024-04-25T02:24:43.140 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T02:24:43.155 INFO:teuthology.orchestra.console.smithi112:Power off 2024-04-25T02:24:43.156 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T02:24:43.165 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2024-04-25T02:24:43.178 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2024-04-25T02:24:43.178 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T02:24:43.201 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-04-25T02:24:47.166 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T02:24:47.202 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T02:24:47.278 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2024-04-25T02:24:47.314 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-04-25T02:24:51.281 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T02:24:51.315 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T02:24:51.392 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off 2024-04-25T02:24:51.425 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-04-25T02:24:51.493 INFO:teuthology.orchestra.console.smithi077:Power off completed 2024-04-25T02:24:51.526 INFO:teuthology.orchestra.console.smithi112:Power off completed 2024-04-25T02:24:51.630 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1937.5255055427551 failure_reason: '"1714011030.4741654 mon.smithi077 (mon.0) 945 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log' flavor: default owner: scheduled_teuthology@teuthology success: false 2024-04-25T02:24:51.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T02:24:51.729 INFO:teuthology.run:FAIL